Wireless camera and transmission method thereof

By introducing data acquisition, encoding, transmission and decoding modules into the wireless camera system, combining MPEG-4 video encoding and WiFi modules, lossless image transmission is realized, solving the problems of degradation in image quality and low efficiency in wireless camera transmission, and improving Image quality and transmission efficiency.

CN119094704AInactive Publication Date: 2024-12-06SHENZHEN CHUANGSHI GRAIN NETWORK CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411240859.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-05
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing wireless cameras cause image quality to decline, delay and lag problems during image transmission. The image quality after transmission is not as good as before transmission, and the transmission efficiency is low and the cost is high.

Method used

Using data acquisition module, data encoding module, data transmission module, data decoding module and video playback module, compressed encoding and decoding through MPEG-4 video encoding algorithm, combined with WiFi module for lossless transmission, ensuring the consistency of video signals before and after transmission , and real-time monitoring and adjustment through image quality analysis and alarm.

Benefits of technology

The image quality after wireless transmission is improved, making it clearer, improving transmission efficiency, reducing costs, ensuring the smoothness and picture quality of video playback, and solving the problems of delay and lag.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094704A_ABST
    Figure CN119094704A_ABST
Patent Text Reader

Abstract

The invention is applicable to the technical field of wireless transmission control of wireless cameras, and provides a wireless camera and a transmission method thereof, and the transmission method of the wireless camera is applied to a transmission control system of the wireless camera. Comprising a data acquisition module, a data coding module, a data transmission module, a data decoding module, a video playing module, a wireless communication module, an alarm, a memory, a processing center and a smart phone. The data acquisition module, the data coding module, the data transmission module, the data decoding module, the video playing module, the wireless communication module, the alarm and the memory are respectively connected with the processing center; the smart phone is in automatic networking connection with the wireless communication module within the range of a wireless network or the Internet; the invention also provides a wireless camera. According to the invention, lossless image transmission can be automatically controlled, the image quality effect is enhanced on the basis of the image quality before wireless transmission, and the image quality after wireless transmission is clearer than that of the original image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of wireless camera transmission control, and more specifically, relates to a wireless camera and a transmission method thereof. Background Art

[0002] The existing "An Image Transmission Processing Method and System (Publication No.: CN111182173B)" discloses a transmission control technology for a wireless camera pen. The server performs a table lookup according to the current environment to obtain the threshold required for the wireless camera pen to process the image, thereby ensuring the image quality of the wireless camera pen under different environmental factors. At the same time, the server adopts a threshold feedback process to improve the accuracy of the threshold setting. The wireless camera pen performs binarization and compression processing according to the threshold, thereby avoiding the wireless smart pen from executing an overly complex algorithm, solving the problem of the limited image processing capability of the wireless smart pen, and the compressed data is more convenient for real-time transmission. However, the image quality after wireless transmission is slightly inferior to that before transmission. Summary of the invention

[0003] In order to solve the deficiencies in the prior art, the purpose of the present invention is to provide a wireless camera and a transmission method thereof. By setting a data acquisition module, a data encoding module, a data transmission module, a data decoding module, and a video playback module, the lossless transmission of images can be automatically controlled, and the image quality effect is enhanced on the basis of the image quality before wireless transmission, so that the image quality after wireless transmission is clearer than the original image, thereby improving the transmission efficiency and reducing the transmission cost.

[0004] In order to achieve the above object, the technical solution adopted by the present invention is:

[0005] A transmission method for a wireless camera is applied to a transmission control system of a wireless camera, comprising a data acquisition module, a data encoding module, a data transmission module, a data decoding module, a video playback module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically networked with the wireless communication module within the range of a wireless network or the Internet;

[0006] The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet;

[0007] The alarm device compares the image quality information of the actual played video with the video play quality standard stored in the memory, and automatically sounds an audible alarm and notifies the user to re-decode and play the video if the quality does not meet the standard;

[0008] The memory is responsible for storing information of the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the video playback quality standard;

[0009] The processing center is responsible for the information transmission of the data acquisition module, data encoding module, data transmission module, data decoding module, video playback module, wireless communication module, alarm, and memory. It is the hub of the system and compares the image quality information of the actual played video with the video playback quality standard stored in the memory: if it meets the standard, it continues to play; if it does not meet the standard, it is transmitted to the alarm and notified to decode and play again;

[0010] The data acquisition module includes a photoelectric conversion unit, a charge integration unit, a voltage conversion unit, a digital conversion unit, and an image processing unit. The video signal is acquired through an image sensor and converted into a recognizable digital signal, and then transmitted to the data encoding module;

[0011] The data encoding module includes an object segmentation unit, a bit grouping unit, a network decomposition unit, a coding compression unit, a video decoding unit, a prediction coding unit, a video bit unit, an object coding unit, and an object construction unit, and is responsible for compressing and encoding the collected original video data according to the MPEG-4 video coding algorithm for storage and transmission, and passing it to the data transmission module;

[0012] The data transmission module includes a wireless conversion unit, a wireless transmission unit, and a data receiving unit, which are responsible for converting the encoded video data into wireless signals through the WiFi module and connecting to a router or access point through a wireless network, and transmitting the signals to the data decoding module;

[0013] The data decoding module includes a video reading unit, a positioning video unit, a decoding video unit, a format conversion unit, and an image processing unit. After receiving the video data transmitted by the camera through the user, the corresponding video decoding algorithm is used to decode the data into a playable video signal and pass it to the video playback module;

[0014] The video playback module includes an image decomposition unit, a decoding and restoration unit, a contrast enhancement unit, a histogram equalization unit, and an image quality unit, which are responsible for transmitting the decoded video signal through the screen of the video playback device, and viewing it in real time or recording and saving it through an application, so that wireless transmission can reach 720p and above high-definition standards within a range of 100 meters, solving problems such as delay, freeze, and low transmission quality during video playback, so that wireless video playback remains smooth and is transmitted to a processing center.

[0015] The present invention also provides a transmission method of a wireless camera, which is applied to a transmission control system of a wireless camera, and the method comprises the following steps:

[0016] S10, during video transmission, the data acquisition module obtains the video signal through the image sensor and converts it into a recognizable digital signal for subsequent transmission, and passes it to the data encoding module;

[0017] S20, the data encoding module compresses and encodes the collected original video data according to the MPEG-4 video encoding algorithm for storage and transmission, and transmits it to the data transmission module;

[0018] S30, the data transmission module converts the encoded video data into a wireless signal through the WiFi module and connects to a router or access point through the wireless network, and transmits it to the data decoding module;

[0019] S40, after receiving the video data transmitted by the camera through the user, the data decoding module uses a corresponding video decoding algorithm to decode the data into a playable video signal, and transmits it to the video playback module;

[0020] S50, the video playback module transmits the decoded video signal through the screen of the video playback device, and the decoded video signal is viewed in real time or recorded and saved through the application program, and then transmitted to the processing center;

[0021] S60: The processing center compares the image quality information of the actually played video with the video play quality standard stored in the memory: if the standard is met, the video continues to be played; if the standard is not met, the information is transmitted to the alarm and a re-decoding and re-playing notification is given.

[0022] Further, the step S10 comprises the following steps:

[0023] S11, the photoelectric conversion unit generates electrons through absorption by the set photosensitive element, and converts them into a corresponding amount of electric charge through jumping motion, and transmits them to the charge integration unit;

[0024] S12, the charge integration unit extracts the electrons from the photosensitive element through the integration operation circuit and gradually integrates the charge into the memory until the set integration time, and transmits it to the voltage conversion unit;

[0025] S13, the voltage conversion unit converts the charge into a voltage signal through a charge integrator, amplifies the voltage signal through an amplifier circuit, and transmits the voltage signal to a digital conversion unit;

[0026] S14, the digital conversion unit converts the amplified voltage signal into a digital signal through a digital-to-analog converter (ADC), and transmits the digital signal to the image processing unit;

[0027] S15. The image processing unit extracts, enhances, segments, recognizes and reconstructs three-dimensional images of digital signals through a digital signal processor so as to be stored, displayed or transmitted.

[0028] Further, the step S20 comprises the following steps:

[0029] S21, the object segmentation unit forms an independent video object (VO) by segmenting the characters, objects and background objects in the video content, and transmits the VO to the bit grouping unit;

[0030] S22, the bit grouping unit groups the video objects (VO) of the characters, objects, and background according to the YUV4:4:4 chrominance signal resolution format, and transmits the groups to the network decomposition unit;

[0031] S23, the network decomposition unit classifies each group into numerous network information packets and data fields of network frames according to the categories of people, objects and backgrounds, and transmits them to the encoding and compression unit;

[0032] S24, the coding and compression unit allocates different code rates to each network information packet according to the importance of the video object to perform intra-frame and inter-frame coding and compression to improve the compression ratio, and transmits the result to the video decoding unit;

[0033] S25, the video decoding unit reads input, decodes, and writes output of the video in units of frames. If normal, the decoding of the next frame is continued and passed to the prediction coding unit;

[0034] S26, the prediction coding unit performs motion estimation and predicted VOP coding based on motion compensation, closes the codec and releases memory space after completing hardware settings, and passes it to the video bit unit;

[0035] S27, the video bit unit performs bit stream processing of encoding mode selection, color signal sampling, and codec selection on the video after VOP encoding, and transmits it to the object encoding unit;

[0036] S28, the object encoding unit encodes each video object (VO) into a scalable (multi-layer) or non-scalable (single-layer) video stream according to application requirements, and transmits it to the object construction unit;

[0037] S29. The object construction unit reconstructs the video object layer (VOL) in a hierarchical manner through an enhanced hierarchical method to achieve visual or spatial grading of VO, which can be encoded into a multi-layer or single-layer video stream.

[0038] Further, the step S30 comprises the following steps:

[0039] S31, the wireless conversion unit is connected to the image video device through a suitable WiFi module to wirelessly transmit the video signal, and the client software is set to facilitate real-time video browsing and transmit it to the wireless sending unit;

[0040] S32, the wireless transmission unit converts the data field of the network frame into a wireless signal, and transmits the wireless signal to the visual playback device without loss, so as to ensure the consistency of the video information before and after transmission, and transmits the wireless signal to the data receiving unit;

[0041] S33, the data receiving unit is connected to the same network via WiFi through a smartphone or computer, and accesses the IP address of the camera through the corresponding camera application or web page.

[0042] Further, the step S40 comprises the following steps:

[0043] S41, the video reading unit opens the video file through the avformat_open_input function and reads the video header information, and passes it to the positioning video unit;

[0044] S42, the positioning video unit obtains the required video stream data according to the multimodal fusion data algorithm calculation formula "G(E,R,P)=∑e∈EWe(Pe)+∑r∈R Wr(Cr)+∑p∈P Wp(Vp), G is the knowledge graph, E is the entity set, R is the relationship set, P is the attribute set, We, Wr, Wp are the weights of the entity, relationship, and attribute respectively, Pe, Cr, Vp are the attribute value of the entity, the connection value of the relationship, and the value of the attribute respectively" and passes it to the decoding video unit;

[0045] S43, the decoding video unit sends a data packet to the decoder through dedicated software for real-time decoding and receives the decoded frame data, and transmits it to the image conversion unit;

[0046] S44, the format conversion unit calculates the formula "H = -∑P(x)log2P(x), H is entropy, P(x) is the probability of character x" through the Huffman decompression algorithm to obtain the amount of information before data compression, and restores it to the video information before compression according to the number, so that the video before and after wireless transmission is consistent, and transmits it to the image processing unit;

[0047] S45, the image processing unit performs color space conversion, scaling preprocessing, image analysis and encoding on the decoded frame data to meet different display or application requirements.

[0048] Further, the step S50 comprises the following steps:

[0049] S51, the image decomposition unit decodes the obtained compressed video data into a continuous image sequence through a decoder for subsequent rendering operations, and transmits the image sequence to a decoding and restoration unit;

[0050] S52, the digital / analog converter of the decoding and restoration unit decodes and converts the digital video signal into an analog signal, converts the color and brightness information of the image into an electrical signal, and transmits it to the contrast enhancement unit;

[0051] S53, the contrast enhancement unit enhances the pixel according to the contrast enhancement transformation calculation formula "y=ax+b, x and y are the pixel values ​​of the two-dimensional matrix image, a and b are the contrast and brightness respectively", and transmits it to the histogram equalization unit;

[0052] S54, the histogram equalization unit calculates the value of the histogram according to the formula "y=(y max -y min ) / (x max -x min )*(xx min )+y min ,x,y are the input and output pixel values ​​respectively, max 、x min are the maximum and minimum input pixel values, respectively, max ,y min The output enhanced image is obtained for the maximum and minimum output pixel values ​​respectively, and is passed to the image quality unit;

[0053] S55. The image quality unit obtains real-time image quality information through a set image quality analyzer so as to subsequently judge the quality level of the image.

[0054] A transmission control system for a wireless camera provided by the present invention also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and when the various functional modules execute the computer program, the steps of the transmission method for a wireless camera described in any one of the above are implemented; the computer-readable storage medium stores a computer program, and when the computer program is executed by the various functional modules, the steps of the transmission method for a wireless camera described in any one of the above are implemented.

[0055] The present invention also provides a wireless camera, which is implemented by the above-mentioned transmission method of the wireless camera.

[0056] The beneficial effects of the present invention compared with the prior art are as follows:

[0057] By setting up data acquisition module, data encoding module, data transmission module, data decoding module and video playback module, the lossless transmission of images can be automatically controlled. The image quality effect is enhanced based on the image quality before wireless transmission, and the image quality after wireless transmission is clearer than the original image, thereby improving transmission efficiency and reducing transmission costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or exemplary technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0059] Figure 1 It is a schematic diagram of the system module of the present invention;

[0060] Figure 2 It is a schematic diagram of a data acquisition module of the present invention;

[0061] Figure 3 It is a schematic diagram of a data encoding module of the present invention;

[0062] Figure 4 It is a schematic diagram of a data transmission module of the present invention;

[0063] Figure 5 It is a schematic diagram of a data decoding module of the present invention;

[0064] Figure 6 It is a schematic diagram of a video playback module of the present invention;

[0065] Figure 7 It is a schematic diagram of the method flow of the present invention;

[0066] Figure 8 This is a schematic diagram of the process decomposition of step S10 in the method flow of the present invention;

[0067] Fig. 9 This is a schematic diagram of the process decomposition of step S20 in the method flow of the present invention;

[0068] Fig.10 This is a schematic diagram of the process decomposition of step S30 in the method flow of the present invention;

[0069] Fig.11 This is a schematic diagram of the process decomposition of step S40 in the method flow of the present invention;

[0070] Fig.12 It is a schematic diagram of the program decomposition of step S50 in the method flow of the present invention. DETAILED DESCRIPTION

[0071] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0072] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments:

[0073] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0074] It should be noted that when a module is referred to as being "disposed" or "disposed on" another module, it can be directly on the other module or indirectly on the other module. When a module is referred to as being "connected to" or "connected to" another module, it can be directly connected to the other module or indirectly connected to the other module.

[0075] In the description of this application, "multiple" means two or more, unless otherwise clearly and specifically defined. "Several" means one or more, unless otherwise clearly and specifically defined.

[0076] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0077] Please refer to Figure 1 As shown, the present invention provides a transmission method for a wireless camera, which is applied to a transmission control system of a wireless camera, including a data acquisition module, a data encoding module, a data transmission module, a data decoding module, a video playback module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically networked with the wireless communication module within the range of a wireless network or the Internet.

[0078] The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet.

[0079] The alarm compares the image quality information of the actually played video with the video play quality standard stored in the memory, and automatically sounds an audible alarm and notifies to re-decode and play if the standard is not met.

[0080] Further explanation: the video playback quality standards include: resolution of 720p or above, frame rate of 24fps or above, encoding format meeting the requirements, bit rate of 360p or 480p video greater than or equal to 0.8Mbps, bit rate of 720p video greater than 1.5Mbps, bit rate of 1080p video greater than 2.5Mbps, bit rate of 4K video is 12Mbps, sound is clear, and volume is balanced.

[0081] The memory is responsible for storing information of the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the video playback quality standard.

[0082] The processing center is responsible for information transmission among the data acquisition module, data encoding module, data transmission module, data decoding module, video playback module, wireless communication module, alarm, and memory. It is the hub of the system and compares the image quality information of the actual played video with the video playback quality standard stored in the memory: if the standard is met, the playback continues; if the standard is not met, the information is passed to the alarm and notified to decode and play again.

[0083] See also Figure 2 As shown, the data acquisition module includes a photoelectric conversion unit, a charge integration unit, a voltage conversion unit, a digital conversion unit, and an image processing unit. The video signal is acquired through an image sensor and converted into a recognizable digital signal, and then transmitted to the data encoding module.

[0084] Furthermore, the photoelectric conversion unit generates electrons through absorption by the set photosensitive element, and converts them into a corresponding number of charges through jumping motion, and transmits them to the charge integration unit; the charge integration unit extracts the electrons from the photosensitive element through the integration operation circuit and gradually integrates the charges into the memory until the set integration time, and transmits them to the voltage conversion unit; the voltage conversion unit converts the charges into voltage signals through the charge integrator, amplifies them through the amplification circuit, and transmits them to the digital conversion unit; the digital conversion unit converts the amplified voltage signal into a digital signal through a digital-to-analog converter (ADC), and transmits it to the image processing unit; the image processing unit extracts, enhances, segments, recognizes and reconstructs three-dimensional stereo images of the digital signals through a digital signal processor so that they can be stored, displayed or transmitted.

[0085] See also Figure 3 As shown, the data encoding module includes an object segmentation unit, a bit grouping unit, a network decomposition unit, a coding compression unit, a video decoding unit, a predictive coding unit, a video bit unit, an object coding unit, and an object construction unit, which is responsible for compressing and encoding the collected original video data according to the MPEG-4 video coding algorithm for storage and transmission, and passing it to the data transmission module.

[0086] Furthermore, the object segmentation unit forms independent video objects (VO) by segmenting the objects of people, objects and background in the video content, and transmits them to the bit grouping unit; the bit grouping unit groups the video objects (VO) of people, objects and background according to the chrominance signal resolution format of YUV4:4:4, and transmits them to the network decomposition unit; the network decomposition unit classifies each group into countless network information packets and data fields of their network frames according to the categories of people, objects and background, and transmits them to the encoding and compression unit; the encoding and compression unit assigns different bit rates to each network information packet according to the importance of the video object, performs intra-frame and inter-frame encoding compression to improve the compression ratio, and transmits it to the video decoding unit; the video decoding unit reads the video input, decodes and writes the video input in units of frames The work done is carried out, and if it is normal, the next frame decoding is continued to be called and passed to the prediction coding unit; the prediction coding unit performs motion estimation and predicted VOP encoding based on motion compensation, closes the codec and releases the memory space after completing the hardware setting, and passes it to the video bit unit; the video bit unit performs bit stream processing of encoding mode selection, color signal sampling, and codec selection on the video after VOP encoding, and passes it to the object encoding unit; the object encoding unit encodes each video object (VO) into a scalable (multi-layer) or non-scalable (single-layer) video stream according to application requirements, and passes it to the construction object unit; the construction object unit reconstructs the video object layer (VOL) in a hierarchical manner through an enhanced hierarchical method to achieve visual or spatial classification of VO, which can be encoded into a multi-layer or single-layer video stream.

[0087] See also Figure 4 As shown, the data transmission module includes a wireless conversion unit, a wireless transmission unit, and a data receiving unit, which are responsible for converting the encoded video data into wireless signals through the WiFi module and connecting to a router or access point through a wireless network, and transmitting them to the data decoding module.

[0088] Furthermore, the wireless conversion unit is connected to the image video device through a suitable WiFi module to wirelessly transmit the video signal, and the client software is set to facilitate real-time video browsing, and the video is transmitted to the wireless sending unit; the wireless sending unit converts the data field of the network frame into a wireless signal, and realizes wireless lossless transmission to the visual playback device to ensure the consistency of the video information before and after transmission, and transmits it to the data receiving unit; the data receiving unit is connected to the same network through WiFi through a smart phone or computer, and accesses the IP address of the camera through the corresponding camera application or web page.

[0089] See also Figure 5As shown, the data decoding module includes a video reading unit, a positioning video unit, a decoding video unit, a format conversion unit, and an image processing unit. After the user receives the video data transmitted by the camera, the corresponding video decoding algorithm is used to decode the data into a playable video signal and pass it to the video playback module.

[0090] Further, the video reading unit opens the video file through the avformat_open_input function and reads the video header information, and passes it to the positioning video unit; the positioning video unit calculates the multimodal fusion data algorithm according to the formula "G(E,R,P)=∑e∈E We(Pe)+∑r∈RWr(Cr)+∑p∈P Wp(Vp), G is the knowledge graph, E is the entity set, R is the relationship set, P is the attribute set, We, Wr, Wp are the weights of the entity, relationship, and attribute respectively, Pe, Cr, Vp are the attribute value of the entity, the connection value of the relationship, and the value of the attribute respectively" to obtain the required video stream data and pass it to the decoding video unit; the decoding video unit sends the data packet to the decoder through special software for real-time decoding and receives the decoded frame data, and passes it to the format conversion unit; the format conversion unit obtains the amount of information before data compression through the Huffman decompression algorithm calculation formula "H=-∑P(x)log2P(x), H is entropy, P(x) is the probability of character x", and restores it to the video information before compression according to the number, so that the video consistency before and after wireless transmission is achieved, and passes it to the image processing unit; the image processing unit performs color space conversion, scaling preprocessing, image analysis and encoding on the decoded frame data to adapt to different display or application requirements.

[0091] See also Figure 6 As shown, the video playback module includes an image decomposition unit, a decoding and restoration unit, a contrast enhancement unit, a histogram equalization unit, and an image quality unit, which are responsible for transmitting the decoded video signal through the screen of the video playback device, and real-time viewing or recording and saving through the application program, so that wireless transmission to 720p and above high-definition standards within a range of 100 meters can be achieved, solving the problems of delay, freeze, low transmission quality, etc. during video playback, so that the wireless video playback remains smooth and is transmitted to the processing center.

[0092] Furthermore, the image decomposition unit decodes the acquired compressed video data into a continuous image sequence through a decoder for subsequent rendering operations, and transmits it to the decoding and restoration unit; the digital / analog converter of the decoding and restoration unit decodes and converts the digital video signal into an analog signal, and converts the color and brightness information of the image into an electrical signal, and transmits it to the contrast enhancement unit; the contrast enhancement unit enhances the pixel according to the contrast enhancement transformation calculation formula "y=ax+b, x, y are the pixel values ​​of the two-dimensional matrix image, a, b are the contrast and brightness respectively", and transmits it to the histogram equalization unit; the histogram equalization unit obtains the output enhanced image according to the histogram calculation formula "y=(ymax-ymin) / (xmax-xmin)*(x-xmin)+ymin, x, y are the input and output pixel values ​​respectively, xmax, xmin are the maximum and minimum values ​​of the input pixel value respectively, ymax, ymin are the maximum and minimum values ​​of the output pixel value respectively", and transmits it to the image quality unit; the image quality unit obtains real-time image quality information through the set image quality analyzer, so as to judge the quality level of the image later.

[0093] How the system works:

[0094] During video transmission, the data acquisition module obtains the video signal through the image sensor and converts it into a recognizable digital signal, and passes it to the data encoding module; the data encoding module compresses and encodes the collected original video data according to the MPEG-4 video encoding algorithm for easy storage and transmission, and passes it to the data transmission module; then the data transmission module converts the encoded video data into a wireless signal through the WiFi module and connects to a router or access point through a wireless network, and passes it to the data decoding module; the control data decoding module uses the corresponding video decoding algorithm to decode the data into a playable video signal after receiving the video data transmitted by the camera from the user, and passes it to the video playback module; the video playback module transmits the decoded video signal through the screen of the video playback device, and uses the application to watch it in real time or record and save it, and passes it to the processing center; the control processing center compares the image quality information of the actual played video with the video playback quality standard stored in the memory: if it meets the standard, it continues to play; if it does not meet the standard, it is passed to the alarm and notified to re-decode and play.

[0095] When staff or managers are outdoors or away from home, they can use their smartphones to automatically connect to the wireless communication module within the range of a wireless network or the Internet to control or monitor the operation of the wireless camera, thereby achieving automated and intelligent control, improving the camera's operating efficiency, and reducing the cost of camera monitoring.

[0096] See also Figure 7As shown, the present invention also provides a transmission method of a wireless camera, which is applied to a transmission control system of a wireless camera, and the method comprises the following steps:

[0097] S10: During video transmission, the data acquisition module obtains the video signal through the image sensor and converts it into a recognizable digital signal for subsequent transmission and passes it to the data encoding module.

[0098] See also Figure 8 As shown, the step S10 comprises the following steps:

[0099] S11, the photoelectric conversion unit generates electrons through absorption by the set photosensitive element, and converts them into a corresponding amount of electric charge through jumping motion, and transmits them to the charge integration unit;

[0100] To further explain, when light shines on the photosensitive array of the image sensor, the photons will be absorbed by photosensitive elements such as photodiodes or metal oxide semiconductor field effect transistors, and the electrons in the photosensitive material will be excited through the surface of the photosensitive element to form photogenerated carrier pairs, which will be transferred to the photosensitive area below the surface under the action of the electric field, and then converted into a jumping motion and then form an electrical signal. The photosensitive element or photosensitive pixel receives the external light signal, that is, converts the received light energy into electrical energy to form a video signal, and converts the photons incident on the photosensitive pixel into a corresponding number of charges through a photoelectric conversion device.

[0101] S12, the charge integration unit extracts the electrons from the photosensitive element through the integration operation circuit and gradually integrates the charge into the memory until the set integration time, and transmits it to the voltage conversion unit;

[0102] It is further explained that when photons are absorbed by the photosensitive element, the photosensitive element converts the photons into electrons, which are collected by the integral operation circuit and exported from the photosensitive element by controlling the potential. As the chip receives external photoelectrons, the charges are stored and transferred out of the photosensitive area in a certain order, ensuring that the charges can be processed and transmitted in an orderly manner. The photocharges accumulate in the photosensitive area, and the amount is proportional to the light intensity. The charges are transmitted to the output node along the charge transfer path by moving charges or photocharge potential wells, and the charges are amplified into voltage signals by the amplifier circuit.

[0103] S13, the voltage conversion unit converts the charge into a voltage signal through a charge integrator, amplifies the voltage signal through an amplifier circuit, and transmits the voltage signal to a digital conversion unit;

[0104] It is further explained that the gain is added through the pre-amplifier circuit to enhance the signal, and the signal is processed and adjusted through circuits such as signal enhancement, noise removal, and color correction to ensure the quality and stability of the video. After the processing, the signal obtained is raised to a standard level and can be recorded on a video recording device or sent to a monitoring display through a transmission system for observation and monitoring. Through circuit processing such as orderly transfer of electric charge, the image information is converted into a form that can be recorded and transmitted, and finally converted into an electrical signal to ensure the accuracy and stability of the signal.

[0105] S14, the digital conversion unit converts the amplified voltage signal into a digital signal through a digital-to-analog converter (ADC), and transmits the digital signal to the image processing unit;

[0106] To explain further, the light image of the scene is focused on the photosensitive or photoconductive target surface of the camera tube, and the excitation of photoelectrons or the change of photoconductivity at each point on the target surface varies with the brightness of each point of the light image; when the target surface is scanned with an electron beam, an electrical signal with an amplitude proportional to the brightness of the light image of the scene at each point is generated, which is transmitted to the television receiver so that the scanning electron beam of the cathode ray tube screen varies with the strength of the input signal; since non-electrical physical quantities can be easily converted into electrical signals through various sensors, and electrical signals are easy to transmit and control, they become the most widely used signals; the voltage or current of the electrical signal that changes with time can be expressed as a function of time, and its waveform can be drawn, and information is transmitted, exchanged, stored, and extracted through electrical signals.

[0107] S15. The image processing unit extracts, enhances, segments, recognizes and reconstructs three-dimensional images of digital signals through a digital signal processor so as to be stored, displayed or transmitted.

[0108] It is further explained that useful information is extracted from complex signals and required signal components are extracted from noise through filters and their algorithms; the characteristics of the signals are highlighted and the signal-to-noise ratio is improved by amplifying and filtering the signals, making the signals easier to identify and process; based on the intensity, color, texture and other characteristics of pixels, the image is divided into different parts or different areas or objects by setting thresholds or other segmentation algorithms; on the basis of extraction, enhancement and segmentation, the processed signals or image contents can be identified by object recognition, scene recognition and other identification through pattern recognition algorithms, making the processing of signals and images more accurate and efficient.

[0109] S20, the data encoding module compresses and encodes the collected original video data according to the MPEG-4 video encoding algorithm for storage and transmission, and transmits it to the data transmission module;

[0110] See also Fig. 9 As shown, the step S20 comprises the following steps:

[0111] S21, the object segmentation unit forms an independent video object (VO) by segmenting the characters, objects and background objects in the video content, and transmits the VO to the bit grouping unit;

[0112] It is further explained that decoding initialization is performed, including opening the file, setting hardware parameters such as the codec and DMA, initializing decoding parameters such as frame count, baud rate setting, decoding initial position, and applying for address space; based on object-based video coding (OBVC), the video image is divided into different objects or moving objects are separated from the background, allowing different encoding methods to be used for different video objects, thereby greatly improving the compression ratio and allowing users to interactively operate multimedia data according to content; object extraction is performed after object division, and the high-order statistical characteristics of displacement frame difference (DFD) and change detection methods in automatic segmentation methods such as mathematical morphology operators are used for video sequences with static backgrounds; for human-computer interaction, a rough outline of the video object is given by human-computer interaction at the initial stage, and then the system refines the outline, and uses automatic tracking methods in subsequent frames for semi-automatic object segmentation, and people can monitor the entire extraction process through the interface and correct the errors caused by the algorithm when necessary.

[0113] S22, the bit grouping unit groups the video objects (VO) of the characters, objects, and background according to the YUV4:4:4 chrominance signal resolution format, and transmits the groups to the network decomposition unit;

[0114] Further explanation: the YUV4:4:4 chrominance signal resolution format grouping is that each pixel contains three components of Y (brightness), U (red), and V (blue). For every 4-point Y sampling, there are corresponding 4-point U and 4-point V belonging to the same group, that is, each Y value corresponds to a U and a V value, and so on. The resolution format of the chrominance signal is the same as that of the luminance signal, avoiding the reduction of picture quality during the processing process; the target value is confirmed by counting the values ​​corresponding to each bit in the group, and the corresponding numbers are respectively given to indicate the division, and then grouping is performed one by one according to the values ​​corresponding to each bit in the group.

[0115] S23, the network decomposition unit classifies each group into numerous network information packets and data fields of network frames according to the categories of people, objects and backgrounds, and transmits them to the encoding and compression unit;

[0116] It is further explained that by setting a data packet that identifies image information and has no compression capacity as a network information packet, it is ensured that the data information is in a lossless state before being sent, including image information packets of countless network frames, wherein the image information packet includes a 2-byte image resolution row valid number, a 2-byte image resolution column valid number, a 4-byte correspondence between the index number and the value of the brightness component bit, and a 4-byte chrominance component bit; an identifier is added to the network information packet corresponding to the same row or column in the source image, and is filled into the data field of the network frame in sequence according to the sequence of the bits.

[0117] S24, the coding and compression unit allocates different code rates to each network information packet according to the importance of the video object to perform intra-frame and inter-frame coding and compression to improve the compression ratio, and transmits the result to the video decoding unit;

[0118] To explain further, start the compression software on the computer and select video compression in the function panel on the left, then click the Add File button to import the local MPEG-4 video file into the application; after importing the video, click the Settings button in the thumbnail, and in the new pop-up window you can customize the video bit rate, frame rate and other parameters to control the output size and quality of the video, and you can also directly drag the compression bar to control the output file volume; after the settings are completed, click OK and the settings will be automatically applied to the video, and then the video will return to the main interface, click the Compression button to start compression or batch compression, you can complete the compression of multiple files at one time, and assign different bit rates according to the importance of the object, allocating more bytes to important objects and fewer bytes to secondary objects to improve the compression ratio.

[0119] S25, the video decoding unit reads input, decodes, and writes output of the video in units of frames. If normal, the decoding of the next frame is continued and passed to the prediction coding unit;

[0120] To further explain, the time the current audio has been played is calculated through parameters such as the audio sampling rate and the number of samples contained in each frame, and the number of frames that the video should play is calculated through the FPS of the video. If the current number of frames actually played is greater than or equal to the number of frames that should be played, the video playback will not be executed during scheduling until the audio has played enough frames and a new demand for video playback is generated. The playback program will continue, thereby effectively controlling the video playback speed; when playing some video files with fast screen switching, the system may not have time to decode the video. In order to make the video catch up with the audio, some video frames may need to be discarded. Due to the characteristics of MPEG-4, the decoding results of other frames except key frames must depend on the decoding results of the previous frame. Therefore, only a part of each frame YUV conversion and LCD output is discarded. When the number of frames that need to be played is greater than the actual number of video frames that have been played plus the number of buffers, it is considered that the system cannot decode enough video frames.

[0121] S26, the prediction coding unit performs motion estimation and predicted VOP coding based on motion compensation, closes the codec and releases memory space after completing hardware settings, and passes it to the video bit unit;

[0122] It is further explained that by performing motion estimation on each VOP (video object plane) and predicting the position and motion of objects in the video sequence, the movement of video objects between consecutive frames is determined so that subsequent frames can be predictively encoded; each VOP is predicted based on the results of motion estimation, and the continuity of the position and motion of objects in the video sequence is utilized. A predicted image is generated by comparing the difference between the current frame and the reference frame, which helps to reduce the size of video data and thus improve compression efficiency; the prediction error of the predicted data is quantized, transformed, and entropy encoded to reduce the size of the data and prepare for transmission or storage, and quantization technology and DCT transform are used to convert image data into frequency domain representation, which is compressed through entropy coding (such as Huffman coding); the binary scene format (BIFS) is used to describe the spatial and temporal positions of audio and video objects in the scene and the relationship between them, so that the visual object sequence (VO) is an MPEG-4 scene, including natural objects or synthetic objects and their enhancement layers.

[0123] S27, the video bit unit performs bit stream processing of encoding mode selection, color signal sampling, and codec selection on the video after VOP encoding, and transmits it to the object encoding unit;

[0124] Further explanation: since in the bit stream, each visual object sequence (VO) is a complete scene layer containing shape information, motion information, and texture information, the shape, motion, and texture information of the same VO are encoded into a separate video object layer (VOL) to achieve visual or spatial grading of VO; in the non-separable grading coding, a hybrid DCT and DPCM coding is used as the basis to add a macroblock structure, motion compensation and inter-frame prediction coding method, and also introduces motion compensation field prediction such as inter-field prediction of field images and inter-field prediction of frame images that support interlaced video. Prediction mode, effectively encodes field images and frame images; supports multiple color signal sampling modes such as 4:2:0 mode, 4:2:2 mode, 4:4:4 mode, etc., and provides different sample point ratios of color signals and brightness signals to meet different video quality and performance requirements; provides two codec options of H.264 and HEVC (High Efficiency Video Coding or H.265). When adding to a job, H.264 is selected as the codec by default. If the computer is running macOS10.13 or later, the codec will be changed to HEVC.

[0125] S28, the object encoding unit encodes each video object (VO) into a scalable (multi-layer) or non-scalable (single-layer) video stream according to application requirements, and transmits it to the object construction unit;

[0126] To further explain, since a video object (VO) is an independent unit composed of many frames that are continuous in time, it depends on the application of the tool and the actual environment in which the system is located. In the case of ultra-low bit rate, VO is a rectangular frame, which is compatible with MPEG-1 and H.263, while in content-based applications, VO is an object in the scene or a two-dimensional or three-dimensional graphic generated by a computer. Since the physical objects such as people and objects in the scene are identified and divided into multiple video objects (VO), they are processed independently according to their shape, position, movement and other characteristics. Each video object (VO) is represented as a series of video object planes (VOPs). The basic unit includes the motion information, shape information and texture information of the video object, which together define the appearance and motion state of the video object; a shape coding algorithm is introduced to allow the shape of the video object to be encoded, including binary shape information and grayscale shape information, including the transparency and specific shape of the video object, and uses motion compensation-based technology for lossless or lossy encoding. It also includes texture information on the appearance of the video object and motion information on the motion state of the object in the video. Its information coding is the core part of its video compression and determines the quality and compression efficiency of the video; the encoder is configured according to specific encoding requirements to optimize the encoding process.

[0127] S29. The object construction unit reconstructs the video object layer (VOL) in a hierarchical manner through an enhanced hierarchical method to achieve visual or spatial grading of VO, which can be encoded into a multi-layer or single-layer video stream.

[0128] It is further explained that the original video / image data is simplified through low-pass filtering, median filtering, morphological filtering and other operations to facilitate video object segmentation; the video / image data after segmentation is extracted with features such as color, texture, motion, frame difference, displacement frame difference, and semantics; the video data is classified according to the extracted features, and the segmentation decision is determined based on a certain uniformity standard; relevant subsequent processing is performed to filter out noise and accurately extract boundaries to complete the creation of the video object layer.

[0129] S30, the data transmission module converts the encoded video data into a wireless signal through the WiFi module and connects to a router or access point through the wireless network, and transmits it to the data decoding module;

[0130] See also Fig.10 As shown, the step S30 comprises the following steps:

[0131] S31, the wireless conversion unit is connected to the image video device through a suitable WiFi module to wirelessly transmit the video signal, and the client software is set to facilitate real-time video browsing and transmit it to the wireless sending unit;

[0132] To further explain, select a WiFi module suitable for image and video transmission, with high-definition video transmission capabilities, support NTSC or PAL formats, and use image compression formats such as H.264 or MJPEG to ensure video quality; connect the WiFi module to the image and video device, and set the working mode, SSID, password and other configurations of the WiFi module, as well as expansion ports such as GPIO and serial ports, to facilitate communication and control with other devices; after the connection and configuration are completed, a test needs to be performed to ensure that the video signal can be successfully transmitted through WiFi, and according to the test results, the transmission parameters need to be adjusted to optimize the video quality; in order to facilitate the monitoring and management of the transmitted video stream, use the client software on the mobile device to allow real-time browsing of the video stream, screenshots, storage of videos, and sending of control signals.

[0133] S32, the wireless transmission unit converts the data field of the network frame into a wireless signal, and transmits the wireless signal to the visual playback device without loss, so as to ensure the consistency of the video information before and after transmission, and transmits the wireless signal to the data receiving unit;

[0134] It is further explained that the wireless network video signal received through the wireless network is converted into a network information data packet video signal, and the high-definition video wireless signal is collected according to relevant instructions, and is optimized and restored to the original video wireless signal, and then decrypted into open video information through the dynamic host configuration protocol according to the original video wireless signal, and converted into color video information; and compared with the original color video information stored in the memory: if it is consistent, it will continue to be transmitted; if it is inconsistent, the video information will continue to be restored until it is consistent with the pre-stored color video.

[0135] S33, the data receiving unit is connected to the same network via WiFi through a smartphone or computer, and accesses the IP address of the camera through the corresponding camera application or web page.

[0136] To further explain, it is necessary to initialize the relevant libraries or systems, use the socket function to create a socket, use the setsockopt function to set the socket's IP address, port number and other properties, use the bind function to bind the IP address, port and other information to the socket so that it can listen to a specific port; use the listen function to start listening and wait for the client's connection request; use the accept function to receive the client's connection request, and once a client requests a connection, the server will accept the connection; once the connection is established, the server can receive the data sent by the client, and the received data may need to be decompressed in order to be displayed correctly; decompress and display the received data by creating a window or using specific display technology.

[0137] S40, after receiving the video data transmitted by the camera through the user, the data decoding module uses a corresponding video decoding algorithm to decode the data into a playable video signal, and transmits it to the video playback module;

[0138] See also Fig.11 As shown, the step S40 comprises the following steps:

[0139] S41, the video reading unit opens the video file through the avformat_open_input function and reads the video header information, and passes it to the positioning video unit;

[0140] To further explain, through AVFormatContext memory allocation, the encapsulation format of the video file is detected, and the video source is loaded into the internal buffer. If it is a network streaming video, connection and socket work will be performed, loaded into the internal buffer, and after reading the video header information, you can call API such as av_dump_format to print the file's file length, bit rate, fps, encoding format and other basic information.

[0141] S42, the positioning video unit obtains the required video stream data according to the multimodal fusion data algorithm calculation formula "G(E,R,P)=∑e∈E We(Pe)+∑r∈R Wr(Cr)+∑p∈P Wp(Vp), G is the knowledge graph, E is the entity set, R is the relationship set, P is the attribute set, We, Wr, Wp are the weights of the entity, relationship, and attribute respectively, Pe, Cr, Vp are the attribute value of the entity, the connection value of the relationship, and the value of the attribute respectively" and passes it to the decoding video unit;

[0142] It is further explained that the information of different frequency, sound, infrared and other sensors can be fused through the multi-sensor data fusion algorithm to more comprehensively describe the situation and characteristics in the video stream and improve the effect of video analysis; and the multi-modal fusion algorithm can integrate and utilize data of different modes to improve the accuracy and robustness of video stream analysis, including multiple forms of data such as multi-channel video stream data, audio data, subtitle data, or multiple modes of data such as image and sensor data, context information, semantic information, etc.; by adopting parallel computing and acceleration algorithms, or optimization algorithms and pruning strategies, etc., the processing time of video stream analysis can be reduced, the real-time performance can be improved, and at the same time, the amount of calculation and memory consumption can be reduced to achieve efficient video stream analysis.

[0143] S43, the decoding video unit sends a data packet to the decoder through dedicated software for real-time decoding and receives the decoded frame data, and passes it to the format conversion unit;

[0144] To further explain, all available codecs and formats are registered through the av_register_all function, the input video file is opened with the avformat_open_input function, and the video header information such as the file's encapsulation format and video stream information is read; the stream information in the video file is obtained through the avformat_find_stream_info function, and the appropriate decoder is found using the avcodec_find_decoder function according to the obtained encoding format; the decoder is opened through the avcodec_open2 function, and a frame of compressed data is read from the input file using the av_read_frame function; the compressed data read is decoded through the avcodec_decode_video2 function and converted into pixel data, and after decoding, the decoder and input file are closed through the avcodec_close and avformat_close_input functions.

[0145] S44, the format conversion unit calculates the formula "H = -∑P(x)log2P(x), H is entropy, P(x) is the probability of character x" through the Huffman decompression algorithm to obtain the amount of information before data compression, and restores it to the video information before compression according to the number, so that the video before and after wireless transmission is consistent, and transmits it to the image processing unit;

[0146] It is further explained that the Huffman decompression algorithm is a lossless compression algorithm, which assigns a binary code to each character, frequently appearing characters are assigned shorter codes, and less common characters are assigned longer codes; the decoded video frames may need to be converted into formats (for example: from the original pixel format to a more commonly used format such as RGB), and the input and output pixel formats, conversion algorithm types and other conversion parameters are set, including: determining the converted target format such as MP4, AVI, WMV, etc., and performing video editing such as clipping, adding subtitles, adjusting size, and coloring as needed; setting the output format, address, storage location, resolution, bit rate, encoding method and other parameters to determine the quality and file size of the output video; the conversion software will convert the video according to the set parameters and format, and after completion, the user can find the converted video file at the specified location.

[0147] S45, the image processing unit performs color space conversion, scaling preprocessing, image analysis and encoding on the decoded frame data to meet different display or application requirements.

[0148] It is further explained that the format-converted image is preprocessed by color space conversion, binarization, filtering, pyramid, extraction, geometric transformation, morphological transformation, edge detection, etc., in order to improve the image quality, reduce processing time, and increase processing accuracy; feature extraction, segmentation, matching and recognition operations are performed on the preprocessed image to ensure the image quality and the preprocessing effect; the processed image is encoded for storage or transmission, for example: the encoding process of the PNG image includes converting the original image into RGB or grayscale color mode, filtering and compressing each pixel, and storing the compressed binary code as a PNG file.

[0149] S50, the video playback module transmits the decoded video signal through the screen of the video playback device, and the application is used to watch in real time or record and save, so that the wireless transmission can reach 720p and above high-definition standards within a range of 100 meters, which solves the problems of delay, freeze, low transmission quality during video playback, so that the wireless video playback remains smooth and is transmitted to the processing center;

[0150] See also Fig.12 As shown, the step S50 comprises the following steps:

[0151] S51. The image decomposition unit decodes the acquired compressed video data into a continuous sequence of images through a decoder for subsequent rendering operations and transfers it to the decoding and restoration unit;

[0152] Further explanation: Before playing, the video file is saved in compressed formats such as MP4, AVI, FLV, etc. to reduce the file size and improve the transmission efficiency. When the player reads the video file, it decodes the video data in compressed formats such as MP4, AVI, FLV, etc. into a continuous sequence of images for subsequent rendering. During the decoding process, the player reads the header information of the video file to obtain basic attributes such as the frame rate, resolution, and encoding method of the video.

[0153] S52. The digital / analog converter in the decoding and restoration unit decodes and converts the digital video signal into an analog signal, converts the color and brightness information of the image into an electrical signal, and transfers it to the contrast enhancement unit;

[0154] Further explanation: The decoded video pixel data is obtained through decoding by the decoder to get a series of continuous pictures, each picture containing the pixel data of one frame. Subsequently, it is rendered through a rendering engine to generate continuous video images. Continuous playback creates an animation effect and forms a video. The smoothness and quality of video playback are related to hardware, software, and the network. Hardware includes the CPU, graphics card, etc., which determines the speed and quality of video decoding and rendering. Software includes the video decoder, rendering engine, etc., which is responsible for video decoding and rendering work. The stability and bandwidth of the network determine the loading and playback speed of the video.

[0155] S53. The contrast enhancement unit enhances the pixels according to the contrast enhancement transformation calculation formula "y = ax + b, where x and y are the pixel values of the two-dimensional matrix image, and a and b are the contrast and brightness respectively", and transfers it to the histogram equalization unit;

[0156] Further explanation: By adjusting the coefficients a and b, the contrast and brightness of the video image can be changed. According to the contrast enhancement transformation calculation formula "y = ax + b, where x and y are the pixel values of the two-dimensional matrix image, and a and b are the contrast and brightness respectively", the pixel values x and y of the two-dimensional matrix image are increased to increase the size of the video image. When 0 < a < 1, the gray level range of the image is reduced; when a > 1, the gray level range of the image is expanded; when b > 0, the brightness increases; when b < 0, the brightness decreases.

[0157] S54, the histogram equalization unit obtains the output enhanced image according to the histogram calculation formula "y = (ymax-ymin) / (xmax-xmin)*(x-xmin+ymin, x, y are the input and output pixel values ​​respectively, xmax, xmin are the maximum and minimum values ​​of the input pixel value respectively, ymax, ymin are the maximum and minimum values ​​of the output pixel value respectively", and transmits it to the image quality unit;

[0160] Further explanation: the pixel value range of the original video image is mapped to the range of [0,255] by the histogram calculation formula "y = (ymax-ymin) / (xmax-xmin)*(x-xmin)+ymin, x, y are the input and output pixel values, xmax, xmin are the maximum and minimum values ​​of the input pixel values, ymax, ymin are the maximum and minimum values ​​of the output pixel values", wherein the maximum value ymax of the output pixel value is set to 255, and the minimum value ymin of the output pixel value is set to 0; the pixel value y of the output image is enhanced by adjusting the maximum value xmax and the minimum value xmin of the input pixel value of the image respectively; and by redistributing the frequency of occurrence of each pixel value in the range of [0,255], the number of pixel points corresponding to each pixel value is approximately equal, thereby achieving contrast enhancement; and by dividing the image into multiple sub-blocks, performing histogram equalization on each sub-block, and limiting the contrast of each sub-block, thereby avoiding the problem of excessive local contrast of the image, and being able to better handle the local contrast problem of the image.

[0162] S55. The image quality unit obtains real-time image quality information through a set image quality analyzer so as to subsequently judge the quality level of the image.

[0163] It is further explained that the image video information is collected in real time by an image analyzer, the image is converted into an electrical signal by a camera, and a high-performance camera is used to ensure that the image has good clarity. After the image is collected, the electronic image is enhanced to make it more suitable for analysis, so as to improve the clarity and contrast of the image for more accurate analysis; through the image analysis process, the grayscale phase that needs to be analyzed is determined and separated from the image, so as to objectively and accurately express various information existing in the sample image with numbers.

[0164] S60: The processing center compares the image quality information of the actually played video with the video play quality standard stored in the memory: if the standard is met, the video continues to be played; if the standard is not met, the information is transmitted to the alarm and a re-decoding and re-playing notification is given.

[0165] Further explanation: the video playback quality standards include: resolution of 720p or above, frame rate of 24fps or above, encoding format meets the requirements, bit rate of 360p or 480p video is greater than or equal to 0.8Mbps, bit rate of 720p video is greater than 1.5Mbps, bit rate of 1080p video is greater than 2.5Mbps, bit rate of 4K video is 12Mbps, sound is clear, and volume is balanced.

[0166] It is further explained that the various steps are displayed in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise clearly stated in this document, there is no strict order restriction for the execution of these steps. These steps can also be executed according to other orders, and some steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0167] A transmission control system for a wireless camera provided by the present invention also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and when the various functional modules execute the computer program, the steps of the transmission method for a wireless camera described in any one of the above are implemented; the computer-readable storage medium stores a computer program, and when the computer program is executed by the various functional modules, the steps of the transmission method for a wireless camera described in any one of the above are implemented.

[0168] Further description, the computer-readable storage medium includes a memory, which can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as the program and instructions corresponding to a wireless camera transmission method in an embodiment of the present invention, including information transmission instructions of each module; the memory executes various functional applications and data processing of each module by running the stored non-volatile software programs and instructions, that is, implements a wireless camera transmission method in the above method embodiment; one or more units are stored in the memory, and when executed by the one or more modules, a wireless camera transmission method in any of the above method embodiments is executed; the computer-readable storage medium stores computer executable instructions, which are executed by one or more modules, and can also be a wireless camera transmission method in any of the above method embodiments.

[0169] To further illustrate, the present invention is described according to the content implemented by a software program of a transmission control system of a wireless camera. The transmission method for each wireless camera is divided into several modules or units to implement the software program instructions generated by each step. The software program instructions include a transmission method for a wireless camera described in any one of the above items.

[0170] The present invention also provides a wireless camera implemented by using the above-mentioned transmission method of the wireless camera.

[0171] It is obvious to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, and that the present application can be implemented in other specific forms without departing from the spirit or essential features of the present application. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present application.

[0172] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application can be modified or replaced by equivalents, and all should be included in the scope of protection of the present application.

Claims

1. A transmission method for a wireless camera, characterized in that : Applied to a transmission control system of a wireless camera, the control system includes a data acquisition module, a data encoding module, a data transmission module, a data decoding module, a video playback module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically connected to the wireless communication module within the range of a wireless network or the Internet; The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet; The alarm device compares the image quality information of the actual played video with the video play quality standard stored in the memory, and automatically sounds an audible alarm and notifies the user to re-decode and play the video if the quality does not meet the standard; The memory is responsible for storing information of the data acquisition module, the data encoding module, the data transmission module, the data decoding module, the video playback module, the wireless communication module, the alarm, and the video playback quality standard; The processing center is responsible for the information transmission of the data acquisition module, data encoding module, data transmission module, data decoding module, video playback module, wireless communication module, alarm, and memory. It is the hub of the system and compares the image quality information of the actual played video with the video playback quality standard stored in the memory: if it meets the standard, it continues to play; if it does not meet the standard, it is transmitted to the alarm and notified to decode and play again; The data acquisition module includes a photoelectric conversion unit, a charge integration unit, a voltage conversion unit, a digital conversion unit, and an image processing unit. The video signal is acquired through an image sensor and converted into a recognizable digital signal, and then transmitted to the data encoding module; The data encoding module includes an object segmentation unit, a bit grouping unit, a network decomposition unit, a coding compression unit, a video decoding unit, a prediction coding unit, a video bit unit, an object coding unit, and an object construction unit, and is responsible for compressing and encoding the collected original video data according to the MPEG-4 video coding algorithm for storage and transmission, and passing it to the data transmission module; The data transmission module includes a wireless conversion unit, a wireless transmission unit, and a data receiving unit, which are responsible for converting the encoded video data into wireless signals through the WiFi module and connecting to a router or access point through a wireless network, and transmitting the signals to the data decoding module; The data decoding module includes a video reading unit, a positioning video unit, a decoding video unit, a format conversion unit, and an image processing unit. After receiving the video data transmitted by the camera through the user, the corresponding video decoding algorithm is used to decode the data into a playable video signal and pass it to the video playback module; The video playback module includes an image decomposition unit, a decoding and restoration unit, a contrast enhancement unit, a histogram equalization unit, and an image quality unit, which are responsible for transmitting the decoded video signal through the screen of the video playback device, and real-time viewing or recording and saving through the application program, so that the wireless transmission can reach 720p and above high-definition standards within a range of 100 meters, solving the problems of delay, freeze, low transmission quality, etc. during video playback, so that the wireless video playback remains smooth and is transmitted to the processing center; The method comprises the following steps: S10, during video transmission, the data acquisition module obtains the video signal through the image sensor and converts it into a recognizable digital signal for subsequent transmission, and passes it to the data encoding module, including the following steps: S11, the photoelectric conversion unit generates electrons through absorption by the set photosensitive element, and converts them into corresponding amount of charges through jumping motion, and transmits them to the charge integration unit; S12, the charge integration unit extracts the electrons from the photosensitive element through the integration operation circuit and gradually integrates the charge into the memory until the set integration time, and transmits it to the voltage conversion unit; S13, the voltage conversion unit converts the charge into a voltage signal through a charge integrator, amplifies the voltage signal through an amplifier circuit, and transmits the voltage signal to a digital conversion unit; S14, the digital conversion unit converts the amplified voltage signal into a digital signal through a digital-to-analog converter (ADC), and transmits the digital signal to the image processing unit; S15, the image processing unit extracts, enhances, segments, and recognizes the digital signal through a digital signal processor, and reconstructs a three-dimensional image so as to be stored, displayed, or transmitted; S20, the data encoding module compresses and encodes the collected original video data according to the MPEG-4 video encoding algorithm for storage and transmission, and transmits it to the data transmission module; S30, the data transmission module converts the encoded video data into a wireless signal through the WiFi module and connects to a router or access point through the wireless network, and transmits it to the data decoding module, including the following steps: S31, the wireless conversion unit is connected to the image video device through a suitable WiFi module to wirelessly transmit the video signal, and the client software is set to facilitate real-time video browsing and transmit it to the wireless sending unit; S32, the wireless transmission unit converts the data field of the network frame into a wireless signal, and transmits the wireless signal to the visual playback device without loss, so as to ensure the consistency of the video information before and after transmission, and transmits the wireless signal to the data receiving unit; S33, the data receiving unit is connected to the same network via WiFi via a smartphone or computer, and accesses the IP address of the camera via a corresponding camera application or web page; S40, after receiving the video data transmitted by the camera through the user, the data decoding module uses a corresponding video decoding algorithm to decode the data into a playable video signal, and transmits it to the video playback module; S50, the video playback module transmits the decoded video signal through the screen of the video playback device, and the decoded video signal is viewed in real time or recorded and saved through the application program, and then transmitted to the processing center; S60: The processing center compares the image quality information of the actually played video with the video play quality standard stored in the memory: if the standard is met, the video continues to be played; if the standard is not met, the information is transmitted to the alarm and a re-decoding and re-playing notification is given.

2. A wireless camera transmission method according to claim 1, characterized in that: The step S20 comprises the following steps: S21, the object segmentation unit forms an independent video object (VO) by segmenting the characters, objects and background objects in the video content, and transmits the VO to the bit grouping unit; S22, the bit grouping unit groups the video objects (VO) of the characters, objects, and background according to the YUV4:4:4 chrominance signal resolution format, and transmits the groups to the network decomposition unit; S23, the network decomposition unit classifies each group into numerous network information packets and data fields of network frames according to the categories of people, objects and backgrounds, and transmits them to the encoding and compression unit; S24, the coding and compression unit allocates different code rates to each network information packet according to the importance of the video object to perform intra-frame and inter-frame coding and compression to improve the compression ratio, and transmits the result to the video decoding unit; S25, the video decoding unit reads input, decodes, and writes output of the video in units of frames. If normal, the decoding of the next frame is continued and passed to the prediction coding unit; S26, the prediction coding unit performs motion estimation and predicted VOP coding based on motion compensation, closes the codec and releases memory space after completing hardware settings, and passes it to the video bit unit; S27, the video bit unit performs bit stream processing of encoding mode selection, color signal sampling, and codec selection on the video after VOP encoding, and transmits it to the object encoding unit; S28, the object encoding unit encodes each video object (VO) into a scalable (multi-layer) or non-scalable (single-layer) video stream according to application requirements, and transmits it to the object construction unit; S29. The object construction unit reconstructs the video object layer (VOL) in a hierarchical manner through an enhanced hierarchical method to achieve visual or spatial grading of VO, which can be encoded into a multi-layer or single-layer video stream.

3. A wireless camera transmission method according to claim 1, characterized in that: The step S40 comprises the following steps: S41, the video reading unit opens the video file through the avformat_open_input function and reads the video header information, and passes it to the positioning video unit; S42, the positioning video unit obtains the required video stream data according to the multimodal fusion data algorithm calculation formula "G(E,R,P)=∑e∈EWe(Pe)+∑r∈R Wr(Cr)+∑p∈P Wp(Vp), G is the knowledge graph, E is the entity set, R is the relationship set, P is the attribute set, We, Wr, Wp are the weights of the entity, relationship, and attribute respectively, Pe, Cr, Vp are the attribute value of the entity, the connection value of the relationship, and the value of the attribute respectively" and passes it to the decoding video unit; S43, the decoding video unit sends a data packet to the decoder through dedicated software for real-time decoding and receives the decoded frame data, and transmits it to the image conversion unit; S44, the format conversion unit calculates the formula "H = -∑P(x)log2P(x), H is entropy, P(x) is the probability of character x" through the Huffman decompression algorithm to obtain the amount of information before data compression, and restores it to the video information before compression according to the number, so that the video before and after wireless transmission is consistent, and transmits it to the image processing unit; S45, the image processing unit performs color space conversion, scaling preprocessing, image analysis and encoding on the decoded frame data to meet different display or application requirements.

4. A wireless camera transmission method according to claim 1, characterized in that: The step S50 comprises the following steps: S51, the image decomposition unit decodes the obtained compressed video data into a continuous image sequence through a decoder for subsequent rendering operations, and transmits the image sequence to a decoding and restoration unit; S52, the digital / analog converter of the decoding and restoration unit decodes and converts the digital video signal into an analog signal, converts the color and brightness information of the image into an electrical signal, and transmits it to the contrast enhancement unit; S53, the contrast enhancement unit enhances the pixel according to the contrast enhancement transformation calculation formula "y=ax+b, x, y are the pixel values ​​of the two-dimensional matrix image, a, b are the contrast and brightness respectively", and transmits it to the histogram equalization unit; S54, histogram equalization unit according to the histogram calculation formula "y=(ymax-ymin) / (xmax -xmin)*(x-xmi n )+ ymin, x, y are the input and output pixel values ​​respectively, xmax, xmin are the maximum and minimum input pixel values ​​respectively, ymax, ymin are the maximum and minimum output pixel values ​​respectively” to obtain the output enhanced image and pass it to the image quality unit; S55. The image quality unit obtains real-time image quality information through a set image quality analyzer so as to subsequently judge the quality level of the image.

5. The transmission method of a wireless camera according to claim 1, characterized in that: The control system also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and when the various functional modules execute the computer program, the steps of the transmission method of a wireless camera described in any one of claims 1 to 4 are implemented; the computer-readable storage medium stores a computer program, and when the computer program is executed by the various functional modules, the steps of the transmission method of a wireless camera described in any one of claims 1 to 4 are implemented.

6. A wireless camera, characterized in that: The method is implemented by using a wireless camera transmission method as described in any one of claims 1 to 5 above.