Signal processing method, image display method and device and wireless camera device

Abstract

The invention relates to the technical field of signal processing, in particular to a signal processing method, an image display method and device and a wireless camera device. The signal processing method applied to the wireless image transmitting equipment of the wireless camera device comprises the following steps: acquiring an image source signal; performing various signal processing on the image source signal to obtain a plurality of candidate images; determining a to-be-coded image from the plurality of candidate images, and determining a target parameter of target signal processing corresponding to the to-be-coded image; encoding the to-be-encoded image to obtain target encoded data; and sending the target coded data and the target parameter so as to decode the target coded data through a wireless image receiving device of the wireless camera device, and obtaining a target image for display based on the target parameter. The problem of limitation of image dynamic parameters caused by software / hardware limitation of the wireless camera device is solved, so that the image display quality can be improved, and the image display quality is closer to an expected effect.

Description

Technical Field

[0001] The present invention relates to the technical field of signal processing, and particularly to a signal processing method, an image display method, a signal processing device, an image display device, a wireless camera device, and a computer-readable storage medium. Background Art

[0002] A wireless camera device is a camera device that transmits video and audio signals through a wireless network (such as Wi-Fi, Bluetooth, Zigbee, etc.). Wireless cameras are widely used in multiple fields such as home security, enterprise monitoring, smart home, and outdoor monitoring.

[0003] The main components of a wireless camera device include a wireless image transmitting device, a wireless image receiving device, and a camera sensor. The camera sensor is usually deployed on the same device as the wireless image transmitting device. The wireless camera device can transmit image / video signals from the wireless image transmitting device to the wireless image receiving device through radio waves, so that the corresponding image / video can be displayed or played on the wireless receiving device.

[0004] The dynamic range of an image refers to the brightness difference between the brightest and darkest parts of the image. The larger the dynamic range, the more brightness levels the image can represent, and thus more detail and color information can be captured. Dynamic range is a very important concept in photography, imaging, and display technologies. However, the dynamic range and performance of the images captured by the wireless camera device may vary from the expected effects due to the limitations of the hardware and software of the wireless camera device, resulting in a difference in the display effect on the wireless image receiving device. Summary of the Invention

[0005] To overcome the problems in the related art, an exemplary embodiment of the present disclosure provides a signal processing method, which is applied to a wireless image transmitting device of a wireless camera device. The method includes: obtaining an image source signal; performing various signal processes on the image source signal respectively to obtain multiple candidate images, where the signal process includes signal gain process and / or exposure time adjustment process; determining a to-be-encoded image from the multiple candidate images, and determining target parameters corresponding to the target signal process of the to-be-encoded image; performing an encoding process on the to-be-encoded image to obtain target encoded data; and sending the target encoded data and the target parameters, so that the wireless image receiving device of the wireless camera device decodes the target encoded data and obtains a target image for display based on the target parameters.

[0006] In some embodiments, determining an image to be encoded from multiple candidate images and determining target parameters for target signal processing corresponding to the image to be encoded includes: respectively determining the image quality of each candidate image; using the candidate image with the optimal image quality among the image qualities of the multiple candidate images as the image to be encoded, and using the signal processing parameters corresponding to the candidate image with the optimal image quality as the target parameters.

[0007] In some embodiments, determining an image to be encoded from multiple candidate images and determining target parameters for target signal processing corresponding to the image to be encoded includes: respectively determining the index parameter values of target index parameters corresponding to each candidate image based on the image pixels of each candidate image; determining the standard parameter value of the target index parameter; using the candidate image corresponding to the index parameter value closest to the standard parameter value as the image to be encoded, and using the signal processing parameters corresponding to the candidate image corresponding to the index parameter value closest to the standard parameter value as the target parameters.

[0008] In some embodiments, the target index corresponding to the target index parameter is a gain performance index and / or an exposure time performance index.

[0009] In some embodiments, the image source signal is one of a continuous multi-frame image source signal; acquiring the image source signal includes: sequentially acquiring each frame of the image source signal so that the wireless image receiving device can display video content corresponding to the multi-frame image source signal.

[0010] In some embodiments, the target parameters are target gain parameters and / or target exposure time parameters; or the target parameters are parameter indication values corresponding to target signal processing.

[0011] In a second aspect, the present disclosure also provides an image display method applied to a wireless image receiving device of a wireless camera device. The method includes: receiving target encoded data and target parameters sent by a wireless image transmitting device of the wireless camera device, where the target encoded data and target parameters are determined by the signal processing method provided in any of the above aspects; decoding the target encoded data, and obtaining a target image for display based on the target parameters; and displaying the target image.

[0012] In some embodiments, decoding the target encoded data and obtaining a target image for display based on the target parameters includes: decoding the target encoded data to obtain a decoding result; performing normalization processing on the decoding result according to the target parameters to obtain the target image, where the target parameters include target gain and / or target exposure time.

[0013] In some embodiments, the image source signal corresponding to the target encoded data is one of a series of consecutive multi-frame image source signals. Displaying the target image includes: sequentially displaying each target image to display video content corresponding to the multi-frame image source signals; and ending the image display in response to the completion of the display of the last target image.

[0014] In a third aspect, the present disclosure also provides a signal processing apparatus applied to a wireless image transmitting device of a wireless camera device. The apparatus includes: an acquisition module for acquiring an image source signal; a first processing module for performing various signal processes on the image source signal respectively to obtain a plurality of candidate images, the signal processes including signal gain processing and / or exposure time adjustment processing; a screening module for determining a to-be-encoded image from the plurality of candidate images and determining target parameters of the target signal process corresponding to the to-be-encoded image; a second processing module for performing an encoding process on the to-be-encoded image to obtain target encoded data; and a transmitting module for transmitting the target encoded data and the target parameters so that the target encoded data is decoded by a wireless image receiving device of the wireless camera device and a target image for display is obtained based on the target parameters.

[0015] In a fourth aspect, the present disclosure also provides an image display apparatus applied to a wireless image receiving device of a wireless camera device. The apparatus includes: a receiving module for receiving the target encoded data and the target parameters transmitted by the wireless image transmitting device of the wireless camera device, the target encoded data and the target parameters being determined by using the signal processing method provided in any of the above aspects; a third processing module for decoding the target encoded data and obtaining a target image for display based on the target parameters; and a display module for displaying the target image.

[0016] In a fifth aspect, the present disclosure also provides a wireless camera device including a wireless image transmitting device and a wireless image receiving device;

[0017] The wireless image transmitting device is configured to acquire an image source signal; perform various signal processes on the image source signal respectively to obtain a plurality of candidate images, the signal processes including signal gain processing and / or exposure time adjustment processing; determine a to-be-encoded image from the plurality of candidate images and determine target parameters of the target signal process corresponding to the to-be-encoded image; perform an encoding process on the to-be-encoded image to obtain target encoded data; and transmit the target encoded data and the target parameters; The wireless image receiving device is configured to receive the target encoded data and the target parameters; decode the target encoded data and obtain a target image for display based on the target parameters.

[0018] Sixth aspect, the present disclosure also provides a computer-readable storage medium storing the following program for executing the signal processing method provided in any of the above aspects or the image display method provided in any of the above aspects.

[0019] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure.

[0020] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: According to the signal processing method provided by the present disclosure, the wireless image transmitting device of the wireless camera device performs various signal processes on the image source signal, including but not limited to at least one of gain adjustment and exposure time adjustment. Through these processes, an encoded image with better or balanced gain and exposure time can be selected to optimize image details, prevent brightness imbalance and color distortion, thereby ensuring the quality and stability of the target encoded data. In addition, by transmitting the encoded target encoded data and the corresponding target parameters to the wireless image receiving device of the wireless camera device, the wireless image receiving device can accurately identify the image signal to be displayed and use these parameters for targeted image reconstruction, which helps to overcome the limitation problem of image dynamic parameters caused by the software / hardware limitations of the wireless camera device, and thus can significantly improve the image display quality and make it closer to the expected effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The present invention can be better understood by describing the exemplary embodiments of the present invention in conjunction with the accompanying drawings. In the drawings:

[0022] Figure 1 is a schematic diagram of the architecture of a wireless camera device shown according to an exemplary embodiment of the present disclosure;

[0023] Figure 2 is a schematic diagram of the process of a signal processing method shown according to an exemplary embodiment of the present disclosure;

[0024] Figure 3 is a schematic diagram of the architecture of a wireless image transmitting device shown according to an exemplary embodiment of the present disclosure;

[0025] Figure 4 is a schematic diagram of the process of an image display method shown according to an exemplary embodiment of the present disclosure;

[0026] Figure 5 is a schematic diagram of the architecture of a wireless image receiving device shown according to an exemplary embodiment of the present disclosure;

[0027] Figure 6 is a schematic diagram of the architecture of another wireless camera device shown according to an exemplary embodiment of the present disclosure;

[0028] Figure 7 is a schematic structural diagram of a signal processing device shown according to an exemplary embodiment of the disclosure;

[0029] Figure 8 is a schematic structural diagram of an image display device shown according to an exemplary embodiment of the disclosure. Detailed implementation manners

[0030] The following will describe the detailed implementation manners of the present invention. It should be noted that in the specific description of these implementation manners, for the sake of concise description, this specification cannot describe all features of the actual implementation manners in detail. It should be understood that in the actual implementation process of any implementation manner, just as in the process of any engineering project or design project, in order to achieve the specific goals of the developer and to meet system-related or business-related restrictions, various specific decisions are often made, and these will also change from one implementation manner to another. In addition, it should also be understood that although the efforts made in this development process may be complex and lengthy, for those of ordinary skill in the art related to the content disclosed in the present invention, some design, manufacturing, or production changes based on the technical content disclosed in this disclosure are just conventional technical means and should not be understood as the content of this disclosure being insufficient.

[0031] Unless otherwise defined, the technical terms or scientific terms used in this disclosure should have the ordinary meanings understood by those of ordinary skill in the technical field to which the present invention belongs. The "first", "second" and similar terms used in this disclosure do not denote any order, quantity or importance, but are only used to distinguish different components. The terms such as "a" or "one" do not denote a quantity limitation, but mean that there is at least one. The terms such as "include" or "comprise" mean that the elements or items appearing before "include" or "comprise" cover the elements or items listed after "include" or "comprise" and their equivalent elements, and do not exclude other elements or items. The terms such as "connect" or "be connected" are not limited to physical or mechanical connections, nor are they limited to direct or indirect connections.

[0032] Such as Figure 1As shown in the figure, the wireless camera device 100 includes a wireless image transmitting device 110, a wireless image receiving device 120, and an image sensor 130. The image sensor 130 is used to collect signals to obtain an image source signal. The wireless image transmitting device 110 is connected to the image sensor 130 and is deployed on the same physical device. The wireless image transmitting device 110 is used to convert the image source signal into a digital signal and send the digital signal to the wireless image receiving device 120 by wireless transmission. The wireless image receiving device 120 is an independent device relative to the wireless image transmitting device 110 and the image sensor 130. The wireless image receiving device 120 is used to convert the received digital signal into an image for display or a video for playback.

[0033] The dynamic range refers to the brightness range between the brightest and darkest that the sensor can capture. For the image sensor 130, it refers to the range of light intensity that it can sense and record. However, the dynamic range of the image sensor 130 is determined based on its quantization bit number (the number of brightness levels that can be distinguished). For example, if the quantization bit number of the camera sensor 130 is 8 bits, the camera sensor can distinguish 256 brightness levels (2^8). If the quantization bit number of the image sensor 130 is 10 bits, the camera sensor can distinguish 1024 brightness levels (2^10). Since the quantization bit number of the camera sensor 130 is fixed, it may cause extreme brightness levels not to be effectively collected during the process of collecting the image source signal. Moreover, during the encoding process of the wireless image transmitting device 110 and the decoding process of the wireless image receiving device 120, the limited word lengths of the encoder and decoder will also affect the signal processing accuracy, thereby affecting the display result of the image or the playback result of the video. Therefore, in either of the above cases, the display effect of the wireless camera device 100 will be affected.

[0034] Furthermore, if high dynamic range (HDR) is implemented in the wireless image transmitting device, it will increase the word length of the image / video pixels, increase the word length of the codec, and increase the amount of data transmitted wirelessly, resulting in an increase in the computing load, computing resources, power consumption, and cost of the wireless image transmitting device. For related general image encoders / video encoders, their word lengths are often 8 bits or 10 bits. Therefore, although HDR can be implemented in the wireless image transmitting device (for example, its dynamic range corresponds to 12 bits, 14 bits, or 16 bits, etc.), there is no effective method to transmit the HDR image / video to the wireless image receiving device, resulting in the inability of the wireless camera device to achieve HDR.

[0035] To solve the above problems, the present disclosure provides a signal processing method, which is applied to the wireless image transmitting device of the wireless camera device. As Figure 2As shown, the signal processing method may include the following steps:

[0036] Step S210, obtaining an image source signal.

[0037] The image source signal refers to the signal obtained by the wireless image transmitting device of the wireless camera device and not processed. The image source signal may be the source signal corresponding to a single image or one of the continuous multi-frame image source signals, and can be specifically determined according to actual acquisition requirements.

[0038] In one example, the image source signal may be the signal collected by the image sensor of the wireless camera device. The image sensor and the wireless image transmitting device are deployed on the same physical device. Therefore, the image source signal may be derived from the environment where the wireless image transmitting device is located. In another example, the image source signal may be the signal pre-stored locally in the wireless image transmitting device, thereby improving the acquisition efficiency and utilization rate of the signal. In still other examples, the image source signal may be the signal obtained from the cloud to meet various requirements.

[0039] Step S220, performing various signal processes on the image source signal respectively to obtain multiple candidate images.

[0040] Since the image source signal is the signal inside the image sensor and belongs to an analog signal, and both the signal intensity of the image source signal and the number of light rays during corresponding acquisition have a certain randomness, which depends on the acquisition environment where the corresponding camera sensor is located and the exposure time of the corresponding camera sensor. Therefore, in order to make the display effect of the image corresponding to the image source signal during display more conform to the desired effect, various signal processes are performed on the image source signal respectively to obtain multiple candidate images, so that the optimal signal processing method for processing the image source signal can be determined from them according to the quality of each candidate image later, thereby achieving the purpose of enhancing the image display effect. Among them, during the signal processing process, the image source signal is first processed, and then the processed signal is converted into a digital signal that can be recognized by the wireless image transmitting device through an analog-to-digital converter, thereby obtaining the corresponding candidate image. The signal processing includes signal gain processing and / or exposure time adjustment processing. That is, during the process of performing signal processing on the image source signal, various signal gain processes can be performed only on the image source signal, various exposure time adjustment processes can be performed only on the image source signal, or various signal gain processes and various exposure time adjustment processes can be performed on the image source signal at the same time, specifically depending on the actual signal processing configuration in the wireless image transmitting device. Among them, the actual value of the signal processing parameter corresponding to each signal processing can be determined according to prior knowledge or specified requirements.

[0041] Among them, by performing signal gain processing on the image source signal, the image source signal can be enhanced, thereby achieving the purpose of increasing the image brightness. Among them, the gain can be expressed in decibels (dB) or multiples (such as 2X, 4X). For example, when the image source signal appears darker due to poor lighting conditions (such as a low-light environment), by performing signal gain processing on it, the details of the image can be enhanced, thereby improving the clarity and recognizability of the image.

[0042] The exposure time refers to the length of time that the photosensitive element of the camera (such as a CMOS or CCD sensor, etc.) is exposed to light. The longer the exposure time, the more light the camera sensor receives, and the brighter the image; conversely, the shorter the exposure time, the darker the image. Therefore, by performing exposure time adjustment processing on the image source signal, the light collection situation of the camera sensor can be improved, thereby achieving the purpose of adjusting the image brightness.

[0043] Step S230, determine the image to be encoded from multiple candidate images, and determine the target parameters for the target signal processing corresponding to the image to be encoded.

[0044] Since different signal processing methods require different parameter settings, different selections of parameters may lead to over-adjustment of the image processing results. For example, if the parameter settings of the signal processing are improper, it may cause the image to be over-magnified, the brightness to increase, or both to occur simultaneously. Such processing results may lead to the loss of details in the highlight area or color distortion when the image is displayed. Among them, the loss of details in the highlight area may cause the bright area to become pure white, and color distortion may cause the color in the highlight area to be unnatural or the saturation to decrease. In addition, this situation may also lead to a decrease in image contrast and dynamic range compression, making it impossible to clearly display the highlight and shadow details of the image. Similarly, if the parameter settings of the signal processing are too small, it may cause the image to be insufficiently magnified, the brightness to decrease, or both to occur simultaneously. Such processing results may lead to the situation of insufficient image exposure when the image is displayed. Among them, insufficient exposure may cause the loss of details in the shadow area of the image or color distortion. Color distortion in the shadow area may cause the color to be unnatural or the saturation to decrease. In addition, this situation may also lead to a decrease in contrast and dynamic range compression, making it difficult to clearly display the image details.

[0045] Therefore, to ensure that the subsequent image display effect can meet the expectations, multiple candidate images are screened to determine the candidate image with the best quality from them, and the candidate image with the best quality is used as the image to be encoded to eliminate the influence of images with a low dynamic range on image display. Among them, images with a low dynamic range can be overexposed or severely overexposed images, underexposed or severely underexposed images. Also, to facilitate the subsequent wireless image receiving device to clearly understand the signal processing process corresponding to the image to be encoded, the target parameters corresponding to the target signal processing of the image to be encoded are determined together.

[0046] In some examples, the target parameters are the target gain parameter and / or the target exposure time parameter. That is, if the image to be encoded is only obtained by performing signal gain processing on the image source signal, then the target parameter is the target gain parameter. If the image to be encoded is only obtained by performing exposure time adjustment processing on the image source signal, then the target parameter is the target exposure time parameter. If the image to be encoded has undergone both signal gain processing and exposure time adjustment processing, then the target parameters are the target gain parameter and the target exposure time parameter.

[0047] In some other examples, the target parameter is the parameter indication value corresponding to the target signal processing. For example, the parameter indication value can be any value from 1 to N, where N represents the total number of multiple signal processes, and there is a one-to-one correspondence between the signal process and the parameter indication value. By determining the parameter indication value, when subsequently sent to the wireless image receiving device, not only can the wireless image receiving device quickly understand the target parameters for signal processing of the image source signal, but also the occupancy of the wireless bandwidth can be reduced, and the data transmission efficiency can be improved.

[0048] Step S240, perform encoding processing on the image to be encoded to obtain target encoded data.

[0049] The encoder in the wireless image transmitting device performs encoding processing on the image to be encoded to convert the format of the image to be encoded into a compressed format, obtaining the target encoded signal, which is convenient for subsequent transmission to the receiving device of the wireless camera device, thereby effectively reducing the size of the image file, reducing the transmission cost, and increasing the transmission speed.

[0050] In some examples, if the image source signal is the source signal corresponding to a single image, the encoder can convert the format of the image to be encoded into an image compression format. For example, it can be the Joint Photographic Experts Group (JPEG) format, the Portable Network Graphics (PNG) format, the Graphics Interchange Format (GIF), or the Tagged Image File Format (TIFF), etc.

[0051] In other examples, if the image source signal is one of a series of consecutive multi-frame image source signals, the encoder can convert the format of the image to be encoded into a video frame compression format. For example, it can be formats such as H.264, H.265, VP9, AV1, MPEG-2, etc.

[0052] Step S250: Send the target encoded data and target parameters so that the wireless image receiving device of the wireless camera device decodes the target encoded data and obtains a target image for display based on the target parameters.

[0053] The wireless image receiving device is used to display the image content corresponding to the image source signal. To enable the wireless image receiving device to display images, the wireless image sending device sends the determined target encoded data and target parameters to the wireless image receiving device, so that the wireless image receiving device can perform targeted decoding on the received target encoded data and restore the image based on the target parameters, in order to expand the dynamic range of the image and thus obtain a target image that can meet the expected effect.

[0054] Among them, the wireless image sending device uses wireless transmission to send the target encoded data and target parameters to the wireless image receiving device, which can weaken the spatial limitation between the two devices, thereby enhancing the application flexibility and application scope of the wireless camera device. Among them, the wireless communication protocol based on which the wireless transmission is carried out can include but is not limited to any one of the following protocols: Bluetooth protocol, Bluetooth Low Energy (BLE) protocol, Wi-Fi protocol, or Ultra-Wideband (UWB) protocol.

[0055] According to the signal processing method provided by the present disclosure, the wireless image transmitting device of the wireless camera device performs various signal processes on the image source signal, including but not limited to at least one of gain adjustment and exposure time adjustment. Through these processes, an image to be encoded with both better or balanced gain and exposure time can be selected to optimize image details, prevent brightness imbalance and color distortion, thereby ensuring the quality and stability of the target encoded data. In addition, by transmitting the encoded target encoded data and corresponding target parameters to the wireless image receiving device of the wireless camera device, the wireless image receiving device can accurately identify the image signal to be displayed and use these parameters for targeted image reconstruction, which helps to overcome the limitation problem of the image dynamic parameters caused by the software / hardware limitations of the wireless camera device, and thus can significantly improve the image display quality and make it closer to the expected effect.

[0056] In some embodiments, the above step S230 may include the following steps:

[0057] Step a1, determining the image quality of each candidate image respectively;

[0058] Step a2, using the candidate image with the optimal image quality among the image qualities of the multiple candidate images as the image to be encoded, and using the signal processing parameters corresponding to the candidate image with the optimal image quality as the target parameters.

[0059] Specifically, the quality of each candidate image can be evaluated respectively to determine the image quality of each candidate image. Among them, the higher the result of the quality evaluation, the better the quality of the corresponding candidate image. Therefore, to ensure the quality and stability of the target encoded data, the candidate image with the optimal image quality among the image qualities of the multiple candidate images is used as the image to be encoded. And when determining the candidate image with the optimal image quality, the signal processing parameters corresponding to the candidate image with the optimal image quality are used as the target parameters, so that the subsequent wireless image receiving device can clarify the restoration process of the image to be encoded.

[0060] In some examples, to evaluate the quality of the candidate images, evaluation metrics can be determined in advance, and then targeted quality evaluation of the candidate images can be performed according to the determined evaluation metrics. For example, the evaluation metrics can include but are not limited to any one of the following: subjective evaluation, objective evaluation of visual quality, etc. Among them, subjective evaluation can be scored by artificial vision, such as peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), human visual system (HVS) model, etc. Objective evaluation can be automatically evaluated by algorithms, such as PSNR, mean square error (MSE), structural similarity index (SSIM), etc. Visual quality can perform targeted evaluation on the clarity, sharpness, color fidelity, noise level, etc. of the image.

[0061] In some other embodiments, the above step S230 may include the following steps:

[0062] Step b1: Based on the image pixels of each candidate image, respectively determine the index parameter values of the target index parameter corresponding to each candidate image;

[0063] Step b2: Determine the standard parameter value of the target index parameter;

[0064] Step b3: Use the candidate image corresponding to the index parameter value closest to the standard parameter value as the image to be encoded, and use the signal processing parameters corresponding to the candidate image corresponding to the index parameter value closest to the standard parameter value as the target parameters.

[0065] Specifically, the target index parameter is an index parameter used to measure whether a candidate image is an optimal image. The indexes corresponding to the target index parameter may include any one or more of the following indexes: gain performance index, exposure time performance index. When the target index parameter is clear, for each candidate image, based on the image pixels of the candidate image, evaluate the situation of the candidate image under the target index parameter, and then obtain the corresponding index parameter value. To determine the quality of each candidate image, the standard parameter value of the target index parameter is determined. This standard parameter value can be understood as the best index parameter value used to measure the image under this target index parameter. The closer the index parameter value is to the standard parameter value, the better the corresponding candidate image; conversely, the farther the index parameter value is from the standard parameter value, the worse the corresponding candidate image.

[0066] Therefore, to ensure the quality and stability of the target encoded data, use the candidate image corresponding to the index parameter value closest to the standard parameter value as the image to be encoded, and when determining the candidate image corresponding to the index parameter value closest to the standard parameter value, use the signal processing parameters corresponding to the candidate image corresponding to the index parameter value closest to the standard parameter value as the target parameters, so that the subsequent wireless image receiving device can clarify the restoration process of the image to be encoded.

[0067] In some application scenarios, the target index parameter may be the average value of image pixels, and the standard parameter value of this target index parameter is the first threshold. Then, the candidate image with the index parameter value closest to the first threshold can be used as the image to be encoded, and the signal processing parameters corresponding to the candidate image with the index parameter value closest to the first threshold can be used as the target parameters.

[0068] In some other application scenarios, the target index parameter may be the maximum value of image pixels or the average value of M maximum pixels, and the standard parameter value of this target index parameter is the second threshold. Then, the candidate image with the index parameter value closest to the second threshold can be used as the image to be encoded, and the signal processing parameters corresponding to the candidate image with the index parameter value closest to the first threshold can be used as the target parameters.

[0069] In some other application scenarios, the target metric parameter may be the pixel ratio of at least one of the bright (highlight) region and the dark (shadow) region in the histogram of the image pixels. The standard parameter value is a pixel ratio interval, including a first pixel ratio and a second pixel ratio. Among them, the first pixel ratio is the maximum pixel ratio threshold between the pixels in the bright (highlight) region and the pixels in the dark (shadow) region. The second pixel ratio is the minimum pixel ratio threshold between the pixels in the bright (highlight) region and the pixels in the dark (shadow) region. In the histogram, the right side represents the bright (highlight) region and the left side represents the dark (shadow) region. If there are more pixel accumulations on the right side, it may indicate overexposure; if there are more accumulations on the left side, underexposure may occur. Therefore, according to the histogram of the image pixels of each candidate image, the candidate images with the pixel ratio of the bright (highlight) region less than the first pixel ratio and / or the pixel ratio of the dark (shadow) region greater than the second pixel ratio can be used as the images to be encoded, and the signal processing parameters corresponding to the candidate image with the metric parameter value closest to the first threshold can be used as the target parameters.

[0070] In some other application scenarios, the target metric parameter may be a combination of any two or more of the following metric parameters: the mean value of the image pixels, the maximum value of the image pixels or the mean value of the M largest pixels, and the pixel ratio of at least one of the bright (highlight) region and the dark (shadow) region in the histogram of the image pixels.

[0071] By screening the candidate images through the target metric parameter, it is possible to effectively eliminate the overexposed or severely overexposed images, as well as the underexposed or severely underexposed images, and select the images to be encoded with better or balanced gain and exposure time, so as to optimize the image details, prevent brightness imbalance and color distortion, and thus contribute to ensuring the quality and stability of the subsequent target encoded data.

[0072] In some embodiments, the image source signal is one of a continuous multi-frame image source signal. Therefore, in the process of obtaining the image source signal, each frame of the image source signal can be obtained in sequence, so that the wireless image receiving device can display the video content corresponding to the multi-frame image source signal and ensure the continuity of the video content display.

[0073] In some optional application scenarios, such as Figure 3 shown, the process of signal processing by the wireless image transmitting device of the wireless camera device can be as follows:

[0074] Obtain the image source signal collected by the image sensor. Input the image source signal into multiple signal processing modules for signal processing, and use the outputs of the respective signal processing modules as candidate images. Among them, the signal processing may include one or more of the following processes: signal gain processing, exposure time adjustment processing. The multiple signal processing modules may be integrated in the same camera sensor or may be connected in series with the image sensor.

[0075] Filter the multiple candidate images through a screening module to determine the optimal image to be encoded and determine the target parameters corresponding to the target signal processing of the image to be encoded.

[0076] Encode the image to be encoded through an encoder to obtain the target encoded data.

[0077] Send the target encoded data and the target parameters to the wireless image receiving device of the wireless camera device through the first wireless module, so that the wireless image receiving device can obtain the target image for display based on the target parameters.

[0078] Through the above method for signal processing, the encoder only performs encoding processing on one of the candidate images, and the first wireless module also performs wireless transmission on one encoded data. Thus, the computing load, computing resources, power consumption, and cost of the wireless image transmitting device and the wireless image receiving device can be greatly reduced, and the reliability of wireless transmission is also improved.

[0079] Based on the same inventive concept, the present invention also provides an image display method, which is applied to the wireless image receiving device of the wireless camera device. As Figure 4 shown, the image display method includes:

[0080] Step S310, receive the target encoded data and the target parameters sent by the wireless image transmitting device of the wireless camera device. Among them, the target encoded data and the target parameters may be determined by any signal processing method provided by the present disclosure used by the wireless image transmitting device.

[0081] Step S320, decode the target encoded data and obtain the target image for display based on the target parameters.

[0082] Perform decoding processing on the image to be encoded through the decoder in the wireless image receiving device to convert the format of the target encoded data into a normal image format or video format, thereby obtaining the decoding result. And, to overcome the dynamic range limitation of the decoder for decoding the target encoded data, the decoding result is restored based on the target parameters, so that the obtained target image can restore the image details and image brightness after signal processing, thereby achieving the purpose of expanding the dynamic range of the target image and ensuring the display effect of the target image.

[0083] Step S330: Display the target image.

[0084] According to the image display method provided by the present disclosure, the wireless image receiving device performs restoration processing on the encoding result of the target encoded data based on the target parameter, which can effectively expand the dynamic range of the target image and avoid the occurrence of image detail loss and insufficient image brightness caused by insufficient word lengths of the encoder and decoder. Therefore, the image quality can be effectively improved, the display effect of the target image can be enhanced, and it can be made closer to the expected effect.

[0085] In some embodiments, the above step S320 may include the following steps:

[0086] Step c1: Decode the target encoded data to obtain a decoding result;

[0087] Step c2: Normalize the decoding result according to the target parameter to obtain the target image.

[0088] Specifically, the decoding algorithm adopted by the decoder corresponds to the encoding algorithm adopted by the encoder, which can ensure the smooth progress of decoding and thus obtain the decoding result.

[0089] To overcome the limitation of the decoder's word length on the image dynamic range, the decoding result is normalized according to the target parameter to better restore image details and ensure image brightness, thereby obtaining the required target image. Among them, the target parameter includes at least any one of the following parameters: target gain, target exposure time.

[0090] In some application scenarios, the target gain can be a linear value or a decibel value, specifically depending on the actual parameter configuration. For the target gain, when normalizing the decoding result, the decoding result can be divided by the target gain, and then the target image can be determined according to the obtained quotient value. Or, the decoding result can be multiplied by the reciprocal of the target gain, and the target image can be determined according to the obtained product value.

[0091] In other application scenarios, in the case of no overexposure, there is a linear relationship between the exposure time and the pixel value in the camera sensor parameters, that is, the normalized pixel value = pixel value / exposure time. Therefore, for the target exposure time, when normalizing the decoding result, according to the above formula, the pixel value of the decoding result can be divided by the target exposure time, and then the normalized pixel value can be obtained, and thus the target image can be obtained according to the normalized pixel value.

[0092] In some other application scenarios, the linear relationship between the exposure time and the pixel value does not hold exactly. In this case, a calibration method can be used to handle this non-linear response of the sensor. For example, based on the pixel value and the exposure time, through a look-up table method, when the target exposure time is clear, the decoded result can be normalized to obtain the required target image.

[0093] In some other application scenarios, the word length of the encoder in the wireless image transmitting device is N1 bits (such as 8 bits or 10 bits), and the word length of the decoder in the wireless image receiving device corresponds to that of the encoder and is also N1 bits. By performing normalization processing on the decoded result according to the target parameters at the wireless image receiving device end, the word length N2 bits (such as 12 bits, 14 bits) corresponding to the decoded result after normalization processing can be greater than the word length N1 bits corresponding to the decoded result. Furthermore, without replacing the hardware, the dynamic range of the image can be effectively expanded, thereby effectively improving the image quality, enhancing the display effect, improving the performance of the wireless imaging device, and enhancing the practicality of the wireless imaging device and the user experience.

[0094] In some examples, the target parameters are the target gain parameter and / or the target exposure time parameter. Furthermore, the wireless image receiving device can directly perform normalization processing according to the received target parameters, which helps to improve the image display efficiency and ensure the performance of the wireless imaging device.

[0095] In some other examples, the target parameter is the parameter indication value corresponding to the target signal processing. Multiple signal processing parameters can be pre-configured in both the wireless image transmitting device and the wireless image receiving device, and a corresponding parameter indication value is configured for each parameter to distinguish each parameter. Furthermore, during the operation of the wireless imaging device, during the wireless interaction between the wireless image transmitting device and the wireless image receiving device, for the target parameter, only the parameter indication value corresponding to the target parameter needs to be transmitted. The wireless image receiving device can clarify the corresponding target parameter according to the received parameter indication value, thereby reducing the amount of data transmission and the occupation of the wireless bandwidth, and helping to improve the data transmission efficiency.

[0096] In some other embodiments, the image source signal corresponding to the target encoded data is one of a series of consecutive multi-frame image source signals. Therefore, the process of displaying the target image can be as follows: display each target image in sequence to display the video content corresponding to the multi-frame image source signals; in response to the completion of the display of the last target image, end the image display. By playing the video in this way, it can be ensured that the content of each image frame in the video stream can be displayed with high quality, thereby helping to enhance the user's viewing experience.

[0097] In some optional application scenarios, such as Figure 5As shown, the process of image display by a wireless image receiving device of a wireless camera device can be as follows: Receive target encoded data and target parameters sent by a wireless image transmitting device through a second wireless module. Decode the target encoded data through a decoder to obtain a decoding result. Normalize the decoding result based on the target parameters through a normalization processing module to obtain a target image. Display the target image through a display module.

[0098] By performing image display in the above manner, the dynamic range of the target image can be effectively expanded, and situations such as missing image details and insufficient image brightness caused by insufficient word lengths of the encoder and decoder can be avoided. Thus, the image quality can be effectively improved, the display effect of the target image can be enhanced, and it can be made closer to the expected effect.

[0099] Based on the same inventive concept, the present invention also provides a wireless camera device. As Figure 6 shown, the wireless camera device 400 may include a wireless image transmitting device 410 and a wireless image receiving device 420. Among them, the execution functions corresponding to each device can be as follows:

[0100] The wireless image transmitting device 410 is used to obtain an image source signal; perform various signal processes on the image source signal respectively to obtain multiple candidate images. The signal process includes signal gain process and / or exposure time adjustment process; determine a to-be-encoded image from the multiple candidate images, and determine target parameters corresponding to the to-be-encoded image for the target signal process; perform encoding process on the to-be-encoded image to obtain target encoded data; and send the target encoded data and the target parameters.

[0101] The wireless image receiving device 420 is used to receive the target encoded data and the target parameters; decode the target encoded data, and obtain a target image for display based on the target parameters.

[0102] Regarding the wireless camera device in the above embodiments, the specific manners in which each device performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0103] In some optional application scenarios, as Figure 6 shown, the wireless camera device 400 may include a wireless image transmitting device 410 and a wireless image receiving device 420. The wireless image transmitting device 410 may include: a signal processing device 411, a screening module 412, an encoder 413, and a first wireless module 414. The signal processing device 411 may include multiple signal processing modules 4111. The wireless image receiving device 420 may include: a second wireless module 421, a decoder 422, a normalization processing module 423, and a display module 424. The process of image display by the Figure 7 wireless camera device shown can be as follows:

[0104] In the wireless image transmitting device 410, the acquired image source signal is respectively subjected to signal processing through a plurality of signal processing modules 4111, and the output of each signal processing module 4111 is used as a candidate image. Among them, the signal processing may include one or more of the following processes: signal gain processing, exposure time adjustment processing. That is, the signal processing module 4111 may be a processing module for performing signal gain processing, a processing module for performing exposure time adjustment processing, or a processing module for respectively performing signal gain processing and exposure time adjustment processing. Moreover, in the signal processing module 4111, an analog-to-digital converter may also be included, which is used to convert the processed image source signal from an analog signal into a digital signal that can be recognized by the wireless image transmitter 410, so as to obtain the corresponding candidate image. In one example, the signal processing module 4111 may include an analog-to-digital converter for performing analog-to-digital conversion processing on the image source signal after signal gain processing or on the image source signal after exposure time adjustment processing. In another example, the signal processing module 4111 may include two analog-to-digital converters, which are respectively used to perform analog-to-digital conversion processing on the image source signal after signal gain processing and on the image source signal after exposure time adjustment processing, thereby improving the generation efficiency of candidate images. The screening module 412 screens a plurality of candidate images to determine the optimal image to be encoded and the target parameters corresponding to the target signal processing of the image to be encoded. The encoder 413 encodes the image to be encoded to obtain the target encoded data. The first wireless module 414 sends the target encoded data and the target parameters to the wireless image receiving device 420 of the wireless imaging device.

[0105] In the wireless image receiving device 420, the second wireless module 421 receives the target encoded data and the target parameters sent by the wireless image transmitting device 410. The decoder 422 decodes the target encoded data to obtain a decoding result. The normalization processing module 423 performs normalization processing on the decoding result based on the target parameters to obtain the target image. The display module 424 displays the target image.

[0106] According to the image display method based on a wireless imaging device provided by the present disclosure, the best candidate image is selected from multiple candidate images as the image to be encoded, and image display is performed based on the image to be encoded. Without changing the hardware of the wireless imaging device, the quality and display effect of the image can be improved, and high dynamic range (HDR) of the wireless imaging device can be achieved. Moreover, a general image encoder / video encoder is used, so that the dynamic range of the image / video at the wireless image receiving device is greater than the dynamic range of the image encoder / video encoder. Furthermore, in the present disclosure, a general image encoder / video encoder can be used for encoding / decoding processing, so that the signal processing method and the image display method provided by the present disclosure have the characteristics of universality, convenience, and low cost.

[0107] Moreover, in the present disclosure, the encoder 413 and the decoder 422 only perform encoding / decoding processing on one of the candidate images, and the first wireless module 414 and the second wireless module 421 also perform wireless transmission on one encoded data. Thus, the computing load, computing resources, power consumption, and cost of the wireless image transmitting device and the wireless image receiving device can be greatly reduced. In addition, it helps to improve the reliability of wireless transmission.

[0108] Based on the same inventive concept, the present disclosure also provides a signal processing device applied to a wireless image transmitting device of a wireless imaging device. As Figure 7 shown, the signal processing device 500 may include:

[0109] An acquisition module 510, configured to acquire an image source signal;

[0110] A first processing module 520, configured to perform various signal processing operations on the image source signal respectively to obtain multiple candidate images, where the signal processing includes signal gain processing and / or exposure time adjustment processing;

[0111] A screening module 530, configured to determine an image to be encoded from multiple candidate images, and determine target parameters of the target signal processing corresponding to the image to be encoded;

[0112] A second processing module 540, configured to perform encoding processing on the image to be encoded to obtain target encoded data;

[0113] A sending module 550, configured to send the target encoded data and the target parameters, so as to decode the target encoded data through a wireless image receiving device of the wireless imaging device, and obtain a target image for display based on the target parameters.

[0114] In some embodiments, the screening module 530 includes: a first determination unit configured to determine the image quality of each candidate image respectively; a first screening unit configured to use the candidate image with the optimal image quality among the image qualities of multiple candidate images as the image to be encoded, and use the signal processing parameters corresponding to the candidate image with the optimal image quality as the target parameters.

[0115] In some embodiments, the screening module 530 includes: a second determination unit configured to determine the index parameter values of the target index parameters corresponding to each candidate image respectively based on the image pixels of each candidate image; a third determination unit configured to determine the standard parameter values of the target index parameters; a second screening unit configured to use the candidate image corresponding to the index parameter value closest to the standard parameter value as the image to be encoded, and use the signal processing parameters corresponding to the candidate image corresponding to the index parameter value closest to the standard parameter value as the target parameters.

[0116] In some embodiments, the target index corresponding to the target index parameters is a gain performance index and / or an exposure time performance index.

[0117] In some embodiments, the image source signal is one of the continuous multi-frame image source signals; the acquisition module 510 includes: an acquisition unit configured to sequentially acquire each frame of the image source signal so that the wireless image receiving device can display video content corresponding to the multi-frame image source signals.

[0118] In some embodiments, the target parameters are target gain parameters and / or target exposure time parameters; or the target parameters are parameter indication values corresponding to target signal processing.

[0119] Regarding the signal processing device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0120] Based on the same inventive concept, the present disclosure also provides an image display device, which is applied to a wireless image receiving device of a wireless camera device. As Figure 8 shown, the image display device 600 includes:

[0121] a receiving module 610 configured to receive the target encoded data and the target parameters sent by the wireless image transmitting device of the wireless camera device, where the target encoded data and the target parameters may be determined by any one of the signal processing methods provided by the present disclosure used by the wireless image transmitting device;

[0122] a third processing module 620 configured to decode the target encoded data and obtain a target image for display based on the target parameters;

[0123] a display module 630 configured to display the target image.

[0124] In some embodiments, the third processing module 620 includes: a decoding unit configured to decode target encoded data to obtain a decoding result; and a data processing unit configured to perform normalization processing on the decoding result according to target parameters to obtain a target image, where the target parameters include a target gain and / or a target exposure time.

[0125] In some embodiments, the image source signal corresponding to the target encoded data is one of a series of consecutive image source signals. The display module 630 includes: a first execution unit configured to sequentially display each target image to display video content corresponding to the series of image source signals; and a second execution unit configured to end image display in response to completion of display of the last target image.

[0126] Regarding the audio signal processing device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0127] Based on the same inventive concept, the present disclosure also provides a computer-readable storage medium storing the following program, and the program is used to execute any signal processing provided by the present disclosure or any image display method provided by the present disclosure.

[0128] This application uses specific terms to describe the embodiments of this application. For example, "one embodiment", "an embodiment", and / or "some embodiments" mean a certain feature, structure, or characteristic related to at least one embodiment of this application. Therefore, it should be emphasized and noted that "an embodiment" or "one embodiment" or "an alternative embodiment" mentioned twice or more at different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures, or characteristics in one or more embodiments of this application can be combined appropriately.

[0129] In the context of this application, unless the context clearly indicates an exception, the words "a", "an", "one", and / or "the" etc. do not specifically refer to the singular, but may also include the plural. Generally speaking, the terms "comprising" and "including" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list, and the method or device may also include other steps or elements.

[0130] Similarly, it should be noted that, in order to simplify the description of this application and thus help the understanding of one or more embodiments of the application, in the previous description of the embodiments of this application, sometimes multiple features are merged into one embodiment, drawing, or description thereof. However, this disclosure method does not mean that the features required by the object of this application are more than the features claimed in this disclosure. In fact, the features of the embodiment are less than all the features of the single embodiment disclosed above.

[0131] The basic concepts have been described above. Obviously, for those skilled in the art, the above disclosure is only an example and does not constitute a limitation to this application. Although not explicitly stated here, those skilled in the art may make various modifications, improvements, and corrections to this application. Such modifications, improvements, and corrections are proposed in this application, so such modifications, improvements, and corrections still fall within the spirit and scope of the embodiments of this application.

Claims

1. A signal processing method, applied to a wireless image transmitting device of a wireless camera device, the method comprising: Acquire image source signal; Performing a plurality of signal processing on the image source signals respectively to obtain a plurality of candidate images, wherein the signal processing includes signal gain processing and / or exposure time adjustment processing; Determine an image to be encoded from the plurality of candidate images, and determine target parameters for processing a target signal corresponding to the image to be encoded; Performing encoding processing on the image to be encoded to obtain target encoded data; The target coded data and the target parameters are transmitted so that the target coded data is decoded by the wireless image receiving device of the wireless camera apparatus and a target image for display is obtained based on the target parameters.

2. The signal processing method according to claim 1, wherein: The step of determining the image to be encoded from the plurality of candidate images, and determining target parameters for processing the target signal corresponding to the image to be encoded, comprises: respectively determining the image quality of each of the candidate images; The candidate image with the best image quality among the multiple candidate images is used as the image to be encoded, and the signal processing parameters corresponding to the candidate image with the best image quality are used as the target parameters.

3. The signal processing method according to claim 1, wherein: The step of determining the image to be encoded from the plurality of candidate images, and determining target parameters for processing the target signal corresponding to the image to be encoded, comprises: Based on the image pixels of each of the candidate images, respectively determine the index parameter value of the target index parameter corresponding to each of the candidate images; Determining a standard parameter value of the target indicator parameter; The candidate image corresponding to the index parameter value closest to the standard parameter value is used as the image to be encoded, and the signal processing parameter corresponding to the candidate image corresponding to the index parameter value closest to the standard parameter value is used as the target parameter.

4. The signal processing method according to claim 3, wherein: The target indicator corresponding to the target indicator parameter is a gain performance indicator and / or an exposure time performance indicator.

5. The signal processing method according to claim 1, wherein: The image source signal is one frame of a continuous plurality of frames of image source signals; The step of acquiring the image source signal comprises: Each frame of the image source signal is acquired in sequence, so that the wireless image receiving device displays video content corresponding to the multiple frames of image source signals.

6. The signal processing method according to claim 1, wherein: The target parameter is a target gain parameter and / or a target exposure time parameter; or The target parameter is a parameter indication value corresponding to the target signal processing.

7. An image display method, applied to a wireless image receiving device of a wireless camera device, the method comprising: Receiving target coding data and target parameters sent by the wireless image transmitting device of the wireless camera apparatus, wherein the target coding data and target parameters are determined by the wireless image transmitting device using the signal processing method described in any one of claims 1 to 6; Decoding the target coded data, and obtaining a target image for display based on the target parameters; The target image is displayed.

8. The image display method according to claim 7, wherein: The decoding of the target coded data and obtaining a target image for display based on the target parameter comprises: Decoding the target coded data to obtain a decoding result; The decoding result is normalized according to the target parameters to obtain the target image, where the target parameters include a target gain and / or a target exposure time.

9. The image display method according to claim 7 or 8, wherein: The image source signal corresponding to the target coded data is one frame of a continuous plurality of frames of image source signals, and the displaying of the target image comprises: Displaying each of the target images in sequence to display video content corresponding to the multiple frames of image source signals; In response to the last target image display being completed, the image display is ended.

10. A signal processing device, applied to a wireless image transmitting device of a wireless camera device, the device comprising: An acquisition module, used for acquiring an image source signal; A first processing module, configured to perform a plurality of signal processing on the image source signal to obtain a plurality of candidate images, wherein the signal processing includes signal gain processing and / or exposure time adjustment processing; A screening module, used to determine an image to be encoded from a plurality of candidate images, and determine target parameters for processing a target signal corresponding to the image to be encoded; A second processing module, used for performing encoding processing on the image to be encoded to obtain target encoded data; The sending module is used to send the target coded data and the target parameters so that the wireless image receiving device of the wireless camera device can decode the target coded data and obtain a target image for display based on the target parameters.

11. An image display device, applied to a wireless image receiving device of a wireless camera device, the device comprising: A receiving module, used for receiving target coding data and target parameters sent by the wireless image transmitting device of the wireless camera apparatus, wherein the target coding data and target parameters are determined by the wireless image transmitting device using the signal processing method according to any one of claims 1 to 6; A third processing module, used for decoding the target coded data, and obtaining a target image for display based on the target parameters; A display module is used to display the target image.

12. A wireless camera device, comprising a wireless image transmitting device and a wireless image receiving device; The wireless image transmitting device is used to obtain an image source signal; perform a plurality of signal processing on the image source signal to obtain a plurality of candidate images, wherein the signal processing includes signal gain processing and / or exposure time adjustment processing; determine an image to be encoded from the plurality of candidate images, and determine target parameters for target signal processing corresponding to the image to be encoded; perform encoding processing on the image to be encoded to obtain target encoded data; and send the target encoded data and the target parameters; The wireless image receiving device is used to receive the target coded data and the target parameters; decode the target coded data, and obtain a target image for display based on the target parameters.

13. A computer-readable storage medium storing the following program, wherein the program is used to execute the signal processing method according to any one of claims 1 to 6 or the image display method according to any one of claims 7 to 9.

Images