Image processing system, cloud server and method

Abstract

The disclosure provides an image processing system, a cloud server and a method, wherein the image processing system comprises a local end comprising at least one display terminal, a cloud server and a remote end comprising a plurality of image acquisition units; wherein: each display terminal is configured to send a data request to the cloud server; the cloud server is configured to receive the data request, determine a target application scenario from a plurality of application scenarios of the display terminal, and determine a target image acquisition unit from the plurality of image acquisition units, process original image data collected by the target image acquisition unit according to a target image processing algorithm corresponding to the target application scenario and the target image acquisition unit, and send the processed image data to the display terminal, so that the display terminal displays the processed image data.

Description

Technical Field

[0001] This disclosure relates to the field of image processing technology, and in particular to an image processing system, cloud server, and method. Background Technology

[0002] With the development of image acquisition and sensing technologies, cameras have been widely used in applications such as intelligent surveillance and smart homes. In these applications, corresponding terminal devices are often required to intelligently process the acquired images before presenting the results to the user. Even in specific scenarios such as first-person view (FPV), remote viewing, and reversing camera imaging, computers (PCs) or other devices are still needed at both the remote and local ends for image acquisition and content display control. Furthermore, each camera at the remote end is equipped with at least one image signal processing (ISP) chip to improve image quality. In addition, each display terminal at the local end can only display images from one camera in the application scenario. Therefore, the existing image processing process suffers from high costs and low data sharing efficiency. Summary of the Invention

[0003] This disclosure provides an image processing system, cloud server, and method, with the specific solutions as follows:

[0004] This disclosure provides an image processing system, comprising:

[0005] It includes a local terminal with at least one display terminal, a cloud server, and a remote terminal including multiple image acquisition units; wherein:

[0006] Each of the display terminals is configured to send a data request to the cloud server;

[0007] The cloud server is configured as follows:

[0008] The system receives the data request, determines the target application scenario from multiple application scenarios of the display terminal, and determines the target image acquisition unit from multiple image acquisition units. It processes the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and sends the processed image data to the display terminal so that the display terminal can display the processed image data.

[0009] Optionally, in this embodiment of the disclosure, the cloud server includes an image processing module, which is configured to:

[0010] The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms.

[0011] Determine the target application scenario and the target image acquisition unit corresponding to the original image data;

[0012] Based on the correspondence table, the target application scenario and the target image acquisition unit corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

[0013] Optionally, in this embodiment of the disclosure, the remote terminal includes an encoding / decoding module coupled to each of the image acquisition units, and the encoding / decoding module is configured to:

[0014] The system receives the data request from the cloud server and drives the target image acquisition unit to acquire the raw image data.

[0015] The original image data, the target application scene, and the target image acquisition unit are encoded into a single-channel digital signal, and the digital signal is sent to the image processing module.

[0016] Optionally, in this embodiment of the disclosure, the remote terminal includes a decoding module coupled to each of the image acquisition units, and the decoding module is configured to:

[0017] The system receives the data request from the cloud server and drives the target image acquisition unit to acquire the raw image data.

[0018] The raw image data is sent to the image processing module.

[0019] Optionally, in this embodiment of the disclosure, the cloud server further includes a display processing module, which is configured to:

[0020] Receive the data request from the display terminal;

[0021] The data request is parsed to determine the display parameters corresponding to the display terminal;

[0022] The target application scenario is determined from the plurality of application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from the plurality of image acquisition units as the target image acquisition unit.

[0023] Optionally, in this embodiment of the disclosure, the display terminal is configured as follows:

[0024] Receive the processed image data from the cloud server;

[0025] The processed image data is converted from a single-channel digital signal to a multi-channel analog signal;

[0026] The display is based on the analog signal.

[0027] Optionally, in this embodiment of the disclosure, the display terminal is configured as follows:

[0028] Receive user input, respond to the input, and generate the data request;

[0029] The data request is sent to the cloud server so that the cloud server can determine the target application scenario from the multiple application scenarios of the display terminal and the target image acquisition unit from the multiple image acquisition units based on the data request.

[0030] Accordingly, this disclosure provides a cloud server, which includes:

[0031] Display processing module and image processing module; wherein:

[0032] The display processing module is configured as follows:

[0033] Receive data requests sent by any of the display terminals in the local terminal, which includes at least one display terminal;

[0034] Based on the data request, a target application scenario is determined from multiple application scenarios of the display terminal, and a target image acquisition unit is determined from multiple image acquisition units included in the remote terminal.

[0035] The image processing module is configured as follows:

[0036] The original image data acquired by the target image acquisition unit is processed according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and the processed image data is sent to the display terminal so that the display terminal can display the processed image data.

[0037] Optionally, in this embodiment of the disclosure, the image processing module is configured as follows:

[0038] The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms.

[0039] Determine the target application scenario and the target image acquisition unit corresponding to the original image data;

[0040] Based on the correspondence table, the target application scenario and the target image acquisition unit corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

[0041] Optionally, in this embodiment of the disclosure, the display processing module is further configured to:

[0042] The data request is parsed to determine the display parameters corresponding to the display terminal;

[0043] The target application scenario is determined from multiple application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from multiple image acquisition units as the target image acquisition unit.

[0044] Accordingly, this disclosure provides an image processing method applied to a cloud server, comprising:

[0045] Receive data requests sent by any of the display terminals in the local terminal, which includes at least one display terminal;

[0046] Based on the data request, a target application scenario is determined from multiple application scenarios of the display terminal, and a target image acquisition unit is determined from multiple image acquisition units included in the remote terminal.

[0047] Based on the target application scenario and the target processing algorithm corresponding to the target image acquisition unit, the raw image data acquired by the target image acquisition unit is processed;

[0048] The processed image data is sent to the display terminal so that the display terminal can display the processed image data.

[0049] Optionally, in this embodiment of the disclosure, processing the raw image data acquired by the target image acquisition unit according to the target application scenario and the target processing algorithm corresponding to the target image acquisition unit includes:

[0050] The encoding / decoding module, which is coupled to each of the image acquisition units in the remote terminal, encodes the original image data, the target application scene, and the target image acquisition unit into a single-channel digital signal.

[0051] The target application scenario and the target image acquisition unit corresponding to the original image data are extracted from the digital signal by the image processing module in the cloud server.

[0052] Based on the correspondence table between application scenarios and image acquisition units and image processing algorithms stored on the cloud server, the target application scenario and the target image acquisition unit corresponding to the target image algorithm are determined from the multiple image processing algorithms included in the correspondence table.

[0053] The original image data is processed according to the target image algorithm.

[0054] Optionally, in this embodiment of the disclosure, after receiving a data request sent by any of the display terminals in a local terminal including at least one display terminal, the method further includes:

[0055] The data request is parsed by the display processing module in the cloud server to determine the display parameters corresponding to the display terminal;

[0056] The target application scenario is determined from the plurality of application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from the plurality of image acquisition units as the target image acquisition unit.

[0057] Accordingly, this disclosure provides an image processing method applied to a local terminal including at least one display terminal, wherein the method includes:

[0058] A data request is sent to the cloud server through any one of the at least one display terminal, so that the cloud server can determine the target application scenario from multiple application scenarios of the display terminal and the target image acquisition unit from multiple image acquisition units of the remote terminal according to the data request.

[0059] The cloud server receives image data after processing the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit.

[0060] The processed image data is then displayed.

[0061] Optionally, in this embodiment of the disclosure, displaying the processed image data includes:

[0062] The processed image data is converted from a single-channel digital signal into a multi-channel analog signal;

[0063] The display is based on the analog signal.

[0064] Optionally, in this embodiment of the disclosure, before sending a data request to the cloud server through any of the at least one display terminal, the method further includes:

[0065] Receive a first input operation from a user for a target application scenario among multiple application scenarios of the at least one display terminal;

[0066] In response to the first input operation, the data request is generated.

[0067] Optionally, in this embodiment of the disclosure, before sending a data request to the cloud server through any of the at least one display terminal, the method further includes:

[0068] The system receives a target application scenario from a user for any of the at least one display terminal, and a second input operation from the target image acquisition unit corresponding to the target application scenario.

[0069] In response to the second input operation, the data request is generated. Attached Figure Description

[0070] Figure 1 This is a schematic diagram illustrating one application scenario of an image processing system provided in an embodiment of the present disclosure;

[0071] Figure 2 This is a schematic diagram of one structure of an image processing system provided in an embodiment of the present disclosure;

[0072] Figure 3 This is a schematic diagram of one structure of an image processing system provided in an embodiment of the present disclosure;

[0073] Figure 4 A schematic diagram illustrating one encoding format of raw image data in an image processing system provided by an embodiment of this disclosure;

[0074] Figure 5 This is a schematic diagram of one structure of an image processing system provided in an embodiment of the present disclosure;

[0075] Figure 6 This is a schematic diagram of one possible structure of a cloud server provided in an embodiment of this disclosure;

[0076] Figure 7 A flowchart illustrating one method of an image processing method provided in this disclosure embodiment;

[0077] Figure 8 for Figure 7 Flowchart of one method for step S103;

[0078] Figure 9 In order to be in Figure 7 Flowchart of the method after step S101;

[0079] Figure 10 A flowchart illustrating another method of an image processing method provided in this disclosure embodiment;

[0080] Figure 11 for Figure 10 Flowchart of step S403;

[0081] Figure 12 In order to be in Figure 10 Flowchart of the first implementation method before step S401;

[0082] Figure 13 In order to be in Figure 10 The flowchart of the second implementation method before step S401. Detailed Implementation

[0083] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. Furthermore, the embodiments and features in the embodiments of this disclosure can be combined with each other without conflict. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0084] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure pertains. As used in this disclosure, the words “comprising” or “including” and similar terms mean that an element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, but do not exclude other elements or objects.

[0085] In existing technologies, for specific scenarios such as FPV, remote viewing, and reversing cameras, it is often necessary to equip both the remote and local ends with PCs or other devices for image acquisition and content display control. Furthermore, each camera on the remote end is equipped with at least one ISP chip to improve image quality. Therefore, the current image processing process is costly and has low data transmission efficiency.

[0086] In view of this, embodiments of the present disclosure provide an image processing system, cloud server, and method for reducing image processing costs and improving data sharing efficiency.

[0087] An image processing system provided in this disclosure can be applied to... Figure 1 The application scenarios shown are in Figure 1 The application scenario shown includes terminal device 1, cloud server 2, and multiple cameras 3. Figure 1The illustration shows a scenario where multiple cameras (3) are used in pairs. Terminal device 1 can be a mobile phone, tablet, augmented reality (AR) glasses, etc., without limitation. Cloud server 2 can be a server cluster or cloud computing center consisting of several servers. Terminal device 1, cloud server 2, and cameras 3 are connected via a network, which can be any communication network such as a local area network (LAN), wide area network (WAN), or mobile internet. Another possible application scenario is that the number of terminal devices can be multiple.

[0088] It should be noted that the application scenarios mentioned above are only shown to facilitate understanding of the spirit and principles of this disclosure, and the embodiments of this disclosure are not limited in any way. On the contrary, the embodiments of this disclosure can be applied to any applicable scenario.

[0089] The following is combined Figure 1 The application scenarios shown illustrate an image processing system provided in this disclosure.

[0090] Please refer to Figure 2 The diagram shown is a structural schematic of an image processing system provided in an embodiment of this disclosure. The image processing system includes:

[0091] It includes a local terminal 100 with at least one display terminal 10, a cloud server 200, and a remote terminal 300 including multiple image acquisition units 30; wherein:

[0092] Each of the display terminals 10 is configured to send a data request to the cloud server 200;

[0093] The cloud server 200 is configured as follows:

[0094] The system receives the data request, determines the target application scenario from multiple application scenarios of the display terminal 10, and determines the target image acquisition unit from multiple image acquisition units 30. It processes the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and sends the processed image data to the display terminal 10 so that the display terminal 10 can display the processed image data.

[0095] In this embodiment, the local terminal 100 may include one or more display terminals. The number of display terminals 10 included in the local terminal 100 can be set according to actual application needs, and is not limited here. The remote terminal 300 may include n image acquisition units 30, where n is an integer greater than 1. The number of image acquisition units 30 can be set according to actual application needs. Each image acquisition unit 30 may be a camera, an image sensor, or an image acquisition card, and is not limited here. In addition, the display terminal 10 may be a liquid crystal display (LCD), a quantum dot light-emitting diode (QLED) display, an organic light-emitting diode (OLED) display, etc., and is not limited here. The display terminal 10 may also include a touch screen.

[0096] In the specific implementation process, each of the at least one display terminal 10 is configured to send a data request to the cloud server. The data request may be triggered manually by the user on the display terminal 10, or it may be an input operation received by the display terminal 10 from the user. For example, the input operation may be a selection operation by the user for an application scenario and a camera model. The display terminal 10 responds to the input operation and generates a display request for displaying image content. For example, after the user selects an application scenario and a camera model on the display terminal 10, a data request is generated to collect images and display the corresponding image content according to the camera corresponding to the camera model under the selected application scenario.

[0097] The cloud server 200 receives the data request from the display terminal 10, determines a target application scenario from multiple application scenarios of the display terminal 10, and determines a target image acquisition unit from multiple image acquisition units. The number of application scenarios can be m, where m is an integer greater than 1. Each application scenario can be remote viewing, human-computer interaction, reversing camera, etc. There can be one target image acquisition unit and one target application scenario; these can be set according to the actual application and are not limited here.

[0098] The cloud server 200 can also process the original image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and send the processed image data to the display terminal 10 so that the display terminal 10 can display the processed image data. The original image data can be data generated by the target image acquisition unit from light signals transmitted from the outside world into electrical signals, and then from the electrical signals into digital signals. For example, the original image data can be image data represented by 8-bit grayscale values. The target image processing algorithm includes at least one of the following: black level correction algorithm, bad pixel correction algorithm, denoising algorithm, automatic white balance algorithm, and data augmentation algorithm. Specifically, processing the original image data using the black level correction algorithm can remove black levels from the original image data, thereby improving image quality. If bad pixels exist in the image, they will not only affect the values ​​of surrounding pixels, but also cause false color at the image edges and flickering of some pixels. Bad pixel correction of the original image data ensures the accuracy of pixel values ​​in the image. By performing automatic white balance processing on the raw image data, the influence of the light source on the image acquisition unit's imaging is eliminated, simulating the constancy of the human visual system and ensuring that the white seen by the human eye in any scene is true white, thereby improving image quality. Furthermore, image enhancement algorithms can enhance the local and overall contrast of the raw image data, making the original unsaturated color information saturated and richer.

[0099] In the specific implementation process, those skilled in the art can select the appropriate image processing algorithm to process the original image data according to the actual application needs. After determining the target application scenario and the target image processing algorithm corresponding to the remote terminal, the original image data from the remote terminal under the target application scenario can be processed, thereby improving the image quality and ensuring the display quality of the display terminal.

[0100] Still with Figure 2As shown, the local terminal 100 includes display terminal 001, display terminal 002, display terminal 003, ..., display terminal 00n. From multiple application scenarios (application scenarios 001, 002, 003, ..., 00n) included in display terminal 001 in the local terminal 100, application scenario 001 is determined as the target application scenario. From multiple image acquisition units (image acquisition unit 001, image acquisition unit 002, image acquisition unit 003, ..., image acquisition unit 00n), image acquisition unit 002 is determined as the target image acquisition unit. If the image processing algorithm corresponding to application scenario 001 and image acquisition unit 002 is ISP1, then the cloud server 200 can... The raw image data acquired by the image acquisition unit 002 is processed according to ISP1. In this way, the display terminal 001 can display the image acquired by the image acquisition unit 002 of application scenario 001. If application scenario 001 is determined as the target application scenario and image acquisition unit 002 is determined as the target image acquisition unit on other display terminals in the local terminal 100 that are different from the display terminal 001, the other display terminals can still display the image acquired by the image acquisition unit 002 of application scenario 001. In this way, each display terminal in the local terminal 100 can share the image data acquired by the same image acquisition unit in the remote terminal 300, thus ensuring the data sharing efficiency of the image processing system.

[0101] Taking the above example, if the application scenario 003 is determined as the target application scenario and the image acquisition unit 003 is determined as the target image acquisition unit from the display terminal 001 in the local terminal 100, then the display terminal 001 can display the image acquired by the image acquisition unit 003. In this way, the same display terminal in the local terminal 100 can display the image data acquired by different image acquisition units in the remote terminal 300, thereby realizing the sharing of image data acquired by different image acquisition units by the same display terminal and ensuring the data sharing efficiency of the image processing system.

[0102] Furthermore, regardless of which target application scenario is determined from the multiple application scenarios, or which target image acquisition unit is determined from the multiple image acquisition units, the cloud server 200 can use the target image processing algorithm corresponding to the target application scenario and the target image acquisition unit to process the raw image data acquired by the target image acquisition unit. The entire processing does not require setting an ISP chip in each display terminal 10 of the local terminal 100 and each image acquisition unit of the remote terminal 300, thereby ensuring that the image processing system reduces image processing costs while taking into account data sharing efficiency.

[0103] Figure 2 The diagram illustrates a structure where the number of display terminals 10, the number of image acquisition units 30, and the number of image processing algorithms included in the cloud server 200 are all n. In specific implementations, the number of display terminals 10, image acquisition units 30, and image processing algorithms in the image processing system can also be other, which will not be detailed here.

[0104] In this embodiment of the present disclosure, an image processing system comprising a local terminal 100 of at least one display terminal 10, a cloud server 200, and a remote terminal 300 comprising multiple image acquisition units 30, wherein each display terminal 10 is configured to send a data request to the cloud server 200, and the cloud server 200 is configured to receive the data request, determine a target application scenario from multiple application scenarios of the display terminal 10 according to the data request, and determine a target image acquisition unit from the multiple image acquisition units 30, process the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and then process the processed image data. The processed image data is sent to the display terminal 10 and displayed by the display terminal 10. In other words, the image acquisition content processing is realized through the cloud server 200. The entire image processing process not only eliminates the need to configure image processing devices at the remote terminal 300 and the local terminal 100 respectively, but also eliminates the need to configure an image processing chip for each image acquisition unit at the remote terminal 300, thereby reducing the cost of image processing. In addition, the same display terminal at the local terminal 100 can also display image data from different image acquisition units at the remote terminal 300, thereby realizing the sharing of image data acquired by different image acquisition units by the same display terminal and ensuring the data sharing efficiency of the image processing system.

[0105] In this disclosed embodiment, it is still combined with Figure 2 As shown, the cloud server 200 includes an image processing module 201, which is configured to:

[0106] The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms.

[0107] Determine the target application scenario and the target image acquisition unit corresponding to the original image data;

[0108] Based on the correspondence table, the target application scenario and the target image acquisition unit corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

[0109] In specific implementation, the image processing module 201 stores a correspondence table between application scenarios, image acquisition units, and image processing algorithms. This correspondence table includes multiple image processing algorithms. The table can be pre-stored by the cloud server 200 or manually created according to user needs. The table can be fixed or updated in real-time based on actual user usage. For example, it can be updated based on the user's evaluation of the image quality acquired by the remote terminal 300 on the display terminal 10 of the local terminal 100. For instance, if the image processing algorithm corresponding to correspondence a in the table is used to process the raw image data acquired by the image acquisition unit 001, and the user evaluates the display quality as poor after display on the display terminal 001, correspondence a can be updated based on the image processing algorithm used when the display quality is good. This updates the table and improves the user experience. Of course, those skilled in the art can use other implementation methods to update the table, which will not be detailed here.

[0110] In the specific implementation process, after determining the target application scenario and the target image acquisition unit corresponding to the original image data, the image processing module 201 can determine the target image algorithm corresponding to the target application scenario and the target image acquisition unit from the multiple image processing algorithms according to the correspondence table. In this way, the image processing module 201 can process the original image data according to the target image algorithm, thereby ensuring the quality of the processed image data.

[0111] In the embodiments disclosed herein, such as Figure 3 The diagram shows one possible structure of the image processing system. The remote terminal 300 includes an encoding / decoding module 301 coupled to each of the image acquisition units 30. The encoding / decoding module 301 is configured as follows:

[0112] The system receives the data request from the cloud server and drives the target image acquisition unit to acquire the raw image data.

[0113] The original image data, the target application scene, and the target image acquisition unit are encoded into a single-channel digital signal, and the digital signal is sent to the image processing module.

[0114] In specific implementation, the remote terminal 300 also includes the encoding / decoding module 301. The encoding / decoding module 301 is coupled to each image acquisition unit 30 in the remote terminal 300. The encoding / decoding module 301 receives data requests from the cloud server 200, parses the data requests, and drives the target image acquisition unit among the multiple image acquisition units to acquire images, thereby obtaining the original image data. Furthermore, the encoding / decoding module 301 encodes the original image data, the target application scene, and the target image acquisition unit into a single-channel digital signal. The encoding / decoding module 301 can encode the number representing the target application scene, the model representing the target image acquisition unit, and the original image data. For example, when the target application scene number is 00a, the target image acquisition unit model is 001, and the original image data is RAW data, "00a001" can be directly appended to the original image data as a grayscale value. Figure 4 The diagram shows one of the encoding formats of the original image data, wherein the target application scenario and the model of the remote terminal are appended to the first line of the image.

[0115] After the encoding / decoding module 301 encodes the original image data, the target application scene, and the target image acquisition unit, the encoding / decoding module 301 sends the encoded single-channel digital signal to the cloud server 200. The cloud server 200 parses the digital signal and, according to the correspondence table, determines the target image processing algorithm corresponding to the target application scene and the target image acquisition unit. It then processes the original image data to obtain processed image data. For example, if "00a001" is obtained from the first row of the digital signal, the first to third bits of "00a" correspond to the number of the target application scene, and the fourth to sixth bits of "001" correspond to the model of the target image acquisition unit. After parsing, the cloud server 200 can select an image processing algorithm suitable for the target application scene and the target image acquisition unit based on the number of the target application scene and the model of the target image acquisition unit. For example, algorithm b can be used to process the original image data acquired by the target image acquisition unit to obtain processed image data. On the one hand, the encoding / decoding module 301 can encode the original image data, the target application scene, and the target image acquisition unit into a single-channel digital signal, and then transmit the single-channel data signal, thereby improving data transmission efficiency. On the other hand, the cloud server 200 can allocate a more suitable target image processing algorithm to the original image data acquired by the target image acquisition unit, thereby ensuring the image quality of the acquired image, and thus ensuring the display quality of the display terminal and improving the user experience.

[0116] In the embodiments disclosed herein, such as Figure 5 The diagram shows one possible structure of the image processing system. The remote terminal 300 includes a decoding module 302 coupled to each of the image acquisition units 30. The decoding module 302 is configured as follows:

[0117] The system receives the data request from the cloud server 200 and drives the target image acquisition unit to acquire the raw image data.

[0118] The raw image data is sent to the image processing module 201.

[0119] In the specific implementation process, the decoding module 302, which is coupled to each of the image acquisition units 30 in the remote terminal 300, receives the data request from the cloud server 200. The decoding module 302 decodes the data request, drives the target image acquisition unit to acquire the original image data, and then sends the original image data to the image processing module 201. The image processing module 201 determines the target image processing algorithm to process the original image data. The image processing module 201 processes the original image data according to the target image processing algorithm and then sends the processed image data to the display terminal 10. Since the entire process only requires the decoding module 302 in the remote terminal 300 to decode the data request, drive the corresponding target image acquisition unit to acquire the original image data, and then determine the target image processing algorithm to process the original image data, the efficiency of processing the original image data is improved.

[0120] In this disclosed embodiment, it is still combined with Figure 3 As shown, the cloud server 200 further includes a display processing module 202, which is configured to:

[0121] Receive the data request from the display terminal;

[0122] The data request is parsed to determine the display parameters corresponding to the display terminal;

[0123] The target application scenario is determined from the plurality of application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from the plurality of image acquisition units as the target image acquisition unit.

[0124] In specific implementation, the cloud server 200 also includes a display processing module 202. The display processing module 202 receives the data request from the display terminal 10, parses the data request, and obtains the display parameters corresponding to the display terminal 10. These display parameters include resolution, refresh rate, interface type, and panel type, etc., which are not limited here. The interface types include High Definition Multimedia Interface (HDMI), DisplayPort (DP), Video Graphics Array (VGA), Digital Visual Interface (DVI), etc., and the panel types include VA, TN, and IPS, etc. For example, after a user selects a target application scenario from the application scenario list of the display terminal 10, the cloud server 200 can parse the data request to obtain the display parameters corresponding to the display terminal 10. Then, a target application scenario is determined from multiple application scenarios of the display terminal 10, and an image acquisition unit that matches the display parameters is determined from multiple image acquisition units as the target image acquisition unit, wherein the multiple application scenarios may be scenarios in the application scenario list.

[0125] For a concrete example, the cloud server 200 reads a string from display terminal A via the Extended Display Identification Data (EDID) protocol. This string includes supplier information, color setting information, manufacturer preset information, display name, display serial number, maximum supported resolution, maximum supported frame rate, and display bit width. The server 200 parses this string to determine the display parameters of display terminal A. Using the maximum supported resolution, maximum supported frame rate, and display bit width from display terminal A's display parameters, the server matches a camera a that meets the relevant parameter requirements. The determined maximum resolution, sampling frame rate, and data bit width of camera a match the display parameters of display terminal A. Since the matching image acquisition unit can be determined based on the display parameters of display terminal 10 itself, and this matched image acquisition unit is used as the target image acquisition unit, the display quality of display terminal 10 can be guaranteed when displaying the image data acquired by the target image acquisition unit.

[0126] In this embodiment of the disclosure, the display terminal 10 is configured as follows:

[0127] Receive the processed image data from the cloud server 200;

[0128] The processed image data is converted from a single-channel digital signal to a multi-channel analog signal;

[0129] The display is based on the analog signal.

[0130] In the specific implementation process, after receiving the processed image data from the cloud server 200, the display terminal 10 converts the processed image data from a single-channel digital signal into a multi-channel analog signal, and then displays the analog signal. For example, the multi-channel analog signal is an R, G, and B three-channel analog signal. On the one hand, since the entire data transmission and processing process is performed on a single-channel digital signal before the display terminal 10 displays the image data acquired by the target image acquisition unit, the transmission efficiency of the single-channel digital signal is guaranteed. On the other hand, before the display terminal 10 displays the image data acquired by the target image acquisition unit, the display terminal 10 converts the single-channel digital signal into a multi-channel analog signal, and then displays the multi-channel analog signal, thereby ensuring the display function of the display terminal 10 and improving the performance of the image processing system.

[0131] In this embodiment of the disclosure, the display terminal 10 is configured as follows:

[0132] Receive user input, respond to the input, and generate the data request;

[0133] The data request is sent to the cloud server 200 so that the cloud server 200 can determine the target application scenario from the multiple application scenarios of the display terminal 10 and the target image acquisition unit from the multiple image acquisition units based on the data request.

[0134] In specific implementation, the display terminal 10 can also receive user input operations, which can be user input operations on the target application scenario and the target image acquisition unit corresponding to the target application scenario in the display terminal 10. The input operations can be user click operations, double-click operations, drag operations, etc. on any option in the application scenario list in the display terminal 10. The input operations can also be user click operations, double-click operations, drag operations, etc. on any option in the image acquisition unit list in the display terminal 10. Of course, the input operations can be set according to actual application needs, which is not limited here.

[0135] After receiving the user's input operation, the display terminal 10 responds to the input operation by generating the data request. The display terminal 10 can send the data request to the display processing module 202 in the cloud server 200. Then, the display processing module 202 parses the data request, determines the target application scenario from the multiple application scenarios of the display terminal 10, and determines the target image acquisition unit from the multiple image acquisition units. For example, the display interface of the display terminal 10 displays a list of application scenarios and a list of camera models. The multiple options in the application scenario list include application scenario A, application scenario B, application scenario C, and application scenario D. The camera model list includes camera a, camera b, and camera c. After the user selects application scenario A and camera a, the display terminal 10 generates a data request for displaying image content and sends the data request to the display processing module 202. After receiving the data request, the display processing module 202 parses the data request to determine the application scenario A selected by the user from the application scenario list, and can use application scenario A as the target application scenario.

[0136] The display processing module 202 can also determine the camera model 'a' selected by the user from the camera model list of the display terminal 10, and use camera model 'a' as the corresponding camera as the target image acquisition unit for the target application scenario. In this way, the user can display the raw image data acquired by the target image acquisition unit in the target application scenario through the display terminal 10 according to actual needs, thereby satisfying the user's personalized display requirements through the display terminal 10.

[0137] Based on the same concept, such as Figure 6 As shown in the embodiments of this disclosure, a cloud server 200 is also provided, the cloud server 200 comprising:

[0138] Display processing module 202 and image processing module 201; wherein:

[0139] The display processing module 202 is configured to:

[0140] Receive data requests sent by any of the display terminals in the local terminal, which includes at least one display terminal;

[0141] Based on the data request, a target application scenario is determined from multiple application scenarios of the display terminal, and a target image acquisition unit is determined from multiple image acquisition units included in the remote terminal.

[0142] The image processing module 201 is configured to:

[0143] The original image data acquired by the target image acquisition unit is processed according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, and the processed image data is sent to the display terminal so that the display terminal can display the processed image data.

[0144] In this embodiment of the disclosure, the image processing module 202 is configured as follows:

[0145] The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms.

[0146] Determine the target application scenario and the target image acquisition unit corresponding to the original image data;

[0147] Based on the correspondence table, the target application scenario and the target image acquisition unit corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

[0148] In this embodiment of the disclosure, the display processing module 202 is further configured to:

[0149] The data request is parsed to determine the display parameters corresponding to the display terminal;

[0150] The target application scenario is determined from multiple application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from multiple image acquisition units as the target image acquisition unit.

[0151] It should be noted that the specific implementation of the display processing module 202 and the image processing module 201 in the cloud server 200 can be referred to the description of the image processing system section above, and will not be repeated here.

[0152] In the specific implementation process, the display processing module 202 and the image processing module 201 in the cloud server 200 can process the raw image data acquired by any image acquisition unit in the remote terminal 300. The whole process not only eliminates the need to configure image processing devices in the remote terminal 300 and the local terminal 100 respectively, but also eliminates the need to configure an image processing chip for each image acquisition unit in the remote terminal 300, thereby reducing the cost of image processing. In addition, the same display terminal 10 in the local terminal 100 can also display image data from different image acquisition units in the remote terminal 300, thereby realizing the sharing of image data acquired by different image acquisition units by the same display terminal and ensuring the efficiency of image data sharing.

[0153] Based on the same publicly disclosed concept, such as Figure 7 As shown in the embodiments of this disclosure, an image processing method is also provided, applied to a cloud server 200, comprising:

[0154] S101: Receive a data request sent by any of the display terminals in the local terminal including at least one display terminal;

[0155] S102: Based on the data request, determine the target application scenario from multiple application scenarios of the display terminal, and determine the target image acquisition unit from multiple image acquisition units included in the remote terminal;

[0156] S103: Process the raw image data acquired by the target image acquisition unit according to the target application scenario and the target processing algorithm corresponding to the target image acquisition unit;

[0157] S104: The processed image data is sent to the display terminal so that the display terminal can display the processed image data.

[0158] In the embodiments disclosed herein, such as Figure 8 As shown, step S103: Based on the target application scenario and the target processing algorithm corresponding to the target image acquisition unit, the original image data acquired by the target image acquisition unit is processed, including:

[0159] S201: Receive the encoding / decoding module in the remote terminal, which is coupled to each of the image acquisition units, and encode the original image data, the target application scene, and the target image acquisition unit into a single-channel digital signal;

[0160] S202: The target application scenario and the target image acquisition unit corresponding to the original image data are extracted from the digital signal by the image processing module in the cloud server;

[0161] S203: Based on the correspondence table between application scenarios and image acquisition units and image processing algorithms stored on the cloud server, determine the target application scenario and the target image acquisition unit corresponding to the target image processing algorithm from the multiple image processing algorithms included in the correspondence table;

[0162] S204: Process the original image data according to the target image algorithm.

[0163] In the embodiments disclosed herein, such as Figure 9 As shown, after receiving a data request from any of the display terminals in the local terminal including at least one display terminal in step S101, the method further includes:

[0164] S301: The display processing module in the cloud server parses the data request and determines the display parameters corresponding to the display terminal;

[0165] S302: Determine the target application scenario from the plurality of application scenarios of the display terminal, and determine the image acquisition unit that matches the display parameters from the plurality of image acquisition units as the target image acquisition unit.

[0166] It should be noted that the principle of the image processing method applied to the cloud server 200 is similar to that of the aforementioned image processing system. Therefore, the implementation of the image processing method applied to the cloud server 200 can refer to the implementation of the aforementioned image processing system, and the specific structure of the cloud server 200 can refer to the relevant implementation of the aforementioned image processing system. Repeated details will not be repeated.

[0167] Based on the same publicly disclosed concept, such as Figure 10 As shown, this disclosure also provides an image processing method applied to a local terminal including at least one display terminal, wherein the method includes:

[0168] S401: Send a data request to the cloud server through any of the at least one display terminal, so that the cloud server can determine the target application scenario from multiple application scenarios of the display terminal and determine the target image acquisition unit from multiple image acquisition units of the remote terminal according to the data request.

[0169] S402: Receive image data after the cloud server processes the original image data collected by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit;

[0170] S403: Display the processed image data.

[0171] In the embodiments disclosed herein, such as Figure 11 As shown, step S403: Displaying the processed image data includes:

[0172] S501: The processed image data is converted from a single-channel digital signal into a multi-channel analog signal;

[0173] S502: Display according to the analog signal.

[0174] In this embodiment of the disclosure, the data request can be generated using the following two implementation methods, but is not limited to these two implementation methods, such as... Figure 12As shown, in the first implementation, before step S401: sending a data request to the cloud server through any of the at least one display terminal, the method further includes:

[0175] S601: Receive a first input operation from a user for a target application scenario among multiple application scenarios of any of the at least one display terminal;

[0176] S602: In response to the first input operation, generate the data request.

[0177] like Figure 13 As shown, in the second implementation, before step S401: sending a data request to the cloud server through any of the at least one display terminal, the method further includes:

[0178] S701: Receive a user's target application scenario for multiple application scenarios of any one of the at least one display terminals, and a second input operation of the target image acquisition unit corresponding to the target application scenario;

[0179] S702: In response to the second input operation, generate the data request.

[0180] In the specific implementation process, the first input operation and the second input operation can be click operation, double click operation, drag operation, swipe operation, etc., and there is no limitation here.

[0181] It should be noted that the principle of the image processing method applied to a local terminal 100 including at least one display terminal 10 is similar to that of the aforementioned image processing system. Therefore, the implementation of the image processing method applied to the local terminal 100 can refer to the implementation of the aforementioned image processing system, and the specific structure of the local terminal 100 can refer to the relevant implementation of the aforementioned image processing system. Repeated details will not be repeated.

[0182] This disclosure provides an image processing system, a cloud server 200, and a method. The image processing system includes a local terminal 100 of at least one display terminal 10, a cloud server 200, and a remote terminal 300 including multiple image acquisition units 30. Each display terminal 10 is configured to send a data request to the cloud server 200. The cloud server 200 is configured to receive the data request, determine a target application scenario from multiple application scenarios of the display terminal 10 based on the data request, and determine a target image acquisition unit from the multiple image acquisition units 30. The system then processes the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit. Then, the processed image data is sent to the display terminal 10, which displays the processed image data. In other words, the image acquisition content processing is realized through the cloud server 200. The entire image processing process not only eliminates the need to configure image processing devices on the remote terminal 300 and the local terminal 100 respectively, but also eliminates the need to configure an image processing chip for each image acquisition unit on the remote terminal 300, thereby reducing the cost of image processing. In addition, the same display terminal on the local terminal 100 can also display image data from different image acquisition units on the remote terminal 300, thereby realizing the sharing of image data acquired by different image acquisition units on the same display terminal and ensuring the data sharing efficiency of the image processing system.

[0183] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0184] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0185] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0186] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0187] Although preferred embodiments of this disclosure have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this disclosure.

[0188] Obviously, those skilled in the art can make various modifications and variations to the embodiments of this disclosure without departing from the spirit and scope of the embodiments of this disclosure. Therefore, if these modifications and variations to the embodiments of this disclosure fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include these modifications and variations.

Claims

1. An image processing system, wherein, include: It includes a local terminal with at least one display terminal, a cloud server, and a remote terminal including multiple image acquisition units; wherein: Each of the display terminals is configured to send a data request to the cloud server; The cloud server is configured to: receive the data request, determine the target application scenario from multiple application scenarios of the display terminal, and determine the target image acquisition unit from multiple image acquisition units; process the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit; replace the image signal processing chip configured in each image acquisition unit in the remote terminal with a shared image signal processing algorithm; and send the processed image data to the display terminal so that the display terminal can display the processed image data. The target application scenario is at least one of the following sub-scenarios: first-person view acquisition, remote viewing, and reversing image; the target image processing algorithm is an image signal processing algorithm shared by the cloud server, and the target image processing algorithm includes at least one of the following: black level correction algorithm, bad pixel correction algorithm, denoising algorithm, automatic white balance algorithm, and data augmentation algorithm; the original image data is single-channel RAW data.

2. The system as claimed in claim 1, wherein, The cloud server includes an image processing module, which is configured as follows: The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms. Determine the target application scenario and the target image acquisition unit corresponding to the original image data; Based on the correspondence table, the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

3. The system as described in claim 2, wherein, The remote terminal includes an encoding / decoding module coupled to each of the image acquisition units, and the encoding / decoding module is configured to: The system receives the data request from the cloud server and drives the target image acquisition unit to acquire the raw image data. The original image data, the target application scene, and the target image acquisition unit are encoded into a single-channel digital signal, and the digital signal is sent to the image processing module.

4. The system as described in claim 2, wherein, The remote terminal includes a decoding module coupled to each of the image acquisition units, and the decoding module is configured to: The system receives the data request from the cloud server and drives the target image acquisition unit to acquire the raw image data. The raw image data is sent to the image processing module.

5. The system according to any one of claims 1-4, wherein, The cloud server also includes a display processing module, which is configured as follows: Receive the data request from the display terminal; The data request is parsed to determine the display parameters corresponding to the display terminal; The target application scenario is determined from the plurality of application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from the plurality of image acquisition units as the target image acquisition unit.

6. The system of claim 1, wherein, The display terminal is configured as follows: Receive the processed image data from the cloud server; The processed image data is converted from a single-channel digital signal to a multi-channel analog signal; The display is based on the analog signal.

7. The system of claim 6, wherein, The display terminal is configured as follows: Receive user input, respond to the input, and generate the data request; The data request is sent to the cloud server so that the cloud server can determine the target application scenario from the multiple application scenarios of the display terminal and the target image acquisition unit from the multiple image acquisition units based on the data request.

8. A cloud server, wherein, include: Display processing module and image processing module; wherein: The display processing module is configured as follows: Receive data requests sent by any of the display terminals in the local terminal, which includes at least one display terminal; Based on the data request, a target application scenario is determined from multiple application scenarios of the display terminal, and a target image acquisition unit is determined from multiple image acquisition units included in the remote terminal; the target application scenario is at least one sub-scenario among first-person view acquisition, remote viewing, and reversing image. The image processing module is configured as follows: The original image data acquired by the target image acquisition unit is processed according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit. The image signal processing chip configured in each image acquisition unit in the remote terminal is replaced by a shared image signal processing algorithm, and the processed image data is sent to the display terminal so that the display terminal can display the processed image data. The target image processing algorithm is an image signal processing algorithm shared by the cloud server, and the target image processing algorithm includes at least one of black level correction algorithm, bad pixel correction algorithm, noise reduction algorithm, automatic white balance algorithm, and data augmentation algorithm. The original image data is single-channel RAW data.

9. The cloud server as described in claim 8, wherein, The image processing module is configured as follows: The system stores a table of correspondences between application scenarios, image acquisition units, and image processing algorithms, and the table includes multiple image processing algorithms. Determine the target application scenario and the target image acquisition unit corresponding to the original image data; Based on the correspondence table, the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit are determined from the plurality of image processing algorithms.

10. The cloud server as described in claim 8, wherein, The display processing module is further configured to: The data request is parsed to determine the display parameters corresponding to the display terminal; The target application scenario is determined from multiple application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from multiple image acquisition units as the target image acquisition unit.

11. An image processing method applied to a cloud server, wherein, include: Receive data requests sent by any of the display terminals in the local terminal, which includes at least one display terminal; Based on the data request, a target application scenario is determined from multiple application scenarios of the display terminal, and a target image acquisition unit is determined from multiple image acquisition units included in the remote terminal. The target application scenario is at least one of the following sub-scenarios: first-person view acquisition, remote viewing, and reversing image. Based on the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit, the raw image data acquired by the target image acquisition unit is processed, and the image signal processing chip configured in each image acquisition unit in the remote terminal is replaced by a shared image signal processing algorithm; the target image processing algorithm is an image signal processing algorithm shared by the cloud server, and the target image processing algorithm includes at least one of black level correction algorithm, bad pixel correction algorithm, noise reduction algorithm, automatic white balance algorithm, and data augmentation algorithm; the raw image data is single-channel RAW data; The processed image data is sent to the display terminal so that the display terminal can display the processed image data.

12. The method of claim 11, wherein, The step of processing the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit includes: The encoding / decoding module, which is coupled to each of the image acquisition units in the remote terminal, encodes the original image data, the target application scene, and the target image acquisition unit into a single-channel digital signal. The target application scenario and the target image acquisition unit corresponding to the original image data are extracted from the digital signal by the image processing module in the cloud server. Based on the correspondence table between application scenarios and image acquisition units and image processing algorithms stored on the cloud server, the target application scenario and the target image acquisition unit corresponding to the target image processing algorithm are determined from the multiple image processing algorithms included in the correspondence table. The original image data is processed according to the target image processing algorithm.

13. The method of claim 11, wherein, After receiving a data request sent by any of the display terminals in the local terminal comprising at least one display terminal, the method further includes: The data request is parsed by the display processing module in the cloud server to determine the display parameters corresponding to the display terminal; The target application scenario is determined from the plurality of application scenarios of the display terminal, and the image acquisition unit that matches the display parameters is determined from the plurality of image acquisition units as the target image acquisition unit.

14. An image processing method applied to a local terminal including at least one display terminal, wherein, include: A data request is sent to the cloud server through any one of the at least one display terminal, so that the cloud server can determine the target application scenario from multiple application scenarios of the display terminal and the target image acquisition unit from multiple image acquisition units of the remote terminal according to the data request. The target application scenario is at least one of the following sub-scenarios: first-person view acquisition, remote viewing, and reversing image. The system receives image data after the cloud server processes the raw image data acquired by the target image acquisition unit according to the target application scenario and the target image processing algorithm corresponding to the target image acquisition unit; the target image processing algorithm is an image signal processing algorithm shared by the cloud server, and the target image processing algorithm includes at least one of the following: black level correction algorithm, bad pixel correction algorithm, denoising algorithm, automatic white balance algorithm, and data augmentation algorithm; the raw image data is single-channel RAW data. The processed image data is then displayed.

15. The method of claim 14, wherein, The process of displaying the processed image data includes: The processed image data is converted from a single-channel digital signal into a multi-channel analog signal; The display is based on the analog signal.

16. The method of claim 14, wherein, Before sending a data request to the cloud server through any of the at least one display terminal, the method further includes: Receive a first input operation from a user for a target application scenario among multiple application scenarios of any of the at least one display terminal; In response to the first input operation, the data request is generated.

17. The method of claim 14, wherein, Before sending a data request to the cloud server through any of the at least one display terminal, the method further includes: Receives a target application scenario from a user for multiple application scenarios of any one of the at least one display terminals, and a second input operation from the target image acquisition unit corresponding to the target application scenario; In response to the second input operation, the data request is generated.

Images