Data processing method, device, shooting system and computer storage medium
By obtaining and optimizing background resources and directly using the optimized background resources as the shooting background during shooting, the problem of high cost and mismatch between light and shadow effects in the existing technology is solved, and a low-cost and efficient shooting effect is achieved.
Patent Information
- Application Number
- CN202110116576.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-28
- Publication Date
- 2025-08-29
- Estimated Expiration
- 2041-01-28
Smart Images

Figure CN113315925B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of electronic information technology, and in particular to data processing methods, devices, shooting systems, and computer storage media. Background Art
[0002] In the broadcasting, film, and television industries, when live action isn't possible, a solid-color screen is often used as the background for filming. This involves placing a solid-color screen in the background area that needs to be composited later. After filming is complete, the green screen area is removed using video editing software and the required background content is filled in. However, this post-production composite stage imposes high production costs and time on film and television production. Furthermore, composite technology divides filming into two parts: on-set shooting and post-production. This can easily lead to a mismatch between the lighting on-set and the lighting and shadow effects produced in post-production, affecting the final filming effect. Summary of the Invention
[0003] In view of this, embodiments of the present application provide a data processing method, device, shooting system, and computer storage medium to solve some or all of the above problems.
[0004] According to the first aspect of an embodiment of the present application, a data processing method is provided, which is applied to a terminal device, and includes: obtaining a target background resource to be displayed, the target background resource including an image resource and / or a video resource; performing image quality optimization processing on the image in the background resource according to reference information; and displaying the background resource so that the image in the background resource is shot as the background.
[0005] According to the second aspect of an embodiment of the present application, a data processing method is provided, which is applied to a server, and includes: receiving a download request sent by a terminal device, the download request being used to request downloading a target background resource; sending the background resource and feature information of the background resource to the terminal device according to the download request, so as to optimize the image quality of the image in the background resource according to the feature information, and shooting with the image in the background resource as the background.
[0006] According to the third aspect of an embodiment of the present application, a terminal device is provided, which includes: an acquisition module for acquiring target background resources to be displayed, the target background resources including image resources and / or video resources; a picture quality optimization module for performing picture quality optimization processing on the image in the background resource based on reference information; and a display module for displaying the background resource so that the image in the background resource can be photographed as the background.
[0007] According to the fourth aspect of an embodiment of the present application, a server is provided, which includes: a receiving module for receiving a download request sent by a terminal device, the download request being used to request downloading a target background resource; a sending module for sending the background resource and feature information of the background resource to the terminal device according to the download request, so as to optimize the image quality of the image in the background resource according to the feature information, and shoot with the image in the background resource as the background.
[0008] According to the fifth aspect of the embodiment of the present application, a shooting system is provided, including: a display screen, a server, a terminal device and a photographic device; the terminal device is the terminal device described in the third aspect of the embodiment of the present application, and the server is the server described in the fourth aspect of the embodiment of the present application; wherein the server is communicatively connected with the terminal device, and the server stores at least one background resource, and the at least one background resource includes an image resource and / or a video resource; the terminal device is used to send a download request to the server, and the download request is used to request downloading of a target background resource; the server is used to send the target background resource corresponding to the download request to the terminal device; the terminal device is also used to optimize the image quality of the image in the background resource according to reference information; the display screen is electrically connected to the terminal device, and the display screen is used to display the target background resource transmitted by the terminal device; the photographic device is used to shoot with the picture displayed on the display screen as the background when the display screen displays the target background resource.
[0009] According to the sixth aspect of the embodiments of the present application, an electronic device is provided, including: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the data processing method described in the first aspect or the second aspect.
[0010] According to a seventh aspect of an embodiment of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the data processing method described in the first aspect or the second aspect is implemented.
[0011] The data processing method, device, shooting system, and computer storage medium provided by the embodiments of the present application include the following steps: obtaining a target background resource to be displayed, the target background resource including an image resource and / or a video resource; optimizing the image quality of the image in the background resource based on reference information, the reference information being used to indicate the situation during the background resource display process; and displaying the background resource so that the image in the background resource can be used as the background for shooting. During the shooting process, the terminal device optimizes the image quality of the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. In addition, on-site shooting can ensure that the background and real-scene lighting effects match, resulting in better shooting effects. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.
[0013] Figure 1 A schematic diagram of a photographing system provided in Example 1 of the present application;
[0014] Figure 2 A block diagram of image quality optimization provided in Example 1 of the present application;
[0015] Figure 3 A logic block diagram of a shooting method provided in Example 1 of the present application;
[0016] Figure 4 A flowchart of a data processing method provided in Example 2 of the present application;
[0017] Figure 5 A flowchart of a data processing method provided in Example 3 of the present application;
[0018] Figure 6 A structural diagram of a terminal device provided in Example 4 of the present application;
[0019] Figure 7 A structural diagram of a server provided in Example 5 of the present application;
[0020] Figure 8 This is a structural diagram of an electronic device provided in Example 6 of the present application. DETAILED DESCRIPTION
[0021] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field should fall within the scope of protection of the embodiments of the present application.
[0022] The specific implementation of the embodiment of the present application is further explained below in conjunction with the accompanying drawings of the embodiment of the present application.
[0023] Example 1
[0024] The first embodiment of the present application provides a shooting system, referring to Figure 1 As shown, Figure 1A schematic diagram of a shooting system provided in Example 1 of the present application. Figure 1 The shooting system shown includes a display screen 101, a server 102, a terminal device 103 and a photographic device 104;
[0025] The server 102 is in communication with the terminal device 103, and the server 102 stores at least one background resource, which includes an image resource and / or a video resource;
[0026] The terminal device 103 is used to send a download request to the server 102, where the download request is used to request downloading of a target background resource;
[0027] The server 102 is used to send a target background resource corresponding to a download request to the terminal device 103;
[0028] The terminal device 103 is further configured to optimize the image quality of the image in the background resource according to the reference information;
[0029] The display screen 101 is electrically connected to the terminal device 103, and the display screen 101 is used to display the target background resource transmitted by the terminal device 103;
[0030] The photographing device 104 is used to take a photo with the image displayed on the display screen 101 as the background when the display screen 101 displays the target background resource.
[0031] It should be noted that this embodiment is only described using a display screen as an example, and it can also be displayed other than through a display screen. For example, a 3D image can be displayed through holographic projection, or displayed on a screen or other plane through a projector. The terminal device can be a smart phone, a tablet computer, a laptop computer, and other devices. The terminal device 103 can access the network, connect to the server 102 through the network, and exchange data. In this application, the network includes a local area network (LAN), a wide area network (WAN), and a mobile communication network; such as the World Wide Web (WWW), Long Term Evolution (LTE), 2G network (2nd Generation Mobile Network), 3G network (3rd Generation Mobile Network), 5G network (5th Generation Mobile Network), etc. Of course, this is just an exemplary description and does not mean that this application is limited to this.
[0032] It should be noted that, in the present application, background resources are resources displayed as background on the display screen 101 when the shooting device is shooting. A background resource can be an image (i.e., image resource) or a video (i.e., video resource). Images can include dynamic images and static images; videos can include at least one image frame and can also include audio data. Background resources can include 2D videos, computer animation (English: Computer Graphics, CG), 3D models, etc. The target background resource can be any background resource in the server 102. This application uses the target background resource as an example for illustration, and does not imply any limitation. Any background resource can be processed in the same way as the target background resource.
[0033] It should also be noted that the reference information is used to indicate the situation during the display process of the background resource. For example, in one embodiment, the reference information includes at least one of feature information, environmental parameters, and device parameters, wherein the feature information can be used to indicate the image quality characteristics of the target background resource; the device parameters are used to indicate the display effects supported by the display screen, for example, the brightness, color gamut, bit depth, etc. supported by the display screen; the environmental parameters are used to indicate the situation of the shooting environment, for example, the environmental parameters may include the ambient light intensity.
[0034] Combine Figure 1 As shown, the terminal device 103 downloads the background resource from the server 102 and displays it on the display screen 101. During the shooting process, the content displayed on the display screen 101 (i.e., the background resource) is used as the background for shooting. The subject is between the lens of the photographic device 104 and the display screen 101, and the subject can be directly photographed in the scene displayed by the background resource. For example, the background resource can be stored in the server 102, and the producer shoots and uploads it to the server 102. For example, the producer can shoot a set of video materials on a selected road section, covering different time periods, different climate conditions, different traffic densities, etc. After completing the necessary post-production splicing, rendering, and editing and color grading, the video content is converted according to the resource standards of the server 102 to obtain the background resource, and then uploaded to the server 102. If a user needs to use the flowing road as the background during the video shooting process, the background resource can be downloaded from the server 102 using the terminal device 103 and displayed on the display screen 101, and the content displayed on the display screen 101 is used as the background for shooting.
[0035] Based on the above description, two specific application scenarios are listed here to illustrate the processing of background resources by the server 102 and the terminal device 103 respectively.
[0036] Optionally, in the first application scenario, the server 102 is described in detail. The server 102's processing of background resources may include review, storage, copyright protection, classification, query, editing, preview, and purchase of background resources. Here, four specific examples are listed for explanation.
[0037] Optionally, in the first example, the server 102 is also used to receive background resources sent by other devices, and store background resources that meet the resource standards. What is described here is the review and warehousing of background resources. The review is based on the resource standards. Those that do not meet the resource standards are prohibited from being stored. Storage means storing the background resources in a resource library in the cloud. The resource standards of background resources can specify the time period to be covered, the minimum duration, and the minimum resolution, bit rate, model accuracy, etc. of the image in the output specifications. The standardization of the background resource production stage ensures the integrity and quality of the background resources, enables background resources to be applied in different environments, and enables the same background resource to be reused multiple times, thereby improving the utilization rate of background resources. Furthermore, before storing the background resource, it can be encrypted according to a preset encryption algorithm to achieve copyright protection of the background resource. If the user purchases the background resource through the terminal device 103, the encrypted background resource can be downloaded and can only be played in the interface corresponding to the server 102 (application interface or web page), or can only be decrypted and played on the terminal device 103 bound to the user, but the user cannot share the background resource with others for playback.
[0038] Optionally, in the second example, the server 102 is further configured to classify the background resources using a preset classification model and to add corresponding tags to the background resources based on the classification results. The classification model may be a pre-trained neural network model. After the user adds tags to the background resources using the classification model, it is convenient for the user to search. Tags are used to indicate the characteristics of the scene displayed by the background resources. For example, tags may include night scenes, snowy days, rainy days, buildings, traffic, etc. The user can browse the page on the terminal device 103 to understand which background resources are stored in the server 102. Using tags for screening or searching can more quickly find the required background resources.
[0039] Optionally, in a third example, server 102 is further configured to generate preview data for background resources. Upon receiving a preview request from terminal device 103, server 102 sends the preview data to terminal device 103; terminal device 103 then plays the preview data. A user on terminal device 103 can browse a page to learn which background resources are stored by server 102. The browsing page can display a brief overview of the background resources and also preview data of the background resources. For example, the background resource can be a video resource, and the preview data can be a small portion of the video resource. The user can view the preview data to understand the scene content of the background resource. For another example, the background resource can be an image resource, and the preview data can be a thumbnail of the image resource. Of course, this is merely an example.
[0040] Optionally, in the fourth example, the server 102 is further configured to generate a download link for the background resource; when the user triggers downloading of the background resource through the terminal device 103, the terminal device 103 obtains the download link for the background resource and downloads the background resource according to the download link.
[0041] In combination with the above description, the processing of the background resource by the server 102 may further include image data analysis of the background resource, image quality restoration, etc. Here, three examples are listed for illustration respectively.
[0042] Optionally, in the first example, server 102 is further configured to perform image data analysis on at least one of the image brightness, noise intensity, blur level, and problem areas of the target background resource, and generate feature information based on the results of the image data analysis. The feature information is used to indicate at least one of the image brightness, noise intensity, blur level, and problem areas of the target background resource. Specifically, image data analysis of the background resource can be performed using an image processing algorithm and / or a neural network model, and the background resource can be adjusted accordingly based on the analysis results to meet shooting requirements.
[0043] Optionally, in the second example, the server 102 is further configured to perform image quality restoration processing on the target background resource based on the feature information. For example, if the background resource image has high noise intensity, noise reduction processing can be performed; if the background resource image color gradient transition is not smooth, resulting in gradient stripes, the grayscale / bit depth can be increased; if the background resource image has low sharpness, resulting in image blur, sharpening can be increased.
[0044] Optionally, in the third example, the server 102 is further configured to determine a bit rate of the target background resource based on the feature information, compress the target background resource based on the determined bit rate of the target background resource, and transmit the compressed target background resource to the terminal device 103. For example, in an image of a background resource, a higher compression ratio is usually used for low-detail areas to save bit rate, but this compression strategy may cause color banding problems in the display. When the display content is used as the background, the problem is more obvious. Therefore, in the present application, a higher bit rate may be allocated to the low-detail area to make the color transition in this area smoother, thereby avoiding the color banding problem.
[0045] Optionally, in the second application scenario, the terminal device 103 side is described in detail, that is, the on-site shooting is described.
[0046] Optionally, in one embodiment, the display screen 101 may include a light emitting diode (LED) screen array, wherein the LED screen array includes at least two LED screens. During on-site filming, the entire display screen 101 may be formed by splicing together small screens. The LED screen array may be constructed at the location where the LED display screen 101 is required, based on the actual scene, shooting angle, and screen size of the on-site setup. A small screen may be a 0.5m×0.5m square screen. Of course, this is merely an example.
[0047] After the terminal device 103 obtains the background resource from the server 102, it can also adjust the background resource when displaying. For example, the terminal device 103 is also used to adjust the image parameters of the background resource and one or more of the device parameters of the display screen 101 to meet the shooting requirements. Exemplarily, the image parameters of the background resource may include brightness, hue, color temperature, bit depth, etc.; the device parameters of the display screen 101 may include brightness, hue, color temperature, etc. It should be noted that the adjustment of the image parameters and / or device parameters by the terminal device 103 can be based on the adjustment instructions input by the user, or it can be adjusted automatically. Here, four specific examples are listed for illustration:
[0048] Optionally, in the first example, the terminal device 103 is configured to obtain an adjustment instruction from the user and perform image optimization processing on the image in the background resource according to the adjustment instruction. For example, when a photographer needs to increase the brightness of the captured background to enhance the background's lighting effects, the dark and bright areas are differentiated based on the image brightness information in the feature information. For areas where color fringes and obvious flaws may appear after increasing the brightness, the original brightness may be maintained.
[0049] Optionally, in the second example, the terminal device 103 is further used to receive characteristic information corresponding to the target background resource sent by the server 102, the characteristic information being used to indicate the image quality characteristics of the target background resource; and the target background resource is optimized according to the characteristic information. The terminal device 103 optimizes the image quality of the background resource to better meet the shooting requirements and improve the shooting quality. For example, taking the example where the characteristic information indicates that the image in the background resource contains gradient stripes, in this case, if the color gamut of the display reaches P3 and the bit depth of the display supports 10 bits (bit) or higher, no additional processing is required. If the bit depth of the display is lower than 10 bits or the color gamut does not reach P3, the image in the background resource can be optimized. Specifically, color level smoothing optimization can be performed to make the color level transition smoother. Optionally, the color scale smoothing optimization may specifically include: determining whether the color difference between two adjacent color bands is greater than 1; if the color difference is greater than 1, dividing the two adjacent color bands into N thinner color bands, wherein the color difference between each two adjacent color bands in the N thinner color bands is less than or equal to 1, where N is an integer greater than 2. Of course, the above processing may be performed on only a portion of the image of the background resource, or may be performed on the entire image.
[0050] Optionally, in the third example, the reference information also includes device parameters; the terminal device 103 is further configured to determine the display effects supported by the display screen based on the device parameters, and to optimize the image quality of the image in the background resource based on the display effects supported by the display screen and the characteristic information. By optimizing the image quality of the background resource in combination with the device parameters and characteristic information, the background resource can be displayed on the display screen in a manner consistent with the characteristics of the display screen, thereby achieving a display effect that meets the shooting requirements.
[0051] Optionally, in a fourth example, the reference information further includes environmental parameters; the terminal device 103 is further configured to determine, based on the environmental parameters, a photographic effect obtained by photographing the background resource under the environment indicated by the environmental parameters; and to optimize the image quality of the background resource based on the photographic effect and the characteristic information. Because environmental influences are taken into account, the background resource, after image quality optimization based on the environmental parameters and characteristic information, when displayed on the display screen, conforms to the current environment and meets the photographic requirements.
[0052] Of course, the image quality of the images in the background resources can also be optimized according to the feature information, device parameters and environmental parameters. The above is only an exemplary description and does not mean that this application is limited to this.
[0053] Optionally, combine the processing of background resources by the server and the terminal device, such as Figure 2 As shown, Figure 2A block diagram of image quality optimization is provided for the first embodiment of the present application. The server performs image data analysis on the background resource and generates feature information based on the analysis results. The image quality is repaired based on the feature information to obtain background resources that meet the resource standards. The terminal device downloads the background resource from the server and decodes it. The image quality of the background resource is optimized based on the feature information. The device parameters and environmental parameters can also be adjusted. The environmental parameters may include the brightness of the ambient light (light), etc. Finally, the adjusted background resource is displayed on the LED screen array.
[0054] Optionally, in combination with the above Figure 1 The shooting system shown, Figure 3 As shown, Figure 3 This is a logic block diagram of a shooting method provided in Example 1 of the present application. Figure 3 In the filming method, there are three parts: background resource production, server-side processing, and on-site shooting. In the background resource production part, the producer shoots the video, edits it according to the resource standards of the background resource, and uploads it to the server through other devices (resource management client); in the server-side processing part, the server reviews and stores the uploaded background resources, and can also perform image data analysis, image quality restoration, and transcoding encryption on the background resources; in on-site shooting, the terminal device downloads the background resources from the server, optimizes the image quality of the background resources, and displays them on the LED screen array (i.e., display screen). Using a photographic device, the picture displayed on the LED screen array is used as the background for shooting. Of course, during the shooting process, lighting assistance can also be used to achieve better shooting effects. The final real-life shot includes the content displayed by the background resource and the real scene, which has a better shooting effect and reduces production costs and time costs. Taking the shooting of film and television dramas as an example, when actors perform when the background resources are displayed on the display screen, they do not need to imagine the scene out of thin air and can more easily immerse themselves in the situation. In combination with the above explanation, two specific examples are listed here. For example, during the filming of a film or TV series, if you need to shoot a certain building, such as a hotel or factory, if the on-site shooting requires renting a venue, and it may not be permitted to shoot, it will also affect the other party's normal operations. Therefore, you can download the background resources of the required hotel, factory, etc. videos on the server, and then display the background resources, and then let the actors stand in front of the displayed screen to perform, and the shooting can be completed; for example, if you need to shoot a place that is difficult for someone to reach, such as a scenic spot, a place that has disappeared in history, or a place that relies on imagination, you can also download the relevant background resources on the server, and then display the background resources for shooting. This not only greatly reduces the cost of on-site rental at the front end, but also reduces the cost of editing at the back end, and it is easier for actors to immerse themselves in the performance. Of course, this is just an example.
[0055] The shooting system provided by the embodiment of the present application includes a display screen, a server, a terminal device and a photographic device. The server is communicatively connected to the terminal device. The server stores at least one background resource, and the at least one background resource includes an image resource and / or a video resource. The terminal device is used to send a download request to the server, and the server is used to send a target background resource corresponding to the download request to the terminal device. The terminal device is also used to optimize the image quality of the image in the background resource according to the reference information. The display screen is electrically connected to the terminal device, and the display screen is used to display the target background resource transmitted by the terminal device. The photographic device is used to shoot with the picture displayed on the display screen as the background when the display screen displays the target background resource. During the shooting process, the terminal device optimizes the image quality of the background resource and then displays the background. There is no need for post-cutting and synthesis, which reduces the production cost and time cost. In addition, on-site shooting can ensure that the background and the real scene light and shadow effects match, and the shooting effect is better.
[0056] Example 2
[0057] In combination with the shooting system described in Example 1, Example 2 of the present application provides a data processing method for use in Figure 1 The terminal equipment shown, refer to Figure 4 As shown, Figure 4 This is a flowchart of a data processing method provided in Example 2 of the present application, the method comprising the following steps:
[0058] Step 401: Acquire target background resources to be displayed.
[0059] The target background resources include image resources and / or video resources. Optionally, in one embodiment, obtaining the target background resources to be displayed includes: sending a download request to the server, the download request is used to request downloading of the target background resources; receiving the target background resources sent by the server in accordance with the download request, the server storing at least one background resource. The user can purchase the target background resources through the terminal device, and after the purchase is successful, the terminal device downloads the target background resources according to the download link of the target background resource. Optionally, in another embodiment, the target background resources are stored on the terminal device or other device, and the terminal device can directly read the target background resources. Of course, the above is only an exemplary description.
[0060] Step 402: Optimize the image quality of the image in the background resource according to the reference information.
[0061] Optionally, the reference information includes at least one of feature information, environmental parameters, and device parameters. Further, three examples are listed here for illustration.
[0062] Optionally, in the first example, the reference information includes feature information; the method also includes: receiving feature information corresponding to the target background resource sent by the server, the feature information is used to indicate the image quality characteristics of the target background resource; performing image quality optimization processing on the image in the background resource according to the reference information, including: performing image quality optimization processing on the target background resource according to the feature information.
[0063] Optionally, in the second example, the reference information includes feature information and device parameters; the image in the background resource is optimized according to the reference information, including: determining the display effect supported by the display screen according to the device parameters, and optimizing the image in the background resource according to the display effect supported by the display screen and the feature information.
[0064] Optionally, in the third example, the reference information includes characteristic information and environmental parameters; the image in the background resource is optimized according to the reference information, including: determining, according to the environmental parameters, a shooting effect after shooting with the background resource as the background in the environment indicated by the environmental parameters; and optimizing the image in the background resource according to the shooting effect and characteristic information.
[0065] Of course, the above is only an example description. The reference information may also include feature information, device parameters, and environmental parameters, and the image quality of the image in the background resource may be optimized based on the feature information, device parameters, and environmental parameters.
[0066] Step 403: Display the background resource so that the image in the background resource can be used as the background for shooting.
[0067] Two examples are provided for specific explanation. In the first example, a background resource can be displayed on a display screen, so that an image in the background resource displayed on the display screen can be used as the background for shooting. The display screen can be an LED screen array. In the second example, the background resource can be displayed so that an image in the background resource can be used as the background for shooting, including: displaying the background resource through holographic projection technology so that a 3D image in the background resource can be used as the background for shooting. Using holographic projection technology to display the 3D image in the background resource can better integrate the displayed image into the actual environment, resulting in better shooting effects.
[0068] It should also be noted that users can change background resources through interactive operations. For example, a background change request is generated by detecting a user operation and sent to the server. The background change request is used to indicate the replacement of a new background. The server receives the new background resource sent by the server and uses the new background resource to replace the background so that the image in the new background resource can be used as the background for shooting. The new background resource can be processed and displayed in the same way as described in steps 401-403, and will not be repeated here.
[0069] The data processing method provided in the embodiments of the present application obtains a target background resource to be displayed, the target background resource including an image resource and / or a video resource; optimizes the image quality of the image in the background resource based on reference information, the reference information being used to indicate the situation during the background resource display process; and displays the background resource so that the image in the background resource can be used as the background for shooting. During the shooting process, the terminal device optimizes the image quality of the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. In addition, on-site shooting can ensure that the background and the real-life lighting effects match, resulting in better shooting effects.
[0070] Example 3
[0071] In combination with the shooting system described in Example 1, Example 3 of the present application provides a data processing method for use in Figure 1 The server shown, refer to Figure 5 As shown, Figure 5 This is a flowchart of a data processing method provided in Example 3 of the present application, the method comprising the following steps:
[0072] Step 501: Receive a download request sent by a terminal device.
[0073] The download request is used to request downloading of the target background resource.
[0074] It should be noted that the server stores at least one background resource, and the background resource on the server may be uploaded by a background resource creator via another device. For example, in one embodiment, the method further includes: receiving background resources sent by another device, encrypting the background resources that meet resource standards according to a preset encryption algorithm, and storing the encrypted background resources.
[0075] Furthermore, the server can also perform image data analysis on the background resource. Taking the target background resource as an example, the method also includes: performing image data analysis on at least one of the image brightness, noise intensity, blur level, and problem area of the target background resource, and generating feature information based on the results of the image data analysis. The feature information is used to indicate at least one of the image brightness, noise intensity, blur level, and problem area of the target background resource. After performing image data analysis on the background resource, the background resource can be processed based on the feature information obtained from the analysis. Here, two examples are listed for illustration:
[0076] Optionally, in the first example, the method further includes: performing image quality restoration processing on the target background resource according to the feature information. For example, the image quality restoration processing may include noise reduction, increasing grayscale / bit depth, etc.
[0077] Optionally, in the second example, the method further includes: determining a bit rate of the target background resource according to the characteristic information, compressing the target background resource according to the determined bit rate of the target background resource, and transmitting the compressed target background resource to the terminal device.
[0078] Of course, this is just an exemplary description. The server can also perform other processing on the background resources, which is described in detail in the first embodiment and will not be repeated here.
[0079] Step 502: Send the background resource and feature information of the background resource to the terminal device according to the download request, so as to optimize the image quality of the image in the background resource according to the feature information, and shoot with the image in the background resource as the background.
[0080] The data processing method provided in an embodiment of the present application receives a download request sent by a terminal device, where the download request is used to request the download of a target background resource; sends the background resource and its characteristic information to the terminal device based on the download request, so as to optimize the image quality of the image in the background resource based on the characteristic information, and then shoots the image using the background resource as the background. During the shooting process, the terminal device optimizes the image quality of the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. In addition, on-site shooting can ensure that the background and real-life lighting effects match, resulting in better shooting effects.
[0081] Example 4
[0082] In combination with the description of embodiment 1 and embodiment 2, embodiment 4 of the present application provides a terminal device for executing the method described in embodiment 2 above, referring to Figure 6 As shown, the terminal device includes:
[0083] An acquisition module 601 is configured to acquire target background resources to be displayed, where the target background resources include image resources and / or video resources.
[0084] The image quality optimization module 602 is used to optimize the image quality of the image in the background resource according to the reference information;
[0085] The display module 603 is used to display background resources so that the images in the background resources can be used as background for shooting.
[0086] Optionally, in one embodiment of the present application, the reference information includes at least one of feature information, environmental parameters, and device parameters.
[0087] Optionally, in one embodiment of the present application, the reference information includes feature information; the acquisition module 601 is further configured to receive feature information corresponding to the target background resource sent by the server, where the feature information is used to indicate the image quality characteristics of the target background resource;
[0088] The image quality optimization module 602 is used to optimize the image quality of the target background resource according to the feature information.
[0089] Optionally, in one embodiment of the present application, the reference information also includes device parameters; the image quality optimization module 602 is used to determine the display effect supported by the display screen based on the device parameters, and optimize the image quality of the image in the background resource based on the display effect supported by the display screen and feature information.
[0090] Optionally, in one embodiment of the present application, the reference information also includes environmental parameters; the image quality optimization module 602 is used to determine the shooting effect after shooting with the background resources as the background in the environment indicated by the environmental parameters based on the environmental parameters; and perform image quality optimization processing on the image in the background resources based on the shooting effect and feature information.
[0091] Optionally, in one embodiment of the present application, the acquisition module 601 is used to send a download request to the server, where the download request is used to request downloading of a target background resource; and receive the target background resource sent by the server according to the download request, where the server stores at least one background resource.
[0092] The terminal device provided in the embodiment of the present application obtains a target background resource to be displayed, the target background resource including an image resource and / or a video resource; performs image quality optimization processing on the image in the background resource based on reference information, the reference information being used to indicate the situation during the background resource display process; and displays the background resource so that the image in the background resource can be used as the background for shooting. During the shooting process, the terminal device optimizes the image in the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. In addition, on-site shooting can ensure that the background and real-life lighting effects match, resulting in better shooting effects.
[0093] Example 5
[0094] In combination with the description of embodiment 1 and embodiment 3, embodiment 5 of the present application provides a server for executing the method described in embodiment 3 above, referring to Figure 7 As shown, the server includes:
[0095] The receiving module 701 is used to receive a download request sent by a terminal device, where the download request is used to request downloading of a target background resource;
[0096] The sending module 702 is used to send the background resource and feature information of the background resource to the terminal device according to the download request, so as to optimize the image quality of the background resource according to the feature information and shoot with the image in the background resource as the background.
[0097] The server also includes a processing module 703, which is optionally used in one embodiment of the present application to perform image quality restoration processing on the target background resource according to the feature information.
[0098] Optionally, in one embodiment of the present application, the processing module 703 is used to determine the bit rate of the target background resource according to the characteristic information, compress the target background resource according to the determined bit rate of the target background resource, and transmit the compressed target background resource to the terminal device.
[0099] Optionally, in one embodiment of the present application, the receiving module 701 is further configured to receive background resources sent by other devices; the processing module 703 is configured to encrypt and store background resources that meet resource standards according to a preset encryption algorithm.
[0100] The server provided in the embodiment of the present application receives a download request sent by a terminal device, where the download request is used to request the download of a target background resource. Based on the download request, the server sends the background resource and its characteristic information to the terminal device, so that the image in the background resource is optimized based on the characteristic information, and the image in the background resource is used as the background for shooting. During the shooting process, the terminal device optimizes the image in the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. Furthermore, on-site shooting can ensure that the background and real-life lighting effects match, resulting in better shooting effects.
[0101] Example 6
[0102] Based on the description of the above embodiments 1 to 5, the sixth embodiment of the present application provides an electronic device for executing the method described in the above embodiment 2 or 3, referring to Figure 8 As shown, Figure 8 This is a structural diagram of an electronic device provided in Example 6 of the present application. The specific embodiments of the present application do not limit the specific implementation of the electronic device.
[0103] like Figure 8 As shown, the electronic device may include: a processor (processor) 802 , a communication interface (Communications Interface) 804 , a memory (memory) 806 , and a communication bus 808 .
[0104] in:
[0105] The processor 802 , the communication interface 804 , and the memory 806 communicate with each other via a communication bus 808 .
[0106] The communication interface 804 is used to communicate with other electronic devices such as terminal devices or servers.
[0107] The processor 802 is configured to execute the program 810 , and specifically may execute the relevant steps in the above method embodiment.
[0108] Specifically, the program 810 may include program codes, which include computer operation instructions.
[0109] Processor 802 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the electronic device may be processors of the same type, such as one or more CPUs, or may be processors of different types, such as one or more CPUs and one or more ASICs.
[0110] The memory 806 is used to store the program 810. The memory 806 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
[0111] The program 810 may be specifically configured to enable the processor 802 to execute any of the methods in the aforementioned second embodiment or third embodiment.
[0112] The specific implementation of each step in program 810 can be found in the corresponding descriptions of the corresponding steps and units in the above-mentioned data processing method embodiment, and will not be repeated here. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding process descriptions in the above-mentioned method embodiment, and will not be repeated here.
[0113] The data processing method provided in the embodiments of the present application obtains a target background resource to be displayed, the target background resource including an image resource and / or a video resource; optimizes the image quality of the image in the background resource based on reference information, the reference information being used to indicate the situation during the background resource display process; and displays the background resource so that the image in the background resource can be used as the background for shooting. During the shooting process, the terminal device optimizes the image quality of the background resource and then displays the background, eliminating the need for post-production cutout synthesis, reducing production costs and time costs. In addition, on-site shooting can ensure that the background and the real-life lighting effects match, resulting in better shooting effects.
[0114] Example 7
[0115] Based on the description of the above-mentioned embodiments 1 to 5, embodiment 7 of the present application provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the method described in embodiment 2 or embodiment 3 is implemented.
[0116] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.
[0117] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or be implemented as software or computer code that can be stored in a recording medium (such as CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or be implemented as computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded via a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a special-purpose processor or programmable or special-purpose hardware (such as ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the data processing method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the data processing method shown here, the execution of the code converts the general-purpose computer into a special-purpose computer for executing the data processing method shown here.
[0118] Those skilled in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.
[0119] The above implementation methods are only used to illustrate the embodiments of the present application, and are not intended to limit the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of the present application, and the scope of patent protection of the embodiments of the present application should be defined by the claims.
Claims
1. A data processing method, applied to a terminal device, comprising: Acquire a target background resource to be displayed and feature information of the target background resource, wherein the target background resource includes an image resource and / or a video resource, and the feature information is used to indicate the image quality characteristics of the target background resource; Performing image quality optimization processing on the image in the background resource according to reference information, the reference information including the feature information, environmental parameters and device parameters, the device parameters being used to indicate a display effect supported by a display screen, the performing image quality optimization processing on the image in the background resource according to the reference information comprising: determining the display effect supported by the display screen according to the device parameters, performing image quality optimization processing on the image in the background resource according to the display effect supported by the display screen and the feature information, and determining, according to the environmental parameters, a shooting effect after shooting with the background resource as a background under an environment indicated by the environmental parameters, performing image quality optimization processing on the image in the background resource according to the shooting effect and the feature information, the environmental parameters including ambient light intensity; The background resource is displayed on the display screen so that the image in the background resource is used as the background for shooting.
2. The method according to claim 1, wherein The method further comprises: Detecting a user operation to generate a background change request, and sending the background change request to the server, wherein the background change request is used to instruct to change to a new background; A new background resource sent by the server is received, and the background is replaced by the new background resource, so as to shoot with the image in the new background resource as the background.
3. The method according to claim 1, wherein The displaying of the background resource so as to use the image in the background resource as the background for shooting includes: The background resource is displayed by holographic projection technology so that the 3D image in the background resource is used as the background for shooting.
4. A data processing method, applied to a server, comprising: receiving a download request sent by a terminal device, wherein the download request is used to request downloading a target background resource; The background resource and characteristic information of the background resource are sent to the terminal device according to the download request, so that the terminal device executes the data processing method according to any one of claims 1-3.
5. The method according to claim 4, wherein The method further comprises: Image data analysis is performed on at least one of the image brightness, noise intensity, blur degree, and problem area of the target background resource, and the feature information is generated based on the result of the image data analysis, wherein the feature information is used to indicate at least one of the image brightness, noise intensity, blur degree, and problem area of the target background resource.
6. The method according to claim 5, wherein: The method further comprises: Perform image quality restoration processing on the target background resource according to the feature information.
7. The method according to claim 5, wherein: The method further comprises: The server is further configured to determine a bit rate of the target background resource according to the characteristic information, compress the target background resource according to the determined bit rate of the target background resource, and transmit the compressed target background resource to the terminal device.
8. The method according to claim 4, wherein: The method further comprises: Receive background resources sent by other devices, encrypt the background resources that meet the resource standards according to the preset encryption algorithm, and store them.
9. A terminal device comprising: An acquisition module, configured to acquire a target background resource to be displayed and feature information of the target background resource, wherein the target background resource includes an image resource and / or a video resource, and the feature information is used to indicate the image quality characteristics of the target background resource; an image quality optimization module, configured to perform image quality optimization processing on the image in the background resource according to reference information, the reference information including the feature information, environmental parameters, and device parameters, the device parameters being used to indicate display effects supported by a display screen, the image quality optimization processing on the image in the background resource according to the reference information comprising: determining the display effects supported by the display screen according to the device parameters, performing image quality optimization processing on the image in the background resource according to the display effects supported by the display screen and the feature information, and determining, according to the environmental parameters, a shooting effect after shooting with the background resource as the background under the environment indicated by the environmental parameters, and performing image quality optimization processing on the image in the background resource according to the shooting effect and the feature information, the environmental parameters including ambient light intensity; The display module is used to display the background resource through the display screen so that the image in the background resource can be used as the background for shooting.
10. A server comprising: A receiving module, configured to receive a download request sent by a terminal device, wherein the download request is used to request downloading of a target background resource; A sending module is used to send the background resource and feature information of the background resource to the terminal device according to the download request, so that the terminal device executes the data processing method according to any one of claims 1-3.
11. A photographing system comprising: A display screen, a server, a terminal device, and a photographic device; the terminal device is the terminal device according to claim 9, and the server is the server according to claim 10; The server is in communication with the terminal device, and the server stores at least one background resource, wherein the at least one background resource includes an image resource and / or a video resource; The terminal device is used to send a download request to the server, wherein the download request is used to request downloading of a target background resource; The server is used to send the target background resource corresponding to the download request to the terminal device; The terminal device is further configured to perform image quality optimization processing on the image in the background resource according to the reference information; The display screen is electrically connected to the terminal device, and the display screen is used to display the target background resource transmitted by the terminal device; The photographing device is used to take pictures with the picture displayed on the display screen as the background when the display screen displays the target background resource.
12. An electronic device comprising: A processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the data processing method according to any one of claims 1 to 8.
13. A computer storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the data processing method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Video display configuration device and video capturing equipment of LED display screen
CN201383314Y
Photographic image display system
CN203827421U
Background synthetic machine for video projection
CN2550807Y
Picture taking device and method, and projecting device and method
JP2003131310A
Photographing system and photographing method
JP2019040004A