An image transmission method for real-time rendering of Web three-dimensional scenes

Abstract

The present application relates to the field of image transmission technology, and in particular to an image transmission method for real-time rendering of Web three-dimensional scenes. The method includes: obtaining multiple frames of images obtained by multi-angle scanning of a target object, determining the target area of ​​the target image in the multiple frames of images, and the difference between the target area and the area corresponding to the same position as the target area in the previous frame of the target image; determining the texture value of the target area; determining the target compression ratio corresponding to the target area according to the multiplication value of the texture value of the target area and the difference degree value; performing image compression processing on the target area according to the target compression ratio to obtain a target compressed image; sending multiple target compressed images corresponding to the multiple frames of images to a server, so that the server performs real-time rendering of the three-dimensional scene of the target object according to the multiple target compressed images. Through the above technical solution, the amount of data processing required by the server can be effectively reduced.

Description

Technical Field

[0001] The present application relates to the field of image transmission technology, and in particular to an image transmission method for real-time rendering of a Web three-dimensional scene. Background Art

[0002] Real-time rendering of three-dimensional scenes refers to the computer generating images of three-dimensional virtual scenes and displaying them on the screen. Real-time rendering of three-dimensional scenes can be applied to video games, virtual reality, augmented reality and real-time simulation.

[0003] In order to achieve real-time rendering of three-dimensional scenes, in the related art, for example, in the Chinese patent application document with publication number CN105263050A, a real-time rendering system for mobile terminals based on a cloud platform is provided, including: a central control unit deployed on a cloud server, a three-dimensional scene management system and cluster, a distributed storage system and cluster, a rendering management service system and cluster, and a load balancing system and cluster respectively connected to the central control unit; a three-dimensional scene management system and cluster, which is used to divide the three-dimensional scene data transmitted from the mobile terminal according to the type of the model group of the three-dimensional scene to obtain three-dimensional scene model group data; a distributed storage system and cluster, which is used to store the three-dimensional scene model group data and automatically adjust the storage location according to different data requirements under different three-dimensional scenes; a rendering management service system and cluster, which is used to retrieve the three-dimensional scene model group data stored in the distributed storage system and cluster, establish and manage the rendering task of the three-dimensional scene image, and finally obtain the three-dimensional scene rendering result data, and compress the obtained three-dimensional scene rendering result data and send it to the mobile terminal; a load balancing system and cluster, which is used to deploy and manage the rendering task process using a dynamic load strategy.

[0004] To facilitate three-dimensional scene rendering of the target object, a scanning device can be used to scan the target object at multiple angles to obtain multiple scanned images, and the scanned images can be sent to a server so that the server can perform three-dimensional scene rendering of the target object based on the scanned images sent by the scanning device; however, in order to ensure the scanning effect of the target object, a large number of scanned images are used to scan the target object, which makes the server have to process a large amount of data for the scanned images when rendering the three-dimensional scene. Summary of the invention

[0005] In order to overcome the problem of a large amount of data processing of scanned images by a server when performing three-dimensional scene rendering in the related art, the present application provides an image transmission method for real-time rendering of Web three-dimensional scenes, comprising: obtaining multiple frames of images obtained by performing multi-angle scanning on a target object, and determining a difference degree value between the target area and a first area for a target area of ​​the target image in the multiple frames of images, wherein the first area is an area corresponding to the same position as the target area in a previous frame of the target image; determining a texture value of the target area according to brightness values ​​of multiple pixels in the target area, wherein the texture value is used to characterize the texture complexity of the target area; determining a target compression ratio corresponding to the target area according to a multiplication value of the texture value of the target area and the difference degree value, so as to determine multiple target compression ratios corresponding to multiple target areas in the target image; performing image compression processing on the target area according to the target compression ratios corresponding to the target area, so as to perform image compression on multiple target areas in the target image to obtain target compressed images; and sending the multiple target compressed images corresponding to the multiple frames of images to a server, so that the server performs real-time rendering of a three-dimensional scene of the target object according to the multiple target compressed images.

[0006] Optionally, determining the difference degree value between the target area and the first area includes: ; Wherein, R is the difference between the target area and the first area, N is the number of pixels in the target area, is the brightness value corresponding to the k-th pixel in the target area, is the brightness value corresponding to the kth pixel in the first area.

[0007] In this way, the information of the pixel point can be effectively represented by the brightness value corresponding to the pixel point. Even in the absence of chromaticity information (U channel and V channel of the image), the difference between two pixels located at the same position in different image areas can be effectively compared through the brightness value corresponding to the pixel point, so as to determine the degree of difference between the target area and the first area.

[0008] Optionally, determining the texture value of the target area according to the brightness values ​​of a plurality of pixels in the target area includes: , where F is the texture value of the target area, N is the number of pixels in the target area, is the m+1th brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the mth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the Nth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the first brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, m is a positive integer less than N, To take the absolute value operation.

[0009] In this way, by determining the texture value of the target area, it is helpful to retain the key information in the image during the subsequent image compression process, while for the non-critical information in the image, there is a high probability that it can be obtained through the previous frame of the target image, or, the information loss is small when compressing the image area containing non-critical information. Therefore, it helps to balance the retention of information and the smaller storage occupancy after image compression processing.

[0010] Optionally, the brightness values ​​of multiple pixels in the target area are obtained in the following manner: converting the format of the target image to obtain a first image whose image format is YUV, and determining a Y channel image from the first image; using the pixel values ​​of multiple pixels in a second area in the Y channel image as the brightness values ​​of multiple pixels in the target area, the second area being an area in the Y channel image corresponding to the same position as the target area.

[0011] In this way, since the brightness value corresponding to the pixel point can effectively represent the information of the pixel point, by converting the format of the target image to obtain the brightness value corresponding to the pixel point in the target area, it is helpful to determine the texture value of the target area according to the brightness value corresponding to the pixel point in the target area.

[0012] Optionally, determining a target compression ratio corresponding to a target area based on the product of a texture value and a difference degree value of the target area includes: taking the product of a texture value and a difference degree value of the target area as a target parameter value of the target area; determining a third area having a largest target parameter value from multiple target areas located in multiple target images, and taking a ratio of the target parameter value of the third area to the target parameter value of the target area as the target compression ratio corresponding to the target area.

[0013] In this way, compared with compressing the entire target image with a lower compression ratio, it is possible to further compress the target area in the target image containing non-critical information with a higher compression ratio, thereby further reducing the storage occupancy of the compressed image; compared with compressing the entire target image with a higher compression ratio, it is possible to compress the target area in the target image containing critical information with a lower compression ratio, thereby retaining the critical information in the target image after compression, reducing the degree of loss of critical information in the image compression process.

[0014] Optionally, performing image compression processing on the target area according to a target compression ratio corresponding to the target area includes: determining a target quantization matrix corresponding to the target compression ratio from multiple preset quantization matrices; different preset quantization matrices correspond to different compression ratios; and performing JPEG compression processing on the target area according to the target quantization matrix.

[0015] Optionally, the multiple-frame images obtained by performing a multi-angle scan on the target object are acquired in the following manner: in response to receiving a scan request sent by a user, sending a first control instruction to a scanning device, the first control instruction being used to control the scanning device to acquire a second image of the target object; receiving the second image sent by the scanning device and displaying it; displaying a first control when the display time of the second image is greater than a preset time, the first control being used to prompt the user whether to scan the target object; in response to receiving a confirmation scan operation on the first control, sending a second control instruction to the scanning device; the second control instruction being used to control the scanning device to acquire multiple-frame images of the target object at different shooting angles; receiving the multiple-frame images of the target object at different shooting angles sent by the scanning device.

[0016] Optionally, the method also includes: upon receiving a confirmation scan operation for the first control, displaying a scan configuration interface; the scan configuration interface is used for the user to input scan parameters, the scan parameters including scan resolution, scan speed, and light intensity of the scan environment; receiving the scan parameters entered by the user in the scan configuration interface, and sending a third control instruction to the scanning device according to the scan parameters, the third control instruction being used to enable the scanning device to control the scanning process of the target object according to the scan parameters.

[0017] Optionally, the method also includes: when the scanning device performs a single-angle scan on the target object, receiving the single-angle scanned image sent by the scanning device and displaying a watermark information list; in response to receiving a user's selection operation on the target watermark information in the watermark information list, and generating a target single-angle scanned image based on the single-angle scanned image and the target watermark information.

[0018] The technical solution provided by the embodiments of the present application may include the following beneficial effects: by determining the target compression ratio of the target area in the target image obtained by scanning the target object, the target compression ratio of the target area can be matched with the actual situation of the target area, and the target area is compressed according to the target compression ratio corresponding to the target area to obtain a target compressed image; while avoiding information loss in the target area, the storage occupancy of the target image can be effectively reduced, and multiple target compressed images corresponding to multiple frames of images can be sent to the server, so that the server performs real-time rendering of the three-dimensional scene of the target object based on the multiple target compressed images, which can effectively reduce the amount of data processing required by the server and improve the efficiency of real-time rendering of the three-dimensional scene of the target object.

[0019] At the same time, the target compression ratio of the target area is determined based on the texture value of the target area and the difference value between the target area and the area corresponding to the same position in the previous frame image. Therefore, it is possible to obtain a compressed image with a smaller storage occupancy while retaining the texture information in the target area; and the target compression ratio value of the target area is determined based on the degree of difference, so that image information with a lower degree of repetition can be retained during compression, thereby avoiding information loss during the image compression process.

[0020] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0022] Figure 1 is a schematic diagram of an application scenario according to an exemplary embodiment;

[0023] Figure 2 The present invention is a flowchart showing an image transmission method for real-time rendering of a Web three-dimensional scene according to an exemplary embodiment. DETAILED DESCRIPTION

[0024] Here, exemplary embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application.

[0025] First, the application scenarios of the embodiments of the present application are briefly introduced. Figure 1As shown, in the application scenario of the present application, the scanning device, the terminal device and the server can be communicatively connected, and the terminal device can send control instructions to the scanning device through the server to enable the scanning device to perform a scanning task on the target object.

[0026] The scanning device can send multiple scanned images obtained by scanning the target object to the server, so that the server can render the three-dimensional scene of the target object in real time based on the multiple scanned images. In order to ensure the scanning effect of the target object; for example, in order to ensure the scanning effect of a water cup, the water cup can be scanned from multiple directions to obtain multiple scanned images of the water cup at different angles.

[0027] The server can perform feature matching on pixel points in the scanned image based on the scanned image received from the scanning device to construct three-dimensional data of the target object, and render a three-dimensional scene of the target object based on the constructed three-dimensional data; for example, a virtual water cup is generated based on the scanning result of the physical water cup, and the rendering result of the virtual water cup is loaded into the three-dimensional game scene.

[0028] The server can send the data of the three-dimensional game scene to the terminal device so that the user can view the three-dimensional game scene through the terminal device; however, in order to ensure the scanning effect of the target object, a large number of scanned images are scanned for the target object, which makes the server have a large amount of data processing for the scanned images when rendering the three-dimensional scene, which is not conducive to reducing the operating pressure of the server.

[0029] In view of the above technical problems, the present application provides an image transmission method for real-time rendering of a Web three-dimensional scene. Figure 2 is a flowchart of an image transmission method for real-time rendering of a Web three-dimensional scene according to an exemplary embodiment, which can be applied to terminal devices such as Figure 2 As shown, the method includes the following steps.

[0030] In step S101, a plurality of frames of images obtained by performing multi-angle scanning on a target object are acquired, and for a target area of ​​the target image in the plurality of frames of images, a difference degree value between the target area and the first area is determined.

[0031] The first region is a region corresponding to the same position as the target region in the previous frame image of the target image. For example, when the size of the target region is an 8×8 image region, the target region is an 8×8 image region located at the upper left corner of the target image. The 8×8 image region located at the upper left corner in the previous frame image of the target image can be used as the first region to compare the difference between the first region and the target region.

[0032] If the features of the area in the current frame image are consistent with the features of the area corresponding to the same position in the previous frame image, it means that there may be repeated scanning between the current frame image and the previous frame image, and the information in the image area in the current frame image is already included in the previous frame image, or can be easily obtained through the information of the area corresponding to the same position in the previous frame image; therefore, determining the difference degree value between the target area and the first area helps to determine the compression ratio of the target area, taking into account the compression efficiency of the image and the completeness of the information.

[0033] In one embodiment, determining the difference between the target area and the first area includes: ; Wherein, R is the difference between the target area and the first area, N is the number of pixels in the target area, is the brightness value corresponding to the k-th pixel in the target area, is the brightness value corresponding to the kth pixel in the first area.

[0034] The brightness value corresponding to the pixel point can effectively represent the information of the pixel point. Even in the absence of chromaticity information (U channel and V channel of the image), the brightness value corresponding to the pixel point can effectively compare the difference between two pixels located at the same position in different image areas, so as to determine the degree of difference between the target area and the first area.

[0035] Among them, the brightness value corresponding to the pixel point can be obtained by converting the image where the pixel point is located into a YUV image, and using the pixel value at the corresponding position of the pixel point in the Y channel of the YUV image as the brightness value corresponding to the pixel point; in the YUV image, Y represents brightness, and U and V represent chromaticity.

[0036] In step S102, the texture value of the target area is determined according to the brightness values ​​of a plurality of pixels in the target area.

[0037] The texture value is used to characterize the texture complexity of the target area; the larger the texture value, the higher the texture complexity of the target area, and the target area has a greater probability of containing key information in the image; on the contrary, the smaller the texture value, the smaller the texture complexity of the target area, and the target area has a higher probability of containing non-key information in the image.

[0038] In one embodiment, determining the texture value of the target area according to the brightness values ​​of a plurality of pixels in the target area includes: , where F is the texture value of the target area, N is the number of pixels in the target area, is the m+1th brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the mth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the Nth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the first brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, m is a positive integer less than N, To take the absolute value operation.

[0039] By and The difference divided by N-1 can provide a reference for the average level of brightness values ​​corresponding to the pixels in the target area, so as to determine the texture complexity of the target area.

[0040] At the same time, by determining the texture value of the target area, it is helpful to retain the key information in the image during the subsequent image compression process, while for the non-critical information in the image, there is a high probability that it can be obtained through the previous frame of the target image, or the information loss of compressing the image area containing non-critical information is small. Therefore, it helps to balance the retention of information and the smaller storage occupancy after image compression processing.

[0041] In one embodiment, the brightness values ​​of multiple pixels in the target area are obtained by: converting the format of the target image to obtain a first image with an image format of YUV, and determining a Y channel image from the first image; using the pixel values ​​of multiple pixels in a second area in the Y channel image as the brightness values ​​of multiple pixels in the target area, the second area being an area in the Y channel image corresponding to the same position as the target area.

[0042] For example, the positions of multiple pixel points located in the target area in the target image are respectively (1, 2), (1, 3), (1, 4) and (2, 1). By performing image conversion on the target image to obtain a first image in YUV format, the pixel value at position (1, 2) in the first image in the Y channel can be used as the brightness value corresponding to the pixel point at position (1, 2) in the target image. With reference to the process of obtaining the brightness value corresponding to the pixel point at position (1, 2) in the target image, the brightness values ​​corresponding to the pixel points in the target area can be obtained respectively.

[0043] In this way, since the brightness value corresponding to the pixel point can effectively represent the information of the pixel point, by converting the format of the target image to obtain the brightness value corresponding to the pixel point in the target area, it is helpful to determine the texture value of the target area according to the brightness value corresponding to the pixel point in the target area.

[0044] In step S103, a target compression ratio corresponding to the target area is determined according to the multiplication value of the texture value of the target area and the difference degree value, so as to determine multiple target compression ratios corresponding to multiple target areas in the target image.

[0045] The difference degree value can be used to characterize the difference degree between the image area at the same position in the current frame image and the previous frame image, and can indirectly reflect the importance of the information contained in the target area; for example, if the target area and the first area contain the same image information, it means that the image information in the target area can be obtained through the first area, and a higher compression ratio can be used for compression of the target area. Moreover, since the image information in the target area can be obtained through the first area, the loss of image information caused by the compression processing of the target area can also be avoided.

[0046] The texture value can reflect the texture complexity of the target area. The image area with higher texture complexity has a higher probability of containing the key information in the image. Therefore, the texture value and the difference degree value are combined to determine the target compression ratio corresponding to the target area. This can take into account the compression of non-key information and the retention of key information during the image compression process.

[0047] For example, for a target area in the target image where the product of the texture value and the difference degree value is larger, the image information contained in the target area is more complex, or the image information contained in the target area is scarcer than all the image information. A lower compression ratio can be used to reduce the loss of image information in the target area during the compression process.

[0048] On the contrary, for the target area in the target image where the product of the texture value and the difference degree value is smaller, the image information contained in the target area is simpler, or the image information contained in the target area is more common in all image information. A higher compression ratio can be used to reduce the storage occupancy of the compressed target image, so as to reduce the amount of data processing required by the server for the compressed image.

[0049] In one embodiment, determining the target compression ratio corresponding to the target area based on the multiplication of the texture value and the difference degree value of the target area includes: taking the multiplication of the texture value and the difference degree value of the target area as the target parameter value of the target area; determining a third area with the largest target parameter value from multiple target areas located in multiple target images, and taking the ratio of the target parameter value of the third area to the target parameter value of the target area as the target compression ratio corresponding to the target area.

[0050] For example, in order to better retain the image information in the target area where the multiplication value of the texture value and the difference degree value is larger, the target area where the multiplication value of the texture value and the difference degree value is the largest may not be compressed, or a compression ratio of 2:1 may be used to compress the target area where the multiplication value of the texture value and the difference degree value is the largest, or the smallest compression ratio within the target compression range may be used to compress the target area where the multiplication value of the texture value and the difference degree value is the largest; on the contrary, for the target area where the multiplication value of the texture value and the difference degree value is the smallest, the largest compression ratio within the target compression range may be used to compress it, and the target compression range may be [2, 200], and the largest compression ratio within the target compression range may be 200.

[0051] In this way, compared with compressing the entire target image with a lower compression ratio, it is possible to further compress the target area in the target image containing non-critical information with a higher compression ratio, thereby further reducing the storage occupancy of the compressed image; compared with compressing the entire target image with a higher compression ratio, it is possible to compress the target area in the target image containing critical information with a lower compression ratio, thereby retaining the critical information in the target image after compression, reducing the degree of loss of critical information in the image compression process.

[0052] In step S104, image compression processing is performed on the target area according to the target compression ratio corresponding to the target area, so as to perform image compression on multiple target areas in the target image to obtain a target compressed image.

[0053] In the embodiment of the present application, compression of the target image or compression of the target area in the target image can be achieved by using image compression processing technologies such as JPEG, PNG (Portable Network Graphics) and WebP.

[0054] The following uses JPEG compression processing technology as an example to explain the image compression processing process in the embodiment of the present application; JPEG compression processing is a lossy compression technology. By performing JPEG compression processing on an image, the file size of the image can be reduced; the JPEG compression processing process mainly includes steps such as color space conversion, image segmentation, discrete cosine transform, quantization, and entropy coding.

[0055] Among them, color space conversion can convert RGB images into YUV color space, where the Y component represents brightness information and the U and V components represent chrominance information; image segmentation can divide the YUV image into multiple small blocks of size 8×8, so as to perform discrete cosine transform (DCT) and quantization operations on the image blocks obtained after segmentation; discrete cosine transform, performing discrete cosine transform on image blocks of size 8×8, can convert image data from the spatial domain to the frequency domain.

[0056] Quantization, using the quantization matrix to quantize the coefficients after discrete cosine transform. Quantization is a process of reducing the precision of the coefficients by dividing the coefficients by the corresponding values ​​in the quantization matrix and rounding them to the nearest integer; Entropy coding, using entropy coding (Huffman coding or arithmetic coding) to compress the quantized coefficients. Entropy coding can encode according to the statistical characteristics of the coefficients, using shorter codewords to represent more frequent values ​​and longer codewords to represent less frequent values.

[0057] In order to achieve different degrees of JPEG compression for different target areas in the same target image, a quantization matrix corresponding to the target compression ratio corresponding to the target area can be used during the compression process of the target area to perform JPEG compression on the target area in the target image. Since different quantization matrices correspond to different compression ratios, JPEG compression can be performed according to the actual situation of the target area in the target image.

[0058] In one embodiment, performing image compression processing on the target area according to a target compression ratio corresponding to the target area includes: determining a target quantization matrix corresponding to the target compression ratio from a plurality of preset quantization matrices; different preset quantization matrices correspond to different compression ratios; and performing JPEG compression processing on the target area according to the target quantization matrix.

[0059] In this way, by selecting a target quantization matrix corresponding to a target compression ratio, the target area can be compressed by the target compression ratio, thereby reducing storage usage and retaining key information in the image during the image compression process.

[0060] In step S105, a plurality of target compressed images corresponding to the plurality of frames of images are sent to a server, so that the server performs real-time rendering of a three-dimensional scene of a target object according to the plurality of target compressed images.

[0061] By rendering the three-dimensional scene of the target object in real time, the server can send the rendered three-dimensional scene data to the terminal device bound to the user, and the user can view the model corresponding to the target object in the three-dimensional scene through the terminal device, or the user can interact with the virtual objects in the three-dimensional scene through the terminal device, for example, move the objects in the three-dimensional scene, or when the user touches the object in the three-dimensional scene, the terminal device can output vibrations corresponding to the target object to simulate the sense of touch of the object.

[0062] The communication between the terminal device and the server can be achieved through WebRTC (Web Real-Time Communication), so that the user can view the three-dimensional scene sent by the server through the browser; WebRTC is an open source technology. WebRTC can achieve real-time audio communication and video communication through the browser without installing plug-ins or software other than the browser; for example, it can realize video conferencing, voice calls, instant messaging and data sharing.

[0063] By using the image transmission method for real-time rendering of Web three-dimensional scenes provided in the embodiments of the present application, a target compression ratio of a target area in a target image obtained by scanning a target object is determined, so that the target compression ratio of the target area can be matched with the actual situation of the target area, and image compression processing is performed on the target area according to the target compression ratio corresponding to the target area to obtain a target compressed image; while avoiding information loss in the target area, the storage occupancy of the target image can be effectively reduced, and multiple target compressed images corresponding to multiple frames of images can be sent to a server, so that the server performs real-time rendering of the three-dimensional scene of the target object according to the multiple target compressed images, which can effectively reduce the amount of data processing required by the server and improve the efficiency of real-time rendering of the three-dimensional scene of the target object.

[0064] At the same time, the target compression ratio of the target area is determined based on the texture value of the target area and the difference value between the target area and the area corresponding to the same position in the previous frame image. Therefore, it is possible to obtain a compressed image with a smaller storage occupancy while retaining the texture information in the target area; and the target compression ratio value of the target area is determined based on the degree of difference, so that image information with a lower degree of repetition can be retained during compression, thereby avoiding information loss during the image compression process.

[0065] In one embodiment, the multi-frame images obtained by performing a multi-angle scan on the target object can be acquired in the following manner: in response to receiving a scan request sent by a user, sending a first control instruction to a scanning device, the first control instruction being used to control the scanning device to acquire a second image of the target object; receiving the second image sent by the scanning device and displaying it; displaying a first control when the display duration of the second image is greater than a preset duration, the first control being used to prompt the user whether to scan the target object; in response to receiving a confirmation scan operation on the first control, sending a second control instruction to the scanning device; the second control instruction being used to control the scanning device to acquire multiple frames of images of the target object at different shooting angles; receiving multiple frames of images of the target object at different shooting angles sent by the scanning device.

[0066] The second image may be an image obtained after the scanning device scans the target object, and the number of the second image may be one; the second image may be a low-resolution scanned image of the target object at a single angle, for example, the resolution of the second image may be 100 DPI (Dots Per Inch), and the second image may be used to preview the object to be scanned by the scanning device.

[0067] In this way, by receiving the second image sent by the scanning device and displaying the second image, the user of the terminal device can view the object to be scanned by the scanning device, which can facilitate the user to determine whether the object scanned by the scanning device is the scanning object expected by the user.

[0068] By setting a preset duration for displaying the second image, it can be ensured that the user has enough time to view the object scanned by the scanning device, and the scanning process can be smoothly carried out. The preset duration can be, for example, between 5 seconds and 20 seconds.

[0069] In one embodiment, a scanning configuration interface can also be displayed when a confirmation scanning operation of the first control is received; the scanning configuration interface is used for the user to input scanning parameters, and the scanning parameters include scanning resolution, scanning speed, and light intensity of the scanning environment; the scanning parameters entered by the user in the scanning configuration interface are received, and a third control instruction is sent to the scanning device according to the scanning parameters, and the third control instruction is used to enable the scanning device to control the scanning process of the target object according to the scanning parameters.

[0070] For example, the scanning device may be provided with a lighting device and a light intensity sensor, wherein the lighting device is used to provide lighting of various light intensities for the scanning process so as to scan the target object; through the light intensity sensor, the light intensity of the scanning environment when scanning the target object can be obtained so as to realize the monitoring of the lighting device provided on the scanning device, or to provide a reference for the light intensity provided by the lighting device.

[0071] In this way, the user can configure scanning parameters such as the scanning resolution, scanning speed and light intensity of the scanning environment of the scanning device, so that the scanning process is more in line with the actual needs of the user.

[0072] For example, since these scanning parameters will affect the scanning imaging effect of the target object and the time required for scanning, the terminal device can also determine the expected scanning effect and expected time corresponding to the scanning parameters, and display the expected scanning effect and expected time to determine whether the user continues to perform the scanning process of the target object through the scanning device.

[0073] In one embodiment, when the scanning device performs a single-angle scan on the target object, a single-angle scanned image sent by the scanning device can be received and a watermark information list can be displayed; in response to receiving a user's selection operation on the target watermark information in the watermark information list, a target single-angle scanned image can be generated based on the single-angle scanned image and the target watermark information.

[0074] For example, the scanning device may be configured with a first mode and a second mode. In the first mode, the scanning device scans the target object at a single angle. In the second mode, the scanning device scans the target object at multiple angles.

[0075] After the user performs a single-angle scan on the target object, the scanned image may need to be annotated with watermark information. When the scanning device performs a single-angle scan on the target object, a watermark information list is displayed to the user so that the user can add the target watermark information to the single-angle scanned image. The added watermark information can meet the user's usage requirements and enhance the user's experience of using the scanning device.

[0076] It should be understood that the features of some embodiments of the various applications described herein may be combined with each other unless specifically stated otherwise.

[0077] Although terms such as "first", "second", and "third" may be used herein to describe various components, parts, regions, layers, or sections, these components, parts, regions, layers, or sections are not limited to these terms. Instead, these terms are only used to distinguish one component, part, region, layer, or section from another component, part, region, layer, or section. Therefore, without departing from the teachings of the examples described herein, the first component, part, region, layer, or section mentioned in the examples may also be referred to as the second component, part, region, layer, or section.

[0078] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description herein, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0079] In addition, the word "exemplary" is used herein to mean serving as an example, instance, or diagram. Any aspect or design described herein as "exemplary" is not necessarily to be understood as being advantageous over other aspects or designs. Instead, the use of the word exemplary is intended to present concepts in a concrete manner. As used herein, the term "or" is intended to mean an inclusive "or" rather than an exclusive "or".

[0080] Likewise, although the present application has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the accompanying drawings. With particular regard to the various functions performed by the components (e.g., elements, resources, etc.) described above, unless otherwise noted, the terms used to describe such components are intended to correspond to any component (functionally equivalent) that performs the specific functions of the described components, even if not structurally equivalent to the disclosed structures.

[0081] Additionally, while particular features of the present application may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations as may be desired and advantageous for any given or particular application.

[0082] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application, and the specification and embodiments are only considered as exemplary.

[0083] It will be appreciated that the present application is not limited to the exact construction that has been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof.

Claims

1. An image transmission method for real-time rendering of a Web three-dimensional scene, applied to a terminal device, characterized in that: include: Acquiring a plurality of frames of images obtained by scanning the target object at multiple angles, and determining a difference value between the target area and the first area for a target area of ​​the target image in the plurality of frames of images, including: ; Wherein, R is the difference between the target area and the first area, N is the number of pixels in the target area, is the brightness value corresponding to the k-th pixel in the target area, is the brightness value corresponding to the k-th pixel in the first area; The first region is a region in a previous frame image of the target image that corresponds to the same position as the target region; Determining a texture value of a target area according to brightness values ​​of a plurality of pixels in the target area includes: , where F is the texture value of the target area, N is the number of pixels in the target area, is the m+1th brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the mth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the Nth brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, is the first brightness value after sorting the brightness values ​​corresponding to all pixels in the target area from small to large, m is a positive integer less than N, To take the absolute value operation; The texture value is used to characterize the texture complexity of the target area; Determining a target compression ratio corresponding to the target area according to a multiplication value of a texture value of the target area and a difference degree value, so as to determine a plurality of target compression ratios corresponding to a plurality of target areas in the target image, including: taking a multiplication value of a texture value of the target area and a difference degree value as a target parameter value of the target area; Determine a third region having the largest target parameter value from among the multiple target regions located in the multiple target images, and use the ratio of the target parameter value of the third region to the target parameter value of the target region as the target compression ratio corresponding to the target region; According to the target compression ratio corresponding to the target area, the target area is subjected to image compression processing, so as to obtain a target compressed image by performing image compression on multiple target areas in the target image, including: determining a target quantization matrix corresponding to the target compression ratio from multiple preset quantization matrices; different preset quantization matrices correspond to different compression ratios; According to the target quantization matrix, performing JPEG compression processing on the target area; Sending a plurality of target compressed images corresponding to the plurality of frame images to a server, so that the server performs real-time rendering of a three-dimensional scene of a target object according to the plurality of target compressed images; The step of determining a target compression ratio corresponding to the target area according to the multiplication value of the texture value of the target area and the difference degree value includes: The multiplication value of the texture value of the target area and the difference degree value is used as the target parameter value of the target area; Determine a third region having the largest target parameter value from among the multiple target regions located in the multiple target images, and use the ratio of the target parameter value of the third region to the target parameter value of the target region as the target compression ratio corresponding to the target region; The multi-frame images obtained by performing multi-angle scanning on the target object are obtained by the following method: In response to receiving a scanning request sent by a user, sending a first control instruction to a scanning device, the first control instruction is used to control the scanning device to capture a second image of the target object; receiving the second image sent by the scanning device and displaying it; displaying a first control when the display time of the second image is longer than a preset time, the first control is used to prompt the user whether to scan the target object; In response to receiving a confirmation scan operation for the first control, a second control instruction is sent to the scanning device; the second control instruction is used to control the scanning device to collect multiple frames of images of the target object at different shooting angles; and the multiple frames of images of the target object at different shooting angles sent by the scanning device are received; In the case of receiving a confirmation scan operation for the first control, displaying a scan configuration interface; the scan configuration interface is used for the user to input scan parameters, the scan parameters including scan resolution, scan speed, and light intensity of the scan environment; Receiving scanning parameters input by the user in the scanning configuration interface, and sending a third control instruction to the scanning device according to the scanning parameters, wherein the third control instruction is used to enable the scanning device to control the scanning process of the target object according to the scanning parameters; In the case where the scanning device performs a single-angle scan on the target object, receiving the single-angle scanned image sent by the scanning device, and displaying a watermark information list; In response to receiving a user's selection operation on target watermark information in the watermark information list, and based on the single-angle scanned image and the target watermark information, a target single-angle scanned image is generated.

2. The image transmission method for real-time rendering of Web three-dimensional scenes according to claim 1, characterized in that: The brightness values ​​of multiple pixels in the target area are obtained in the following way: Convert the target image into a YUV image and obtain a first image. The pixel values ​​of multiple pixels in the second area of ​​the Y channel image are used as the brightness values ​​of multiple pixels in the target area, and the second area is an area in the Y channel image corresponding to the same position as the target area.

Images