Image rendering method and device based on artificial intelligence, equipment, medium and product

Abstract

The embodiment of the invention provides an image rendering method and device based on artificial intelligence, equipment, a medium and a product, and relates to the technical field of artificial intelligence. The method comprises the following steps: sending a device parameter of a target device to a cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameter; performing image rendering on the to-be-transmitted image based on the equipment parameters to obtain a target transmission image; sending the encrypted transmission image encrypted based on the key to a cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and storing the target transmission image to a storage space corresponding to the cloud storage signature link; transmission completion information is sent to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information. According to the invention, various different intelligent devices can directly output the acquired image content, and the user experience of the intelligent devices is improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of artificial intelligence technology. More specifically, the embodiments of the present invention relate to an image rendering method, device, equipment, medium and product based on artificial intelligence. Background Art

[0002] This section is intended to provide a background or context to embodiments of the invention that are recited in the claims. No description herein is admitted to be prior art by inclusion in this section.

[0003] With the rapid development of smart devices such as smart homes, screen systems, and electronic photo frames, users have put forward higher requirements for the interconnection between smart devices and the flexible transmission and rendering of image content. However, in the process of image content transmission between smart devices on the current market, the smart device receiving the image content is usually unable to directly output the image content due to the different file formats supported by the smart devices, resulting in a poor user experience. Summary of the invention

[0004] In this context, embodiments of the present invention are intended to provide an artificial intelligence-based image rendering method, apparatus, device, medium, and product.

[0005] In a first aspect of an embodiment of the present invention, there is provided an image rendering method based on artificial intelligence, the method comprising: Sending device parameters of the target device to the cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters; wherein the device parameters include at least display resolution, image display size, image format, memory parameters, and graphics processor parameters; Performing image rendering on the image to be transmitted based on the device parameters to obtain a target transmission image; Encrypting the target transmission image based on the key to obtain an encrypted transmission image; Sending the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain the target transmission image, and stores the target transmission image in the storage space corresponding to the cloud storage signature link; The transmission completion information is sent to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

[0006] In one embodiment of this implementation manner, before rendering the image to be transmitted based on the device parameters to obtain the target transmission image, the method further includes: Obtain target image and image style information input by the user; Extracting features of the target image and the image style information respectively to obtain image features corresponding to the target image and style information features corresponding to the image style information; Adjusting the image feature based on the style information to obtain a target image feature; The target image and the target image features are encoded to obtain an image to be transmitted.

[0007] In one embodiment of this implementation manner, performing image rendering on the image to be transmitted based on the device parameters to obtain the target transmission image includes: Determine the image type of the image to be transmitted; wherein the image type is a picture type or a video type; If the image type is the picture type, decapsulating the image to be transmitted to obtain a first image to be transmitted; Comparing the first image to be transmitted with the device parameters to obtain a first comparison result; If the first comparison result indicates that the first image to be transmitted matches the device parameter, encapsulating the first image to be transmitted to obtain a target transmission image; If the first comparison result indicates that the first image to be transmitted does not match the device parameters, the first image to be transmitted is decoded to obtain a first decoded image; and the first decoded image is rendered based on the device parameters to obtain a first rendered image; and the first rendered image is encoded to obtain a first encoded image; and the first encoded image is encapsulated to obtain a target transmission image; wherein the first rendered image matches the device parameters.

[0008] In an embodiment of this implementation manner, if the image type is the video type, the method further includes: Decapsulating the image to be transmitted to obtain a second image to be transmitted and an audio to be transmitted; Performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second encoded image corresponding to the second image to be transmitted and an encoded audio corresponding to the audio to be transmitted; The second encoded image and the encoded audio are encapsulated to obtain a target transmission image.

[0009] In one embodiment of this implementation manner, the performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second coded image corresponding to the second image to be transmitted and coded audio corresponding to the audio to be transmitted includes: Comparing the second image to be transmitted with the device parameter to obtain a second comparison result; and at the same time, comparing the audio to be transmitted with the device parameter to obtain a third comparison result; If the second comparison result indicates that the second image to be transmitted matches the device parameter, determining the second image to be transmitted as a second encoded image; If the second comparison result indicates that the second image to be transmitted does not match the device parameters, the second image to be transmitted is decoded to obtain a second decoded image; and the second decoded image is image rendered based on the device parameters to obtain a second rendered image; and the second rendered image is encoded to obtain a second encoded image; wherein the second rendered image matches the device parameters; If the third comparison result indicates that the audio to be transmitted matches the device parameter, determining the audio to be transmitted as encoded audio; If the third comparison result indicates that the audio to be transmitted does not match the device parameters, the audio to be transmitted is decoded to obtain decoded audio; and the decoded audio is image rendered based on the device parameters to obtain rendered audio; and the rendered audio is encoded to obtain encoded audio; wherein the rendered audio matches the device parameters.

[0010] In one embodiment of this implementation manner, encrypting the target transmission image based on the key to obtain the encrypted transmission image includes: Segmenting the target transmission image based on a preset file size to obtain a plurality of target transmission sub-images; Encrypting each of the target transmission sub-images based on the key to obtain multiple encrypted transmission sub-images; The plurality of encrypted transmission sub-images are determined as an encrypted transmission image.

[0011] In a second aspect of the embodiments of the present invention, there is provided an image rendering device based on artificial intelligence, comprising: A first sending unit is used to send device parameters of the target device to the cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters; wherein the device parameters at least include display resolution, image display size, image format, memory parameters, and graphics processor parameters; A rendering unit, configured to render the image to be transmitted based on the device parameters to obtain a target transmission image; An encryption unit, used for encrypting the target transmission image based on the key to obtain an encrypted transmission image; A second sending unit is used to send the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and stores the target transmission image in a storage space corresponding to the cloud storage signature link; The third sending unit is used to send transmission completion information to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

[0012] In a third aspect of an embodiment of the present invention, a computing device is provided, comprising: at least one processor, a memory, and an input-output unit; wherein the memory is used to store a computer program, and the processor is used to call the computer program stored in the memory to execute any one of the methods described in the first aspect.

[0013] In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, which includes instructions, and when the instructions are executed on a computer, the computer executes the method described in any one of the first aspects.

[0014] In a fifth aspect of the embodiments of the present invention, a computer program product is provided, comprising a computer program, which implements any one of the methods in the first aspect when executed by a processor.

[0015] According to the artificial intelligence-based image rendering method, apparatus, device, medium and product of the embodiments of the present invention, the device parameters of the target device receiving the image content can be obtained, and the image to be transmitted uploaded by the user can be rendered according to the device parameters to obtain the target transmission image that matches the device parameters of the target device, and the target transmission image can be encrypted and transmitted to the cloud server so that the cloud server can store the target transmission image, and then the target device can download the target transmission image from the cloud server, so that various different smart devices can receive the image content that matches the device parameters, thereby directly outputting the acquired image content, thereby improving the user experience of the smart device. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the exemplary embodiments of the present invention will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, in which: Figure 1 A schematic diagram of a flow chart of an image rendering method based on artificial intelligence provided by an embodiment of the present invention; Figure 2 A schematic diagram of a flow chart of a method for generating an image to be transmitted provided by an embodiment of the present invention; Figure 3 A schematic flow chart of a method for processing a video type image to be transmitted provided by an embodiment of the present invention; Figure 4 A schematic flow chart of another image rendering method based on artificial intelligence provided by an embodiment of the present invention; Figure 5 A schematic diagram of the structure of an image rendering device based on artificial intelligence provided by an embodiment of the present invention; Figure 6 A schematic diagram of the structure of a medium according to an embodiment of the present invention is schematically shown; Figure 7 A schematic diagram of the structure of a computing device according to an embodiment of the present invention is schematically shown.

[0017] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION

[0018] The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present invention, and are not intended to limit the scope of the present invention in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0019] Those skilled in the art know that the embodiments of the present invention can be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure can be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0020] According to an embodiment of the present invention, an artificial intelligence-based image rendering method, device, equipment, medium and product are proposed.

[0021] It should be noted that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction and does not have any limiting meaning.

[0022] The principle and spirit of the present invention are explained in detail below with reference to several representative embodiments of the present invention.

[0023] Exemplary Methods Reference below Figure 1 , Figure 1 This is a flow chart of an image rendering method based on artificial intelligence provided by an embodiment of the present invention. It should be noted that the embodiments of the present invention can be applied to any applicable scenario.

[0024] Figure 1 The process of the image rendering method based on artificial intelligence provided by an embodiment of the present invention includes: Step S101: sending device parameters of a target device to a cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters.

[0025] In the embodiment of the present invention, the device parameters include at least display resolution, image display size, image format, memory parameters and graphics processor parameters. The image format can be png, jpg, dng, heic, mp3, aac, mp4, mov, h264, h265 and other formats included in the mainstream Android / iOS system.

[0026] The target device may be a smart device such as a smart camera, a smart photo frame, a central control device, a smart watch, etc., which is not limited in the embodiments of the present invention. The cloud storage signature link may be a storage link on the OSS cloud storage corresponding to the cloud server. According to the cloud storage signature link, the information to be stored may be stored in the storage space indicated by the cloud storage signature link on the OSS cloud storage.

[0027] As an optional implementation, before step S102, the following may also be included: Obtain target image and image style information input by the user; Extracting features of the target image and the image style information respectively to obtain image features corresponding to the target image and style information features corresponding to the image style information; Adjusting the image feature based on the style information to obtain a target image feature; The target image and the target image features are encoded to obtain an image to be transmitted.

[0028] Among them, by implementing this implementation method, the target image can be adjusted in a targeted manner according to the image style information input by the user, so that the image style of the adjusted image to be transmitted is the same as the image style desired by the user, thereby improving the user experience.

[0029] In the embodiment of the present invention, the image style information may be two-dimensional, Marilyn Monroe, The Scream, Ukiyo-e, Van Gogh's Self-Portrait, Van Gogh's Starry Sky, etc., which is not limited in the embodiment of the present invention.

[0030] Please also read Figure 2 , Figure 2A flow chart of a method for generating an image to be transmitted provided in one embodiment of the present invention, wherein information can be input through the AIGC-Stable Diffusion framework: a prompt word (Promot) and a user-defined photo (target image). Afterwards, the VAE model interpreter can be used to extract features of the target image to obtain image features; and the Clip model text interpreter can be used to extract features of the image style information to obtain style information features. And the Diffusion model can be used to adjust the image features based on the style information to obtain the target image features; and then the VAE model encoder can be used to encode the target image and the target image features to obtain the image to be transmitted. Among them, the Diffusion model can be used to adjust various parameters of the image (such as deviation intensity, number of inference steps, scale, seed, resolution, image quality, etc.) according to the style information features, so as to achieve an effect matching the image style information.

[0031] Step S102: Rendering the image to be transmitted based on the device parameters to obtain a target transmission image.

[0032] As an optional implementation manner, step S102 performs image rendering on the image to be transmitted based on the device parameters, and a method of obtaining the target transmission image may include: Determine the image type of the image to be transmitted; wherein the image type is a picture type or a video type; If the image type is the picture type, decapsulating the image to be transmitted to obtain a first image to be transmitted; Comparing the first image to be transmitted with the device parameters to obtain a first comparison result; If the first comparison result indicates that the first image to be transmitted matches the device parameter, encapsulating the first image to be transmitted to obtain a target transmission image; If the first comparison result indicates that the first image to be transmitted does not match the device parameters, the first image to be transmitted is decoded to obtain a first decoded image; and the first decoded image is rendered based on the device parameters to obtain a first rendered image; and the first rendered image is encoded to obtain a first encoded image; and the first encoded image is encapsulated to obtain a target transmission image; wherein the first rendered image matches the device parameters.

[0033] Among them, by implementing this implementation mode, different image rendering methods can be used according to different image types of images to be transmitted, so that the obtained target transmission image can be better adapted to the target device. And the image to be transmitted of the picture type can be rendered and packaged, so as to obtain a target transmission image of the picture type that better matches the device parameters of the target device.

[0034] In the embodiment of the present invention, the first image to be transmitted may be compared with the device parameters, and a method of obtaining the first comparison result may specifically be: Firstly, a first resolution, a first image size, a first image format and a first image memory size of a first image to be transmitted are obtained; The first resolution is compared with the display resolution, the first image size is compared with the image display size, the first image format is compared with the image format, and the first image memory size is compared with the memory parameter to obtain a first comparison result.

[0035] Among them, if the first resolution is less than or equal to the display resolution, the first image size is less than or equal to the image display size, the first image format is the same as the image format, and the first image memory size is less than or equal to the memory parameter, then the first comparison result indicates that the first image to be transmitted matches the device parameters; otherwise, the first comparison result indicates that the first image to be transmitted does not match the device parameters.

[0036] In the embodiment of the present invention, the image rendering of the first decoded image may be implemented by OpenGL, that is, the first decoded image may be compressed by OpenGL so that the obtained first rendered image matches the device parameters.

[0037] Optionally, if the image type is the video type, the method may further include: Decapsulating the image to be transmitted to obtain a second image to be transmitted and an audio to be transmitted; Performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second encoded image corresponding to the second image to be transmitted and an encoded audio corresponding to the audio to be transmitted; The second encoded image and the encoded audio are encapsulated to obtain a target transmission image.

[0038] Among them, by implementing this implementation, the video type image to be transmitted can be decapsulated into a second image to be transmitted and an audio to be transmitted, and the second image to be transmitted and the audio to be transmitted can be rendered respectively to obtain a second encoded image and encoded audio, and then the second encoded image and the encoded audio can be encapsulated to obtain a target transmission image. Through this rendering method, the image and audio can be rendered separately, thereby improving the rendering effect of the video to be transmitted.

[0039] Specifically, the method of performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain the second encoded image corresponding to the second image to be transmitted and the encoded audio corresponding to the audio to be transmitted may include: Comparing the second image to be transmitted with the device parameter to obtain a second comparison result; and at the same time, comparing the audio to be transmitted with the device parameter to obtain a third comparison result; If the second comparison result indicates that the second image to be transmitted matches the device parameter, determining the second image to be transmitted as a second encoded image; If the second comparison result indicates that the second image to be transmitted does not match the device parameters, the second image to be transmitted is decoded to obtain a second decoded image; and the second decoded image is image rendered based on the device parameters to obtain a second rendered image; and the second rendered image is encoded to obtain a second encoded image; wherein the second rendered image matches the device parameters; If the third comparison result indicates that the audio to be transmitted matches the device parameter, determining the audio to be transmitted as encoded audio; If the third comparison result indicates that the audio to be transmitted does not match the device parameters, the audio to be transmitted is decoded to obtain decoded audio; and the decoded audio is image rendered based on the device parameters to obtain rendered audio; and the rendered audio is encoded to obtain encoded audio; wherein the rendered audio matches the device parameters.

[0040] Among them, by implementing this implementation method, the second image to be transmitted and the audio to be transmitted can be compared with the device parameters respectively, and the rendering method of the second image to be transmitted and the audio to be transmitted can be determined according to the second comparison result and the third comparison result, so that the obtained second encoded image and encoded audio are more matched with the device parameters.

[0041] In the embodiment of the present invention, the second image to be transmitted may be compared with the device parameters, and the second comparison result may be obtained in the following manner: Firstly, a second resolution, a second image size, a second image format and a second image memory size of a second image to be transmitted are obtained; The second resolution is compared with the display resolution, the second image size is compared with the image display size, the second image format is compared with the image format, and the second image memory size is compared with the memory parameter to obtain a second comparison result.

[0042] Among them, if the second resolution is less than or equal to the display resolution, the second image size is less than or equal to the image display size, the second image format is the same as the image format, and the second image memory size is less than or equal to the memory parameter, then the second comparison result indicates that the second image to be transmitted matches the device parameters; otherwise, the second comparison result indicates that the second image to be transmitted does not match the device parameters.

[0043] Please also read Figure 3 , Figure 3 A schematic flow chart of a method for processing a video type image to be transmitted provided by an embodiment of the present invention, wherein: The image to be transmitted can be decapsulated to obtain a second image to be transmitted in the Video Track format and an audio to be transmitted in the AudioTrack format; At this time, the second image to be transmitted and the audio to be transmitted may be compared with the device parameters respectively to obtain a second comparison result and a third comparison result; If the second comparison result indicates that the second image to be transmitted matches the device parameter, the second image to be transmitted is determined as the second encoded image; that is, the second image to be transmitted does not need to be rendered, but is directly determined as the second encoded image through transparent transmission; If the third comparison result indicates that the audio to be transmitted matches the device parameters, the audio to be transmitted is determined as encoded audio; that is, the audio to be transmitted does not need to be rendered, but is directly transmitted through transparent transmission to be determined as encoded audio; If the second comparison result indicates that the second image to be transmitted does not match the device parameters, the second image to be transmitted may be decoded, compressed based on OpenGL, and encoded to obtain a second encoded image; If the third comparison result indicates that the audio to be transmitted does not match the device parameters, the audio to be transmitted may be decoded, audio rendered, encoded, and the like may be performed to obtain the encoded audio.

[0044] The second encoded image and the encoded audio may then be packaged as a target transmission image.

[0045] In addition, the target transmission image can be compressed using zip to reduce the size of the target transmission image.

[0046] Step S103: encrypt the target transmission image based on the key to obtain an encrypted transmission image.

[0047] As an optional implementation manner, step S103 encrypts the target transmission image based on the key, and the method of obtaining the encrypted transmission image may include: Segmenting the target transmission image based on a preset file size to obtain a plurality of target transmission sub-images; Encrypting each of the target transmission sub-images based on the key to obtain multiple encrypted transmission sub-images; The plurality of encrypted transmission sub-images are determined as an encrypted transmission image.

[0048] Among them, by implementing this implementation method, the target transmission image can be encrypted, thereby making the encrypted target transmission image transmitted to the cloud server more secure.

[0049] For example, the target transmission image is divided into preset file sizes (for example, 100KB per piece), and each target transmission sub-image is encrypted using AES128 (CCB mode) separately. The key local key is dynamically generated by the cloud server. The generation rule is based on the currently uploaded device parameters, timestamp, and random number. The key is valid for 1 hour and needs to be re-requested if it expires.

[0050] Step S104, sending the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain the target transmission image, and stores the target transmission image in the storage space corresponding to the cloud storage signature link.

[0051] Step S105 , sending transmission completion information to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

[0052] In an embodiment of the present invention, the transmission completion information (MQTT) may include a cloud storage signature link storing the target transmission image, and the target device may download the target transmission image through the cloud storage signature link. When all target transmission images are downloaded, an MQTT notification is sent to the target device to notify that all target transmission images have been downloaded, and the target device may verify the integrity of the target transmission image.

[0053] Please also read Figure 4 , Figure 4 A flowchart of another image rendering method based on artificial intelligence according to an exemplary embodiment of the present invention is shown, comprising: Step S401, pairing the artificial intelligence-based image rendering device with a target device.

[0054] Step S402: The target device reports device parameters to the artificial intelligence-based image rendering apparatus.

[0055] Step S403: the artificial intelligence-based image rendering device sends device parameters of the target device to the cloud server.

[0056] Step S404: The cloud server requests the OSS cloud storage for a cloud storage signature link.

[0057] Step S405: OSS cloud storage sends a cloud storage signature link to the cloud server.

[0058] Step S406: The cloud server generates a key based on the device parameters.

[0059] Step S407: The cloud server sends the cloud storage signature link and key to the artificial intelligence-based image rendering device.

[0060] Step S408: The image rendering device based on artificial intelligence performs image rendering on the image to be transmitted based on the device parameters to obtain a target transmission image.

[0061] Step S409: the artificial intelligence-based image rendering device encrypts the target transmission image based on the key to obtain an encrypted transmission image.

[0062] Step S410: The artificial intelligence-based image rendering device sends the encrypted transmission image to the OSS cloud storage based on the cloud storage signature link.

[0063] Step S411, the artificial intelligence-based image rendering device sends a transmission completion message to the target device.

[0064] Step S412: The target device sends a download request to the OSS cloud storage.

[0065] Step S413, the OSS cloud storage sends a target transmission image corresponding to the download request information to the target device.

[0066] The present invention enables various smart devices to receive image content that matches the device parameters, thereby directly outputting the acquired image content, thereby improving the user experience of the smart device. In addition, the present invention can also improve the user experience. In addition, the present invention can also obtain a target transmission image of a picture type that better matches the device parameters of the target device. In addition, the present invention can also improve the rendering effect of the video to be transmitted. In addition, the present invention can also make the obtained second encoded image and encoded audio more matched with the device parameters. In addition, the present invention can also make the encrypted target transmission image transmitted to the cloud server more secure.

[0067] Exemplary Devices After introducing the method of the exemplary embodiment of the present invention, next, refer to Figure 5 An image rendering device based on artificial intelligence according to an exemplary embodiment of the present invention is described, and the device includes: The first sending unit 501 is used to send device parameters of the target device to the cloud server, so that the cloud server feeds back the cloud storage signature link and key based on the device parameters; wherein the device parameters at least include display resolution, image display size, image format, memory parameters and graphics processor parameters; A rendering unit 502, configured to render the image to be transmitted based on the device parameters to obtain a target transmission image; An encryption unit 503, configured to encrypt the target transmission image based on the key to obtain an encrypted transmission image; The second sending unit 504 is used to send the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and stores the target transmission image in the storage space corresponding to the cloud storage signature link; The third sending unit 505 is used to send transmission completion information to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

[0068] As an optional implementation manner, the rendering unit 502 is further configured to: Before rendering the image to be transmitted based on the device parameters to obtain the target transmission image, obtaining the target image and image style information input by the user; Extracting features of the target image and the image style information respectively to obtain image features corresponding to the target image and style information features corresponding to the image style information; Adjusting the image feature based on the style information to obtain a target image feature; The target image and the target image features are encoded to obtain an image to be transmitted.

[0069] Among them, by implementing this implementation method, the target image can be adjusted in a targeted manner according to the image style information input by the user, so that the image style of the adjusted image to be transmitted is the same as the image style desired by the user, thereby improving the user experience.

[0070] As an optional implementation manner, the rendering unit 502 performs image rendering on the image to be transmitted based on the device parameters, and a specific method for obtaining the target transmission image may be: Determine the image type of the image to be transmitted; wherein the image type is a picture type or a video type; If the image type is the picture type, decapsulating the image to be transmitted to obtain a first image to be transmitted; Comparing the first image to be transmitted with the device parameters to obtain a first comparison result; If the first comparison result indicates that the first image to be transmitted matches the device parameter, encapsulating the first image to be transmitted to obtain a target transmission image; If the first comparison result indicates that the first image to be transmitted does not match the device parameters, the first image to be transmitted is decoded to obtain a first decoded image; and the first decoded image is rendered based on the device parameters to obtain a first rendered image; and the first rendered image is encoded to obtain a first encoded image; and the first encoded image is encapsulated to obtain a target transmission image; wherein the first rendered image matches the device parameters.

[0071] Among them, by implementing this implementation mode, different image rendering methods can be used according to different image types of images to be transmitted, so that the obtained target transmission image can be better adapted to the target device. And the image to be transmitted of the picture type can be rendered and packaged, so as to obtain a target transmission image of the picture type that better matches the device parameters of the target device.

[0072] As an optional implementation manner, the rendering unit 502 is further configured to: If the image type is the video type, decapsulate the image to be transmitted to obtain a second image to be transmitted and an audio to be transmitted; Performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second encoded image corresponding to the second image to be transmitted and an encoded audio corresponding to the audio to be transmitted; The second encoded image and the encoded audio are encapsulated to obtain a target transmission image.

[0073] Among them, by implementing this implementation, the video type image to be transmitted can be decapsulated into a second image to be transmitted and an audio to be transmitted, and the second image to be transmitted and the audio to be transmitted can be rendered respectively to obtain a second encoded image and encoded audio, and then the second encoded image and the encoded audio can be encapsulated to obtain a target transmission image. Through this rendering method, the image and audio can be rendered separately, thereby improving the rendering effect of the video to be transmitted.

[0074] As an optional implementation manner, the rendering unit 502 performs image rendering on the second image to be transmitted and the audio to be transmitted respectively, and a method of obtaining a second encoded image corresponding to the second image to be transmitted and an encoded audio corresponding to the audio to be transmitted may specifically be: Comparing the second image to be transmitted with the device parameter to obtain a second comparison result; and at the same time, comparing the audio to be transmitted with the device parameter to obtain a third comparison result; If the second comparison result indicates that the second image to be transmitted matches the device parameter, determining the second image to be transmitted as a second encoded image; If the second comparison result indicates that the second image to be transmitted does not match the device parameters, the second image to be transmitted is decoded to obtain a second decoded image; and the second decoded image is image rendered based on the device parameters to obtain a second rendered image; and the second rendered image is encoded to obtain a second encoded image; wherein the second rendered image matches the device parameters; If the third comparison result indicates that the audio to be transmitted matches the device parameter, determining the audio to be transmitted as encoded audio; If the third comparison result indicates that the audio to be transmitted does not match the device parameters, the audio to be transmitted is decoded to obtain decoded audio; and the decoded audio is image rendered based on the device parameters to obtain rendered audio; and the rendered audio is encoded to obtain encoded audio; wherein the rendered audio matches the device parameters.

[0075] Among them, by implementing this implementation method, the second image to be transmitted and the audio to be transmitted can be compared with the device parameters respectively, and the rendering method of the second image to be transmitted and the audio to be transmitted can be determined according to the second comparison result and the third comparison result, so that the obtained second encoded image and encoded audio are more matched with the device parameters.

[0076] As an optional implementation manner, the encryption unit 503 encrypts the target transmission image based on the key, and the method of obtaining the encrypted transmission image may be: Segmenting the target transmission image based on a preset file size to obtain a plurality of target transmission sub-images; Encrypting each of the target transmission sub-images based on the key to obtain multiple encrypted transmission sub-images; The plurality of encrypted transmission sub-images are determined as an encrypted transmission image.

[0077] Among them, by implementing this implementation method, the target transmission image can be encrypted, thereby making the encrypted target transmission image transmitted to the cloud server more secure.

[0078] The present invention enables various smart devices to receive image content that matches the device parameters, thereby directly outputting the acquired image content, thereby improving the user experience of the smart device. In addition, the present invention can also improve the user experience. In addition, the present invention can also obtain a target transmission image of a picture type that better matches the device parameters of the target device. In addition, the present invention can also improve the rendering effect of the video to be transmitted. In addition, the present invention can also make the obtained second encoded image and encoded audio more matched with the device parameters. In addition, the present invention can also make the encrypted target transmission image transmitted to the cloud server more secure.

[0079] Exemplary Media After introducing the method and apparatus of the exemplary embodiment of the present invention, next, reference is made to Figure 6 For a description of a computer-readable storage medium according to an exemplary embodiment of the present invention, please refer to Figure 6 , the computer-readable storage medium shown is a CD 60, on which a computer program (i.e., a program product) is stored. When the computer program is executed by the processor, the steps recorded in the above method implementation are implemented, for example, sending device parameters of the target device to the cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters; wherein the device parameters at least include display resolution, image display size, image format, memory parameters, and graphics processor parameters; performing image rendering on the image to be transmitted based on the device parameters to obtain a target transmission image; encrypting the target transmission image based on the key to obtain an encrypted transmission image; sending the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and stores the target transmission image in the storage space corresponding to the cloud storage signature link; sending transmission completion information to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information; the specific implementation method of each step is not repeated here.

[0080] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0081] Exemplary Computing Devices After introducing the method, apparatus and medium of the exemplary embodiments of the present invention, next, reference is made to Figure 7 A computing device for artificial intelligence-based image rendering according to an exemplary embodiment of the present invention.

[0082] Figure 7 A block diagram of an exemplary computing device 70, which may be a computer system or a server, is shown that is suitable for use in implementing embodiments of the present invention. Figure 7 The computing device 70 shown is merely an example and should not bring any limitation to the functionality and scope of use of embodiments of the present invention.

[0083] like Figure 7 As shown, the components of the computing device 70 may include, but are not limited to: one or more processors or processing units 701 , a system memory 702 , and a bus 703 connecting different system components (including the system memory 702 and the processing unit 701 ).

[0084] The computing device 70 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computing device 70, including volatile and non-volatile media, removable and non-removable media.

[0085] The system memory 702 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 7021 and / or cache memory 7022. The computing device 70 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the ROM 7023 may be used to read and write non-removable, non-volatile magnetic media ( Figure 7 is not shown in the Figure 7 As shown in FIG. 7 , a disk drive for reading and writing a removable non-volatile disk (e.g., a “floppy disk”) and an optical disk drive for reading and writing a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 703 via one or more data medium interfaces. The system memory 702 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0086] A program / utility 7025 having a set (at least one) of program modules 7024 may be stored, for example, in system memory 702, and such program modules 7024 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. Program modules 7024 generally perform the functions and / or methods of the embodiments described herein.

[0087] The computing device 70 may also communicate with one or more external devices 704 (e.g., a keyboard, a pointing device, a display, etc.). Such communication may be performed via an input / output (I / O) interface 705. In addition, the computing device 70 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 706. Figure 7 As shown, the network adapter 706 communicates with other modules (such as the processing unit 701, etc.) of the computing device 70 via the bus 703. It should be understood that although Figure 7 Not shown, other hardware and / or software modules may be used in conjunction with computing device 70 .

[0088] The processing unit 701 executes various functional applications and data processing by running the program stored in the system memory 702, for example, sending the device parameters of the target device to the cloud server so that the cloud server can feedback the cloud storage signature link and key based on the device parameters; wherein the device parameters include at least display resolution, image display size, image format, memory parameters and graphics processor parameters; rendering the image to be transmitted based on the device parameters to obtain the target transmission image; encrypting the target transmission image based on the key to obtain the encrypted transmission image; sending the encrypted transmission image to the cloud server so that the cloud server can decrypt the encrypted transmission image based on the key to obtain the target transmission image, and store the target transmission image in the storage space corresponding to the cloud storage signature link; sending the transmission completion information to the target device so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information. The specific implementation methods of each step will not be repeated here. It should be noted that although several units / modules or sub-units / sub-modules of the image rendering device based on artificial intelligence are mentioned in the above detailed description, this division is only exemplary and not mandatory. In fact, according to the embodiments of the present invention, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.

[0089] In the description of the present invention, it should be noted that the terms “first”, “second” and “third” are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0090] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0091] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0092] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0093] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0094] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that can be executed by a processor. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., various media that can store program codes.

[0095] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

[0096] In addition, although the operations of the method of the present invention are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0097] In an exemplary embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.

Claims

1. An image rendering method based on artificial intelligence, characterized in that: The method comprises: Sending device parameters of the target device to the cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters; wherein the device parameters include at least display resolution, image display size, image format, memory parameters, and graphics processor parameters; Performing image rendering on the image to be transmitted based on the device parameters to obtain a target transmission image; Encrypting the target transmission image based on the key to obtain an encrypted transmission image; Sending the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and stores the target transmission image in the storage space corresponding to the cloud storage signature link; The transmission completion information is sent to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

2. The image rendering method based on artificial intelligence according to claim 1, characterized in that: Before rendering the image to be transmitted based on the device parameters to obtain the target transmission image, the method further includes: Obtain target image and image style information input by the user; Extracting features of the target image and the image style information respectively to obtain image features corresponding to the target image and style information features corresponding to the image style information; Adjusting the image feature based on the style information to obtain a target image feature; The target image and the target image features are encoded to obtain an image to be transmitted.

3. The image rendering method based on artificial intelligence according to claim 1, characterized in that: The performing image rendering on the image to be transmitted based on the device parameters to obtain the target transmission image comprises: Determine the image type of the image to be transmitted; wherein the image type is a picture type or a video type; If the image type is the picture type, decapsulating the image to be transmitted to obtain a first image to be transmitted; Comparing the first image to be transmitted with the device parameters to obtain a first comparison result; If the first comparison result indicates that the first image to be transmitted matches the device parameter, encapsulating the first image to be transmitted to obtain a target transmission image; If the first comparison result indicates that the first image to be transmitted does not match the device parameters, the first image to be transmitted is decoded to obtain a first decoded image; and the first decoded image is rendered based on the device parameters to obtain a first rendered image; and the first rendered image is encoded to obtain a first encoded image; and the first encoded image is encapsulated to obtain a target transmission image; wherein the first rendered image matches the device parameters.

4. The image rendering method based on artificial intelligence according to claim 3, characterized in that: If the image type is the video type, the method further includes: Decapsulating the image to be transmitted to obtain a second image to be transmitted and an audio to be transmitted; Performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second encoded image corresponding to the second image to be transmitted and an encoded audio corresponding to the audio to be transmitted; The second encoded image and the encoded audio are encapsulated to obtain a target transmission image.

5. The image rendering method based on artificial intelligence according to claim 4, characterized in that: The performing image rendering on the second image to be transmitted and the audio to be transmitted respectively to obtain a second coded image corresponding to the second image to be transmitted and coded audio corresponding to the audio to be transmitted includes: Comparing the second image to be transmitted with the device parameter to obtain a second comparison result; and at the same time, comparing the audio to be transmitted with the device parameter to obtain a third comparison result; If the second comparison result indicates that the second image to be transmitted matches the device parameter, determining the second image to be transmitted as a second encoded image; If the second comparison result indicates that the second image to be transmitted does not match the device parameters, the second image to be transmitted is decoded to obtain a second decoded image; and the second decoded image is image rendered based on the device parameters to obtain a second rendered image; and the second rendered image is encoded to obtain a second encoded image; wherein the second rendered image matches the device parameters; If the third comparison result indicates that the audio to be transmitted matches the device parameter, determining the audio to be transmitted as encoded audio; If the third comparison result indicates that the audio to be transmitted does not match the device parameters, the audio to be transmitted is decoded to obtain decoded audio; and the decoded audio is image rendered based on the device parameters to obtain rendered audio; and the rendered audio is encoded to obtain encoded audio; wherein the rendered audio matches the device parameters.

6. The image rendering method based on artificial intelligence according to any one of claims 1 to 5, characterized in that: The step of encrypting the target transmission image based on the key to obtain the encrypted transmission image includes: Segmenting the target transmission image based on a preset file size to obtain a plurality of target transmission sub-images; Encrypting each of the target transmission sub-images based on the key to obtain multiple encrypted transmission sub-images; The plurality of encrypted transmission sub-images are determined as an encrypted transmission image.

7. An image rendering device based on artificial intelligence, characterized in that: include: A first sending unit is used to send device parameters of the target device to the cloud server, so that the cloud server feeds back a cloud storage signature link and a key based on the device parameters; wherein the device parameters at least include display resolution, image display size, image format, memory parameters, and graphics processor parameters; A rendering unit, configured to render the image to be transmitted based on the device parameters to obtain a target transmission image; An encryption unit, used for encrypting the target transmission image based on the key to obtain an encrypted transmission image; A second sending unit is used to send the encrypted transmission image to the cloud server, so that the cloud server decrypts the encrypted transmission image based on the key to obtain a target transmission image, and stores the target transmission image in a storage space corresponding to the cloud storage signature link; The third sending unit is used to send transmission completion information to the target device, so that the target device downloads the target transmission image from the cloud server after receiving the transmission completion information.

8. A computing device, characterized in that The computing device comprises: at least one processor, memory, and input-output unit; The memory is used to store a computer program, and the processor is used to call the computer program stored in the memory to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium comprising instructions, characterized in that: When the method is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images