Terminal image encryption, storage and analysis method, device and system

Abstract

The embodiment of the invention discloses a terminal image encryption, storage and analysis method and device, a terminal image encryption, storage and analysis system and a medium. The terminal image encryption method comprises the following steps: confirming whether a preset trigger condition takes effect or not; if the preset triggering condition takes effect, controlling the showcase terminal to shoot; generating a first image in a jpeg format according to a shooting result; and writing preset encryption information in the program mark segment of the first image to generate a second image. The terminal image encryption method provided by the embodiment of the invention achieves the effect of improving the user experience.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of smart showcases, and in particular to a terminal image encryption, storage, and analysis method, and a device and system thereof. Background Art

[0002] With the rapid development of the Internet of Things, smart display cabinets, such as smart display freezers, are increasingly widely used in retail. The prior art smart display freezers combine the analysis and reasoning technology of the Internet of Things, smart sensors and artificial intelligence, which can help retailers better manage product display and inventory. Smart display freezers are usually equipped with sensors and cameras to regularly capture images of the products inside the freezer. In the prior art, these captured images are usually not encrypted. The background AI analysis system can receive and analyze the images of these products to automatically detect the inventory of food. However, since the smart display freezer is not closed to the background AI analysis system, the background AI analysis system can receive images of legitimate products in addition to images that are not related to the products, images that are not related to the analysis task, or other junk images. Since the background AI analysis system cannot distinguish the sources of various images, this leads to a heavy workload on the background AI analysis system, and the actual computing power of storage and analysis work will be greatly weakened, which in turn leads to the failure to complete the analysis task in a timely manner or output erroneous results, so the user experience is poor. Summary of the invention

[0003] The embodiments of the present invention provide a terminal image encryption method, device, system and medium, which achieve the effect of improving user experience.

[0004] According to one aspect of the present invention, a terminal image encryption method is provided, including: confirming whether a preset trigger condition is effective; if the preset trigger condition is effective, controlling the display cabinet terminal to take pictures; generating a first image in jpeg format according to the shooting result; and writing preset encryption information in a program marker segment of the first image to generate a second image.

[0005] Furthermore, generating a first image in jpeg format according to the shooting result includes: determining whether the shooting result is in jpeg format; if the shooting result is not in jpeg format, converting the image corresponding to the shooting result into jpeg format; if the shooting result is in jpeg format, maintaining the format of the shooting result.

[0006] Furthermore, the encrypted information at least includes a terminal identification code, a shooting timestamp, and an encrypted signature.

[0007] Furthermore, the program marker segment of the first image is any one or more marker segments from APP0 to APP15 for storing application specific information.

[0008] Furthermore, the confirmation of whether the preset triggering conditions are effective includes: confirming whether an action of scanning a code to place an order occurs; or confirming whether an action of opening or closing a cabinet door occurs; or confirming whether an action of picking up and placing goods occurs.

[0009] According to another aspect of the present invention, there is provided an image storage method, which is applied to a server, and comprises: receiving a plurality of images to be processed in jpeg format; confirming whether the program marker segment of the image to be processed includes preset encryption information; if the image to be processed includes the preset encryption information, storing the image to be processed, otherwise abandoning the storage of the image to be processed.

[0010] According to another aspect of the present invention, there is provided an image analysis method, which is applied to a server and includes:

[0011] Receive several images to be processed in jpeg format;

[0012] confirming whether the program marker segment of the image to be processed includes preset encryption information;

[0013] If the image to be processed includes the preset encryption information, the image to be processed is analyzed to generate an operation report of the showcase terminal; otherwise, the analysis of the image to be processed is abandoned.

[0014] According to another aspect of the present invention, there is provided a terminal image encryption device, comprising:

[0015] The condition trigger module is used to confirm whether the preset trigger condition is effective;

[0016] A shooting control module is used to control the display cabinet terminal to shoot when the preset trigger condition takes effect;

[0017] An image generation module, used to generate a first image in jpeg format according to the shooting result;

[0018] The image encryption module is used to write preset encryption information into the program marker segment of the first image to generate a second image.

[0019] According to another aspect of the present invention, there is provided a device for storing an image, comprising:

[0020] An image receiving module is used to receive a number of images to be processed in jpeg format;

[0021] An encryption confirmation module, confirming whether the program marker segment of the image to be processed includes preset encryption information;

[0022] The image storage module is used to store the image to be processed when the image to be processed includes the preset encryption information, and otherwise abandon the storage of the image to be processed.

[0023] According to another aspect of the present invention, there is provided an image analysis device, comprising:

[0024] An image receiving module is used to receive a number of images to be processed in jpeg format;

[0025] An encryption confirmation module, used to confirm whether the program marker segment of the image to be processed includes preset encryption information;

[0026] The image analysis module is used to analyze the image to be processed to generate an operation report of the display cabinet terminal when the image to be processed includes the preset encryption information, and otherwise abandon the analysis of the image to be processed.

[0027] According to another aspect of the present invention, there is provided an image processing system comprising:

[0028] one or more processors;

[0029] A memory is used to store one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned terminal image encryption method, image storage method or image analysis method.

[0030] According to another aspect of the present invention, there is provided a storage medium storing a computer program, wherein the program, when executed by a processor, implements the above-mentioned terminal image encryption method, image storage method or image analysis method.

[0031] Compared with the prior art, the terminal image encryption method of this embodiment can encrypt and sign the image when the image is captured at the display cabinet terminal. The JPEG image assets after encryption and signature can enter the circulation link more safely for storage and analysis during subsequent use. Since the legal image has encrypted signature information, unsigned illegal files will be rejected by the system when trying to enter the system for storage or data analysis. This not only prevents potential illegal data from entering, but also ensures the integrity and legality of the data during all operations. In addition, the digital signature process of this embodiment does not affect the metadata (Meta Data) of the JPEG file. Therefore, whether it is subsequent AI analysis or manual review, the original information of the file can be fully retained, and the information will not be lost or tampered with due to the signature. The lossless signature method of this embodiment allows JPEG files to be flexibly and directly used in various AI analysis applications while maintaining a high degree of security, legality and traceability. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 This is a flow chart of a terminal image encryption method provided in Embodiment 1 of the present invention.

[0034] Figure 2 This is a flow chart of an image storage method provided in Embodiment 2 of the present invention.

[0035] Figure 3 This is a flowchart of an image encryption method provided in Embodiment 3 of the present invention.

[0036] Figure 4 This is a flow chart of a terminal image encryption device provided in Embodiment 4 of the present invention.

[0037] Figure 5 This is a flow chart of an image storage device provided in Embodiment 5 of the present invention.

[0038] Figure 6 This is a flow chart of an image analysis device provided in Embodiment 6 of the present invention.

[0039] Figure 7 It is a schematic diagram of an image processing system provided by Embodiment 7 of the present invention. DETAILED DESCRIPTION

[0040] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0041] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0042] Embodiment 1

[0043] Figure 1 This is a flow chart of a terminal image encryption method provided by the first embodiment of the present invention. This embodiment can be applied to a terminal image encryption device for execution. The device can be implemented by software and / or hardware and can generally be integrated into a display cabinet terminal. Figure 1 As shown, the method includes the following operations:

[0044] S110: Confirm whether the preset trigger condition is effective.

[0045] In one embodiment, the display cabinet terminal may be a display cabinet terminal such as a vending machine or a smart display freezer. In one embodiment, a camera facing the goods is provided on the door or inside the display cabinet terminal, and when the trigger condition takes effect, the display cabinet terminal controls the camera to capture the image of the goods. The trigger condition may be an operation on the display cabinet terminal, such as scanning a code to place an order, opening or closing a door, replenishing goods, etc. In one embodiment, the confirmation of whether the preset trigger condition is effective includes: confirming whether the action of scanning a code to place an order occurs; or confirming whether the action of opening or closing a door occurs; or confirming whether the action of picking up and placing goods occurs. In this embodiment, if one or more of the actions of scanning a code to place an order, opening or closing a door, and / or picking up and placing goods occurs, it can be determined that the trigger condition is met, and the display cabinet terminal controls the camera to capture the image of the goods, otherwise it continues to identify the operation on the display cabinet terminal.

[0046] S120, if the preset trigger condition takes effect, control the showcase terminal to take pictures;

[0047] If the preset trigger condition is the scanning and ordering behavior, it means that a user is shopping for goods at this time. At this time, the image captured by the control display terminal can be used to analyze the popularity of the goods within the preset time. If the preset trigger condition is the door opening or closing behavior, it means that the user is ready to take out the goods, or the merchant is restocking. At this time, the image captured by the control display terminal can be used to analyze the user's habit of taking things, or analyze whether the merchant's restocking method complies with market rules. If the preset trigger condition is the goods picking and placing behavior, the image captured by the control display terminal can be used to analyze the user's popularity of the goods selected, or analyze the number of restockings by the merchant.

[0048] S130, generating a first image in jpeg format according to the shooting result;

[0049] In this embodiment, the camera can automatically generate the first image in jpeg format. In other embodiments, if the format of the image generated by the camera is uncertain, generating the first image in jpeg format according to the shooting result includes: determining whether the shooting result is in jpeg format; if the shooting result is not in jpeg format, converting the image corresponding to the shooting result into jpeg format; if the shooting result is in jpeg format, maintaining the shooting result format.

[0050] S140: Writing preset encryption information into the program marker segment of the first image to generate a second image.

[0051] In one embodiment, referring to Table 1, the program marker segment of the first image is any one or more marker segments from APP0 to APP15 (APP0~APP15) for storing application specific information.

[0052] Table 1: Structure definition of the first image

[0053] Tag Name Tagged content illustrate SOI 0xFFD8 Start Of Image SOF0 0xFFC0 Start Of Frame 0 SOF2 0xFFC2 Start of Frame 2 DHT 0xFFC4 Define Huffman Table(s) DQ 0xFFDB Define Quantization Table(s) DRI 0xFFDD Define Restart Interval SOS 0xFFDA Start of Scan RST0~RST7 0xFFD0~0xFFD7 Restart APP0~APP15 0xFFE0~0xFFEF Application Specific Information COM 0xFFFE Comment EOI 0xFFD9 End of Image

[0054] In one embodiment, referring to Table 2, the encrypted information at least includes a terminal identification code, a shooting timestamp, and an encrypted signature. Preferably, the encrypted signature uses AES encryption and digital signature. AES encryption is a symmetric key encryption that uses the same key to encrypt and decrypt data. Digital signatures use asymmetric encryption algorithms, such as RSA, to sign data with a private key and verify with a public key to ensure the integrity of the data and the authenticity of the source. This method can prevent data from being tampered with during transmission and can verify the identity of the data sender. Preferably, during the AES encryption process, different encryption modes and padding schemes can also be selected, such as ECB, CBC, CTR and other modes, as well as PKCS7, PKCS5, NoPadding and other padding schemes to adapt to different application scenarios and security requirements.

[0055] Table 2: Encrypted information structure

[0056] Terminal identification code Shooting timestamp Cryptographic Signature

[0057] Compared with the prior art, the terminal image encryption method of this embodiment can encrypt and sign the image when the image is captured by the display cabinet terminal. The JPEG image asset after the encryption signature can enter the circulation link more safely for storage and analysis during subsequent use. Since the legal image has encrypted signature information, the unsigned illegal file will be rejected by the system when trying to enter the system for storage or data analysis. This not only prevents the entry of potential illegal data, but also ensures the integrity and legality of the data in all operations. In addition, the digital signature process of this embodiment does not affect the metadata (Meta Data) of the JPEG file. Therefore, whether it is subsequent AI analysis or manual review, the original information of the file can be fully retained, and the information will not be lost or tampered with due to the signature. The lossless signature method of this embodiment enables JPEG files to be used flexibly and directly in various AI analysis applications while maintaining high security, legality and traceability. In one embodiment, the generation of signature information is based on the terminal identification code and the shooting timestamp input preset algorithm calculation.

[0058] Embodiment 2

[0059] Figure 2 is a flow chart of an image storage method provided by the second embodiment of the present invention. This embodiment can be applied to an image storage device for execution. The device can be implemented by software and / or hardware and can generally be integrated in a server. Figure 2 As shown, the method includes the following operations:

[0060] S210, receiving a number of images to be processed in jpeg format;

[0061] In this embodiment, the server receives several images to be processed in jpeg format, which may be images with encrypted signatures generated by the showcase terminal in the first embodiment, or images generated by other terminals without being encrypted.

[0062] S220, confirming whether the program marking segment of the image to be processed includes preset encryption information;

[0063] In this embodiment, the server reads the content of the program marker segment of the image to be processed, first confirms whether there is encrypted signature information, and if so, decrypts the encrypted signature information according to a preset key, and confirms whether the image to be processed is a legal image generated by a preset showcase terminal according to the decryption result. In one embodiment, if the decryption result is true, the image to be processed is a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed includes the preset encryption information, and if the decryption result is false, the image to be processed is not a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed does not include the preset encryption information. In one embodiment, the verification of whether the signature information is true is based on the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation, and is true when the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation and the encrypted signature are exactly the same, and false when they are not the same.

[0064] S210: If the image to be processed includes the preset encryption information, the image to be processed is stored; otherwise, the storage of the image to be processed is abandoned.

[0065] In one embodiment, if the image to be processed includes the preset encryption information, it means that the image to be processed is a legal image or an image corresponding to the analysis task, and the image to be processed is stored to facilitate subsequent centralized reading and analysis of the image to be processed, so as to obtain the operation recommendation information of the corresponding commodity of the display cabinet terminal, such as purchase quantity adjustment information, hot-selling recommendation information, etc. If the image to be processed does not include the preset encryption information, it means that the image to be processed is an illegal image or has nothing to do with the analysis task, and the storage of the image to be processed is abandoned at this time to avoid wasting storage space.

[0066] In this embodiment, since the legal image to be processed has an encrypted signature, the legality of the received image to be processed can be verified by the encrypted signature before it is stored. The system only stores legal images, which saves a lot of system storage space.

[0067] Embodiment 3

[0068] Figure 3 is a flow chart of an image analysis method provided by the third embodiment of the present invention. This embodiment can be applied to an image analysis device for execution. The device can be implemented by software and / or hardware and can generally be integrated into a server. Figure 3 As shown, the method includes the following operations:

[0069] S310, receiving a number of images to be processed in jpeg format;

[0070] In this embodiment, the server receives several images to be processed in jpeg format. These images may be images that are encrypted and signed in the first embodiment, or images generated by other terminals that are not encrypted.

[0071] S320, confirming whether the program marking segment of the image to be processed includes preset encryption information;

[0072] In this embodiment, the server reads the content of the program marker segment of the image to be processed, first confirms whether there is encrypted signature information, and if so, decrypts the encrypted signature information according to a preset key, and confirms whether the image to be processed is a legal image generated by a preset showcase terminal according to the decryption result. In one embodiment, if the decryption result is true, the image to be processed is a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed includes the preset encryption information, and if the decryption result is false, the image to be processed is not a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed does not include the preset encryption information. In one embodiment, the verification of whether the signature information is true is based on the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation, and is true when the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation and the encrypted signature are exactly the same, and false when they are not the same.

[0073] S310: If the image to be processed includes the preset encryption information, the image to be processed is analyzed to generate an operation report of the showcase terminal; otherwise, the analysis of the image to be processed is abandoned.

[0074] In one embodiment, if the image to be processed includes the preset encrypted information, it means that the image to be processed is a legitimate image or an image corresponding to the analysis task, and the image to be processed is analyzed to generate an operation report of the display cabinet terminal. In this embodiment, the operation report of the display cabinet terminal may include product recommendation information, product purchase information, product quantity adjustment information, hot product recommendation information, etc.

[0075] In this embodiment, since the legal image to be processed has an encrypted signature, the legality of the image to be processed can be verified by the encrypted signature before the received image to be processed is analyzed. The system only analyzes the legal images, and automatically shields illegal images during the analysis process, without spending a lot of computing power to analyze illegal images, thus avoiding wasting system computing power. Since the interference information of illegal images is shielded, this embodiment further improves the accuracy of the system analysis results.

[0076] In an alternative embodiment, during the transmission of the encrypted signature image captured by the showcase terminal to different legitimate network nodes, each node may modify the encrypted signature and further add each node processing information to the encrypted signature, such as the identification code of the node device, the number of encrypted signature modification times, etc. In one embodiment, the number of encrypted signature modification times may be a counting parameter, and the initial parameter of the number of signature modification times is 1 when the image is captured from the showcase terminal. The number of signature modification times increases by 1 for each additional node in the transmission process of the image among legitimate network nodes.

[0077] Embodiment 4

[0078] Figure 4 4 is a schematic diagram of the structure of a terminal image encryption device provided by the fourth embodiment of the present invention. The device 400 can be implemented by software and / or hardware, and can generally be integrated into a display cabinet terminal, such as Figure 4 As shown, the device 400 includes a condition trigger module 410, a shooting control module 420, an image generation module 430, and an image encryption module 440. In one embodiment, the display cabinet terminal can be a display cabinet terminal such as a vending machine, a smart display freezer, etc. In one embodiment, a camera facing the goods is set on the door or inside the display cabinet terminal, and when the trigger condition takes effect, the display cabinet terminal controls the camera to capture an image of the goods.

[0079] The condition trigger module 410 is used to confirm whether the preset trigger condition is effective. The trigger condition can be an operation on the display cabinet terminal, such as scanning a code to place an order, opening or closing a cabinet door, replenishing goods, etc. In one embodiment, the confirmation of whether the preset trigger condition is effective includes: confirming whether the action of scanning a code to place an order occurs; or confirming whether the action of opening or closing a cabinet door occurs; or confirming whether there is an action of picking up and placing goods. In this embodiment, if one or more of the actions of scanning a code to place an order, opening or closing a cabinet door, and / or picking up and placing goods occurs, it can be determined that the trigger condition is met, otherwise the operation on the display cabinet terminal continues to be identified.

[0080] The shooting control module 420 is used to control the showcase terminal to shoot when a preset trigger condition takes effect.

[0081] In one embodiment, if the preset trigger condition takes effect when the order is placed by scanning a code, it means that a user is shopping for goods at this time. At this time, the image captured by the display cabinet terminal can be used to analyze the popularity of the goods within the preset time. If the preset trigger condition takes effect when the cabinet door is opened or closed, it means that the user is ready to take out the goods, or the merchant is restocking. At this time, the image captured by the display cabinet terminal can be used to analyze the user's habit of taking things, or to analyze whether the merchant's restocking method complies with market rules. If the preset trigger condition takes effect when the goods are taken and put, the image captured by the display cabinet terminal can be used to analyze the user's popularity of the goods selected, or to analyze the number of restocks by the merchant.

[0082] The image generation module 430 is used to generate a first image in jpeg format according to the shooting result.

[0083] In one embodiment, the camera can automatically generate the first image in jpeg format. In other embodiments, if the format of the image generated by the camera is uncertain, generating the first image in jpeg format according to the shooting result includes: determining whether the shooting result is in jpeg format; if the shooting result is not in jpeg format, converting the image corresponding to the shooting result into jpeg format; if the shooting result is in jpeg format, maintaining the shooting result format.

[0084] The image encryption module 440 is used to write preset encryption information into the program marker segment of the first image to generate a second image.

[0085] In one embodiment, referring to Table 1, the program marker segment of the first image is any one or more marker segments from APP0 to APP15 (APP0~APP15) for storing application specific information.

[0086] In one embodiment, with reference to Table 2, the encrypted information at least includes a terminal identification code, a shooting timestamp, and an encrypted signature. Preferably, the encrypted signature uses AES encryption and digital signature. AES encryption is a symmetric key encryption that uses the same key to encrypt and decrypt data. Digital signatures use asymmetric encryption algorithms, such as RSA, to sign data with a private key and verify with a public key to ensure the integrity of the data and the authenticity of the source. This method can prevent data from being tampered with during transmission and can verify the identity of the data sender. Preferably, in the process of AES encryption, different encryption modes and padding schemes can also be selected, such as ECB, CBC, CTR and other modes, as well as PKCS7, PKCS5, NoPadding and other padding schemes to adapt to different application scenarios and security requirements. In one embodiment, the generation of signature information is based on the terminal identification code and the shooting timestamp input preset algorithm calculation.

[0087] The above-mentioned terminal image encryption device can execute the terminal image encryption method provided by any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method. For the technical details not described in detail in this embodiment, please refer to the terminal image encryption method provided by any embodiment of the present invention. Since the terminal image encryption device introduced above is a device that can execute the terminal image encryption method in the embodiment of the present invention, based on the terminal image encryption method introduced in the embodiment of the present invention, the technical personnel in this field can understand the specific implementation method of the terminal image encryption device of this embodiment and its various variations, so how the terminal image encryption device implements the terminal image encryption method in the embodiment of the present invention will not be described in detail here. As long as the technical personnel in this field implement the device adopted by the terminal image encryption method in the embodiment of the present invention, it belongs to the scope of protection of this application.

[0088] Embodiment 5

[0089] Figure 5 5 is a schematic diagram of a terminal image storage device provided in Embodiment 5 of the present invention. The device 500 can be implemented by software and / or hardware, and can generally be integrated into a server, such as Figure 5 As shown, the device 500 includes an image receiving module 510 , an encryption confirmation module 520 and an image storage module 530 .

[0090] The image receiving module 510 is used to receive a number of images to be processed in jpeg format.

[0091] In this embodiment, the server receives several images to be processed in jpeg format. These images may be images captured by the showcase terminal in the first embodiment and then encrypted and signed, or images generated by other terminals without being encrypted.

[0092] The encryption confirmation module 520 is used to confirm whether the program marker segment of the image to be processed includes preset encryption information.

[0093] In this embodiment, the server reads the content of the program marker segment of the image to be processed, first confirms whether there is encrypted signature information, and if so, decrypts the encrypted signature information according to a preset key, and confirms whether the image to be processed is a legal image generated by a preset showcase terminal according to the decryption result. In one embodiment, if the decryption result is true, the image to be processed is a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed includes the preset encryption information, and if the decryption result is false, the image to be processed is not a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed does not include the preset encryption information. In one embodiment, the verification of whether the signature information is true is based on the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation, and is true when the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation and the encrypted signature are exactly the same, and false when they are not the same.

[0094] The image storage module 530 is used to store the image to be processed when the image to be processed includes the preset encryption information, and otherwise abandon the storage of the image to be processed.

[0095] In one embodiment, if the image to be processed includes the preset encryption information, it means that the image to be processed is a legal image generated by the preset showcase terminal or an image corresponding to a legal analysis task, and the image to be processed is stored to facilitate subsequent centralized reading and analysis of the image to be processed, and then obtain the operation recommendation information of the corresponding commodity of the showcase terminal, such as purchase quantity adjustment information, hot product recommendation information, etc. If the image to be processed does not include the preset encryption information, it means that the image to be processed is an illegal image or has nothing to do with the analysis task, and the storage of the image to be processed is abandoned at this time to avoid wasting storage space.

[0096] The above-mentioned image storage device can execute the image storage method provided by any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method. For the technical details not described in detail in this embodiment, please refer to the image storage method provided by any embodiment of the present invention. Since the terminal image storage device introduced above is a device that can execute the image storage method in the embodiment of the present invention, based on the image storage method introduced in the embodiment of the present invention, the technical personnel in this field can understand the specific implementation mode of the terminal image storage device of this embodiment and its various variations, so how the terminal image storage device implements the image storage method in the embodiment of the present invention will not be described in detail here. As long as the technical personnel in this field implement the device adopted by the image storage method in the embodiment of the present invention, it belongs to the scope of protection of this application.

[0097] Embodiment 6

[0098] Figure 6600 is a schematic diagram of a terminal image analysis device provided in Embodiment 6 of the present invention. The device 600 can be implemented by software and / or hardware, and can generally be integrated into a server, such as Figure 6 As shown, the device 600 includes an image receiving module 610 , an encryption confirmation module 620 and an image analysis module 630 .

[0099] The image receiving module 610 is used to receive a number of images to be processed in jpeg format.

[0100] In this embodiment, the server receives several images to be processed in jpeg format. These images may be images that are encrypted and signed in the first embodiment, or images generated by other terminals that are not encrypted.

[0101] The encryption confirmation module 620 is used to confirm whether the program marker segment of the image to be processed includes preset encryption information.

[0102] In this embodiment, the server reads the content of the program marker segment of the image to be processed, first confirms whether there is encrypted signature information, and if so, decrypts the encrypted signature information according to a preset key, and confirms whether the image to be processed is a legal image generated by a preset showcase terminal according to the decryption result. In one embodiment, if the decryption result is true, the image to be processed is a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed includes the preset encryption information, and if the decryption result is false, the image to be processed is not a legal image generated by a preset showcase terminal, that is, the program marker segment of the image to be processed does not include the preset encryption information. In one embodiment, the verification of whether the signature information is true is based on the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation, and is true when the information generated by the terminal identification code and the shooting timestamp input by the preset algorithm calculation and the encrypted signature are exactly the same, and false when they are different.

[0103] The image analysis module 630 is used to analyze the image to be processed when the image to be processed includes the preset encryption information, so as to generate an operation report of the showcase terminal.

[0104] In one embodiment, if the image to be processed includes the preset encrypted information, it means that the image to be processed is a legitimate image or an image corresponding to the analysis task, and the image to be processed is analyzed to generate an operation report of the display cabinet terminal. In this embodiment, the operation report of the display cabinet terminal may include product recommendation information, product purchase information, product quantity adjustment information, hot product recommendation information, etc.

[0105] The above-mentioned image analysis device can execute the image analysis method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. For technical details not fully described in this embodiment, please refer to the image analysis method provided in any embodiment of the present invention. Since the image analysis device introduced above is a device that can execute the image analysis method in the embodiment of the present invention, based on the image analysis method introduced in the embodiment of the present invention, technical personnel in this field can understand the specific implementation mode of the image analysis device of this embodiment and its various variations, so how the image analysis device implements the image analysis method in the embodiment of the present invention will not be introduced in detail here. As long as the technical personnel in this field implement the device adopted by the image analysis method in the embodiment of the present invention, it belongs to the scope of protection of this application.

[0106] Embodiment 7

[0107] Figure 7 FIG. 2 shows a schematic diagram of the structure of an image processing system provided by Embodiment 7 of the present invention. Figure 7 As shown, the image processing system 700 includes a display cabinet terminal 710 and a server 720. The display cabinet terminal 710 and the server 720 are connected in a wired network or a wireless network. The display cabinet terminal 710 and the server 720 respectively include at least one processor 11 and a memory (only the detailed structure of the local conference host is shown in the figure) that is communicatively connected to the at least one processor 11, wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the image processing system 700 can also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other through the bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0108] Multiple components of the display cabinet terminal 710 and the server 720 in the image processing system 700 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the image processing system 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0109] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, for example, the processor of the display cabinet terminal 710 implements the terminal image encryption method, and the processor of the server 720 implements the image storage method and / or the image analysis method.

[0110] In some embodiments, the terminal image encryption method, the image storage method and / or the image analysis method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the display cabinet terminal 710 or / and the server 720 of the image processing system 700 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the terminal image encryption method, the image storage method and / or the image analysis method described above may be executed. Alternatively, in other embodiments, the processor 11 may be configured to execute the terminal image encryption method, the image storage method and / or the image analysis method by any other appropriate means (e.g., by means of firmware).

[0111] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0112] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0113] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0114] To provide interaction with a user, the systems and techniques described herein may be implemented on a mobile terminal having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the mobile terminal. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0115] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0116] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0117] Embodiment 8

[0118] Embodiment 8 of the present invention further provides a computer storage medium storing a computer program, wherein the computer program, when executed by a computer processor, is used to execute the terminal image encryption method, image storage method and / or image analysis method described in any of the above embodiments of the present invention.

[0119] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM, or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0120] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0121] The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.

[0122] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

[0123] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A terminal image encryption method, applied to a display cabinet terminal, characterized in that: include: Confirm whether the preset trigger conditions are effective; If the preset trigger condition takes effect, the display cabinet terminal is controlled to shoot; Generate a first image in jpeg format according to the shooting result; The preset encryption information is written into the program marker segment of the first image to generate the second image.

2. The terminal image encryption method according to claim 1, characterized in that: The step of generating a first image in jpeg format according to the shooting result includes: Determine whether the shooting result is in jpeg format; If the shooting result is not in jpeg format, converting the image corresponding to the shooting result into jpeg format; If the shooting result is in jpeg format, the shooting result format is maintained.

3. The terminal image encryption method according to claim 1, characterized in that: The encrypted information at least includes a terminal identification code, a shooting timestamp, and an encrypted signature.

4. The terminal image encryption method according to claim 1, characterized in that: The confirming whether the preset triggering condition is effective includes: Confirm whether an order has been placed by scanning the QR code; or Confirm whether the cabinet door is opened or closed; or Confirm whether there is any cargo picking and placing behavior.

5. A method for storing an image, applied to a server, characterized in that: include: Receive several images to be processed in jpeg format; confirming whether the program marker segment of the image to be processed includes preset encryption information; If the image to be processed includes the preset encryption information, the image to be processed is stored; otherwise, the storage of the image to be processed is abandoned.

6. An image analysis method, applied to a server, characterized in that: include: Receive several images to be processed in jpeg format; confirming whether the program marker segment of the image to be processed includes preset encryption information; If the image to be processed includes the preset encryption information, the image to be processed is analyzed to generate an operation report of the showcase terminal; otherwise, the analysis of the image to be processed is abandoned.

7. A terminal image encryption device, characterized in that: include: The condition trigger module is used to confirm whether the preset trigger condition is effective; A shooting control module is used to control the display cabinet terminal to shoot when the preset trigger condition takes effect; An image generation module, used to generate a first image in jpeg format according to the shooting result; The image encryption module is used to write preset encryption information into the program marker segment of the first image to generate a second image.

8. An image storage device, characterized in that: include: An image receiving module is used to receive a number of images to be processed in jpeg format; An encryption confirmation module, confirming whether the program marker segment of the image to be processed includes preset encryption information; The image storage module is used to store the image to be processed when the image to be processed includes the preset encryption information, and otherwise abandon the storage of the image to be processed.

9. An image analysis device, characterized in that: include: An image receiving module is used to receive a number of images to be processed in jpeg format; An encryption confirmation module, used to confirm whether the program marker segment of the image to be processed includes preset encryption information; The image analysis module is used to analyze the image to be processed to generate an operation report of the display cabinet terminal when the image to be processed includes the preset encryption information, and otherwise abandon the analysis of the image to be processed.

10. An image processing system, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the terminal image encryption method as described in any one of claims 1 to 4, or implement the image storage method as described in claim 5, or implement the image analysis method as described in claim 6.

Images