A single-pixel imaging operation method, device, system and storage medium

Abstract

The present invention discloses a single-pixel imaging operation method, apparatus, system, and storage medium. The method includes: generating a preset optical image through a projector and projecting it onto a target object, and obtaining an optical field intensity signal according to the projected optical field; determining the second-order correlation between the preset optical image and the optical field intensity signal, and calculating an estimated value of the preset optical image according to the second-order correlation; performing an optical logic operation according to the estimated value to output an operation result corresponding to the target object. By generating a preset optical image through a projector and using the methods of composite coding and single-pixel imaging for non-linear optical logic operations, the present invention enables non-linear optical logic operations to be achieved based on a single-pixel imaging optical logic gate system using a simple and low-cost optical experimental apparatus under ordinary lighting conditions, solving the problem that expensive equipment and harsh experimental conditions are required in the existing optical logic operation process.

Description

Technical Field

[0001] The present invention relates to the technical field of optical computing, and particularly relates to a single-pixel imaging operation method, device, system and storage medium. Background Art

[0002] In most modern electronic computing devices, complex computing processes (for example, deep learning networks with multiple neuron layers) are ultimately decomposed into many basic logic gate operations based on binary bits. Common basic logic gate operations include AND Gate, NAND Gate, OR Gate, NOR Gate, XOR Gate, XNOR Gate, etc. When a large number of different logic gates are connected to each other in an appropriate manner to form a logic circuit, more complex mathematical operations such as addition, subtraction, and multiplication can be achieved. Compared with analog computing, digital computing with binary logic gates has advantages in terms of accuracy, stability, and robustness. However, current electronic computing faces some bottlenecks, and it is becoming increasingly difficult to further improve computing power. Compared with electronic computing, optical computing generally has potential advantages such as high light speed, high parallelism, and low power consumption. Therefore, the optical implementation of logic gate operations is an important research issue.

[0003] Now, one challenge faced by optical computing is that logic gates are generally non-linear mathematical operations, while many optical systems only have linear mathematical models. In previous work, non-linear optical logic gates can be realized through methods such as semiconductor amplifiers, nanophotonic plasmonic networks, silicon micro-ring resonators, non-linear photonic crystal nanospaces, diffraction neural networks, etc. However, these systems usually require optical devices made of special materials, strictly controlled light sources, and harsh experimental conditions.

[0004] Therefore, the prior art still needs to be improved. Summary of the Invention

[0005] The technical problem to be solved by the present invention is that, aiming at the defects of the prior art, the present invention provides a single-pixel imaging operation method, device, system and storage medium to solve the technical problem that expensive equipment and harsh experimental conditions are required in the existing optical logic operation process.

[0006] The technical solution adopted by the present invention to solve the technical problem is as follows:

[0007] In a first aspect, the present invention provides a single-pixel imaging operation method, and the single-pixel imaging operation method includes the following steps:

[0008] Generate a preset optical image through a projector and project it onto a target object, and obtain an optical field intensity signal according to the projected optical field;

[0009] Determine the second-order correlation between the preset optical image and the optical field intensity signal, and calculate the estimated value of the target object according to the second-order correlation;

[0010] Perform optical logic operations according to the estimated value to output an operation result corresponding to the target object.

[0011] In one implementation, before generating the preset optical image by the projector and projecting it onto the target object, and obtaining the optical field intensity signal according to the projected optical field, it includes:

[0012] Perform composite coding according to the input binary value and the type of logic gate operation to obtain a plurality of the preset optical images;

[0013] Sort a plurality of the preset optical images according to a preset arrangement order to obtain an illumination image sequence for projection by the projector.

[0014] In one implementation, before generating the preset optical image by the projector and projecting it onto the target object, and obtaining the optical field intensity signal according to the projected optical field, it further includes:

[0015] Divide the image corresponding to the target object into a plurality of sub-regions, and determine the binary bit value according to the corresponding light reflectivity in each sub-region.

[0016] In one implementation, the preset optical image includes a random structured light image, a Fourier image, and a Hadamard image.

[0017] In one implementation, the type of logic gate operation includes an AND gate, a NAND gate, an OR gate, a NOR gate, an XOR gate, and an XNOR gate.

[0018] In one implementation, generating the preset optical image by the projector and projecting it onto the target object, and obtaining the optical field intensity signal according to the projected optical field, includes:

[0019] Control the projector to sequentially project a plurality of the preset optical images onto the target object according to the illumination image sequence;

[0020] Collect the corresponding one-dimensional signals after projection through a single-pixel sensor arranged behind the target object, and sequentially obtain a plurality of the optical field intensity signals according to the correlation between the collected one-dimensional signals and the target object.

[0021] In one implementation, sequentially obtaining a plurality of the optical field intensity signals according to the correlation between the collected one-dimensional signals and the target object includes:

[0022] Determine the correlation between the target object and the corresponding preset optical image;

[0023] Obtain a plurality of the optical field intensity signals according to the relevance:

[0024] ;

[0025] wherein, is the preset optical image;

[0026] is the th projection, is the number of projections;

[0027] is the image corresponding to the target object.

[0028] In one implementation, the determining the second-order correlation between the preset optical image and the optical field intensity signal, and calculating the estimated value of the target object according to the second-order correlation includes:

[0029] Determine the second-order correlation between the preset optical image and each of the optical field intensity signals respectively according to the compressive sensing algorithm;

[0030] Calculate the estimated value of the target object according to the second-order correlation:

[0031] ;

[0032] wherein, is the average value of the optical field intensity signals of the

[0033] is the average value of the preset optical images of the

[0034] is the average value of the convolution of the

[0035] In one implementation, the performing the optical logic operation according to the estimated value includes:

[0036] Sort the obtained estimated values according to the projection order to obtain a single-pixel intensity sequence;

[0037] Select the maximum value in the single-pixel intensity sequence, and use the abscissa label corresponding to the maximum value as the operation result corresponding to the target object.

[0038] In one implementation, the single-pixel imaging operation method further includes:

[0039] Verify the operation result according to the true value of the image corresponding to the target object, and output the verification result.

[0040] In a second aspect, the present invention provides a single-pixel imaging operation device, including: a processor and a memory, where the memory stores a single-pixel imaging operation program, and when the single-pixel imaging operation program is executed by the processor, it is used to implement the single-pixel imaging operation method as described in the first aspect.

[0041] In a third aspect, the present invention provides a single-pixel imaging operation system, including: a projector, a single-pixel sensor, and the single-pixel imaging operation device as described in the second aspect;

[0042] The projector is used to generate a preset optical image, and after being projected onto the projection surface of the target object, a light field intensity signal is obtained;

[0043] The single-pixel sensor is used to collect the light field intensity signal and send the light field intensity signal to the single-pixel imaging operation device;

[0044] The single-pixel imaging operation device is used to control the projector to generate the preset optical image, and is used to perform optical logic operations according to the light field intensity signal to output an operation result corresponding to the target object.

[0045] In a fourth aspect, the present invention provides a storage medium, where the storage medium stores a single-pixel imaging operation program, and when the single-pixel imaging operation program is executed by a processor, it is used to implement the single-pixel imaging operation method as described in the first aspect.

[0046] The present invention adopts the above technical solutions and has the following effects:

[0047] The present invention generates a preset optical image through a projector, and uses the methods of composite coding and single-pixel imaging to perform non-linear optical logic operations. Thus, based on the optical logic gate system of single-pixel imaging, under ordinary lighting conditions, with a simple and low-cost optical experimental device, non-linear optical logic operations can be realized, the efficiency of non-linear optical logic operations is improved, and at the same time, the problems of expensive equipment and harsh experimental conditions required in the existing optical logic operation process are solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on the structures shown in these drawings.

[0049] Figure 1 It is a flowchart of the single-pixel imaging operation method in an implementation manner of the present invention.

[0050] Figure 2 It is a schematic diagram of a single-pixel imaging operation system in an implementation manner of the present invention.

[0051] Figure 3 It is a schematic diagram of the input of binary values in an implementation manner of the present invention.

[0052] Figure 4 It is a schematic diagram of the encoding and image of binary values in an implementation manner of the present invention.

[0053] Figure 5 It is a schematic diagram of the single-pixel intensity sequence of binary values in an implementation manner of the present invention.

[0054] Figure 6 It is a schematic diagram of the input of composite encoding in an implementation manner of the present invention.

[0055] Figure 7 It is a schematic diagram of the composite encoding and image in an implementation manner of the present invention.

[0056] Figure 8 It is a schematic diagram of the output of the binary value encoding in an implementation manner of the present invention.

[0057] Figure 9 It is a schematic diagram of the output of the composite encoding in an implementation manner of the present invention.

[0058] Figure 10 It is a functional schematic diagram of a single-pixel imaging operation device in an implementation manner of the present invention.

[0059] The realization, functional characteristics and advantages of the present invention will be further described with reference to the embodiments and the accompanying drawings. Specific Embodiments

[0060] To make the objectives, technical solutions and advantages of the present invention clearer and more definite, the following further describes the present invention in detail with reference to the accompanying drawings and by way of examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0061] Exemplary Method

[0062] Currently, one of the challenges faced by optical computing is that logic gates are generally non-linear mathematical operations, while many optical systems only have linear mathematical models. In previous work, non-linear optical logic gates could be realized through methods such as semiconductor amplifiers, nanophotonic plasmonic networks, silicon micro-ring resonators, non-linear photonic crystal nanospaces, and diffraction neural networks. However, these systems usually require optical devices made of special materials, strictly controlled light sources, and harsh experimental conditions.

[0063] To solve the above technical problems, this embodiment provides a single-pixel imaging operation method. The single-pixel imaging operation method proposed in this embodiment is implemented based on an optical logic gate system for single-pixel imaging, and can inherit the characteristics of the single-pixel imaging system. Under ordinary lighting conditions, a simple and low-cost optical experimental device can be used to achieve non-linear optical logic operations, improving the efficiency of non-linear optical logic operations. At the same time, the problem that expensive equipment and harsh experimental conditions are required in the existing optical logic operation process is solved.

[0064] As Figure 1 shown, an embodiment of the present invention provides a single-pixel imaging operation method, and the single-pixel imaging operation method includes the following steps:

[0065] Step S100, generate a preset optical image through a projector and project it onto a target object, and obtain an optical field intensity signal according to the projected optical field.

[0066] In this embodiment, the single-pixel imaging operation method is applied to a single-pixel imaging operation device, and the single-pixel imaging operation device includes but is not limited to: devices such as a computer that implement optical logic gate operations based on single-pixel imaging.

[0067] Single-pixel imaging (SPI), as a new type of computational imaging method, sequentially modulates the optical field of a target object through different illumination patterns, and at the same time uses a single-pixel sensor without spatial resolution to record the overall intensity of the optical field. Mathematically analyzed, the optical field intensity is the result of the inner product of the illumination pattern and the object image. Single-pixel imaging can optically implement linear weighted summation or linear classification operations. In previous work, researchers only tried to use single-pixel imaging to complete optical analog computing. In this embodiment, optical logic gate calculations are performed within the framework of single-pixel imaging. An optical logic gate system based on single-pixel imaging is proposed, and the illumination images used can be updated at a refresh rate of megahertz or even gigahertz per second, and the calculation speed is very fast. At the same time, the system can work through single-photon detection under very weak illumination conditions, greatly reducing power consumption. Moreover, due to the characteristics of the single-pixel imaging system, the system only needs to use a simple and low-cost optical experimental device under ordinary lighting conditions to achieve non-linear optical logic operations.

[0068] Before implementing the single-pixel imaging operation method, it is also necessary to set the illumination pattern projected by the projector to obtain an illumination image sequence for illumination.

[0069] Specifically, in an implementation manner of this embodiment, before step S100, the following steps are included:

[0070] Step S001, perform composite encoding according to the input binary value and the type of logic gate operation to obtain a plurality of the preset optical images;

[0071] Step S002: Sort a number of the preset light images according to a preset arrangement order to obtain an illumination image sequence for projection by the projector.

[0072] Step S003: Divide the image corresponding to the target object into a number of sub-regions, and determine the binary bit values according to the corresponding light reflectance within each sub-region.

[0073] As Figure 2 shown, in this embodiment, the single-pixel imaging system includes: a projector, a single-pixel sensor, and a single-pixel imaging operation device (i.e., the computer shown in the figure); when implementing this embodiment, binary values and logic gate operation types can be pre-input into the single-pixel imaging operation device, and the single-pixel imaging operation device can perform composite encoding according to the input binary values and logic gate operation types, thereby obtaining a number of light images, and then sorting the number of preset light images according to a preset arrangement order (for example, the preset arrangement order is the order after arranging and combining according to binary values and logic gate operation types) to obtain an illumination image sequence for projection by the projector.

[0074] In an implementation manner of this embodiment, the preset number of light images includes: a random structured light image, a Fourier image, and a Hadamard image; for the sake of easy understanding, the random structured light image is used as an example for description in this embodiment.

[0075] In an implementation manner of this embodiment, the input logic gate operation types are six common types of logic gates; among them, the logic gate operation types include: AND gate, NAND gate, OR gate, NOR gate, XOR gate, and XNOR gate; specifically, the definitions of the six common types of logic gates are as Figure 3 shown; for example, if the binary value of input 1 is 0 and the binary value of input 2 is 1, the output of the XOR gate is 1. Because logic gates are designed based on binary (0 or 1), each logic gate has only 4 types of inputs, namely (0, 0), (1, 0), (0, 1), and (1, 1). When a large number of different logic gates are connected to each other and form a logic circuit in an appropriate manner, ideal mathematical operations (such as addition, subtraction, and multiplication) can be achieved. Compared with analog computing, digital computing with binary logic gates has advantages in terms of accuracy, stability, and robustness.

[0076] In an implementation manner of this embodiment, in the single-pixel imaging optical logic gate system, the target image (i.e., the image corresponding to the target object) can be divided into 4 sub-regions, and by encoding the light reflectance within different sub-regions, the binary bits of two inputs are represented; as Figure 4As shown, if the binary value of Input 1 is 0, the upper left sub-region will have the maximum reflectivity (white), while the upper right sub-region will have the minimum reflectivity (black); if the binary value of Input 1 is 1, the encoding will be exactly the opposite, that is, the upper left sub-region will have the minimum reflectivity (black), while the upper right sub-region will have the maximum reflectivity (white).

[0077] Specifically, as Figure 4 shown in (b), there are a total of four possible encoding methods. These four encoding methods correspond to the illumination patterns being projected onto the target object in a fixed order (in the order shown in the figure), so that four corresponding single-pixel intensity values can be obtained. When the image corresponding to the target object matches the illumination pattern, the single-pixel intensity value will be the highest. According to the logical gate operation rules, the binary bit output values corresponding to the four encoded images can be determined. As Figure 5 shown in (c), the target logical gate output values (0 or 1) corresponding to the first, second, third, and fourth illumination patterns in the figure are pre-displayed on the horizontal axis of the single-pixel intensity distribution map (for example, Figure 5 the 0, 0, 0, and 1 of the AND gate in (c)). By comparing the actual magnitudes of the four single-pixel values obtained by the single-pixel system, the maximum single-pixel intensity (depending on the encoded target image) corresponds to the corresponding label on the horizontal axis, which is the output logical gate value.

[0078] Furthermore, the system proposed in this embodiment can be further extended to the compound optical logic gate operation that simultaneously uses multiple logic gates; not only encodes the target image (i.e., the image corresponding to the target object) according to the input binary value, but also encodes the target image according to the type of logical gate operation; that is, the compound logical operation needs to determine the output according to the logical gate type and the input, and the binary and the logical gate operation type must be encoded. The two are encoded simultaneously, and the encoding result is placed on one picture. The encoding method is as Figure 6 shown.

[0079] As Figure 6 shown, in the encoded target image, there will be a total of 10 sub-regions for performing three possible types of logical gate operations. Similar to Figure 4 , the first four sub-regions (the first and second rows) are used to represent the binary bit values of the two inputs, and the remaining six sub-regions (the third, fourth, and fifth rows) are used to represent the type of logical gate.

[0080] For example, if an AND gate is being operated, the right sub-region of the third row will be "opened" and marked white. The left sub-region of the third row will be "closed" and marked black. In addition, the fourth and fifth rows will both be in the "closed" mode. The target image can be encoded in 12 different ways, 12 different illumination images or 12 possible encoded target images as Figure 7As shown. These 12 different illumination images will be projected in the single-pixel imaging system in the order of Figure 7 from left to right and from top to bottom.

[0081] In this embodiment, after obtaining the illumination images by means of composite coding, the single-pixel imaging operation device can control the projector to project a number of preset light images in sequence according to the illumination image sequence obtained by composite coding, so as to implement optical logic gate operation based on single-pixel imaging.

[0082] Specifically, in one implementation manner of this embodiment, step S100 includes the following steps:

[0083] Step S101, controlling the projector to project a number of the preset light images on the target object in sequence according to the illumination image sequence;

[0084] Step S102, collecting the corresponding one-dimensional signals after projection through a single-pixel sensor arranged behind the target object, and obtaining a number of the light field intensity signals in sequence according to the correlation between the collected one-dimensional signals and the target object.

[0085] In this embodiment, before controlling the projector to project, it is necessary to control the light field intensity of the on-site environment. Assuming that the light field intensity of the on-site environment is 0 (i.e., absolute darkness), then the optical logic gate operation process can be not affected by the on-site ambient light; and when the projector projects the composite-coded image, mainly a number of preset light images are projected on the target object in sequence according to the illumination image sequence obtained by composite coding; furthermore, by collecting the corresponding one-dimensional signals after projection through a single-pixel sensor arranged behind the target object, a number of on-site light field intensity signals can be obtained; wherein, a number of the light field intensity signals and a number of the preset light images are in a one-to-one correspondence relationship.

[0086] Specifically, in one implementation manner of this embodiment, step S102 includes the following steps:

[0087] Step S102a, determining the correlation between the target object and the corresponding preset light image;

[0088] Step S102b, obtaining a number of the light field intensity signals according to the correlation.

[0089] In this embodiment, according to the single-pixel imaging principle, a correlation test is carried out. Assuming that the random structured light image generated by the projector is , where represents the th projection, is the projection number, represents the image coordinate. The light image and the target object The intensity signal generated after the action is collected by the lens and then captured by a single-pixel sensor without spatial resolution to obtain a one-dimensional intensity signal. , according to the optical image and the object , the following can be obtained:

[0090] ;

[0091] It is worth mentioning that in this embodiment, when determining the correlation between the target object and the corresponding preset optical image, the correlation (i.e., functional relationship) between the composite coded image and the image of the target object can be obtained through experimental data.

[0092] Furthermore, in order to reduce the number of acquisitions and improve the acquisition efficiency, the method of compressive sensing can be introduced (compressive sensing is an algorithm, that is, after obtaining the result, using this algorithm can improve the reconstruction quality). Single-pixel imaging can be realized under incoherent light illumination, only capturing the intensity distribution of the target image, and the system does not require strict experimental conditions.

[0093] This embodiment performs composite coding in the form of binary numerical values and logic gate types to obtain a coded image, and realizes optical logic operations through the projection method of a projector, only capturing the intensity distribution of the target image, avoiding the optical devices and strict experimental conditions required in the optical logic operation process.

[0094] As Figure 1 shown, in one implementation manner of the embodiment of the present invention, the single-pixel imaging operation method further includes the following steps:

[0095] Step S200, determining the second-order correlation between the preset optical image and the optical field intensity signal, and calculating the estimated value of the target object according to the second-order correlation.

[0096] In this embodiment, after obtaining a plurality of one-dimensional intensity signals captured by the single-pixel sensor, according to the second-order correlation between different illumination images and the optical field intensity signal, the estimated value of each illumination image can be calculated.

[0097] Specifically, in one implementation manner of this embodiment, step S200 includes the following steps:

[0098] Step S201, respectively determining the second-order correlation between the preset optical image and each of the optical field intensity signals according to the compressive sensing algorithm;

[0099] Step S202, calculating the estimated value of the target object according to the second-order correlation.

[0100] In this embodiment, the second-order correlation between each composite-coded image and the corresponding light field intensity signal can also be obtained from experimental data. After projections, the estimated value of the image of the target object and can be obtained according to the second-order correlation:

[0101] ;

[0102] where is the average value of the light field intensity signals for projections;

[0103] is the average value of the preset optical images for projections;

[0104] is the average value of the convolutions for projections.

[0105] It is worth mentioning that as the number of measurements increases, the estimated value of the image of the target object will be closer and closer to the true target image.

[0106] As Figure 1 shown, in one implementation of the embodiment of the present invention, the single-pixel imaging operation method further includes the following steps:

[0107] Step S300: Perform an optical logic operation according to the estimated value to output an operation result corresponding to the target object.

[0108] In this embodiment, after obtaining the estimated values corresponding to each composite-coded image, an optical logic operation can be performed according to the estimated values to output an operation result corresponding to the target object; where the output operation result is a value close to the true value of the image of the target object.

[0109] In one implementation of this embodiment, step S300 includes the following steps:

[0110] Step S301: Sort the obtained estimated values according to the projection order to obtain a single-pixel intensity sequence;

[0111] Step S302: Select the maximum value in the single-pixel intensity sequence, and use the abscissa label corresponding to the maximum value as the operation result corresponding to the target object.

[0112] In this embodiment, when the image of the target object matches the illumination pattern, the single-pixel intensity value will be the highest. According to the logical gate operation rules, the binary bit output value corresponding to the encoded image can be determined. As Figure 8 shown, the target logical gate output values (0 or 1) corresponding to the first, second, third, and fourth illumination patterns in Figure 4 are pre-displayed on the horizontal axis of the single-pixel intensity distribution diagram. By comparing the actual magnitudes of the four single-pixel values obtained by the single-pixel system, the corresponding label on the horizontal axis of the maximum single-pixel intensity (depending on the encoded target image) is the output logical gate value.

[0113] Correspondingly, as Figure 9 shown, Figure 7 the target logical gate output values (0 or 1) corresponding to the 12 illumination patterns in

[0114] are pre-displayed on the horizontal axis of the single-pixel intensity distribution diagram. By comparing the actual magnitudes of the four single-pixel values obtained by the single-pixel system, the corresponding label on the horizontal axis of the maximum single-pixel intensity (depending on the encoded target image) is the output logical gate value. Figure 8 and Figure 9 the single-pixel intensity sequences in

[0115] In an implementation manner of the embodiment of the present invention, the single-pixel imaging operation method further includes the following steps:

[0116] Step S400, verifying the operation result according to the true value of the image corresponding to the target object, and outputting a verification result.

[0117] In this embodiment, through the single-pixel imaging experiment, the proposed scheme of this embodiment can be verified.

[0118] First, print the object image (i.e., the image of the target object) on a paper card (i.e., output the target image);

[0119] Then, project the illumination pattern through the JmGOG3 projector;

[0120] Finally, record the optical signal through the FDS1010 photodetector, and collect data through the NI USB-6216 data acquisition card. By comparing the experimental data with the true data, the output result can be verified.

[0121] It is worth mentioning that the single-pixel imaging operation method proposed in this embodiment can be applied to all different types of logical gates.

[0122] In the actual experimental process, taking the AND gate, OR gate, and XOR gate as examples, the following steps may be included:

[0123] Step S1: Project the illumination patterns corresponding to the input binary values (0, 0), (1, 0), (0, 1), and (1, 1) Figure 4 ((b)) onto the target image in sequence. Each of the three logic gates has a total of four input combinations, resulting in a total of 12 encoded patterns;

[0124] Step S2: Test all 12 possible cases, and the results are completely correct. The system can always display the correct logic gate output result that is the same as the logic gate output result in Figure 3 . Specifically, as shown in the three result examples in Figure 8 (the single-pixel intensity values are normalized).

[0125] The single-pixel imaging process can be regarded as a "competition" process. The maximum single-pixel intensity will be the "winner". In Figure 8 (a), it is the case where both input 1 and input 2 are 0 and the result of the AND gate operation. Among them, the first single-pixel value obtained by the single-pixel system is the largest, so the first single-pixel value is the "winner", and its corresponding label is 0. Therefore, the AND logic gate output result optically calculated by the single-pixel imaging system will be 0, and its result is the same as the logic operation result. For other logic gates and other input bit values, the working mechanism is similar and will not be elaborated here.

[0126] Similarly, by testing the 12 possible cases corresponding to the three different types of logic gates, AND gate, OR gate, and XOR gate, in the Figure 6 and Figure 7 shown composite system, the results are also completely correct. Figure 9 Three examples (the single-pixel intensity values are normalized) are shown in Figure 8 . In the composite system, the single-pixel imaging system needs to simultaneously detect the input binary bit values and the type of the logic gate. Compared with the results in Figure 8 , the difference between the maximum value and the second maximum value in the single-pixel intensity sequence is smaller, but it can still correctly indicate the logic gate output.

[0127] This embodiment achieves the following technical effects through the above technical solutions:

[0128] In this embodiment, a preset optical image is generated by a projector, and non-linear optical logic operations are performed by means of composite coding and single-pixel imaging. Thus, based on the optical logic gate system of single-pixel imaging, non-linear optical logic operations can be achieved by using a simple and low-cost optical experimental device under ordinary lighting conditions, improving the efficiency of non-linear optical logic operations and solving the problem that expensive equipment and harsh experimental conditions are required in the existing optical logic operation process.

[0129] Exemplary device

[0130] Based on the above embodiment, the present invention further provides a single-pixel imaging operation device, and its principle block diagram can be as Figure 10 shown.

[0131] The single-pixel imaging operation device includes: a processor, a memory, an interface, a display screen, and a communication module connected by a system bus; wherein, the processor of the single-pixel imaging operation device is used to provide computing and control capabilities; the memory of the single-pixel imaging operation device includes a storage medium and an internal memory; the storage medium stores an operating system and a computer program; the internal memory provides an environment for the operation of the operating system and the computer program in the storage medium; the interface is used to connect external devices, such as mobile terminals and computers, etc.; the display screen is used to display corresponding single-pixel imaging operation information; the communication module is used to communicate with a cloud server or a mobile terminal.

[0132] When the computer program is executed by the processor, it is used to implement a single-pixel imaging operation method.

[0133] Those skilled in the art can understand that Figure 10 the principle block diagram shown in

[0134] merely shows the block diagram of some structures related to the solution of the present invention, and does not constitute a limitation on the single-pixel imaging operation device to which the solution of the present invention is applied. The specific single-pixel imaging operation device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0135] Exemplary system

[0136] Based on the above embodiment, the present invention further provides a single-pixel imaging operation system, as Figure 2 shown, including: a projector, a single-pixel sensor, and the single-pixel imaging operation device (i.e., the computer shown in the figure) described above;

[0137] The projector is used to generate a preset optical image, which is projected onto the projection surface of the target object to obtain a light field intensity signal;

[0138] The single-pixel sensor is used to collect the light field intensity signal and send the light field intensity signal to the single-pixel imaging operation device;

[0139] The single-pixel imaging operation device is used to control the projector to generate the preset optical image and perform optical logic operations according to the light field intensity signal to output an operation result corresponding to the target object.

[0140] In one embodiment, a storage medium is provided. The storage medium stores a single-pixel imaging operation program, which is used to implement the single-pixel imaging operation method as described above when executed by a processor.

[0141] Those of ordinary skill in the art can understand that all or part of the processes in the above-described embodiment methods can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile storage medium. When the computer program is executed, it can include the processes of the above-described method embodiments. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided by the present invention can include non-volatile and / or volatile memories.

[0142] In summary, the present invention provides a single-pixel imaging operation method, device, system, and storage medium. The method includes: generating a preset optical image through a projector and projecting it onto a target object, and obtaining a light field intensity signal according to the projected light field; determining the second-order correlation between the preset optical image and the light field intensity signal, and calculating an estimated value of the target object according to the second-order correlation; performing an optical logic operation according to the estimated value to output an operation result corresponding to the target object. The present invention generates a preset optical image through a projector and uses the methods of composite coding and single-pixel imaging to perform non-linear optical logic operations. Thus, based on the optical logic gate system of single-pixel imaging, non-linear optical logic operations can be achieved using a simple and low-cost optical experimental device under ordinary lighting conditions, solving the problem that expensive equipment and harsh experimental conditions are required in the existing optical logic operation process.

[0143] It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above description. All such improvements and transformations should fall within the protection scope of the appended claims of the present invention.

Claims

1. A single-pixel imaging operation method, characterized in that, the single-pixel imaging operation method includes: generating a preset light image by a projector and projecting it onto a target object, and obtaining a light field intensity signal according to the projected light field; determining the second-order correlation between the preset light image and the light field intensity signal, and calculating an estimated value of the target object according to the second-order correlation; performing an optical logic operation according to the estimated value to output an operation result corresponding to the target object; before the step of generating a preset light image by a projector and projecting it onto a target object, and obtaining a light field intensity signal according to the projected light field, includes: performing composite coding according to the input binary numerical values and logic gate operation types to obtain a plurality of the preset light images; sorting the plurality of preset light images according to a preset arrangement order to obtain an illumination image sequence for projection by the projector; before the step of generating a preset light image by a projector and projecting it onto a target object, and obtaining a light field intensity signal according to the projected light field, further includes: dividing the image corresponding to the target object into a plurality of sub-regions, and determining the binary numerical values according to the corresponding light reflectance in each sub-region; the performing an optical logic operation according to the estimated value includes: sorting the obtained estimated values according to the projection order to obtain a single-pixel intensity sequence; selecting the maximum value in the single-pixel intensity sequence, and using the abscissa label corresponding to the maximum value as the operation result corresponding to the target object.

2. The single-pixel imaging operation method according to claim 1, characterized in that, the preset light image includes a random structured light image, a Fourier image, and a Hadamard image.

3. The single-pixel imaging operation method according to claim 1, characterized in that, the logic gate operation types include an AND gate, a NAND gate, an OR gate, a NOR gate, an XOR gate, and an XNOR gate.

4. The single-pixel imaging operation method according to claim 1, characterized in that, the step of generating a preset light image by a projector and projecting it onto a target object, and obtaining a light field intensity signal according to the projected light field, includes: controlling the projector to sequentially project a plurality of the preset light images onto the target object according to the illumination image sequence; collecting one-dimensional signals corresponding to the projection by a single-pixel sensor disposed behind the target object, and sequentially obtaining a plurality of the light field intensity signals according to the correlation between the collected one-dimensional signals and the target object.

5. The single-pixel imaging operation method according to claim 4, characterized in that, the step of sequentially obtaining a plurality of the light field intensity signals according to the correlation between the collected one-dimensional signals and the target object includes: determining the correlation between the target object and the corresponding preset light image; obtaining a plurality of the light field intensity signals according to the correlation: ； Among them, is the preset optical image; For the th projection, where is the number of projections; is the image corresponding to the target object.

6. The single-pixel imaging operation method according to claim 1, characterized in that, the step of determining the second-order correlation between the preset light image and the light field intensity signal, and calculating an estimated value of the target object according to the second-order correlation, includes: Determine the second-order correlation between the preset optical image and each of the optical field intensity signals respectively according to the compressive sensing algorithm; Calculate the estimated value of the target object according to the second-order correlation: ； Among them, is the average value of the optical field intensity signals of the secondary projection; is the average value of the preset optical images for the secondary projection; is the average value of the convolution of the secondary projection.

7. The single-pixel imaging operation method according to claim 1, characterized in that, the single-pixel imaging operation method further includes: Verify the operation result according to the true value of the image corresponding to the target object, and output the verification result.

8. A single-pixel imaging operation device, characterized in that, comprises: a processor and a memory, the memory stores a single-pixel imaging operation program, and when the single-pixel imaging operation program is executed by the processor, it is used to implement the single-pixel imaging operation method according to any one of claims 1-7.

9. A single-pixel imaging operation system, characterized in that, comprises: a projector, a single-pixel sensor and the single-pixel imaging operation device according to claim 8; the projector is used to generate a preset optical image, and after being projected onto the projection surface of the target object, obtain an optical field intensity signal; the single-pixel sensor is used to collect the optical field intensity signal and send the optical field intensity signal to the single-pixel imaging operation device; the single-pixel imaging operation device is used to control the projector to generate the preset optical image, and is used to perform optical logic operations according to the optical field intensity signal to output an operation result corresponding to the target object.

10. A storage medium, characterized in that, the storage medium stores a single-pixel imaging operation program, and when the single-pixel imaging operation program is executed by a processor, it is used to implement the single-pixel imaging operation method according to any one of claims 1-7.

Images