Chemical reaction control method, system and device based on solution color

Abstract

The invention discloses a chemical reaction control method, system and device based on solution color, and relates to the technical field of chemical reaction control, and the method comprises the following steps: obtaining an experiment scheme; extracting color description in the experimental scheme, and expanding the color description into an image generation cue word; generating a plurality of color images matched with the image generation prompt words, and sending the color images to experimenters; acquiring a color image selected by an experimenter; acquiring a real-time image of the reaction instrument; and comparing the color of the real-time image with the color of the selected color image, and if the color of the real-time image is the same as the color of the color image, starting a control operation in the experiment scheme. According to the method, the fuzzy color description is converted into the specific color image, meanwhile, an experimenter is allowed to select the most appropriate color image, the uncertainty of judgment is reduced, and the accuracy and reliability of an experiment are improved.

Description

Technical Field

[0001] The present application relates to the technical field of chemical reaction control, and in particular to a method, system and device for chemical reaction control based on solution color. Background Art

[0002] In chemical experiments, some operations need to be started or ended at specific nodes, such as ending stirring, and many of these specific nodes are determined by the color of the solution in the reaction instrument.

[0003] By combining chemical reaction control with image recognition technology, the color of the solution in the reaction instrument can be monitored in real time, and subsequent operations can be started when the color of the solution reaches the required level. However, color is a very subjective description. Even if the experimenter describes the color in a text-based experimental plan, the imprecision of the color will make it impossible to perform automated control at the node envisioned by the experimenter. For example, the following description exists in the experimental plan: "Stop the experiment after the reaction solution turns dark red." The dark red here is not a specific value, which causes the computer program to deviate from the subsequent control operations after recognizing the color of the reaction solution, resulting in poor reliability and accuracy of the imaging experiment and poor reproducibility of the experimental results. Summary of the Invention

[0004] The embodiments of the present application provide a method, system, and device for controlling a chemical reaction based on solution color, which are used to solve the problem in the prior art that inaccurate description of color can easily lead to deviations in the control of chemical reactions.

[0005] In one aspect, an embodiment of the present application provides a method for controlling a chemical reaction based on solution color, comprising:

[0006] Obtain experimental plans;

[0007] Extract the color descriptions in the experimental scheme and expand them into image generation prompts;

[0008] Generate multiple color images that match the image generation prompt words and send the color images to the experimenter;

[0009] Get the color image selected by the experimenter;

[0010] Collect real-time images of the reaction instrument;

[0011] The color of the real-time image is compared with the color of the selected color image. If the color of the real-time image is the same as the color of the color image, the control operation in the experimental plan is started.

[0012] In one possible implementation, a large language model is used to extract color descriptions in experimental scenarios.

[0013] In one possible implementation, a generation network based on a combination of a diffusion model and ControlNet is used to generate color images.

[0014] In a possible implementation, before generating a color image, an empty instrument image uploaded by an experimenter is obtained, and a color matching the image generation prompt word is filled in the empty instrument image to obtain a color image.

[0015] In one possible implementation, after obtaining the empty instrument image, the material data selected by the experimenter is also obtained, the color transmittance of the instrument is determined based on the experimental data, and the empty instrument image filled with color is rendered based on the transmittance to obtain a color image.

[0016] In one possible implementation, a method for comparing the color of a real-time image with the color of a selected color image includes: dividing the real-time image into a plurality of blocks, and dividing the color image into a plurality of blocks equal in number to the real-time image; performing similarity calculations on each block of the real-time image and each block of the color image to obtain corresponding similarities; and calculating an average of the similarities of all blocks, and if the average reaches or exceeds a similarity threshold, determining that the color of the real-time image and the color image are the same.

[0017] On the other hand, an embodiment of the present application further provides a chemical reaction control system based on solution color, comprising:

[0018] Plan acquisition module, used to obtain experimental plans;

[0019] Description extraction module, used to extract color descriptions in experimental schemes and expand color descriptions into image generation prompt words;

[0020] An image generation module is used to generate multiple color images that match the image generation prompt words and send the color images to the experimenter;

[0021] An image acquisition module is used to acquire the color image selected by the experimenter;

[0022] An image acquisition module, used to acquire real-time images of the reaction instrument;

[0023] The reaction control module is used to compare the color of the real-time image with the color of the selected color image, and if the color of the real-time image is the same as the color of the color image, start the control operation in the experimental plan.

[0024] On the other hand, an embodiment of the present application further provides a chemical reaction control device based on solution color, comprising:

[0025] processor;

[0026] a memory for storing processor-executable instructions;

[0027] Wherein, the processor executes the above-mentioned chemical reaction control method based on solution color.

[0028] The chemical reaction control method, system, and device based on solution color in this application have the following advantages:

[0029] 1. Accurate quantification: Converting fuzzy color descriptions into specific color images reduces the uncertainty of judgment.

[0030] 2. Real-time monitoring of experimental progress: Real-time monitoring of solution color changes during the experiment to ensure that the experiment is carried out according to the predetermined plan and accurately determine the key nodes of the experiment.

[0031] 3. Automated experiment control: automatically trigger operations when experimental conditions are met to improve experimental efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0033] Figure 1 A flow chart of a chemical reaction control method based on solution color provided in an embodiment of the present application.

[0034] Figure 2 The empty instrument image and the generated simulation image provided in the embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0036] Figure 1 This is a flow chart of a method for controlling a chemical reaction based on solution color provided in an embodiment of the present application. This embodiment of the present application provides a method for controlling a chemical reaction based on solution color, comprising:

[0037] S100, obtain the experimental plan.

[0038] For example, before starting an experiment, the experimenter will write a written experimental plan. In the experimental plan, the names of raw materials, amounts, temperatures, and operating methods are recorded in detail according to the experimental steps. This experimental plan not only guides the experimenter's operation but also provides reliable data for subsequent automated control.

[0039] S110, extracting the color description in the experimental scheme and expanding the color description into image generation prompt words.

[0040] For example, a large language model (LLM) can be used to extract color descriptions in experimental protocols. The large language model can identify the attributes of each word in the experimental protocol. When a word is determined to be a word representing a color, it will be extracted and then expanded into an image generation prompt word with a similar meaning. For example, the experimental protocol states "When the solution turns red, stop heating." The large language model can identify "red" as a word representing color, that is, a color description, and then expand it into "light red," "magenta," "dark red," etc., all of which represent "red." These words are image generation prompt words.

[0041] Specifically, for each color description, the closest color value is found. This color value is represented by an RGB value. For example, the color value of red is (255,0,0). After the color value is determined, it is adjusted according to a certain numerical interval to generate multiple color values. These color values ​​are then renamed, ultimately resulting in multiple image generation prompts.

[0042] S120: Generate multiple color images that match the image generation prompt words, and send the color images to the experimenter.

[0043] For example, a generation network based on a combination of a diffusion model and ControlNet can be used to generate a color image.

[0044] Specifically, the process of generating a color image through a generative network is as follows:

[0045] Extract the words representing colors from the image generation prompt words;

[0046] Convert the color word to the corresponding RGB value to generate the corresponding pure color image;

[0047] Load the Stable Diffusion base model and the ControlNet model specially trained for color control;

[0048] The pure color image is used as the input condition of the ControlNet model, and the content other than color words in the image generation prompt words is combined to guide the ControlNet model to generate a color image that meets the requirements.

[0049] Furthermore, before generating the color image, an empty instrument image uploaded by the experimenter is obtained, and the color matching the image generation prompt word is filled in the empty instrument image to obtain the color image.

[0050] Specifically, when the experimenter observes the color of the solution, he will be affected by the reaction instrument. In order to make the color image selected by the experimenter more in line with expectations, this application will fill the empty instrument image uploaded by the experimenter with color to form a color image. Figure 2 As shown, in Figure 2 In the figure, the image on the left is an empty instrument image, while the image on the right is a color image generated by filling the empty instrument image with multiple colors.

[0051] Furthermore, after obtaining the empty instrument image, the material data selected by the experimenter is also obtained, the color transmittance of the instrument is determined based on the experimental data, and the empty instrument image filled with color is rendered based on the transmittance to obtain a color image.

[0052] Specifically, although most reaction instruments whose colors can be observed from the outside are colorless and transparent, some reaction instruments are not. Moreover, even if a colorless and transparent reaction instrument is used, different materials will affect the color observed by the experimenter from the outside. In order to adapt to this influence, after the experimenter uploads the empty instrument image, the embodiment of the present application also prompts the experimenter to select the material of the reaction instrument, for example Figure 2 For the conical flask in the image, the experimenter can choose the material to be glass, PFA (polytetrafluoroethylene), or PETG (transparent plastic). Since each material has its own unique light transmission, rendering the color image according to this transmission condition can make the color image closer to what the experimenter observes.

[0053] S130, obtaining a color image selected by the experimenter.

[0054] For example, the color image will be displayed by a display device. After the experimenter determines the most suitable color image, he or she can select the color image by touching or clicking the mouse.

[0055] S140, collecting real-time images of the reaction instrument.

[0056] For example, a camera may be installed on the reaction instrument, and the camera may capture a video stream of the reaction instrument during a chemical reaction. By extracting the video stream frame by frame, a real-time image may be obtained.

[0057] S150 , comparing the color of the real-time image with the color of the selected color image. If the color of the real-time image is the same as the color of the color image, starting the control operation in the experimental plan.

[0058] Exemplarily, the method of comparing the color of the real-time image with the color of the selected color image includes:

[0059] The real-time image is divided into a plurality of blocks, for example, N*M blocks, and the color image is also divided into a plurality of blocks of the same number as the real-time image, that is, also N*M blocks;

[0060] Calculate the similarity between each block of the real-time image and each block of the color image to obtain the corresponding similarity;

[0061] The average value of the similarities of all blocks is calculated. If the average value reaches or exceeds the similarity threshold T, it is determined that the color of the real-time image is the same as the color of the color image.

[0062] It should be understood that to improve color comparison accuracy and reduce data volume, the location of the instrument in the real-time image can be first identified, and then the background outside the instrument can be removed from the real-time image. The real-time image with the removed background can then be segmented into multiple blocks. However, since the color image does not contain any background, background removal is not required.

[0063] Moreover, when calculating the similarity of blocks, it is necessary to perform similarity calculation between a block in the real-time image and a block at a corresponding position in the color image.

[0064] The present application also provides a solution color-based chemical reaction control system, which includes:

[0065] Plan acquisition module, used to obtain experimental plans;

[0066] Description extraction module, used to extract color descriptions in experimental schemes and expand color descriptions into image generation prompt words;

[0067] An image generation module is used to generate multiple color images that match the image generation prompt words and send the color images to the experimenter;

[0068] An image acquisition module is used to acquire the color image selected by the experimenter;

[0069] An image acquisition module, used to acquire real-time images of the reaction instrument;

[0070] The reaction control module is used to compare the color of the real-time image with the color of the selected color image, and if the color of the real-time image is the same as the color of the color image, start the control operation in the experimental plan.

[0071] The present application also provides a solution color-based chemical reaction control device, comprising:

[0072] processor;

[0073] a memory for storing processor-executable instructions;

[0074] Wherein, the processor executes the above-mentioned chemical reaction control method based on solution color.

[0075] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0076] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A chemical reaction control method based on solution color, characterized in that: include: Obtain experimental plans; Extracting color descriptions in the experimental scheme and expanding the color descriptions into image generation prompt words; generating a plurality of color images matching the image generation prompt words, and sending the color images to an experimenter; Acquire the color image selected by the experimenter; Collect real-time images of the reaction instrument; The color of the real-time image is compared with the color of the selected color image, and if the color of the real-time image is the same as the color of the color image, a control operation in the experimental plan is started.

2. A chemical reaction control method based on solution color according to claim 1, characterized in that: A large language model is used to extract the color description in the experimental scheme.

3. A chemical reaction control method based on solution color according to claim 1, characterized in that: The color image is generated using a generation network based on a combination of a diffusion model and ControlNet.

4. A chemical reaction control method based on solution color according to claim 1, characterized in that: Before generating the color image, an empty instrument image uploaded by an experimenter is obtained, and a color matching the image generation prompt word is filled into the empty instrument image to obtain the color image.

5. A chemical reaction control method based on solution color according to claim 4, characterized in that: After obtaining the empty instrument image, the material data selected by the experimenter is also obtained, the color transmittance of the instrument is determined based on the experimental data, and the empty instrument image filled with color is rendered based on the transmittance to obtain the color image.

6. A chemical reaction control method based on solution color according to claim 1, characterized in that: The method of comparing the color of the real-time image with the color of the selected color image includes: dividing the real-time image into a plurality of blocks, and dividing the color image into a plurality of blocks having the same number as that of the real-time image; Calculating the similarity between each block of the real-time image and each block of the color image to obtain corresponding similarities; An average value of the similarities of all blocks is calculated, and if the average value reaches or exceeds a similarity threshold, it is determined that the color of the real-time image is the same as the color of the color image.

7. A system using the solution color-based chemical reaction control method according to any one of claims 1 to 6, characterized in that: include: Plan acquisition module, used to obtain experimental plans; A description extraction module, configured to extract color descriptions in the experimental scheme and expand the color descriptions into image generation prompt words; An image generation module, configured to generate a plurality of color images matching the image generation prompt words, and send the color images to an experimenter; An image acquisition module, used to acquire the color image selected by the experimenter; An image acquisition module, used to acquire real-time images of the reaction instrument; The reaction control module is used to compare the color of the real-time image with the color of the selected color image, and if the color of the real-time image is the same as the color of the color image, start the control operation in the experimental plan.

8. A chemical reaction control device based on solution color, characterized in that: include: processor; a memory for storing instructions executable by the processor; Wherein, the processor executes the chemical reaction control method based on solution color according to any one of claims 1-6.

Images