Cigarette burning image registration method, device, equipment, medium and product

Abstract

The application discloses a cigarette combustion image registration method, device, equipment, medium and product. The method comprises the following steps: acquiring a cigarette combustion visible light image sequence and a cigarette combustion infrared thermal image sequence; extracting the highest temperature in each cigarette combustion infrared thermal image; for a plurality of cigarette combustion infrared thermal images, determining a registration time of the cigarette combustion infrared thermal images, and based on a plurality of highest temperatures, determining at least one to-be-used time in a neighborhood time window associated with the registration time; based on the registration time, the puffing parameters corresponding to the puffing device and the at least one to-be-used time, determining a first interval duration between the registration time and the puffing time of the first to-be-tested cigarette; based on the first interval duration and the shooting frequency of the industrial camera, determining a target visible light image associated with the cigarette combustion infrared thermal image from the cigarette combustion visible light image sequence. The accuracy of image registration is improved, and the accuracy of cigarette combustion state detection is improved.

Description

Technical Field

[0001] This invention relates to the field of cigarette combustion detection technology, and in particular to a cigarette combustion image registration method, apparatus, equipment, medium and product. Background Technology

[0002] During the combustion process of cigarettes, the combustion state directly affects the conversion efficiency and pathway of tobacco raw materials into smoke components, thus significantly impacting the sensory quality of cigarettes, such as aroma characteristics, smoke smoothness, and the level of off-flavors. Therefore, accurately and effectively detecting and evaluating the combustion state of cigarettes is of great significance for cigarette product quality control, formula optimization, and the research and development of new tobacco products.

[0003] In existing technologies, there are generally two methods for detecting the combustion state of cigarettes.

[0004] One approach is to use visible light images or temperature field images of cigarettes during combustion to assess the combustion state. However, single-image detection methods cannot comprehensively reflect the combustion state of cigarettes, resulting in poor detection performance and low accuracy.

[0005] Another approach relies on manual registration of two images taken at the same moment, based on the content presented in the visible light image and the temperature field image, to assess the cigarette combustion state at that moment. However, this manual registration method is not only inefficient and costly, but also prone to subjective judgment errors, leading to poor detection accuracy. Summary of the Invention

[0006] This invention provides a method, apparatus, device, medium, and product for registering cigarette combustion images, thereby improving the accuracy of image registration between infrared thermal images and visible light images of cigarette combustion, thus enhancing the accuracy of cigarette combustion state detection and improving the quality control level of cigarette products.

[0007] According to one aspect of the present invention, a cigarette combustion image registration method is provided, applied to a cigarette combustion detection system, the cigarette combustion detection system including a puffing device and an industrial camera and an infrared thermal imager on the same horizontal plane; the field of view of the industrial camera and the field of view of the infrared thermal imager include the same cigarette to be tested, the cigarette to be tested being mounted on the puffing device; the method includes: The method acquires a sequence of visible light images and a sequence of infrared thermal images of cigarette combustion; wherein the sequence of visible light images of cigarette combustion is obtained by the industrial camera during the combustion process of the cigarette under test; the sequence of infrared thermal images of cigarette combustion is obtained by the infrared thermal imager during the combustion process of the cigarette under test, and includes multiple infrared thermal images of cigarette combustion; the combustion process includes a smoking stage and a smoldering stage; Extract the highest temperature from each of the infrared thermal images of cigarette combustion; For multiple infrared thermal images of cigarette combustion, determine the registration time of the infrared thermal images of cigarette combustion, and based on multiple maximum temperatures, determine at least one time to be used within a neighborhood time window associated with the registration time. Based on the registration time, the suction parameters corresponding to the suction device, and at least one usage time, a first interval duration is determined between the registration time and the first suction time of the cigarette to be tested. Based on the first interval duration and the shooting frequency of the industrial camera, a target visible light image associated with the cigarette combustion infrared thermal image is determined from the visible light image sequence of the cigarette combustion.

[0008] According to another aspect of the present invention, a cigarette combustion image registration device is provided, configured for use in a cigarette combustion detection system, the cigarette combustion detection system including a puffing device and an industrial camera and an infrared thermal imager on the same horizontal plane; the field of view of the industrial camera and the field of view of the infrared thermal imager include the same cigarette to be tested, the cigarette to be tested being mounted on the puffing device; the device includes: The image sequence acquisition module is used to acquire visible light image sequences and infrared thermal image sequences of cigarette combustion; wherein, the visible light image sequence of cigarette combustion is obtained by the industrial camera during the combustion process of the cigarette under test; the infrared thermal image sequence of cigarette combustion is obtained by the infrared thermal imager during the combustion process of the cigarette under test, including multiple infrared thermal images of cigarette combustion; the combustion process includes a smoking stage and a smoldering stage; The highest temperature sequence extraction module is used to extract the highest temperature from each of the infrared thermal images of cigarette combustion. The module for determining the time to be used is used to determine the time to be registered for multiple infrared thermal images of cigarette combustion, and to determine at least one time to be used within a neighborhood time window associated with the time to be registered based on multiple maximum temperatures. The first interval duration determination module is used to determine the first interval duration between the registration time and the first time of absorbing the cigarette to be tested, based on the registration time, the absorbing parameters corresponding to the absorbing device, and at least one time to be used. The target visible light image determination module is used to determine, based on the first interval duration and the shooting frequency of the industrial camera, a target visible light image associated with the cigarette combustion infrared thermal image from the cigarette combustion visible light image sequence.

[0009] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: At least one processor; and a memory communicatively connected to said at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the image registration method according to any embodiment of the present invention.

[0010] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the image registration method according to any embodiment of the present invention.

[0011] According to another aspect of the present invention, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the image registration method as described in any embodiment of the present invention.

[0012] The technical solution of this invention acquires a sequence of visible light images and an infrared thermographic image sequence of cigarette combustion during the combustion process. Combined with temperature characteristic analysis of the infrared thermographic image sequence, it determines the highest temperature sequence and the time to be used associated with the registration time. Then, using the registration time, the corresponding suction parameters of the suction device, and at least one time to be used, it accurately calculates the first interval between the registration time and the first suction time. Based on this first interval and the shooting frequency of the industrial camera, it determines the target visible light image at the same time as the infrared thermographic image of cigarette combustion from the visible light image sequence. This improves the accuracy and efficiency of image registration. Analyzing the cigarette combustion state based on the infrared thermographic image and the visible light image at the same time effectively enhances the accuracy of cigarette combustion state detection, reduces detection costs, and solves the problems of poor analysis effect, low accuracy, and high cost in existing technologies that rely on a single image or manual comparison of different image contents to determine the cigarette combustion state.

[0013] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a flowchart of a cigarette combustion image registration method provided by an embodiment of the present invention; Figure 2 This is a schematic diagram of a cigarette combustion detection system provided according to an embodiment of the present invention; Figure 3 This is a flowchart illustrating a method for characterizing cigarette combustion image acquisition and control according to an embodiment of the present invention. Figure 4 This is a schematic diagram for characterizing a neighborhood time window according to an embodiment of the present invention; Figure 5 This is a schematic diagram of a visible light image of a target and an infrared thermal image of cigarette combustion at the same moment, provided according to an embodiment of the present invention. Figure 6 This is a schematic diagram of the structure of a cigarette combustion image registration device according to an embodiment of the present invention; Figure 7 This is a schematic diagram of the structure of an electronic device that implements the image registration method of this invention. Detailed Implementation

[0016] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0017] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0018] Before introducing this technical solution, we can first describe the application scenarios. The technical solution provided by this invention can be applied to any scenario where it is necessary to register visible light images and infrared thermal images of cigarette combustion at the same moment to analyze the combustion state of cigarettes.

[0019] Currently, the existing technology for registering visible light images and temperature field images at the same moment mainly relies on manual registration based on the content presented in the visible light images and temperature field images to obtain two images at the same moment, and then assessing the cigarette combustion state at that moment based on the two images. However, this manual registration method is not only inefficient and costly, but also prone to subjective judgment errors, resulting in poor detection accuracy.

[0020] To address the aforementioned issues, image registration for cigarette combustion can be performed based on the technical solution provided in this embodiment. The cigarette combustion image registration method provided by this technical solution can be applied to a cigarette combustion detection system. Cigarette combustion images are acquired using an industrial camera and an infrared thermal imager within the cigarette combustion detection system, and the two types of cigarette combustion images (including visible light images and infrared thermal images) are simultaneously registered.

[0021] In this embodiment, the cigarette combustion detection system includes a suction device and an industrial camera and an infrared thermal imager on the same plane; the field of view of the industrial camera and the field of view of the infrared thermal imager include the same cigarette to be tested, and the cigarette to be tested is mounted on the suction device.

[0022] The smoking device can be a device used to simulate the smoking process. The cigarette to be tested can be a cigarette whose combustion state needs to be detected. The industrial camera can be a high-resolution, high-frame-rate imaging device capable of capturing visible light images of the cigarette during combustion. An infrared thermal imager can be a device capable of capturing infrared radiation from an object's surface and converting it into a temperature distribution image; it can generate a thermal image by detecting the thermal radiation on the surface of the cigarette to be tested.

[0023] It should be noted that the optical axes of the industrial camera and the infrared thermal imager can be located in the same plane. This plane can be set to a horizontal or vertical direction according to the detection requirements, thereby realizing multi-angle synchronous visual and thermal imaging acquisition of the cigarette combustion process.

[0024] Figure 1 This is a flowchart of a cigarette combustion image registration method according to an embodiment of the present invention. This embodiment is applicable to any cigarette combustion visible light image and cigarette combustion infrared thermographic image that need to be registered at the same moment to analyze the cigarette combustion state. This method can be executed by an image registration device, which can be implemented in hardware and / or software, and can be configured in a cigarette combustion detection system. Figure 1 As shown, the method includes: S110. Acquire visible light image sequence and infrared thermal image sequence of cigarette combustion.

[0025] The visible light image sequence of cigarette combustion can be obtained by an industrial camera during the combustion process of the cigarette under test, including multiple visible light images of cigarette combustion. The combustion process includes the inhalation stage and the smoldering stage. For example, the industrial camera can continuously acquire multiple visible light images of cigarette combustion during the inhalation action of the inhalation device on the cigarette under test, and during the smoldering process between inhalations. The visible light images of cigarette combustion can include the appearance characteristics of the cigarette during combustion, such as, but not limited to, the shape of the combustion cone, color changes, and the shape of the smoke.

[0026] A sequence of infrared thermal images of cigarette combustion can be captured by an infrared thermal imager during the combustion process of the cigarette under test, including multiple infrared thermal images of cigarette combustion. For example, the infrared thermal imager can continuously acquire multiple infrared thermal images of cigarette combustion during the smoking action of the cigarette under test by the smoking device, and during the smoldering process between smoking intervals. The infrared thermal image of cigarette combustion is a visual representation of the temperature field, which can include temperature field information during the cigarette combustion process. For example, the infrared thermal image of cigarette combustion includes information on the temperature distribution of the surface of the cigarette under test and its surrounding space during the combustion process.

[0027] In this embodiment, the cigarette to be tested can be mounted on a suction device, which is used to perform periodic suction operations on the cigarette to be tested. Both an industrial camera and an infrared thermal imager can continuously photograph the cigarette to be tested throughout its entire combustion process (including the suction process and the smoldering process during the suction intervals).

[0028] In practical applications, industrial cameras can capture images of the cigarette under test throughout its entire combustion process, continuously acquiring multiple visible light images of cigarette combustion to obtain a sequence of visible light images. Simultaneously, infrared thermal imagers can also capture images of the cigarette under test throughout its entire combustion process, obtaining a sequence of infrared thermal images of cigarette combustion. This sequence includes multiple infrared thermal images of cigarette combustion. Furthermore, the captured visible light and infrared thermal images of cigarette combustion can be stored in a database. When it is necessary to detect the combustion state of the cigarette under test, the corresponding visible light and infrared thermal images can be retrieved from the database for analysis.

[0029] For example, a suction device (such as a smoking machine) is connected to a control device, which in turn is connected to an industrial camera. When the suction device suctions the cigarette under test according to set suction parameters, it emits a suction signal. Upon receiving the suction signal, the control device can automatically control the industrial camera to capture images, ensuring a complete sequence of visible light images of cigarette combustion and avoiding frame loss. For instance, the industrial camera can capture images of the cigarette under test at a preset frequency (e.g., 10 frames per second) to obtain a sequence of visible light images of cigarette combustion. To ensure no frames of infrared thermal images of cigarette combustion are missed, an infrared thermal imager can begin capturing images before the suction device begins suction. For example, the infrared thermal imager can capture images at a certain frequency (e.g., one frame every 0.1 seconds) to obtain a sequence of infrared thermal images of cigarette combustion.

[0030] In other words, the control device is mainly used to control the industrial camera, which can automatically trigger shooting during the first puff, thereby completely capturing the visible light image of cigarette combustion and avoiding missed frames. The infrared thermal imager can operate independently or be controlled by the control device; to completely capture the temperature field of the cigarette's entire combustion cycle, the infrared thermal imager can be started in advance before the first puff. That is, the suction device, control device, and industrial camera work together in a coordinated manner, and the infrared thermal imager can work independently or under control.

[0031] To ensure that the infrared thermal imager can clearly and completely capture the entire combustion process of the cigarette under test, the cigarette under test can be installed on the suction device first. Before the suction device sucks up the cigarette under test, the infrared thermal imager can be started to take pictures of the cigarette under test.

[0032] The operation of activating the infrared thermal imager can be manually triggered. For example, when a user presses the start button on the infrared thermal imager, it is considered that the operation of photographing the cigarette under test has been initiated. This allows multiple infrared thermal images of the cigarette combustion process to be continuously captured after the cigarette is smoked.

[0033] In this embodiment, the method of aspirating the cigarette to be tested based on the aspiration device can be: determining the aspiration parameters associated with the aspiration initiation event, and aspirating the cigarette to be tested based on the aspiration device according to the aspiration parameters.

[0034] The suction start event can refer to a signal or condition that triggers the suction device to begin performing the suction action. This suction start event can be a command issued by the user through an interface (such as a button or touchscreen), a start signal sent by a higher-level control system (such as an automated testing process program), or a trigger signal when the cigarette is lit. Suction parameters can refer to parameters used to control the suction of the cigarette under test; for example, suction parameters include, but are not limited to, suction duration, suction interval, and suction flow rate.

[0035] In this embodiment, the cigarette to be tested can be installed on the puffing device, and the puffing parameters can be set. The puffing device can detect whether a puffing initiation event has occurred. For example, when the puffing device detects user operation, external control command, or cigarette ignition, it can determine that a puffing initiation event has occurred. The puffing device can generate negative pressure at the filter end according to the preset or dynamically configured puffing parameters associated with the event, thereby completing the puffing action. At this time, the infrared thermal imager has been turned on in advance and can continuously capture images of the cigarette to be tested, obtaining multiple infrared thermal images of cigarette combustion. Furthermore, the infrared thermal imager can be turned off after puffing is completed.

[0036] The advantage of this setup is that by activating the infrared thermal imager before starting the inhalation device, it ensures that the infrared thermal imager begins to capture images before the cigarette to be tested is inhaled. This allows for the complete acquisition of infrared thermal images of the cigarette combustion from the moment the cigarette is lit until the inhalation stops, enabling the infrared thermal images of cigarette combustion to more accurately reflect the temperature field changes during the actual combustion process. This, in turn, improves the accuracy, comprehensiveness, and reliability of cigarette combustion status detection.

[0037] In this embodiment, the industrial camera can be controlled by a control device to take pictures. The control device can be a device used to receive a suction synchronization command and control the industrial camera to take pictures. To ensure that the industrial camera can completely capture the combustion process of the cigarette, a suction synchronization command can be generated when the cigarette under test is first sucked by the suction device, and the suction synchronization command can be sent to the control device; when the control device receives the suction synchronization command, it controls the industrial camera to take pictures of the cigarette under test.

[0038] The suction synchronization command is a notification signal issued by the suction device when it initiates the suction action on the cigarette under test. It informs the control device that the suction phase has begun, triggering the industrial camera to start recording, thus synchronizing the camera's operation with the combustion process. This suction synchronization command can be sent automatically by the suction device. The control device can be a programmable logic controller (PLC), an industrial computer, or an embedded system. In a suction scenario, the control device receives the suction synchronization command from the suction device and translates it into specific operation commands for the industrial camera, achieving coordinated control between the devices.

[0039] Specifically, before the industrial camera captures images of the cigarette under test, a puff synchronization command can be generated when the puffing device first puffs the cigarette. This command can be synchronously sent to the control device via wired communication (such as Ethernet, RS-485, or digital I / O signals). Upon receiving the puff synchronization command, the control device automatically controls the connected industrial camera to capture images of the cigarette under test during its first puff. The industrial camera captures images of the cigarette under test according to set shooting parameters such as shooting frequency and time, obtaining multiple visible light images of cigarette combustion during the combustion process. For example, assuming a shooting time of 5 minutes, the industrial camera can continuously shoot for 5 minutes after receiving the puff synchronization command. Simultaneously, the captured sequence of visible light images of cigarette combustion can be saved to a storage device for later retrieval.

[0040] The advantage of this setup is that by generating a simultaneous suction command when the cigarette under test is first sucked by the suction device and sending this command to the control device, the synchronization between the industrial camera's shooting operation and the first suction process can be ensured, avoiding data loss due to equipment startup time differences. Simultaneously, it allows for more accurate and comprehensive acquisition of visible light images reflecting the combustion state of the cigarette during the actual smoking process, further improving the accuracy and reliability of cigarette combustion detection.

[0041] Next, the technical solution provided in the embodiments of the present invention will be explained in terms of process, taking the cigarette combustion detection system as an example to illustrate the implementation of the technical solution provided in the embodiments of the present invention.

[0042] To enable those skilled in the art to further understand the technical solutions of the embodiments of the present invention, a description of the cigarette combustion detection system can be provided first. See also... Figure 2 The diagram shows the structure of a cigarette combustion detection system. The system includes a suction device and an industrial camera and an infrared thermal imager positioned on the same plane. Both the industrial camera's and the infrared thermal imager's fields of view include the same cigarette under test. The cigarette under test is mounted on the suction device. In practical applications, the industrial camera and the infrared thermal imager can be positioned at the same horizontal level (or in the same vertical plane) and both placed on the same side of the cigarette under test to ensure consistent viewing angles and facilitate subsequent registration of the cigarette combustion images. The industrial camera is connected to a control device, which in turn is connected to the suction device (such as a smoking machine).

[0043] See Figure 3The flowchart shown illustrates a method for acquiring and controlling images of cigarette combustion. Its implementation can be as follows: Shooting parameters, such as the shooting interval and duration, can be set within the control device. After the infrared thermal imager starts capturing the temperature field, the inhalation device initiates inhalation. Upon the first puff, a synchronization command is issued. Upon receiving the synchronization command, the control device controls the industrial camera to capture images according to the shooting parameters, obtaining a sequence of visible light images of cigarette combustion. After the industrial camera stops capturing images for the set duration, a sequence of infrared thermal images of cigarette combustion during the combustion process can be obtained. Finally, after the infrared thermal imager stops capturing the temperature field, a sequence of infrared thermal images of cigarette combustion during the combustion process can be acquired.

[0044] S120. Extract the highest temperature from each infrared thermal image of cigarette combustion.

[0045] The highest temperature can refer to the highest temperature value extracted frame by frame from the infrared thermal image sequence of cigarette combustion. The multiple highest temperatures corresponding to the infrared thermal image sequence record the curve of the highest temperature changing over time during cigarette combustion, which can reflect the dynamic characteristics of combustion temperature, such as temperature fluctuations during the smoldering stage and the instantaneous temperature rise peak during inhalation.

[0046] It should be noted that each infrared thermogram of cigarette combustion contains a maximum temperature. When the device draws in the cigarette being tested, the maximum temperature of the cigarette combustion cone rises rapidly.

[0047] In this embodiment, after acquiring the cigarette combustion infrared thermal image sequence, temperature data processing can be performed independently on each frame of the cigarette combustion infrared thermal image. For a single frame of cigarette combustion infrared thermal image, all valid pixels (excluding background or non-cigarette areas) can be traversed, and their corresponding temperature values ​​can be read. By comparing the temperature values ​​of all pixels, the maximum value is identified as the instantaneous highest temperature corresponding to that frame of cigarette combustion infrared thermal image. The highest temperature is extracted sequentially for each frame of cigarette combustion infrared thermal image in the cigarette combustion infrared thermal image sequence, thereby obtaining the highest temperature of each frame of cigarette combustion infrared thermal image. These highest temperatures can be arranged in chronological order to ensure the accuracy of subsequent determination of the time to be used.

[0048] S130. For multiple infrared thermal images of cigarette combustion, determine the registration time of the infrared thermal images of cigarette combustion, and based on multiple maximum temperatures, determine at least one time to be used within the neighborhood time window associated with the registration time.

[0049] The "registration time" refers to the point in the sequence of infrared thermal images of cigarette combustion that needs to be matched with the visible light image of cigarette combustion at the same time. The registration time is the moment when the infrared thermal imager captures the current infrared thermal image of cigarette combustion. The neighborhood time window refers to a continuous time period extending forward and / or backward along the time axis, centered on the registration time. For example, the neighborhood time window can be a time interval extending forward from the previous capture time as the end capture time, or it can be a time interval extending backward from the next capture time as the start capture time. The neighborhood time window can include a preset number or a preset duration of capture times. The "use time" refers to the point in the neighborhood time window where the temperature rises rapidly, and can include one or more. Each use time corresponds to one infrared thermal image of cigarette combustion. This neighborhood time window can be used to limit the range of relevant data searched near the registration time, avoiding traversal of all maximum temperatures and improving search efficiency. It should be noted that the method of registering the infrared thermal images of cigarette combustion in the cigarette combustion sequence is the same. The following explanation will be based on the registration of any one of the infrared thermal images of cigarette combustion.

[0050] In this embodiment, the moment when the infrared thermal image of cigarette combustion is captured can be determined by the built-in clock and shooting frequency of the infrared thermal imager or by an external synchronization signal, and this moment is used as the registration moment. The time range or number of moments within the neighborhood time window can be preset. For example, the neighborhood time window can be a time interval extending forward from the shooting moment preceding the registration moment as the end shooting moment; or, the neighborhood time window can be a time interval extending forward from the shooting moment preceding the registration moment as the end shooting moment, and then extending forward by a certain number of shooting moments. Alternatively, the neighborhood time window can be a time interval extending backward from the shooting moment following the registration moment as the start shooting moment, and then extending forward by a certain number of shooting moments.

[0051] Furthermore, the timing to be used within a neighborhood time window can be determined based on multiple highest temperatures, and various implementation methods can be adopted.

[0052] One implementation method is to extract the highest temperature at each moment within a neighboring time window according to the shooting sequence, obtaining a temperature sequence sorted by time. The positive temperature change rate between adjacent moments in the temperature sequence is calculated sequentially. When the positive temperature change rate corresponding to a certain moment exceeds a preset rapid rise threshold, that moment can be determined as a time to be used. If there are multiple moments exceeding the preset rapid rise threshold within the window, multiple times to be used can be determined accordingly. For example, the rapid rise threshold can be set to 15℃ / frame; when the positive temperature change rate at a certain moment exceeds this threshold, that moment is marked as a time to be used.

[0053] Another implementation method is to perform first-order difference processing on the temperature sequence consisting of the highest temperatures within the neighborhood time window to obtain a temperature change sequence. Moments in the temperature change sequence whose values ​​exceed a preset temperature abrupt change threshold are identified as moments to be used. For example, the temperature abrupt change threshold can be set to 15°C; if the temperature change at a certain moment is greater than this threshold, that moment is determined as a moment to be used.

[0054] Another implementation method is to divide the highest temperature sequence within the neighborhood time window into multiple continuous segments according to time, and perform linear fitting on each segment to obtain the temperature change slope of the corresponding segment. When the slope of a certain segment is significantly greater than the slope of the previous segment (e.g., exceeding a set ratio), the boundary moment between the two segments is determined as the inflection point where the temperature begins to rise rapidly, and this inflection point moment can be determined as the moment to be used. For example, the slope ratio threshold can be set to 2 times. If the slope of the later segment reaches 2 times or more of the previous segment, then the boundary moment between the two segments is taken as the moment to be used.

[0055] Another implementation method is to set a sliding analysis window (such as a short window containing N time points) within the neighborhood time window, and calculate the average temperature change rate within each sliding window. When the temperature change rate corresponding to the sliding window exceeds a preset change rate threshold and continues to meet the condition for a certain number of frames, the start time of that sliding window is determined as the start time of the rapid temperature rise and is used as the time to be used. For example, the sliding window length can be set to 5 frames and the change rate threshold to 15℃ / frame. When three consecutive sliding windows meet the threshold condition, the start time of the first window that meets the condition is determined as the time to be used.

[0056] It should be noted that the above-mentioned rapid rise threshold, temperature change threshold, and rate of change threshold are only exemplary values. In practical applications, they can be adaptively set based on cigarette type, shooting frame rate, ambient temperature conditions, and experimental calibration results. This embodiment does not impose specific limitations on these values.

[0057] In this embodiment, determining at least one time to be used within a neighborhood time window associated with the time to be registered, based on multiple maximum temperatures, includes: determining at least one time when the maximum temperature begins to rise rapidly within a neighborhood time window associated with the time to be registered, based on multiple maximum temperatures, and determining the time when the maximum temperature begins to rise rapidly as the time to be used.

[0058] The moment when the highest temperature begins to rise rapidly can refer to the point in the highest temperature sequence where the temperature value begins to rise significantly in a short period of time. The steep rising segment of the temperature curve corresponding to this moment can be characterized by a temperature change rate (i.e., slope) that is significantly higher than that of the surrounding period, corresponding to dynamic processes such as a sudden increase in combustion intensity or local combustion acceleration caused by the suction action.

[0059] In this embodiment, a neighborhood time window centered on the registration time can be defined on the maximum temperature sequence composed of multiple maximum temperatures, based on the registration time. Within this neighborhood time window, local dynamic analysis of the maximum temperature sequence is performed. By calculating the temperature difference between adjacent time points in the neighborhood time window or fitting the slope of local temperature changes, the moment when the rate of increase of the maximum temperature increases significantly can be identified, and the starting time corresponding to this moment of change is determined as the moment when the maximum temperature begins to rise rapidly.

[0060] Specifically, a temperature curve can be fitted based on multiple maximum temperatures within a neighborhood time window in the maximum temperature sequence. The temperature curve can be detected in intervals where the rising slope exceeds a preset threshold or where the temperature rises continuously and significantly at multiple consecutive time points. Within these rapidly heating intervals, the starting point of the significant temperature increase can be further located, such as the inflection point where the temperature transitions from a gradual to a steep rise. This time point is taken as the moment when the maximum temperature begins to rise rapidly. This moment when the maximum temperature begins to rise rapidly corresponds to the starting point of the abrupt change in the slope of the temperature curve. One or more identified moments when the maximum temperature begins to rise rapidly can be selected as the times to be used.

[0061] For example, see Figure 4 This allows us to plot temperature curves that change with time based on the highest temperature sequence. Assuming the registration time for the infrared thermal image of cigarette combustion to be aligned is t, multiple points where the highest temperature begins to rise rapidly can be identified within a neighborhood time window centered at t. For example, the temperature within the neighborhood time window can be... and The two moments are the times when the highest temperature begins to rise rapidly, which are the times when the temperature is ready to be used.

[0062] By fitting the temperature curve, the moment when the highest temperature begins to rise rapidly can be located more intuitively, thereby improving data processing efficiency and recognition accuracy.

[0063] S140. Based on the registration time, the suction parameters corresponding to the suction device, and at least one time to be used, determine the first interval between the registration time and the suction time of the first suction of the cigarette to be tested.

[0064] The first time a cigarette is drawn into the test can refer to the starting point when the drawing device performs the first drawing action on the lit cigarette, i.e., the start time of the first drawing.

[0065] In this embodiment, the registration time is the time corresponding to a certain temperature feature point in the infrared thermographic image sequence of cigarette combustion. The start time of the first puff is given by the puffing device. When the puffing device performs the first puff action, its internal system will accurately record the start time of the puff action or issue a puff start signal with a timestamp. This timestamp is the puff time corresponding to the first puff.

[0066] The "ready-to-use" moment is the point in the cigarette combustion infrared thermographic sequence where the highest temperature initiated by the puff begins to rise rapidly. This moment corresponds to the temperature abrupt change triggered by the puffing action. The first interval between the "ready-to-use" moment and the start of the first puff can be determined based on the puffing parameters. For example, if the interval between two adjacent puffs is set to 60 seconds in the puffing parameters, the interval between the "ready-to-use" moment (such as the temperature abrupt change corresponding to the second puff) and the start of the first puff is also 60 seconds, thus achieving time alignment between the infrared thermographic sequence and the puffing sequence.

[0067] Optionally, the suction parameters include the suction interval duration. Based on the registration time, the suction parameters corresponding to the suction device, and at least one time to be used, a first interval duration is determined between the registration time and the first suction time of the cigarette to be tested. This includes: determining a second interval duration between the time to be used and the first suction time of the cigarette to be tested based on at least one time to be used and the suction interval duration; and determining the first interval duration based on at least one time to be used, the registration time, and the second interval duration.

[0068] The infrared thermal images of each cigarette combustion obtained by the infrared thermal imager are taken continuously in chronological order. Each cigarette combustion infrared thermal image corresponds to a unique shooting sequence number, and the shooting sequence numbers are consecutive and non-repeating (for example, the first infrared thermal image has a sequence number of 1, and the fifth infrared thermal image has a sequence number of 5). During the process of sucking the cigarette to be tested, the suction device will perform multiple consecutive suction actions according to preset suction parameters, and the suction port sequence corresponding to each suction is consecutive and orderly.

[0069] Specifically, each pending time corresponds to a unique sequence number in the infrared thermal image capture sequence. Each pending time corresponds to one suction action, and its order of appearance among all pending times represents the corresponding suction port sequence; that is, the pending time corresponds to the i-th suction port. The pending time is the moment in the infrared thermal image sequence when the highest temperature caused by the suction action begins to rise rapidly. Each such pending time corresponds to one suction action, sequentially corresponding to the 1st suction port, the 2nd suction port, and so on up to the i-th suction port. For example, if in the infrared thermal image capture sequence, the first identified moment of rapid temperature rise corresponds to the 1st suction port, the second identified moment of rapid temperature rise corresponds to the 2nd suction port, and so on, the nth identified pending time corresponds to the nth suction port.

[0070] Furthermore, the puff sequence index corresponding to the time to be used can be extracted, and the puff sequence index and the initial puff sequence value (set to 1) can be subtracted to obtain the puff sequence difference. The preset puff interval duration and the puff sequence difference are multiplied to obtain the second interval duration between the time to be used and the first puff of the cigarette to be tested. The time to be registered and the time to be used can be subtracted to obtain the shooting interval duration. The shooting interval duration and the second interval duration are summed to obtain the first interval duration. Based on the first interval duration and the shooting frequency of the industrial camera, the visible light image of cigarette combustion belonging to the same time as the infrared thermal image of cigarette combustion is accurately matched to achieve temporal alignment between the infrared thermal image and the visible light image.

[0071] For example, the first interval between the registration time and the first smoking time of the test cigarette can be determined according to formula (1). Formula (1) can be expressed as: .

[0072] In the formula, express The second interval between the time of the first puff reference time (i.e., the time of the first puff of the cigarette to be tested); Indicates the first The time of use corresponding to the cigarette smoked during oral smoking; An index indicating the suction port sequence; Indicates the duration of the suction interval; Indicates the time to be registered; Indicates the duration of the first interval.

[0073] S150, Based on the first interval duration and the shooting frequency of the industrial camera, determine the target visible light image associated with the infrared thermal image of cigarette combustion from the visible light image sequence of cigarette combustion.

[0074] The shooting frequency of an industrial camera refers to the frequency at which the camera captures visible light images of cigarette combustion, i.e., the number of images captured per second. For example, assuming the shooting frequency of an industrial camera is 10fps, it means that 10 frames of images are captured per second.

[0075] In this embodiment, by combining the first interval duration and the shooting frequency of the industrial camera, the image frame number of the visible light image of cigarette combustion, time-registered with the infrared thermal image of cigarette combustion, is determined. Then, the visible light image of cigarette combustion corresponding to the image frame number is searched from multiple visible light images of cigarette combustion in the cigarette combustion visible light image sequence and selected as the target visible light image. For example, see [link to relevant documentation] Figure 5 The images shown are infrared thermal images of cigarette combustion and visible light images of the target at the same time.

[0076] It should be noted that the industrial camera begins taking pictures when the suction device begins its first puff of the cigarette to be tested. Therefore, the first interval is the same as the time between when the industrial camera takes the visible light image at the registration point and when the cigarette to be tested is first puffed.

[0077] Based on this, in the process of determining the target visible light image associated with the infrared thermal image of cigarette combustion from the visible light image sequence based on the first interval duration and the shooting frequency of the industrial camera, the first interval duration and the shooting frequency of the industrial camera are multiplied to obtain the image frame number corresponding to the time to be registered; based on the visible light image of cigarette combustion corresponding to the image frame number in the visible light image sequence of cigarette combustion, the target visible light image associated with the infrared thermal image of cigarette combustion is determined.

[0078] Specifically, the first interval duration and the shooting frequency of the industrial camera are multiplied to obtain a product value. This product value is used as the image frame number corresponding to the time to be registered. Furthermore, the visible light image of cigarette combustion corresponding to the image frame number is identified as the target visible light image associated with the infrared thermal image of cigarette combustion.

[0079] For example, the image frame number can be determined according to formula (2), which can be expressed as: In the formula, Indicates the image frame number. Indicates the duration of the first interval. This refers to the shooting frequency of the industrial camera. Image frame number. The corresponding visible light image of cigarette combustion and the infrared thermal image of cigarette combustion corresponding to the time to be registered are the two images after time registration.

[0080] Based on the above technical solution, after completing the time-series registration of the infrared thermal image of cigarette combustion and the visible light image of cigarette combustion, the combustion state of the cigarette under test can be analyzed based on the infrared thermal image of cigarette combustion and the target visible light image registered with it. That is, based on the multimodal images registered at the same time, the accurate analysis of the combustion state of cigarettes can be achieved.

[0081] Specifically, by combining temperature information from the infrared thermographic image of cigarette combustion with the appearance features from the visible light image of the target cigarette, the combustion state of the cigarette under test can be comprehensively evaluated to identify any abnormal combustion phenomena, such as localized overheating, uneven combustion, or extinguishing. Furthermore, based on the evaluation results of the cigarette's combustion state, it can be determined whether the cigarette meets quality standards. The advantage of this approach is that it improves the accuracy and efficiency of cigarette combustion state detection, thereby enhancing the technical effect of improving the quality control level of cigarette products.

[0082] The technical solution of this invention acquires a sequence of visible light images and an infrared thermographic image sequence of cigarette combustion during the combustion process. Combined with temperature characteristic analysis of the infrared thermographic image sequence, it determines the highest temperature sequence and the time to be used associated with the registration time. Then, using the registration time, the corresponding suction parameters of the suction device, and at least one time to be used, it accurately calculates the first interval between the registration time and the first suction time. Based on this first interval and the shooting frequency of the industrial camera, it determines the target visible light image at the same time as the infrared thermographic image of cigarette combustion from the visible light image sequence. This improves the accuracy and efficiency of image registration. Analyzing the cigarette combustion state based on the infrared thermographic image and the visible light image at the same time effectively enhances the accuracy of cigarette combustion state detection, reduces detection costs, and solves the problems of poor analysis effect, low accuracy, and high cost in existing technologies that rely on a single image or manual comparison of different image contents to determine the cigarette combustion state.

[0083] Figure 6 This is a schematic diagram of a cigarette combustion image registration device according to an embodiment of the present invention. The device is configured for use in a cigarette combustion detection system, which includes a suction device and an industrial camera and an infrared thermal imager on the same plane; the field of view of the industrial camera and the field of view of the infrared thermal imager both include the same cigarette to be tested, and the cigarette to be tested is mounted on the suction device. Figure 6 As shown, the device includes: an image sequence acquisition module 210, a maximum temperature sequence extraction module 220, a time-to-use determination module 230, a first interval duration determination module 240, and a target visible light image determination module 250.

[0084] The image sequence acquisition module 210 is used to acquire visible light image sequences and infrared thermal image sequences of cigarette combustion. The visible light image sequences are captured by the industrial camera during the combustion process of the cigarette under test. The infrared thermal image sequences are captured by the infrared thermal imager during the combustion process of the cigarette under test, including multiple infrared thermal images of cigarette combustion. The combustion process includes a smoking stage and a smoldering stage. The maximum temperature sequence extraction module 220 is used to extract the maximum temperature from each of the infrared thermal images of cigarette combustion. The time-to-use determination module 230 is used to determine the time to use from the multiple infrared thermal images of cigarette combustion. The system includes a registration time for the infrared thermal image of cigarette combustion, and a determination of at least one time to be used within a neighborhood time window associated with the registration time based on multiple maximum temperatures; a first interval duration determination module 240, used to determine a first interval duration between the registration time and the first time of smoking the cigarette to be tested, based on the registration time, the smoking parameters corresponding to the smoking device, and at least one time to be used; and a target visible light image determination module 250, used to determine a target visible light image associated with the infrared thermal image of cigarette combustion from the visible light image sequence of cigarette combustion based on the first interval duration and the shooting frequency of the industrial camera.

[0085] The apparatus provided in this invention acquires a sequence of visible light images and an infrared thermographic image sequence of cigarette combustion during the combustion process. By analyzing the temperature characteristics of the infrared thermographic image sequence, it determines the highest temperature sequence and the time to be used associated with the registration time. Then, using the registration time, the suction parameters corresponding to the suction device, and at least one time to be used, it accurately calculates the first interval between the registration time and the first suction time. Based on this first interval and the shooting frequency of the industrial camera, it determines the target visible light image at the same time as the infrared thermographic image of cigarette combustion from the visible light image sequence. This improves the accuracy and efficiency of image registration. By analyzing the cigarette combustion state based on the infrared thermographic image and the visible light image at the same time, it effectively improves the accuracy of cigarette combustion state detection, reduces detection costs, and solves the problems of poor analysis effect, low accuracy, and high cost in existing technologies that rely on a single image or manual comparison of different image contents to determine the cigarette combustion state.

[0086] Optionally, based on the above-described apparatus, the image registration apparatus may further include: The start-up unit is used to start the infrared thermal imager to take a picture of the cigarette to be tested.

[0087] Optionally, based on the above-described apparatus, the image registration apparatus may further include: A suction control unit is used to determine suction parameters associated with a suction initiation event, and the suction device performs suction on the cigarette to be tested based on the suction parameters.

[0088] Optionally, based on the above-described apparatus, the image registration apparatus may further include: The suction synchronization command sending unit is used to generate a suction synchronization command when the cigarette to be tested is first sucked based on the suction device, and send the suction synchronization command to the control device. The shooting unit is used to control the industrial camera to shoot the cigarette to be tested when the control device receives the suction synchronization command.

[0089] Based on the above-mentioned device, the time to be used determination module 230 is used to determine, based on multiple maximum temperatures, at least one time when the maximum temperature begins to rise rapidly within a neighborhood time window associated with the time to be registered, and determine the time when the maximum temperature begins to rise rapidly as the time to be used.

[0090] Based on the above-mentioned device, the suction parameters include the suction interval duration, and the first interval duration determination module 240 includes: The second interval duration determination unit is used to determine the second interval duration between the time to be used and the time of first smoking of the cigarette to be tested, based on at least one time to be used and the smoking interval duration. The first interval duration determination unit is used to determine the first interval duration based on at least one of the times to be used, the times to be registered, and the second interval duration.

[0091] Based on the above-mentioned device, the target visible light image determination module 250 includes: The image frame number determination unit is used to multiply the first interval duration and the shooting frequency of the industrial camera to obtain the image frame number corresponding to the registration time. The target visible light image determination unit is used to determine the target visible light image associated with the cigarette combustion infrared thermal image based on the cigarette combustion visible light image corresponding to the image frame number in the cigarette combustion visible light image sequence.

[0092] Based on the above-described device, the device further includes: The combustion state analysis unit is used to analyze the combustion state of the cigarette under test based on the infrared thermogram of the cigarette combustion and the target visible light image associated with the infrared thermogram of the cigarette combustion.

[0093] The image registration apparatus provided in this embodiment of the invention can execute the image registration method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method.

[0094] Figure 7 This is a schematic diagram of the structure of an electronic device implementing the image registration method of an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0095] like Figure 7 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0096] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0097] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as image registration methods.

[0098] In some embodiments, the image registration method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or mounted on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the image registration method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the image registration method by any other suitable means (e.g., by means of firmware).

[0099] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0100] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0101] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0102] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0103] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0104] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0105] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the image registration method provided in any embodiment of this invention.

[0106] In implementing the computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0107] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0108] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for registering cigarette combustion images, characterized in that, An application is made in a cigarette combustion detection system, the system comprising a suction device and an industrial camera and an infrared thermal imager positioned on the same plane; the field of view of the industrial camera and the field of view of the infrared thermal imager both include the same cigarette to be tested, the cigarette to be tested being mounted on the suction device; the method includes: The method acquires a sequence of visible light images and a sequence of infrared thermal images of cigarette combustion; wherein the sequence of visible light images of cigarette combustion is obtained by the industrial camera during the combustion process of the cigarette under test; the sequence of infrared thermal images of cigarette combustion is obtained by the infrared thermal imager during the combustion process of the cigarette under test, and includes multiple infrared thermal images of cigarette combustion; the combustion process includes a smoking stage and a smoldering stage; Extract the highest temperature from each of the infrared thermal images of cigarette combustion; For multiple infrared thermal images of cigarette combustion, determine the registration time of the infrared thermal images of cigarette combustion, and based on multiple maximum temperatures, determine at least one time to be used within a neighborhood time window associated with the registration time. Based on the registration time, the suction parameters corresponding to the suction device, and at least one usage time, a first interval duration is determined between the registration time and the first suction time of the cigarette to be tested. Based on the first interval duration and the shooting frequency of the industrial camera, a target visible light image associated with the cigarette combustion infrared thermal image is determined from the visible light image sequence of the cigarette combustion.

2. The method according to claim 1, characterized in that, Before the suction device draws in the cigarette to be tested, the method further includes: The infrared thermal imager is activated to take a picture of the cigarette to be tested.

3. The method according to claim 1, characterized in that, The process of drawing the cigarette to be tested using the suction device includes: Determine the suction parameters associated with the suction initiation event, and then use the suction device to perform suction on the cigarette to be tested based on the suction parameters.

4. The method according to claim 3, characterized in that, The method further includes: When the cigarette to be tested is first sucked on using the suction device, a suction synchronization command is generated and sent to the control device. When the control device receives the suction synchronization command, it controls the industrial camera to take a picture of the cigarette to be tested.

5. The method according to claim 1, characterized in that, The step of determining at least one time to be used within a neighborhood time window associated with the time to be registered, based on multiple maximum temperatures, includes: Based on multiple maximum temperatures, at least one maximum temperature in the neighborhood time window associated with the time to be registered is determined to start rising rapidly, and the maximum temperature starting to rise rapidly is determined as the time to be used.

6. The method according to claim 1, characterized in that, The suction parameters include the suction interval duration. The determination of the first interval duration between the registration time and the first suction time of the cigarette to be tested, based on the registration time, the suction parameters corresponding to the suction device, and at least one usage time, includes: Based on at least one of the times to be used and the duration of the smoking interval, a second interval duration is determined between the time to be used and the time of the first smoking of the cigarette to be tested; The first interval duration is determined based on at least one of the times to be used, the times to be registered, and the second interval duration.

7. The method according to claim 1, characterized in that, The step of determining the target visible light image associated with the cigarette combustion infrared thermal image from the visible light image sequence based on the first interval duration and the shooting frequency of the industrial camera includes: The first interval duration and the shooting frequency of the industrial camera are multiplied to obtain the image frame number corresponding to the time to be registered; Based on the visible light image of cigarette combustion corresponding to the image frame number in the visible light image sequence of cigarette combustion, a target visible light image associated with the infrared thermal image of cigarette combustion is determined.

8. The method according to claim 1, characterized in that, The method further includes: The combustion state of the cigarette under test is analyzed based on the infrared thermal image of the cigarette combustion and the target visible light image associated with the infrared thermal image of the cigarette combustion.

9. A cigarette combustion image registration device, characterized in that, A device is configured for use in a cigarette combustion detection system, the system including a suction device and an industrial camera and an infrared thermal imager positioned at the same horizontal plane; the field of view of the industrial camera and the field of view of the infrared thermal imager both include the same cigarette to be tested, the cigarette to be tested being mounted on the suction device; the device includes: The image sequence acquisition module is used to acquire visible light image sequences and infrared thermal image sequences of cigarette combustion; wherein, the visible light image sequence of cigarette combustion is obtained by the industrial camera during the combustion process of the cigarette under test; the infrared thermal image sequence of cigarette combustion is obtained by the infrared thermal imager during the combustion process of the cigarette under test, including multiple infrared thermal images of cigarette combustion; the combustion process includes a smoking stage and a smoldering stage; The highest temperature sequence extraction module is used to extract the highest temperature from each of the infrared thermal images of cigarette combustion. The module for determining the time to be used is used to determine the time to be registered for multiple infrared thermal images of cigarette combustion, and to determine at least one time to be used within a neighborhood time window associated with the time to be registered based on multiple maximum temperatures. The first interval duration determination module is used to determine the first interval duration between the registration time and the first time of absorbing the cigarette to be tested, based on the registration time, the absorbing parameters corresponding to the absorbing device, and at least one time to be used. The target visible light image determination module is used to determine, based on the first interval duration and the shooting frequency of the industrial camera, a target visible light image associated with the cigarette combustion infrared thermal image from the cigarette combustion visible light image sequence.

10. An electronic device, characterized in that, The electronic device includes: At least one processor; and a memory communicatively connected to said at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the image registration method according to any one of claims 1-8.

Images