Furnace opening spectral imaging chip and method for determining the brightest area at the furnace opening
By setting a furnace mouth spectral imaging chip with a light modulation layer on the image sensor, the spectral and image information of the steelmaking furnace mouth is collected, which solves the problems of accuracy and cost in converter steelmaking endpoint control and realizes rapid and safe endpoint identification and temperature measurement.
Patent Information
- Application Number
- CN202110328490.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-26
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2041-03-26
AI Technical Summary
In the existing technology, the endpoint control method of converter steelmaking relies on manual experience or complex large instruments, which has low accuracy and high cost, making it difficult to achieve micro-volume, low-cost, safe and reliable online smelting endpoint control.
A furnace opening spectral imaging chip is used. By setting a light modulation layer on the surface of the photosensitive area of the image sensor, the incident light is spectrally modulated using the light modulation structure to acquire furnace opening images and spectral information. The image sensor converts these into electrical signals to achieve non-contact temperature and endpoint identification.
It enables rapid, accurate, safe and reliable measurement of smelting endpoints and furnace mouth temperatures, reduces costs, is easy to integrate with backend systems, and improves identification accuracy and qualitative analysis capabilities.
Smart Images

Figure CN115132765B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of semiconductor technology, and in particular to a furnace opening spectral imaging chip and a method for determining the brightest region of the furnace opening. Background Technology
[0002] End-point control in converter steelmaking is a challenging problem in the metallurgical industry, referring to the control of smelting temperature during the blowing process. Accurate end-point control significantly improves the quality of the final steel. Among various end-point control methods, manual experience control and static model control often have low accuracy, while dynamic model control is often costly and complex to maintain, making it unsuitable for small converters. Summary of the Invention
[0003] To address the problems existing in the prior art, embodiments of the present invention provide a furnace mouth spectral imaging chip and a method for determining the brightest region of the furnace mouth.
[0004] Specifically, the embodiments of the present invention provide the following technical solutions:
[0005] In a first aspect, embodiments of the present invention provide a furnace mouth spectral imaging chip, comprising: an image sensor, and a light modulation layer disposed on the surface of the photosensitive area of the image sensor;
[0006] The light modulation layer includes a light modulation structure, which is used to perform spectral modulation on incident light entering at least one point of the light modulation structure, so as to obtain incident light carrying information corresponding to the at least one point on the surface of the photosensitive area; the incident light carrying information refers to the incident light spectral information of the flame at at least one point in the imaging image; the incident light refers to at least one of the radiation light and transmitted light from the steelmaking furnace opening.
[0007] The image sensor is used to convert the information carried by the incident light corresponding to the at least one point after being modulated by the optical modulation layer into a corresponding electrical signal, wherein the electrical signal is the image matrix modulated by the optical modulation layer.
[0008] Furthermore, the incident light carries information including light intensity distribution information and spectral information at at least one point in the imaging image. Furthermore, each group of micro / nano structure arrays has the function of broadband filtering or narrowband filtering.
[0009] Furthermore, the thickness of the optical modulation layer is 0.1λ to 10λ, where λ represents the center wavelength of the incident light.
[0010] Secondly, embodiments of the present invention also provide an intelligent smelting control device, including the furnace mouth spectral imaging chip as described in the first aspect.
[0011] Thirdly, embodiments of the present invention also provide a method for determining the brightest region of a furnace opening in a furnace opening spectral imaging chip, including:
[0012] Obtain the image matrix I modulated by the optical modulation layer. The image matrix I has a size of H×W, and the light intensity value at the i-th row and j-th column of the image is represented by I. i,j It means that 0≤I i,j ≤255 and I i,j It is an integer;
[0013] The convolution kernel size is determined to be K×K, and the element at the i-th row and j-th column of the convolution kernel is K. i,j And K i,j =1;
[0014] The convolution kernel is convolved with the image matrix I. The convolution boundary is padded with P and filled with 0 elements. The stride is S. The resulting matrix is I'. The size of matrix I' is H'×W'.
[0015] Based on convolution operations The value of the element I' in the i-th row and j-th column of matrix I' i,j satisfy Each element of matrix I' represents the sum of light intensity values for a region of the image matrix I;
[0016] Determine the position of the largest element in the image matrix I';
[0017] If the position of the largest element of the image matrix I' is in the l-th row and k-th column, then the top left corner element of the brightest region of the image matrix I is located in the l×S+1-S-th row and k×S+1-S-th column, and the bottom right corner element of the brightest region is located in the l×S+KS-th row and k×S+KS-th column.
[0018] This invention provides a furnace mouth spectral imaging chip for furnace mouth spectral imaging, enabling subsequent determination of furnace mouth temperature and / or carbon content based on the furnace mouth spectral imaging, thereby facilitating the control of the steelmaking endpoint. In this furnace mouth spectral imaging chip, a light modulation layer is disposed on the surface of the photosensitive area of an image sensor. The light modulation layer includes a light modulation structure, which is used to perform spectral modulation on incident light entering at least one point of the light modulation structure, thereby obtaining incident light-carrying information corresponding to the at least one point on the surface of the photosensitive area. Correspondingly, the image sensor converts the incident light-carrying information corresponding to the at least one point into a corresponding electrical signal, which is the image matrix modulated by the light modulation layer. Therefore, this invention, through the furnace mouth spectral imaging chip, can realize the information carried by incident light at the furnace mouth. The non-contact acquisition of information provided by this invention, compared with commercial spectrometers in the prior art, is achieved by a furnace mouth spectral imaging chip. This chip collects incident light carrying information including light intensity distribution and spectral information at at least one point in the furnace mouth image. Since the incident light carrying information at at least one point in the furnace mouth image covers information such as the image or spectrum of the furnace mouth flame, it can fully utilize the image or spectral information of the furnace mouth flame when identifying temperature or steelmaking endpoint based on the incident light carrying information at at least one point in the furnace mouth image. This enables accurate identification of smelting temperature or smelting endpoint, effectively solving the problem of inaccurate identification in the prior art. Attached Figure Description
[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0020] Figure 1 This is a schematic diagram of a furnace opening identification process to determine the smelting endpoint and a spectral imaging chip provided by an embodiment of the present invention.
[0021] Figure 2 This is a top view of an optical modulation layer provided in an embodiment of the present invention;
[0022] Figure 3 This is a schematic diagram of the broadband filtering effect of a micro / nano structure provided in an embodiment of the present invention;
[0023] Figure 4 This is a schematic diagram of the narrowband filtering effect of a micro / nano structure provided in an embodiment of the present invention;
[0024] Figure 5This is a flowchart illustrating a method for determining the brightest area of a furnace opening according to an embodiment of the present invention.
[0025] Figure 6 This is an image of the furnace flame captured by a spectral imaging chip provided in an embodiment of the present invention;
[0026] Figure 7 This is a schematic diagram of the brightest area determined according to the method for determining the brightest area of the furnace opening provided in this embodiment;
[0027] Figure 8 This is a schematic flowchart of a method for fabricating a furnace mouth spectral imaging chip according to another embodiment of the present invention. Detailed Implementation
[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0029] Converter steelmaking is currently the most widely used and efficient steelmaking method in the world. End-point control is one of the key technologies in converter production, and accurate determination of the end point is crucial for improving smelting quality and shortening the smelting cycle. However, due to unstable raw materials, complex chemical reactions, and strict requirements for the steel grades being produced, accurate control of the smelting end point remains a challenge. Accurate online monitoring of the smelting end point temperature has always been a pressing problem for the global metallurgical industry. Currently, the industry mainly relies on manual experience or complex large-scale instruments to measure furnace mouth temperature and qualitative measurements of slag residue for end-point control, resulting in low accuracy and high cost. Therefore, realizing a small-volume, low-cost, safe, reliable, and easily integrated online smelting end-point control chip is of great significance to the development of the steel smelting industry and its automation, representing true Industry 4.0. This invention, based on the spectral radiation information characteristic analysis of the converter steelmaking furnace mouth, conducts online non-contact measurement of the smelting end point temperature in converter steelmaking, thereby achieving accurate online control of the smelting end point. Specifically, this embodiment of the invention provides a furnace mouth spectral imaging chip for monitoring the smelting endpoint. In this furnace mouth spectral imaging chip, a light modulation layer is disposed on the surface of the photosensitive area of an image sensor. The light modulation layer includes a light modulation structure. The light modulation layer is used to perform spectral modulation on the incident light entering at least one point of the light modulation structure, so as to obtain incident light carrying information corresponding to the at least one point on the surface of the photosensitive area. Correspondingly, the image sensor is used to convert the incident light carrying information corresponding to the at least one point into a corresponding electrical signal. The electrical signal is the image matrix modulated by the light modulation layer. Compared to existing commercial spectrometers, the furnace mouth spectral imaging chip provided by this invention collects incident light information that includes both light intensity distribution and spectral information at at least one point in the furnace mouth image. Since this incident light information at at least one point encompasses the image or spectrum of the furnace mouth flame, it can fully utilize the image or spectral information of the furnace mouth flame when identifying temperature or the steelmaking endpoint based on this incident light information. This enables accurate identification of smelting temperature or the smelting endpoint, effectively solving the problem of inaccurate identification in existing technologies. The following detailed embodiments will further explain and illustrate the contents of this invention.
[0030] like Figure 1 As shown, an embodiment of the present invention provides a furnace mouth spectral imaging chip for smelting endpoint monitoring tasks, comprising: an image sensor 2, and a light modulation layer 1 disposed on the surface of the photosensitive area of the image sensor 2;
[0031] The light modulation layer 1 includes a light modulation structure, which is used to perform spectral modulation on incident light entering at least one point of the light modulation structure, so as to obtain incident light carrying information corresponding to the at least one point on the surface of the photosensitive area; the incident light carrying information refers to the incident light spectral information of the flame at at least one point in the imaging image; the incident light refers to at least one of the radiation light or transmitted light from the steelmaking furnace opening.
[0032] The image sensor 2 is used to convert the information carried by the incident light corresponding to the at least one point after being modulated by the optical modulation layer into a corresponding electrical signal, wherein the electrical signal is the image matrix modulated by the optical modulation layer.
[0033] In this embodiment, the smelting endpoint monitoring task includes identifying the smelting endpoint, and correspondingly, the smelting endpoint monitoring result includes the smelting endpoint identification result. Furthermore, the smelting endpoint monitoring task also includes identifying the real-time smelting temperature during the smelting process, and correspondingly, the smelting endpoint monitoring result also includes the endpoint temperature identification result during the smelting process.
[0034] It should be understood that the term "and / or" in this embodiment and other embodiments describes the relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.
[0035] This invention provides a furnace mouth spectral imaging chip for furnace mouth spectral imaging. Based on this imaging, the furnace mouth temperature can be determined, thus facilitating control of the steelmaking endpoint. In this furnace mouth spectral imaging chip, a light modulation layer is disposed on the surface of the photosensitive area of an image sensor. The light modulation layer includes a light modulation structure, which modulates the spectrum of incident light entering at least one point of the light modulation structure. This modulates the incident light carrying information corresponding to that at least one point on the surface of the photosensitive area. Correspondingly, the image sensor converts the incident light carrying information modulated by the light modulation layer at the at least one point into a corresponding electrical signal. This electrical signal is the image matrix modulated by the light modulation layer. Therefore, this invention enables non-contact acquisition of furnace mouth incident light carrying information using a furnace mouth spectral imaging chip. The furnace mouth spectral imaging chip acquires incident light carrying information including the information at at least one point of the furnace mouth image. The light intensity distribution information and spectral information are considered. Since the incident light at different points in the furnace opening carries information including the image or spectrum of the furnace flame, when identifying temperature or the steelmaking endpoint based on the incident light information at at least one point, the image or spectral information of the furnace flame can be fully utilized. This enables accurate identification of the smelting temperature or the smelting endpoint, effectively solving the problem of inaccurate identification in existing technologies. Therefore, this embodiment of the invention can use a furnace opening spectral imaging chip based on an optical filter array to replace a commercial spectrometer. This furnace opening spectral imaging chip uses different periodic structures of micro-nano structures to perform different broadband filtering modulations on a beam of light. By detecting the response of the light after passing through different micro-nano structures, the spectral information of the light to be measured can be recovered using algorithms. This furnace opening spectral imaging chip can reconstruct the spectral information of the entire flame region using the light intensity values in the furnace flame image. Therefore, the spectral imaging chip can measure the spectral information of one or more points of the furnace flame.
[0036] In this embodiment, the light modulation layer 1 includes a light modulation structure. The light modulation structure modulates the spectrum of incident light (e.g., the transmitted light or radiation light of the target to be identified) entering at least one point of the light modulation structure, so as to obtain the incident light carrying information corresponding to the at least one point on the surface of the image sensor 2.
[0037] It should be noted that since the incident light carries information including the light intensity distribution and spectral information at at least one point in the furnace mouth image, when identifying the temperature or steelmaking endpoint based on the incident light carrying information at at least one point, the image or spectral information of the furnace mouth flame can be fully utilized, thereby enabling accurate identification of the smelting temperature or smelting endpoint, which can effectively solve the problem of inaccurate identification in the prior art.
[0038] In this embodiment, it is understood that the modulation intensity is related to the specific structural form of the optical modulation structure. For example, different modulation intensities can be achieved by designing different optical modulation structures (such as changing the shape and / or size parameters of the optical modulation structure).
[0039] In this embodiment, it is understood that the optical modulation structure at at least one point on the optical modulation layer 1 has a spectral modulation effect on the incident light. It should be noted that the optical modulation layer 1 is composed of multiple optical filter units, and the optical modulation structure at different positions within each optical filter unit is different, thus having different spectral modulation effects on the incident light; the optical modulation structures at different positions between optical filter units can be the same or different, thus having the same or different spectral modulation effects on the incident light.
[0040] like Figure 1 As shown, the complete process for identifying the furnace opening of a steelmaking furnace to determine whether it is the end point of smelting is as follows: The light emitted by the furnace flame 100 of the steelmaking converter 200 is collected by the furnace opening spectral imaging chip 300. After processing by the light modulation layer and image sensor in the furnace opening spectral imaging chip, an image containing the spectral information of the incident light is obtained. Subsequently, the spectral information of the input light (incident light) can be obtained by analyzing the image. Then, the smelting temperature and the end point of smelting can be accurately monitored based on the spectral information of the input light.
[0041] Therefore, the purpose of this embodiment is to provide a novel optoelectronic chip for smelting endpoint control. This chip can collect image and spectral information of the furnace mouth during the smelting process online, and can realize rapid, accurate, safe and reliable measurement of smelting endpoint, furnace mouth temperature and detection and qualitative analysis of carbon elements, etc.
[0042] This chip directly fabricates micro-nano modulation structures on the surface of the photosensitive area of the image sensor. Several discrete or continuous micro-nano structures constitute a unit. Micro-nano modulation structures at different locations have different spectral modulation effects on incident light, and together they constitute the optical modulation layer.
[0043] Understandably, this chip solution can be mass-produced using existing CMOS processes, reducing the size, power consumption, and cost of the device.
[0044] Each micro / nano modulation structure in the optical modulation layer is pre-designed and can be fabricated by directly growing one or more layers of dielectric or metallic material on the image sensor, followed by etching. 2 ~10 5 λ 2The thickness is typically 0.1λ to 10λ, where λ is the center wavelength of the target band. Each modulation unit structure in the optical modulation layer corresponds to multiple pixels on the image sensor. The optical modulation layer is fabricated directly on the image sensor, and the image sensor and processor are connected via electrical contacts.
[0045] It is understandable that both the optical modulation layer and the CIS wafer (a special type of image sensor) can be manufactured using semiconductor CMOS integration technology. The optical modulation layer can be monolithically integrated directly on the image sensor at the wafer level. The chip can be fabricated in a single CMOS fabrication process, thus achieving monolithic integration at the wafer level. This helps to reduce the distance between the sensor and the optical modulation layer, shrink the device size, and lower packaging costs.
[0046] The furnace mouth spectral imaging chip provided in this embodiment has the following advantages: A. It enables safe, reliable, rapid, and accurate control of the smelting endpoint. B. It is easily integrated with backend industrial control systems, with high recognition accuracy and accurate qualitative analysis. C. The chip can be fabricated in a single CMOS process, which helps reduce device failure rate, improve device yield, and reduce costs. D. It achieves monolithic integration at the wafer level, which minimizes the distance between the sensor and the optical modulation layer, thus reducing unit size, device volume, and packaging costs.
[0047] Based on the above embodiments, in this embodiment, the optical modulation structure in the optical modulation layer includes a regular structure and / or an irregular structure; and / or, the optical modulation structure in the optical modulation layer includes a discrete structure and / or a continuous structure.
[0048] In this embodiment, the optical modulation structure in the optical modulation layer may include only regular structures, only irregular structures, or both regular and irregular structures.
[0049] In this embodiment, the term "regular structure" in optical modulation structure can mean that the smallest modulation unit contained in the optical modulation structure has a regular structure, such as a rectangle, square, or circle. Furthermore, "regular structure" can also mean that the arrangement of the smallest modulation units in the optical modulation structure is regular, such as a regular array, circle, trapezoid, or polygon. Additionally, "regular structure" can also mean that both the smallest modulation units in the optical modulation structure have a regular structure and a regular arrangement.
[0050] In this embodiment, the term "irregular structure" in optical modulation structure can refer to the following: the minimum modulation unit contained in the optical modulation structure is an irregular structure, such as an irregular polygon, a random shape, or other irregular graphic. Furthermore, "irregular structure" in optical modulation structure can also refer to the following: the arrangement of the minimum modulation units contained in the optical modulation structure is irregular, such as an irregular polygonal form, a random arrangement, etc. Additionally, "irregular structure" in optical modulation structure can also refer to the following: both the minimum modulation units contained in the optical modulation structure are irregular structures, and the arrangement of the minimum modulation units is also irregular.
[0051] In this embodiment, it should be noted that the optical modulation structure has different modulation effects on light of different wavelengths. Specific modulation methods include, but are not limited to, scattering, absorption, interference, surface plasmon resonance, and resonance enhancement. By designing different filter structures, the transmission spectrum of light passing through different sets of filter structures will be different.
[0052] It is understandable that since the function of the light modulation layer 1 is to modulate the spectrum of the incident light, it is preferable to use materials with high refractive index and low loss. For example, silicon, germanium, germanium-silicon materials, silicon compounds, germanium compounds, III-V group materials, etc. can be selected for preparation. Among them, silicon compounds include, but are not limited to, silicon nitride, silicon dioxide, silicon carbide, etc.
[0053] Based on the above embodiments, in this embodiment, the optical modulation structure in the optical modulation layer includes a unit array composed of multiple micro-nano units, each micro-nano unit corresponding to one or more pixels on the image sensor; the structures of each micro-nano unit may be the same or different.
[0054] The following is combined Figure 2 For example, in this embodiment, such as Figure 2 As shown, the light modulation layer 1 is etched with several micro / nano units, each containing an array of various micro / nano structures that modulate the received light from the flame. Different structures exhibit different modulation effects, including but not limited to scattering, absorption, transmission, reflection, interference, excitation, and resonance enhancement. This modulation effect can be altered by changing the shape of the micro / nano structure unit; the unit geometry can include, but is not limited to, circles, crosses, regular polygons, rectangles, and any combination thereof. Furthermore, this modulation effect can be changed by altering the parameters of the micro / nano structure; these parameters can include, but are not limited to, the micro / nano structure's period, radius, side length, duty cycle, thickness, and any combination thereof. The micro / nano structures on the light modulation layer are holes that penetrate or partially penetrate the flat plate.
[0055] In this embodiment, it should be noted that different micro / nano units have different modulation effects on light of different wavelengths. Specific modulation methods include, but are not limited to, scattering, absorption, interference, surface plasmon resonance, and resonance enhancement. By designing different micro / nano units, the transmission spectrum of light passing through different sets of micro / nano units is different.
[0056] Based on the above embodiments, in this embodiment, the micro-nano unit includes multiple sets of micro-nano structure arrays, and the structures of each set of micro-nano structure arrays may be the same or different.
[0057] Based on the above embodiments, in this embodiment, each group of micro-nano structure arrays has the function of broadband filtering or narrowband filtering.
[0058] In this embodiment, the micro / nano structure array obtains the modulation intensity of different wavelength components of the incident light from the steelmaking furnace opening by performing broadband or narrowband filtering. For example... Figure 3 and Figure 4 As shown, each array of micro-nano structures in the optical modulation layer has the function of broadband filtering or narrowband filtering.
[0059] It is understandable that each group of micro / nano structure arrays can possess broadband filtering capabilities, narrowband filtering capabilities, or a combination of both. Furthermore, the broadband and narrowband filtering ranges of each group of micro / nano structure arrays can be the same or different. For example, by designing the period, duty cycle, radius, and side length of each group of micro / nano structures within a micro / nano unit, it can achieve narrowband filtering, allowing only one (or fewer) wavelengths of light to pass through. Conversely, by designing the period, duty cycle, radius, and side length of each group of micro / nano structures within a micro / nano unit, it can achieve broadband filtering, allowing more or all wavelengths of light to pass through.
[0060] Understandably, in practical applications, the filtering state of each micro-nano structure array can be determined by using broadband filtering, narrowband filtering, or a combination thereof, depending on the application scenario.
[0061] Based on the above embodiments, in this embodiment, each group of micro / nano structure arrays is a periodic structure array or an aperiodic structure array.
[0062] In this embodiment, each group of micro / nano structure arrays can be entirely periodic, entirely aperiodic, or partially periodic and partially aperiodic. Periodic structure arrays are easier to design using optical simulation, while aperiodic structure arrays can achieve more complex modulation effects.
[0063] In this embodiment, each group of micro-nano structure arrays within the micro-nano unit exhibits different modulation effects on light of different wavelengths, and the modulation effects on input light also differ between the groups of micro-nano structure arrays. Specific modulation methods include, but are not limited to, scattering, absorption, interference, surface plasmon resonance, and resonance enhancement. By designing different micro-nano structure arrays, the transmission spectrum of light passing through different groups of micro-nano structure arrays is made different.
[0064] Based on the above embodiments, in this embodiment, the thickness of the light modulation layer is 0.1λ to 10λ, where λ represents the center wavelength of the incident light.
[0065] In this embodiment, it should be noted that if the thickness of the optical modulation layer is much smaller than the center wavelength of the incident light, it cannot achieve effective spectral modulation; if the thickness of the optical modulation layer is much larger than the center wavelength of the incident light, it is difficult to fabricate and will introduce significant optical losses. Therefore, in this embodiment, to reduce optical losses, facilitate fabrication, and ensure effective spectral modulation, the overall size (area) of each micro / nano unit in the optical modulation layer 1 is typically λ. 2 ~10 5 λ 2 The thickness is typically 0.1λ to 10λ (λ represents the center wavelength of the incident light at the steelmaking furnace opening). For example... Figure 5 As shown, the overall size of each micro / nano unit is 0.5 μm. 2 ~40000μm 2 The dielectric material in the optical modulation layer 1 is polycrystalline silicon with a thickness of 50 nm to 2 μm.
[0066] Based on the above embodiments, in this embodiment, the image sensor is any one or more of the following:
[0067] CMOS image sensor (CIS), charge-coupled device (CCD), single-photon avalanche diode (SPAD) array, and focal plane array.
[0068] In this embodiment, it should be noted that a wafer-level CMOS image sensor (CIS) is used to achieve monolithic integration at the wafer level, which can minimize the distance between the image sensor and the light modulation layer. This is beneficial for reducing the size of the unit, lowering the device volume and packaging cost. SPAD can be used for weak light detection, and CCD can be used for strong light detection.
[0069] In this embodiment, the optical modulation layer and the image sensor can be fabricated using complementary metal-oxide-semiconductor (CMOS) integration technology, which helps reduce device failure rate, increase device yield, and reduce cost. For example, the optical modulation layer can be prepared by directly growing one or more layers of dielectric material on the image sensor, followed by etching, depositing a metal material before removing the sacrificial layer used for etching, and finally removing the sacrificial layer.
[0070] Based on the same inventive concept, another embodiment of the present invention provides an intelligent smelting control device, including: a furnace mouth spectral imaging chip as described in the above embodiment. The intelligent smelting control device may include various devices related to smelting process control, and this embodiment does not limit this to any particular type.
[0071] Since the intelligent smelting control device provided in this embodiment includes the furnace mouth spectral imaging chip described in the above embodiments, the intelligent smelting control device provided in this embodiment has all the beneficial effects of the furnace mouth spectral imaging chip described in the above embodiments. Since the above embodiments have already described this in detail, this embodiment will not repeat it.
[0072] Understandably, flame spectroscopy is a non-contact control method with low cost and minimal requirements for the production environment. It calculates smelting temperature by extracting and analyzing the characteristics of the flame spectrum, thereby achieving endpoint control. To reduce the cost and improve the accuracy of the spectral collection module in the detection system, the spectral imaging chip based on an optical filter array, as described in the above embodiments, can replace a commercial spectrometer. This spectral imaging chip utilizes different periodic structures of micro / nano structures to perform different broadband filtering modulations on a beam of light. By detecting the response of the light after passing through different micro / nano structures, the spectral information of the light under test can be recovered using algorithms. This spectral imaging chip can reconstruct the spectral information of the entire flame region using the light intensity values in the furnace flame image. Therefore, the spectral imaging chip can measure the spectral information of multiple points in the furnace flame. Since the spectrum of the brightest region in the furnace flame image is least affected by smoke interference, the spectrum of the brightest region is closest to the true spectrum of the flame. Compared with commercial spectrometers that can only collect spectral information from a single point, it can effectively eliminate the interference of smoke, thereby improving the accuracy of the temperature measurement system. However, when recovering the spectrum, the spectral imaging chip needs to perform spectral recovery on all regions in the furnace flame image. This results in most of the spectra recovered by the spectral imaging chip and device being discarded, greatly wasting the time required for spectral recovery. Therefore, an algorithm that automatically determines the brightest region of the converter furnace flame image before the spectral imaging chip recovers the spectrum is of great significance for shortening the measurement time of the smelting temperature by the spectral imaging chip and device, thereby improving the control efficiency of converter steelmaking.
[0073] Therefore, based on the same inventive concept, another embodiment of the present invention provides a method for determining the brightest region of a furnace opening based on the furnace opening spectral imaging chip described in the above embodiment, including the following:
[0074] Obtain the image matrix I modulated by the optical modulation layer. The image matrix I has a size of H×W, and the light intensity value at the i-th row and j-th column of the image is represented by I. i,j It means that 0≤I i,j ≤255 and I i,j It is an integer;
[0075] The convolution kernel size is determined to be K×K, and the element at the i-th row and j-th column of the convolution kernel is K. i,j And K i,j =1;
[0076] The convolution kernel is convolved with the image matrix I. The convolution boundary is padded with P and filled with 0 elements. The stride is S. The resulting matrix is I'. The size of matrix I' is H'×W'.
[0077] Based on convolution operations The value of the element I' in the i-th row and j-th column of matrix I' i,j satisfy Each element of matrix I' represents the sum of light intensity values for a region of the image matrix I;
[0078] Determine the position of the largest element in the image matrix I';
[0079] If the position of the largest element of the image matrix I' is in the l-th row and k-th column, then the top left corner element of the brightest region of the image matrix I is located in the l×S+1-S-th row and k×S+1-S-th column, and the bottom right corner element of the brightest region is located in the l×S+KS-th row and k×S+KS-th column.
[0080] The following is combined Figure 5 , Figure 6 and Figure 7 The method for determining the brightest area of the furnace opening provided in this embodiment will be described in detail. For example... Figure 5 As shown, the algorithm for determining the brightest region provided in this embodiment includes the following steps:
[0081] Step 1:
[0082] The image of the furnace flame is passed through a photonic crystal array chip to obtain a grayscale image matrix I. Let the size of matrix I be H×W, and let the light intensity value at the i-th row and j-th column of the image be represented by I. i,j It means that 0≤I i,j ≤255 and is an integer;
[0083] Step Two:
[0084] The size of the convolution kernel is determined and can be adjusted according to actual needs. Assume the kernel size is K×K, and the element at the i-th row and j-th column of the kernel is K. i,j And K i,j =1;
[0085] Step 3:
[0086] A convolution operation is performed between the convolution kernel and the image matrix. The convolution boundary is padded with P elements, and the stride is S. The resulting matrix is I'. Let the size of matrix I' be H' × W'. Each element of I' represents the sum of light intensity values for a certain region of matrix I;
[0087] Step Four:
[0088] Determine the position of the largest element in matrix I', and denote it as the l-th row and k-th column;
[0089] Step 5:
[0090] Since each element of matrix I' represents the sum of light intensity values for a certain region of matrix I, the position of the largest element in matrix I' reflects the position of the brightest region in matrix I. If the largest element of matrix I' is located in row l and column k, then the top-left element of the brightest region in image matrix I is located in row l×S+1-S and column k×S+1-S, and the bottom-right element is located in row l×S+KS and column k×S+KS.
[0091] This embodiment automatically determines the position of the brightest region of the converter furnace flame through a matrix convolution algorithm, which can significantly reduce the amount of data that needs to be processed when the spectral chip and device used for the end-point control of converter steelmaking recover the spectrum, thereby improving its control efficiency.
[0092] This embodiment proposes using image convolution to determine the position of the brightest region in the furnace flame image, which greatly reduces the computational load of the spectral imaging chip and device used for converter steelmaking endpoint control when recovering the spectrum and improves its control efficiency.
[0093] In this embodiment, when the spectral imaging chip used for endpoint control in converter steelmaking is applied to the automatic determination of the brightest region of the flame at the furnace mouth in a stainless steel plant converter steelmaking process, the effect is as follows: Figure 6 and Figure 7 As shown. At this time, the size of the grayscale image matrix I is H×W=1216×1936, the size of the convolution kernel is K×K=30×30, and the stride S=30. Figure 6 The image shows a grayscale image of the furnace flame captured by a spectral imaging chip. Figure 7 The algorithm automatically identifies the brightest region for this purpose.
[0094] Based on the same inventive concept, another embodiment of the present invention provides a method for fabricating a furnace mouth spectral imaging chip as described in the above embodiments, such as... Figure 8 As shown, the specific steps include the following:
[0095] Step 1810: Prepare the image sensor;
[0096] Step 1820: Prepare a light modulation layer containing a light modulation structure on the surface of the photosensitive area of the image sensor.
[0097] The light modulation layer includes a light modulation structure, which is used to perform spectral modulation on incident light entering at least one point of the light modulation structure, so as to obtain incident light-carrying information corresponding to the at least one point on the surface of the photosensitive area; the incident light-carrying information refers to the incident light spectral information of the flame at at least one point in the imaging image; the incident light-carrying information includes light intensity distribution information and spectral information at at least one point in the furnace opening image; the incident light refers to at least one of the radiated light or transmitted light of the steelmaking furnace opening; the image sensor is used to convert the incident light-carrying information corresponding to the at least one point after modulation by the light modulation layer into a corresponding electrical signal, the electrical signal being an image matrix modulated by the light modulation layer.
[0098] When the furnace mouth spectral imaging chip is used for intelligent processing tasks at the steelmaking furnace mouth, the input training samples and output training samples corresponding to the intelligent processing tasks are used to train the furnace mouth spectral imaging chip, which includes different optical modulation structures, image sensors and processors with different fully connected parameters, to obtain optical modulation structures, image sensors and processors that meet the training convergence conditions.
[0099] In this embodiment, it should be noted that, as Figure 1 As shown, the optical modulation layer 1 can be fabricated by directly growing one or more layers of dielectric material on the image sensor 2, followed by etching, depositing a metal material before removing the sacrificial layer used for etching, and finally removing the sacrificial layer. By designing the size parameters of the optical modulation structure, each unit can have different modulation effects on light of different wavelengths within the target range, and this modulation effect is insensitive to the incident angle and polarization. Each unit in the optical modulation layer 1 corresponds to one or more pixels on the image sensor 2. 1 is fabricated directly on 2.
[0100] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for determining the brightest region at the furnace opening based on a furnace opening spectral imaging chip, characterized in that, A furnace mouth spectral imaging chip is used for monitoring the end point of smelting. The furnace mouth spectral imaging chip includes: an image sensor and a light modulation layer disposed on the surface of the photosensitive area of the image sensor; the light modulation layer includes a light modulation structure, which is used to perform spectral modulation on incident light entering at least one point of the light modulation structure, so as to obtain incident light-carrying information corresponding to the at least one point on the surface of the photosensitive area; the incident light-carrying information refers to the incident light spectral information of the flame at at least one point in the imaging image; the incident light refers to at least one of the radiated light and transmitted light of the steelmaking furnace mouth; the image sensor is used to convert the incident light-carrying information corresponding to the at least one point after modulation by the light modulation layer into a corresponding electrical signal, the electrical signal being an image matrix modulated by the light modulation layer; the method includes: Obtain the image matrix modulated by the optical modulation layer. The image matrix The size is Image number Line 1 The light intensity value at the column is used It means that among them and It is an integer; Determine the kernel size as convolution kernel number Line 1 The element at column is ,and ; The convolution kernel is combined with the image matrix Perform a convolution operation, with the convolution boundary padded as follows: The filling element is Step size is The matrix after convolution is ;matrix The size is , Based on convolution operation , ,matrix The Line 1 Column element value satisfy ,matrix Each element represents the image matrix. The sum of light intensity values in a region; Determine the image matrix The position of the largest element; If the image matrix The position of the largest element is the th line, number The column then determines the image matrix. The element in the top left corner of the brightest area is located at the 1st line, number The element in the bottom right corner of the brightest area is located in the column. line, number List.
Citation Information
Patent Citations
Spectrum chip, spectrograph and spectrum chip preparation method
CN111811651A
Converter mouth flame image collection system
CN205024254U
