Method for detecting external light in an ophthalmic surgical cassette

Abstract

The embodiments disclosed herein provide a surgical console, a surgical cassette, and a method for acquiring a grayscale image with an image sensor and then processing the image with an embedded microcontroller to decode a barcode and / or determine a current fluid level within the surgical cassette. The image sensor is used to detect external light coming into the field of view of the image sensor. A software algorithm stored within the microcontroller in the surgical console determines whether the likelihood of external light interference is high. If the likelihood of external light interference is high, a warning or alarm is generated to alert the user to remove the external light source or to turn the console away from the external light source. Normal console operation and functionality is restored after the user removes the external light and then clears the warning.

Description

Cross-references to related applications

[0001] This application claims the benefit of U.S. Provisional Application Serial No. 63 / 594,718 (filed October 31, 2023), the contents of which are incorporated herein by reference in their entirety. Background Technology

[0002] This disclosure generally pertains to ophthalmic surgical kits and their usage. Summary of the Invention

[0003] This disclosure generally relates to ophthalmic surgical consoles and surgical kits and their usage.

[0004] The following description and accompanying drawings illustrate certain illustrative features of one or more embodiments. Attached Figure Description

[0005] The accompanying drawings depict certain aspects of one or more of the disclosed embodiments and should therefore not be construed as limiting the scope of this disclosure.

[0006] Figure 1A An example of an ophthalmic surgical system that can be used to perform ophthalmic surgery on the eye, according to certain embodiments, is illustrated.

[0007] Figure 1B According to certain embodiments Figure 1A An example of a subsystem of the console of an ophthalmic surgical system.

[0008] Figure 2A This is a rear isometric view of an example surgical box that can be operatively coupled to a console of an ophthalmic surgical system according to certain embodiments.

[0009] Figure 2B According to certain embodiments Figure 2A Rear elevation view of the surgical box.

[0010] Figure 3 This is an enlarged cross-sectional schematic diagram of the interaction between a surgical box and a surgical console according to certain embodiments, illustrating an image sensor disposed in the surgical console detecting a barcode disposed on the surgical box, the barcode being illuminated by a light source disposed in the surgical console.

[0011] Figure 4 The illustration shows a barcode set on a surgical box according to certain embodiments. Figure 3 The final image obtained by the image sensor seen in the image.

[0012] Figure 5A The illustration shows an image sensor capturing data and using it to generate images according to certain embodiments when the lower left visible light source remains dimmed. Figure 4The final image seen is an image of the barcode on the surgical box.

[0013] Figure 5B The illustration shows an image sensor capturing data and using it to generate images according to certain embodiments when the visible light source in the upper right corner remains dimmed. Figure 4 Another image of the barcode on the surgical box, which is the final image seen in the picture.

[0014] Figure 5C The illustration shows an image sensor capturing data and using it to generate images according to certain embodiments when the visible light source in the lower right corner remains dimmed. Figure 4 Another image of the barcode on the surgical box, which is the final image seen in the picture.

[0015] Figure 5D The illustration shows an image sensor capturing data and using it to generate images when the upper left visible light source remains dimmed, according to certain embodiments. Figure 4 Another image of the barcode on the surgical box, which is the final image seen in the picture.

[0016] Figure 6 This is another enlarged cross-sectional schematic diagram of the interaction between the surgical cartridge and the surgical console according to certain embodiments, this time illustrating an image sensor disposed in the surgical console to detect the fluid level in the surgical cartridge by illuminating the reservoir with infrared light.

[0017] Figure 7A It is captured by an image sensor according to certain embodiments and Figure 6 The image of the fluid level window corresponding to when the reservoir is empty.

[0018] Figure 7B It is captured by an image sensor according to certain embodiments and Figure 6 An image of the fluid level window corresponding to when the reservoir is ¼ full.

[0019] Figure 7C It is captured by an image sensor according to certain embodiments and Figure 6 An image of the fluid level window corresponding to when the reservoir is half full.

[0020] Figure 7D It is captured by an image sensor according to certain embodiments and Figure 6 An image of the fluid level window corresponding to when the reservoir is full.

[0021] Figure 8 The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method includes a test or check for external light interference performed before decoding the barcode of the surgical box.

[0022] Figure 9The illustration shows a method for using, according to certain embodiments, in... Figure 8 The flowchart describes a method for checking external light interference within an image, in which the average pixel brightness value of the image is calculated.

[0023] Figure 10 The illustration shows a method for using, according to certain embodiments, in... Figure 8 The flowchart describes a method for checking external light interference within a finite number of consecutive image frames, where the average pixel brightness value of each image is calculated.

[0024] Figure 11 The illustration shows a method for using, according to certain embodiments, in... Figure 8 The flowchart describes a method for checking external light interference within a large number of consecutive frame images, where the average pixel brightness value of each image is calculated.

[0025] Figure 12A The illustration shows a method for using, according to certain embodiments, in... Figure 8 The flowchart describes a method for checking external light interference within an image, wherein a distribution map of all pixels with pixel brightness values ​​equal to or greater than a predetermined threshold is generated for that image.

[0026] Figure 12B This refers to an image of a barcode region including a fluid level window, captured by an image sensor according to certain embodiments. The image shows local regions with pixel brightness values ​​equal to or greater than a predetermined threshold and individual sizes greater than a predetermined limit. These local regions can be... Figure 12A The method is used to draw and process distribution maps to determine external light interference.

[0027] Figure 12C This refers to an image of a barcode region including a fluid level window, captured by an image sensor according to certain embodiments. The image shows individual local regions with pixel brightness values ​​equal to or greater than a predetermined threshold and with sizes smaller than a predetermined limit. These local regions can be... Figure 12A The method is used to draw and process distribution maps to determine external light interference.

[0028] Figure 13 The illustration shows a method for using, according to certain embodiments, in... Figure 8 The flowchart of the method for checking external light interference is as follows: for a finite number of consecutive frame images, a finite number of distribution maps of all pixels with pixel brightness values ​​equal to or greater than a predetermined threshold are generated.

[0029] Figure 14 The illustration shows a method for using, according to certain embodiments, in... Figure 8The flowchart of the method for checking external light interference is as follows: for a large number of consecutive frame images, a large number of distribution maps of all pixels with pixel brightness values ​​equal to or greater than a predetermined threshold are generated.

[0030] Figure 15A The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method includes an external light interference check performed after decoding of the barcode on the surgical box fails.

[0031] Figure 15B It is an image of the barcode area of ​​the surgical box, including the fluid level window, captured by an image sensor according to certain embodiments when external light interferes with the barcode.

[0032] Figure 16 The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method shows that a check for external light interference is performed only after a predetermined number of decoding failures have been made using different decoding parameters on the barcode of the surgical box.

[0033] Figure 17A The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method shows that, after successfully decoding the barcode of the surgical box, a check for external light interference is performed.

[0034] Figure 17B It is an image of the barcode area of ​​the surgical box, including the fluid level window, captured by an image sensor according to certain embodiments when external light interferes with the fluid level window.

[0035] Figure 18 The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method includes a check for external light interference performed after a failure to calibrate the fluid level sensor for the surgical box.

[0036] Figure 19 The illustration shows an operation according to certain embodiments. Figure 3 The flowchart of the image sensor method shows that, after successfully decoding the barcode and calibrating the fluid level sensor for the surgical box, checks against external light interference are periodically performed while the surgical console is in standby mode.

[0037] Figure 20 The illustration shows an operation according to certain embodiments. Figure 3The flowchart of the image sensor method shows that, after successfully decoding the barcode and calibrating the fluid level sensor for the surgical box, checks against external light interference are periodically performed while the surgical console is in surgical mode.

[0038] Figure 21A The illustration shows an operation according to certain embodiments. Figure 3 A flowchart of an image sensor method, wherein, while actively monitoring the fluid level of the surgical box and while the surgical console is in standby or surgical mode, the average pixel brightness value within a defined inspection area of ​​each image in a continuous series of live frames is calculated to check for external light interference.

[0039] Figure 21B The image is an image of a barcode area of ​​a surgical cartridge, including a fluid level window, captured by an image sensor according to certain embodiments. The image shows a defined inspection area located outside the barcode area including the fluid level window for checking for external light interference.

[0040] Figure 21C According to certain embodiments, when strong external light is present in the defined inspection area used for inspecting external light interference, Figure 21B The image includes a barcode area of ​​the fluid level window, and the external light is defined by the average pixel brightness value of the defined inspection area being greater than a predetermined threshold.

[0041] Figure 22A The illustration shows an operation according to certain embodiments. Figure 3 A flowchart of an image sensor method, wherein, while actively monitoring the fluid level of the surgical box and while the surgical console is in standby or surgical mode, a distribution map is continuously drawn of local areas with pixel brightness values ​​equal to or greater than a predetermined threshold within a defined inspection area of ​​each image in a continuous series of live frames to check for external light interference.

[0042] Figure 22B According to certain embodiments, when external light is present within the defined inspection area... Figure 21B The image includes a barcode area of ​​a fluid level window, wherein the external light is defined as a local region having a pixel brightness value greater than a predetermined threshold, and wherein the area of ​​these local regions is individually greater than a predetermined limit.

[0043] To facilitate understanding, the same reference numerals are used where possible to refer to common elements in the figures. It is contemplated that elements and features of one embodiment can be advantageously combined in other embodiments without further description. Detailed Implementation

[0044] During ophthalmic surgery, a surgical cartridge can be operatively coupled to the fluid control module of a surgical console and is used to facilitate aspiration, suction, infusion, or transfusion functions typically performed during ophthalmic surgery. The surgical cartridge typically has one or more fluid chambers or reservoirs, such as infusion chambers, transfusion chambers, aspiration chambers, and venturi chambers. A barcode is typically printed or marked on the surgical cartridge, storing specific data / information associated with the cartridge, including pressure sensor data or parameters used for pressure sensor calibration, cartridge identification information, and manufacturing date. Typically, during surgical console setup, after the surgical cartridge has been successfully coupled to the fluid control module of the surgical console, the surgical console's barcode reader decodes the data or information stored in the barcode. The surgical console then performs calibration of one or more fluid level sensors for the surgical cartridge. After the console is set up, it works in conjunction with one or more fluid level sensors on the surgical console, along with one or more valve assemblies, one or more peristaltic pumps and / or venturi pumps, to track and maintain the appropriate fluid level in the fluid chamber of the box in console standby mode and during surgery.

[0045] However, in conventional surgical control consoles, barcode readers and fluid level sensors are optical and operate under an internal illumination source within the console. Therefore, any external light that penetrates the surgical chamber and is seen by the barcode reader and / or fluid level sensor is essentially unwanted noise. Depending on its intensity, when external light enters the surgical chamber, it can not only interfere with the surgical control console's ability to decode the barcode on the surgical chamber currently connected to the fluid control module, but it can also interfere with the console's ability to accurately read the current fluid level within the fluid chamber of the surgical chamber, leading to a loss of proper control over the fluid level and consequently malfunctioning other fluid level-related console functions.

[0046] Therefore, it is necessary to detect external light within the surgical chamber and further determine whether external light might interfere with the proper operation of the barcode reader and / or fluid level sensor. Once external light interference is identified, the external light source is removed or otherwise mitigated, thereby ensuring that the surgical console performs its correct functions of decoding the barcode and accurately reading the fluid level within the fluid chamber of the surgical chamber.

[0047] Therefore, certain embodiments disclosed herein provide an ophthalmic surgical console that includes a fluid level sensor barcode reader (LSBR) in its fluid control module. The LSBR is an optical sensor that uses a complementary metal-oxide-semiconductor (CMOS) sensor camera to capture grayscale digital images of barcodes marked or set on each surgical cassette during console setup, and to capture live images of the fluid level window within the surgical cassette before, during, and after surgery. Each image is processed into a digital matrix called pixel luminance values. These pixel luminance values ​​represent the intensity or brightness of each pixel in 8-bit grayscale from 0 to 255, where a pixel luminance value of 0 represents "black" and a pixel luminance value of 255 represents "white". By using separate internal light source groups and capturing and processing the barcode images and fluid level window images at separate times, the LSBR provides both fluid level sensor and barcode reader functions in an integrated device.

[0048] Figure 1A An example of an ophthalmic surgical system 10, according to certain embodiments, which can be used to perform ophthalmic surgery on the eye, is illustrated. In the illustrated embodiment, system 10 includes components connected and referenced as shown. Figure 1B The console 100 (also referred to as the "surgical console"), housing 102, display screen 104, interface device 107 (e.g., foot pedal), fluid control subsystem 110, and handheld device 112 are described in more detail.

[0049] Figure 1B According to certain embodiments Figure 1A Examples of subsystems of the console 100 of the ophthalmic surgical system 10. The console 100 includes a housing 102 that houses a computer 103 (with an associated display screen 104) and subsystems 106, 110, and 116 supporting an interface device 107 and handheld devices 112 (112a-c). The interface device 107 receives input to the surgical system 10, sends output from the system 10, and / or processes input and / or output. Examples of the interface device 107 include a foot pedal, a manual input device (e.g., a keyboard), and a display. The interface subsystem 106 receives input from the interface device 107 and / or sends output to the interface device.

[0050] Handpiece 112 can be any suitable ophthalmic surgical instrument, such as an ultrasound-driven phacoemulsification (phaco) handpiece, a laser handpiece, an irrigation cannula, a vitrectomy handpiece, or another suitable surgical handpiece. Fluid control subsystem 110 provides fluid control for one or more handpieces 112 (112a-c). For example, fluid control subsystem 110 can manage the fluid used for irrigation cannula. Handpiece subsystem 116 supports one or more handpieces 112. For example, handpiece subsystem 116 can manage the ultrasound oscillations of the phaco handpiece, provide laser energy to the laser handpiece, control the operation of the irrigation cannula, and / or manage the features of the vitrectomy handpiece.

[0051] Computer 103 controls the operation of ophthalmic surgical system 10. In some embodiments, computer 103 includes a controller that sends instructions to components of system 10 to control system 10. Display screen 104 displays data provided by computer 103.

[0052] According to some embodiments, computer 103 controls the operation of ophthalmic surgical system 10. Typically, a computer includes a processor and memory. The memory may include any means capable of operating to receive, store, or retrieve data, including but not limited to electronic, magnetic, or optical memory, whether volatile or non-volatile. The memory may include code stored thereon. The code may include instructions executable by the processor. For example, the code can be created using any programming language, including but not limited to C++ or any other programming language (including assembly language, hardware description languages, and database programming languages). In some cases, the code may be a program that, when loaded into the processor, causes the surgical console to receive and process information from one or more subsystems 106, 110, and 116 to, for example, provide fluid control for one or more handpieces 112.

[0053] The processor may be or include a microprocessor, microcontroller, embedded microcontroller, programmable digital signal processor, or any other programmable device operable to receive information from memory or other means communicating with the processor, computer 103, and / or console 100 and perform one or more operations on the received information. For example, the processor may send instructions to components of the fluid control subsystem 110 or other means or systems communicating with computer 103 to control such means and systems. The processor may also be operable to output results based on the operations it performs. Display screen 104 shows data and other output results provided by the processor of computer 103. In some cases, the processor may also be or include an application-specific integrated circuit, a programmable gate array, programmable array logic, or any other means or combination of means operable to process electrical signals.

[0054] Figure 2A It is a console that can be operatively connected to an ophthalmic surgical system according to certain embodiments (e.g., Figures 1A to 1B The illustration shows a rear isometric view of an example surgical box 200 of the control console 100 of the ophthalmic surgical system 10. Figure 2B According to certain embodiments Figure 2A The rear elevation view of the surgical box 200. For clarity, this article will... Figures 2A to 2B Combined description. The surgical cartridge 200 includes two pump assemblies 202 (202a-b) providing a pressure source and / or a vacuum source, and four valve assemblies 204 (204a-d) controlling pressure and / or fluid communication within the surgical cartridge 200. In some other embodiments, there may be only one pump assembly or more than two pump assemblies. In some other embodiments, there may be more or fewer than four valve assemblies (e.g., two to six valve assemblies).

[0055] In some embodiments, the surgical cartridge 200 is coupled to an external pressure source and / or vacuum source. In such embodiments, the external source may serve as an alternative to or supplement to the pump assembly 202.

[0056] The surgical cartridge 200 has a housing 205 including a base 206 and inlet / outlet ports 210 (210a-c) in the base 206, which provide pressure and / or fluid communication between the interior and exterior of the housing 205. Although not shown, each port 210a-c corresponds to a component of the fluid control subsystem 110 and / or a corresponding handheld component 112a-c. Figures 1A to 1B Flow lines (e.g., fittings) can be connected between (as shown).

[0057] In some embodiments, one of the first pump assembly 202a or the second pump assembly 202b provides a pressure source (e.g., to generate a driving force for fluid infusion), while the other of the first pump assembly 202a or the second pump assembly 202b provides a vacuum source (e.g., to generate a suction force for fluid aspiration). The first pump assembly 202a and the second pump assembly 202b may be peristaltic pumps or any other suitable type of pump for generating pressure and / or vacuum. In some embodiments, the first pump assembly 202a and the second pump assembly 202b are identical to each other.

[0058] Valve assembly 204 is coupled to base 206. Valve assembly 204 cooperatively functions to control pressure and / or fluid communication within and through surgical cartridge 200. In the illustrated embodiment, surgical cartridge 200 includes a first valve assembly 204a, a second valve assembly 204b, a third valve assembly 204c, and a fourth valve assembly 204d. As shown, in Figure 2AIn one embodiment, four valve assemblies 204 are arranged at the four corners of the housing 205, thereby surrounding two pump assemblies 202 arranged toward the center of the housing 205. However, in some other embodiments, the pump assemblies 202 and valve assemblies 204 may have any other suitable arrangement.

[0059] A Venturi reservoir 282 is disposed within the housing 205 of the surgical cartridge 200. The Venturi reservoir 282 performs at least two primary functions critical to the operation of the surgical cartridge 200. Typically, the Venturi reservoir 282 provides connection to a vacuum source for fluid aspiration during Venturi operation, provides a fluid volume buffer for normal vacuum depressurization within the surgical cartridge, and provides a fluid volume buffer for releasing vacuum pressure that may accumulate within the surgical cartridge 200 in the event of a surge following a closure failure. In some embodiments, during normal aspiration / suction use under Venturi vacuum, the Venturi reservoir 282 also allows air to separate from the liquid and then be discharged outside the cartridge 200 via the surgical console.

[0060] The Venturi reservoir 282 includes a barcode region 289 defined in a base 206. The barcode region 289 is positioned along the optical path of an image sensor in the console 100, which decodes the barcode and, according to some embodiments, determines the fluid level in the Venturi reservoir 282. In some embodiments, the image sensor is a single camera sensor or a complementary metal-oxide-semiconductor (CMOS) sensor. According to some embodiments, the image sensor is configured to image an area of ​​560 pixels × 560 pixels, and the image sensor has a nominal field of view of 12.32 mm × 12.32 mm, a minimum field of view of 12 mm × 12 mm, and a maximum field of view of 13 mm × 13 mm. During normal operation, the nominal fluid level in the Venturi reservoir 282 lies between the lower and upper limits of a fluid level window within the barcode region 289. The relatively small size or footprint of the barcode region 289 compared to other designs allows for the use of a more compact housing 205.

[0061] In some embodiments, the surgical cartridge 200 further includes one or more features configured to interact with components of the surgical console 100 to facilitate identification by the surgical console 100 of the type, serial number, pressure sensor calibration data or parameters, manufacturing date, batch number, etc. of the surgical cartridge 200. In one embodiment, both the features for facilitating identification of the surgical cartridge 200 and for measuring the fluid level in the Venturi reservoir 282 disposed within the surgical cartridge 200 are implemented by the LSBR of the surgical console 100.

[0062] In some embodiments, features for facilitating identification include decoding the barcode 1016 disposed on the surgical box 200, such as... Figure 3 The illustration shows an enlarged top cross-sectional view of the interface between a barcode region 289 defined in the base 206 of the surgical cartridge 200 and an LSBR 1002 disposed in the fluid control subsystem 110 of the surgical console 100. The LSBR 1002 includes an image sensor 1004 and at least one visible light source 1006 configured to emit visible light at an angle relative to a window 290 disposed in front of the LSBR 1002 within the surgical console 100 and relative to a barcode surface 1010 within the barcode region 289 of the surgical cartridge 200. The barcode region 289 includes a cavity 1008. The cavity 1008 includes a barcode surface 1010 on which a barcode 1016 is disposed. In one embodiment, the barcode 1016 is laser-etched onto the barcode surface 1010, meaning that the barcode 1016 includes a plurality of smooth surfaces 1014 that are interleaved or spaced apart from a plurality of etched surfaces 1012 generated by the laser. In one embodiment, the smooth surfaces 1014 of the barcode 1016 are made of smooth, dark, black, or other light-absorbing plastic; however, because the top layer of the etched surfaces 1012 of the barcode 1016 is roughened by laser processing, each of the etched surfaces 1012 includes a rough or uneven surface that can diffuse or scatter light.

[0063] In one embodiment, to enable the surgical console 100 to decode a barcode 1016 disposed within the surgical cartridge 200, visible light 1020 is emitted from at least one visible light source 1006 along an optical path that enters the cavity 1008 at an angle relative to a window 290 disposed within the surgical console 100. After passing through the window 290, the visible light 1020 is incident on the barcode 1016 on the barcode surface 1010, illuminating both the smooth surface 1014 and the etched surface 1012 of the barcode 1016 at an angle. Visible light 1020 illuminating portions of the smooth surface 1014 of the barcode 1016 is either reflected away from the image sensor 1004 (as indicated by arrow 1022) or absorbed by the material, including the barcode surface 1010. Visible light 1020 illuminating portions of the etched surface 1012 is diffused, with some of it being guided back through window 290 and detected by the image sensor 1004, as indicated by line 1024. Figure 4As seen, the final result is an image of barcode 1016, which consists of bright and dark portions. The bright portions represent light 1024 guided back to image sensor 1004 by etched surface 1012, and the dark portions represent light 1022 reflected or absorbed by smooth surface 1014. Therefore, under appropriate lighting conditions, surgical console 100 can then decode the image of barcode 1016 using known software, thereby obtaining the stored data / information of surgical cartridge 200 currently inserted into the fluid control subsystem 110 of surgical console 100, including pressure sensor calibration data / parameters, cartridge identification information, and manufacturing date. This ensures that cartridge 200 is the correct cartridge and that console 100 can operate correctly for the surgery currently being performed on the patient.

[0064] In one embodiment, the LSBR 1002 includes four different visible light sources, each configured to illuminate the barcode 1016 at an angle as disclosed above. According to some embodiments, each light source provides light with a wavelength of 630 nm. Figures 5A to 5D As seen in the accompanying drawings, reference numerals 1006a-d correspond to light reflected from the barcode surface 1010 from each of four different visible light sources. In a related embodiment, the four visible light sources are symmetrically arranged around the image sensor 1004, i.e., at least two visible light sources are arranged on each side of the image sensor 1004, thereby positioning the image sensor 1004 in the middle or center of the arranged visible light sources. However, when multiple visible light sources are used and the image sensor 1004 acquires images, glare or light intensity after reflection from each of the visible light sources 1006a-d may blur the barcode 1016 and make it difficult for the user to detect. To solve this problem, the image sensor 1004 captures an image sequence of the barcode 1016, wherein each image in the sequence satisfies the condition that at least one of the visible light sources 1006a-d is dimmed or turned off, while the remaining visible light sources 1006a-d are illuminated. For example, as Figures 5A to 5D As seen in the image sensor 1004, four images are acquired, each of which includes a different number of visible light sources that have been dimmed or turned off, thereby producing a corresponding number of reflections 1006a-d. Figure 5A It is an illustration of the first image captured in the sequence, in which the third visible light source is dimmed, while the first, second, and fourth visible light sources remain lit, thereby producing the corresponding first reflection 1006a, second reflection 1006b, and fourth reflection 1006d.

[0065] As in Figure 5AAs seen, light from the illuminated visible light source is reflected and blocks or partially blocks the corresponding portion of the barcode 1016, while the portion of the barcode 1016 corresponding to the location of the third visible light source remains dark, thereby allowing diffuse light 1024 from the etched surface 1012 to appear clearly within the image. This process is then repeated for each of the remaining visible light sources, i.e., Figure 5B The illustration shows how barcode 1016 appears when the second visible light source dims. Figure 5C The illustration shows how barcode 1016 appears when the fourth visible light source dims, and... Figure 5D The illustration shows how barcode 1016 appears when the first visible light source dims.

[0066] After obtaining all images of barcode 1016, the image processing software suite within the surgical console 100... Figures 5A to 5D All the images seen, so as to selectively... Figures 5A to 5D The darkened portions of each corresponding image are combined into, for example, Figure 4 The single synthetic image seen in the image is used to create something like... Figure 4 The image shown is a single composite image of barcode 1016, comprising the clearest received diffuse light 1024 from each portion of barcode 1016. Although in Figures 5A to 5D The document shows four visible light sources 1006a-d and four images; however, it should be clearly understood that fewer or additional images may be captured, or fewer or additional visible light sources may be used, in addition to what is explicitly disclosed herein. For example, in one particular embodiment, image sensor 1004 may capture only two images: a first image with only the first visible light source 1006a and the second visible light source 1006b illuminated, and a second image with only the third visible light source 1006c and the fourth visible light source 1006d illuminated. Internal software within the surgical console 100 can then overlay or “stitch” the bottom portion of the first image with the top portion of the second image to create a single final image including the clearest or most readable portion of the barcode 1016. In some embodiments, a final image consisting of three regions (i.e., a top region, a middle region, and a bottom region) is provided. In some embodiments, the bottom region will be derived from the first image, the top region from the second image, and the middle region will be a transition zone, wherein the middle region includes a blending area of ​​the first and second images. The bottom edge of the middle region (which could be, for example, 100% from the first image and 0% from the second image) transitions linearly to the top edge of the middle region (0% from the first image and 100% from the second image).

[0067] In some embodiments, Figure 6The illustration shows features used to determine the current fluid level in a Venturi reservoir 282 located within the surgical box 200. (As shown) Figure 6 As seen, the Venturi reservoir 282 is adjacent to a barcode area 289 defined in the base 206. When the surgical cartridge 200 is coupled to the surgical console 100, the barcode area 289 is positioned along the optical path of an image sensor 1004 in the surgical console 100, which is used to determine the fluid level in the Venturi reservoir 282.

[0068] exist Figure 6The cavity 1008 of the barcode area 289 seen herein includes a plurality of internal surfaces 291a-d. In some embodiments, these internal surfaces include a normal surface 291a and angled surfaces 291b, 291c, and 291d. In some embodiments, the plurality of internal surfaces 291a-d may include any combination of flat, angled, or curved configurations while maintaining the same function. For example, in one embodiment, surface 291a is flat and normal to the optical path of incident infrared light emitted by an infrared light source 1030 disposed within the LSBR 1002 of the surgical console 100 (indicated by arrow 1032). After transmission through surface 291a, the infrared (IR) light contacts a first angled surface 291b, which is aligned with both the infrared light source 1030 and the Venturi reservoir 282 in the LSBR 1002 of the console 100. The first angled surface 291b includes polished portions or textures, as well as angular orientations (if flat) or curvatures to help guide IR light from the IR light source 1030 toward the second angled surface 291c. In other words, IR light emitted from the LSBR 1002 of the console 100 is reflected from the first angled surface 291b, travels along an optical path from right to left of the viewer as indicated by arrow 1034, and is then partially reflected back from the second angled surface 291c (which may be flat or curved) along an optical path away from the viewer toward the LSBR 1002 of the console 100, as indicated by dashed arrow 1036. A portion of the infrared light reflected from the LSBR 1002 of the control console 100 passes through a third angled surface 291d, which is oriented to redirect the reflected IR light along an optical path, as indicated by the dashed arrow 1038, through a window 290 disposed within the LSBR 1002 of the surgical control console 1000, and onto the image sensor 1004 of the LSBR 1002 in the surgical control console 100 for detection. In some embodiments, each angled surface 291b, 291c is oriented at approximately 45 degrees relative to the plane of the base 206, such that the infrared light reflected from the LSBR 1002 in the control console 100 is reversed or rotated approximately 180 degrees relative to the infrared light emitted from the LSBR 1002 in the control console 100. However, in some other embodiments, the angled surfaces 291b, 291c, and 291d are oriented at other angles corresponding to the position and / or orientation of the infrared light source 1030 and the image sensor 1004.

[0069] The detection of the relative fluid level within the Venturi reservoir 282 operates based on the difference in refractive index between air and the liquid at surface 291c. In one embodiment, when IR light is incident on the second angled surface 291c, a first portion of the IR light incident where liquid is present on surface 291c is refracted at the solid-liquid interface and continues along path 1060 into the Venturi reservoir 282, while a second portion or the remainder of the IR light incident where no liquid is present on surface 291c undergoes total internal reflection from the second angled surface 291c and is then guided to the angled surface 291d. Following this process, an image of surface 291c is projected into image sensor 1004 of LSBR 1002. The areas of the surface in contact with the liquid appear dark, while the areas in contact with air appear bright. This image can be analyzed to determine the fluid level. The proportion or amount of IR light entering the fluid relative to the proportion or amount of IR light 1036 reflected from the second angled surface 291c after total internal reflection depends on the amount of fluid currently contained in the Venturi reservoir 282. Specifically, the portion of the incident IR light 1034 incident on the corresponding surface portion behind the Venturi reservoir 282 where fluid is present will be refracted into the Venturi reservoir 282 and will therefore never be detected by the image sensor 1004. Meanwhile, the portion of the incident IR light 1034 incident on the corresponding surface portion behind the Venturi reservoir 282 where no fluid is present will instead undergo total internal reflection and be reflected from the second angled surface 291c, and will then be detected by the image sensor 1004 of the LSBR 1002. Therefore, the net effect is that IR light is absorbed where fluid is present in the Venturi reservoir 282 and reflected where no fluid is present, thereby providing a means for determining the exact current amount of fluid within the Venturi reservoir 282. The image of surface 291c is guided by surface 291d and projected into the image sensor 1004 of LSBR 1002 in the shape and size of surface 291d. This surface is defined as fluid level window 1044, as seen in FIG7. In some embodiments, fluid level window 1044 is part of the barcode area 289 seen by the image sensor 1004 of LSBR 1002, that is, both barcode 1016 and fluid level window 1044 are within the field of view of the image sensor 1004 of LSBR 1002.

[0070] Figures 7A to 7D The illustration shows a series of example images of a fluid level window 1044 captured by the image sensor 1004 of the LSBR 1002 when multiple different fluid levels are detected within the Venturi reservoir 282, which is part of a barcode area 289. Figure 7AAs seen, most of the IR light has been detected by the image sensor 1004, thus providing a fluid level reading where the bright portion 1040 occupies most of the fluid level window 1044 (corresponding to the amount of light reflected from the second angled surface 291c), indicating that the Venturi reservoir 282 is empty or nearly empty. Figure 7B In the image sensor 1004, most of the IR light has been detected, providing a fluid level reading where the bright portion 1040 occupies the top ¾ of the fluid level window 1044 and the dark portion 1042 occupies the remaining bottom ¼ of the fluid level window 1044, thus indicating that the fluid in the Venturi reservoir 282 is approximately ¼ full. Figure 7C In this process, a portion of the IR light has been detected by the image sensor 1004, thereby providing a fluid level reading where the bright portion 1040 occupies the top half of the fluid level window 1044 and the dark portion 1042 occupies the remaining bottom half of the fluid level window 1044, thus indicating that the fluid in the Venturi reservoir 282 is approximately half full. Figure 7D In the image sensor 1004, only a small portion of the IR light has been detected, thereby providing a fluid level reading where the bright portion 1040 occupies the top ¼ of the fluid level window 1044 and the dark portion 1042 occupies the remaining bottom ¾ of the fluid level window 1044, thus indicating that the fluid in the Venturi reservoir 282 is approximately ¾ full.

[0071] However, when in Figure 3 The barcode decoding program seen there or Figure 6Problems can arise when an external light source or ambient light is introduced during the fluid level sensing process described above. This is because any external light seen by the image sensor 1004 of the LSBR 1002 can be noise that may interfere with the barcode 1016 and / or the fluid level window 1044. To block external light, a box made of opaque material or covering the entire front surface of the box with an opaque film may be effective. However, for manufacturability and inspection considerations, according to some embodiments, the surgical box 200 is made of transparent or translucent material, and only a small area directly in front of the barcode area 289 is covered with an opaque film. Therefore, when a strong external light source is pointed directly at the surgical box 200, this light may enter the surgical box 200 through the area and structure not covered by the light-blocking film or other light-mitigation measures and bounce inside, which may cause the light leakage level to rise to a level sufficient to interfere with the normal functioning of the image sensor 1004. For example, in the case of a barcode reader, strong external light may significantly reduce the contrast of the barcode pattern or blur the barcode pattern image, making the barcode 1016 undecodeable. The data and information stored in the barcode 1016 of each surgical cartridge 200 includes pressure sensor calibration data and parameters for each cartridge type. In short, the surgical console 100 simply cannot function without decoding the barcode 1016. In the case of the level sensor, strong external light can significantly increase the brightness within the fluid level window 1044, or appear as a bright spot in the fluid-filled area of ​​the dark portion 1042, which should be dark. Correct fluid level determination requires sufficient image contrast, i.e., a sufficient difference between the brightness of the air area and the darkness of the fluid area. Insufficient image contrast can lead to erroneous fluid level readings, which, when fed back to the fluid control subsystem 110, may cause the true fluid level to rise or fall in a way that renders the fluid control subsystem 110 inoperable.

[0072] This invention provides a method for acquiring a grayscale image using an image sensor 1004 and then processing the image using a computer 103 to decode a barcode 1016 and / or determine the current fluid level within a surgical cartridge 200. The image sensor 1004 is further used to detect external light entering its field of view. A software algorithm stored within the computer 103 in the surgical console 100 determines whether the likelihood of external light interference is high. If the likelihood of external light interference is high, a warning or alarm is generated to alert the user to remove the external light source or to turn the console away from it. Depending on the risk level, such as during surgery or setup, certain operations or functions of the surgical console 100 may also be suspended. For example, the surgical console 100 may enter a safe state or "safe mode" until the interference is eliminated. Normal console operation and functions resume once the user removes the external light and then clears the warning.

[0073] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 300 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 8 As seen in the flowchart. The procedure begins at step 302, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In steps 304A-F, the image sensor 1004 is enabled to perform tests to determine if any external light may have inadvertently shone on the surgical cartridge 200 and interfered with the decoding of the barcode 1016 and / or fluid level sensing. Steps 304A-F determine whether external light interference exists, whether external light interference is unlikely, or whether there is no external light interference.

[0074] If external light interference is confirmed, console 100 will generate an external light warning in step 310 to guide the user to remove the external light source or turn console 100 away from the external light source. After the user resolves the external light in step 312 and clears the warning in step 314, the program returns to steps 304A-F.

[0075] If no external light interference is detected, the console proceeds to barcode decoding step 306. Subsequently, if barcode decoding is successful during step 309, normal console operation continues in step 308; otherwise, console 100 generates a barcode failure warning in step 305 to guide the user to replace cartridge 200. After the user replaces cartridge 200 in step 307, the program returns to step 302, where the new surgical cartridge 200 is connected to the fluid control subsystem 110 of the surgical console 100.

[0076] If it is determined that external light interference is unlikely, console 100 proceeds to barcode decoding in step 303. Subsequently, if barcode decoding is successful during step 301, normal console operation continues in step 308; otherwise, the console generates an external light warning in step 310 to guide the user to remove the external light source or turn the console away from the external light source. After the user resolves the external light in step 312 and clears the warning in step 314, the program returns to steps 304A-F.

[0077] According to certain embodiments, such as Figure 9As seen, step 304A includes image sensor 1004 capturing a grayscale image of the barcode area 289 of surgical cartridge 200 using default or predetermined exposure, gain, and frame rate in step 338, while the internal visible light sources 1006a-d and infrared light source 1030 remain off. According to some embodiments, image sensor 1004 has a default exposure of 0.5 ms, a gain of 3.0x, and a frame rate of 60 frames per second. Next, computer 103 within surgical console 100 processes and records the intensity or luminance value of each pixel of the grayscale image in this step, i.e., each pixel has a recorded value between zero or black and 255 or white. Then, computer 103 calculates the average pixel luminance value of the entire grayscale image in step 340, and then compares the calculated value with a predetermined threshold stored in computer 103 in step 342. If the calculated average value is equal to or greater than the threshold, external light interference has been detected, and in step 310 (e.g., via the display screen 104 of the surgical console 100), an alert (or warning notification), warning, image, or message is sent to the user, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if the calculated average value is less than a predetermined threshold, then no external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as shown. Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0078] According to certain embodiments, such as Figure 10 As seen, step 304B includes image sensor 1004 capturing a limited number of consecutive grayscale frames of the barcode region 289 of surgical box 200 in step 344. For example, according to one embodiment, image sensor 1004 captures a sequence of sixteen (16) consecutive frames. The specific number of consecutive images represents the persistence of external light conditions over its duration. For example, 16 frames divided by 60 frames / second represents a total time of 0.267 seconds. Figure 9 Compared to a single-image method, using a limited number of images to check for external light interference can filter out transient conditions that might be detected on a single image. In step 346, the computer 103 within the surgical console 100 calculates the average pixel brightness value for each image, and then in step 348 compares each of the calculated average pixel brightness values ​​with a predetermined threshold stored in the computer 103. If all calculated averages are equal to or greater than the threshold, external light interference has been detected, and in step 310, an alert (or warning notification), warning, image, or message is sent to the user, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if all calculated averages are less than a predetermined threshold, then no external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as shown. Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. If the calculated average pixel brightness value of some, but not all, images is equal to or greater than a predetermined threshold, then external light interference is unlikely, and image sensor 1004 is allowed to decode barcode 1016 in step 303, as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0079] According to certain embodiments, such as Figure 11 As seen, step 304C includes image sensor 1004 capturing a large number of consecutive grayscale images of the barcode region 289 of surgical box 200 in step 316. For example, according to one embodiment, image sensor 1004 captures a sequence of 120 consecutive frames. The specific number of consecutive images indicates the permanent or periodic presence of external light conditions within their duration. For example, 120 frames divided by 60 frames / second represents a total time of 2 seconds. Figure 9 Single image method and Figure 10 Compared to methods using a limited number of images, using a large number of images to check for external light interference is more likely to detect external light conditions that exist in the form of short pulses but cyclically occur over a prolonged period of time. Therefore, these external light conditions are unlikely to be detected in a short analysis period, such as IR remote controls with a certain switching frequency. In step 318, computer 103 calculates the average pixel brightness value for each of the plurality of grayscale images, and then in step 320 compares each of the calculated average pixel brightness values ​​with a predetermined threshold stored in computer 103. If all calculated averages are equal to or greater than the threshold, external light interference has been detected, and in step 310, an alert (or warning notification), warning, image, or message, such as [example message would be inserted here], is sent to the user. Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if all calculated averages are less than a predetermined threshold, then no external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as shown. Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0080] According to some embodiments, if the calculated average of some, but not all, images is equal to or greater than a predetermined threshold, computer 103 determines in step 319 whether a repetitive or cyclical pattern exists, i.e., the calculated average repeatedly crosses the predetermined threshold. If an alternating pattern of the calculated average repeatedly crossing the predetermined threshold exists, external light interference exists, and a warning is generated for the user in step 310, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. If no pattern exists where the calculated average repeatedly crosses a predetermined threshold, then, according to some embodiments, computer 103 counts the number of frames in each group of consecutive frames having an average pixel brightness value equal to or greater than the predetermined threshold in step 323, and compares the frame count with a predetermined limit (e.g., 16 frames). If at least one such group has a frame count equal to or greater than the predetermined limit, external light interference is detected, and a warning is generated in step 310, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. If the frame count for all such groups is not equal to or greater than a predetermined limit, external light interference is unlikely, and the surgical console 100 is allowed to proceed to barcode decoding in step 303, as shown. Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0081] According to certain embodiments, such as Figure 12A As seen, step 304D includes image sensor 1004 capturing a grayscale image of the barcode region 289 of surgical cartridge 200 in step 328. Computer 103 within surgical console 100 records and processes the intensity or luminance value of each pixel of the image in step 330. Then, in step 332, computer 103 compares the luminance value of each pixel with a predetermined threshold stored within computer 103. According to some embodiments, the predetermined threshold is 10. Next, according to some embodiments, in step 334, a distribution map of all pixels that have been determined to have luminance values ​​equal to or greater than the predetermined threshold is generated. Then, in step 336, computer 103 determines whether the generated distribution map contains any regions that are individually larger than a predetermined size limit. For example, as... Figure 12B As seen in the illustration, an exemplary image of barcode region 289 is shown, wherein a locally bright region 335 of a pixel has been determined to have a pixel brightness value greater than a predetermined threshold and an area or size greater than a predetermined size limit. According to some embodiments, the predetermined size limit is a region size of 5 pixels × 5 pixels. Small external light spots (e.g., bright regions 335 equal to or smaller than 5 pixels × 5 pixels, such as...) Figure 12CThe external light spot (as seen in the image) does not affect barcode decoding because the decoding process allows for a predetermined degree of distortion or damage to the barcode pattern. Small external light spots have no practical impact on fluid level sensing because the level sensor algorithm is designed to be robust enough to handle low levels of noise, such as small bubbles similar to the external light spot.

[0082] By mapping the distribution of external light regions identified as exceeding a size threshold, the current method detects local external light spots that may interfere with the proper functioning of the image sensor 1004. Otherwise, these local external light spots would be missed when averaging the pixel brightness values ​​across the entire image, as the impact of finite-sized external light spots on the overall average pixel brightness value of the entire image is negligible through averaging. If at least one region within the generated distribution map is individually larger than a predetermined size limit, external light interference has been detected, and in step 310, an alert (or warning notification), warning, image, or message is generated for the user, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if none of the regions within the generated distribution map individually exceed a predetermined size limit, then external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as follows. Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0083] In one embodiment, such as Figure 13 As seen, step 304E includes image sensor 1004 capturing a limited number of grayscale images of the barcode area 289 of surgical cartridge 200 in step 350. For example, according to one embodiment, image sensor 1004 captures a sequence of sixteen (16) consecutive frames. The specific number of consecutive images represents the persistence of external light conditions over its duration. For example, 16 frames divided by 60 frames / second represents a total time of 0.267 seconds. In step 352, computer 103 within surgical console 100 records and processes the intensity or luminance of each pixel in each of the limited number of images. Then, in step 354, computer 103 compares the luminance value of each pixel in each image with a predetermined threshold stored in computer 103. According to some embodiments, the predetermined threshold is 10.

[0084] Next, according to some embodiments, in step 356, a distribution map of all pixels that have been determined to have a brightness value equal to or greater than a predetermined threshold is generated for each of a finite number of images. Then, in step 358, computer 103 determines whether the distribution map generated for each image contains any region that is individually larger than a predetermined size limit. According to some embodiments, the predetermined size limit is a region size of 5 pixels × 5 pixels. If each image contains at least one distribution map marker region that is individually larger than the predetermined size limit, external light interference has been detected, and in step 310, an alert (or warning notification), warning, image, or message is generated for the user, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if none of the images contain at least one distribution map marker area that is individually larger than a predetermined size limit, then no external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as follows. Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. If some, but not all, images have at least one individual distribution map marker area larger than a predetermined size limit, external light interference is less likely, and image sensor 1004 is allowed to decode barcode 1016 in step 303, as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0085] In one embodiment, such as Figure 14 As seen, step 304F includes image sensor 1004 capturing a large number of consecutive grayscale images of the barcode region 289 of surgical box 200 in step 360. For example, according to one embodiment, image sensor 1004 captures a sequence of 120 consecutive frames. The specific number of consecutive images indicates the permanent or periodic presence of external light conditions within their duration. For example, 120 frames divided by 60 frames / second represents a total time of 2 seconds. Figure 9 and Figure 12A Single image method and Figure 10 and Figure 13Compared to a limited number of images, using a large number of images to test or examine external light interference is more likely to detect external light conditions that exist in the form of short pulses but cyclically occur over a prolonged period of time, and therefore are less likely to be detected in a shorter analysis period. In step 362, the computer 103 within the surgical console 100 records and processes the intensity or luminance value of each pixel in each of a large number of grayscale images. Then, in step 364, the computer 103 compares the luminance value of each pixel with a predetermined threshold stored within the computer 103. According to some embodiments, the predetermined threshold is 10.

[0086] Next, according to some embodiments, in step 366, a distribution map of all pixels that have been determined to have a brightness value equal to or greater than a predetermined threshold is generated for each of a large number of images. Then, in step 368, computer 103 determines whether the distribution map generated for each image contains any region that is individually larger than a predetermined size limit. According to some embodiments, the predetermined size limit is a region size of at least 5 pixels × 5 pixels. If each image contains at least one distribution map marker region that is individually larger than the predetermined size limit, external light interference has been detected, and in step 310, an alert (or warning notification), warning, image, or message is generated for the user, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. Alternatively, if none of the images contain at least one distribution map marker area that is individually larger than a predetermined size limit, then no external light interference has been detected, and the image sensor 1004 is then permitted to decode the barcode 1016 in step 306, as follows. Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0087] According to some embodiments, if some, but not all, of a large number of images include at least one distribution map marker region that is individually larger than a predetermined size limit, then in step 372, computer 103 determines whether a repetitive or cyclical pattern exists in the large number of consecutive frames, i.e., images with and without at least one distribution map marker region that is individually larger than the predetermined size limit appear alternately. If such a pattern exists, external light interference exists, and an alert is sent to the user in step 310, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8The illustrated subsequent procedure steps. If this mode does not exist, according to some embodiments, in step 374, computer 103 counts the number of frames in each group of consecutive frames having at least one individually larger than a predetermined size limit area. If the frame count of at least one such group is equal to or greater than a predetermined limit (e.g., 16), external light interference exists, and an alert is sent to the user in step 310, such as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The illustrated subsequent procedure steps. However, if the frame count of such a group is less than a predetermined limit, the presence of external light is unlikely, and the image sensor 1004 is allowed to decode the barcode 1016 in step 303, as... Figure 8 As seen in the image. Then, the user continues... Figure 8 The following steps are illustrated in the diagram.

[0088] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 400 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 15A As seen in the flowchart. The procedure 400 begins at step 402, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 404, with the visible light sources 1006a-d on and the infrared light source 1030 off, the surgical console 100 attempts to decode the barcode 1016. If the barcode 1016 is successfully decoded, the surgical console 100 continues with the normal operating procedure in step 412. If the barcode 1016 is not decoded, for example when the external light spot 414 interferes with the barcode 1016 (e.g. Figure 15B (As seen in the image), in step 406, the visible light sources 1006a-d are turned off and the image sensor 1004 is enabled in order to perform a test to detect any external light that may have inadvertently shone on the surgical box 200.

[0089] According to some embodiments, the test or inspection for external light interference performed in step 406 is Figures 9 to 14 Any of the procedures 304A-F shown and described above. According to some other embodiments, step 406 includes actions performed relative to each other in any order. Figures 9 to 14 More than one of the procedures 304A-F shown. If in step 406... Figures 9 to 14If at least one of the procedures 304A-F shown detects external light interference, an ambient light warning is generated for the user in step 408 to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 411 and clears the warning in step 415, the program returns to step 404 to decode the barcode. However, if in step 406... Figures 9 to 14 If at least one of the selected programs (304A-F) detects no external light interference, a barcode failure warning is generated for the user in step 410. After the user replaces the cartridge in step 413, the program returns to step 402, in which the new cartridge is connected to the fluid control subsystem 110 of the surgical console 100.

[0090] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 500 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 16 As seen in the flowchart. The procedure begins at step 502, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 504, with the visible light sources 1006a-d on and the infrared light source 1030 off, the surgical console 100 attempts to decode the barcode 1016. If the barcode 1016 is successfully decoded, the surgical console 100 continues with the normal operating procedure in step 512. If the initial decoding of the barcode 1016 fails (i.e., the initial attempt is unsuccessful), in step 506, the surgical console 100 attempts to decode the barcode 1016 a predetermined number of times or rounds. According to some embodiments, step 506 includes the surgical console 100 attempting to decode the barcode 1016 at least six times. According to some embodiments, the exposure and / or gain of the image sensor 1004, the power or intensity of the visible light sources 1006a-d, and / or the decoding workload level of the algorithm used to decode the barcode 1016 may vary or be adjusted between subsequent attempts. If the barcode 1016 is successfully decoded in step 506, the surgical console 100 continues with normal operating procedures in step 512. However, if the barcode 1016 cannot be decoded after a predetermined number of attempts, in step 508, the visible light sources 1006a-d are turned off and the image sensor 1004 is enabled to perform a test to detect any external light that may have inadvertently illuminated the surgical cassette 200.

[0091] According to some embodiments, the test or inspection for external light interference performed in step 508 is Figures 9 to 14Any of the procedures 304A-F shown and described above. According to some other embodiments, step 508 includes actions performed relative to each other in any order. Figures 9 to 14 More than one of the procedures 304A-F shown. If in step 508... Figures 9 to 14 If at least one of the procedures 304A-F shown detects external light interference, an external light warning is generated for the user in step 510 to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 513 and clears the warning in step 517, the program returns to step 504 to decode the barcode. However, if in step 508... Figures 9 to 14 If at least one of the selected programs (304A-F) detects no external light interference or determines that external light interference is unlikely, a barcode failure warning is generated for the user in step 514. After the user replaces the cartridge in step 515, the program returns to step 502, in which the new cartridge is connected to the fluid control subsystem 110 of the surgical console 100.

[0092] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 600 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 17A As seen in the flowchart. The procedure begins at step 602, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 604, the surgical console 100 successfully decodes the barcode 1016 while the visible light sources 1006a-d are turned on and the infrared light source 1030 remains off. Subsequently, in step 606, the visible light sources 1006a-d are turned off and the image sensor 1004 is enabled to perform a test to detect any external light that may have inadvertently shone onto the surgical cartridge 200.

[0093] According to some embodiments, the test or inspection for external light interference performed in step 606 is Figures 9 to 14 Any of the procedures 304A-F shown and described above. According to some other embodiments, step 606 includes actions performed relative to each other in any order. Figures 9 to 14 More than one of the procedures 304A-F shown. If in step 606... Figures 9 to 14 At least one of the procedures 304A-F shown detects external light interference, for example, when external light spot 612 interferes with fluid level window 1044 (e.g. Figure 17BIf (as seen in the image), then in step 608 an external light warning is generated for the user to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 611 and clears the warning in step 613, the program returns to step 606. However, if in step 606, by... Figures 9 to 14 If at least one of the procedures selected in 304A-F as shown detects no external light interference or determines that external light interference is unlikely, the surgical console 100 continues with the normal operating procedure in step 610. By performing a check for external light interference in step 606 after successfully decoding the barcode 1016 in step 604, it is ensured that there is no external light anywhere within the barcode area 289 of the surgical cartridge 200 (including the fluid level window 1044, which is offset relative to the barcode 1016 or located in a separate area).

[0094] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 700 for coupling and connecting the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, such as... Figure 18 As seen in the flowchart. The procedure begins at step 702, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 704, the surgical console 100 successfully decodes the barcode 1016 while the visible light sources 1006a-d are on and the infrared light source 1030 remains off. Subsequently, in step 706, the surgical console 100 attempts to calibrate the fluid level sensor function of the LSBR 1002 against the fluid level window 1044 within the barcode area 289. According to some embodiments, this calibration is required to determine the position and size of the fluid level window 1044, and, with exposure and LED power / current fixed, the illumination intensity of the image sensor 1004, expressed as a gain value. If the calibration is successful, the surgical console continues with normal operating procedures in step 708. However, if the calibration in step 706 fails, the visible light sources 1006a-d and the infrared light source 1030 are turned off and the image sensor 1004 is enabled so that a test can be performed in step 710 to detect any external light that may have inadvertently shone on the surgical box 200.

[0095] According to some embodiments, the test or inspection for external light interference performed in step 710 is Figures 9 to 14 Any of the procedures 304A-F shown and described above. According to some other embodiments, step 710 includes execution relative to each other in any order. Figures 9 to 14More than one of the procedures 304A-F shown. If in step 710... Figures 9 to 14 If at least one of the procedures 304A-F shown detects external light interference, an ambient light warning is generated for the user in step 712 to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 715 and clears the warning in step 717, the procedure returns to step 706 to calibrate the fluid level sensor. However, if in step 710... Figures 9 to 14 If at least one of the procedures selected in 304A-F as shown detects no external light interference or determines that external light interference is unlikely, then the computer 103 of the surgical console 100 applies the factory calibration results / parameters stored in the memory of the LSBR 1002 in step 713, and then continues with the normal operating procedure in step 708. Calibration may fail if external light is present in or near the fluid level window 1044. It is possible that factors other than external light may also cause calibration failure; for example, the surgical cartridge 200 may have been filled with fluid when it is reused. In this case, the size and location of the fluid level window 1044 cannot be determined, and therefore the less accurate factory calibration results and parameters stored in the memory of the LSBR 1002 are required.

[0096] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 800 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 19As seen in the flowchart. The procedure begins at step 802, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 804, the surgical console 100 successfully decodes the barcode 1016. Subsequently, in step 806, the surgical console 100 successfully calibrates the fluid level sensor function of the LSBR 1002 with reference to the fluid level window 1044. According to some embodiments, after decoding the barcode 1016 and calibrating the fluid level sensor, and other actions, the basic setup of the surgical console 100 is completed, and then the surgical console 100 enters a standby mode in step 808, in which the visible light sources 1006a-d are turned off and the infrared light source 1030 is turned on to continuously track and report the current fluid level within the fluid level window 1044 in real time. In step 810, while still in standby mode, the infrared light source 1030 is periodically turned off and the image sensor 1004 is enabled to perform a test to detect any external light that may inadvertently illuminate the surgical cassette 200. According to some embodiments, "periodically" or "periodically" refers to a pre-selected duration scheduled or otherwise executed according to a predetermined schedule or command issued by the surgical console 100. According to some embodiments, "continuous" or "uninterrupted" refers to the continuous or uninterrupted execution of a task.

[0097] According to some embodiments, the test or inspection for external light interference performed in step 810 is Figures 9 to 14 Any of the procedures 304A-F shown and described above. According to some other embodiments, step 810 includes actions performed relative to each other in any order. Figures 9 to 14 More than one of the procedures 304A-F shown. If in step 810... Figures 9 to 14 If at least one of the procedures 304A-F shown detects external light interference, an external light warning is generated for the user in step 812 to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 811 and clears the warning in step 813, the program returns to step 808, actively tracking and reporting the fluid level in standby mode. However, if in step 810... Figures 9 to 14 If at least one of the selected procedures in 304A-F detects no external light interference or determines that external light interference is unlikely, the surgical console 100 continues with the normal operating procedure in step 814.

[0098] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 900 for coupling and connecting the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, such as... Figure 20 As seen in the flowchart. The procedure begins at step 902, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. Then, in step 904, the surgical console 100 successfully decodes the barcode 1016. Subsequently, in step 906, the surgical console 100 successfully calibrates the fluid level sensor function of the LSBR 1002 with reference to the fluid level window 1044. According to some embodiments, after decoding the barcode 1016 and calibrating the fluid level sensor, and other actions, the basic setup of the surgical console 100 is completed, and then the surgical console 100 enters surgical mode in step 908, wherein the visible light sources 1006a-d are turned off and the infrared light source 1030 is turned on, so that the current fluid level within the fluid level window 1044 can be continuously tracked and reported in real time during surgery in step 908. In step 910, while still in surgical mode, the infrared light source 1030 is periodically turned off and the image sensor 1004 is enabled in order to perform a test to detect any external light that may inadvertently shine on the surgical box 200.

[0099] According to some embodiments, the tests or checks against external light interference performed in step 910 are respectively as follows: Figure 9 And any one or both of procedures 304A and 304D shown in Figure 12 and described above. Since the surgical console 100 is in active surgical mode, only as shown in Figure 12, Figure 9Procedure 304A, as seen in Figure 12, or procedure 304D, as seen in Figure 12, are feasible because they are used to analyze a single image. This is because analyzing multiple consecutive frames for a long duration to check for external light with the infrared light source 1030 off would essentially disable the fluid level sensor, as the fluid level window 1044 would not be visible within the same number of consecutive images or the same duration, resulting in a loss of the ability to track real-time fluid levels during surgery. Conversely, a single image checks for external light interference quickly enough to be inserted between normal frames of the barcode area 289, or in some other embodiments, a single normal frame of the barcode area 289 can be periodically replaced without interfering with continuous tracking of the fluid level. According to some embodiments, the image sensor 1004 is set to have an exposure of 0.5 ms, a gain of 3.0x, and a frame rate of 60 frames per second, which makes the total available time for each frame / image 16.667 ms. Therefore, as long as the total time used to capture and process each frame / image, including a 0.5 ms exposure, is less than half of 16.667 ms or 8 ms, an image for checking external light interference can be captured between two normal fluid level tracking images of barcode area 289.

[0100] According to some embodiments, step 910 includes actions performed relative to each other in any order. Figure 9 And the procedures 304A and 304D shown in Figure 12. If in step 910... Figure 9 If at least one of the procedures 304A or 304D shown in Figure 12 detects external light interference, an ambient light warning is generated for the user in step 912 to guide the user to remove the external light source and / or turn the surgical console 100 away from the external light source. After the user resolves the external light in step 907 and clears the warning in step 909, the program returns to step 908 to actively track and report the fluid level in surgical mode. However, if in step 910... Figure 9 If at least one of the procedures 304A and 304D shown in Figure 12 detects no external light interference, the surgical console 100 continues the normal operating procedure in step 914.

[0101] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into program 1100 for coupling and connecting the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, such as... Figure 21AAs seen in the flowchart. The procedure begins in step 1102, where the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. Then, in step 1104, the surgical console 100 successfully decodes the barcode 1016. Subsequently, in step 1106, the surgical console 100 successfully calibrates the fluid level sensor function of the LSBR 1002 with reference to the fluid level window 1044.

[0102] According to some embodiments, after decoding barcode 1016 and calibrating the fluid level sensor, as well as other actions, the basic setup of the surgical console 100 is completed, and then the surgical console 100 enters a standby mode or surgical mode in step 1108, wherein the visible light sources 1006a-d are turned off and the infrared light source 1030 is turned on to continuously track and report the current fluid level within the fluid level window 1044 in real time. When capturing and processing a continuous series of live frames or images of the barcode area 289 in step 1103 for fluid level tracking and reporting, according to some embodiments, an inspection area 1112 defined within the barcode area 289 is processed for each frame to check for external light interference. The inspection area 1112 is outside or away from both the barcode 1016 and the fluid level window 1044, and is typically dark during standby or surgical operations, thereby increasing the likelihood of detecting external light within it. For example, according to some embodiments, Figure 21B The defined inspection area 1112 is shown above the barcode 1016 and to the left of the fluid level window 1044.

[0103] In step 1110, computer 103 calculates the average pixel brightness value of the defined inspection area 1112 for each frame or image. According to some embodiments, steps 1108 and 1110 occur simultaneously, such that active real-time tracking of the fluid level within the fluid level window 1044 is performed while checking for external light interference. In step 1114, the calculated average pixel brightness value of the defined inspection area for each image is then compared to a predetermined threshold stored in computer 103. According to some embodiments, the predetermined threshold is 10. In step 1105, if the average pixel brightness values ​​of all inspection areas for any frame are not equal to or greater than the predetermined threshold, there is no external light interference, and the surgical console 100 then continues with normal operating procedures in step 1122. Alternatively, in step 1105, if there are inspection areas with calculated average pixel brightness values ​​equal to or greater than the threshold, then in step 1109, computer 103 compares the frame count of each group of consecutive frames having such average pixel brightness values ​​equal to or greater than the predetermined threshold with a predetermined quantity limit (e.g., 16). If any such frame count is equal to or greater than a predetermined limit, external light interference has been detected, and an alert image or message is sent to the user in step 1116. Simultaneously, the surgical console 100 (if in surgical mode) automatically suspends console operations related to fluid levels in step 1115. After the user resolves the external light in step 1117 and clears the alert in step 1119, the program returns to step 1108. Alternatively, if none of these frame counts are equal to or greater than the predetermined limit, in step 1120, the computer 103 determines whether an alternating pattern exists, i.e., the average pixel brightness value of the inspected area alternately crosses a threshold between high and low values.

[0104] According to some embodiments, if computer 103 detects this alternating pattern in step 1120, external light interference has been detected, and an alert image or message is sent to the user in step 1116. Simultaneously, surgical console 100 (if in surgical mode) automatically suspends console operations related to fluid levels in step 1115. After the user resolves the external light in step 1117 and clears the alert in step 1119, the program returns to step 1108. Alternatively, if this alternating pattern is not detected in step 1120, external light interference is unlikely, and surgical console 100 continues with normal operating procedures in step 1122. Figure 21CThe illustration shows a case where a large area of ​​external light 1118 exists within the defined inspection area 1112. The brightness and size of the external light 1118 cause the average pixel brightness value of the inspection area 1112 to rise above a predetermined limit. Therefore, if the external light 1118 persists for a minimum of consecutive frames (e.g., 16), or if the external light 1118 operates in a persistent on / off mode, this method of detecting external light interference according to the present invention will detect and determine it as external light interference.

[0105] According to some embodiments, the method of the present invention for detecting external light interference is incorporated into a program 1200 for coupling and connecting the surgical cartridge 200 to a fluid control subsystem 110 of the surgical console 100, such as... Figure 22A As seen in the flowchart. The procedure begins at step 1202, in which the user connects the surgical cartridge 200 to the fluid control subsystem 110 of the surgical console 100, aligning the barcode area 289 with the window 290 of the LSBR 1002 in the surgical console 100. In step 1204, the surgical console 100 successfully decodes the barcode 1016. Subsequently, in step 1206, the surgical console 100 successfully calibrates the fluid level sensor function of the LSBR 1002 with reference to the fluid level window 1044. According to some embodiments, after decoding the barcode 1016 and calibrating the fluid level sensor, as well as other actions, the basic setup of the surgical console 100 is completed, and then the surgical console 100 enters a standby mode or surgical mode in step 1208, in which the visible light sources 1006a-d are turned off and the infrared light source 1030 is turned on to continuously track and report the current fluid level within the fluid level window 1044 in real time.

[0106] When capturing and processing continuous live frames or images of the barcode area 289 in step 1203 for fluid level tracking and reporting, according to some embodiments, an inspection area 1112 is defined within the barcode area 289 of each frame being processed. The inspection area 1112 is outside or away from both the barcode 1016 and the fluid level window 1044, and is typically dark during standby or surgical operations, thereby increasing the likelihood of detecting external light within it. For example, according to some embodiments, Figure 22BA defined inspection area 1112 is shown above barcode 1016 and to the left of fluid level window 1044. In step 1210, computer 103 records and processes the luminance value of each pixel contained within the defined inspection area 1112 for each frame or image. According to some embodiments, steps 1208 and 1210 occur simultaneously, such that active real-time tracking of the fluid level within fluid level window 1044 is performed while checking for external light interference. In step 1205, the luminance value of each pixel in inspection area 1112 is then compared with a predetermined threshold stored in computer 103.

[0107] Next, according to some embodiments, in step 1216, a distribution map of all pixels in inspection region 1112 that have been determined to have a brightness value equal to or greater than a predetermined threshold is generated for each image. Then, in step 1218, computer 103 determines whether the generated distribution map corresponding to each image contains any region that is individually larger than a predetermined size limit. For example, as Figure 22B As seen in the image, an exemplary image of barcode area 289 is shown, wherein a locally bright region 1214 of pixels identified as having a pixel brightness value greater than a predetermined threshold is located within inspection area 1112. The locally bright region 1214 has a relatively large area or size exceeding a predetermined size limit. According to some embodiments, the predetermined size limit is an area size of at least 5 pixels × 5 pixels. If none of the images contain at least one such distribution map marked region, there is no external light interference, and the surgical console 100 continues normal operating procedures in step 1224. If an image with at least one such distribution map marked region exists, in step 1209, the computer 103 compares the frame count of each group of consecutive frames containing such distribution map marked regions with a predetermined quantity limit (e.g., 16). If any such frame count is equal to or greater than the predetermined quantity limit, external light interference has been detected, and an alert image or message is sent to the user in step 1222, while the surgical console 100 (if in surgical mode) automatically suspends console operations related to fluid levels in step 1215. After the user resolves the external light issue in step 1217 and clears the warning in step 1219, the program returns to step 1208. Alternatively, if none of these frame counts are equal to or greater than a predetermined limit, then in step 1226, the computer 103 determines whether there exists a pattern of alternating images with and without such distribution map marked areas.

[0108] According to some embodiments, if computer 103 detects this alternating pattern in step 1226, external light interference has been detected, and an alert image or message is sent to the user in step 1222. Simultaneously, surgical console 100 (if in surgical mode) automatically suspends console operations related to fluid levels in step 1215. After the user resolves the external light in step 1217 and clears the alert in step 1219, the program returns to step 1208. Alternatively, if this alternating pattern is not detected in step 1226, external light interference is unlikely, and surgical console 100 continues with normal operating procedures in step 1224.

[0109] According to some embodiments, in the method for checking external light interference of the present invention, a predetermined pixel brightness value threshold can be adjusted or changed based on the exposure and / or gain settings of the image sensor 1004, and / or the power or current flowing through the visible light sources 1006a-d and / or the infrared light source 1030 (if turned on if necessary). Since the pixel brightness value is directly affected by exposure, gain, and illuminance, the higher the exposure, gain, or illuminance, the higher the resulting pixel brightness value. According to some embodiments, for the image sensor 1004 to operate correctly for decoding barcodes and performing fluid level sensing, one of these three factors is adjustable, while the other two are fixed. For example, according to some embodiments where gain is an adjustable variable, the pixel brightness value threshold (T) is proportional to the gain value (G). In another embodiment, the pixel brightness value threshold (T) is determined according to a polynomial equation and / or a table that increases the threshold (T) as the gain value (G) increases. Examples of polynomial equations and tables are given below.

[0110] T = 0.75G^2 – 0.75G + 55

[0111] Table 1:

[0112] The gain value is set during fluid level sensor calibration and is based on the average pixel brightness value when the fluid level window 1044 is empty while the power / current levels in the exposure and infrared light source 1030 remain constant. Similarly, in other embodiments, the pixel brightness value threshold (T) may be proportional to the exposure or illumination power rather than the gain value (G) and may be determined according to a polynomial equation and / or according to a table where the exposure or illumination power is a variable.

[0113] Accordingly, this paper provides an improved ophthalmic surgical box, a device for reading images by an image sensor located within a surgical console, and a method of using the same.

[0114] The foregoing description is provided to enable any person skilled in the art to practice the various embodiments described herein. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be applied to other embodiments. Therefore, the claims are not intended to limit them to the embodiments shown herein, but are given the full scope consistent with the language of the claims.

[0115] Some features described in the context of individual embodiments in this specification may also be implemented in combination in a single embodiment. Conversely, different features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments. Furthermore, while features previously described may be described as functioning in certain combinations, or even initially claimed in this manner, in some cases one or more features from the claimed combination may be separated from that combination, and the claimed combination may be for sub-combinations or variations thereof.

[0116] Specific embodiments of this subject matter have been described. As will be apparent to those skilled in the art, other embodiments, modifications, and variations thereof are within the scope of the following claims. Although operations are depicted in a specific order in the drawings or claims, this should not be construed as requiring such operations to be performed in the specific order shown or in a sequential order, nor as requiring the performance of all illustrated operations (some operations may be considered optional) to achieve the desired result. In some cases, multitasking or parallel processing (or a combination of multitasking and parallel processing) may be advantageous and may be implemented as appropriate as needed.

[0117] Furthermore, the separation or integration of various system modules and components in the previously described embodiments should not be construed as requiring such separation or integration in all embodiments. It should be understood that the described program components and systems can typically be integrated together in a single software product or packaged into multiple software products.

[0118] Therefore, the exemplary embodiments described above do not limit or restrict this disclosure. Other changes, substitutions, and modifications are possible without departing from the spirit and scope of this disclosure.

[0119] Although the steps of the embodiment methods or processes are presented and described sequentially, those skilled in the art will understand that some or all of the steps may be performed in a different order, may be combined or omitted, and some or all of the steps may be performed in parallel. These steps may be performed actively or passively. The method or process may be repeated or extended to support multiple components or multiple users within a field environment. Therefore, the scope should not be considered limited to the specific arrangement of steps shown in the flowchart or diagram.

[0120] Unless otherwise defined, all technical and scientific terms used have the same meaning as commonly understood by one of ordinary skill in the art to which these systems, devices, methods, processes and compositions pertain.

[0121] In this disclosure, the terms “top,” “bottom,” “side,” “above,” “below,” “up,” “down,” “upward,” “downward,” “horizontal,” and “vertical” do not refer to absolute directions. Rather, these terms refer to directions relative to a non-specific reference plane. This non-specific reference plane can be vertical, horizontal, or have other angular orientations.

[0122] Unless the context clearly indicates otherwise, the singular forms “a,” “one,” and “the” include plural references. In the claims, unless specifically stated otherwise, references to the singular element are not intended to mean “one and only one,” but rather “one or more.” Unless specifically stated otherwise, the term “some” means one or more.

[0123] The embodiments disclosed herein may suitably “include,” “consist of,” or “substantially constitute of” the disclosed restrictive features, and may be practiced in the absence of any undisclosed restrictive features. As used herein and in the appended claims, the words “comprising,” “having,” and “including,” and all their grammatical variations, are each intended to have an open-ended, non-limiting meaning that does not exclude additional elements or steps.

[0124] "Optional" and "optionally" mean that the material, event, or situation described below may or may not be present or occur. The specification includes examples of the material, event, or situation occurring and examples of the material, event, or situation not occurring.

[0125] As used, the term "determine" encompasses a wide variety of actions. For example, "determine" can include calculation, operation, processing, derivation, investigation, searching (e.g., searching in a table, database, or other data structure), and ascertainment. Furthermore, "determine" can include receiving (e.g., receiving information) and accessing (e.g., accessing data in memory). Moreover, "determine" can include parsing, selecting, picking, and building.

[0126] When the terms “approximately” or “about” are used, the term can mean that the value can vary by up to ±10%, up to 5%, up to 2%, up to 1%, up to 0.5%, up to 0.1%, or up to 0.1%.

[0127] A range can be expressed as from about one particular value to about another particular value (inclusive). When expressing such a range, it should be understood that another embodiment is from one particular value to another, together with all particular values ​​in the range and combinations thereof.

[0128] As used, terms such as “first” and “second” are arbitrarily assigned and are intended only to distinguish two or more components of a system, device, or composition. It should be understood that the terms “first” and “second” serve no other purpose and are not part of the name or description of a component, nor do they necessarily define the relative location or position of the component. Furthermore, it should be understood that the mere use of the terms “first” and “second” does not require the existence of any “third” component, but such a possibility is conceivable within the scope of the various embodiments described.

[0129] As used, "CPU," "processor," "at least one processor," or "one or more processors" generally refers to a single processor configured to perform one or more operations, or multiple processors configured to collectively perform one or more operations. In the case of multiple processors, the execution of the one or more operations may be divided among different processors, but a single processor may perform multiple operations, and multiple processors may collectively perform a single operation. Similarly, "memory," "at least one memory," or "one or more memory" generally refers to a single memory configured to store data and / or instructions, or multiple memories configured to collectively store data and / or instructions.

[0130] Although only a few exemplary embodiments have been described in detail, those skilled in the art will readily understand that many modifications may be made to the exemplary embodiments without substantially departing from the scope of the described disclosure. Accordingly, all such modifications are intended to be included within the scope of this disclosure as defined in the appended claims.

Claims

1. A method for detecting external light interference within a surgical box, the method comprising: After the barcode area of ​​the surgical box has been aligned with the image sensor of the surgical console, the image sensor is used to check for external light interference within the barcode area. If no external light interference is detected or is unlikely to exist within the barcode area, attempt to decode the barcode within the barcode area, or If external light interference is detected within the barcode area, a first warning notification is generated for the user.

2. The method as described in claim 1, wherein, Attempting to decode the barcode within the barcode area includes: If the barcode is successfully decoded, input from the user for operating the surgical console is permitted; or If the barcode is not successfully decoded, a second alert notification is generated for the user.

3. The method of claim 1, further comprising: Receive input from the user for clearing the first alert notification; as well as The external light interference within the barcode area is re-examined using the image sensor.

4. The method of claim 1, wherein, Detecting external light interference within the barcode area using the image sensor includes: Capture an image of the barcode area; Calculate the average pixel brightness value of the image; The calculated average pixel brightness value of the image is compared with a predetermined threshold; and If the calculated average pixel brightness value of the image is lower than the predetermined threshold, then no external light interference or the presence of such external light interference is detected within the barcode area, or If the calculated average pixel brightness value of the image is equal to or higher than the predetermined threshold, then the external light interference is detected within the barcode area.

5. The method of claim 4, further comprising: Capture multiple images of the barcode area; Calculate the average pixel brightness value for each of the plurality of images; The calculated average pixel brightness value of each of the plurality of images is compared with the predetermined threshold. as well as If the calculated average pixel brightness value of each of the plurality of images is lower than the predetermined threshold, then no external light interference or the external light interference is unlikely to exist within the barcode area, or If the calculated average pixel brightness value of each of the plurality of images is equal to or higher than the predetermined threshold, then the external light interference is detected within the barcode area.

6. The method of claim 5, further comprising: If the calculated average pixel brightness of at least one of the plurality of images is equal to or higher than the predetermined threshold, then it is determined whether there is a pattern in which the calculated average pixel brightness values ​​of the plurality of images repeatedly cross the predetermined threshold. If there exists a pattern where the calculated average pixel brightness value of the multiple images repeatedly crosses the predetermined threshold, then the external light interference is detected within the barcode area, or If there is no pattern in which the calculated average pixel brightness value of the multiple images repeatedly crosses the predetermined threshold: Record the number of consecutive frame images within the plurality of images that have an average pixel brightness value equal to or higher than the predetermined threshold; The number of consecutive frame images with an average pixel brightness value equal to or higher than the predetermined threshold within the plurality of images is compared with a predetermined quantity limit; as well as If the number of consecutive frame images with an average pixel brightness value equal to or higher than the predetermined threshold is equal to or higher than the predetermined quantity limit, then the external light interference is detected within the barcode area, or If the number of consecutive frame images with an average pixel brightness value equal to or higher than the predetermined threshold is less than the predetermined quantity limit, then no external light interference or the external light interference is unlikely to exist within the barcode area.

7. The method of claim 1, wherein, Detecting external light interference within the barcode area using the image sensor includes: Capture an image of the barcode area; Record the brightness value of each pixel within the image; The brightness value of each pixel in the image is compared with a predetermined threshold; Generate a distribution map including pixels with brightness values ​​equal to or higher than the predetermined threshold; and If the generated distribution map does not include any distribution map marker areas containing pixels with brightness values ​​equal to or higher than the predetermined threshold that are larger than the predetermined size limit, then no external light interference or the presence of such external light interference is detected within the barcode area, or If the generated distribution map includes a distribution map marking area containing at least one pixel with a brightness value equal to or higher than the predetermined threshold that is larger than the predetermined size limit, then the external light interference is detected within the barcode area.

8. The method of claim 7, further comprising: Capture multiple images of the barcode area; Record the brightness value of each pixel within each of the plurality of images; The brightness value of each pixel within each of the plurality of images is compared with a predetermined threshold; For each of the plurality of images, a distribution map is generated including pixels with brightness values ​​equal to or higher than the predetermined threshold; as well as If none of the generated distribution maps include a distribution map marker area containing at least one pixel with a brightness value equal to or higher than the predetermined threshold that is larger than the predetermined size limit, then no external light interference or the presence of such external light interference is detected within the barcode area. If each generated distribution map includes a distribution map marker area containing at least one pixel with a brightness value equal to or higher than the predetermined threshold that is greater than the predetermined size limit, then the external light interference is detected within the barcode area.

9. The method of claim 8, further comprising: If at least one generated distribution map includes a distribution map marker region containing at least one pixel with a brightness value equal to or higher than the predetermined threshold that is greater than the predetermined size limit, then it is determined whether there exists a pattern of alternating distribution map regions containing at least one pixel with a brightness value equal to or higher than the predetermined threshold that is greater than the predetermined size limit. If the pattern is present, the external light interference is detected within the barcode area, or If the specified mode is not available: For each group of consecutive distribution maps that includes at least one pixel with a brightness value equal to or higher than the predetermined threshold and a distribution map marking region that is greater than the predetermined size limit, the number of frames recorded is counted. Compare the frame count for each group with a predetermined quantity limit; and If the number of frames counts exceeds the predetermined limit, the external light interference is detected within the barcode area, or If the total number of frames is not greater than the predetermined limit, then no external light interference is detected or the external light interference is unlikely to exist within the barcode area.

10. The method of claim 1, further comprising, prior to performing an initial attempt to decode the barcode within the barcode area using the image sensor.

11. The method of claim 10, further comprising, if the initial attempt is unsuccessful, repeatedly attempting to decode the barcode within the barcode area in multiple rounds before checking for external light interference. If the barcode is successfully decoded during at least one of the plurality of rounds, then input from the user for operating the surgical console is permitted, or If the barcode is not successfully decoded during any of the plurality of rounds, an inspection of the barcode area for external light interference is performed using the image sensor.

12. The method of claim 1, further comprising: Before performing the inspection of the barcode area for external light interference using the image sensor, an attempt is made to decode the barcode; After decoding the barcode and before using the image sensor to check for external light interference within the barcode area, attempt to calibrate the fluid level sensor using the fluid level window within the barcode area as a reference. as well as If the attempt to calibrate the fluid level sensor is successful, then no external light interference or the likelihood of such external light interference being present is detected within the barcode area, or If the attempt to calibrate the fluid level sensor is unsuccessful, the image sensor is used to check for external light interference within the barcode area.

13. A method for detecting external light interference within a surgical box, comprising: After aligning the barcode area of ​​the surgical box with the image sensor of the surgical console, the barcode within the barcode area is decoded; The fluid level sensor of the surgical console is calibrated using the fluid level window within the barcode area as a reference. When the surgical console is in standby mode or surgical mode, the fluid level in the fluid level window is monitored; When the surgical console is in standby mode or surgical mode, the image sensor periodically checks for external light interference within the barcode area; as well as If no external light interference is detected within the barcode area, then surgical procedures are initiated via the surgical console, or If external light interference is detected within the barcode area, an alert notification is generated for the user.

14. The method of claim 13, further comprising: When the surgical console is in standby mode or surgical mode, the image sensor continuously checks for external light interference within the barcode area, wherein the continuous checking includes: Capture multiple consecutive live images of the barcode area, each of the multiple live images including a defined inspection area; Calculate the average pixel brightness value of the defined inspection area within each of the plurality of live images; The average pixel brightness value of the defined inspection area within each of the plurality of live images is compared with a predetermined threshold; and If the calculated average pixel brightness value of the defined inspection area within each of the plurality of live images is lower than the predetermined threshold, then no external light interference or the likelihood of external light interference being present is detected within the barcode area. If the calculated average pixel brightness value of the defined inspection area within at least one of the plurality of live images is equal to or higher than the predetermined threshold, then the number of consecutive images within the plurality of live images whose calculated average pixel brightness value of the defined inspection area is equal to or higher than the predetermined threshold is counted. If the number of consecutive images is equal to or greater than a predetermined limit, then the external light interference is detected within the barcode area, or If the number of consecutive frames is less than the predetermined limit, then it is determined whether there exists an alternating pattern in the plurality of live images where the average pixel brightness value of the defined inspection area repeatedly crosses the predetermined threshold. If, within the plurality of live images, the average pixel brightness value of the defined inspection area repeatedly crosses the predetermined threshold, then the external light interference is detected within the barcode area, or If there is no pattern in the plurality of live images where the average pixel brightness value of the defined inspection area repeatedly crosses the predetermined threshold, then no external light interference or the external light interference is unlikely to exist in the barcode area.

15. The method of claim 13, wherein, In the standby mode or the surgical mode, periodically checking the external light interference within the barcode area using the image sensor includes: Capture multiple consecutive live images of the barcode area, each of the multiple live images including a defined inspection area; Calculate the brightness value of each pixel within the defined inspection area for each of the plurality of live images; The brightness value of each pixel within the defined inspection area of ​​each of the plurality of live images is compared with a predetermined threshold. For each of the plurality of live images, generate a distribution map including pixels with brightness values ​​equal to or higher than the predetermined threshold within the defined inspection area; and If none of the plurality of live images include at least one distribution map marker area containing pixels with a brightness value equal to or higher than the predetermined threshold within the defined inspection area that is individually larger than a predetermined size limit, then no external light interference or the presence of such external light interference is detected within the barcode area, or If at least one of the plurality of live images includes a distribution map marker region containing at least one pixel whose individual size is greater than the predetermined size limit and has a brightness value equal to or higher than the predetermined threshold within the defined inspection area, then the number of consecutive images containing distribution map marker regions containing at least one pixel whose individual size is greater than the predetermined size limit and has a brightness value equal to or higher than the predetermined threshold within the defined inspection area is counted. If the number of consecutive images is equal to or greater than a predetermined limit, then the external light interference is detected within the barcode area, or If the number of consecutive frames is less than the predetermined number limit, then it is determined whether there exists an alternating pattern within the plurality of live images where at least one pixel, individually larger than the predetermined size limit, has a brightness value equal to or higher than the predetermined threshold within the defined inspection area, repeatedly crossing the predetermined threshold. If, within the plurality of live images, a pattern exists where a distribution map marking region containing at least one pixel with a brightness value equal to or higher than the predetermined threshold, located within the defined inspection area and having a brightness value equal to or higher than the predetermined threshold, repeatedly crosses the predetermined threshold, then the external light interference is detected within the barcode area. If, within the plurality of live images, there is no pattern in which at least one pixel in the distribution map marking area of ​​the defined inspection area, having a brightness value equal to or higher than the predetermined threshold, repeatedly crosses the predetermined threshold, then no external light interference is detected or the external light interference is unlikely to exist within the barcode area.

Images