Indication system for surgical lighting device

Abstract

The present disclosure provides an indication system of a surgical lighting device, comprising a computer device connectable to a plurality of light modules, wherein the computer device is configured to determine an illuminance setting of each light module of the plurality of light modules, compare the illuminance setting of at least two light modules of the plurality of light modules to at least one output illuminance threshold, and output an indication if the at least one output illuminance threshold is exceeded. The present disclosure also provides a surgical lighting device, an indication method, and a detection system of a surgical lighting device.

Description

Technical Field

[0001] This disclosure relates to an indication system for a surgical lighting device. Specifically, the invention relates to an indication system comprising a computer device connectable to multiple optical modules. This disclosure also relates to a system for determining the overlap of illumination areas of a surgical lighting device. Background Technology

[0002] Surgical lights are used in operating rooms to illuminate the surgical area. IEC 60601-2-41 stipulates that the total irradiance should be minimized, and the total irradiance within the illuminated area should not exceed a specified amount. If the user overlaps the light fields of several illuminators (such as optical modules), it is possible to exceed this irradiance, and this information should be included in the instructions for use (IFU) so that the user can take appropriate measures. This places inherent tasks and obligations on the user. Further assistance to users in this regard is needed. Summary of the Invention

[0003] The present invention provides an indicator system, an surgical lighting device, and an indicator method for a surgical lighting device.

[0004] According to a first aspect of the invention, an indication system for a surgical lighting apparatus is provided. The indication system includes a computer device connectable to a plurality of optical modules. The computer device is configured to: determine an illuminance setting for each of the plurality of optical modules; compare the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold; and if the at least one output illuminance threshold is exceeded, then output an indication.

[0005] It has been found that providing an indication when at least one output illuminance threshold is exceeded offers a better user experience for users such as surgeons. Specifically, such an indication allows for easier compliance with the international surgical lighting standard IEC 60601-2-41. As mentioned above, this standard defines the requirements for surgical lighting technology and stipulates that users should be informed if overlapping of the light modules in a surgical lighting device could lead to exceeding certain irradiance, power, or brightness levels.

[0006] The indication system disclosed herein draws additional attention to the information, but only when at least one output illuminance threshold is exceeded. Thus, the indication system provides guided interaction between the user and the system, and is efficient because it only draws additional attention when the threshold is exceeded.

[0007] In some embodiments, the computer device is configured to: if a plurality of optical modules includes more than two optical modules, then identify two optical modules among the plurality of optical modules that have two maximum illuminance settings. By identifying the two optical modules with two maximum illuminance settings, it is possible to determine whether at least one output illuminance threshold is exceeded based solely on the illuminance settings of these two optical modules. This improves computational efficiency and avoids unnecessary indications.

[0008] In some embodiments, the step of comparing the illuminance settings of at least two optical modules out of a plurality of optical modules with at least one output illuminance threshold may include: combining the illuminance settings of at least two optical modules out of a plurality of optical modules or the illuminance settings of two optical modules out of a plurality of optical modules having two highest illuminance settings, and comparing the combined illuminance settings with a total output illuminance threshold. By combining the illuminance settings of (partial) optical modules, it is only necessary to determine whether an indication should be output in a single comparison with the total output illuminance threshold.

[0009] The illuminance setting for each of the multiple optical modules can be a percentage of the maximum illuminance of the optical module, such as 50% of the maximum illuminance, or it can be the set power of the optical module (e.g., irradiance), such as 160 kilolux (klx) or 615 watts per square meter.

[0010] The total output illuminance threshold can be a percentage of the total illuminance setting of the optical modules. For example, the total output illuminance threshold can be 160% of the maximum illuminance of each optical module, such as two optical modules both set to 80% illuminance. Alternatively, the total output illuminance threshold can be irradiance, such as 256 klx, 260 klx, 180 klx, or 205 klx.

[0011] Computer devices can be configured to convert a given illuminance setting into different units to ensure that the given illuminance setting aligns with the output illuminance threshold. For example, if the illuminance setting for each of multiple optical modules is defined as a percentage of the module's maximum illuminance, and the threshold is irradiance, then the computer device can convert the percentage of maximum illuminance to irradiance, and vice versa.

[0012] In some embodiments, the step of comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold may include: comparing the illuminance setting of a first optical module of the plurality of optical modules with a first output illuminance threshold, and comparing the illuminance setting of a second optical module of the plurality of optical modules with a second dynamic output illuminance threshold, the second threshold depending on at least one of the first threshold and the first illuminance setting. By comparing the first illuminance setting with the first output illuminance threshold and comparing the second illuminance setting with the second dynamic output illuminance threshold, it is ensured that the combined illuminance settings do not exceed the threshold without calculating the combined illuminance settings.

[0013] In some other embodiments, the first and second optical modules in a plurality of optical modules may be two optical modules having two maximum illuminance settings.

[0014] In some embodiments, a computer device may be configured to determine whether the illumination area of ​​one of a plurality of optical modules overlaps with the illumination area of ​​another of the plurality of optical modules.

[0015] In other embodiments, the computer device may be configured to: not output an indication if the lighting areas do not overlap; and / or output a further indication if the lighting areas overlap and exceed an output illuminance threshold; and / or output an indication if the lighting areas overlap. By determining whether the lighting areas overlap, the indication can be further reduced to only the necessary indication, thereby providing a more efficient and user-friendly system, or providing a further indication when the lighting areas overlap, so that up-to-date indication can be provided.

[0016] In some other embodiments, the computer device may be configured to continuously determine whether the illuminated areas overlap. This allows for the provision of the latest indication. Alternatively, the computer device may be configured to determine whether the illuminated areas overlap at predetermined time intervals. The predetermined time interval may be between one second and one minute, or between one second and ten seconds, or between one second and five seconds. Increasing the time interval can reduce the computational burden, thereby improving the efficiency of the system.

[0017] In some other embodiments, the computer device may be configured to determine the percentage of overlap when illuminated areas overlap. This percentage of overlap can help provide an indication only when needed. That is, an indication can be provided only when the overlap exceeds, for example, 5%, 10%, 20%, 30%, or any other suitable value.

[0018] In some other embodiments, each of the plurality of optical modules includes at least one of the following: a structured light system, wherein the step of determining whether the illumination areas overlap includes detecting the interference pattern of the structured light from the structured light system; and a camera, wherein the step of determining whether the illumination areas overlap includes comparing images from each camera for corresponding features. It should be understood that if the interference pattern of the structured light or the corresponding feature of the camera image is present in each corresponding illumination area, the illumination areas are considered to overlap. This allows for efficient detection of overlapping illumination areas, including the percentage of overlap (if desired), using relatively simple structured light systems or widely available cameras (such as standard RGB cameras using CCD or CMOS sensors).

[0019] In some other embodiments, the computer device further includes an artificial neural network configured using a training dataset, wherein: the step of detecting an interference pattern includes using the artificial neural network to detect an interference pattern of structured light; and / or the step of comparing images from various cameras to perform feature detection includes using the artificial neural network to detect corresponding features in images from different cameras.

[0020] Advantageously, the use of artificial neural networks allows for improved overlap detection. More advantageously, the system includes a camera and a structured light system, as well as an artificial neural network for detecting interferograms and corresponding features, which can further improve overlap detection.

[0021] If an artificial neural network is provided, it can be configured to receive and process context-related information based on at least one of the following: patient characteristics; surgery type; environmental data; and illuminance settings and / or focus settings of at least two light modules. Advantageously, the use of context-related processing allows, for example, the output illuminance threshold to be dynamic based on at least one patient characteristic (e.g., a lower threshold based on patient body size and / or skin pigmentation), based on surgery type (e.g., an upper threshold based on a specific surgical procedure), or based on other data.

[0022] In some other embodiments, the computer device may be configured to prevent changes to the illuminance setting of one of the multiple optical modules until an indication has been confirmed.

[0023] In some embodiments using artificial neural networks, the computer device can be configured to automatically reduce the illuminance setting of one of a plurality of optical modules when at least one output illuminance threshold is exceeded. The illuminance setting can be automatically reduced only after at least one output illuminance threshold has been exceeded for a predetermined period of time and / or when a predetermined illuminance setting amount is not acknowledged and / or no confirmation is received within the predetermined period of time.

[0024] In some embodiments, it can be determined whether the illumination areas of the optical modules overlap before comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold. Therefore, the illuminance settings can be compared with at least one output illuminance threshold only if the illumination areas overlap.

[0025] However, preferably, before determining whether the illumination areas of the optical modules overlap, the illuminance settings of at least two of the multiple optical modules are compared with at least one output illuminance threshold. Therefore, overlap can be determined only if the output illuminance threshold is exceeded.

[0026] In an alternative embodiment, each of the plurality of optical modules may include at least one of the following: a position sensor; an angle sensor; an accelerometer; and a gyroscope, for determining whether the illumination area of ​​one optical module overlaps with the illumination area of ​​another optical module. In this embodiment, the system determines the position and orientation of each optical module relative to the other optical modules to determine whether the illumination area of ​​one optical module overlaps with the illumination area of ​​another optical module.

[0027] In another alternative embodiment, the computer device may be connected to a camera system including at least two cameras for determining the position and angle of each of the plurality of optical modules and the position of the illumination area of ​​each of the plurality of optical modules, thereby determining whether the illumination area of ​​one of the plurality of optical modules overlaps with the illumination area of ​​another of the plurality of optical modules.

[0028] In some embodiments, the indication system includes an indicator. An indication can be output by activating the indicator. The indicator can be a visual indicator and / or an auditory indicator.

[0029] In some embodiments, the output is based on at least one of the following: an optical module among a plurality of optical modules; a wall control panel; a motion controller; and a third-party device.

[0030] In some embodiments, the indication is at least one of a visual indication and an auditory indication. This allows for clear output of the indication and enables the user to receive the indication quickly.

[0031] For example, one or each of the light modules may include a marker for displaying an indication. For instance, an indication can be displayed by illuminating the marker. The marker may be illuminated in a specific color. This color may be a color that makes the indication visible, such as red, yellow, or orange.

[0032] In some other embodiments, each of the plurality of optical modules includes an optical module control panel, which includes markings.

[0033] Wall-mounted control panels can include a graphical user interface (GUI). Instructions can be output within the GUI. Alternatively or additionally, motion controllers may include a graphical user interface (GUI).

[0034] In some embodiments, the indication may include context-related information such as at least one of the following: patient characteristics; type of surgery; environmental data; and illuminance settings and / or focus settings for at least two light modules. Advantageously, including this context-related information can provide improved and / or guided human-computer interaction and allow the user to easily view the relevant context-related information.

[0035] In some embodiments, the computer device may be configured to receive at least one of the following: input for confirming the indication; input for pausing the indication system; and input for delaying the indication. Input for pausing the indication system may include the amount of time the indication system is paused, or an event that triggers the restart of the indication system. This event may be: changing the output illuminance setting of the optical module; or detecting movement of the optical module. Input for delaying the indication may include the amount of time the indication is delayed, or an event that triggers the issuance of the indication. This event may be: changing the output illuminance setting of the optical module; or detecting movement of the optical module. It should be understood that the indication can only be "paused" after startup, but the indication system can be paused at any time. These inputs allow for a more efficient indication system in which users can interact with the indication in a variety of improved ways.

[0036] In some embodiments, the computer device may be configured to receive input for raising and / or lowering the illuminance setting of one or each of a plurality of optical modules. At least one of the optical modules, wall control panels, and GUI may include input for raising and / or lowering the illuminance setting.

[0037] In some other embodiments, the computer device may be configured to compare the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold whenever the illuminance setting of one of the plurality of optical modules is changed.

[0038] Computer devices may include a processor and memory. Memory may store instructions that, when executed by the processor, instruct the system to perform the steps it is configured to execute. If the computer device does not include memory, then the computer device may be a thin client connected to the processor, where the server stores the instructions.

[0039] According to a second aspect of the invention, a surgical lighting device is provided, comprising: an indication system generally as described herein; and a plurality of optical modules connected to a computing device.

[0040] In some embodiments, the surgical lighting device includes a controller configured to receive input for raising and / or lowering the illuminance setting of one or each of a plurality of light modules, the controller being further configured to communicate the input to the computer device of the indicating system.

[0041] In embodiments where the indication system includes at least one of a light module, a wall control panel, and a GUI, and includes inputs, the controller may be configured to receive inputs from these inputs for raising and / or lowering illuminance settings.

[0042] In some embodiments, each of the at least two optical modules includes a structured light camera connected to a computer device.

[0043] According to a third aspect of the present invention, a method for indicating a surgical lighting device comprising a plurality of optical modules is provided, comprising: determining an illuminance setting for each of the plurality of optical modules; comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold; and if the at least one output illuminance threshold is exceeded, then output indication.

[0044] In some embodiments, the method further includes the step of: if the plurality of optical modules includes more than two optical modules, then identifying two optical modules among the plurality of optical modules that have two highest illuminance settings.

[0045] In some embodiments, the method further includes the following steps: combining the illuminance settings of at least two optical modules among a plurality of optical modules or the illuminance settings of two optical modules having two highest illuminance settings among a plurality of optical modules, and comparing the combined illuminance settings with a total output illuminance threshold.

[0046] In some embodiments, the method further includes the steps of: comparing the illuminance setting of a first optical module among a plurality of optical modules with a first output illuminance threshold, and comparing the illuminance setting of a second optical module among a plurality of optical modules with a second dynamic output illuminance threshold, the second threshold depending on at least one of the first threshold and the first illuminance setting. The first and second optical modules among the plurality of optical modules may be two optical modules having two highest illuminance settings.

[0047] In some embodiments, the method further includes the step of determining whether the illumination area of ​​one of the plurality of optical modules overlaps with the illumination area of ​​another of the plurality of optical modules.

[0048] In some other embodiments, determining whether the illumination areas overlap may include using a structured light system with multiple optical modules to detect the interference pattern of the structured light in the structured light system.

[0049] In some other embodiments, determining whether the illuminated areas overlap may include using cameras with multiple light modules to detect corresponding features in images from different cameras.

[0050] In some other embodiments, the steps of detecting interferograms and / or detecting corresponding features in images from different cameras include using an artificial neural network configured with a training dataset. If both cameras and a structured light system / camera are used, and the artificial neural network is used to detect the interferograms and corresponding features, then detection performance can be improved.

[0051] In some other embodiments, the use of artificial neural networks includes context-sensitive processing based on at least one of the following: patient characteristics; type of surgery; environmental data; and illuminance settings and / or focus settings of at least two light modules.

[0052] The step of determining whether the illumination area of ​​one optical module overlaps with the illumination area of ​​another optical module can be achieved using position sensors, angle sensors, accelerometers, and gyroscopes. Alternatively, a camera system can be used to determine the position and angle of each optical module.

[0053] In some other embodiments, the method includes at least one of the following steps: if the illumination areas do not overlap, then avoid outputting an indication; if the illumination areas overlap and exceed an output illuminance threshold, then output a further indication; and if the illumination areas overlap, then output an indication.

[0054] According to a fourth aspect of the present invention, a detection system for a lighting device is provided, comprising: a computer device connectable to a plurality of optical modules, wherein the computer device is configured to: determine whether the lighting area of ​​one of the plurality of optical modules overlaps with the lighting area of ​​another of the plurality of optical modules.

[0055] In some other embodiments, each of the plurality of optical modules includes a structured light system, and the computer device is configured to determine whether the illumination areas overlap, including detecting the interference pattern of the structured light of the structured light system.

[0056] In another embodiment, the detection system includes at least two cameras, wherein the step of determining whether the illumination areas overlap includes comparing images from each camera for corresponding features. The at least two cameras may be located in respective optical modules among a plurality of optical modules. In one specific embodiment, each optical module includes a camera. As should be understood, if corresponding features of the camera images are present in each corresponding illumination area, the illumination areas are considered to overlap.

[0057] In yet another embodiment, the computer device may be configured to determine the percentage of overlap when the lighting areas overlap.

[0058] In some other embodiments, the step of detecting the interference pattern includes using an artificial neural network configured with a training dataset.

[0059] In some alternative embodiments, the plurality of optical modules may include at least one of a position sensor, an angle sensor, an accelerometer, and a gyroscope for determining whether the illumination area of ​​one optical module overlaps with the illumination area of ​​another optical module. In alternative embodiments, a computer device may be connected to a camera system including at least two cameras for determining the position and angle of each optical module and the position of its illumination area, thereby determining whether the illumination area of ​​the plurality of optical modules overlaps with the illumination area of ​​another optical module.

[0060] The foregoing description of the first aspect of this disclosure has described further features of the second, third, and fourth aspects of this disclosure.

[0061] When referring to functional components in the apparatus embodiments for performing the steps of the method, it should be understood that these components may be implemented in hardware, software, or a combination of both. When implemented in hardware, these components may be implemented as one or more hardware components, such as one or more application-specific integrated circuits (ASICs). When implemented in software, these components may be implemented as one or more computer programs that execute on one or more processors.

[0062] It should be understood that the features described with respect to the first aspect of this disclosure can also be equally applied to all other aspects of this disclosure. The features described with respect to the first aspect of this disclosure can also be applied to the second and third aspects of this disclosure. For example, the apparatus features described with respect to the first, second, or fourth aspects can be applied to the method of the third aspect after necessary modifications. Attached Figure Description

[0063] The invention will be further described by way of example only, with reference to the accompanying drawings, in which:

[0064] Figure 1 A schematic diagram of an indication system according to a first embodiment is shown;

[0065] Figure 2 A schematic diagram of a surgical lighting device according to a second embodiment is shown, including an indication system according to the second embodiment;

[0066] Figure 3 A schematic diagram of a surgical lighting device according to a third embodiment is shown, including an indication system according to the third embodiment;

[0067] Figure 4 A schematic diagram of a surgical lighting device according to a fourth embodiment is shown, including an indication system according to the fourth embodiment;

[0068] Figure 5 A schematic diagram of a surgical lighting device according to a further embodiment is shown, including a detection system according to the embodiment;

[0069] Figure 6 A schematic diagram of a surgical lighting device according to a further embodiment is shown, including a detection system according to a further embodiment;

[0070] Figure 7 A schematic diagram of the neural network of the detection system of a surgical illumination device according to a further embodiment is shown;

[0071] Figure 8It shows the use of Figure 7 Flowchart of a neural network;

[0072] Figure 9a , Figure 9b and Figure 9c An exemplary light module control panel, or indicating system, of a surgical lighting device according to one embodiment is shown; and

[0073] Figure 10a and Figure 10b An exemplary graphical user interface (GUI), or instruction system, for a surgical lighting device according to one embodiment is shown. Detailed Implementation

[0074] Figure 1 A schematic diagram of a surgical lighting device indicator system 100 is shown. The surgical lighting device is configured to illuminate the surgical site of a patient 102 placed on a patient support device 103.

[0075] The indicating system 100 communicates with a surgical lighting device that includes two optical modules 104a, 104b. However, it should be understood that the surgical lighting device may include three, four, or more such optical modules. The indicating system 100 includes a computer device 106 that can be connected to two optical modules 104a, 104b. The connection between the computer device 106 and the optical modules 104a, 104b can be wireless or wired. The computer device 106 is configured to receive or determine the output illuminance setting of each optical module 104a, 104b in the surgical lighting device.

[0076] The computer device 106 of the indication system 100 can be a stand-alone computer device, i.e., a device independent of other parts of the surgical lighting apparatus. Alternatively, the computer device 106 can be integrated into one of the two optical modules 104a, 104b, a wall control panel that can be connected to the computer device 106, a hospital computer system such as an electronic medical record, or a third-party device such as a tablet computer.

[0077] If at least one output illuminance threshold is exceeded, then the indication system 100 sends an indication. Exceeding at least one output illuminance threshold depends on the illumination settings of the optical modules 104a and 104b. The output illuminance threshold can be a single threshold, that is, the illuminance settings of the optical modules 104a and 104b can be combined to calculate a combined illuminance setting compared with the total output illuminance threshold.

[0078] For example, if the illuminance setting of each optical module in optical modules 104a and 104b is 80%, then the combined illuminance setting is 160%. If the total output illuminance threshold is, for example, 150%, then the threshold is exceeded, and the system 100 outputs an indication.

[0079] If the surgical lighting device includes more than two light modules 104a, 104b, the indication system first identifies the two light modules with the two highest illuminance settings among the multiple light modules. For example, if the illuminance of the first light module 104a is set to 30%, the illuminance of the second light module 104b is set to 80%, and the illuminance of the third light module (not shown) is set to 90%, and the total output illuminance threshold is, for example, 150%, then the combined illuminance of the second and third light modules is set to 170%, exceeding the threshold.

[0080] Although the illuminance settings and thresholds in these examples are expressed as a percentage of the maximum illuminance of the optical module, they can also be expressed in klx or W / m². 2 Irradiance is expressed in units of irradiance, or converted to irradiance. Conversion between irradiance and irradiance setting percentages can include the use of a lookup table. The lookup table can include irradiance setting percentages and equivalent irradiance values.

[0081] Table 1 shows various examples of illuminance settings for surgical illumination devices with one (1LH), two (2LH), or three (3LH) light modules, and whether an output indication should be given when comparing the combined illuminance setting of two light modules with two maximum illuminance settings (2LHmax) to the total output illuminance threshold of 250klx.

[0082]

[0083] Table 1: Illuminance settings of the first light module (LH1), second light module (LH2), and third light module (LH3) of a surgical illumination device with one (1LH), two (2LH), or three (3LH) light modules; combined illuminance settings of two light modules with two maximum illuminance settings (2LHmax); and whether an output indicator is provided.

[0084] Alternatively, the illuminance settings of optical modules 104a and 104b can each be compared individually with different output illuminance thresholds. For example, the illuminance setting of the first optical module 104a can be 80%. This can be compared with a first output illuminance threshold, which can be, for example, 60%. The illuminance setting of the second optical module 104b can also be 80%. This can be compared with a second dynamic output illuminance threshold, which is, for example, 150% minus the illuminance setting of the first optical module 104a, and thus in this case, 70%. Since the illuminance settings of the first optical module 104a and the second optical module 104b exceed the first output illuminance threshold and the second dynamic output illuminance threshold, an indication will be output.

[0085] The instruction can communicate with one or each of optical modules 104a and 104b, each of which has an optical module control panel. Alternatively or additionally, the instruction can communicate with a graphical user interface (GUI) of a wall control panel and a separate third-party device such as a tablet computer.

[0086] The instruction can be output as a visual instruction, an auditory instruction, or a combination of visual and auditory instructions. Multiple visual and / or auditory instructions can exist that make up an instruction.

[0087] like Figure 2 As shown, computer device 106 may include processor 200 and memory 202. In this example, wall control panel 108 is shown communicating with computer device 106; the functionality of wall control panel 108 has been described above. Wall control panel 108 is configured to display a GUI, which will be referenced below. Figure 10a and Figure 10b Further description of the GUI. Furthermore, optical modules 104a and 104b include their respective optical module control panels 110a and 110b; and reference will be made below. Figure 9a , Figure 9b and Figure 9c Further describe the functions of the optical module control panels 110a and 110b.

[0088] like Figure 3 As shown, another example of the indicating system 300 includes a computer device 306 that communicates with each optical module 104a, 104b, and also communicates with a controller 308, which in turn communicates with a wall control panel 108. As can be seen, the controller 308 also communicates with each optical module 104a, 104b. The controller 308 is configured to receive input from the wall control panel 108 or from the optical module control panels 110a, 110b, and then issue corresponding commands to the optical modules 104a, 104b to control their illuminance output. It should be understood that the controller 308 can be configured as follows: Figure 3 The individual device shown may be configured as part of one or more optical modules 104a, 104b, or as part of an indication system 300, or as part of a wall control panel 108.

[0089] like Figure 4 As shown, another example of the indicating system 400 includes a computer device 401. The indicating system 400 operates in a similar manner to the indicating systems 100 and 300 described above. However, the indicating system 400 is further connected to a detection system 402. The detection system 402 is configured to detect whether the illumination areas of the optical modules 104a and 104b overlap. Figure 4As shown, the illumination areas can overlap in the overlapping area 403. The detection system 402 receives data from cameras 404a, 404b disposed in each of the optical modules 104a, 104b, specifically structured light cameras / systems. Such optical modules are manufactured by Trumpf Medizin Systeme GmbH as iLEDs. TM 7. Sales.

[0090] Alternatively, cameras 404a and 404b can be standard cameras, such as RGB cameras using CCD or CMOS type sensors.

[0091] like Figure 5 As shown, the present invention also relates to a detection system 402 independent of the indication system 100 or 300, which is connected to or includes a computer device 401.

[0092] like Figure 6 As shown, whether set independently of or together with the indication system 100 or 300, or set as part of the indication system 100 or 300, the detection system 401 may further include an artificial neural network 600 as part of the computer device 401.

[0093] like Figure 7 and Figure 8 As shown, the artificial neural network 600 can be trained using a training dataset 700. The training dataset 700 may include labeled data, which consists of pairs of inputs and desired outputs. When training using the training dataset 700, each node layer in the neural network 600 is configured to automatically learn to recognize features of the training dataset 700 by repeatedly attempting to reconstruct the input (i.e., the training dataset). The neural network 600 learns by attempting to minimize the difference between the network output and the probability distribution of the training dataset 700. The training dataset 700 can be generated under conditions close to real-world conditions, i.e., the conditions during use.

[0094] The labeled data for the training dataset 700 may include inputs such as images from a camera, for example, structured light images from a structured light system, or RGB images from a standard camera. Although this example involves generating the neural network 600 through supervised machine learning, those skilled in the art should understand that semi-supervised machine learning or other machine learning methods may be used where appropriate.

[0095] Once the neural network 600 has been trained, real data 702, such as data from structured light cameras 404a and 404b, is used as input, and the output can be whether there is overlap 704 in the illumination areas of the light modules 104a and 104b. The output may also include the percentage of overlap 704.

[0096] If the real data 702 is data from structured light cameras 404a and 404b, then the neural network 600 can be configured to recognize the interference between the structured light patterns of the structured light cameras 404a and 404b.

[0097] Alternatively, if cameras 404a and 404b are standard cameras such as RGB cameras, then neural network 600 can be trained using data from the RGB cameras. If the real data 702 is data from RGB cameras, then neural network 600 can be configured to recognize corresponding features, i.e., features present in images from different RGB cameras. If the same features are detected in images from different RGB cameras, then overlap can be identified.

[0098] You can use open-source machine learning platforms such as TensorFlow or PyTorch to develop neural networks 600.

[0099] like Figure 8 As shown, a training dataset 700 (800) is provided for the neural network 600 to train it to recognize structured light pattern interference. Then, real data (802) is provided for the trained neural network 600.

[0100] The real data can be preprocessed (803) to assist the neural network 600 in processing the real data. For example, preprocessing (803) can be performed by at least one of the following: cropping the input structured light image or RGB image; and reducing the resolution of the input structured light image or RGB image to improve overlap detection performance. Cropping the input may include cropping the input to correspond to the input portion corresponding to the corresponding illumination region.

[0101] The neural network 600 processes the real data 702, or if the real data 702 was preprocessed in step 803, it processes the preprocessed real data 702 to determine whether the structured light patterns of the structured light cameras 404a and 404b overlap (804). The structured light patterns generated by the structured light cameras can be configured to cover the entire illumination area of ​​each light module 104a and 104b, so any overlap of the structured light patterns means that the illumination areas of the light modules 104a and 104b must also overlap.

[0102] If interference is detected, i.e., if overlapping structured light patterns are detected, then information indicating overlapping light patterns (806) is transmitted to computer device 401. If interference is not detected, i.e., if non-overlapping structured light patterns are detected, then information indicating non-overlapping light patterns (806) is transmitted to computer device 401.

[0103] If interference is detected, the neural network 600 can be trained and configured to determine (810) the percentage overlap of the structured light pattern. The percentage overlap can be transmitted (812) to the computer device 401. If the training data and the real data are from an RGB camera, the corresponding features from feature detection can also be used to determine the percentage overlap.

[0104] When determining whether to output an indication, the percentage of overlap can be considered. For example, an indication can be output only if the percentage of overlap is greater than 10%, 20%, or 30%.

[0105] Alternatively or additionally, if the illuminance setting is automatically reduced after exceeding at least one output illuminance threshold for a predetermined time period and / or after exceeding a predetermined illuminance setting and / or without confirmation within the predetermined time period, then the predetermined time period can be shortened and the predetermined illuminance setting can be reduced when the overlap increases. That is, the predetermined time period is shortest and the predetermined illuminance setting is lowest when the overlap is 100%. There is a direct relationship between the extension of the predetermined time period or the increase of the predetermined illuminance setting and the reduction of the overlap.

[0106] Neural network 600 can be configured to continue training after initial training on training dataset 700. For example, intermittently, neural network 600 can request confirmation that the overlap detection result (i.e., whether overlap exists, the percentage of overlap, or no overlap) is correct. Additionally or alternatively, additional training data, including input and desired output pairs, can be intermittently provided to neural network 600 to optimize neural network 600.

[0107] Figure 9a Examples of optical module control panels 110a and 110b for optical modules 104a and 104b are shown, featuring icons 900 that can be illuminated to output indications. In some embodiments, icon 900 may be a button that can be pressed to confirm the indication. However, generally, confirmation is not required if the illuminance settings are changed using the optical module control panels 110a and 110b.

[0108] The optical module control panels 110a and 110b further include inputs in the form of buttons 902 to switch the optical modules 104a and 104b on and off, and inputs in the form of buttons 904a and 904b to raise and lower the illuminance settings of the optical modules 104a and 104b.

[0109] Figure 9b and Figure 9cFurther examples of the light module control panels 110a, 110b are shown, in which, instead of illuminating the indicator icon 900, a light near the icon can be lit to output an indication. The light module control panels 110a, 110b may further include an illuminance setting indicator 906, which includes multiple markers indicating the current illuminance setting of the light modules 104a, 104b.

[0110] Figure 10a and Figure 10b An example of a graphical user interface (GUI) 1000 for outputting instructions is shown. The GUI can be displayed on a wall control panel 108 and / or on a third-party device such as a tablet computer.

[0111] The instruction can be displayed as a pop-up 1002 within the GUI 1000. Pop-up 1002 may include one or more buttons for confirming the instruction. Figure 10a and Figure 10b In one embodiment, the GUI includes a “Cancel” button 1004, which can automatically reduce the illuminance setting of at least one of the optical modules 104a and 104b, or simply indicate removal; the GUI also includes an “OK” button 1006 that only confirms the indication, which can increase the illuminance setting to be started as requested.

[0112] In addition, pop-up 1002 can provide a link to the relevant User Manual (IFU), such as a hyperlink, specifically a link to a specific page or chapter within the IFU. Upon opening the link, another pop-up (not shown) containing the relevant IFU can be provided for immediate viewing by the user. Alternatively, upon opening the link, the system can utilize the standard user interface of the IFU to provide access to the relevant IFU.

[0113] Besides pop-up 1002, example GUI 1000... Figure 10b An example of an additional indicator 1008 is shown, which can be displayed to draw further attention to the instruction. After the instruction is confirmed, the pop-up 1002 and the additional indicator 1008 can still be displayed in the GUI 1000.

[0114] Instructions can be displayed in one or more of the optical module control panels 104a, 104b, third-party devices, and wall control panels 108.

[0115] It should be understood that the above embodiments are merely exemplary embodiments of this disclosure. It should also be understood that the features described with respect to one embodiment of the disclosure can be equally applied to other embodiments of this disclosure.

Claims

1. A pointing system for a surgical lighting device, comprising: A computer device capable of connecting to multiple optical modules, wherein the computer device is configured as follows: Determine the illuminance setting for each of the plurality of optical modules; The illuminance settings of at least two of the plurality of optical modules are compared with at least one output illuminance threshold; and If the at least one output illuminance threshold is exceeded, then an output indication is generated.

2. The indicating system according to claim 1, wherein, The computer equipment is configured as follows: If the plurality of optical modules includes more than two optical modules, then two optical modules with two highest illuminance settings are identified among the plurality of optical modules.

3. The indicating system according to claim 1 or 2, wherein, The step of comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold includes: The illuminance settings of at least two optical modules in the plurality of optical modules or the illuminance settings of two optical modules having two highest illuminance settings in the plurality of optical modules are combined, and the combined illuminance settings are compared with the total output illuminance threshold.

4. The indicating system according to claim 1, wherein, The step of comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold includes: The illuminance setting of the first optical module among the plurality of optical modules is compared with a first output illuminance threshold, and the illuminance setting of the second optical module among the plurality of optical modules is compared with a second dynamic output illuminance threshold, wherein the second threshold depends on at least one of the first threshold and the first illuminance setting.

5. The indicating system according to claim 2, wherein, The step of comparing the illuminance settings of at least two of the plurality of optical modules with at least one output illuminance threshold includes: The illuminance setting of the first optical module among the plurality of optical modules is compared with a first output illuminance threshold, and the illuminance setting of the second optical module among the plurality of optical modules is compared with a second dynamic output illuminance threshold, wherein the second threshold depends on at least one of the first threshold and the first illuminance setting. Among them, the first optical module and the second optical module are two optical modules with two maximum illuminance settings.

6. The indicating system according to claim 1, wherein, The computer device is configured to determine whether the illumination area of ​​one of the plurality of optical modules overlaps with the illumination area of ​​another of the plurality of optical modules. Preferably, the computer device is configured to: If the illuminated areas do not overlap, then no indication is output; and / or If the illuminated areas overlap and exceed the output illuminance threshold, then a further indication is output; and / or If the lighting areas overlap, then an output indication is provided.

7. The indicating system according to claim 6, wherein, The computer device is configured to determine the percentage of overlap when the lighting areas overlap.

8. The indicating system according to claim 6 or 7, wherein, Each of the plurality of optical modules includes at least one of the following: A structured light system, wherein the step of determining whether the illumination areas overlap includes detecting the interference pattern of the structured light from the structured light system; and The camera, wherein the step of determining whether the illuminated areas overlap includes comparing images from each camera for corresponding features.

9. The indicating system according to claim 8, wherein, The computer device includes an artificial neural network configured using a training dataset, wherein: The step of detecting the interference pattern includes using the artificial neural network to detect the interference pattern of the structured light; and / or The step of comparing corresponding features of images from different cameras includes using the artificial neural network to detect whether there are the same features in images from different cameras.

10. The indicating system according to claim 9, wherein, The artificial neural network is configured to receive and process context-related information based on at least one of the following: Patient characteristics; Type of surgery; Environmental data; and The illuminance settings and / or focus settings of the at least two optical modules.

11. The indicating system according to claim 1 or 2, wherein, The instruction is at least one of the following: Visual instructions; and Auditory indications.

12. The indicating system according to claim 1 or 2, wherein, The instruction is the output of at least one of the following: One of the plurality of optical modules; Wall control panel; Motion controller; as well as Third-party equipment.

13. The indicating system according to claim 1 or 2, wherein, The instruction includes context-related information about at least one of the following: Patient characteristics; Type of surgery; Environmental data; The illuminance settings and / or focus settings of the at least two optical modules.

14. The indicating system according to claim 1 or 2, wherein, The computer device is configured to receive at least one of the following: Input used to confirm the instruction; Used to pause the input of the indication system; and Used to delay the input of the indicated instruction.

15. A surgical lighting device, comprising: The indicating system according to claim 1 or 2; as well as Multiple optical modules connected to the computer device, and Preferably, each of the at least two optical modules includes a structured light camera connected to the computer device.

16. A method for indicating a surgical lighting device comprising multiple optical modules, comprising: Determine the illuminance settings for each of the multiple optical modules; The illuminance settings of at least two of the plurality of optical modules are compared with at least one output illuminance threshold. as well as If the at least one output illuminance threshold is exceeded, then an output indication is generated.

Images