Multi-mode integrated intelligent operating shadowless lamp and application control method thereof

Abstract

The invention provides a multi-mode integrated intelligent operation shadowless lamp and an application control method thereof, and provides a novel intelligent shadowless lamp which can provide a multi-mode operation auxiliary function in operation application. According to the shadowless lamp, based on voice interaction and background intelligent analysis, functional services such as intelligent and whole-course operating room lamplight can be achieved. The shadowless lamp has a mechanical arm automatic driving function, and can be automatically stretched to a spatial body position required by a corresponding operation type according to preset control parameters, so that the operation of a nurse is saved. Meanwhile, corresponding shadowless lamp brightness adjustment, operation recording and camera shooting and X-ray shooting starting can be achieved under voice control, so that the shadowless lamp is suitable for the orthopedic operation, the application service function of the shadowless lamp is greatly improved, the operation progress is accelerated, manpower resources of itinerant nurses are saved, the situation that recording and other situations occupy the operation view is avoided, and the operation contact infection risk is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent medical devices, and particularly to a multi-modal integrated intelligent surgical shadowless lamp, an application control method thereof, an electronic device, and a computer-readable storage medium. Background Art

[0002] The application structure of a traditional surgical shadowless lamp is as shown in the appendix Figure 1 shown. It is mainly supported by a mechanical bracket (composed of various support arms and joints) at the lower end of the shadowless lamp, and the control of the shadowless lamp is mainly manually controlled through the control system shown in the appendix Figure 2 shown. During use, the operating nurse needs to manually operate the mechanical bracket according to the required surgical field angle to adjust the angle of the shadowless lamp to the required surgical field angle.

[0003] However, during surgery (especially orthopedic surgery), the application of traditional shadowless lamps reveals deficiencies: Firstly, during the operation, since the surgeons and nurses will change their positions, the surgeon needs to adjust the brightness of the shadowless lamp according to the ambient brightness after the position change. At this time, the circulating nurse needs to manually operate the mechanical bracket to adjust the brightness of the shadowless lamp, which will occupy the working time of the operating nurse and surgical resources; moreover, manual operation may cause contact infections. After the operating nurse touches the shadowless lamp and then touches the surgical instruments, it may increase the infection risk of the subsequent surgical site.

[0004] Secondly, during orthopedic surgery, the surgeon needs to perform surgical positioning operations according to the patient's bone condition. In the traditional surgical process, first, the patient needs to be sent to the radiology department for bone photography and then to the operating room, which will delay the surgical progress of the surgical patient and is extremely inconvenient.

[0005] Finally, during the operation, for example, in laparoscopic surgery, sometimes the circulating nurse needs to take pictures of the surgical field of the laparoscopic lens and record the lens images (for subsequent disease, surgical research or teaching). In the traditional process, a mobile phone needs to be held close to the surgical field for photography. However, this will contaminate the field of view, block the surgical field of view, and affect surgical operations. Especially, it will affect the surgical space. Moreover, the circulating nurse must hold the lens all the time, which not only occupies human resources but also easily causes fatigue.

[0006] In addition, for traditional mechanical shadowless lamps, their application control is relatively backward and cannot meet the requirements of intelligent control, and their intelligent control level needs to be improved. Summary of the Invention

[0007] In order to solve the technical problems existing in the prior art, the present invention provides the following technical solutions: On the one hand, a multi-modal integrated intelligent operating shadowless lamp is provided. The intelligent operating shadowless lamp includes an intelligent operating shadowless lamp and a surgical nurse background, where: (1) The intelligent operating shadowless lamp includes a shadowless lamp, a main control board, a control panel, and a power supply, and further includes: A camera for intraoperative video recording of the surgical video and feeding back the surgical recorded video to the main control board; An X-ray machine for taking X-rays and feeding back the X-image signal to the main control board; A voice module for collecting the control voice data of medical staff and sending it to the voice chip; A voice chip for parsing and recognizing the control voice data, obtaining the control semantic information therein and sending it to the main control board; The main control board is used to forward the control semantic information or the surgical recorded video to the wireless communication module; and perform image processing on the X-image signal, generate the corresponding X-image and send it to the LED display; and respond to the corresponding control instructions issued by the background to control the shadowless lamp, the camera or the X-ray machine to perform shadowless lamp brightness adjustment, video recording or X-ray shooting; The LED display is used to display the X-image; The wireless communication module is used to realize the communication between the intelligent operating shadowless lamp and the surgical nurse background, including: reporting the control semantic information or the surgical recorded video to the surgical nurse background; (2) The surgical nurse background is used to process and feedback the control semantic information or the surgical recorded video, including: Reading the control time in the control semantic information; Inputting the control semantic information into a preset shadowless lamp AI control recognition model, and the shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs a control strategy matching the control features; Combining the control time and the control strategy, generating a corresponding control instruction and sending it to the wireless communication module of the intelligent operating shadowless lamp, and the wireless communication module forwards the control instruction to the main control board; The voice module is electrically connected to the voice chip; The shadowless lamp, the control panel, the memory, the power supply, the camera, the X-ray machine, the voice chip, the wireless communication module, and the LED display are respectively electrically connected to the main control board; The intelligent operating shadowless lamp is communicatively connected to the surgical nurse background.

[0008] Preferably, the intelligent operating shadowless lamp further includes: The robotic arm 100 is used to support and install the shadowless lamp 200, the camera 300, and the X-ray machine 400; The robotic arm is electrically connected to the main control board.

[0009] Preferably, the robotic arm 100 includes a main robotic arm and a sub-robotic arm, which are used to support the main shadowless lamp and the sub-shadowless lamp respectively.

[0010] Preferably, the method for generating the shadowless lamp AI control recognition model includes: Prepare the control voice data related to the shadowless lamp, the camera, the X-ray machine, and the robotic arm respectively; Perform semantic parsing on the control voice data to generate corresponding control text information; Perform feature engineering on the control text information to identify and extract the control features in the control text information; Perform information annotation on the control features, and the annotation information includes: the control strategies matching the control features, including: The first drive control parameters of the shadowless lamp at different brightness levels; The second drive control parameters of the camera in the continuous shooting mode and the one-time shooting mode respectively; The third drive control parameter of the X-ray machine in the one-time shooting mode; The fourth drive control parameter of the robotic arm at different spatial angles; Statistically analyze each of the annotated control features to obtain a feature set; Divide the feature set into a training set and a validation set according to a preset ratio; Input the training set into a preset random forest model for feature training and learning to generate the shadowless lamp AI control recognition model; Use the validation set to verify the recognition performance of the shadowless lamp AI control recognition model: If the verification is passed, deploy the shadowless lamp AI control recognition model on the surgical nurse background; Otherwise, repeat the above steps to reconstruct the shadowless lamp AI control recognition model.

[0011] Preferably, the main control board is integrated with: An MCU chip for logic control and calculation; An FPGA chip for image processing of the X image signal; A clock circuit for controlling timing.

[0012] Preferably, the intelligent surgical shadowless lamp further includes: A memory for caching the surgical recording video, the X image, and the control voice data; After the voice chip parses and recognizes the operation end instruction issued by the medical staff, the main control board responds to the operation end instruction, deletes the cached data and turns off the intelligent operation shadowless lamp; The memory is electrically connected to the main control board.

[0013] On the other hand, an application control method for a multi-modal integrated intelligent operation shadowless lamp is provided. The method includes the following steps: The circulating nurse activates the intelligent operation shadowless lamp through the control panel and sends an activation request message to the operation nurse background; The operation nurse background responds to the activation request message and issues a corresponding preset body position strategy according to the current operation attribute; The main control board of the intelligent operation shadowless lamp executes the preset body position strategy, controls the robotic arm to extend to the preset space state according to the control parameters in the preset body position strategy, and at the same time turns on the shadowless lamp to the preset brightness, and conducts power-on tests on the camera and the X-ray machine respectively. The circulating nurse judges the test results: If the test state is good, input the corresponding test success instruction through the control panel and report it to the operation nurse background by the intelligent operation shadowless lamp; otherwise, input the corresponding test failure instruction and report it to the operation nurse background by the intelligent operation shadowless lamp, and the operation nurse background issues a preset fault test instruction for self-test and repair of the fault; Collect the control voice data of the medical staff through the voice module and send it to the voice chip; Parse and recognize the control voice data through the voice chip, obtain the control semantic information therein and send it to the main control board; Forward the control semantic information to the wireless communication module through the main control board; Report the control semantic information to the operation nurse background through the wireless communication module; The operation nurse background processes the control semantic information or the operation recording video and gives feedback, including: Read the control time in the control semantic information; Input the control semantic information into a preset shadowless lamp AI control recognition model, and the shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs a control strategy matching the control features; Combine the control time and the control strategy to generate a corresponding control instruction and issue it to the wireless communication module of the intelligent operation shadowless lamp, and the wireless communication module forwards the control instruction to the main control board; The main control board responds to the corresponding control instruction issued by the background and controls the shadowless lamp, the camera or the X-ray machine to adjust the brightness of the shadowless lamp, record the video or take an X-ray film; The main control board forwards the surgical recording video captured by the camera to the wireless communication module, and reports the surgical recording video to the surgical nurse background through the wireless communication module, which is recorded and saved by the surgical nurse background; The main control board processes the X-ray image signal collected by the X-ray machine, generates a corresponding X-ray image and sends it to the LED display; The X-ray image is displayed through the LED display.

[0014] On the other hand, an electronic device is provided, and the electronic device includes: a processor; a memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, the application control method of the multi-modal integrated intelligent surgical shadowless lamp as described above is implemented.

[0015] On the other hand, a computer-readable storage medium is provided, and at least one instruction is stored in the storage medium, and the at least one instruction is loaded and executed by the processor to implement the application control method of the multi-modal integrated intelligent surgical shadowless lamp as described above. The beneficial effects brought by the technical solution provided by the embodiments of the present invention at least include: The present invention proposes a new type of intelligent shadowless lamp, which can provide multi-modal surgical assistance functions in surgical applications. The shadowless lamp can realize intelligent full-process operating room lighting and other functional services based on voice interaction and background intelligent analysis. It has an automatic robotic arm driving function, and can automatically extend the shadowless lamp to the spatial position required for the corresponding surgical type according to the predetermined control parameters, saving the operation of nurses. At the same time, it can realize the corresponding shadowless lamp brightness adjustment, surgical recording and imaging, and can start X-ray radiography under voice control, which is suitable for orthopedic surgery, greatly improving the application service function of the shadowless lamp, improving the surgical progress, saving the human resources of the circulating nurses, avoiding the situation that recording and other situations occupy the surgical view, and reducing the risk of surgical contact infection. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0017] Figure 1 is a schematic diagram of the application structure of the traditional shadowless lamp of the present invention; Figure 2 is a schematic diagram of the control system structure of the traditional shadowless lamp of the present invention; Figure 3 is a schematic diagram of the control system structure of an intelligent surgical shadowless lamp provided by an embodiment of the present invention; Figure 4 It is a schematic diagram of an integrated structure of a shadowless lamp driven by a mechanical arm provided by an embodiment of the present invention; Figure 5 It is a schematic diagram of a generation process of an AI model provided by an embodiment of the present invention; Figure 6 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0018] The technical solution of the present invention is described below in conjunction with the accompanying drawings.

[0019] In the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "example" in the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "example" is intended to present the concept in a specific way. In addition, in the embodiments of the present invention, the meaning expressed by "and / or" can be both, or it can be either of the two.

[0020] In the embodiments of the present invention, "image" and "picture" can sometimes be used interchangeably. It should be noted that when the difference between them is not emphasized, the meanings they intend to express are the same. "of", "corresponding, relevant" and "corresponding" can sometimes be used interchangeably. It should be noted that when the difference between them is not emphasized, the meanings they intend to express are the same.

[0021] In the embodiments of the present invention, sometimes the subscripts such as W 1 It may be mistakenly written as a non-subscript form such as W1. When the difference is not emphasized, the meanings they express are the same.

[0022] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0023] The embodiment of the present invention provides a multi-modal integrated intelligent surgical shadowless lamp and an application control method thereof, which can be implemented by an electronic device, which can be a terminal or a server. Figure 3 The multi-modality integrated intelligent surgical shadowless light shown.

[0024] The intelligent surgical shadowless lamp can include the original shadowless lamp, main control board, control panel and power supply. Figure 2 As shown, no further elaboration is given here.

[0025] like Figure 3As shown in the figure, on the one hand, a multi-modal integrated intelligent operating shadowless lamp is provided. The intelligent operating shadowless lamp includes an intelligent operating shadowless lamp and a surgical nurse background, where: (1) The intelligent operating shadowless lamp includes a shadowless lamp, a main control board, a control panel, and a power supply. It also includes: A camera for intraoperative video recording of the surgical video and feeding back the surgical recorded video to the main control board; An X-ray machine for taking X-rays and feeding back the X-image signal to the main control board; A voice module for collecting the control voice data of medical staff and sending it to the voice chip; A voice chip for parsing and recognizing the control voice data, obtaining the control semantic information (abbreviated as semantic information) therein and sending it to the main control board; The main control board is used to forward the control semantic information or the surgical recorded video to the wireless communication module; and perform image processing on the X-image signal to generate a corresponding X-image and send it to the LED display; and respond to the corresponding control instructions issued by the background to control the shadowless lamp, the camera or the X-ray machine for shadowless lamp brightness adjustment, video recording or X-ray taking; The LED display is used to display the X-image; The wireless communication module is used to realize the communication between the intelligent operating shadowless lamp and the surgical nurse background, including: reporting the control semantic information or the surgical recorded video to the surgical nurse background; (2) The surgical nurse background is used to process and feedback the control semantic information or the surgical recorded video, including: Reading the control time in the control semantic information; Inputting the control semantic information into a preset shadowless lamp AI control recognition model (AI model), and the shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs a control strategy matching the control features; Combining the control time and the control strategy to generate a corresponding control instruction and sending it to the wireless communication module of the intelligent operating shadowless lamp, and the wireless communication module forwards the control instruction to the main control board; The voice module is electrically connected to the voice chip; The shadowless lamp, the control panel, the memory, the power supply, the camera, the X-ray machine, the voice chip, the wireless communication module and the LED display are respectively electrically connected to the main control board; The intelligent operating shadowless lamp is communicatively connected to the surgical nurse background.

[0026] The present invention proposes a novel intelligent shadowless lamp, which can provide multi-modal surgical assistance functions during surgical applications. This shadowless lamp can realize intelligent and full-process operating room lighting and other functional services based on voice interaction and background intelligent analysis. It has an automatic robotic arm driving function and can automatically extend the shadowless lamp to the spatial position required for the corresponding surgical type according to the predetermined control parameters, saving the operation of nurses. At the same time, it can realize the corresponding brightness adjustment of the shadowless lamp, surgical recording and imaging, and can start X-ray radiography under voice control, which is applicable to orthopedic surgeries, greatly improving the application service function of the shadowless lamp, improving the surgical progress, saving the human resources of the circulating nurses, avoiding the situation where recording and other operations occupy the surgical view, and reducing the risk of surgical contact infection.

[0027] Specifically, in the present invention, a robotic arm is used instead of a mechanical support frame, and the shadowless lamp is installed on the robotic arm. Corresponding operation instructions can be input through a control panel (which can be voice-operated or manually operated, and voice control is preferred), and the main control board parses the instructions to control the movement position of the robotic arm in space. Specifically, it can be implemented in combination with the three-dimensional space operation principle of the robotic arm.

[0028] In the present invention, the robotic arm can be controlled by the main control board according to the corresponding control parameters for the corresponding body position. The camera, X-ray machine (similar to oral X-ray equipment, dental X-ray machine, which is small in size and can be integrated on the robotic arm), and the shadowless lamp can be integrally installed on the robotic arm. It can be integrated and installed in combination with Figure 4 the installation structure schematic diagram shown. The camera, X-ray machine, and the camera are all in the same direction as the shadowless lamp. The specific installation position and angle on the robotic arm can be adjusted in advance according to habits or requirements.

[0029] In the present invention, for the device models of electronic hardware such as cameras, shadowless lamps, robotic arms, and X-ray machines, there are no restrictions, and they can be purchased by the hospital or customized. The data communication and supported data formats between the corresponding main control board and the corresponding electronic devices can be configured according to the selected main control board.

[0030] The present invention is also provided with a configured voice module. Moreover, in the controller of the shadowless lamp, not only a main control board MCU chip is integrated, but also a voice chip is integrated. The voice module can collect the voice data of the circulating nurse or the surgeon for controlling the shadowless lamp and send it to the voice chip. The voice chip parses the voice data and identifies the control semantic information therein. The parsed and identified semantic information is sent to the main control board, and the main control board then reports it to the background through a wireless communication module.

[0031] For the parsing of voice data by a voice chip, existing voice recognition systems can be referred to. The process of using a voice chip to parse and recognize semantic information in voice data generally includes the following steps: Collection and preprocessing of voice signals: The voice chip collects voice signals through a built-in microphone or an externally connected microphone.

[0032] The collected voice signals will be preprocessed, including noise cancellation, voice enhancement, and feature extraction, etc., to improve the accuracy of subsequent processing. Feature extraction is to convert the audio signal into a set of feature vectors. Common methods include discrete Fourier transform (DFT), wavelet transform, Mel-frequency cepstral coefficients (MFCC), and linear predictive coding (LPC), etc.

[0033] Analysis and processing of feature information: Closely following the feature information, the voice chip will identify and segment words according to the grammar rules of different languages.

[0034] During the recognition process, the chip will consider the context before and after as an auxiliary recognition condition, which is conducive to more accurately analyzing and recognizing voice data.

[0035] Semantic analysis and decoding: Based on the acoustic model and language model, the voice chip will perform semantic analysis on the feature information.

[0036] The acoustic model calculates the score of each feature vector in the acoustic features according to the acoustic features, while the language model calculates the probability of the sound signal corresponding to the phrase sequence according to the relevant linguistic theories.

[0037] Finally, decode the phrase sequence in combination with the existing dictionary to obtain the final text representation or instruction.

[0038] Post-processing and output: The recognized semantic information may undergo further post-processing, such as grammar correction, semantic parsing, etc., to ensure the accuracy of the output. This process can be carried out by the background to query and match the semantic information according to the semantic knowledge base stored in the preset semantic knowledge base for each feature (to avoid recognition errors caused by inaccurate voice issued by the user), retrieve the complete control semantic text information according to the semantic keywords in the semantic information and send it to the AI model, so as to facilitate the AI model to perform model recognition and strategy prediction based on the complete control semantic text and improve the accuracy.

[0039] After the processing is completed, the voice chip will output the recognition result in the form of text or instruction for subsequent systems or applications to use.

[0040] Regarding the specific voice chip model, since there are various choices and continuously updated products in the market, it can be selected according to the specific application scenarios and requirements.

[0041] The wireless communication module can be a wired or wireless module. Bluetooth communication is preferred in this invention. For the communication link and address access request between Bluetooth and the background server, etc., please understand in combination with the existing internal wireless communication mode in the hospital.

[0042] On the background, the background can identify the semantic information fed back from each operating room in the operating room, identify the control semantic information and perform preprocessing, such as semantic analysis, keyword extraction, etc. Input the control semantic information into a preset AI model. The AI model can perform feature recognition on the semantic information, identify the control features therein, such as identifying the object of voice control by the current nurse, such as the shadowless lamp and its control features. The control features, such as the brightness level to which the shadowless lamp is to be controlled, are: adjust the brightness of the shadowless lamp to level 3. The AI model can perform feature recognition based on the shadowless lamp and the brightness level 3 therein and perform feature matching. In this way, the control strategy corresponding to the semantic information features is matched and output. The control strategy contains the specific control parameters for adjusting the brightness of the shadowless lamp to level 3 brightness. The specific drive control parameters are set and configured in advance by the administrator.

[0043] After the background performs intelligent analysis and generates the corresponding control strategy, it can combine the control time extracted from the previous semantic information preprocessing, such as continuously controlling the shadowless lamp or continuously illuminating the shadowless lamp for 30 minutes. Combine its control time and the drive control parameters in the control strategy to jointly generate the corresponding control instruction (the control instruction for continuously illuminating the shadowless lamp at level 3 brightness for 30 minutes) and send it down.

[0044] The Bluetooth module of the intelligent surgical shadowless lamp receives and forwards it to its main control board, and the main control board executes the drive control parameters in the control strategy to control the shadowless lamp and achieve the corresponding brightness adjustment.

[0045] If the voice control is the voice of camera recording, it can also follow the above process of voice parsing and recognition, upload it to the background, and the background performs intelligent analysis to generate the corresponding camera recording control instruction. Identify the camera recording shooting mode desired by the current nurse through the semantic information related to camera recording, such as instructing the camera to continuously take pictures, or take pictures for 1 second or 3 seconds at a time, or take one picture at a time. The corresponding shooting control strategy also contains the corresponding camera drive control parameters, such as controlling the camera to take pictures according to the corresponding focusing parameters, number of shootings, etc.

[0046] For the X-ray machine, it can also be operated in the same way as described above, enabling the X-ray camera to take continuous X-ray films, or take multiple consecutive or single X-ray films at once, etc. In this way, under orthopedic surgery, X-ray irradiation can be carried out through voice control to generate X-ray images. Or take single X-ray films or multiple X-ray films at once. The specific parameters for driving the X-ray film shooting can be set by the administrator in advance for the driving strategy in the corresponding shooting mode.

[0047] For the control requirements such as clinical surgical camera recording and X-ray film shooting, the strategy configuration can be combined with the specific operations of existing clinical surgeries, which will not be elaborated in this embodiment.

[0048] The main control board can perform image signal processing based on the FPGA chip therein, generate corresponding X-ray images and send them to the LED display; the LED display is used to display the X-ray images. This can facilitate orthopedic surgeons to perform orthopedic surgeries.

[0049] As Figure 4 shown, preferably, the intelligent surgical shadowless lamp further includes: A robotic arm 100 for supporting and installing the shadowless lamp 200, the camera 300, and the X-ray machine 400; The robotic arm is electrically connected to the main control board.

[0050] The shadowless lamp 200 can be set at the end of the robotic arm 100, and the camera 300 and the X-ray machine 400 can be respectively set on both sides of the robotic arm 100, and they can be installed according to the principle of convenience. Since the shadowless lamp is directly facing the surgical field, the recorded surgeries are generally the most regular, and there is no need for manual lens holding, which will not contaminate the surgical field.

[0051] Preferably, the robotic arm 100 includes a main robotic arm and a secondary robotic arm for respectively supporting the main shadowless lamp and the secondary shadowless lamp.

[0052] The present invention preferably uses two types of main and secondary shadowless lamps for control. The secondary shadowless lamp provides auxiliary illumination, and the control parameters of its secondary robotic arm can follow the settings of the main robotic arm.

[0053] As Figure 5 shown, preferably, the method for generating the shadowless lamp AI control recognition model includes: Respectively prepare control voice data related to the shadowless lamp, the camera, the X-ray machine, and the robotic arm; Perform semantic parsing on the control voice data to generate corresponding control text information; Perform feature engineering on the control text information to identify and extract the control features in the control text information; Perform information annotation on the control features, and the annotation information includes: the control strategy matching the control features, including: The first drive control parameters of the shadowless lamp at different brightness levels; The second drive control parameters of the camera in continuous shooting mode and one-time shooting mode; The third drive control parameters of the X-ray machine in one-time shooting mode; The fourth drive control parameters of the robotic arm at different spatial angles; Statistically analyze each of the labeled control features to obtain a feature set; Divide the feature set into a training set and a validation set according to a preset ratio; Input the training set into a preset random forest model for feature training and learning to generate the shadowless lamp AI control recognition model; Use the validation set to verify the recognition performance of the shadowless lamp AI control recognition model: If the verification passes, deploy the shadowless lamp AI control recognition model on the surgical nurse background; Otherwise, repeat the above steps to reconstruct the shadowless lamp AI control recognition model.

[0054] Here, a random forest model is used to construct the AI model.

[0055] The following is the detailed model construction process for constructing the shadowless lamp AI control recognition model based on the control voice data of the shadowless lamp, camera, X-ray machine, and robotic arm: 1. Data Preparation Step 1.1: Prepare the control voice data related to the shadowless lamp, camera, X-ray machine, and robotic arm respectively.

[0056] Implementation details: Collect the actual control voice commands of medical staff for the shadowless lamp (such as adjusting brightness), camera (such as continuous shooting or one-time shooting), X-ray machine (such as starting one-time shooting), and robotic arm (such as adjusting spatial angle) in the operating room environment. Ensure that the voice data is clear, noise-free, and covers all possible control scenarios.

[0057] The control voice data, such as: "Control the shadowless lamp to continuously illuminate at three levels of brightness for 30 minutes", involves the control feature parameters of the relevant shadowless lamp and its control strategy, and the features can be extracted through a feature extraction algorithm.

[0058] 2. Semantic Analysis Step 2.1: Perform semantic analysis on the control voice data to generate corresponding control text information.

[0059] Implementation details: Use speech recognition technology (such as ASR, Automatic Speech Recognition) to convert speech data into text. Subsequently, use natural language processing (NLP) technology to parse the intent and parameters in the text. For example, "Adjust the brightness of the shadowless lamp to the maximum" is parsed into the intent "Adjust the brightness of the shadowless lamp" and the parameter "maximum".

[0060] 3. Feature Engineering Step 3.1: Perform feature engineering on the control text information to identify and extract control features in the control text information.

[0061] Implementation details: Identify keywords and phrases in the text, such as device names (shadowless lamp, camera, etc.), control actions (adjust, shoot, etc.) and parameter values (brightness level, shooting mode, etc.). These keywords and phrases constitute control features. The following steps can be referred to: 1). Text preprocessing First, preprocess the control text information, including removing irrelevant characters (such as punctuation marks, special symbols, etc.), word segmentation, part-of-speech tagging, removing stop words, etc. The purpose of this step is to purify the text data and lay a good foundation for subsequent feature extraction.

[0062] 2). Select feature extraction algorithms According to the characteristics and requirements of the control text information, select one or more appropriate feature extraction algorithms. Commonly used feature extraction algorithms include: Bag of Words (BoW): Consider the text as a set composed of a series of words, ignore the order and grammatical relationship between words, and only consider the word frequency.

[0063] Term Frequency-Inverse Document Frequency (TF-IDF): On the basis of the bag of words model, consider the distribution of words in the entire document set, and give higher weights to words that appear frequently in a specific document but are rare in the entire set.

[0064] Word Embedding: Such as Word2Vec, GloVe, etc., map words into a high-dimensional vector space, so that similar words are closer in the vector space. This method can capture the semantic relationship between words.

[0065] N-gram model: Consider the combination of consecutive N words in the text to capture the local context information between words.

[0066] Named Entity Recognition (NER): Identify entities (such as device names, parameter values, etc.) in the text and extract them as features.

[0067] 3). Apply the feature extraction algorithm Apply the selected feature extraction algorithm to the preprocessed control text information. Taking TF-IDF as an example, the specific steps are as follows: Calculate Term Frequency (TF): Count the number of times each word appears in a specific control text information and calculate its frequency.

[0068] Calculate Inverse Document Frequency (IDF): Count the number of documents in the entire control text information set that contain a specific word and calculate its inverse document frequency.

[0069] Calculate TF-IDF value: Multiply the term frequency and the inverse document frequency to obtain the TF-IDF value of each word, which is used as the feature weight of the word.

[0070] 4). Identify and extract control features Based on the results of the feature extraction algorithm, identify and extract the control features in the control text information. These features may include: Device name: Such as "shadowless lamp", "camera", etc., extracted through named entity recognition or bag-of-words model.

[0071] Control action: Such as "adjust", "shoot", etc., which can also be extracted through named entity recognition or bag-of-words model.

[0072] Parameter value: Such as "brightness level", "shooting mode", etc., which may need to be extracted in combination with regular expressions or specific parsing rules.

[0073] 5). Construct a feature vector Convert the extracted control features into a feature vector for subsequent model training and use. The feature vector can be a fixed-length array or matrix, where each element corresponds to the feature weight or existence identifier of a control feature.

[0074] 6). Feature selection and dimensionality reduction (optional) If the number of features is too large or there are redundant features, feature selection or dimensionality reduction operations can be performed to reduce the model complexity and improve performance. Common methods include Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), etc.

[0075] Through the above steps, the feature extraction algorithm can be used to perform feature engineering on the control text information, identify and extract the key control features, providing strong support for the construction of the subsequent shadowless lamp AI control recognition model.

[0076] 4. Information annotation Step 4.1: Perform information annotation on the control features, and the annotation information includes the control strategies that match the control features.

[0077] Implementation details: Shadowless lamp: Annotate the first drive control parameters (such as brightness percentage or current value) at different brightness levels.

[0078] Camera: Annotate the second drive control parameters (such as shooting duration, resolution, etc.) in continuous shooting mode and single-shot shooting mode.

[0079] X-ray machine: Annotate the third drive control parameters (such as exposure time, voltage, etc.) in single-shot shooting mode.

[0080] Robotic arm: Annotate the fourth drive control parameters (such as joint angles, movement speed, etc.) at different spatial angles.

[0081] Step 4.2: Count the control features after each annotation to obtain a feature set.

[0082] Implementation details: Organize all the annotated control features to form a feature set that includes device name, control action, parameter value, and control strategy.

[0083] 5. Data division Step 5.1: Divide the feature set into a training set and a validation set according to a preset ratio.

[0084] Implementation details: Usually, the training set accounts for a larger proportion of the feature set (such as 70%-80%) and is used for model training; the validation set accounts for a smaller proportion (such as 20%-30%) and is used for model validation. Ensure that the training set and the validation set are representative in terms of device type, control action, and parameter value.

[0085] 6. Model training Step 6.1: Input the training set into a preset random forest model for feature training and learning to generate the shadowless lamp AI control recognition model.

[0086] Implementation details: Use the random forest algorithm to train the training set. Random forest is an ensemble learning method that improves model performance by constructing multiple decision trees and integrating their prediction results. During the training process, optimize the model parameters (such as the number of trees, maximum depth, etc.) to minimize the prediction error.

[0087] 7. Model validation Step 7.1: Use the validation set to verify the recognition performance of the shadowless lamp AI control recognition model.

[0088] Implementation details: Input the validation set into the shadowless lamp AI control recognition model, and calculate metrics such as the accuracy, recall rate, and F1 score predicted by the model. If the metrics meet the preset standards (such as accuracy > 90%), the model is considered to pass the verification.

[0089] Step 7.2: If the verification is passed, deploy the shadowless lamp AI control recognition model on the operating room nurse's background; otherwise, repeat the above steps to reconstruct the shadowless lamp AI control recognition model.

[0090] Implementation details: If the model passes the verification, integrate it into the operating room nurse's background system to achieve the voice control function. If not, analyze the reasons for the insufficient model performance (such as data imbalance, improper feature selection, etc.), adjust the model parameters or data preprocessing methods, and reconstruct and verify the model again.

[0091] Through the above steps, a shadowless lamp AI control recognition model that can accurately identify and respond to voice commands for operating room equipment control can be constructed.

[0092] The structure and application of the random forest model will not be elaborated here.

[0093] Preferably, the main control board is integrated with: An MCU chip for logic control and calculation; An FPGA chip for image processing of the X image signal; A clock circuit for controlling timing.

[0094] The MCU chip and the FPGA chip are recommended as follows: MCU chip: STM32F103. This is a 32-bit microcontroller produced by ST (STMicroelectronics) and belongs to the STM32 series. It integrates a high-performance RISC core, high-speed memory, rich enhanced I / O ports, and peripherals, and is suitable for a variety of embedded applications. The STM32F103 series of microcontrollers are widely used in industrial automation, consumer electronics, medical equipment, and other fields due to their high performance, low power consumption, and ease of development.

[0095] FPGA Chip: Xilinx Artix-7. Xilinx is a leading supplier of FPGA technology, and the Artix-7 series is a high-performance, low-power FPGA product launched by it. It is manufactured using advanced 28nm technology, providing a rich number of logic cells, DSP modules, and I / O resources. The Artix-7 series of FPGAs supports high-speed serial transceivers and can be used to achieve high-speed data communication. In addition, it also provides a rich variety of interface options, such as PCIe, Gigabit Ethernet, etc., suitable for a variety of embedded systems, communication devices, and data center applications.

[0096] 1. MCU Chip Function: Logic Control and Calculation: The MCU chip (Microcontroller Unit) is a highly integrated microcomputer system that integrates various functional modules such as a processor core, memory storage, and peripheral device interfaces. It is responsible for executing logic control and calculation tasks, such as receiving external input signals, executing control instructions, and processing data.

[0097] Function: In the main control board, the MCU chip acts as the core controller of the system and is responsible for coordinating the work of each component. For example, it can receive signals from external devices and issue control instructions according to preset logic rules to control the FPGA chip to perform image processing or the clock circuit to measure time.

[0098] 2. FPGA Chip Function: Image Processing: The FPGA chip (Field-Programmable Gate Array) is a highly flexible programmable logic device, and users can program and reprogram its logic functions after manufacturing. In the field of image processing, the FPGA chip can efficiently execute various image processing algorithms, such as denoising, contrast enhancement, image segmentation, etc.

[0099] Function: In the main control board, the FPGA chip is responsible for receiving X image signals and performing real-time processing on them. By configuring the internal logic cells and interconnect structures of the FPGA, complex image processing algorithms can be implemented to meet specific application requirements. For example, in the field of medical imaging, the FPGA chip can be used to improve image quality and diagnostic accuracy.

[0100] 3. Clock Circuit Function: Control Timing: The clock circuit is one of the key components on the main control board. It is responsible for generating a stable clock signal to control the working rhythm and timing relationship of each component. The clock signal provides a stable time reference for the system, ensuring that each component can work according to the predetermined rhythm.

[0101] Function: In the main control board, the clock signal generated by the clock circuit is distributed to components such as the MCU chip and the FPGA chip to control their working timing. For example, the MCU chip can execute instructions and process data according to the clock signal; the FPGA chip can execute image processing algorithms according to the clock signal. At the same time, the clock circuit can also ensure the synchronization between components to avoid data exchange errors or system instability problems.

[0102] In summary, the MCU chip, the FPGA chip, and the clock circuit each play an important role on the main control board, and through collaborative work, they achieve the logical control, image processing, and timing functions of external devices. This integrated design improves the overall performance and reliability of the system and meets the requirements of complex application scenarios. The specific model is selected by the user.

[0103] Preferably, the intelligent surgical shadowless lamp further includes: A memory for caching the surgical recording video, X-ray images, and control voice data; After the voice chip analyzes and recognizes the surgical end instruction issued by the medical staff, the main control board responds to the surgical end instruction, deletes the cached data, and turns off the intelligent surgical shadowless lamp; The memory is electrically connected to the main control board.

[0104] If the surgery is over, the circulating nurse sends an end voice message. Referring to the above voice control scheme, the system issues a surgical end instruction and shuts down, deleting the cache. Waiting for the next activation.

[0105] On the other hand, an application control method for a multi-modal integrated intelligent surgical shadowless lamp is provided. The method includes the following steps: The circulating nurse activates the intelligent surgical shadowless lamp through the control panel and sends an activation request message to the surgical nurse background; The surgical nurse background responds to the activation request message and issues a corresponding preset body position strategy according to the current surgical attribute; The main control board of the intelligent surgical shadowless lamp executes the preset body position strategy. According to the control parameters in the preset body position strategy, it controls the robotic arm to extend to the preset spatial state, and at the same time turns on the shadowless lamp to the preset brightness, and conducts power-on tests on the camera and the X-ray machine respectively. The circulating nurse judges the test results: If the test state is good, the corresponding test success instruction is input through the control panel and reported by the intelligent surgical shadowless lamp to the surgical nurse background; otherwise, the corresponding test failure instruction is input and reported by the intelligent surgical shadowless lamp to the surgical nurse background, and the preset fault test instruction is issued by the surgical nurse background for self-test and repair of faults. Collect the control voice data of medical staff through the voice module and send it to the voice chip; Parse and identify the control voice data through the voice chip to obtain the control semantic information therein and send it to the main control board; Forward the control semantic information to the wireless communication module through the main control board; Report the control semantic information to the surgical nurse background through the wireless communication module; The surgical nurse background processes the control semantic information or the surgical recording video and gives feedback, including: Read the control time in the control semantic information; Input the control semantic information into the preset shadowless lamp AI control recognition model. The shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs the control strategy matching the control features; Combine the control time and the control strategy to generate the corresponding control instruction and send it to the wireless communication module of the intelligent surgical shadowless lamp. The wireless communication module forwards the control instruction to the main control board; The main control board responds to the corresponding control instruction issued by the background and controls the shadowless lamp, the camera or the X-ray machine to adjust the brightness of the shadowless lamp, perform video recording of the surgery or take X-rays; The main control board forwards the surgical recording video captured by the camera to the wireless communication module. The wireless communication module reports the surgical recording video to the surgical nurse background, and the surgical nurse background records and saves it; The main control board performs image processing on the X-ray image signal collected by the X-ray machine to generate the corresponding X-ray image and sends it to the LED display; Display the X-ray image through the LED display.

[0106] The above steps should be understood in combination with the above description and will not be elaborated here.

[0107] Figure 6 It is a schematic structural diagram of an electronic device provided by an embodiment of the present invention, as Figure 6As shown, the electronic device 410 may include a first processor 2001.

[0108] Optionally, the electronic device 410 may further include a memory 2002 and a transceiver 2003.

[0109] Among them, the first processor 2001 is connected to the memory 2002 and the transceiver 2003, such as through a communication bus.

[0110] Next, specific introductions will be made to the various components of the electronic device 410 in conjunction with Figure 6 : Among them, the first processor 2001 is the control center of the electronic device 410, which may be a single processor or a collective term for multiple processing elements. For example, the first processor 2001 is one or more central processing units (CPUs), or may be an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention, such as: one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs).

[0111] Optionally, the first processor 2001 may execute various functions of the electronic device 410 by running or executing software programs stored in the memory 2002 and calling data stored in the memory 2002.

[0112] In a specific implementation, as an embodiment, the first processor 2001 may include one or more CPUs, such as Figure 6 the CPU0 and CPU1 shown in

[0113] In a specific implementation, as an embodiment, the electronic device 410 may also include multiple processors, such as Figure 6 the first processor 2001 and the second processor 2004 shown in

[0114] Among them, the memory 2002 is used to store software programs for implementing the solution of the present invention and is controlled by the first processor 2001 for execution. The specific implementation method may refer to the above method embodiments and will not be elaborated here.

[0115] Optionally, the memory 2002 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or may also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2002 may be integrated with the first processor 2001 or may exist independently and be coupled to the first processor 2001 through an interface circuit ( Figure 6 not shown) of the electronic device 410. The embodiments of the present invention do not make specific limitations on this.

[0116] The transceiver 2003 is used to communicate with a network device or communicate with a terminal device.

[0117] Optionally, the transceiver 2003 may include a receiver and a transmitter ( Figure 6 not shown separately). Among them, the receiver is used to implement the receiving function, and the transmitter is used to implement the sending function.

[0118] Optionally, the transceiver 2003 may be integrated with the first processor 2001 or may exist independently and be coupled to the first processor 2001 through an interface circuit ( Figure 6 not shown) of the electronic device 410. The embodiments of the present invention do not make specific limitations on this.

[0119] It should be noted that Figure 6 the structure of the electronic device 410 shown does not constitute a limitation on the router. The actual knowledge structure recognition device may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0120] In addition, the technical effects of the electronic device 410 can refer to the technical effects of the multi-modal integrated intelligent surgical shadowless lamp and its application control method described in the above method embodiments, and will not be elaborated here.

[0121] It should be understood that the first processor 2001 in the embodiments of the present invention may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0122] It should also be understood that the memory in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0123] The above embodiments can be implemented in whole or in part by software, hardware (such as circuits), firmware, or any combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that contains one or more collections of available media. The available media can be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0124] It should be understood that the term "and / or" in this document is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. Here, A and B can be singular or plural. In addition, the character " / " in this document generally represents an "or" relationship between the associated objects before and after, but it may also represent an "and / or" relationship, which can be specifically understood with reference to the context.

[0125] In the present invention, "at least one" means one or more, and "a plurality" means two or more. "At least one of the following" or its similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, and c can be single or multiple.

[0126] It should be understood that in various embodiments of the present invention, the magnitudes of the serial numbers of the above processes do not mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

[0127] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0128] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and units can refer to the corresponding processes in the foregoing method embodiments, and will not be described herein again.

[0129] In several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the above-described embodiments are merely illustrative. For example, the division of the units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, or indirect couplings or communication connections of units, which can be electrical, mechanical or other forms.

[0130] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0131] In addition, the functional units in each embodiment of the present invention can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

[0132] When the above-mentioned functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or a part of this technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0133] The above is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of changes or substitutions, which should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A multi-modal integrated intelligent surgical shadowless lamp, characterized in that: The intelligent surgical shadowless lamp includes an intelligent surgical shadowless lamp and a surgical nurse backstage, wherein: (1) The intelligent surgical shadowless lamp includes a shadowless lamp, a main control board, a control panel and a power supply, and also includes: Camera, used to record surgical videos during surgery and feed the recorded surgical videos back to the main control board; X-ray machine, used for taking X-rays and feeding back X-ray image signals to the main control board; Voice module, used to collect the control voice data of medical staff and send it to the voice chip; A voice chip is used to parse and identify the control voice data, obtain the control semantic information therein and send it to the main control board; A main control board is used to forward the control semantic information or the surgical recording video to the wireless communication module; and to perform image processing on the X-ray image signal, generate a corresponding X-ray image and send it to the LED display; and to respond to the corresponding control instructions issued by the background, control the shadowless lamp, the camera or the X-ray machine, and perform shadowless lamp brightness adjustment, video recording or X-ray filming; An LED display, used for displaying the X-ray image; A wireless communication module is used to realize the communication between the intelligent surgical shadowless lamp and the surgical nurse backstage, including: reporting the control semantic information or the surgical recorded video to the surgical nurse backstage; (2) The surgical nurse backend is used to process the control semantic information or the surgical video and provide feedback, including: Reading the control time in the control semantic information; Input the control semantic information into a preset shadowless lamp AI control recognition model, and the shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs a control strategy that matches the control features; In combination with the control time and control strategy, a corresponding control instruction is generated and sent to the wireless communication module of the intelligent surgical shadowless lamp, and the wireless communication module forwards the control instruction to the main control board; The voice module is electrically connected to the voice chip; The shadowless lamp, control panel, memory, power supply, camera, X-ray machine, voice chip, wireless communication module and LED display are electrically connected to the main control board respectively; The intelligent surgical shadowless lamp is connected to the surgical nurse backstage for communication.

2. The multi-modal integrated intelligent surgical shadowless lamp according to claim 1, characterized in that: The intelligent surgical shadowless lamp also includes: A mechanical arm (100) used for supporting and installing the shadowless lamp (200), the camera (300) and the X-ray machine (400); The mechanical arm is electrically connected to the main control board.

3. The multi-modal integrated intelligent surgical shadowless lamp according to claim 2, characterized in that: The mechanical arm (100) comprises a main mechanical arm and a secondary mechanical arm, which are used to respectively support a main lamp and a secondary lamp of the shadowless lamp.

4. The multi-modal integrated intelligent surgical shadowless lamp according to claim 1, characterized in that: The method for generating the shadowless lamp AI control recognition model comprises: Prepare control voice data for the shadowless lamp, camera, X-ray machine and robotic arm respectively; Performing semantic analysis on the control voice data to generate corresponding control text information; Performing feature engineering on the control text information to identify and extract control features in the control text information; The control feature is annotated with information, and the annotated information includes: the control strategy matching the control feature, including: First driving control parameters of the shadowless lamp at different brightness levels; The second driving control parameters of the camera in the continuous shooting mode and the one-shot shooting mode respectively; The third driving control parameter of the X-ray machine in the one-shot shooting mode; The fourth driving control parameters of the robot arm at different spatial angles; Counting the control features after each labeling to obtain a feature set; Dividing the feature set into a training set and a validation set according to a preset ratio; Input the training set into a preset random forest model to perform feature training and learning to generate the shadowless lamp AI control recognition model; The recognition performance of the shadowless lamp AI control recognition model is verified using the verification set: If the verification is successful, the shadowless lamp AI control recognition model is deployed on the surgical nurse background; Otherwise, repeat the above steps to rebuild the shadowless lamp AI control recognition model.

5. The multi-modal integrated intelligent surgical shadowless lamp according to claim 1, characterized in that: The main control board is integrated with: MCU chip, used for logic control and calculation; An FPGA chip, used for performing image processing on the X image signal; Clock circuit, used to control timing.

6. The multi-modal integrated intelligent surgical shadowless lamp according to claim 1, characterized in that: The intelligent surgical shadowless lamp also includes: A memory, used for caching the surgical recording video, X-ray image and control voice data; After the voice chip parses and recognizes the end-of-surgery instruction issued by the medical staff, the main control board responds to the end-of-surgery instruction, deletes the cached data and turns off the intelligent surgical shadowless lamp; The memory is electrically connected to the main control board.

7. An application control method of the multi-modal integrated intelligent surgical shadowless lamp according to any one of claims 1 to 6, characterized in that: The method comprises the following steps: The circulating nurse activates the intelligent surgical shadowless light through the control panel and sends an activation request message to the surgical nurse backstage; The surgical nurse backstage responds to the activation request information and issues a corresponding preset posture strategy according to the current surgical attributes; The main control board of the intelligent surgical shadowless lamp executes the preset body position strategy, controls the mechanical arm to extend to the preset space state according to the control parameters in the preset body position strategy, turns on the shadowless lamp to the preset brightness, and performs power-on tests on the camera and the X-ray machine respectively. The circulating nurse determines the test result: if the test status is good, the corresponding test success command is input through the control panel and reported to the surgical nurse backstage by the intelligent surgical shadowless lamp; Otherwise, the corresponding test failure instruction is input and reported by the intelligent surgical shadowless lamp to the surgical nurse backstage, and the surgical nurse backstage issues a preset fault test instruction to perform fault self-test and repair; Collect the control voice data of medical staff through the voice module and send it to the voice chip; The control voice data is parsed and recognized by the voice chip, the control semantic information therein is obtained and sent to the main control board; forwarding the control semantic information to the wireless communication module through the main control board; Reporting the control semantic information to the surgical nurse backstage via the wireless communication module; The surgical nurse processes the control semantic information or the surgical recording video in the background and provides feedback, including: Reading the control time in the control semantic information; Input the control semantic information into a preset shadowless lamp AI control recognition model, and the shadowless lamp AI control recognition model recognizes the control features in the control semantic information and outputs a control strategy that matches the control features; In combination with the control time and control strategy, a corresponding control instruction is generated and sent to the wireless communication module of the intelligent surgical shadowless lamp, and the wireless communication module forwards the control instruction to the main control board; The main control board responds to the corresponding control instructions issued by the background, controls the shadowless lamp, camera or X-ray machine, and performs brightness adjustment of the shadowless lamp, video recording or X-ray filming; The main control board forwards the surgical video recorded by the camera to the wireless communication module, and reports the surgical video to the surgical nurse backstage through the wireless communication module, which records and saves the video; The main control board processes the X-ray image signals collected by the X-ray machine, generates corresponding X-ray images and sends them to the LED display; The X-image is displayed through an LED display.

8. An electronic device, characterized in that: The electronic device comprises: processor; A memory having computer-readable instructions stored thereon, wherein when the computer-readable instructions are executed by the processor, the method according to any one of claims 1 to 7 is implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 7.

Images