Intelligent control system

Abstract

The utility model discloses an intelligent control system. The system comprises a first voice device and a processing device. The first voice device is in communication connection with the processing device. The first voice device comprises a first voice input component and a first voice processing component, the first voice input component is configured to detect first user voice, and the first voice processing component is configured to convert the detected first user voice into a first voice signal. The processing device is configured to process the first voice signal to obtain a control instruction for controlling the target device.

Description

[0001] Cross-references

[0002] This application claims the priority of Chinese patent application No. 202311028614.6 filed on August 15, 2023, entitled “A method and system for intelligent display of a surgical screen” and the priority of Chinese patent application No. 202311028926.7 filed on August 15, 2023, entitled “A method for X-ray imaging”. The entire contents of the above applications are incorporated herein by reference. Technical Field

[0003] The utility model relates to the field of intelligent control, in particular to an intelligent control system used in the medical field. Background Art

[0004] In medical scenarios, such as DSA examinations and X-ray scans in hospitals, doctors and technicians often need to manually operate the equipment in the examination room (such as display devices, imaging devices, etc.). However, manual operation is time-consuming and labor-intensive, which will lead to low efficiency in the execution of medical processes and may also affect the normal progress of medical processes due to misoperation.

[0005] Therefore, an intelligent control system is provided to assist doctors in accurately and automatically controlling the equipment in the examination room through voice, thereby improving the efficiency and accuracy of the execution of medical procedures. Utility Model Content

[0006] The utility model provides an intelligent control system. The system may include a first voice device and a processing device. The first voice device may be connected to the processing device for communication. The first voice device may include a first voice input component and a first voice processing component, the first voice input component is configured to detect a first user voice, and the first voice processing component is configured to convert the detected first user voice into a first voice signal. The processing device may be configured to process the first voice signal to obtain a control instruction for controlling a target device. The target device may include a display device and / or a medical device.

[0007] In some embodiments, the first voice device, the processing device, and the target device may be arranged in an examination room; and / or the first voice device, the processing device, and the target device may be integrated on a same terminal device.

[0008] In some embodiments, the first voice device may further include a first voice output component, a control component, and a user interaction component. The control component may be connected to the first voice output component and the first voice input component in communication, and is configured to control the switch state of the first voice output component and the first voice input component. The user interaction component may be connected to the control component and the processing device in communication, and is configured to send the switch state of the first voice output component and the first voice input component to the processing device. The processing device may be further configured to control the connection state between it and the first voice device based on the switch state.

[0009] In some embodiments, the first voice input component and the first voice output component may be an integrated structure.

[0010] In some embodiments, the first voice device may also be configured to play feedback voice.

[0011] In some embodiments, the system may further include a second voice device installed in the control room. The second voice device may be configured to receive the first voice signal from the processing device or the first voice device and play the first user voice.

[0012] The second voice device may include a second voice output component, a second voice input component, and a second voice processing component, and the first voice signal may be sent from the first voice device to the second voice device.

[0013] In some embodiments, the system may further include a network switching device configured to implement a communication connection between the processing device and the first voice device, and a communication connection between the processing device and the second voice device.

[0014] In some embodiments, the target device may include a display device. In response to the control instruction, the display device may perform at least one of the following operations: switching a display image on the display device, playing or pausing a display image on the display device, switching a display mode of the display device, setting display parameters of a display image on the display device, processing a display image on the display device, setting a display area division method of the display device, and causing a display interface to jump to a user configuration interface.

[0015] In some embodiments, the target device may include a medical device. In response to the control instruction, the medical device may perform at least one of the following operations: controlling a component of the medical device to move, performing a medical procedure on a target area of ​​a target object, setting a working mode of the medical device, setting relevant parameters of a medical procedure corresponding to the medical device, and starting or stopping the medical procedure.

[0016] In some embodiments, the target device may include a medical device and a display device. In response to the control instruction, the display device may display the medical procedure performed by the medical device.

[0017] In some embodiments, the medical device may be a C-arm X-ray imaging device.

[0018] The utility model also provides an intelligent control system. The system may include a voice device and a processing device. The voice device may be configured to detect a user's voice and convert the detected user's voice into a voice signal. The processing device may be configured to process the voice signal to obtain a control instruction for controlling a target device. The target device may include a display device and / or a medical device. The display device may be configured to determine the display content and display mode of the display device based on part of the control instruction. The medical device may be configured to control the operation of the medical device based on at least the remaining part of the control instruction.

[0019] In some embodiments, the voice device may include a first voice device and / or a second voice device. The first voice device may be arranged in an examination room, on one or more of a display device or a medical device. The second voice device may be arranged in a control room. The second voice device may be connected to the first voice device for communication.

[0020] In some embodiments, the medical device may be a C-arm X-ray imaging device, and the display device and the medical device may be arranged adjacent to each other. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The present invention will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0022] Figure 1A is a schematic diagram of an application scenario of an exemplary intelligent control system according to some embodiments of this specification;

[0023] Figure 1B is a schematic diagram of an exemplary X-ray imaging device according to some embodiments of the present specification;

[0024] Figure 1C is an exemplary schematic diagram of an exemplary voice device according to some embodiments of the present specification;

[0025] Figure 1D is an exemplary schematic diagram of an exemplary microphone according to some embodiments of the present specification;

[0026] Figure 1E is an exemplary schematic diagram of an exemplary speaker according to some embodiments of the present specification;

[0027] Figure 2 is a block diagram of an exemplary processing device according to some embodiments of the present specification;

[0028] Figure 3 is a flowchart of an exemplary intelligent control process according to some embodiments of this specification;

[0029] Figure 4 is a flowchart of an exemplary speech recognition process according to some embodiments of this specification;

[0030] Figure 5 is an exemplary flow chart of the intelligent control process of the display device according to some embodiments of this specification;

[0031] Fig. 6A is an exemplary schematic diagram of a display interface of a display device according to some embodiments of this specification;

[0032] Figure 6B is an exemplary schematic diagram of an update display interface according to some embodiments of this specification;

[0033] Figure 7 is a flowchart of an exemplary collision detection process according to some embodiments of this specification;

[0034] Fig. 8A is an exemplary schematic diagram of controlling the movement of one or more components of an X-ray imaging device according to some embodiments of the present specification;

[0035] Figure 8B is another exemplary schematic diagram of controlling the movement of one or more components of an X-ray imaging device according to some embodiments of the present specification;

[0036] Fig. 9 is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0037] Fig.10 is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0038] Fig.11 is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0039] Fig. 12A is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0040] Fig. 12B is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0041] Fig.13 is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0042] Fig.14 is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification;

[0043] Fig.15 is a schematic diagram of a voice interaction process between a first voice device and a second voice device according to some embodiments of this specification;

[0044] Fig.16 This is a flowchart of an exemplary process of controlling a medical device according to some embodiments of this specification. DETAILED DESCRIPTION

[0045] In order to more clearly illustrate the technical solution of the utility model, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0046] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0047] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0048] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0049] Figure 1A It is a schematic diagram of an application scenario of an exemplary intelligent control system shown in some embodiments of this specification.

[0050] like Figure 1A As shown, the intelligent control system 100 may include a medical device 110, a network 120, a processing device 130, a storage device 140, a voice device 150, an image acquisition device 160, and a display device 170. The components in the intelligent control system 100 may be connected in various ways. For example, the medical device 110 and the processing device 130 may be connected or communicated through the network 120. For another example, the processing device 130 may be directly connected to the medical device 110.

[0051] The medical device 110 may be a device for performing a medical procedure, which may be installed in an examination room (such as an operating room, a scanning room). For example, the medical device 110 may include a medical scanning device for performing a medical scanning procedure (for example, an X-ray imaging device, an ultrasound scanner, a computed tomography (CT) scanner, a magnetic resonance imaging (MRI) scanner, a positron emission computed tomography (PET) scanner, an X-ray imaging-magnetic resonance imaging (X-ray-MRI) scanner, a positron emission tomography-X-ray imaging (PET-X-ray) scanner, a positron emission tomography-computed tomography (PET-CT) scanner, etc.). For another example, the medical device 110 may include a device for performing surgery (such as digital subtraction angiography (DSA) surgery, radiotherapy surgery, etc.). The above-mentioned medical devices are for illustrative purposes only and are not intended to limit the scope of this specification.

[0052] As an example only, the medical device 110 may be an X-ray imaging device. The X-ray imaging device may be used to scan a target area of ​​a target object through X-rays and generate a medical image (e.g., a scanned image). The target object may include a biological object (e.g., a human body, an animal, etc.), a non-biological object (e.g., a phantom), etc. In some embodiments, the target area of ​​the target object may include a specific part, organ, and / or tissue of the target object. For example, the target area of ​​the target object may include the head, chest, legs, etc., or any combination thereof, without limitation. In some embodiments, the target area of ​​the target object may include a specific part, organ, and / or tissue of the target object and other organs and / or tissues within a certain range around it. The target object may also be referred to as a patient hereinafter.

[0053] In some embodiments, the X-ray imaging device may include one or more components. For example, the X-ray imaging device may be a C-arm X-ray imaging device, which includes a robotic arm forearm, a robotic arm upper arm, a C-arm frame, a bed plate, etc. In some embodiments, during the movement of one or more components of the X-ray imaging device, in order to provide a timely collision warning, a pressure sensor may be installed on one or more components of the X-ray imaging device. As an example only, Figure 1BThe X-ray imaging device is shown, and pressure sensors can be installed at the tail of the forearm of the mechanical arm, the lower edge of the forearm of the mechanical arm, the lower edge of the upper arm of the mechanical arm, the tail of the wire tube package, the upper edge of the outer arc of the C-arm, the lower edge of the outer arc of the C-arm, the bottom of the bed, the flat panel detector (FD) cover, the tube cover, etc. In some embodiments, when a collision occurs at the part where the pressure sensor is installed, and the pressure of the collision is greater than the pressure threshold, the X-ray imaging device sends a collision warning to the processing device 130 through the network 120. For more information about collision warning, please refer to Figure 7 and its related description.

[0054] The network 120 may include any suitable network that facilitates information and / or data exchange of the intelligent control system 100. In some embodiments, one or more components of the intelligent control system 100 (e.g., the medical device 110, the processing device 130, the storage device 140, or the voice device 150) may transmit information and / or data to one or more other components of the intelligent control system 100 via the network 120. For example, the processing device 130 may obtain a medical image of a target object (e.g., a patient) from the medical device 110 via the network 120. In some embodiments, the network 120 may be any one or more of a wired network or a wireless network. In some embodiments, the network may be a point-to-point, shared, centralized, or other topological structure or a combination of multiple topological structures.

[0055] The processing device 130 may process data and / or information obtained from the medical device 110, the storage device 140 and / or the voice device 150. In some embodiments, the processing device 130 may be configured to process a voice signal to obtain a control instruction for controlling the target device. For example, the processing device 130 may obtain a first voice signal. For another example, the processing device 130 may perform voice recognition on the first voice signal to obtain a voice recognition result. For another example, the processing device 130 may determine whether the first user voice contains a control instruction for the target device in the examination room based on the voice recognition result. For another example, in response to determining that the first user voice contains a control instruction for the target device in the examination room, the processing device 130 may control the target device based on the control instruction. In some embodiments, the target device may include a display device 170 and / or a medical device 110. The display device 170 may be configured to determine the display content and display mode of the display device 170 based on part of the control instruction. The medical device 110 may be configured to control the operation of the medical device 110 based on at least the remaining part of the control instruction.

[0056] In some embodiments, the processing device 130 can be a single server or a server group. The server group can be centralized or distributed. In some embodiments, the processing device 130 can be local or remote. The processing device 130 can be directly connected to the medical device 110, the storage device 140 and the voice device 150 to access the stored or acquired information and / or data. In some embodiments, the processing device 130 can be implemented on a cloud platform. By way of example only, the cloud platform can include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc. or any combination thereof.

[0057] The storage device 140 may store data and / or instructions. In some embodiments, the storage device 140 may store data obtained from the medical device 110, the terminal 130, and / or the processing device 130. For example, the storage device 140 may store medical images obtained by the medical device 110, etc. In some embodiments, the storage device 140 may store data and / or instructions that the processing device 130 may execute or use to execute the exemplary methods described in this specification. For example, the storage device 140 may store instructions for the processing device 130 to execute the methods shown in the various flow charts. In some embodiments, the storage device 140 may include a mass storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. In some embodiments, the storage device 140 may be implemented on a cloud platform.

[0058] In some embodiments, the storage device 140 may be connected to the network 120 to communicate with one or more components of the intelligent control system 100 (e.g., the medical device 110, the processing device 130, the voice device 150, etc.). One or more components of the intelligent control system 100 may access data or instructions stored in the storage device 140 via the network 120. In some embodiments, the storage device 140 may be directly connected to or communicate with one or more components of the intelligent control system 100. In some embodiments, the storage device 140 may be part of the processing device 130.

[0059] In some embodiments, the processing device 130 and / or the storage device 140 may be part of the medical device 110 .

[0060] The voice device 150 can be used to realize the voice interaction between the user and the intelligent control system 100. For example, the voice device 150 can be configured to detect the user's voice and convert the detected user's voice into a voice signal. In some embodiments, the voice device 150 may include a voice input component (such as a microphone) and a voice output component (such as a speaker), wherein the microphone is used to receive the user's voice (for example, the first user's voice, the second user's voice), and the speaker is used to play the feedback voice. Exemplary microphones may include dynamic microphones, condenser microphones, electret microphones, silicon micro-microphones, liquid microphones, laser microphones, etc., or any combination thereof. Exemplary speakers may include dynamic (electric) speakers, condenser (electrostatic) speakers, piezoelectric (crystal or ceramic) speakers, electromagnetic (compression spring) speakers, ion speakers, pneumatic speakers, etc., or any combination thereof.

[0061] In some embodiments, the microphone and the speaker may be integrated into the same voice device 150. For example, Figure 1C As shown, the microphone 152 and the speaker 154 can be arranged in an integrated manner on the voice device 150. That is, the microphone 152 and the speaker 154 can be an integrated structure. In some embodiments, the microphone and the speaker can be independent devices. For example, the voice device 150 can include one or more Figure 1D The microphone device shown and one or more Figure 1E Speaker equipment shown.

[0062] In some embodiments, the number and type of microphones and / or speakers can be determined according to actual conditions. For example, in an inspection room, four microphones and one speaker can be arranged separately; in a control room, four microphones and one speaker can be arranged in one piece. For another example, when the ambient noise is greater than a noise threshold (e.g., 100 decibels (dB)), and the distance between the user and the microphone is less than a first distance threshold (e.g., 10 cm, 20 cm, 30 cm, 50 cm, etc.), a gooseneck microphone can be used. For another example, when the ambient noise is greater than the noise threshold, and the distance between the user and the microphone is greater than a second distance threshold (e.g., 1 meter, 2 meters, 3 meters, 5 meters, etc.), multiple microphones (e.g., 128 microphones) can be used for sound directional enhancement, thereby enhancing the sound in a specific area and weakening the surrounding noise.

[0063] In some embodiments, multiple microphones (or speakers) may be arranged in an array. For example, four microphones may be arranged as follows: Figure 1CFor example, the microphones (or speakers) may be arranged in a regular (e.g., circular, rectangular, square, triangular, elliptical, etc.) or irregular pattern. In some embodiments, the arrangement of the microphones and speakers needs to meet certain conditions. For example, the minimum spacing between the microphones and the speakers needs to be greater than a third distance threshold (e.g., 5 cm, 10 cm, 15 cm, etc.). For another example, the central axis of the multiple microphones and the central axis of the speaker need to be placed vertically or approximately vertically. As an example only, Figure 1C As shown, the projection of the voice device 150 can be approximated as a rectangle, the central axis of the microphone 152 (as shown by the dotted line A) is parallel to the long side of the rectangle, and the central axis of the speaker 154 (as shown by the dotted line B) is parallel to the short side of the rectangle.

[0064] In some embodiments, the voice device 150 may be a part of the processing device 130. For example, the voice device 150 may be integrated in the processing device 130 as an operating console of the medical device 110.

[0065] In some embodiments, the voice device 150 may include multiple sub-devices. For example, the voice device may include a first voice device and / or a second voice device. The first voice device may be arranged in the examination room, on one or more of the display device 170 or the medical device 110. The second voice device may be arranged in the control room. The second voice device may be connected to the first voice device for communication. For more information about the first voice device and the second voice device, see Figure 9-14 and its description.

[0066] The image acquisition device 160 can be used to acquire real-time optical images of the inspection room (e.g., a first real-time optical image, a second real-time optical image, a third real-time optical image). The image acquisition device 160 may include a camera. In some embodiments, the image acquisition device 160 may include multiple devices installed in different positions to acquire real-time optical images of the same area at different shooting angles and / or different areas. The image acquisition device 160 may include cameras (e.g., digital cameras, analog cameras, depth cameras, structured light cameras, etc.), sensors (e.g., red, green, blue (RGB) sensors, RGB depth (RGB-D) sensors, etc.), laser imaging devices (e.g., phase laser acquisition devices, point laser acquisition devices, etc.), and other devices that can acquire optical image data of the target object.

[0067] The display device 170 can be used to display relevant information of each medical link in the medical process. For example, the display device 170 can display real-time optical images. For another example, the display device 170 can display the medical images of patients in the medical process, the change information or curve graphs of physiological indicators (such as blood pressure, heart rate, etc.). For another example, the display device 170 can display feedback information (for example, the content of the feedback voice) after executing the control instruction. The display device 170 may include a liquid crystal display (LCD), a display based on a light emitting diode (LED), a flat panel display, a curved display, a television device, a cathode ray tube (CRT), etc., or any combination thereof. In some embodiments, the display device 170 and the medical device 110 can be arranged adjacent to each other.

[0068] In some embodiments, the voice device 150, the image acquisition device 160 and / or the display device 170 may be integrated on the same device. In some embodiments, the voice device 150, the image acquisition device 160 and the display device 170 may be different devices.

[0069] In some embodiments, the voice device 150, the image acquisition device 160 and / or the display device 170 can be installed at any position in the examination room. For example, the voice device 150, the image acquisition device 160 and / or the display device 170 can be fixed to a fixed position (e.g., the ceiling) in the examination room by a detachable or non-detachable connection. For another example, the examination room can be equipped with a slide rail, and the voice device 150, the image acquisition device 160 and / or the display device 170 can be installed on the slide rail by a detachable or non-detachable connection, so that the position of the voice device 150, the image acquisition device 160 and / or the display device 170 can be flexibly adjusted according to the user's position.

[0070] In some embodiments, the intelligent control system 100 may further include a system control device (not shown in the figure). The system control device refers to a device used to control a target device (e.g., medical device 110, voice device 150, image acquisition device 160, and / or display device 170). In some embodiments, the system control device may include a system controller unit (SCU) for executing control instructions related to the target device. For example, the system control device may control the rack of the medical device 110 to move to a specific position and adjust one or more parameters of the medical device 110 (e.g., a ray switch, etc.) through the system control unit.

[0071] In some embodiments, the system control device may include multiple system control units set for different medical procedures. For example, the system control device may include a system control unit for X-ray imaging, a system control unit for DSA examination, etc. Different system control units may include different sets of control instructions, which may be predetermined according to the medical procedure (such as pre-set according to the scanning protocol). The system control unit of the system control device implements the operation of the target device by executing one or more control instructions. In some embodiments, the system control device may be a part of the medical device 110. In some embodiments, the system control device and the processing device 130 may be integrated into one device.

[0072] In some embodiments, the components of the intelligent control system 100 may be arranged in the same room. Figure 1A As shown, medical equipment 110, network 120, processing equipment 130, storage equipment 140, voice equipment 150, image acquisition device 160 and display equipment 170 can be arranged in the examination room. In some embodiments, some components of the intelligent control system 100 can be arranged in different rooms. For more description on how some components of the intelligent control system are arranged in different rooms, see Figure 9-14 and its description.

[0073] In some embodiments, multiple components of the intelligent control system 100 can be integrated on the same terminal device. For example, the voice device 150 and the processing device 130 can be integrated on the medical device 110. For another example, the voice device 150, the processing device 130 and the display device 170 can be integrated on the same terminal device (e.g., the medical device 110).

[0074] It should be noted that the intelligent control system 100 is provided for illustrative purposes only and is not intended to limit the scope of the present application. For those of ordinary skill in the art, various modifications or variations can be made based on the description of this specification. For example, the intelligent control system 100 may also include a database, an information source, etc. For another example, the intelligent control system 100 may be implemented on other devices to achieve similar or different functions. However, the changes and modifications will not deviate from the scope of this specification.

[0075] Figure 2 2 is a block diagram of an exemplary processing device according to some embodiments of the present specification. The processing device 130 may include an acquisition module 210 , an identification module 220 , a determination module 230 , and a control module 240 .

[0076] The acquisition module 210 may be used to acquire a first voice signal. The first voice signal may be generated by a first voice device by detecting a first user's voice, and the first voice device may be installed in the examination room. For more information about acquiring the first voice signal, please refer to Figure 3 Step 310 and its related description.

[0077] The recognition module 220 can be used to perform speech recognition on the first speech signal to obtain a speech recognition result. For more information about obtaining the speech recognition result, please refer to Figure 3 Step 320 and its related description.

[0078] The determination module 230 may be used to determine whether the first user's voice contains a control instruction for a target device in the examination room based on the voice recognition result. The target device may include a display device (e.g., display device 170) and / or a medical device (e.g., medical device 110) installed in the examination room. For more information on determining whether the first user's voice contains a control instruction for a target device in the examination room, please refer to Figure 3 Step 330 and its related description.

[0079] The control module 240 may be used to control the target device in the examination room based on the control instruction in response to determining that the first user's voice contains a control instruction for the target device in the examination room. For more information about controlling the target device, please refer to Figure 3 Step 340 and its related description.

[0080] Each module in the processing device 130 can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0081] It should be noted that the above description of the processing device 130 and its modules is only for convenience of description and does not limit the present specification to the scope of the embodiments. It is understandable that, after understanding the principle of the processing device 130, those skilled in the art may arbitrarily combine the modules or form sub-devices to connect with other modules without deviating from the principle. For example, Figure 2 The acquisition module 210, identification module 220, determination module 230 and control module 240 disclosed in the specification can be different modules in a system, or one module can realize the functions of the above two modules. For another example, each module in the processing device 130 can share a storage module, or each module can have its own storage module. Such variations are all within the protection scope of this specification.

[0082] Figure 3 300 is a flowchart of an exemplary intelligent control process according to some embodiments of the present specification. In some embodiments, process 300 may be executed by intelligent control system 100. For example, process 300 may be stored in a storage device (e.g., storage device 140) in the form of an instruction set (e.g., an application program). In some embodiments, processing device 130 (e.g., Figure 2 One or more modules shown in the figure) can execute the instruction set and correspondingly instruct one or more components of the intelligent control system 100 to execute the process 300.

[0083] Medical procedures usually require the collaboration of multiple people. For example, doctors in examination rooms (e.g., scanning rooms or operating rooms) need to manually operate the control box and / or touch panel of medical equipment to control the medical equipment while performing examinations or operations, which can easily interrupt the examinations or operations and even affect the safety of patients in emergencies. For another example, doctors need to communicate with technicians to assist in completing the relevant operations of the medical process, which places high demands on the technicians' professional skills, proficiency, and degree of cooperation with doctors. In addition, each operation in the medical process requires multiple rounds of feedback from doctors and technicians, which greatly affects the execution efficiency and safety of the medical process.

[0084] Therefore, it is necessary to provide an intelligent control method to assist users in controlling target devices through voice and improve the efficiency and safety of medical procedures. In some embodiments, intelligent control can be achieved by executing the following operations of process 300.

[0085] In step 310 , the processing device 130 (eg, the acquisition module 210 ) may acquire a first speech signal.

[0086] The first voice signal can be generated by the first voice device by detecting the first user's voice. The first voice device can be installed in the examination room. For more description of the voice device, see Figure 1A , 1C -1E and 9-14 and their descriptions.

[0087] The first user voice refers to the voice of at least one user (also referred to as the first user) in the examination room. The at least one user may include a doctor (such as a surgeon), a nurse, a technician (such as a technician assisting the surgeon, a technician making calls, etc.) performing a medical procedure, or any combination thereof. In some embodiments, the first user voice is emitted before or during the execution of the medical procedure.

[0088] The medical process may be a scanning process, a surgical process, a treatment process, etc., which may include multiple medical links. As an example only, the medical process may include a preparation link for a scan plan, a scan execution link, a preparation link for treatment or surgery, an execution link for treatment or surgery, a postoperative treatment link, etc., or any combination thereof. Medical processes have different types, which may be determined according to different medical scenarios (such as the scanned area of ​​interest, the type of surgery). For example, a DSA surgical scenario corresponds to a DSA medical process. In some embodiments, the medical links included in different types of medical processes may be predetermined.

[0089] The first voice signal may be a digital signal. For example, the first voice device may detect or collect the first user voice, and convert the first user voice into the first voice signal for subsequent processing. For another example, the first voice device may detect or collect the first user voice, and convert the first user voice into an initial voice signal, and then process the initial voice signal to generate a voice signal. The processing includes at least noise reduction processing.

[0090] It is understandable that various types of noise may exist in a voice detection environment (for example, an inspection room), such as various types of equipment noise (such as mechanical noise, etc.), environmental noise (such as traffic noise, etc.), etc. The initial voice signal refers to the initial digital signal generated after the first user's voice is converted. Noise reduction processing refers to the process of removing the noise signal in the initial voice signal. Noise reduction processing can be performed based on various audio noise reduction algorithms such as time domain filtering algorithms and frequency domain filtering algorithms. For example, the first voice device can perform noise reduction processing on the initial voice signal. In some embodiments, the first voice device can also perform noise reduction processing on the first user's voice it receives, and then convert the noise-reduced voice into a first voice signal.

[0091] By performing noise reduction processing on the first user's voice through the first voice device, the computing load of the processing device 130 can be reduced compared to performing noise reduction processing on the processing device 130 .

[0092] In some embodiments, the processing device 130 may obtain the first voice signal from a first voice device (e.g., voice device 150). Alternatively, the processing device 130 may obtain the first voice signal from a storage device storing the first voice signal (e.g., storage device 140, external storage device, etc.).

[0093] In step 320 , the processing device 130 (eg, the recognition module 220 ) may perform speech recognition on the first speech signal to obtain a speech recognition result.

[0094] The speech recognition result may be in the form of text, which may indicate the speech content of the first user's speech. In some embodiments, the processing device 130 may process the first speech signal through various speech recognition technologies to obtain a speech recognition result. For example, the processing device 130 may process the first speech signal through a language processing model to obtain a speech recognition result. The language processing model includes one or a combination of acoustic models such as a hidden Markov neural network (Hidden Markov Model, HMM), a BERT (Bidirectional Encoder Representations from Transformer) model, a GPT (Generative Pre-Trained Transformer) model, and the like. In some embodiments, the language processing model may be a large language model.

[0095] In some embodiments, language processing models can be trained for different medical processes or different medical scenarios. For example, the language processing model may include a model for a DSA surgery scenario, a model for a lung tumor resection surgery scenario, etc. It can also be a model for a certain surgeon (such as a surgeon in charge) or a technician (such as a shouting technician) in a certain medical scenario (such as a DSA surgery scenario). It can be understood that training different language processing models for different medical processes and different users can improve the accuracy of speech recognition.

[0096] In some embodiments, the speech recognition result may be in other forms recognizable by the processing device 130 , such as an electrical signal, a code, a coded instruction, etc. indicating the speech content of the first user's speech.

[0097] In some embodiments, the speech recognition result may include control instructions related to the target device. As an example, the speech recognition result may be "move the rack to the left position", etc. The speech recognition result may also include other communication content, such as the doctor's instructions to the patient, daily communication between medical staff, etc.

[0098] In some embodiments, the speech recognition result may indicate the target user's speech content. The target user refers to a preset user who is allowed to control the medical procedure. For example, the target user may be a user who is allowed to adjust the parameters of the scanning device, a user who is allowed to control the start or stop of the medical scan, etc. In some embodiments, the target user may be determined based on a medical protocol related to the medical procedure (such as a scanning protocol, an examination protocol, etc.).

[0099] In some embodiments, the processing device 130 may determine, based on the first voice signal, the first voiceprint information of at least one user corresponding to the first voice signal; determine, based on the first voiceprint information of at least one user, whether the at least one user includes a target user; in response to determining that the at least one user includes the target user, determine a target voice signal corresponding to the target user; and perform voice recognition on the target voice signal to obtain a voice recognition result. For more descriptions on performing voice recognition on the target voice signal to obtain a voice recognition result, see Figure 4 and its description.

[0100] In step 330 , the processing device 130 (eg, the determination module 230 ) may determine, based on the speech recognition result, whether the first user's speech contains a control instruction for a target device in the examination room.

[0101] A target device is a device that a user (such as a target user) wants to control. For example, a target device may include Figure 1A One or more of the medical equipment 110 , the voice equipment 150 , the image acquisition device 160 and the display device 170 .

[0102] A control instruction refers to an instruction for controlling a target device to perform a specific operation. For example, when the target device includes a display device installed in an inspection room, the control instruction may include an instruction for switching a display image on the display device, an instruction for playing or pausing a display image on the display device, an instruction for switching a display mode (such as a road map mode) of the display device, an instruction for setting display parameters (such as image size, resolution, and presentation angle) of a display image on the display device, an instruction for processing a display image on the display device, an instruction for setting a display area division method of the display device, an instruction for causing the display interface to jump to a user configuration interface, or any combination thereof. Exemplarily, the processing of the display image includes saving the display image, sending the display image to a user terminal, performing noise reduction processing on the display image, performing subtraction operations on the display image, and the like.

[0103] For another example, when the target device includes a medical device installed in an examination room (for example, an X-ray imaging device), the control instructions may include instructions for motion control of components of the medical device (such as a rack, a bed), instructions for the medical device to perform a medical procedure on a target area of ​​a target object, instructions for switching or setting an operating mode of the medical device (such as a DSA mode, a GCT mode), instructions for setting relevant parameters of a medical procedure corresponding to the medical device (such as scanning parameters, radiotherapy parameters, etc.), instructions for the medical device to start or stop a medical procedure, etc., or any combination thereof.

[0104] For another example, when the target device includes an image acquisition device (e.g., image acquisition device 160) installed in an examination room, the control instructions may include instructions for motion control of the image acquisition device, instructions for adjusting shooting parameters of the image acquisition device (e.g., focal length, exposure time, etc.), instructions for causing the image acquisition device to send captured real-time optical images, etc., or any combination thereof.

[0105] For another example, when the target device includes a voice device (e.g., voice device 150) installed in an examination room, the control instructions may include instructions for motion control of the voice device, instructions for adjusting the acquisition parameters of the voice device (e.g., the position, orientation, noise reduction, etc. of the microphone), instructions for adjusting the playback parameters of the voice device (e.g., the position, orientation, volume, etc. of the speaker), etc., or any combination thereof.

[0106] In some embodiments, the processing device 130 may pre-process the speech recognition result. For example, the processing device 130 may process the speech recognition result based on information extraction technology to determine the keywords contained in the speech recognition result, and then determine whether the speech recognition result contains control instructions related to the target device. Keywords may include the target device and one or more components thereof. For another example, the processing device 130 may compare the speech recognition result with a preset keyword corresponding to a target device. If the speech recognition result contains the preset keyword, it can be determined that the first user's voice contains the control instruction for the target device.

[0107] In some embodiments, the processing device 130 may further perform structured processing on the speech recognition result to determine the structured control instruction, and then determine whether the speech recognition result includes the control instruction based on the preset control instruction set and the structured control instruction corresponding to the speech recognition result. For more description on determining whether the speech recognition result includes the control instruction, please refer to Fig.16 and its description.

[0108] If it is determined that the first user voice contains a control instruction for the target device in the examination room, the processing device 130 may execute step 340. If it is determined that the first user voice does not contain a control instruction for the target device in the examination room, the processing device 130 may execute step 350 or end the process 300.

[0109] In step 340 , the processing device 130 (eg, the control module 240 ) may control the target device based on the control instruction.

[0110] For example, the control instruction is a control instruction for the display device 170, and the processing device 130 can control the display device 170 based on the control instruction. Accordingly, in response to the control instruction, the display device 170 can perform at least one of the following operations: switching the display image on the display device 170, playing or pausing the display image on the display device 170, switching the display mode of the display device 170, setting the display parameters of the display image on the display device 170, processing the display image on the display device 170, setting the display area division method of the display device 170, and causing the display interface to jump to the user configuration interface. For more descriptions on controlling the display device 170 based on the control instruction, see Figure 5-6B and its description.

[0111] For another example, the control instruction is a control instruction for the medical device 110, and the processing device 130 can control the medical device 110 based on the control instruction. Accordingly, the medical device 110 can perform at least one of the following operations in response to the control instruction: control the movement of a component of the medical device 110, perform a medical procedure on a target area of ​​a target object, set the working mode of the medical device 110, set relevant parameters of the medical procedure corresponding to the medical device 110, start or stop the medical procedure, etc. For more descriptions on controlling the medical device 110 based on the control instruction, see Figure 7-8B and its description.

[0112] In some embodiments, based on the control instruction, the processing device 130 may also control the display device 170 to display the operation performed by the medical device 110. For example, in response to the control instruction, the display device 170 may display the medical procedure performed by the medical device 110.

[0113] In some embodiments, the processing device 130 may determine whether the first user's voice contains a wake-up word based on the voice recognition result. The wake-up word may indicate that the first user's voice is related to the voice control mode. Among them, the wake-up word may be a preset word used to distinguish the content of daily communication, for example, A01, B02, etc. The description of the wake-up word here is only an example and is not intended to limit the form of the wake-up word. If it is determined that the first user's voice contains a wake-up word and contains a control instruction for the target device, the processing device 130 may control the target device in response to the control instruction. In other words, the user needs to issue a wake-up word and a control instruction at the same time to control the target device. In this way, the security risk of control can be increased.

[0114] In some embodiments, when the voice control mode is turned on, or within a preset time period after the user issues a wake-up word, the user does not need to issue a wake-up word, but only needs to issue a control instruction to control the target device. In this way, repeated wake-up operations can be avoided and control efficiency can be improved.

[0115] In some embodiments, the processing device 130 may send a control instruction to the system control device so that the system control device controls the target device (eg, medical device). For more information about enabling the system control device to control the medical device, see Fig.16 and its description.

[0116] In step 350 , the processing device 130 (eg, the control module 240 ) may control the first voice device to play the feedback voice.

[0117] Feedback voice refers to voice containing the execution status of the control instruction. For example, the feedback voice may include feedback voice on whether the control instruction has been executed (for example, the first voice device plays "the control instruction has been executed", "the control instruction execution failed"), feedback voice containing prompt information for the next operation (for example, the first voice device plays "the control instruction has been executed, whether to perform imaging", "the control instruction execution failed, confirm whether the target device is abnormal"), etc., or any combination thereof.

[0118] In some embodiments, the processing device 130 may determine the security level of the control instruction based on the voice recognition result, and then determine the content of the feedback voice based on the security level. Further, the processing device 130 may control the first voice device to play the feedback voice based on the content of the feedback voice. For example, the types of security levels and the control instructions and feedback voice contents corresponding to each security level may be predetermined, and the corresponding relationship may be stored in the form of a comparison table. The processing device 130 may determine the security level and feedback voice content of the control instruction in the voice recognition result according to the comparison table.

[0119] As an example only, the corresponding security level and feedback voice content can be determined according to the security risk of the device operation corresponding to each control instruction and the feedback of the device. For example, the security level can be divided into four categories: A, B, C, and D. Among them, Class A corresponds to control instructions with high security risks and no protective measures, such as ray unlocking, motion unlocking, etc. The feedback voice content corresponding to the control instructions of Class A can be a request for user voice confirmation (such as "Please confirm whether to emit rays"). Class B corresponds to control instructions with high security risks but protective measures, such as the modification of relevant parameters such as motion, rays, and protocols. The feedback voice content corresponding to the control instructions of Class B can be a repeated control instruction (such as "C-arm adjusted to the positive position") to ensure that the user knows the upcoming operation. Class C corresponds to control instructions with low security risks but unclear feedback, such as the modification of relevant parameters of the display device and the prompt of the end of the line release. The feedback voice content corresponding to the control instructions of Class C can be a prompt tone corresponding to successful execution or a prompt tone corresponding to failed execution. Class D corresponds to control instructions with low security risks and obvious feedback, such as canceling the alarm. The feedback voice content corresponding to the control instructions of Class D can be no additional prompts.

[0120] In some embodiments, the processing device 130 may also control the display device to display the content of the feedback voice. For example, the processing device 130 may send the feedback voice content to the display device to control the display device to display the content of the feedback voice in the form of text, image, color, etc.

[0121] In some embodiments, the feedback voice may also include an answer to the inquiry in the first user's voice. For example, the processing device 130 may determine whether the first user's voice contains an inquiry based on the voice recognition result. If the first user's voice contains an inquiry, the processing device 130 may determine the answer information corresponding to the inquiry and control the first voice device to play the answer information. In some embodiments, the processing device 130 may also control the display device to display the answer information.

[0122] In some embodiments, the feedback voice may also include a prompt for an abnormal situation. For example, the processing device 130 may obtain abnormal feature information of the target object and control the first voice device to play the abnormal feature information. In some embodiments, the processing device 130 may also control the display device to display the abnormal feature information.

[0123] In some embodiments of this specification, by determining whether the first user's voice contains a control instruction for the target device, intelligent voice control of the target device can be achieved. Therefore, the doctor can directly interact with the target device by voice without manually controlling the target device, thereby reducing the number of medical staff required in the medical process, improving the execution efficiency and accuracy of the medical process, and ensuring that the medical process is carried out more smoothly.

[0124] It should be noted that the above description of process 300 is provided for illustrative purposes only and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various changes and modifications can be made under the guidance of this specification. However, these changes and modifications do not depart from the scope of this specification. In some embodiments, process 300 can be completed by one or more undescribed additional operations and / or omitting one or more operations discussed above.

[0125] For example, before step 310, process 300 may further include step 302, where the processing device 130 may enable the voice control mode. Specifically, the processing device 130 may obtain the second voice signal and determine whether the second user voice contains the wake-up word. If it is determined that the second user voice contains the wake-up word, the processing device 130 may enable the voice control mode. The second voice signal may be generated by the first voice device by detecting the second user voice.

[0126] Figure 4 is a flowchart of an exemplary speech recognition process according to some embodiments of this specification. In some embodiments, Figure 3 Operation 320 in the above process can be implemented by executing process 400 .

[0127] In step 410, the processing device 130 (eg, the recognition module 220) may determine first voiceprint information of at least one user corresponding to the first voice signal based on the first voice signal.

[0128] The first voiceprint information refers to the voice feature information of at least one user who makes the first user voice, which can be used to determine the identity of at least one user, for example, a specific doctor, technician, nurse, etc.

[0129] In some embodiments, the processing device 130 may perform voiceprint feature extraction processing on the first voice signal based on voiceprint recognition technology, etc., to obtain first voiceprint information of at least one user corresponding to the first voice signal.

[0130] In step 420, the processing device 130 (eg, the identification module 220) may determine whether the at least one user includes a target user based on the first voiceprint information of the at least one user.

[0131] In some embodiments, the processing device 130 may obtain the target voiceprint information corresponding to the target user. The target voiceprint information refers to the voiceprint information of the target user (such as a voiceprint feature vector). For example, the processing device 130 may obtain the target voiceprint information corresponding to the target user from a voiceprint feature library. The voiceprint feature library may store the voiceprint information of multiple users (such as doctors, nurses, technicians, and other personnel in a hospital). Exemplarily, the voices of different doctors, medical staff, and the like may be collected in advance, and the voiceprint information corresponding to each user may be generated based on the voiceprint extraction technology, thereby generating a voiceprint feature library based on the identity information of each user (such as name, work number, etc.) and its corresponding voiceprint information. The voiceprint feature library may be stored on the storage device 140, or on an independent storage device.

[0132] In some embodiments, the processing device 130 may determine whether the at least one user includes the target user by comparing the first voiceprint information of the at least one user with the target voiceprint information. For example, the processing device 130 may perform voiceprint matching processing on the first voiceprint information of each user in the at least one user and the target voiceprint information to determine whether the user is the target user. Exemplarily, the processing device 130 may determine the similarity between the first voiceprint information of each user and the target voiceprint information, and whether the voiceprint similarity is greater than a preset similarity threshold. If the similarity between the first voiceprint information of the user and the target voiceprint information of a target user is greater than the preset similarity threshold, the user is determined to be the target user.

[0133] In some embodiments, for each user in at least one user, the processing device 130 can determine the identity information of the user based on the first voiceprint information, and determine the speech weight of the user based on the identity information of the user. Further, the processing device 130 can determine whether the user is a target user based on the speech weight of the user. For example, the processing device 130 can predetermine the speech weight of each user based on the user's work information (e.g., position, years of work, number of surgeries performed, etc.), and store it in a storage device (e.g., storage device 140, independent storage device). After determining the identity information of each user in at least one user based on the first voiceprint information, the speech weight of each user can be determined, and whether the speech weight is greater than a preset authority threshold. If the user's speech weight is greater than the preset authority threshold, the user is determined to be a target user.

[0134] If it is determined that the at least one user includes the target user, the processing device 130 may execute step 430. If it is determined that the at least one user does not include the target user, the processing device 130 may execute the end process 400. In some embodiments, if it is determined that the at least one user does not include the target user, the processing device 130 may determine that the first user's voice does not include a control instruction for the target device in the examination room.

[0135] In step 430 , the processing device 130 (eg, the recognition module 220 ) may determine a target speech signal corresponding to the target user.

[0136] In some embodiments, the processing device 130 may determine the speech signal corresponding to the target user as the target speech signal. For example, if the at least one user includes only the target user, the processing device 130 may determine the first speech signal as the target speech signal. For another example, if the at least one user includes the target user and other users, the processing device 130 may use a speech signal extraction algorithm to extract the speech signal corresponding to the target user from the first speech signal, and determine the speech signal corresponding to the target user as the target speech signal.

[0137] In step 440 , the processing device 130 (eg, the recognition module 220 ) may perform speech recognition on the target speech signal to obtain a speech recognition result.

[0138] In some embodiments, the processing device 130 may process the target speech signal through various speech recognition technologies to obtain a speech recognition result. For more descriptions of speech recognition technologies, please refer to step 320.

[0139] In some embodiments of this specification, the identity of the speaking user is identified through voiceprint information analysis, and only the target voice signal corresponding to the target user is extracted for voice recognition. In this way, the influence of the voice of non-target users on the control of medical procedures can be avoided, and the accuracy and safety of medical equipment operation control can be improved, thereby ensuring that the medical procedures are carried out more smoothly.

[0140] Figure 5 500 is an exemplary flow chart of the intelligent control process of the display device according to some embodiments of the present specification. In some embodiments, process 500 is a specific embodiment of process 300.

[0141] In the medical process, it is often necessary to use a display device to display the display content corresponding to each medical link (such as before execution, during execution, etc.) to assist doctors in performing medical activities (such as medical scanning, surgery). However, the display configuration and display content of the display interface are often more complicated, and adjustments are often more frequent. In addition, the usage habits and configuration preferences of different users (such as doctors) are very different, and manual adjustments are often time-consuming and laborious. In particular, for relevant medical staff who are not familiar with the functions or functional interfaces of the display interface, it is necessary to spend a lot of time to train on the use of the system. During the intense medical activities, adjustments are often prone to errors, which may seriously affect the normal progress of medical activities. Therefore, it is necessary to provide an effective system and method for intelligently controlling display devices. In some embodiments, the display device can be intelligently controlled by executing the following operations of process 500.

[0142] In step 510 , the processing device 130 (eg, the acquisition module 210 ) may acquire a second speech signal.

[0143] The second voice signal is generated by the first voice device by detecting the second user's voice. The second voice signal can be obtained in a similar manner to the first voice signal, which will not be described in detail here.

[0144] The second user voice refers to the voice uttered by at least one second user participating in the medical procedure. For example, the second user voice may be the voice uttered by a person such as a doctor, a nurse, or a technician participating in the medical procedure.

[0145] In some embodiments, the second user voice is issued before the medical procedure is performed. The second voice signal can be used to initially configure the display interface of the display device (e.g., display device 170) before the medical procedure is performed. The initial configuration may include determining initialization parameters of the display interface and generating an initial display interface. For relevant content about the initial display interface, see Fig. 6A and its description.

[0146] In step 520, the processing device 130 (eg, the determination module 230) may determine, based on the second voice signal, second voiceprint information of at least one second user corresponding to the second voice signal.

[0147] The second voiceprint information refers to the voice feature information of at least one second user, which can be used to determine the identity of at least one second user. In some embodiments, the processing device 130 can perform voiceprint feature extraction processing on the second voice signal based on voiceprint recognition technology, etc. to obtain the second voiceprint information corresponding to the second voice signal.

[0148] In step 530, the processing device 130 (eg, the control module 240) may determine initial display parameters of the display device based on the second voiceprint information.

[0149] The initial display parameters refer to parameters used to determine the initial display interface of the display device.

[0150] In some embodiments, the processing device 130 may present different initial display interfaces according to different user display preferences. The initial display interface may include an initial segmentation scheme of the screen, which includes parameter configurations such as the number, size, and arrangement of the initial display areas in the screen. Among them, the user display preferences may include display parameters that the user is interested in. It can be understood that users have different preferences for parameters such as the background, color, display area division, and arrangement of the display interface. For example, users of different ages, genders, and vision have different preferences for the size (such as length, width), position (such as left, middle, top, etc.) of the display area of ​​interest, the font and size of the displayed content, etc.

[0151] In some embodiments, the processing device 130 can record and store historical display interface configurations of different users (such as display configurations of medical links before executing various types of medical procedures), and determine the display preferences of each user based on the historical display interface configurations (such as the most frequently used configuration records).

[0152] In some embodiments, the processing device 130 can determine the identity of at least one second user based on the second voiceprint information, and determine the display preference of at least one second user according to the identity, thereby determining initial display parameters related to the display interface to complete the initialization of the display interface.

[0153] In some embodiments, the processing device 130 may determine the identity of at least one second user based on the second voiceprint information, and determine the medical procedure to be performed based on the identity of the at least one second user. Further, the processing device 130 may determine the initial display parameters related to the display interface based on the medical procedure to be performed to complete the initialization of the display interface.

[0154] In some embodiments, the processing device 130 can determine whether the at least one second user includes the target user based on the second voiceprint information. The target user refers to a user who has operation authority on the display device among the at least one second user participating in the medical process. In some embodiments, different operation authorities can be configured for different target users; for the same operation authority, different speech weights can be configured for different target users, and the instructions of the target user with a greater speech weight need to be processed first. In some embodiments, the method for determining whether the at least one second user includes the target user can be similar to the method for determining whether the at least one first user includes the target user described in step 420.

[0155] If it is determined that the at least one second user includes the target user, the processing device 130 may determine the initial display parameters of the display device based on the identity information of the target user. If it is determined that the at least one second user does not include the target user, the processing device 130 may end the process 500.

[0156] In step 540 , the processing device 130 (eg, the acquisition module 210 ) may acquire a first speech signal.

[0157] The first voice signal may be generated by the first voice device by detecting the first user's voice. In some embodiments, the first voice signal is detected during a medical procedure (such as scanning, surgery). For more information about obtaining the first voice signal, see Figure 3 and its description.

[0158] In step 550 , the processing device 130 (eg, the determination module 230 ) may determine whether the first user voice includes a control instruction for the display device.

[0159] The processing device 130 may execute step 320 to determine the speech recognition result; and determine whether the first user's speech contains a control instruction for the display device based on the method described in step 330 .

[0160] In response to determining that the first user voice includes a control instruction for the display device, the processing device 130 may execute step 560 to control the display device based on the control instruction.

[0161] For example, the processing device 130 can determine the updated display parameters related to the display interface based on the voice recognition result, so as to update the display interface. The updated display parameters refer to the display parameters and their corresponding parameter values ​​used to adjust one or more display areas of the display interface. For example, the updated display parameters can be used to enlarge or reduce a certain display area (adjustment of length or width), translate (position coordinates), rotate, transparency, hide / display, etc. The updated display parameters can also be used to adjust or process the display content in the display area, such as switching, sending, selecting, playing, rotating, scaling, etc. of the displayed image, adjusting the color and font size of the text in the display area, etc. As an example only, for DSA surgical scenes (DSA medical procedures), the updated display parameters may include saving of perspective sequences, sending references, selecting specific sequences, playing / pausing, switching of upper and lower frames, switching of upper and lower sequences, switching of subtracted original images, etc. However, it is not limited to this, and the method of updating the display parameters and the updated display parameters can be arbitrarily determined as needed.

[0162] In some embodiments, for each first voice signal, the processing device 130 can determine the identity of the sender of the voice signal through voiceprint analysis, and determine whether the sender is the target user described in step 530. If the sender of a first voice signal is the target user (such as the doctor or technician in charge of the operation), the first voice signal will be used as the target voice signal to determine the update display parameters.

[0163] In some embodiments, the processing device 130 can also determine to update display parameters based on speech weight. For example, the speech weight of the surgeon can be set larger, the speech weight of the assisting medical staff can be set smaller, and the speech weight of the user specified in the non-medical process can be set to 0. The processing device 130 can determine to update the display parameters based on the user identity corresponding to the first voice signal and its speech weight. For example, the first voice signal corresponding to the maximum speech weight needs to be processed first; if the speech weight is 0, no response is given. In this way, the accuracy and efficiency of updating the display interface can be improved, and the waste of computing resources and time caused by unnecessary updates can be avoided.

[0164] In some embodiments, the processing device 130 may also generate predicted display parameters based on the adjustment of the display interface by updating the display parameters. Typically, updates of different display areas in the display interface are linked, and adjustments to one display area may affect other display areas. Exemplarily, display area A is adjacent to display area B on the left and right, and if display area A is enlarged (such as increasing the horizontal width), display area B can be reduced. The processing device 130 can determine the predicted display parameters based on the linkage relationship between the areas. For example, in response to the enlargement of display area A, the predicted display parameters may be to reduce display area B, or reduce its transparency or hide it.

[0165] In some embodiments, the predicted display parameters may also be related to user display preference parameters. For example, the display parameters preferred by the target user may be determined based on the display parameter adjustment record of the target user. In some embodiments, the predicted display parameters may also be related to the overall aesthetics of the display interface.

[0166] By predicting display parameters, the target user can be assisted in configuring the display interface, thereby reducing the user's overall adjustment workload and adjustment time for the display interface and improving the user experience.

[0167] In some embodiments, the processing device 130 can determine feedback information (e.g., feedback voice, feedback display information, etc.) based on the predicted display parameters. Feedback information can be used to provide users with update suggestions for interface parameters. In some embodiments, feedback information may also include other types of information. For example, equipment usage problems (product introduction), operating process problems (such as instructions for a certain process in the system), equipment failures (such as software exception information), etc. As an example only, when updating the display interface, if the processing device 130 detects software or hardware failure information, the user can be reminded through feedback information. For example, feedback information is played through a first voice device, feedback display information is displayed through a display device, etc. In some embodiments of this specification, human-computer interaction can be achieved through feedback information, and targeted suggestions or feedback can be provided to users to enhance user experience.

[0168] In some embodiments, the display device includes a target display area configured to display characteristic information of the target object. The processing device 130 can obtain abnormal characteristic information of the target object, and based on the abnormal characteristic information, update the display mode of the target display area. Exemplarily, when the updated content and / or data (such as blood pressure, blood sugar, heart rate and other key data) in the target display area is abnormal data below or above the critical value, the abnormal data of the target display area can be presented in a highlighted or flashing form to attract the user's attention. In some embodiments, the processing device 130 can also control the first voice device or the wearable device worn by the target user to issue a warning message. For example, the processing device 130 can play a warning message through the first voice device to notify the user, so that the user does not have to pay attention to the screen all the time and can know the occurrence of abnormal conditions in time. For another example, the processing device 130 can send the warning message to the earphones, special bracelets, mobile devices of the user, etc. worn by the user, and the earphones, special bracelets, mobile devices of the user, etc. worn by the user can issue a warning in the form of voice broadcast, vibration, ringing, text messages, etc. Therefore, doctors and medical staff can shift more attention to their own work, reduce the burden on technicians and doctors, and improve the quality of work.

[0169] In some embodiments, the processing device 130 may obtain other voice signals sent by the user during the execution of the medical procedure. For example, a third voice signal sent by the user to adjust a component of the imaging device may be received, and the position of the component may be adjusted based on the third voice signal. For another example, the processing device 130 may receive a voice query sent by the user, determine the answer information corresponding to the query, and control the first voice device to play the answer information.

[0170] In some embodiments, the processing device 130 may identify a control instruction related to the user configuration interface based on the fourth voice signal. The user configuration interface may display user configuration parameters. When a control instruction related to the user configuration interface is detected, the processing device 130 may control the display device to jump to the user configuration interface, and determine the updated user configuration parameters in the user configuration interface based on the fourth voice signal to update or adjust the user configuration parameters in the user configuration interface. Exemplary user configuration parameters may include display parameters, exposure parameters, system parameters, print setting parameters, and other parameters.

[0171] In some embodiments of the present specification, by acquiring the fourth voice signal emitted by the user during the execution of a medical procedure, it is possible to quickly and automatically jump to the corresponding user configuration interface and automatically complete the setting of the user configuration parameters in the user configuration interface.

[0172] In some embodiments, steps 510-530 may be omitted, and the processing device 130 may determine the initial display parameters of the display device based on other methods. For example, the initial display parameters of the display device are system default configuration parameters. For another example, when the first voice signal includes a control instruction corresponding to the target user, the processing device 130 may determine the display parameters preferred by the target user as the initial display parameters.

[0173] Fig. 6A It is an exemplary schematic diagram of a display interface of a display device according to some embodiments of the present specification.

[0174] The display interface 600A is an initial display interface determined according to the initial display parameters. Fig. 6A As shown, the display interface 600A may include a display area 610, a display area 620, a display area 630, and a display area 640. Different display areas may be used to present different display contents in a medical process. For example, the display area 610 may present a menu, the display area 620 may be used to present a real-time surgical screen, the display area 630 may be used to present various physiological indicators of the patient (such as blood pressure, heart rate, etc.), and the display area 640 may be used to present other contents (such as surgical instructions or warnings, etc.).

[0175] Figure 6B It is an exemplary schematic diagram of a display interface shown in some embodiments of this specification.

[0176] Display interface 600B is the display interface updated according to the updated display parameters. Figure 6B As shown, the display area 610 (not shown in the figure) is configured to be hidden; the horizontal length of the display area 620 is increased so that the area covers the original display area 610; the vertical height of the display area 630 is reduced; and the vertical height of the display area 640 is increased.

[0177] In some embodiments, the user can adjust the display interface from 600A to 600B by uttering user voices such as "hide the menu bar" or "minimize the menu bar". The intelligent control system 100 can process the voice signal corresponding to the user voice through a trained language processing model to generate a corresponding semantic text. Among them, the semantic text may include an operation subject and an update parameter. For example, the operation subject "menu bar" corresponds to the display area 610, and the update parameter is "hide". Further, the intelligent control system 100 can generate corresponding program instructions based on the semantic text. For example, the program instruction can be used to set the parameters of the display area 610 to hide (such as setting the display attribute to false).

[0178] Figure 7is a flowchart of an exemplary collision detection process shown in some embodiments of this specification.

[0179] Medical equipment (e.g., X-ray imaging equipment) usually needs to frequently move one or more components (e.g., C-arm racks) during the medical process to observe the target area at different angles and achieve more accurate scanning or treatment. However, since the positioning takes a long time, it will lead to problems such as increased duration of the entire medical process and increased ineffective radiation. In the process of moving components, the components of the medical equipment may also collide with objects or people in the examination room, increasing the safety risks in the medical process. Therefore, it is necessary to provide an effective system and method for collision detection.

[0180] like Figure 3 As described above, before or during the execution of a medical procedure, the processing device 130 may detect a control instruction issued by a user to control the medical device. For example, the control instruction may include a control instruction "scan the patient's head position" to scan a target area of ​​a target object. For another example, the control instruction may include a control instruction "move the C-arm to the spider position", "angle the C-arm to 45° to the left", etc. to move one or more components of the medical device.

[0181] In response to the control instruction, the processing device 130 can control one or more components of the medical device to move to the target position to scan the target area of ​​the target object. The target position refers to the position to which one or more components of the medical device need to be moved. The target area refers to the organ and / or tissue of the target object that needs to be scanned and imaged. For example, when the control instruction is "scan the patient's head position", the processing device 130 can first determine whether the patient's head position is in the center of the field of view of the medical device (or the scanning center). If the patient's head position is in the center of the field of view of the medical device, the processing device 130 can control the medical device to scan the patient's head position. If the patient's head position is not in the center of the field of view of the medical device, the processing device 130 can control the components of the medical device (e.g., a C-arm frame) to move so that the patient's head position is in the center of the field of view of the medical device, and then scan the patient's head position.

[0182] As an example only, when the control instruction is a control instruction to scan a target area of ​​a target object, the processing device 130 may acquire a third real-time optical image related to the medical device and the target object taken by an image acquisition device installed in the examination room, and determine the planned motion information of the components of the medical device based on the third real-time optical image. Further, the processing device 130 may control the components of the medical device to move based on the planned motion information to perform a medical procedure on the target area.

[0183] Planned motion information refers to the motion information of each component predetermined before executing the control instruction. The motion information includes the movement parameters involved in each component during the motion process. For example, the movement parameters may include the type, movement angle, movement distance, movement time, movement speed, etc. of the moving component (e.g., a robot arm forearm, a robot arm upper arm, a C-arm frame, a bed board, etc.). For example, the processing device 130 may generate a three-dimensional object model of the target object based on the third real-time optical image, and determine the position of the target area of ​​the target object based on the three-dimensional object model. Then, the processing device 130 may obtain the current position of the component of the medical device (e.g., through the parameters of the medical device or the third real-time optical image); and determine the motion information of the component of the medical device based on the position of the target area and the current position of the component of the medical device. Further, the processing device 130 may determine the type of the target area to be scanned (e.g., head, liver, etc.) based on the control instruction, determine the position information of the target area (e.g., three-dimensional coordinate information of the center point of the head) based on the type of the target area and the three-dimensional object model of the target object; determine the planned motion information of one or more components of the medical device based on the position information of the target area; and control the movement of one or more components of the medical device based on the planned motion information. For another example, the processing device 130 may determine movement parameters of one or more of a bed, a detector, a radiation source, etc., so as to align an imaging isocenter of the medical device with a center point of the target area.

[0184] In some embodiments, before controlling the movement of a component based on planned movement information, the processing device 130 may perform a virtual collision detection to verify the planned motion information. Specifically, if no collision occurs in the virtual collision detection, the processing device 130 may control the movement of the component based on the planned motion information. If a collision occurs in the virtual collision detection, the processing device 130 may update the planned motion information until the updated planned motion information passes the virtual collision detection. For more description of virtual collision detection, please see below. By performing virtual collision detection on the planned motion information, the potential collision risk during the movement of the component can be determined in advance, thereby eliminating the potential collision risk and improving the safety of the medical process.

[0185] During movement of components of the medical device, the processing device 130 may execute the process 700 to perform collision detection.

[0186] Step 710 : During the movement of the components of the medical device, the processing device 130 (eg, the acquisition module 210 ) may acquire a first real-time optical image related to the medical device taken by an image acquisition device.

[0187] The first real-time optical image refers to an image related to the medical device (e.g., medical device 110, X-ray imaging device) and other objects in the examination room (e.g., target object) during the movement of components of the medical device, which can reflect the real-time status of each object in the examination room.

[0188] The first real-time optical image can be captured by an image acquisition device (eg, image acquisition device 160) installed in the examination room. For more information about the image acquisition device, see Figure 1A and its related description.

[0189] In step 720 , the processing device 130 (eg, the determination module 230 ) may determine whether a collision will occur during the movement of the component based on the first real-time optical image.

[0190] For example, the processing device 130 may determine the relative position (e.g., the closest distance) between the component and other components or external objects (e.g., the voice device 150, the display device 170, at least one user, the target object, etc.) based on the first real-time optical image. If the relative position is less than the fourth distance threshold, the processing device 130 may determine that a collision will occur during the movement of the component.

[0191] For another example, the processing device 130 may determine whether the motion trajectory of the component overlaps with other components or external objects based on the first real-time optical image. If the motion trajectory overlaps with other components or external objects, the processing device 130 may determine that a collision will occur during the motion of the component.

[0192] In some embodiments, the processing device 130 may also determine whether one or more components of the medical device collide during movement in other ways. As an example only, the processing device 130 may determine the current motion information based on the first real-time optical image, and perform virtual collision detection based on the current motion information. The current motion information refers to the motion information of each component during the execution of the control instruction (for example, when the first real-time optical image is taken). For example, the processing device 130 may generate a virtual imaging system based on the characteristic information and / or real-time optical image of the components of the medical device. The virtual imaging system includes virtual representations of various components of the medical device (such as detectors, radiation sources, racks, etc.). The virtual imaging system can be used to perform virtual collision detection. For example, the movement trajectory of the virtual representation corresponding to each component can be calculated based on the motion information of each component, and it can be determined whether the movement trajectory of the virtual representation corresponding to each component will collide with the virtual representation of other components. Taking the detector and the bed as an example, the processing device 130 can determine whether the current distance between the detector and the bed is less than the fourth distance threshold based on the detector model and the bed model in the virtual imaging system and the positions of the two models in the image. If it is less than the fourth distance threshold, it is determined that a collision may occur at the current moment. For another example, the processing device 130 can predict the distance between the detector and the bed at the next moment or time period based on the detector model and the bed model in the virtual imaging system, and whether the distance is less than a fourth threshold. If it is less than the fourth distance threshold, it is determined that there may be a risk of collision in the future. In some embodiments, virtual collision detection can be established based on a twin digital system. For example, the twin digital system can display virtual representations of various components of medical equipment (such as detectors, radiation sources, racks, etc.), virtual representations of users in the detection room, etc. in real time on a display device. It should be understood that in some embodiments, the processing device 130 can also directly identify the detector and the bed from the real-time optical image and make a distance judgment.

[0193] For another example, a pressure sensor is installed on one or more components of the medical device (e.g., a robot arm forearm, a robot arm upper arm, a wire tube bag, a C-arm outer arc, a bed bottom, a flat panel detector, a tube, etc.), and when a collision occurs at a part where the pressure sensor is installed, and the collision pressure is greater than a pressure threshold, the processing device 130 determines that the part has collided. The pressure threshold may be a default value, a pre-set value, etc.

[0194] In some embodiments, in order to improve the safety of one or more components of the medical device during movement, when the processing device 130 detects that a component of the medical device is about to collide with other objects or personnel during movement, the processing device 130 can reduce the moving speed of the component.

[0195] If it is determined that no collision will occur during the movement of the component, the processing device 130 may control the movement of one or more components of the medical device based on the motion information; if it is determined that a collision will occur during the movement of the component, the processing device 130 may execute step 730.

[0196] In step 730 , the processing device 130 (eg, the control module 240 ) may control the first voice device to issue a collision warning.

[0197] For example, the processing device 130 may send an instruction to play a collision warning to the first voice device to control the first voice device to issue a collision warning. For example, the voice broadcast may be "the tail of the mechanical arm may collide with the infusion stand."

[0198] In some embodiments, the processing device 130 may also display a virtual collision warning on a display device. For example, the processing device 130 may display a part where a collision is about to occur and / or has occurred on the display device 170. The display device 170 may indicate a part where a collision is about to occur and / or has occurred by a special mark. For example, the display device 170 may select a part where a collision is about to occur and / or has occurred by a red box. For another example, the display device 170 may mark a part where a collision is about to occur and / or has occurred with a red exclamation mark. In some embodiments, the processing device 130 may determine possible collision events with different urgency levels (such as corresponding to different collision probabilities and different collision severities), and indicate these collision events with different special marks. For example, components involved in collision events with different urgency levels may be marked with boxes of different colors.

[0199] In some embodiments, the processing device 130 may also issue a warning message on a wearable device worn by the target user.

[0200] In some embodiments of the present specification, not only can the location of an impending and / or already occurring collision be displayed on a display device, but a collision warning can also be broadcast by voice through a first voice device, thereby providing the user with multi-dimensional collision location prompts, allowing the user to promptly detect collision risks and make quick judgments.

[0201] In step 740 , the processing device 130 (eg, the acquisition module 210 ) may acquire a third speech signal.

[0202] The third voice signal is generated by the first voice device by detecting the third user's voice.

[0203] In some embodiments, after the first voice device issues a collision warning, the first voice device may detect a third user voice of a user (such as a target user) to generate a third voice signal. For example, the third user voice may include "ignore the collision warning", "re-perform virtual collision detection", "move the robot arm 20 centimeters to the right", etc.

[0204] In step 750 , the processing device 130 (eg, the determination module 230 ) may determine a collision response strategy based on the third voice signal.

[0205] For example, the processing device 130 may determine a collision response strategy based on the control instruction in the third voice signal. For example, in response to the third target voice signal being "ignore the collision warning", the processing device 130 may continue to execute the movement control instruction. For another example, in response to the third target voice signal being "move the robotic arm 20 centimeters to the right", the processing device 130 may control the robotic arm to move 20 centimeters to the right.

[0206] Just as an example, Fig. 8A As shown, the user first selects the Open CBCT acquisition protocol by voice, and the processing device 130 determines whether the three-dimensional object model of the target object is established. If the three-dimensional object model of the target object is not established, the routine operation is entered, and the user manually controls the movement of one or more components of the X-ray imaging device. If the three-dimensional object model is established, the processing device 130 obtains the control instruction input by the target user through voice, such as "scan the liver position of the patient". When the user presses the "APC" button for a long time, the processing device 130 first controls the C-arm frame to move to the exposure start position (that is, automatically placing the liver position in the center of the field of view), and then determines the movement parameters based on the three-dimensional object model of the target object and the control instruction, and performs virtual collision detection based on the movement parameters. If a collision is detected, a virtual collision warning is performed through the display device and / or the first voice device, and a virtual collision detection is performed again after the obstacle is removed. If no collision is detected, one or more components of the X-ray imaging device are controlled to move, and the target area of ​​the target object is scanned and imaged. In some embodiments, in the process of controlling the C-arm frame to move to the exposure start position, the processing device 130 can also perform virtual collision detection. For example, the processing device 130 may determine the movement parameters of the C-arm frame according to the current position of the C-arm frame and the exposure start position, and perform virtual collision detection based on the movement parameters.

[0207] As an example only, when the user inputs a control instruction "scan the patient's liver position" through voice, the processing device 130 can obtain the control instruction through voice recognition. In response to the control instruction, the processing device 130 can obtain a real-time optical image related to the medical device and the target object taken by the image acquisition device installed in the examination room, model the target object and the medical device based on the real-time optical image to generate a three-dimensional object model of the target object, and determine the position (e.g., center point) of the target area of ​​the target object based on the three-dimensional object model. Then, the processing device 130 can obtain the current position of the components of the medical device (e.g., through the parameters of the medical device or the real-time optical image), and determine the motion information of the center of the field of view of the medical device moving to the exposure start position (i.e., placing the liver position in the center of the field of view) based on the position of the target area and the current position of the components of the medical device. In some embodiments, the processing device 130 can perform virtual collision detection based on the motion information. After the liver position is placed in the center of the field of view of the medical device, the processing device 130 can control the medical device to perform a scanning operation.

[0208] In some embodiments, when the control instruction is a control instruction to move one or more components of the X-ray imaging device, the storage device 140 may pre-store the correspondence between different control instructions and movement parameters. After the first voice device receives the control instruction input by the target user, it sends the control instruction to the processing device 130. The processing device 130 may access the storage device 140 based on the determined control instruction, determine the motion information through the correspondence, and control the movement of one or more components of the X-ray imaging device based on the motion information. In some embodiments, the processing device 130 may process the control instruction using a speech processing model to obtain the semantic text corresponding to the control instruction, and determine the motion information based on the semantic text. In some embodiments, the language processing model includes a large language model (LLM), which may be various deep learning models trained using a large amount of text data.

[0209] In some embodiments, in order to improve the safety of the movement of one or more components of the X-ray imaging device system, the processing device 130 can identify the identity of at least one user based on the control instruction of at least one user, and determine whether there is a target user (for example, an operator of the X-ray imaging device) among the at least one user. If there is a target user among the at least one user, the processing device 130 executes the control instruction input by the target user; if there is no target user among the at least one user, the processing device 130 determines whether the user has control authority, and if there is no control authority, a prompt is given through the first voice device (for example, a voice "no control authority" is played).

[0210] For example, Figure 8BAs shown, the user can turn on the voice control of the X-ray imaging device through the voice wake-up function. If the wake-up fails, the normal operation is entered, and the user manually controls the movement of one or more components of the X-ray imaging device. If the wake-up is successful, the processing device 130 obtains the control instruction input by the user through the first voice device, such as "C-arm left angle 45°". The processing device 130 can recognize the control instruction. Identifying a control instruction refers to processing the control instruction to determine its corresponding text and determining the movement parameters based on the text. If the corresponding text can be recognized and the motion information can be determined based on the text, the recognition is successful, otherwise the recognition fails. If the processing device 130 cannot recognize the control instruction, the user is prompted to re-enter the control instruction through the first voice device. If the processing device 130 successfully recognizes the control instruction, when the user triggers the motion control button, the processing device 130 controls the movement of one or more components of the X-ray imaging device based on the motion information corresponding to the control instruction.

[0211] Just as an example, taking the common percutaneous coronary intervention (PCI) surgery as an example, in order to better observe the lesions of the patient's left and right coronary arteries during the operation, the C-arm needs to frequently switch between 8 clinical angles, resulting in long positioning time, increased ineffective radiation exposure to patients and doctors, and other problems. Users can control the C-arm to reach the target position quickly and accurately through voice control commands, which can not only achieve more accurate treatment, but also greatly improve the positioning efficiency of the C-arm during the operation and reduce radiation damage.

[0212] In some embodiments of the present specification, one or more components of a medical device are moved quickly and accurately to a target position through voice control commands. This not only facilitates doctors to observe the examination conditions of the patient's target area at different angles and improves the accuracy of detection, but also greatly improves the positioning efficiency of components of medical devices in the medical process and reduces radiation damage caused by multiple adjustments to the positioning angles of components due to human operational errors and the like.

[0213] In some embodiments, in order to improve the safety of one or more components of the medical device during movement and avoid collision of components with other objects or people during movement, after the processing device receives the control instruction input by the user and determines the motion information, it enters the waiting state for movement trigger. When the user further confirms the movement instruction, the processing device 130 sends the motion information to the medical device to control one or more components of the medical device to move to the target position.

[0214] There are many ways for the user to further confirm the movement instruction. For example, the user can further confirm the movement instruction by triggering the motion control button. For another example, the user can further confirm the movement instruction by voice inputting "confirm movement" through the first voice device.

[0215] In some embodiments, during the movement of one or more components, the processing device 130 may update the real-time optical image and perform a collision warning based on the updated real-time optical image. For example, the processing device 130 may repeat steps 710-750 to move the components of the medical device to the target position.

[0216] In some embodiments of the present specification, updated real-time optical images and / or pressure sensors are used to detect whether one or more components of a medical device will collide during movement, so that movement collision problems can be discovered in a timely manner and the safety of medical procedures can be improved.

[0217] In some embodiments, the processing device 130 may execute the process 700 to perform collision detection before executing a process of moving a component of the medical device.

[0218] In some embodiments of this specification, through real-time optical images and voice control instructions, the medical device is controlled to scan the target area of ​​the patient and detect collision problems during movement, which not only realizes the automatic control of the movement of the components of the medical device, quickly and accurately reaches the target position to scan and image the target area, reduces the measurement of invalid radiation, but also effectively avoids the problem of mobile collision and improves the safety during surgery. In addition, by combining the advantages of wide range of optical anti-collision monitoring and the convenience and simplicity of voice control, the accuracy and efficiency of intelligent control can be further improved.

[0219] In some embodiments, process 700 may further include one or more other steps.

[0220] For example, before the first voice signal is detected, the processing device 130 (e.g., the control module 240) may acquire a second real-time optical image related to the medical device taken by an image acquisition device installed in the examination room. The second real-time optical image is taken by an image acquisition device (e.g., the image acquisition device 160) installed in the examination room, and it can reflect the state of each object in the examination room before the first voice signal is detected. For example, the second real-time optical image can display the position information of the target object to be scanned and one or more components of the medical device.

[0221] Further, the processing device 130 can control the display device to display a target interface based on the second real-time optical image. The target interface refers to an interface used to reflect the real-time status of the target object and the medical device. The real-time status of the target object and the medical device may include the positional relationship between the target object and the medical device, for example, the minimum distance between the target object and the medical device. For example, the second real-time optical image can be displayed in the target interface. For another example, the processing device 130 can reconstruct the second real-time optical image to obtain one or more of a three-dimensional object model of the target object, a three-dimensional device model of the medical device, a three-dimensional object model of other people (such as a doctor) or objects (such as a voice device 150, a display device 170, a surgical light) in the examination room, and display these three-dimensional models in the target interface.

[0222] In some embodiments, before the first voice signal is detected, the second real-time optical image can be continuously updated, and accordingly, the target interface (e.g., the real-time status of the target object and the medical device) can also be continuously updated, so that the user can understand the real-time dynamics of the examination room.

[0223] During the process of the user controlling the movement of the components of the medical device through voice control, the processing device 130 can update the target interface based on the first real-time optical image. For example, the processing device 130 can present the first real-time optical image in the target interface. Alternatively, the processing device 130 can reconstruct the first real-time optical image to obtain one or more of a three-dimensional object model of the target object, a three-dimensional device model of the medical device, a three-dimensional object model of other people (such as doctors) or objects (such as voice equipment 150, display device 170, surgical lights) in the examination room, and send these three-dimensional models to the display device 170 for display or to update the target interface. When a possible collision is detected, the processing device 130 can control the display device to present a collision warning in the target interface.

[0224] Fig. 9 900 is a schematic diagram of an exemplary intelligent control system according to some embodiments of the present specification. Intelligent control system 900 is a variation of intelligent control system 100. Some components thereof have the same or similar functions and / or structures as corresponding components in intelligent control system 100.

[0225] like Fig. 9 As shown, the intelligent control system 900 may include a processing device 130, a network 920, a system control device 930, a first voice device 940, and a second voice device 950. Different components of the intelligent control system 900 may be arranged in different rooms.

[0226] The processing device 130 can process data and / or information obtained from the system control device 930, the first voice device 940, and the second voice device 950. For example, the processing device 130 can process voice signals obtained from the first voice device 940 and the second voice device 950. In some embodiments, the processing device 130 can be connected to the first voice device 940 and the second voice device 950 for communication, and can obtain voice signals collected by the first voice device 940 and / or the second voice device 950.

[0227] In some embodiments, the processing device 130 can process the voice signal. For example, the processing device 130 can perform voiceprint recognition on the voice signal to determine the identity information of the speaking user (such as a doctor, technician, etc.). For another example, the processing device 130 can perform voice recognition on a voice signal (for example, a first voice signal) to determine whether the voice signal contains control instructions related to medical equipment. In some embodiments, the processing device 130 can send control instructions related to medical equipment (such as X-ray imaging equipment, DSA equipment, etc.) to the system control device 930, so that the system control device 930 performs one or more medical equipment-related control operations in a medical process (such as X-ray imaging, DSA examination, etc.). For more information about voice recognition, see Figure 3 In some embodiments, the processing device 130 may extract a target voice signal corresponding to the target user from the voice signal (eg, the first voice signal). For more information about extracting the target voice signal, see Figure 4 and its related description.

[0228] like Fig. 9 As shown, the processing device 130 can be deployed in an equipment room. The equipment room refers to a room used to deploy various types of equipment including but not limited to the processing device 130 and the system control device 930. In some embodiments, the processing device 130 can also be deployed in a control room or an inspection room. In some embodiments, the processing device 130 or a portion thereof can also be distributedly deployed in a combination of an equipment room, a control room, and an inspection room. In some embodiments, the processing device 130 can also be remote. For example, the processing device 130 can be implemented on a cloud platform.

[0229] The network 920 may include any suitable network that facilitates information and / or data exchange of the intelligent control system 900. In some embodiments, one or more components of the intelligent control system 900 (e.g., the processing device 130, the system control device 930, the first voice device 940, and the second voice device 950) may communicate information and / or data with one or more other components of the intelligent control system 900 via the network 920. In some embodiments, the network 920 may be an Ethernet network, which may be implemented by a network switching device. The network switching device may be configured to implement a communication connection between the processing device 130 and the first voice device 940, and a communication connection between the processing device 130 and the second voice device 940.

[0230] In some embodiments, the network switching device (not shown in the figure) may be one or more network data switching / forwarding devices, which may be deployed in an equipment room or other suitable places (such as a control room, an inspection room, etc.). For example, it may be one or a combination of a network switch, a router, etc. The network switching device may include one or more access points for realizing connection and data exchange between one or more other components of the intelligent control system 900 (such as the first voice device 940, the second voice device 950, etc.).

[0231] In some embodiments, the network switching device can be used to implement voice interaction between the first voice device 940 and the second voice device 950, and the process of voice interaction can be called voice intercom. Exemplarily, the voice signal of the first voice device 940 can be sent to the processing device 130 through the network switching device; further, the processing device 130 can send the voice signal to the second voice device 950 through the network switching device, so that the second voice device 950 can play the voice signal through its voice output component (such as a speaker, etc.), thereby realizing a voice intercom process from the first voice device 940 to the second voice device 950.

[0232] Similarly, the voice signal of the second voice device 950 can be sent to the processing device 130 through the network switching device; further, the processing device 130 can send the voice signal to the first voice device 940 through the network switching device, so that the first voice device 940 can play the voice signal through its voice output component (such as a speaker, etc.). Thus, a voice intercom process from the second voice device 950 to the first voice device 940 is realized.

[0233] The system control device 930 is a device used to control the medical device. For more information about the system control device, see Figure 1A and its related description.

[0234] Voice devices can be used to implement voice interaction between multiple users. The first voice device 940 refers to a voice device deployed in the examination room. The second voice device 950 refers to a voice device deployed in the control room. The control room is where the controller of the medical process is located. The controller can issue control instructions related to the medical process (such as control instructions for medical equipment) in the control room, observe and monitor the execution process of the medical process, and guide patients or other users in the examination room. The examination room is a place where medical procedures are performed, in which medical equipment (CT equipment, DSA equipment, radiotherapy equipment, etc.) can be deployed. In addition, patients undergoing medical procedures, technicians performing medical procedures, etc. can be located in the examination room.

[0235] The personnel in the control room and the personnel in the examination room can have a voice conversation through the first voice device 940 and the second voice device 950. Hereinafter, one or more personnel in the examination room may be referred to as the first type of users, and one or more personnel in the control room may be referred to as the second type of users, wherein the first type of users and the second type of users may include doctors, technicians, or other medical staff. The first type of users may also include patients. For example, when performing a scan, the second type of users may be doctors, and the first type of users may be scanning technicians and patients.

[0236] Voice devices can also be used to implement voice control of devices. For example, the first type of user and / or the second type of user can issue voice control instructions through their corresponding voice devices to intelligently control the equipment in the examination room, control room, and equipment room. As an example only, the doctor in the examination room can control the medical equipment in the examination room and the display device in the control room by voice. Therefore, through the intelligent control system 900 including the processing device 130 and the voice device (for example, the first voice device 940 and the second voice device 950), the user can interact with the target device (such as medical equipment, display device, etc.). For example, the processing device 130 can perform voice recognition on the voice collected by the voice device to obtain control instructions, and control the target device through the control instructions.

[0237] Hereinafter, the voice of the first user is referred to as the first user voice, and the signal related to the first voice is referred to as the first voice signal. The voice of the second user is referred to as the third user voice, and the signal related to the third voice is referred to as the third voice signal.

[0238] like Fig. 9 As shown, the first voice device 940 may include a first voice input component 941, a first voice output component 942 and a first voice processing component 943. The second voice device 950 may include a second voice input component 951, a second voice output component 952 and a second voice processing component 953.

[0239] The voice input component can be used to collect or detect user voice, which can include various sound collection devices such as microphones and voice recorders.

[0240] The voice output component can be used to play sound, which can include various sound output devices such as speakers, audio equipment, and loudspeakers.

[0241] The voice processing component can be used to convert and process voice signals. In some embodiments, the voice processing component may include an audio signal codec for encoding the user voice (i.e., analog signal) detected by the voice input component into a voice signal (i.e., digital signal) and transmitting it to the processing device 130 for voice recognition and other processing; or decoding the voice signal into an analog signal for playback through the voice output component. In some embodiments, the voice processing component may also include various components related to sound processing, such as filters and noise reducers.

[0242] Taking the first voice device 940 as an example, the first voice input component 941 is configured to detect the first voice of the first type of user, and the first voice output component 942 is configured to play the second voice of the second type of user. The first voice processing component 943 can be configured to convert the first voice into a first voice signal, convert the third voice signal into a playable second voice, and process the first voice signal and / or the third voice signal (such as noise reduction, sound amplification, etc.).

[0243] In some embodiments, the voice input component and the voice output component in each voice device are respectively connected to its voice processing component, and the voice processing component is further connected to the network 920.

[0244] In some embodiments, the intelligent control system 900 may also include other devices, such as a medical device 110, a storage device 140, an image acquisition device 160, a display device 170, etc. For more descriptions of storage devices, image acquisition devices, and display devices, see Figure 1A and its related description.

[0245] Fig.10 is a schematic diagram of an exemplary intelligent control system according to some embodiments of the present specification.

[0246] The intelligent control system 1000 is similar to the intelligent control system 900, except that the intelligent control system 1000 includes a first network 921 and a second network 922. The first network 921 is used to implement data communication between the processing device 130 and the first voice device 940 and the second voice device 950. The second network 922 is used to implement data communication between the processing device 130 and the system control device 930. In some embodiments, the first network 921 can be connected to the first voice processing component 943 and the second voice processing component 953.

[0247] In some embodiments of the present specification, the first network 921 is used to transmit data related to the voice intercom scenario, and the second network 922 is used to transmit data related to the control scenario of the medical device. This can avoid mutual influence between the two types of data transmission, ensure that each type of data has sufficient transmission bandwidth, and improve data transmission efficiency.

[0248] The first network 921 and the second network 922 may be networks of the same type or different types. For example only, Fig.11 The intelligent control system 1100 shown is a specific embodiment of the intelligent control system 1000. Fig.11 As shown, the first network 921 is implemented by cables 923 and 924 , and the second network 922 is implemented by a network switch 925 .

[0249] The cable 923 is configured to realize the communication connection between the processing device 130 and the first voice device 940. The cable 923 can be various types of cables, which can be determined according to the interface type of the processing device 130 or the first voice device 940. In some embodiments, the processing device 130 may include various different types of interfaces, for example, it can be one or a combination of multiple USB (Universal Serial Bus) interfaces, TRS (Tip Ring S1eeve) audio interfaces. The cable 923 can be a USB cable, a TRS cable, etc. connecting the first voice device 940 to the processing device 130.

[0250] The cable 924 is configured to realize the communication connection between the processing device 130 and the second voice device 950. Similar to the cable 923, the cable 924 can also be various types of cables (such as a USB cable).

[0251] The network switch 925 refers to a network switching device used to implement network data forwarding between the processing device 130 and the system control device 930. For more information about the network switching device, see Fig. 9 and its description.

[0252] In some embodiments of the present specification, the processing device 130 is directly connected to the first voice device 940 and the second voice device 950 through cables (such as cable 923 and cable 924), so that direct data transmission between the processing device 130 and the first voice device 940 and the second voice device 950 can be achieved, thereby improving the efficiency of voice intercom between the first voice device 940 and the second voice device 950.

[0253] Fig. 12A is a schematic diagram of an exemplary intelligent control system according to some embodiments of the present specification.

[0254] Intelligent control system 1200A and Fig.10 The intelligent control system 1000 is similar to the one in FIG. 1 , except that the structure of the second voice device 950 is different. Fig. 12A As shown, the second voice device 950 may include a second voice input component 951, a second voice output component 952, a second voice processing component 953, a control component 954, and a user interaction component 955. The control component 954 is respectively connected to the second voice output component 952, the second voice input component 951, the second voice processing component 953, and the user interaction component 955 for communication.

[0255] The control component 954 is configured to control the switch state of the second voice output component 952 and the second voice input component 951. For example, the control component 954 is provided with switch buttons of the second voice input component 951 and the second voice output component 952, and the user can use these buttons to turn on or off the second voice input component 951 and the second voice output component 952. In some embodiments, the control component 954 may include a key board.

[0256] The user interaction component 955 may be configured to send the switch status of the second voice input component 951 and the second voice output component 952 to the system control device 930. Fig. 12AAs shown, the user interaction component 955 is further connected to the system control device 930 for communication, and is configured to send the switch status of the second voice input component 951 and the second voice output component 952 to the system control device 930; the system control device 930 can send the switch status to the processing device 130 through the second network 922, and the processing device 130 is further configured to control the connection status between it and the second voice device 950 based on the switch status. As an example only, when the second voice input component 951 or the second voice output component 952 is turned on, the processing device 130 can establish a connection with the second voice device 950, and accept the voice signal collected by the second voice device 950 or send a voice signal to the second voice device 950. When the second voice input component 951 and the second voice output component 952 are turned off, the processing device 130 can disconnect the connection between the second voice device 950.

[0257] In some embodiments, the user interaction component 955 can be connected via a controller area network bus (Controller Area Network,

[0258] CAN) is communicatively connected with the system control device 930.

[0259] The above description is for illustrative purposes only, and actual application scenarios may vary. For example, the user interaction component 955 may be configured to communicate directly with the processing device 130 via the second network 922, so that the switch status of the second voice input component 951 and the second voice output component 952 can be sent to the processing device 130. For another example, the structure of the first voice device 940 may be similar to that of the second voice device 950, and also include a control component and a user interaction component. For details, see Fig. 12B , Fig. 12B is a schematic diagram of an exemplary intelligent control system according to some embodiments of this specification. Fig. 12A The intelligent control system 1200A is similar to the intelligent control system 1200A in FIG. 1 , except that the structures of the first voice device 940 and the second voice device 950 are different. Fig. 12BAs shown, the first voice device 940 may include a first voice input component 941, a first voice output component 942, a first voice processing component 943, a control component 944, and a user interaction component 945. The control component 944 of the first voice device 940 may be connected to the voice output component 942 and the voice input component 941 for communication, and is configured to control the switch state of the voice output component 942 and the voice input component 941. The user interaction component 945 of the first voice device 940 may be connected to the control component 944 of the first voice device 940 and the processing device 130 for communication, and is configured to send the switch state of the voice output component 942 and the voice input component 941 to the processing device 130. Therefore, the processing device 130 may be further configured to control the connection state between it and the first voice device 940 based on the switch state of the voice output component 942 and the voice input component 941.

[0260] Fig.13 is a schematic diagram of an exemplary intelligent control system according to some embodiments of the present specification.

[0261] like Fig.13 As shown, the intelligent control system 1300 may include a processing device 130, a network 920, a system control device 930, a first voice device 940, and a second voice device 950. The processing device 130 and the system control device 930 may be arranged in an equipment room or other suitable places (such as a control room, etc.), the first voice device 940 is arranged in an inspection room, and the second voice device 950 is arranged in a control room. The second voice device 950 includes a second voice input component 951, a second voice output component 952, and a second voice processing component 953. The first voice device 940 includes a first voice input component 941 and a first voice output component 942, but does not include a voice processing component.

[0262] The processing device 130, the network 920, the system control device 930, and the second voice device 950 can be connected with Fig. 9 The processing device 130, the network 920, the system control device 930 and the second voice device 940 in the intelligent control system 900 are similar and will not be described in detail here.

[0263] The second voice device 950 is connected to the processing device 130 for communication, and the first voice device 940 is connected to the second voice device 950 for communication. Fig.13 As shown, the second voice device 950 is connected to the processing device 130 via the network 920. The first voice input component 941 and the first voice output component 942 in the first voice device 940 can be connected to the second voice processing component 953 in the second voice device 950 via the cable 926 and the cable 927, respectively.

[0264] In some embodiments, when the distance between the control room and the inspection room is less than a preset distance threshold, Fig.13 The manner shown is to directly connect the first voice device 940 to the second voice device 950. The preset distance threshold may be 20 m or other suitable values.

[0265] In some embodiments, the first voice device 940 can be regarded as a part of the second voice device 950. For example, when building the intelligent control system 1300, one of the multiple microphones of the second voice device 950 can be placed in the inspection room as the first voice input component 941; one of the multiple speakers of the second voice device 950 can be placed in the inspection room as the first voice output component 942.

[0266] In some embodiments, the second voice device 950 can be configured to detect a third user voice to generate a third voice signal, and send the third voice signal to the processing device 130, the processing device 130 is configured to send the third voice signal to the first voice device 940, the first voice device 940 is configured to convert the third voice signal into a user voice and output the user voice; the first voice device 940 is further configured to detect the first user voice, and send the detected first user voice to the second voice device 950, the second voice device 950 is configured to convert the first voice signal into a user voice and output the user voice. In this embodiment, the first voice device 940 is only used for sound collection and sound output, and voice processing (such as noise reduction processing) is performed by the second voice processing component 953 of the second voice device 950.

[0267] The first user voice refers to the user voice corresponding to one or more users in the examination room, and the first voice signal is the voice signal corresponding to the first user voice; the third user voice refers to the user voice corresponding to one or more users in the control room, and the third voice signal is the voice signal corresponding to the third user voice. For more information about user voice and voice signal, see Figure 3 and its description.

[0268] In some embodiments, the system control device 930 can be used to execute preset control instructions related to the medical device, and the system control device 930 is communicatively connected with the processing device 130 .

[0269] In some embodiments, the processing device 130 is further configured to perform speech recognition on the first voice signal to obtain a speech recognition result; based on the speech recognition result, determine whether the first voice signal contains a control instruction; in response to the first voice signal containing a control instruction, send the speech recognition result to the system control device 930, so that the system control device 930 controls the medical device. For more information about speech recognition results and control instructions, see Fig.15 And its description will not be repeated here.

[0270] In some embodiments, the processing device 130 can extract the target voice signal emitted by the target user from the first voice signal and send it to the second voice device 950. For more information about target voice signal extraction, see Figure 4 And its description will not be repeated here.

[0271] In some embodiments of the present specification, it is only necessary to set up voice input components such as microphones and voice output components such as speakers in the inspection room. The voice signal of the inspection room can be directly received and processed (such as noise reduction processing) by the second voice device 950 through cables, which can save the consumption of network data and make the overall structural setting of the intelligent control system simpler and easier to maintain.

[0272] Fig.14 is a schematic diagram of an exemplary intelligent control system according to some embodiments of the present specification.

[0273] The intelligent control system 1400 is similar to the intelligent control system 1300, except that the intelligent control system 1400 includes a first network 921 and a second network 922. Fig.14 As shown, the first network 921 is used to implement data communication between the processing device 130 and the second voice device 950. The second network 922 is used to implement data communication between the processing device 130 and the system control device 930.

[0274] The above description of the intelligent control system is for illustrative purposes only. The actual intelligent control system may have various changes. For example, the connection mode of each component in the intelligent control system may be changed. For another example, taking the intelligent control system 1300 as an example, it may also include a voice signal encoding device and a voice signal decoding device. The voice signal encoding device and the voice signal decoding device may be arranged between the first network 921 and the processing device 130 for voice signal transmission or conversion.

[0275] Fig.15 15 is a schematic diagram of a voice interaction process between a first voice device and a second voice device according to some embodiments of this specification. In some embodiments, process 1500 may be executed by processing device 130.

[0276] like Fig.15 As shown, the processing device 130 can receive the first voice signal 1502 through the first voice device 940. For example, the processing device 130 can obtain the first voice signal 1502 through the network 920 or the first network 921. The processing device 130 can perform voice recognition on the first voice signal 1502 to obtain a voice recognition result 1504. For more description of obtaining the voice recognition result, see Figure 4 Based on the speech recognition result 1504, the processing device 130 can determine the control instruction 1506 (or the target speech signal) corresponding to the first speech signal 1502, and send the control instruction 1506 (or the target speech signal) to the second speech device 950. For more information about determining the control instruction, see Figure 3 In some embodiments, the second voice device 940 may play the control instruction 1506 (or the target voice signal). In some embodiments, the first voice signal 1502 may be sent to the second voice device 940 together with the control instruction 1506 (or the target voice signal), and the second voice device 940 may play the first voice signal 1502.

[0277] Similarly, the processing device 130 can receive the third voice signal through the second voice device 950. The processing device 130 can perform voice recognition on the third voice signal to obtain a voice recognition result. Based on the voice recognition result, the processing device 130 can determine the control instruction (or target voice signal) corresponding to the third voice signal, and send the control instruction (or target voice signal) to the first voice device 940.

[0278] Fig.16 This is a flowchart of an exemplary process of controlling a medical device according to some embodiments of this specification.

[0279] In some embodiments, Figure 3 Operation 340 in the embodiment may be implemented by process 1600. In some embodiments, process 1600 may be performed by processing device 130.

[0280] In step 1610 , the processing device 130 may perform structured processing on the control instruction to generate a structured control instruction.

[0281] The structured control instruction has a preset data structure. The preset data structure can be determined by a medical protocol. Medical protocols corresponding to different medical procedures can define different data structures of control instructions. For example, the preset data structure may include medical equipment type, component type, and operating parameters. The medical equipment type may include the type of medical equipment in the examination room (such as CT equipment, DSA equipment), etc. The component type may refer to the target component that needs to be operated on the medical equipment (such as the rack of DSA, etc.), and the operating parameters may include specific operations on the target component (such as the moving distance, the rotation angle, etc.).

[0282] In some embodiments, the processing device 130 may perform structured processing on the speech recognition result to determine a structured control instruction.

[0283] In step 1620 , the processing device 130 may send the structured control instruction to the system control device so that the system control device controls the medical device.

[0284] The processing device 130 can determine whether the control instruction is a control instruction of the target type based on the structured control instruction and the preset control instruction set. The preset control instruction set may include one or more preset control instructions related to the medical device. Each preset control instruction in the control instruction set has a preset data structure (i.e., a structured control instruction). Exemplarily, the processing device 130 can determine whether the medical device type and component type in the structured control instruction corresponding to the control instruction are consistent with the medical device type and component type of the preset control instruction. If inconsistent, it means that the control instruction corresponding to the speech recognition result is not a control instruction of the target type. If consistent, it means that the control instruction corresponding to the speech recognition result contains a control instruction of the target type.

[0285] In response to determining that the control instruction is a target type of control instruction, the processing device 130 may send the structured control instruction to the system control device so that the system control device controls the medical device.

[0286] Compared with the original voice recognition results / control instructions, the content of structured control instructions is more concise and accurate, so sending structured control instructions can improve the accuracy and efficiency of medical device control. In response to the voice recognition result not containing the target type of control instructions, the processing device 130 does not need to send the voice recognition result to the system control device 930, and can generate a notification message to send to the first voice device 940 and / or the second voice device 950 to inform the relevant personnel, so that the relevant personnel know that the voice intercom did not generate control instructions related to the medical device. The relevant personnel can reorganize the voice content according to actual needs (such as whether the voice intercom expects to complete the control of the medical device, or just communicate with the examination room staff). Among them, the notification message can be in various forms such as text (such as a message presented by a display device), voice (such as feedback played by the speaker of the first voice device 940), etc.

[0287] In some embodiments, the processing device 130 can extract the target voice signal from the first voice signal, and then determine whether the target voice signal contains a control instruction of the target type. In this way, the control instruction issued by the target user to control the medical device can be accurately identified, and the medical device can be accurately controlled accordingly.

[0288] In some embodiments of the present specification, (1) the user's voice signal is processed through voice recognition to achieve intelligent voice control of the target device and automated control of the operation of the medical device, so that doctors can interact with the medical device by voice without manually controlling the medical device, thereby reducing the number of medical staff required in the medical process, improving the efficiency and accuracy of the execution of the medical process, and ensuring that the medical process proceeds more smoothly; (2) the identity of the speaking user is identified through voiceprint information analysis, and only the target voice signal corresponding to the target user is identified and processed, which can avoid the influence of the voice of non-target users on the control of the medical process and improve the accuracy and safety of the operation control of the medical equipment. , thereby ensuring that the medical process proceeds more smoothly; (3) Through intelligent voice control, the display interface of the display device is automatically personalized, and the display parameters of the display interface are adjusted through the user's voice commands, thereby improving the execution efficiency of the medical process and enhancing the user experience; (4) Through real-time optical images and voice control commands, the medical device is controlled to scan the patient's target area and detect collision problems during movement. It not only realizes the automatic control of the movement of the components of the medical device, quickly and accurately reaches the target position to scan and image the target area, reduces the measurement of invalid radiation, but also effectively avoids the problem of mobile collision and improves the safety during the operation.

[0289] Some embodiments of this specification also provide a computer-readable storage medium, which stores computer instructions. When a computer reads the computer instructions, the computer executes the intelligent control method described in this specification. For more technical details, see Figures 1A to 16 The relevant description will not be repeated here.

[0290] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0291] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0292] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0293] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0294] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0295] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0296] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. An intelligent control system (900), characterized in that: include: a first voice device (940); and The processing device (130), the first voice device (940) and the processing device (130) are in communication connection, wherein: The first voice device (940) comprises a first voice input component (941) and a first voice processing component (943), wherein the first voice input component (941) is configured to detect a first user voice, and the first voice processing component (943) is configured to convert the detected first user voice into a first voice signal; and The processing device (130) is configured to process the first voice signal to obtain a control instruction for controlling a target device, wherein the target device includes a display device (170) and / or a medical device (110).

2. The intelligent control system (900) according to claim 1, characterized in that: The first speech device (940), the processing device (130) and the target device are arranged in an examination room; and / or The first voice device (940), the processing device (130) and the target device are integrated on the same terminal device.

3. The intelligent control system (900) according to claim 1, characterized in that: The first voice device (940) further comprises: A first speech output component (942); a control component (944), the control component (944) being communicatively connected with the first voice output component (942) and the first voice input component (941), and being configured to control the on / off states of the first voice output component (942) and the first voice input component (941); a user interaction component (945), the user interaction component (945) being communicatively connected to the control component (944) and the processing device (130), and being configured to send the switch states of the first voice output component (942) and the first voice input component (941) to the processing device (130); The processing device (130) is further configured to control a connection state between the processing device (130) and the first voice device (940) based on the switch state.

4. The intelligent control system (900) according to claim 3, characterized in that: The first voice input component (941) and the first voice output component (942) are an integrated structure.

5. The intelligent control system (900) according to claim 1, characterized in that: The first voice device (940) is also configured to play feedback voice.

6. The intelligent control system (900) according to claim 1, characterized in that: The system (900) further comprises: A second voice device (950) installed in a control room, wherein the second voice device (950) is configured to receive the first voice signal from the processing device (130) or the first voice device (940) and play the first user voice.

7. The intelligent control system (900) according to claim 6, characterized in that: The second voice device (950) includes a second voice output component (952), a second voice input component (951) and a second voice processing component (953), and the first voice signal is sent from the first voice device (940) to the second voice device (950).

8. The intelligent control system (900) according to claim 6, characterized in that: The system further comprises: The network switching device is configured to realize a communication connection between the processing device (130) and the first voice device (940), and a communication connection between the processing device (130) and the second voice device (950).

9. The intelligent control system (900) according to claim 1, characterized in that: The target device includes the display device (170), wherein the display device (170) performs one or more combinations of the following operations in response to the control instruction: Switching the display image on the display device (170); Playing or pausing the display image on the display device (170); Switching the display mode of the display device (170); Setting display parameters of the image displayed on the display device (170); Processing the display image on the display device (170); Setting a display area division method of the display device (170); The display interface of the display device (170) is caused to jump to a user configuration interface.

10. The intelligent control system (900) according to any one of claims 1 to 9, characterized in that: The target device includes the medical device (110), wherein the medical device (110) performs one or more combinations of the following operations in response to the control instruction: Controlling the movement of components of the medical device (110); performing a medical procedure on a target area of ​​a target subject; Setting the working mode of the medical device (110); Setting relevant parameters of the medical procedure corresponding to the medical device (110); Start or stop a medical procedure.

11. The intelligent control system (900) according to claim 1, characterized in that: The target device includes the medical device (110) and the display device (170), wherein: In response to the control instruction, the display device (170) displays the medical procedure performed by the medical device (110).

12. The intelligent control system (900) according to claim 1, characterized in that: The medical device (110) is a C-arm X-ray imaging device.

13. An intelligent control system (900), characterized in that: include: A voice device (150), wherein the voice device (150) is configured to detect a user's voice and convert the detected user's voice into a voice signal; A processing device (130), the processing device (130) being configured to process the voice signal to obtain a control instruction for controlling a target device, the target device comprising a display device (170) and / or a medical device (110), wherein: The display device (170) is configured to determine the display content and display mode of the display device (170) based on part of the control instructions, and the medical device (110) is configured to control the operation of the medical device (110) based on at least the remaining part of the control instructions.

14. The intelligent control system (900) according to claim 13, characterized in that: The voice device (150) comprises a first voice device and a second voice device, wherein: The first audio device is arranged in an examination room, on one or more of a display device (170) or a medical device (110); and The second voice device is arranged in a control room, and the second voice device is communicatively connected with the first voice device.

15. The intelligent control system (900) according to claim 14, characterized in that: The medical device (110) is a C-arm X-ray imaging device, and the display device (170) is arranged adjacent to the medical device (110).

Images