Medical system and processing method

Abstract

This medical system has a first processor and a second processor. The first processor transmits a graphical user interface (GUI) and an ID to the second processor. When a new ID is the same as an ID appended to data received from the second processor, the first processor executes first processing based on at least a part of the newly generated graphical user interface and the data. When the new ID is different from the ID appended to the data received from the second processor, the first processor executes second processing different from the first processing.

Description

Medical Systems and Treatment Methods

[0001] The present disclosure relates to medical systems and processing methods.

[0002] A system has been developed that displays images acquired by an endoscope on a monitor. This system includes a server and a client. The client transmits images acquired by the endoscope to the server. The server generates a GUI (graphical user interface) including the received images and transmits the GUI to the client. The client has a monitor and displays the received GUI on the monitor. A user, such as a doctor, observes the images included in the GUI displayed on the monitor and performs a diagnosis. The user also operates buttons and other controls included in the GUI to acquire images for recording.

[0003] Japanese Patent Publication No. 6205749 discloses a virtual desktop system in which a server and a client communicate via a network. The operations of the server and the client in this system will be described below.

[0004] The server generates a GUI and sends it to the client via the network. The client displays the GUI received from the server. The user operates buttons while viewing the displayed GUI. When the user clicks a button, the client sends data indicating the operation to the server.

[0005] The server predicts the operation content for the GUI. If a delay occurs in the network and the predicted result differs from the operation content actually performed by the client, it is possible that the operation was performed on a GUI generated earlier than the GUI newly generated by the server. Therefore, the server executes processing based on the GUI generated a little earlier.

[0006] Japanese Patent No. 6205749

[0007] In a medical system using an endoscope, it is desirable to avoid a situation in which the GUI displayed on the client differs from the GUI generated by the server, resulting in the execution of an incorrect function. Unless the amount of delay in the network is specified, it is difficult for the virtual desktop system described above to determine how recently generated the GUI should be used. Therefore, the situation in which an incorrect function is executed cannot be completely eliminated.

[0008] The present disclosure aims to provide a medical system and a processing method that can avoid the execution of erroneous functions.

[0009] According to a first aspect of the present disclosure, a medical system includes a first processor and a second processor. The first processor generates a graphical user interface including an image generated by an endoscope and associated with an ID. The newly generated graphical user interface is associated with a new ID. The first processor transmits the graphical user interface and the ID to the second processor. When the new ID is the same as the ID added to data received from the second processor, the first processor performs a first process based on at least a portion of the newly generated graphical user interface and the data. When the new ID is different from the ID added to the data received from the second processor, the first processor performs a second process different from the first process. The second processor displays the graphical user interface received from the first processor on a display, accepts data input in response to an operation of the graphical user interface, and transmits the data, to which the ID associated with the graphical user interface is added, to the first processor.

[0010] According to a second aspect of the present disclosure, in the first aspect, the first processor may ignore the data in the second processing.

[0011] According to a third aspect of the present disclosure, in the first aspect, the first processor may perform processing in accordance with the data and at least a portion of the graphical user interface associated with an ID that is the same as the ID added to the data in the second processing.

[0012] According to a fourth aspect of the present disclosure, in the first aspect, when a component for operating the graphical user interface changes, the ID may be updated.

[0013] According to a fifth aspect of the present disclosure, in the first aspect, the data may indicate coordinates at which an operation was performed in the graphical user interface.

[0014] According to a sixth aspect of the present disclosure, a processing method includes: a first processor generates a graphical user interface including an image generated by an endoscope and associated with an ID; the newly generated graphical user interface is associated with a new ID; the first processor transmits the graphical user interface and the ID to a second processor different from the first processor; the second processor displays the graphical user interface received from the first processor on a display; the second processor accepts data input in response to an operation of the graphical user interface; the second processor transmits the data, to which the ID associated with the graphical user interface is attached, to the first processor; when the new ID is the same as the ID attached to the data received from the second processor, the first processor performs a first process based on at least a portion of the newly generated graphical user interface and the data; and when the new ID is different from the ID attached to the data received from the second processor, the first processor performs a second process different from the first process.

[0015] According to the above aspects, the medical system and processing method can avoid the execution of an erroneous function.

[0016] 1 is a block diagram showing the configuration of a medical system of an embodiment; FIG. 2 is a flowchart showing the procedure of a process executed by a first processing unit included in the medical system of an embodiment; FIG. 3 is a flowchart showing the procedure of a process executed by a first processing unit included in the medical system of an embodiment; FIG. 4 is a flowchart showing the procedure of a process executed by a second processing unit included in the medical system of an embodiment; FIG. 5 is a flowchart showing the procedure of a process executed by a second processing unit included in the medical system of an embodiment; FIG. 6 is a diagram showing an example of a GUI in an embodiment; FIG. 7 is a diagram showing an example of a GUI in an embodiment;

[0017] An embodiment of the present disclosure will be described with reference to the drawings. Fig. 1 shows the configuration of a medical system 1 according to this embodiment. The medical system 1 shown in Fig. 1 includes a first system 10 and a second system 20.

[0018] The first system 10 includes a first processing unit 11 and a memory 12. The second system 20 includes an endoscope 21, a second processing unit 22, a monitor 23, and a GUI operation unit 24. For example, the first system 10 is a cloud system, and the second system 20 is a local system within a hospital. The first system 10 and the second system 20 are connected via a network such as the Internet.

[0019] The endoscope 21 is a camera and has a long, thin insertion section and an image sensor located at the tip of the insertion section. The endoscope 21 is inserted into a living body and sequentially generates two or more images of the inside of the living body. The two or more images constitute a video. The endoscope 21 is connected to the second processing section 22 by a cable. The endoscope 21 sequentially outputs the two or more images to the second processing section 22.

[0020] The endoscope 21 and the second processing unit 22 may be arranged in the same housing. The endoscope 21 and the second processing unit 22 may be connected wirelessly.

[0021] The second processing unit 22 sequentially transmits two or more images output from the endoscope 21 to the first processing unit 11, and the first processing unit 11 sequentially receives the two or more images. Communication between the first processing unit 11 and the second processing unit 22 is performed via a network.

[0022] The first processing unit 11 generates a GUI including the image received from the second processing unit 22 and operation components such as buttons. The GUI corresponds to an operation screen displayed on the monitor 23. The operation components are associated with specific functions. For example, the specific function is capturing (releasing) a still image or adjusting the amount of light from a light source (not shown) in the second system 20. The specific function may also be other functions. When the image or operation components need to be updated, the first processing unit 11 generates a new GUI including the updated image or the updated operation components.

[0023] The first processing unit 11 associates the generated GUI with an ID (identifier) ​​and stores the GUI and the ID in the memory 12. For example, the ID is a sequence number. The ID may be time information (timestamp) indicating the time when the GUI was generated. The memory 12 is a volatile or non-volatile memory.

[0024] The first processing unit 11 generates a new ID every time a new GUI is generated and associates the new GUI with the new ID. The first processing unit 11 may generate a new ID every time a predetermined time has elapsed even if the image or operation component is not updated, and may associate the ID with an already generated GUI. The ID may be separate from the GUI or may be included in the GUI.

[0025] The first processing unit 11 transmits the GUI and ID associated with each other to the second processing unit 22, and the second processing unit 22 receives the GUI and ID. The second processing unit 22 displays the received GUI on the monitor 23. As a result, the second processing unit 22 displays the image and operation components on the monitor 23. The monitor 23 is a display such as a liquid crystal monitor.

[0026] The user views the GUI displayed on the monitor 23 and operates the GUI operation unit 24 as necessary to perform operations on the GUI operation components. The GUI operation unit 24 is an operation device such as a mouse. The GUI operation unit 24 may also be a touch panel arranged on the screen of the monitor 23. The GUI operation unit 24 outputs operation data indicating the results of the operation performed by the user to the second processing unit 22. For example, the operation data indicates the coordinates (x, y) where an operation such as a click operation was performed on the GUI. The second processing unit 22 accepts the operation data.

[0027] When the operation data is accepted, the second processing unit 22 acquires an ID associated with the GUI displayed on the monitor 23. The second processing unit 22 adds the ID to the operation data and transmits the operation data to the first processing unit 11. The ID may be separate from the operation data or may be included in the operation data.

[0028] The first processing unit 11 receives the operation data to which the ID has been added, obtains from the memory 12 the ID associated with the GUI last transmitted to the second processing unit 22, and compares the ID added to the operation data with the ID obtained from the memory 12.

[0029] If there is no delay or the delay is small in the network, the two IDs match. At this time, the first processing unit 11 retrieves from the memory 12 the GUI that was last transmitted to the second processing unit 22, and executes the first processing based on the GUI and the operation data.

[0030] An example of the first process will be described. The first processing unit 11 identifies a position on the GUI where an operation such as a click operation was performed, based on the coordinates indicated by the operation data. If the identified position is on a specific operation component in the GUI, the first processing unit 11 determines that the operation component has been operated and executes a function associated with the operation component. If the identified position is not on the specific operation component, the first processing unit 11 ignores the operation based on the operation data.

[0031] If the delay in the network is large, the first processing unit 11 may generate a new GUI before the second processing unit 22 displays the GUI on the monitor 23 or while the GUI is being displayed on the monitor 23. In this case, the ID added to the operation data will not match the ID acquired from the memory 12, and the first processing unit 11 will execute a second process that is different from the first process.

[0032] A first example of the second process will be described below: The first processing unit 11 ignores the operation based on the operation data.

[0033] A second example of the second process will be described. The first processing unit 11 retrieves from the memory 12 a GUI associated with the same ID as the ID added to the operation data. This GUI is the same as the GUI displayed on the monitor 23 when the user performed the operation. The first processing unit 11 identifies the position on the GUI where an operation such as a click operation was performed, based on the coordinates indicated by the operation data. If the identified position is on a specific operation component in the GUI, the first processing unit 11 determines that the operation component has been operated and executes a function associated with that operation component. If the identified position is not on a specific operation component, the first processing unit 11 ignores the operation based on the operation data.

[0034] The first processing unit 11 and the second processing unit 22 are configured with at least one of a processor and a logic circuit. For example, the processor is at least one of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). For example, the logic circuit is at least one of an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array). The first processing unit 11 and the second processing unit 22 may include two or more processors. The first processing unit 11 and the second processing unit 22 may include two or more logic circuits.

[0035] A computer may load a program and execute the loaded program, which includes instructions that define the operation of at least one of the first processing unit 11 and the second processing unit 22. In other words, the functions of at least one of the first processing unit 11 and the second processing unit 22 may be realized by software.

[0036] The above program may be provided by a "computer-readable recording medium" such as a flash memory. The program may be transmitted to the medical system 1 from a computer storing the program via a transmission medium or by transmission waves in the transmission medium. The "transmission medium" that transmits the program is a medium that has the function of transmitting information. Media that have the function of transmitting information include networks (communication networks) such as the Internet and communication lines (communication lines) such as telephone lines. The above program may realize some of the functions described above. Furthermore, the above program may be a difference file (difference program). The above function may be realized by combining a program already recorded on the computer with a difference program.

[0037] The operation of the first processing unit 11 will be described using Figures 2 and 3. Figures 2 and 3 show the procedure of the process executed by the first processing unit 11. The first processing unit 11 executes the process shown in Figure 2 and the process shown in Figure 3 in parallel.

[0038] When an image is received from the second processing unit 22, the first processing unit 11 generates a GUI including the image and operation components. Alternatively, when an operation component in an already generated GUI needs to be updated, the first processing unit 11 generates a GUI including the image and the updated operation components (step S100). The first processing unit 11 may generate a GUI when a user operation or background processing occurs.

[0039] After step S100, the first processing unit 11 associates the GUI generated in step S100 with an ID, and stores the GUI and the ID in the memory 12 (step S105).

[0040] After step S105, the first processing unit 11 transmits the GUI and the ID to the second processing unit 22 (step S110). After step S110, step S100 is executed.

[0041] 2, the first processing unit 11 determines whether or not operation data has been received from the second processing unit 22 (step S115). When the first processing unit 11 determines in step S115 that operation data has not been received, step S115 is executed again.

[0042] When the first processing unit 11 determines in step S115 that operation data has been received, the first processing unit 11 determines whether the ID attached to the operation data is the same as the ID associated with the GUI generated in step S100 (step S120).

[0043] When the first processing unit 11 determines in step S120 that the two IDs are the same, the first processing unit 11 executes the first processing based on the GUI generated in step S100 and the operation data received from the second processing unit 22 (step S125). After step S125, step S115 is executed.

[0044] If the first processing unit 11 determines in step S120 that the two IDs are different, the first processing unit 11 executes the second process (step S130). After step S130, step S115 is executed.

[0045] In step S105, the first processing unit 11 may associate a portion of the GUI with an ID and store the portion of the GUI and the ID in the memory 12. For example, the first processing unit 11 may store information about only the buttons included in the GUI and the ID in the memory 12. In step S125, the first processing unit 11 may execute the first process based on the portion of the GUI and the operation data. Therefore, the first processing unit 11 may execute the first process based on GUI information that is the entire or part of the GUI generated in step S100.

[0046] In a second example of the second process, the first processing unit 11 may retrieve from the memory 12 a GUI associated with the same ID as the ID added to the operation data. The GUI is a part of the GUI that was displayed on the monitor 23 when the user performed the operation. The first processing unit 11 may execute the second process described above by using the GUI retrieved from the memory 12.

[0047] In the second process, the first processing unit 11 may display a message on a monitor (not shown in Fig. 1). The message may indicate that the data is to be ignored. Alternatively, the message may indicate that processing is to be performed based on the data and at least a part of a GUI associated with the same ID as the ID attached to the data.

[0048] The user may select one of the first setting and the second setting in the second processing. If the user selects the first setting, the first processing unit 11 ignores the data in the second processing. If the user selects the second setting, the first processing unit 11 executes processing in the second processing according to the data and at least a part of the GUI associated with the same ID as the ID added to the data.

[0049] The operation of the second processing unit 22 will be described using Figures 4 and 5. Figures 4 and 5 show the procedure of the process executed by the second processing unit 22. The second processing unit 22 executes the process shown in Figure 4 and the process shown in Figure 5 in parallel.

[0050] The second processing unit 22 determines whether or not the GUI and ID have been received from the first processing unit 11 (step S200). When the second processing unit 22 determines in step S200 that the GUI and ID have not been received, step S200 is executed again.

[0051] When the second processing unit 22 determines in step S200 that the GUI and ID have been received, the second processing unit 22 displays the GUI on the monitor 23 (step S205). After step S205, step S200 is executed.

[0052] 4, the second processing unit 22 monitors the GUI operation unit 24 and determines whether the GUI has been operated (step S210). If the second processing unit 22 determines in step S210 that the GUI has not been operated, step S210 is executed again.

[0053] When the second processing unit 22 determines in step S210 that the GUI has been operated, the second processing unit 22 accepts operation data output from the GUI operation unit 24 (step S215).

[0054] After step S215, the second processing unit 22 adds an ID associated with the GUI displayed on the monitor 23 to the operation data, and transmits the operation data to the first processing unit 11 (step S220). After step S220, step S210 is executed.

[0055] 6 shows another example of the procedure of the process executed by the second processing unit 22. The same parts as those shown in FIG. 4 or 5 will not be described.

[0056] When the second processing unit 22 determines in step S200 that the GUI and ID have not been received, step S210 is executed. After step S205, step S210 is executed. After step S220, step S200 is executed.

[0057] 7 and 8 show examples of GUIs. The first processing unit 11 generates a GUI 40 shown in Fig. 7, and then generates a GUI 41 shown in Fig. 8.

[0058] 7 includes an image I1, a button B1, and a button B2. The GUI 40 is displayed on the monitor 23, and an operation such as a click is performed at a position P1 on the button B2. At this time, the second processing unit 22 transmits operation data including the coordinates of the position P1 to the first processing unit 11.

[0059] 8 includes an image 12, a button B1, and a button B3. The first processing unit 11 generates the GUI 41 while the GUI 40 is being displayed on the monitor 23 due to a delay occurring in the network.

[0060] When an operation is performed at position P1 on the GUI 40, the first processing unit 11 receives operation data including the coordinates of position P1 from the second processing unit 22. Button B3 at position P1 on the newly generated GUI 41 is different from button B2 at position P1 on the GUI 40 where the user performed the operation. When the first processing unit 11 executes the function associated with button B3, an incorrect function is executed. In this embodiment, the first processing unit 11 executes the second process without executing the function associated with button B3. Therefore, the incorrect function is not executed.

[0061] As described above, the first processing unit 11 generates a GUI that includes an image generated by the endoscope 21 and is associated with an ID. The newly generated GUI is associated with a new ID. The first processing unit 11 transmits the GUI and the ID to the second processing unit 22. If the new ID is the same as the ID added to the data received from the second processing unit 22, the first processing unit 11 executes a first process based on at least a portion of the newly generated GUI and the data. If the new ID is different from the ID added to the data received from the second processing unit 22, the first processing unit 11 executes a second process that is different from the first process. The second processing unit 22 displays the GUI received from the first processing unit 11 on the monitor 23. The second processing unit 22 accepts data input in response to an operation of the GUI and transmits the data, to which the ID associated with the GUI is added, to the first processing unit 11.

[0062] The first processing unit 11 ignores the data in the second processing, or performs processing in accordance with the data and at least a part of the GUI associated with the same ID as the ID added to the data in the second processing.

[0063] When the component for GUI operation changes, the ID is updated.

[0064] The above data indicates the coordinates at which an operation was performed in the GUI.

[0065] If the new ID is different from the ID added to the data received from the second processing unit 22, the first processing unit 11 does not execute the first processing, thereby enabling the medical system 1 to avoid executing an erroneous function.

[0066] The first processing unit 11 ignores the above data in the second processing, and in this case, the medical system 1 can avoid the execution of an erroneous function with a simple process.

[0067] Although preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to these embodiments and their modifications. Addition, omission, substitution, and other modifications of the configuration are possible without departing from the spirit of the present disclosure. Furthermore, the present disclosure is not limited by the above description, but is limited only by the scope of the appended claims.

[0068] According to embodiments of the present disclosure, medical systems and processing methods can reduce the performance of erroneous functions.

[0069] REFERENCE SIGNS LIST 10 First system 11 First processing unit 12 Memory 20 Second system 21 Endoscope 22 Second processing unit 23 Monitor 24 GUI operation unit

Claims

1. A medical system having a first processor and a second processor, wherein the first processor: generates a graphical user interface including an image generated by an endoscope and associated with an ID; associates the newly generated graphical user interface with a new ID; transmits the graphical user interface and the ID to the second processor; when the new ID is the same as the ID added to the data received from the second processor, performs a first process based on at least a portion of the newly generated graphical user interface and the data; when the new ID is different from the ID added to the data received from the second processor, performs a second process different from the first process; and the second processor: displays the graphical user interface received from the first processor on a display; accepts data input in response to operations on the graphical user interface; and transmits the data, to which the ID associated with the graphical user interface is added, to the first processor.

2. The medical system of claim 1, wherein the first processor ignores the data in the second processing.

3. The medical system of claim 1, wherein the first processor performs processing in accordance with the data and at least a portion of the graphical user interface associated with the same ID as the ID added to the data in the second processing.

4. The medical system of claim 1, wherein the ID is updated when an operational component of the graphical user interface changes.

5. The medical system of claim 1, wherein the data indicates coordinates at which an operation was performed in the graphical user interface.

6. A processing method, in which a first processor generates a graphical user interface including an image generated by an endoscope and associated with an ID, the newly generated graphical user interface being associated with a new ID, the first processor transmits the graphical user interface and the ID to a second processor different from the first processor, the second processor displays the graphical user interface received from the first processor on a display, the second processor accepts data input in response to an operation of the graphical user interface, and the second processor transmits the data to which the ID associated with the graphical user interface is attached to the first processor, when the new ID is the same as the ID attached to the data received from the second processor, the first processor performs a first process based on at least a part of the newly generated graphical user interface and the data, and when the new ID is different from the ID attached to the data received from the second processor, the first processor performs a second process different from the first process.

Images