Imaging device, control method, information processing device, and program
The imaging device adjusts focus bracket settings based on medical information to capture clear images across multiple areas, addressing the limitations of fixed focus systems and enhancing diagnostic accuracy.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2026-03-13
AI Technical Summary
Existing imaging systems fail to capture images suitable for comprehensive medical diagnoses, as they often fix focus positions based on a single purpose, leading to out-of-focus areas and inadequate diagnostic information.
An imaging device that adjusts focus bracket imaging settings based on medical information, such as patient history and department, ensuring clear focus across relevant areas for medical imaging.
Enables the capture of images with broader depth of field focus, facilitating more accurate medical diagnoses by ensuring all relevant areas are in focus, reducing operational burden on photographers.
Smart Images

Figure 2026046866000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an imaging device, a control method, an information processing device, and a program, and particularly to a technique for assisting diagnosis using an imaging device.
Background Art
[0002] There is a system that provides imaging control information corresponding to an inspection purpose to an imaging device and supports setting of imaging conditions in the imaging device (Patent Document 1). In the system of Patent Document 1, the imaging control information is configured to fix some parameters such as the focus position, zoom position, and ISO sensitivity for each inspection purpose, and the parameters that can be changed by the photographer can be restricted for each inspection purpose.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, for some inspection purposes, symptoms, etc., suitable inspections, diagnoses, etc. may not be possible with only the images obtained by one-time shooting. For example, in the mode where the focus position is fixed according to the inspection purpose as in Patent Document 1, although the image is in focus on a specific part, an image that is not in focus on other parts may be taken. As a result, with only the images taken in such a state, there is a possibility that a doctor cannot make a suitable diagnosis.
[0005] The present invention has been made in view of the above problems, and an object thereof is to provide an imaging device, a control method, an information processing device, and a program that preferably set an imaging device based on medical information related to medical imaging.
Means for Solving the Problems
[0006] To achieve the aforementioned objectives, the present invention provides an imaging device for use in medical imaging, comprising: an imaging means for imaging a patient; a first acquisition means for acquiring medical information about the patient; and a setting means for setting imaging conditions for medical imaging performed on the patient, wherein the imaging conditions include settings related to focus bracket imaging, and the setting means is characterized by changing the settings related to focus bracket imaging based on the medical information acquired by the first acquisition means. [Effects of the Invention]
[0007] With this configuration, according to the present invention, it is possible to suitably set the imaging device based on medical information related to medical imaging. [Brief explanation of the drawing]
[0008] [Figure 1] A diagram illustrating the configuration of a support system according to embodiments and modified examples of the present invention. [Figure 2] Block diagram illustrating the functional configuration of the imaging device 101 according to embodiments and modified examples of the present invention. [Figure 3] Block diagram illustrating the functional configuration of the information processing device 106 according to embodiments and modifications of the present invention. [Figure 4A] Figure illustrating imaging control information according to embodiments and modified examples of the present invention. [Figure 4B] Figure illustrating imaging control information according to embodiments and modified examples of the present invention. [Figure 5] A flowchart illustrating the imaging process performed by the imaging device 101 according to Embodiment 1 of the present invention. [Figure 6] A flowchart illustrating the setting process according to Embodiment 1 of the present invention. [Figure 7] This figure illustrates a screen displayed on the display device 204 for selecting the purpose of inspection in an imaging device 101 according to embodiments and modified examples of the present invention. [Figure 8] This figure illustrates a screen displayed on a display device 204 for specifying an inspection area in an imaging device 101 according to embodiments and modified examples of the present invention. [Figure 9] A diagram for explaining assist graphics according to embodiments and modifications of the present invention [Figure 10] A flowchart illustrating the shooting process executed by the imaging device 101 according to Embodiment 2 of the present invention [Figure 11] A flowchart illustrating the setting process according to Embodiment 2 of the present invention [Figure 12] A flowchart illustrating the FB setting process according to Embodiment 2 of the present invention [Figure 13] A flowchart illustrating the FB setting process according to Embodiment 3 of the present invention [Figure 14] A flowchart illustrating the shooting process executed by the imaging device 101 according to Embodiment 4 of the present invention [Figure 15] A flowchart illustrating the setting process according to Embodiment 4 of the present invention [Figure 16] A diagram illustrating the operation sequence of the support system according to Modification 2 of the present invention [Figure 17] A flowchart illustrating the shooting process executed by the imaging device 101 according to Modification 2 of the present invention [Figure 18] A flowchart illustrating the preliminary shooting process according to Modification 2 of the present invention [Figure 19] A flowchart illustrating the setting process according to Modification 2 of the present invention [Figure 20] A flowchart illustrating the FB setting process according to Embodiment 5 of the present invention
Mode for Carrying Out the Invention
[0009] [Embodiment 1] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.
[0010] The following-described embodiment will explain an example of applying the present invention to a support system including an imaging device that performs medical imaging and an information processing device that provides information on parameters to be set for medical imaging to the imaging device, as an example of the support system. However, the present invention is applicable to any device capable of setting appropriate parameters for medical imaging in the imaging device.
[0011] Also, in this specification, "medical imaging" is described as referring to an act of imaging at least a part of a person's (such as a patient or a subject) body (for example, an examination site such as an affected part) in applications such as examinations, diagnoses, and inspections. Therefore, the images obtained by medical imaging can be used for examinations, diagnoses, and inspections. Hereinafter, for the sake of easy understanding of the invention, the application of medical imaging will be simply referred to as "examination", the person as the subject will be referred to as "patient", and the image obtained by medical imaging will be referred to as "examination image". However, it should be understood that the medical imaging according to the implementation of the present invention is not limited to those used for examinations.
[0012] 《Configuration of the Support System》 FIG. 1 is a diagram illustrating the configuration of the support system according to the present embodiment. As shown in the figure, the support system includes, in addition to an imaging device 101 for imaging a patient 110, an information processing device 106 that controls the overall operation of the support system including the imaging device 101, and an image management system 105 that manages the examination images obtained by imaging. The support system also includes an electronic medical record system 104 that manages various types of information about the patient (hereinafter referred to as medical information). The medical information managed in the electronic medical record system 104 is provided, for example, when an information acquisition request for displaying an electronic medical record of the patient is received from the display terminal 103, and can be used for displaying and editing the electronic medical record on the display terminal 103. In the present embodiment, the imaging device 101, the electronic medical record system 104, the image management system 105, and the information processing device 106 are configured to be able to transmit and receive information via the network 102.
[0013] In this embodiment, the imaging device 101 is a digital still camera configured to generate visible light image data as an inspection image by capturing images. The imaging device 101 is configured to communicate with the information processing device 106 via the network 102 while the power is on. When the imaging device 101 generates an inspection image, it transmits the inspection image to the information processing device 106.
[0014] The electronic medical record system 104 has an aspect as a database that manages medical information (or electronic medical record information, patient information) for each patient whose information is registered. Medical information for one patient includes, for example, a management number uniquely assigned to that patient, and basic information about the patient such as the patient's name, age, and gender. Medical information also includes information on the patient's medical history and past medical history (hereinafter referred to as medical history information). Medical history information may include information on the location and body part of illnesses and injuries the patient has suffered in the past, the results of examinations and diagnoses, and information to identify the image data used for examinations and diagnoses (image ID). Medical information may be updated in response to, for example, an examination using the imaging device 101, or when a new electronic medical record is generated or an existing electronic medical record is edited on the display terminal 103. The electronic medical record system 104 is configured to read the medical information associated with the management number when it receives an information acquisition request that includes the patient's management number, and to return it to the device that sent the request.
[0015] The image management system 105 has an aspect as a database for managing various types of image data related to patients. The image management system 105 primarily manages examination images captured by the imaging device 101. Each examination image is associated with an image ID that uniquely identifies the examination image, a management number indicating the patient who is the subject of the examination image, and information on the date and time of capture. In addition, the system may be configured to associate various other information with the examination images, such as information on parameters (imaging conditions) set in the imaging device 101 at the time of capture, and the patient's condition. Examination images are registered in the image management system 105, for example, when medical imaging is performed by the imaging device 101, or when a recording instruction is given after medical imaging. Furthermore, the system may be configured to update examination images, for example, when additional information to be added to the examination image is input. The image management system 105 is configured to read the image data associated with the image ID included in the image acquisition request when it receives an image acquisition request for the image data it manages, and send it back to the device that sent the request.
[0016] The information processing device 106 communicates with the imaging device 101, the electronic medical record system 104, and the image management system 105 via the network 102. In the support system of this embodiment, when performing medical imaging using the imaging device 101, the information processing device 106 mainly communicates with the electronic medical record system 104 and the image management system 105 via the network 102 and obtains information to be transmitted to the imaging device 101. As will be described in detail later, when performing medical imaging using the imaging device 101, the information processing device 106 obtains medical information related to the patient 110 from the electronic medical record system 104 and registers (uploads) the examination images to the image management system 105. The information processing device 106 also provides the imaging device 101 with imaging control information, including information on parameters (imaging conditions) to be set in the imaging device 101 in order to capture examination images in an appropriate state. Information communication between the information processing device 106 and the imaging device 101 can be done using, for example, an HDMI® cable, but any communication method between these devices may be used.
[0017] Here, imaging control information includes parameters (imaging conditions) to be set in the imaging device 101, as well as information specifying the screen to be displayed on the display device of the imaging device 101 during medical imaging, and information to be attached to the image obtained by medical imaging (ancillary information). By referring to the imaging control information, the imaging device 101 can be controlled to change various operations related to medical imaging according to the purpose of the examination, etc. Imaging conditions refer to various parameters related to imaging set in the imaging device 101. In one embodiment, such parameters may include a series of parameters related to focus position, zoom position, ISO sensitivity, exposure, Tv value, Av value, white balance, strobe flash, color adjustment processing, and edge enhancement processing.
[0018] <Configuration of the imaging device> Figure 2 is a block diagram illustrating the functional configuration of the imaging device 101 in this embodiment.
[0019] The CPU 201 controls the operation of each block in the imaging device 101. Specifically, the CPU 201 controls the operation of each block by reading the operation program for each block from the ROM 202, loading it into the RAM 203, and executing it.
[0020] ROM202 is a non-volatile memory device. ROM202 stores not only the operation programs for each block of the imaging device 101, but also parameters necessary for the operation of each block. In contrast, RAM203 is a volatile memory device. RAM203 functions as the main memory of the CPU201. RAM203 acts not only as an area for deploying the operation programs of each block, but also as a working area during the operation of each block and as a storage area for intermediate data generated by the operation of each block.
[0021] The imaging unit 200 generates image data of the subject (patient 110). The imaging unit 200 includes a solid-state image sensor. The imaging unit 200 generates an analog image signal by photoelectric conversion of the optical image formed on the imaging surface of the solid-state image sensor via an imaging optical system (not shown). The imaging unit 200 also outputs a digital image signal (image data) by performing A / D conversion processing on the generated analog image signal.
[0022] The display device 204 displays various information related to the imaging device 101. The display device 204 can also display, for example, image data obtained by medical imaging or image data recorded on a recording medium (not shown).
[0023] The input device 205 is a user input interface provided by the imaging device 101. The input device 205 detects operation inputs made to operating members such as a release button, selection key switch, or touch panel provided on the imaging device 101. When the input device 205 detects an operation input, it outputs a control signal corresponding to the operation input.
[0024] The media drive 206 reads and writes data to and from the connected recording medium. The media drive 206 may be configured to allow the attachment and detachment of a recording medium (not shown).
[0025] I / F207 is a network interface for the imaging device 101 to communicate with external devices. I / F207 connects to the network 102 via the communication line 209, and by establishing a communication connection with other devices on the network 102, it becomes possible to communicate with those devices.
[0026] The system bus 208 enables the transmission and reception of information between the various blocks of the imaging device 101. The system bus 208 is composed of, for example, an address bus, a data bus, and a control bus.
[0027] The image processing unit 211 applies various image processing to the image data generated by the imaging unit 200. The image data generated by the imaging unit 200 is stored in the RAM 203, for example, along with information indicating the imaging conditions set at the time of shooting. The image processing unit 211 applies image processing to this image data to generate an inspection image. Such image processing includes, for example, a series of processes to create image data that is adapted to the characteristics of human vision.
[0028] The file generation unit 212 converts the image data into a recording format (a general-purpose still image format) and generates an image file for registration, for example, with the image management system 105. In this embodiment, the file generation unit 212 generates the inspection image as a JPEG image.
[0029] <Configuration of Information Processing Device> Figure 3 is a block diagram illustrating the functional configuration of the information processing device 106 in this embodiment.
[0030] The CPU 301 controls the operation of each block in the information processing unit 106. Specifically, the CPU 301 controls the operation of each block by reading the operation program for each block from the ROM 302, loading it into the RAM 303, and executing it. Alternatively, the CPU 301 controls the operation of each block by reading the application program related to medical imaging from the hard disk drive (HDD) 305, loading it into the RAM 303, and executing it.
[0031] ROM 302 is a non-volatile memory device. ROM 302 stores not only the operating programs for each block of the information processing device 106, but also parameters necessary for the operation of each block. In contrast, RAM 303 is a volatile memory device. RAM 303 functions as the main memory of the CPU 301. RAM 303 functions not only as an area for deploying the operating programs for each block, but also as a working area during the operation of each block and as a storage area for intermediate data generated by the operation of each block.
[0032] The display 304 displays various types of information related to the information processing device 106. For example, the display 304 displays necessary information in each sequence of an application related to medical imaging.
[0033] The HDD305 is a recording device configured to permanently retain information. In addition to application programs related to medical imaging, the HDD305 records data and libraries related to those applications, for example.
[0034] The input device 306 is a user input interface provided by the information processing device 106. The input device 306 may include, for example, a pointing device or a keyboard, and detects operation inputs made to these devices. When the input device 306 detects an operation input, it outputs a control signal corresponding to the operation input.
[0035] The media drive 307 reads and writes data to and from the connected recording medium. The media drive 307 may be configured to allow the attachment and detachment of a recording medium (not shown).
[0036] I / F308 is a network interface for information processing device 106 to communicate with external devices. I / F308 connects to network 102 via communication line 310, and by establishing a communication connection with other devices on network 102, it becomes possible to communicate with those devices.
[0037] The system bus 309 enables the transmission and reception of information between the blocks of the information processing device 106. The system bus 309 is composed of, for example, an address bus, a data bus, and a control bus.
[0038] 《Overview of the support system's operation》 The following describes the general operation of each device when performing medical imaging using the support system of this embodiment.
[0039] In the support system of this embodiment, it is assumed that patient 110 has medical information pre-registered in the electronic medical record system 104. That is, each patient 110 is assigned a management number in advance, and medical information associated with that management number is registered in the electronic medical record system 104. Furthermore, a wristband is worn on the arm of patient 110 during the examination, and the management number information pertaining to patient 110 is attached to the wristband, for example, in the form of a barcode.
[0040] Prior to medical imaging, the person performing the imaging (hereinafter simply referred to as the "imaging person"), such as a doctor or technician, uses the imaging device 101 to photograph the patient's 110 wristband. This imaging process stores image data, including the appearance of the barcode, in the RAM 203 of the imaging device 101. In the support system of this embodiment, this image data is transmitted to the information processing device 106, which is configured to identify the patient's 110 management number by performing image analysis.
[0041] Once the patient's management number is identified, the information processing device 106 sends an information acquisition request containing the management number to the electronic medical record system 104, and acquires medical information related to patient 110 from the electronic medical record system 104. Since it is considered that not all of patient 110's medical information is necessary for medical imaging, the information acquisition request may include information that limits the medical information to be acquired to, for example, information registered within the most recent month. In this case, only the information related to patient 110 that corresponds to a specific period is extracted and returned to the information processing device 106.
[0042] In the support system of this embodiment, the photographer primarily operates the imaging device 101 while performing medical imaging. Therefore, medical information sent back from the electronic medical record system 104 to the information processing device 106 is further transferred from the information processing device 106 to the imaging device 101. Upon receiving the medical information, the imaging device 101 performs a process to inquire with the photographer whether the acquired medical information is that of patient 110. This process may be performed, for example, by displaying the name, age, and gender included in the received medical information on the display device 204 of the imaging device 101, and then prompting the photographer to input whether or not it is that of patient 110.
[0043] Once it is confirmed that the medical information pertains to patient 110, the imaging device 101 identifies the medical department in which the medical imaging will be performed. In this embodiment, the identification of the medical department is based on the examination or treatment history information contained in the medical information pertaining to patient 110. In other words, the CPU 201 of the imaging device 101 identifies which medical department the medical imaging to be performed pertains to based on the treatment history information contained in the received medical information. The identification of the medical department may be configured to require an operation input for final confirmation by the person taking the image. Alternatively, in a configuration in which the treatment history information contains information on multiple medical departments, the system may be configured to accept an operation input to select the medical department in which the medical imaging will be performed from among the multiple medical departments identified based on the medical information.
[0044] Information on the identified medical department is transmitted from the imaging device 101 to the information processing device 106. In the support system of this embodiment, information on the imaging conditions to be set in the imaging device 101 for medical imaging performed on patient 110 is supplied to the imaging device 101 by the information processing device 106 in the form of imaging control information. In other words, the support system of this embodiment reduces the burden on the photographer in adjusting the parameters of the imaging device 101 because the information processing device 106 supplies imaging control information to the imaging device 101 to set imaging conditions that are suitable for the medical department of patient 110.
[0045] <Imaging control information> The imaging control information is pre-recorded in, for example, the HDD305 for multiple types of medical departments. The imaging control information specifies imaging conditions 403 for each medical department 401, as shown in Figures 4A and 4B. In Figures 4A and 4B, two types of medical departments 401 are given as examples: "Dermatology" and "Dentistry," and the imaging conditions 403 to be set in the imaging device 101 are specified for each. Dermatology is further subdivided by examination purpose 402, and in the example shown in the figure, the examination purposes 402 for dermatology are "pressure ulcers," "burns," "seborrheic dermatitis," "atopic dermatitis," "psoriasis," and "urticaria." As mentioned above, the imaging conditions 403 specify the parameters to be set for focus position, zoom position, ISO sensitivity, exposure, Tv value, Av value, white balance, strobe flash, color adjustment processing, edge enhancement processing, etc.
[0046] As shown in the figure, the imaging control information 427 when the clinical department 401 is dentistry and the imaging control information 421-426 when the clinical department 401 is dermatology differ in whether or not the imaging conditions 403 include parameters related to focus bracket imaging. In general, compared to dermatology, medical imaging in dentistry involves a shorter imaging distance (subject distance) for the subject (the teeth of the patient 110), while examination images with even focus across the depth positions from the molars to the anterior teeth tend to be considered important for diagnosis. Therefore, in the support system of this embodiment, the operation of the imaging device 101 is controlled by the imaging control information so that focus bracket imaging is performed when the clinical department identified based on medical information is dentistry, and focus bracket imaging is not performed when it is not dentistry.
[0047] The imaging control information shown in Figures 4A and 4B also includes other information, but since the support system of this embodiment switches the imaging conditions related to focus bracket imaging according to the medical department, the explanation is omitted. This other information will be described in detail as appropriate in embodiments that use the relevant information. That is, the imaging control information of this embodiment is configured to include the medical department 401, the purpose of the examination 402, and the imaging conditions 403.
[0048] Upon receiving imaging control information, the imaging device 101 sets various parameters related to imaging conditions based on that information. Subsequently, when medical imaging is performed by the photographer, the imaging device 101 generates examination image data (image file) and records it on a recording medium. If focus bracketing is performed, the image data obtained from multiple shots with different focal lengths is combined and recorded on the recording medium as examination image data. This combination effectively expands the depth of field, making it possible to generate an image that is in focus on a subject distributed over a wider range in the depth direction than the image data obtained from a single shot.
[0049] The header of the inspection image data may include an image ID that uniquely identifies the inspection image in the support system. This image ID may be issued, for example, by the imaging device 101, or by the image management system 105 in response to an issuance request from the imaging device 101.
[0050] Subsequently, the imaging device 101 associates the imaging conditions information at the time of acquisition of the examination image data with the patient's management number 110 and transmits the examination image data to the information processing device 106. At this time, if the medical department is dermatology, information regarding the purpose of the examination may be further associated with the examination image data. The information processing device 106 temporarily stores the examination image data and associated information in the HDD 305, converts it into data in a predetermined format, and uploads it to the image management system 105 along with a registration request, thereby enabling the management of the examination image data.
[0051] In the support system of this embodiment, the medical DICOM (Digital Imaging and Communications in Medicine) format is adopted as the image data format managed by the image management system 105. The DICOM format is an international standard for medical data communication, and it is possible to associate and record information such as patient information 110 and test results (evaluation values) with image data. For this reason, for test image data temporarily held in the information processing device 106, it may be possible to add information such as evaluation values using the imaging device 101 or the information processing device 106 before uploading it to the image management system 105.
[0052] When the upload of the examination image data (DICOM image) to the image management system 105 is complete, a completion response is sent back to the information processing device 106. Upon receiving this completion response, the information processing device 106 transmits information to the imaging device 101, and the imaging device 101 may notify the photographer that the upload is complete. In this way, the support system of this embodiment assists in setting the imaging conditions of the imaging device 101 related to medical imaging, and allows the examination images taken with the appropriate settings to be registered in the image management system 105.
[0053] 《Photo Processing》 The imaging process performed in the imaging device 101 of this embodiment for medical imaging will be described below using the flowchart in Figure 5 to illustrate the specific processing steps. The processing steps corresponding to the flowchart can be realized by the CPU 201 reading the corresponding processing program stored in, for example, the ROM 202, loading it into the RAM 203, and executing it. This imaging process will be described as starting, for example, when medical information relating to patient 110 is received in response to the transmission of an image of patient 110's wristband.
[0054] In S501, CPU201 identifies the medical department involved in the medical imaging procedure based on the received medical information.
[0055] In S502, the CPU 201 executes a setting process to set various parameters of the imaging conditions on the imaging device 101.
[0056] <Setup Process> Here, the configuration process performed in this step will be explained in detail with reference to the flowchart in Figure 6.
[0057] In S601, CPU201 determines whether the medical department involved in this medical imaging is dentistry. If CPU201 determines that the medical department involved in this medical imaging is dentistry, it moves the process to S602; otherwise, it moves the process to S604.
[0058] In S602, the CPU 201 sends a request to the information processing device 106 via the I / F 207 to transmit imaging control information associated with dentistry, including settings related to focus bracket imaging. Upon receiving this transmission request, the CPU 301 of the information processing device 106 reads the imaging control information indicating that the clinical department 401 is dentistry from the HDD 305 and sends it back to the imaging device 101 via the I / F 308.
[0059] In step S603, the CPU 201 completes the setting process by setting imaging conditions based on the imaging control information returned from the information processing device 106. Setting these imaging conditions includes setting parameters (e.g., number of shots, step width) for performing focus bracketing in medical imaging.
[0060] On the other hand, if S601 determines that the medical department involved in this medical imaging is not dentistry, CPU201 sends a request to transmit imaging control information associated with the identified medical department (and examination purpose) to information processing device 106 via I / F207 in S604. The imaging control information requested in this step does not include settings related to focus bracketing. Upon receiving the transmission request, CPU301 of information processing device 106 reads the imaging control information corresponding to the medical department 401 and examination purpose 402 from HDD305 and sends it back to imaging device 101 via I / F308.
[0061] In step S605, the CPU 201 completes the setting process by setting imaging conditions based on the imaging control information returned from the information processing device 106. Setting these imaging conditions includes setting the system to not perform focus bracketing in medical imaging.
[0062] Once the setup process is complete, CPU201 determines in S503 of the shooting process whether or not an operation input related to the shooting instruction has been made. If CPU201 determines that an operation input related to the shooting instruction has been made, it moves the process to S504; otherwise, it repeats the process in this step.
[0063] In S504, the CPU 201 controls the imaging process and records the obtained examination image data to the recording medium via the media drive 206, associating it with an image ID. More specifically, the CPU 201 causes the imaging unit 200 to perform an imaging operation, applies predetermined image processing to the image data obtained, and then causes the file generation unit 212 to convert it to JPEG format, thereby recording the examination image data. If imaging conditions related to focus bracketing are set, that is, if the medical department for this medical imaging is dentistry, the image data recorded on the recording medium as examination image data may be an image synthesized from images obtained from multiple imaging attempts. In this case, the CPU 201 may control the recording of the multiple images used for synthesis to a separate recording medium.
[0064] In S505, the CPU 201 displays the inspection image data recorded on the recording medium in S504 on the display device 204 and asks the photographer whether the inspection image data recorded is in a state appropriate for determining the inspection result. In response to this inquiry, the CPU 201 controls the system to accept an operation input regarding whether the recorded inspection image data is in a state appropriate.
[0065] In S506, CPU201 determines whether an operation input indicating that the recorded inspection image data is in an appropriate state has been made in relation to the display shown in S505. If CPU201 determines that an operation input indicating that the inspection image data is in an appropriate state has been made, it moves the process to S507. If CPU201 determines that an operation input indicating that the inspection image data is not in an appropriate state has been made, it returns the process to S503.
[0066] In S507, the CPU 201 transmits the examination image data recorded on the recording medium to the I / F 207, associates the imaging conditions information related to the examination image data with the patient 110's management number, and sends it to the information processing device 106.
[0067] In S508, the CPU 201 determines whether or not an evaluation value is entered for the inspection image data. This determination can be made, for example, based on whether or not an operation to enter an evaluation value has been input in response to a display asking whether or not an evaluation value is entered. If the CPU 201 determines that an evaluation value is entered for the inspection image data, it moves the process to S509; if it determines that it is not, it moves the process to S510.
[0068] In S509, the CPU 201 receives input of an evaluation value for the inspection image data. Upon receiving the evaluation value, the CPU 201 transmits the evaluation value to the I / F 207, associates it with the image ID related to the inspection image data, and sends it to the information processing device 106.
[0069] In S510, the CPU 201 transmits information to the information processing device 106 via the I / F 207 indicating that input regarding the inspection image data has been completed. Upon receiving this information, the CPU 301 of the information processing device 106 executes the process of uploading the inspection image data, along with the evaluation values as needed, to the image management system 105. When the CPU 301 receives a response (completion response) from the image management system 105 indicating that the upload is complete, it forwards the completion response to the imaging device 101.
[0070] In S511, CPU201 determines whether or not it has received a completion response. If CPU201 determines that it has received a completion response, it completes the imaging process related to this medical imaging. If CPU201 determines that it has not received a completion response, it repeats the processing in this step.
[0071] As described above, the support system of this embodiment allows for the optimal setting of the imaging device based on medical information related to medical imaging. More specifically, in the imaging device 101 of this embodiment, if the medical department identified based on the medical information relating to the patient 110 is dentistry, control is performed to set the imaging conditions to perform focus bracket imaging. Furthermore, in the imaging device 101, if the medical department identified based on the medical information is a medical department other than dentistry, control is performed to set the imaging conditions so that focus bracket imaging is not performed. In other words, in dental medical imaging, where examination images with even focus across the depth positions from the molars to the anterior teeth are considered important, the imaging device 101 can reduce the operational burden on the photographer regarding the setting of focus bracket imaging parameters.
[0072] In this embodiment, the imaging process has been described as performing the transmission of inspection image data and the transmission of evaluation values at different timings. However, it goes without saying that the implementation of the present invention is not limited to this. That is, the imaging device 101 may transmit data in which the evaluation value information has been inserted into the header of the inspection image data to the information processing device 106, so that the information processing device 106 does not need to perform the process of associating the evaluation value with the inspection image data.
[0073] [Embodiment 2] In the embodiments described above, when the medical department involved in medical imaging is dentistry, imaging conditions including the execution of focus bracket imaging are set based on imaging control information. On the other hand, even in medical imaging related to dentistry, the preferred parameters for focus bracket imaging may change depending on the examination site. For example, the distribution in the depth direction of the main subject (dental arch and teeth) will differ when photographing the dental arch with the upper and lower teeth separated from the patient 110, and when photographing the dental arch from the front or side with the teeth in contact. That is, it is preferable to change the parameters of focus bracket imaging according to the examination site. In this embodiment, we will describe an embodiment in which the specification of the examination site is further accepted during medical imaging, and the parameters of focus bracket imaging are switched according to the specified examination site.
[0074] 《Overview of the support system's operation》 The following describes the general operation of each device when performing medical imaging using the support system of this embodiment. Note that various configurations and some operations of the support system may be the same as in Embodiment 1, and the following describes the operations specific to this embodiment.
[0075] In the support system of this embodiment, once the medical department is identified based on the medical information relating to patient 110, the imaging device 101 further accepts the selection of the examination purpose for that medical department. The examination purpose is predefined for each medical department as described above, and it is assumed that this information is stored in the ROM 202 of the imaging device 101, for example. When the medical department for which medical imaging is to be performed is identified in the imaging device 101, if there are multiple selectable examination purposes for that medical department, a display prompts the user to select one of them. In the example of imaging control information shown in Figures 4A and 4B, multiple examination purposes are defined for dermatology, and when dermatology is identified as the medical department, the display accepting the selection of the examination purpose is as shown in Figure 7(a), for example. Once the examination purpose is selected, the imaging device 101 receives imaging control information relating to the medical department and examination purpose from the information processing device 106. The imaging device 101 then accepts the specification of the examination site from which to acquire examination image data. The selectable examination sites are predefined for each medical department and examination purpose, and in this embodiment, candidates can be identified by referring to the imaging control information.
[0076] <Imaging control information> As shown in Figures 4A and 4B, the imaging control information of this embodiment defines candidate body parts to be photographed during an examination for each combination of the medical department 401 and the examination purpose 402, as candidate body part 404. For example, in the imaging control information 427 related to dentistry, five types of body parts are defined as candidate body parts 404: "maxilla," "mandible," "front view," "left view," and "right view." In this case, the display device 204 of the imaging device 101, which has been identified as the medical department performing medical imaging as dentistry, displays a list of candidate examination body parts as shown in Figure 8, and the photographer inputs an operation to specify the examination body part to be photographed from among these.
[0077] In this configuration where multiple candidate examination sites are defined, the system may be configured to require imaging of multiple sites in order to determine the examination results in the relevant medical department. Whether imaging of multiple sites is required to determine the examination results is described in the multiple site determination 411 of the imaging control information. The multiple site determination 411 defines examination sites for which imaging of multiple sites is essential in order to determine the examination results in medical imaging. In the example of imaging control information 427, the multiple site determination 411 defines that imaging of multiple sites is essential when the maxilla and mandible are specified as examination sites in medical imaging related to dentistry. In the imaging device 101 of this embodiment, when an examination site for which acquisition of whole-body examination image data is essential is specified, control is performed to turn ON (true) a multiple site flag (logical information) held in, for example, RAM 203. When the multiple site flag is ON, the CPU 201 controls the imaging process to repeat the process until all examination image data of the necessary sites are recorded.
[0078] Furthermore, in dermatological examinations, depending on the examination site (affected area) where symptoms are present, it may be necessary to obtain examination image data of the entire patient 110 to determine the examination results. In other words, in order to determine the examination results (symptoms) for a specific examination site, it may be necessary to know how the symptoms manifest throughout the entire body of the patient 110. For this reason, the multiple site determination 411 may define examination sites that require the entire body to be included as multiple sites. For example, in the imaging control information 422 related to burns in dermatology, when "head / neck," "trunk," "upper limbs," and "lower limbs" are specified as examination sites, the multiple site determination 411 defines that imaging of multiple sites including the entire body is mandatory. In the imaging device 101 of this embodiment, when an examination site that requires the acquisition of whole-body examination image data is specified in this way, control is performed to turn ON (true) a whole-body flag (logical information) held in, for example, RAM 203. The imaging control information illustrated in Figures 4A and 4B defines the differences in the operation of the imaging device 101 and the support system depending on whether the whole-body flag is ON or OFF. For example, in the imaging control information 422, the imaging conditions 403 define that the imaging conditions for the zoom position change according to the value of the whole-body flag.
[0079] Furthermore, cases requiring multiple examination image data to determine the examination result are not limited to images of different body parts or the entire body. For example, there are cases where the examination result is determined based on examination image data taken of the same body part under different lighting and imaging conditions. For this reason, the multiple image determination 410 defines whether or not (yes / no) multiple examination image data of different / same body parts are necessary to determine the examination result in medical imaging. In the imaging device 101 of this embodiment, if multiple examination image data are essential for determining the examination result, control is performed to turn ON (true) a multiple image determination flag (logical information) held in, for example, RAM 203.
[0080] Incidentally, judging the examination results based on examination image data obtained from medical imaging requires that the examination image data be captured in appropriate conditions, such as whether the subject being examined is captured at the appropriate size within the field of view and whether the lighting conditions are appropriate. On the other hand, in the case where the examiner is asked to confirm whether or not the examination image data has been captured in appropriate conditions by displaying the recorded examination image data on the display device 204, there are cases where, for example, examination image data that is not properly focused is recorded. In particular, in the case where the display device 204 is small, it is difficult to check the details of the examination image data, and examination image data that is not in appropriate condition may be overlooked and recorded. If examination image data that is not in appropriate condition is recorded in this way, the examination must be repeated, which can place a burden on the examiner and the patient 110. In particular, in the case where recording of multiple areas or multiple images of examination image data is required to judge the examination results, the time required for the examination will also be prolonged, which can place an excessive burden on the examiner and the patient 110. For this reason, the imaging control information also defines assist figures 405 and confirmation conditions 406 to assist in capturing and recording examination image data in appropriate conditions for each examination area.
[0081] The assist figure 405 defines a figure to be displayed to indicate the preferred position within the field of view where the subject (examination area) should be distributed when imaging the selected examination area. For example, in the assist figure 405 of the imaging control information 427, when the maxilla or mandible is specified as the examination area, a curve showing the contour of the dental arch and a vertical line passing through the center of the field of view are defined. In this case, for example, when performing medical imaging of the maxilla, the display device 204 of the imaging device 101 displays each assist figure superimposed on the captured image 901 showing the subject currently captured by the imaging unit 200, as shown in Figure 9. In the example in the figure, the captured image 901 is superimposed with an arch-shaped curve (contour) 902 corresponding to the dental arch and a vertical line 903 that passes through the center of the field of view and extends vertically (vertically) from the display device 204. This display allows the photographer to easily understand where within the field of view the dental arch should be captured when taking medical images of the upper jaw, and to frame the imaging device 101 so that the image of the subject (examination area) matches the displayed assist figure.
[0082] On the other hand, confirmation condition 406 defines various conditions for confirming the state of inspection image data obtained by shooting, so that inspection image data in an appropriate state is registered in the image management system 105. For example, confirmation condition 406 of the imaging control information 427 specifies that when the upper or lower jaw is designated as the inspection area, the condition for the inspection image data to be in an appropriate state is that the focus position is near the position where the contour lines of the assist figure were superimposed at the time of shooting. Also, confirmation condition 406 specifies that when the front, left, or right side is designated as the inspection area, the condition for the inspection image data to be in an appropriate state is that the focus position is in the center of the field of view. Furthermore, confirmation condition 406 specifies a range of values for subject distance and brightness / edge evaluation value that will determine the inspection image data to be in an appropriate state. Also, confirmation condition 406 specifies a range of values for the overlap rate between the area where the contour lines were distributed and the area where a predetermined color is distributed in the inspection image data that will determine the inspection image data to be in an appropriate state when contour lines are used as assist figures. In this case, if the subject being examined is a tooth, the specified color will be, for example, a white-based color, which is a common shade of tooth. Therefore, it will be confirmed, based on confirmation condition 406, whether the area in the examination image data where this white-based color is distributed is captured within the area where the outline was displayed during framing, that is, the area defined as where the dental arch should be distributed within the field of view.
[0083] In other words, the imaging control information of this embodiment is configured to include, in addition to the imaging control information of Embodiment 1, a candidate body part 404, an assist figure 405, a confirmation condition 406, a multiple image judgment 410, and a multiple body part judgment 411. In this way, the support system of this embodiment can assist the photographer in recording inspection image data in an appropriate state for the inspection body part specified by the imaging device 101. That is, the imaging device 101 of this embodiment can not only set imaging conditions for photographing the inspection body part based on the imaging control information relating to the inspection body part, but can also display an assist figure to assist with framing and determine whether or not to re-photograph the inspection image data.
[0084] 《Photo Processing》 The imaging process performed in the imaging device 101 of this embodiment for medical imaging will be described below using the flowchart in Figure 10 to explain the specific processes. The processes corresponding to the flowchart can be realized by the CPU 201 reading the corresponding processing program stored in, for example, the ROM 202, loading it into the RAM 203, and executing it. This imaging process will be described as starting when medical information related to patient 110 is received in response to the transmission of an image of patient 110's wristband, for example. In the description of the imaging process of this embodiment, steps that perform the same processing as the imaging process of Embodiment 1 will be given the same reference numbers, and the following description will be limited to steps that perform processing specific to the imaging process of this embodiment.
[0085] In S501, the clinical department involved in the medical imaging is identified, and in S1001, the CPU 201 accepts the selection of the examination purpose. This step may be performed if multiple examination purposes are defined for the identified clinical department. That is, in the case of dentistry, where only one type of examination purpose (teeth) is defined, as in the examples in Figures 4A and 4B, this step may not be performed. When selecting the examination purpose, a screen related to the selection of the examination purpose is displayed on the display device 204, as shown in Figure 7(a).
[0086] In step S1002, the CPU 201 executes a setting process to set various parameters of the imaging conditions on the imaging device 101.
[0087] <Setup Process> Here, the configuration process performed in this step will be explained in detail with reference to the flowchart in Figure 11. In the description of the configuration process in this embodiment, steps that perform the same processing as the configuration process in Embodiment 1 will be given the same reference numbers, and the following description will be limited to steps that perform processing specific to the configuration process in this embodiment.
[0088] In S1101, the CPU201 determines whether or not it has received imaging control information related to the current medical imaging. If the CPU201 has received the imaging control information related to the current medical imaging, it moves the process to S1103; otherwise, it moves the process to S601.
[0089] If S601 determines that the medical department involved in this medical imaging is not dentistry, CPU201 sends a request to transmit imaging control information associated with the identified medical department and the selected examination purpose to the information processing device 106 via I / F207 in S1102. The transmission request sent in this step is for obtaining imaging control information from the information processing device 106, which does not include settings related to focus bracket imaging. Upon receiving the transmission request, CPU301 of the information processing device 106 reads the imaging control information corresponding to the medical department 401 and examination purpose 402 from HDD305 and sends it back to the imaging device 101 via I / F308.
[0090] If imaging control information is received in S602 or S1102, the CPU 201 accepts the specification of the examination site in S1103. Information on candidate sites that can be specified as examination sites is included in the received imaging control information. Therefore, the CPU 201 configures a screen for specifying the examination site based on the imaging control information and displays it on the display device 204, and accepts operation input related to the specification. When the CPU 201 accepts operation input related to the specification of the examination site, it moves the processing to S1104.
[0091] In S1104, the CPU201 sets various flags (multiple site flag, whole body flag, and multiple image judgment flag) based on the information of the specified examination site and imaging control information. For example, if the medical department is dentistry, the CPU201 sets the multiple site flag and the multiple image judgment flag to true, and the whole body flag to false. Also, for example, if the medical department is dermatology, the purpose of the examination is burns, and the examination site is the upper limb, the CPU201 sets all of the multiple site flag, whole body flag, and multiple image judgment flag to true. This step may be performed only once for this medical imaging.
[0092] In S1105, CPU201 determines whether the medical department involved in this medical imaging is dentistry. If CPU201 determines that the medical department involved in this medical imaging is dentistry, it moves the process to S1106; otherwise, it moves the process to S1107.
[0093] In S1106, CPU201 executes the focus bracket (FB) setting process, which sets the imaging conditions for dental imaging.
[0094] (FB configuration process) Here, the FB configuration process performed in this step will be explained in detail with reference to the flowchart in Figure 12.
[0095] In S1201, the CPU 201 sets imaging conditions based on imaging control information received from the information processing device 106. Setting these imaging conditions includes changing the settings to perform focus bracketing, and setting the number of shots and step width, which are specified as default values in the imaging control information, as parameters for performing focus bracketing. Furthermore, in focus bracketing, it is preferable to make the depth of field of the images obtained in each of the multiple shots shallow in order to obtain a composite image with a suitably extended depth of field when the images obtained from shooting at each focus position are combined. For this reason, setting these imaging conditions also includes setting the Av value to open to increase the amount of light by opening the aperture in order to make the depth of field shallow.
[0096] In S1202, CPU201 determines whether the specified examination site is the maxilla or the mandible. If CPU201 determines that the specified examination site is either the maxilla or the mandible, it moves the process to S1203; otherwise, it moves the process to S1205.
[0097] In S1203, CPU201 sets the focus position to the position of the dental arch. That is, if the examination site is the maxilla, CPU201 sets the focus position to focus on the upper dental arch. Also, if the examination site is the mandible, CPU201 sets the focus position to focus on the lower dental arch.
[0098] In S1204, CPU201 completes the FB setting process by changing the parameters for the number of shots and step width related to focus bracketing from the default values. Specifically, CPU201 changes the number of shots to a value greater than the default value (increases the number of shots) and changes the step width to a value smaller than the default value (narrows the step width).
[0099] On the other hand, if the CPU 201 determines in S1202 that the specified inspection area is neither the maxilla nor the mandible, it sets the focus position to the center of the field of view in S1205. In other words, the CPU 201 sets the focus position to the center of the field of view when the inspection area is the front, left, or right side.
[0100] In S1206, CPU201 completes the FB setting process by changing the parameters for the number of shots and step width related to focus bracketing from the default values. Specifically, CPU201 changes the number of shots to a value smaller than the default value (reduces the number of shots) and changes the step width to a value larger than the default value (widens the step width).
[0101] Once the FB configuration process is complete, CPU201 finishes the configuration process.
[0102] Furthermore, if S1105 determines that the medical department involved in this medical imaging is not dentistry, the CPU 201 completes this setting process in S1107 by setting imaging conditions based on the information of the specified examination site and the imaging control information received from the information processing device 106. Setting these imaging conditions includes setting that focus bracketing should not be performed in medical imaging.
[0103] Once the setup process is complete, CPU201 transfers the shooting process to S1003.
[0104] In step S1003, the CPU 201 displays assist figures related to the examination area on the display device 204 based on the imaging control information. More specifically, the CPU 201 controls the display device 204 to display an image obtained by superimposing assist figures onto the captured images sequentially output by the imaging unit 200.
[0105] In S504, when the inspection image data is recorded on the recording medium, the CPU 201 determines in S1004 whether the recorded inspection image data is in an appropriate state. This determination may be made based on the confirmation conditions 406 of the imaging control information. The confirmation conditions for determining whether the inspection image data is in an appropriate state may include conditions related to the focus position, subject distance, brightness, and edge evaluation value. In addition, the confirmation conditions may also include conditions related to the positional relationship between the area where the assist inspection related to the inspection part is placed and the subject image in the inspection image data, the color distribution in the inspection image data, and the positional relationship between the subject and the imaging device 101. Therefore, the CPU 201 checks whether each of the confirmation conditions is met, for example, based on the image of the inspection image data or the values of the corresponding parameters stored in the header of the inspection image data (imaging conditions and measurement information of the distance measuring sensor for focusing).
[0106] The CPU 201 determines that the inspection image data is in an appropriate state and proceeds to S1005 if the inspection image data satisfies all the conditions specified in the confirmation conditions 406 of the imaging control information. The CPU 201 also determines that the inspection image data is not in an appropriate state and returns to S503 if the inspection image data does not satisfy any of the conditions specified in the confirmation conditions 406 of the imaging control information.
[0107] When returning to S503, the CPU 201 may display a notification on the display device 204 to ensure that appropriate examination image data is recorded for any conditions that the examination image data did not meet. For example, in maxillary medical imaging, if the focus position is not near the contour line of the assist figure, the notification may include content prompting a change in framing so that the dental arch follows the contour line of the assist figure. Also, for example, if the subject distance is not within the distance range defined in the confirmation conditions, the notification may include content indicating that the subject distance is too far / too close. Also, for example, if the imaging device 101 is not facing the examination site (subject), the notification may include content prompting a change in orientation. Also, for example, if the brightness is not within the value range defined in the confirmation conditions, the notification may include content indicating that the brightness is too bright / too dark. For example, if the edge evaluation value does not fall within the range specified in the confirmation conditions, the notification may include instructions to the photographer to stabilize the imaging device 101 or to the patient 110 to remain still in order to reduce camera shake or subject blur.
[0108] In step S1005, the CPU 201 transmits the examination image data recorded on the recording medium to the I / F 207, and sends the information processing device 106 with the associated imaging condition information, examination purpose information, and patient 110 management number.
[0109] Furthermore, after determining in S508 that no evaluation value has been entered, or after evaluation value has been entered in S509, CPU 201 determines in S1006 whether multiple examination image data are necessary to determine the examination results related to the medical imaging. This determination can be made based on whether the multiple image determination flag is true or not. Alternatively, this determination can be made based on whether the whole-body flag or the multiple-part flag is true or not. If CPU 201 determines that multiple examination image data are necessary to determine the examination results, it moves the process to S1007; if it determines that they are not necessary, it moves the process to S510.
[0110] In S1007, the CPU 201 stores in the RAM 203 information indicating that the inspection area related to the inspection image data transmitted to the information processing device 106 in S507 has already been photographed. This information can be used to notify the photographer of the photographed area on the screen that accepts the specification of the inspection area shown in Figure 8.
[0111] In S1008, CPU201 determines whether or not there are any areas that have not been photographed for this medical imaging procedure. If CPU201 determines that there are areas that have not been photographed, it returns to processing in S1002; otherwise, it moves the process to S1009.
[0112] In S1009, CPU201 determines whether or not whole-body imaging data of patient 110 is necessary to determine the results of the medical imaging examination. This determination can be made based on whether or not the whole-body flag is true. If CPU201 determines that whole-body imaging data is necessary to determine the results of the examination, it moves the process to S1010; otherwise, it moves the process to S510.
[0113] In S1010, the CPU 201 receives input of evaluation values (overall evaluation values) based on the examination image data of each examination site acquired in connection with the medical imaging in this case, and the examination image data of the patient 110's whole body. Here, the overall evaluation value may be derived by performing a predetermined calculation based on the evaluation values input for the examination image data of each examination site and the evaluation values obtained by image analysis of the examination image data of the whole body. When the CPU 201 receives input of the overall evaluation value, it transmits the overall evaluation value to the I / F 207 and sends it to the information processing device 106 along with the image ID related to the examination image data.
[0114] As described above, the support system of this embodiment provides auxiliary information (such as assist shapes and confirmation conditions) for recording inspection image data in an appropriate state as imaging control information, thus avoiding the need for repeated inspections and other troublesome tasks.
[0115] In this embodiment, the FB setting process was described as changing the number of shots and step width from the default values specified in the imaging control information for both cases where the examination site is the maxilla / mandible and cases where it is not. However, the implementation of the present invention is not limited to this. The FB setting process only needs to be adjusted so that when recording examination image data that captures details of a subject with a wide depth distribution, such as a dental arch, the number of shots is greater and the step width is narrower than for subjects with a relatively narrow depth distribution, such as the front, left, and right sides of a dental arch. In other words, the parameter adjustment for focus bracket imaging only needs to be adjusted so that the number of shots is greater when the dental arch is the examination site compared to cases where the dental arch is not the examination site. Similarly, the parameter adjustment for focus bracket imaging only needs to be adjusted so that the step width is narrower when the dental arch is the examination site compared to cases where it is not. In other words, although the FB setting process was described as changing each parameter from the default value in both cases where the dental arch is the examination site and cases where it is not, one of them may be left at the default value as long as the relative relationship is ensured.
[0116] [Example 1] In the embodiments described above, it was assumed that the imaging conditions were not changed during the period in which multiple focus bracket imaging was performed, but the implementation of the present invention is not limited to this. When the maxilla or mandible is specified as the examination site, the dental arch, which is the subject, is distributed at different positions in the depth direction, which can lead to biases in the lighting conditions or differences in how the strobe hits the teeth. That is, even when imaging is performed at the same time, the lighting conditions may differ between the molars and anterior teeth, so when image data obtained by imaging these under fixed imaging conditions is combined, the resulting examination image data may have altered exposure for some of the subjects (teeth). Therefore, if the exposure changes within the examination image data, the reliability of the examination results judged based on that examination image data may decrease.
[0117] Therefore, when CPU201 performs multiple shots related to focus bracketing, it may adjust the imaging conditions to smooth the exposure for front teeth (subjects located closer in the depth direction), where the exposure may change depending on the lighting conditions. On the other hand, for back teeth (subjects located further away in the depth direction), where the lighting conditions tend to be darker, the influence of the strobe lighting conditions is considered to be low, so exposure smoothing should be disabled.
[0118] [Embodiment 3] In the above-described embodiment 2, an embodiment was described in which parameters (number of shots and step width) for performing focus bracket imaging according to the examination area specified by the photographer were adjusted, but the present invention is not limited to this. The extent to which the subject extends in the depth direction changes depending on the angle at which the imaging surface of the imaging unit 200 (or imaging device 101) is directed to the subject during shooting. Due to the structure of the human body, it is difficult to position the imaging device 101 in a position directly facing the occlusal surface of the dental arch for shooting, so when shooting the maxilla or mandible, the subject is shot from an oblique angle. As a result, when the imaging device 101 and the subject are not directly facing each other, the subject will be captured by the imaging unit 200 in a manner that extends in the depth direction more than when they are directly facing each other. More specifically, the more the imaging device 101 is deviated from the direction directly facing the subject (the larger the angle between the imaging direction and the front direction of the subject), the greater the depth direction of the subject will be captured. For this reason, this embodiment will describe an embodiment in which parameters for performing focus bracket imaging are adjusted according to the angle between the front direction of the subject and the imaging direction.
[0119] 《FB configuration process》 The FB setting process performed in the imaging device 101 of this embodiment will be described in detail below with reference to Figure 13. In the description of the FB setting process of this embodiment, steps that perform the same processing as the FB setting process of Embodiment 2 will be given the same reference numerals, and the following description will be limited to steps that perform processing specific to the FB setting process of this embodiment.
[0120] In S1203, when the focus position is set to the position of the dental arch, the CPU 201 acquires the angle between the frontal direction of the subject (the occlusal surface of the dental arch at the examination site) and the imaging direction in S1301. The angle may be derived, for example, by estimating the three-dimensional shape of the subject based on the output of the distance measuring sensor and deriving it based on the normal vector of the surface of the subject to be photographed in that three-dimensional shape. Alternatively, the angle may be derived based on the posture of the imaging device 101 based on the output of a built-in posture sensor, assuming that the dental arch of the patient 110 is in a specific posture on the dental chair or the like.
[0121] In S1302, CPU201 changes the parameters for the number of shots and step width related to focus bracketing, based on the magnitude of the angle between the front direction of the subject and the imaging direction acquired in S1302, from the default values. At this time, CPU201 adjusts the number of shots to a larger value and the step width to a smaller value as the angle increases. In other words, when the angle is large, it is assumed that the subject is distributed over a wide range in the depth direction, so CPU201 reduces the step width and increases the number of shots to ensure the sharpness of the subject at the corresponding distance for each focus position. CPU201 completes this FB setting process after changing the parameters related to focus bracketing.
[0122] By doing so, the parameters related to focus bracketing are adjusted according to the depth distribution of the subject, making it possible to generate inspection image data with even focus across the subject through synthesis.
[0123] In this embodiment, when the upper or lower jaw is specified as the examination site, an embodiment has been described in which the parameters related to focus bracketing are adjusted according to the magnitude of the angle between the frontal direction of the subject and the imaging direction. However, the implementation of the present invention is not limited to this. The extent of the subject in the depth direction in dental medical imaging is not limited to a specific examination site, but changes depending on the arrangement relationship between the subject to be examined and the imaging device 101, or the arrangement relationship and the shape of the subject. For this reason, when performing focus bracketing regardless of the examination site, the extent of the subject in the depth direction may be estimated according to the angle between the frontal direction of the subject and the imaging direction, and the parameters related to focus bracketing may be adjusted accordingly.
[0124] [Embodiment 4] In the embodiments and modifications described above, a method of performing focus bracket imaging to record examination image data when the medical department is dentistry was explained, but the implementation of the present invention is not limited to this. Examination image data in which the entire dentition is evenly focused, as described above, is particularly desired in cases where no specific tooth exhibiting symptoms is identified, such as in caries checks or regular checkups. In contrast, in examinations and treatments where a specific tooth or gum exhibiting symptoms (e.g., periodontitis) is identified, examination image data that is pinpoint focused on that tooth or gum, rather than the entire dentition, is desired. In other words, even if the medical department is dentistry, focus bracket imaging may not be necessary depending on the purpose of the examination. In this embodiment, multiple examination purposes are defined in advance for dentistry, and a method of setting imaging conditions, including parameters for performing focus bracket imaging, when an examination purpose concerning the entire dentition is selected will be described.
[0125] To facilitate understanding of the invention, this embodiment will be described as having two types of examination purposes related to dentistry: "caries / periodic checkup" and "treatment." Here, "caries / periodic checkup" corresponds to an examination purpose concerning the entire dentition, while "treatment" corresponds to an examination purpose concerning some teeth (or gums). Furthermore, although the contents of the imaging control information when the examination purpose is "treatment" will not be described in detail, such imaging control information will not include settings related to focus bracket imaging. That is, if the medical department is dentistry and the examination purpose is treatment, the imaging device 101 requests imaging control information that does not include settings related to focus bracket imaging from the information processing device 106, and records the examination image data by imaging that is not focus bracket imaging.
[0126] 《Photo Processing》 The imaging process performed in the imaging device 101 of this embodiment will be described in detail with reference to the flowchart in Figure 14. In the description of the imaging process of this embodiment, steps that perform the same processing as in the imaging processes of Embodiments 1 and 2 will be given the same reference numerals, and the following description will be limited to steps that perform processing specific to the imaging process of this embodiment.
[0127] In S501, the clinical department involved in the medical imaging is identified, and in S1401, the CPU 201 accepts the selection of the examination purpose. In this embodiment, multiple examination purposes are defined for dentistry, so even when the clinical department is dentistry, the screen for selecting the examination purpose is displayed on the display device 204. Here, the screen for selecting the examination purpose can be configured for each clinical department, for example, and for dentistry, a screen like the one shown in Figure 7(b) is displayed. As shown in the figure, on the screen for selecting the examination purpose for dentistry, two options are presented to the person taking the imaging: "Cavity / regular check-up" and "Treatment".
[0128] In S1402, the CPU 201 executes a setting process to set various parameters of the imaging conditions on the imaging device 101.
[0129] <Setup Process> Here, the configuration process performed in this step will be explained in detail with reference to the flowchart in Figure 15. In the description of the configuration process in this embodiment, steps that perform the same processing as in the configuration processes of Embodiments 1 and 2 will be given the same reference numbers, and the following description will be limited to steps that perform processing specific to the configuration process of this embodiment.
[0130] If S601 determines that the medical department involved in this medical imaging is dentistry, CPU201 determines in S1501 whether the purpose of the examination related to this medical imaging is for dental caries or routine checkups. If CPU201 determines that the purpose of this medical imaging is for dental caries or routine checkups, it moves the process to S602. If CPU201 determines that the purpose of this medical imaging is not for dental caries or routine checkups, i.e., treatment, it moves the process to S1102.
[0131] In this manner, when medical imaging is performed for the purpose of examining some teeth, the imaging device 101 of this embodiment is controlled to acquire imaging control information from the information processing device 106 that does not include settings related to focus bracket imaging. In this case, the imaging device 101 is configured to control the imaging conditions so that focus bracket imaging is not performed, and thus it is possible to record examination image data suitable for the examination of some teeth.
[0132] In this embodiment, two types of dental examination purposes have been given as examples: caries / periodic checkups and treatment, and treatment has been explained as an examination purpose concerning some teeth. However, it goes without saying that the implementation of the present invention is not limited to this. These examination purposes are merely examples, and it will be easy to understand that not all dental treatments target some teeth, nor do all caries / periodic checkups target the entire dentition. In other words, in another embodiment, the examination purposes can be further subdivided, and for each examination purpose, it may be determined whether the examination target is the entire dentition or some teeth, that is, whether or not focus bracket imaging is required.
[0133] [Differentiation 2] The embodiments and modifications described above describe a method of requesting the photographer to input evaluation values and other information regarding inspection image data as needed. On the other hand, in recent years, there are systems, such as Patent Document 1, that use an inference model to infer information (auxiliary information) that is suitable for the inspection purpose based on image data of the subject being inspected. By applying such a system to the support system, it is possible to support, for example, the input of evaluation values associated with inspection image data related to the shooting process S508 to S509.
[0134] 《Inference Models Related to Inference of Auxiliary Information》 Auxiliary information may include, for example, information about the subject included in the image data that indicates the area (affected area) where the symptoms for the examination are appearing, and the condition of that area (severity of symptoms). This information can be, for example, two-dimensional information corresponding to the area, or numerical information such as the area of the area or the progression of symptoms. In one embodiment, the auxiliary information may also include the evaluation value itself.
[0135] In order to enable the inference of such auxiliary information from image data of subjects related to the examination purpose, this modified support system builds an inference model by performing machine learning in advance. For example, the inference model can be built using machine learning with training data that quantifies which pixels in each image data image data show symptoms and the degree of those symptoms, for each examination purpose and case, based on a set of image data of the relevant examination area. The training data can also include the color and color distribution of the affected area in the image data.
[0136] In this modified example, the constructed inference model is implemented in the information processing device 106. The information processing device 106 is configured to allow switching between inference models depending on the inspection purpose. Therefore, when the CPU 301 of the information processing device 106 receives inspection image data associated with an inspection purpose from the imaging device 101, it provides the inspection image data as input to the inference model related to that inspection purpose and causes it to infer auxiliary information.
[0137] The auxiliary information is transmitted from the information processing device 106 to the imaging device 101, associated with the image ID of the examination image data used as input to the inference model, and is displayed on the display device 204 as an inference result. The photographer can input evaluation values related to the examination purpose for the examination image data while referring to the inference result (either by inputting evaluation values based on the photographer's knowledge based on the inference result, or by inputting evaluation values by adjusting the numerical values of the inference result). For example, in a configuration where the auxiliary information includes two-dimensional information indicating the area of the affected area, the auxiliary information may be displayed in a manner in which the two-dimensional information is superimposed on the examination image data used as input to the inference model (image data identified by the image ID associated with the auxiliary information).
[0138] In this modified example, the information provided to the imaging device 101 for each inspection objective, that is, the information of what the inference model infers as auxiliary information in the information processing device 106, is included in the imaging control information and provided to the imaging device 101. As shown in Figures 4A and 4B, in the support system of this modified example, each piece of imaging control information includes an inference display 407, an evaluation item 408, and an evaluation value 409. That is, the imaging control information of this embodiment is configured to include, in addition to the imaging control information of Embodiment 2, an inference display 407, an evaluation item 408, and an evaluation value 409. The evaluation item 408 indicates the item for which the corresponding inference model of the information processing device 106 makes inferences for each inspection objective. The evaluation value 409 indicates the type of evaluation value that the corresponding inference model of the information processing device 106 makes inferences for each evaluation item. The inference display 407 indicates whether or not to display the inference result when auxiliary information is received from the information processing device 106, and the item to be displayed on the display device 204 as the inference result. Therefore, the CPU 201 of the imaging device 101 controls the display of inference results based on the imaging control information received from the information processing device 106, with respect to the auxiliary information received after transmitting the inspection image data to the information processing device 106.
[0139] 《Operation Sequence of the Support System》 The following describes the operation overview of the support system for this modified example, which performs evaluation value inference based on inspection image data in the information processing device 106, using the sequence diagram in Figure 16.
[0140] In S1601, the photographer uses the imaging device 101 to photograph the patient's wristband.
[0141] In S1602, the imaging device 101 transmits image data, including the appearance of the barcode obtained by the imaging in S1601, to the information processing device 106.
[0142] In S1603, the information processing device 106 performs image analysis of the received barcode, including its appearance, to identify the patient's management number.
[0143] In S1604, the information processing device 106 sends an information acquisition request to the electronic medical record system 104, which includes the management number identified in S1603.
[0144] In S1605, the electronic medical record system 104, upon receiving an information retrieval request, searches its database for medical information associated with the management number included in the information retrieval request.
[0145] In S1606, the electronic medical record system 104 returns the medical information obtained as a search result to the information processing device 106. As described above, the medical information returned to the information processing device 106 may be composed of information on tests registered during the most recent period, such as the last month, from the medical information obtained as a search result.
[0146] In S1607, the information processing device 106 transfers the medical information returned from the electronic medical record system 104 to the imaging device 101.
[0147] In S1608, the imaging device 101 prompts the photographer to confirm whether the medical information received from the information processing device 106 is patient 110's information. At this time, the imaging device 101 displays the name, age, and gender of the patient 110 on the display device 204 as confirmation information. The display also includes an OK button (GUI for inputting that the information is patient 110's) and an NG button (GUI for inputting that the information is not patient 110's) for the photographer to input their confirmation result. If the photographer inputs an operation related to selecting the OK button, the sequence proceeds to S1609. On the other hand, if the photographer inputs an operation related to selecting the NG button, the sequence returns to S1601.
[0148] In S1609, if the medical information relating to patient 110 includes information on multiple tests, the imaging device 101 displays candidate clinical departments and test objectives on the display device 204 based on that information and accepts the selection. If the medical information relating to patient 110 does not include information on any tests, the imaging device 101 displays all candidate clinical departments and test objectives on the display device 204 and accepts the selection. If the medical information relating to patient 110 includes information on only one test, or if there are multiple tests but all of them share the same clinical department and test objective, the sequence proceeds to S1611.
[0149] In S1610, the imaging device 101 determines whether or not the operator has made an input regarding the selection of the medical department and the purpose of the examination. If the operator has made an input regarding the selection, the sequence proceeds to S1611; otherwise, S1610 is repeated. The selection of the medical department and the purpose of the examination may be configured to accept selections in stages. Furthermore, the items for which the operator's selection operation is accepted may be limited to the purpose of the examination only, or vice versa, to the medical department only, as in the above embodiment and modified examples.
[0150] In S1611, the imaging device 101 transmits information regarding the medical department and examination purpose related to this medical imaging to the information processing device 106.
[0151] In S1612, the information processing device 106 reads the corresponding imaging control information from the HDD 305 to the RAM 303 based on the received information on the medical department and the purpose of the examination.
[0152] In S1613, the information processing device 106 transmits the imaging control information read from the RAM 303 to the imaging device 101.
[0153] In S1614, the imaging device 101 stores the received imaging control information in the RAM 203 and displays candidate examination sites on the display device 204 based on this imaging control information to accept the designation.
[0154] In S1615, the imaging device 101 determines whether or not an operation input related to the designation of the examination area has been made by the photographer. If an operation input related to the designation has been made by the photographer, the sequence proceeds to S1616; otherwise, S1615 is repeated.
[0155] In S1616, the imaging device 101 sets the imaging conditions for the specified examination area.
[0156] In S1617, the imaging device 101 performs a series of imaging processes based on the operation input related to the imaging instruction from the photographer, and records the obtained inspection image data onto a recording medium via the media drive 206, associating it with an image ID.
[0157] In S1618, the imaging device 101 transmits the recorded examination image data to the information processing device 106, associating it with the imaging conditions, examination purpose, and patient 110 management number related to the examination image data.
[0158] In S1619, the information processing device 106 stores the received inspection image data in the HDD 305. The information processing device 106 then inputs the inspection image data into an inference model corresponding to the inspection purpose and infers auxiliary information.
[0159] In S1620, the information processing device 106 transmits the auxiliary information obtained by inference to the imaging device 101, associating it with the image ID of the inspection image data used as input to the inference model.
[0160] In S1621, the imaging device 101 displays the inference result for the inspection image data recorded in S1617 on the display device 204 based on the received auxiliary information. The display of the inference result also includes an OK button (GUI for inputting that there is no problem with the inference result) and a reshoot button (GUI for inputting that there is a problem with the inference result and that reshooting and reinference are necessary) for the photographer to confirm that there is no problem with the inference result. Note that the display of the inference result is performed only if it is specified in the inference display 407 of the imaging control information to display the inference result.
[0161] In S1622, the imaging device 101 determines whether an operation input related to selecting the OK button or the retake button has been made by the photographer. It also determines whether an operation input related to specifying the examination area has been made. If an operation input related to selecting the OK button has been made by the photographer, the sequence proceeds to S1623; if an operation input related to selecting the retake button has been made, it returns to S1617.
[0162] In S1623, the imaging device 101 displays each evaluation item defined in the imaging control information related to the inspection purpose on the display device 204 and accepts input (or editing) of evaluation values. Here, if the displayed evaluation item includes an evaluation value corresponding to auxiliary information, that evaluation value is also displayed on the display device 204. That is, for evaluation items for which an evaluation value has been obtained as an inference result, editing of the evaluation value of the inference result is accepted. On the other hand, for evaluation items for which an evaluation value has not been obtained as an inference result, it is configured to allow new evaluation values to be entered. For such evaluation items, for example, related inference result information can also be displayed as reference information. In addition to the display that accepts input of evaluation values, a completion button (GUI for entering that editing / new input of evaluation values has been completed) is also included to accept operation input to the effect that the displayed evaluation value does not need to be edited or the photographer has decided that no new input is required.
[0163] In S1624, the imaging device 101 determines whether or not the photographer has made an input to select the "complete" button. If the photographer has made an input to select the "complete" button, the sequence proceeds to S1625; otherwise, S1624 is repeated.
[0164] In S1625, the imaging device 101 transmits the input or edited evaluation value information to the information processing device 106, associating it with the image ID and management number of the corresponding inspection image data.
[0165] In S1626, the information processing device 106 stores the received evaluation value information in RAM 303, associating it with the corresponding inspection image data recorded in HDD 305. Here, the corresponding inspection image data is image data on which inference regarding the evaluation value has been made, and is image data associated with the same image ID as the evaluation value information.
[0166] In S1627, the information processing device 106 generates an image file in DICOM format (DICOM image) containing medical information, evaluation values, and examination image data.
[0167] In S1628, the information processing device 106 transmits (uploads) the generated DICOM image to the image management system 105 along with the management number related to patient 110 and image data that reflects the inference results (for example, examination image data with information on the area where symptoms are present).
[0168] In S1629, the image management system 105 registers the received DICOM image and other information in the database and sends a completion response back to the information processing device 106.
[0169] In S1630, the information processing device 106 receives a completion response from the image management system 105, which is then forwarded to the imaging device 101. This allows the imaging device 101 to display a notification on the display device 204 indicating that the registration of the examination image data related to this medical imaging has been completed.
[0170] In this configuration, where the display of inference results is specified in the imaging control information, and inference results (auxiliary information) based on inspection image data are provided from the information processing device 106 to the imaging device 101, the processing in S509 of the imaging process related to the input of evaluation values may be forcibly executed. More specifically, in the configuration where the display of inference results is specified in the inference display 407 of the imaging control information, the processing in S508 to inquire whether or not evaluation values have been input is not executed, and the evaluation value input / editing screen based on the inference results is displayed and the processing in S509 is performed.
[0171] Applications of Reasoning In the image control information related to this modified example shown in Figures 4A and 4B, for dental procedures, no inference for inputting evaluation values or display of inference results is performed. On the other hand, inference based on examination image data can be used not only to derive predetermined evaluation values for the purpose of examination, but also, for example, to identify symptoms appearing in the subject in the examination image data.
[0172] In the above-described Embodiment 4, a method was described in which, in medical imaging related to dentistry, the presence or absence of focus bracket imaging is switched according to the examination purpose selected by the photographer. In other words, Embodiment 4 described a method in which, in medical imaging related to dentistry, the presence or absence of focus bracket imaging is switched depending on whether the examination purpose is related to the entire dentition or to a part of the teeth (or gums).
[0173] On the other hand, in embodiments where an inference model is available that infers the condition of the patient's oral cavity (dental arch and gums) based on image data, the step of having the photographer select the purpose of the examination can be omitted. For example, before the recording photography (main photography) related to dentistry, the inference model may be made to infer the condition of the patient's oral cavity based on the image data obtained from focus bracket photography, and based on the inference result, it may be decided whether or not to perform focus bracket photography in the main photography.
[0174] In other words, in this modified example, when the medical department involved in the medical imaging is identified as dentistry, the oral cavity of patient 110 is imaged (preliminary imaging) with the setting to perform focus bracket imaging. Here, the preliminary imaging of patient 110's oral cavity may be performed on each of the multiple examination sites provided for dentistry, or it may be limited to specific examination sites such as the maxilla and mandible. Furthermore, the imaging control information for the preliminary imaging is acquired separately from the main imaging information processing device 106. The image data (preliminary images) obtained from the preliminary imaging is transmitted from the imaging device 101 to the information processing device 106, and the information processing device 106 uses a dental inference model to infer the state of patient 110's oral cavity based on the image data. The inference result of the state of patient 110's oral cavity is transmitted to the imaging device 101, which uses it to determine whether the main imaging should target the entire dentition or only some teeth (or gums).
[0175] Therefore, in this modified support system, machine learning is performed in advance on image data of various conditions in the oral cavity related to dentistry, and an inference model capable of inferring symptoms appearing in the oral cavity is constructed. For example, for image data showing symptoms of tooth decay, machine learning is performed using the area of the affected area, the decayed portion, the inflamed / infected portion, and depth information in the image data as training data. Furthermore, oral symptoms can include not only symptoms related to teeth such as tooth decay, but also symptoms related to the gums such as gingivitis and periodontitis. The inference model constructed by such machine learning can, by inputting image data obtained from preliminary imaging, infer the state and distribution of specific symptoms if they are present in the subject captured in the image data (teeth and gums in the oral cavity of patient 110).
[0176] Preliminary shooting process The preliminary imaging process performed in the imaging device 101 of this modified example will be described in detail with reference to the flowchart in Figure 17. In the description of the preliminary imaging process of this modified example, steps that perform the same processing as the imaging process of Embodiment 4 will be given the same reference numerals, and the following description will be limited to steps that perform processing specific to the preliminary imaging process of this modified example.
[0177] In S501, the department involved in the medical imaging is identified. In S1701, CPU201 determines whether the department involved in the medical imaging is dentistry. If CPU201 determines that the department involved in the medical imaging is dentistry, it moves the process to S1702; otherwise, it moves the process to S1401.
[0178] In S1702, CPU201 performs preliminary imaging processing related to preliminary dental imaging.
[0179] <Preliminary shooting process> Here, the preliminary imaging process performed in this step will be explained in detail with reference to the flowchart in Figure 18.
[0180] In S1801, the CPU 201 sends a request to the information processing device 106 via the I / F 207 to transmit imaging control information related to preliminary dental imaging. As described above, the imaging control information for which a transmission request is made in this step includes settings related to focus bracket imaging. Upon receiving the transmission request, the CPU 301 of the information processing device 106 reads the corresponding imaging control information from the HDD 305 and sends it back to the imaging device 101 via the I / F 308.
[0181] In S1802, the CPU 201 sets imaging conditions based on imaging control information related to preliminary imaging returned from the information processing device 106. Setting these imaging conditions includes setting parameters (e.g., number of shots, step width) for performing focus bracketing imaging in medical imaging.
[0182] In S1803, the CPU201 determines whether or not an operation input related to the shooting (preliminary shooting) instruction has been made. If the CPU201 determines that an operation input related to the shooting instruction has been made, it moves the process to S1804; otherwise, it repeats the process in this step.
[0183] In S1804, CPU201 performs control related to focus bracketing (control of multiple shots) and stores the obtained images in RAM203. CPU201 also synthesizes the images obtained from multiple shots to generate image data related to preliminary shooting (data for status determination: preliminary image).
[0184] In S1805, the CPU 201 transmits state determination data to the I / F 207 and has it sent to the information processing device 106 along with a request for inference of the oral cavity state. Upon receiving the inference request, the CPU 301 of the information processing device 106 inputs the state determination data into the inference model related to dentistry to infer auxiliary information and sends the auxiliary information back to the imaging device 101. Upon receiving the auxiliary information from the information processing device 106, the CPU 201 completes this preliminary imaging process.
[0185] Once the preliminary shooting process is complete, CPU201 moves the shooting process to S1703.
[0186] In S1703, the CPU 201 executes a setting process to set various parameters of the imaging conditions on the imaging device 101.
[0187] <Setup Process> Here, the configuration process performed in this step will be explained in detail with reference to the flowchart in Figure 19. In the description of the configuration process in this embodiment, steps that perform the same processing as the configuration process in Embodiments 1, 2, and 4 will be given the same reference number, and the following description will be limited to steps that perform processing specific to the configuration process in this embodiment.
[0188] If S601 determines that the medical department involved in this medical imaging is dentistry, CPU201 determines in S1901 whether or not to perform the imaging on the entire dentition. This determination is made based on the auxiliary information received in the preliminary imaging process. In one embodiment, CPU201 makes this determination based on the distribution of areas inferred to be affected by symptoms in the condition determination data. Specifically, if the areas inferred to be affected by symptoms are concentrated near some teeth or gums, CPU201 determines that the imaging will not be performed on the entire dentition, i.e., will be performed on some teeth or gums. On the other hand, if the areas inferred to be affected by symptoms are dispersed at multiple locations within the dentition, CPU201 determines that the imaging will be performed on the entire dentition. If CPU201 determines that the imaging will be performed on the entire dentition, it moves the process to S602; if it determines that it will not, it moves the process to S1102.
[0189] In this manner, when medical imaging is performed on a portion of teeth or gums, the imaging device 101 of this embodiment is controlled to acquire imaging control information from the information processing device 106 that does not include settings related to focus bracket imaging. In this case, the imaging device 101 is configured to set parameters for imaging conditions that control the process so as not to perform focus bracket imaging, thereby enabling the recording of examination image data suitable for the examination of a portion of teeth or gums.
[0190] [Embodiment 5] Incidentally, since focus bracketing requires recording multiple image data while changing the focus position, it is preferable that the patient 110 does not move during the focus bracketing period. However, it is difficult to keep young patients 110, such as kindergarteners or elementary school students, still for a long period of time. Therefore, in this embodiment, a method for adjusting the parameters for performing focus bracketing based on the age of the patient 110 will be described. In the following example, a method for adjusting the parameters to shorten the time required for focus bracketing when the age of the patient 110 is less than the threshold of 10 years will be described.
[0191] 《FB configuration process》 The FB setting process performed in the imaging device 101 of this embodiment will be described in detail below with reference to Figure 20. In the description of the FB setting process of this embodiment, steps that perform the same processing as the FB setting process of Embodiment 2 will be given the same reference numerals, and the following description will be limited to steps that perform processing specific to the FB setting process of this embodiment.
[0192] In S1201, when imaging conditions are set based on imaging control information, CPU201 determines in S2001 whether or not patient 110's age is less than 10 years. This determination can be made by referring to the medical information related to patient 110. If CPU201 determines that patient 110's age is less than 10 years, it moves the process to S2002; otherwise, it completes this FB setting process.
[0193] In S2002, CPU201 completes the FB setting process by changing the parameters for the number of shots and step width related to focus bracketing from the default values. Specifically, CPU201 changes the number of shots to a value smaller than the default value (reduces the number of shots) and changes the step width to a value larger than the default value (widens the step width).
[0194] In this way, when patient 110 is a young child, the parameters for the number of shots and step width related to focus bracket imaging, which are set as default values, can be adjusted to reduce the physical burden on patient 110.
[0195] In this embodiment, the FB setting process describes treating young patients 110 as irregular patients and changing the parameters related to focus bracket imaging from their default values when the patient is young. However, the implementation of the present invention is not limited to this. For example, in a setting where the support system is used in a facility where young patients 110 are the primary target of examination, such as pediatric dentistry, the parameters related to focus bracket imaging may be changed to increase the imaging period when the patient 110 is not young.
[0196] Furthermore, while Figure 20 describes an FB setting process in which parameters related to focus bracket imaging are adjusted to values that reduce physical burden when the patient 110 is a child, the implementation of the present invention is not limited to this. When photographing the dental arch, the patient 110 must keep their mouth open, but for example, having an elderly patient 110 keep their mouth open for a long time can also be a physical burden. Therefore, the adjustment of parameters related to focus bracket imaging may be configured to be performed not only in children, but also when a predetermined age condition is met.
[0197] Furthermore, the adjustment of parameters related to focus bracket imaging based on patient 110's medical information is not limited to patient 110's age. The adjustment of parameters related to focus bracket imaging may be made based on, for example, patient 110's gender, medical history, etc.
[0198] Furthermore, the criteria for parameter adjustment are not limited to reducing the physical burden caused by focus bracketing. For example, in cases where the frequency of examinations for similar symptoms is increasing, the presence of different factors is suspected, and although the physical burden may increase, it goes without saying that parameter adjustments may be made to enable more precise examinations.
[0199] [Difference 3] In the embodiments and modifications described above, when focus bracketing is performed, a composite image obtained by combining image data from multiple shots is transmitted to the information processing device 106 (registered in the image management system 105) as inspection image data. This embodiment is useful not only because it allows image data with an extended depth of field to be registered as inspection image data, but also because it reduces the processing load on the information processing device 106 and the image management system 105 that receive the image data.
[0200] On the other hand, the process of combining multiple image data (hereinafter referred to as the combining process) requires a certain amount of processing time. Furthermore, the computational load of the imaging device 101 increases when the combining process is performed, so additional processing may not be possible until the combining process is completed. For this reason, in a configuration in which medical imaging is performed sequentially for multiple patients, the number of patients that can be examined within a limited period such as consultation time may decrease when medical imaging, including focus bracketing, is performed. In other words, there are cases in which it is preferable to prioritize the execution of medical imaging rather than reducing the processing load of the information processing device 106 and the image management system 105, such as when there is a backlog of consultations and examination appointments.
[0201] Therefore, the CPU 201 may, in the imaging process, acquire schedule information regarding the schedule of medical imaging to be performed using the imaging device 101, and control whether or not to execute the synthesis process based on this information. That is, the CPU 201 switches, based on the schedule information, whether the examination image data to be transmitted to the information processing device 106 when focus bracket imaging is performed is image data obtained from multiple imaging sessions, or composite image data obtained by combining these sessions. The schedule information may be acquired, for example, from the information processing device 106, or from other servers that manage reservation information for medical institutions and examination facilities.
[0202] Specifically, when focus bracketing is performed, the CPU 201 determines whether or not sufficient time can be allocated for the synthesis process based on, for example, the time until the next examination (medical imaging) included in the schedule information or the number of examinations scheduled for that day. If the CPU 201 determines that sufficient time can be allocated for the synthesis process, it outputs a single composite image obtained by combining multiple image data obtained from focus bracketing to the I / F 207 and sends it to the information processing device 106 as examination image data. If the CPU 201 determines that sufficient time cannot be allocated for the synthesis process, it outputs multiple image data obtained from focus bracketing to the I / F 207 and sends them to the information processing device 106 as examination image data.
[0203] Here, the number of image data transmitted to the information processing device 106 does not need to be the same as the number of shots taken for focus bracketing. That is, the image data transmitted to the information processing device 106 only needs to be such that a composite image data with an extended depth of field can be generated by performing a composite processing using that image data as material in any of the devices. In other words, instead of transmitting all of the image data for the set number of shots to the information processing device 106, by configuring it to transmit only a portion of it through decimation, the processing load on the information processing device 106 and the imaging device 101 can be reduced. For example, in a configuration where accuracy (the overall degree of focus of the subject image) is important for the composite image data to be generated in the future, the image data to be transmitted can be extracted by decimating based on a minimum step width that guarantees a predetermined accuracy. Alternatively, in a configuration where it is important to reduce the load related to information transmission and reception, the image data to be transmitted can be extracted by decimating based on the step width or the number of shots so that the number of extracted image data remains within a predetermined number.
[0204] In addition, for example, if the purpose of the examination requires imaging of multiple examination sites in order to determine the examination results, the system may be configured to switch whether or not to perform the image synthesis process.
[0205] [Differentiation Example 4] In the embodiments and modifications described above, an embodiment was described in which the medical department for the medical imaging is identified based on the medical history information contained in the patient's medical information, but the invention is not limited thereto. The medical department may be identified, for example, by referring to the reservation information registered for the patient's examination. Alternatively, the medical department may be identified, for example, based on preliminary images obtained from preliminary imaging of the examination site of the patient's examination site. In this embodiment, if it is determined by image analysis that teeth are captured in the preliminary image, the CPU 201 can identify the medical department as dentistry.
[0206] [Difference 5] The embodiments and modifications described above describe a method for controlling focus bracket imaging in medical imaging when the medical department is dentistry, but the present invention is not limited thereto. The present invention can be applied to medical imaging in medical departments where focus bracket imaging is preferable or for examination purposes.
[0207] Generally, health checkups and comprehensive medical examinations incorporate various tests into the process so that patients can complete their diagnosis in a single visit, with the results being provided later by mail or other means. However, if there are deficiencies in the medical imaging performed during the examination, such as insufficient focus, an accurate diagnosis cannot be made, requiring the patient to return to the clinic, which is burdensome for the patient. Furthermore, by imaging the subject under various shooting conditions, it is possible to make a diagnosis from multiple perspectives, such as discovering symptoms that were not anticipated during the examination. For this reason, the setting of imaging conditions for focus bracket imaging may be configured to be used in medical imaging in medical departments other than dentistry.
[0208] [Modification 6] In the above-described embodiment and modified support system, the imaging control information corresponding to the medical department and examination purpose determined in the imaging device 101 is acquired from the information processing device 106, and the parameters are adjusted in the imaging device 101. However, the implementation of the present invention is not limited to this, and for example, the parameters may be adjusted in the information processing device 106 to suit the medical imaging of patient 110, and the information of the adjusted parameters may be provided to the imaging device 101. In this case, the CPU 301 of the information processing device 106, for example, in the process of determining the imaging conditions for the medical imaging to be performed by the imaging device 101, adjusts the parameters based on the medical information of patient 110 to configure the imaging control information when performing focus bracket imaging. Subsequently, the CPU 301 causes the imaging control information to be transmitted to the imaging device 101 via the I / F 308. Upon receiving the imaging control information, the CPU 201 of the imaging device 101 can complete the setting of the imaging conditions for the current medical imaging based on the imaging control information without performing parameter adjustments.
[0209] [Other embodiments] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.
[0210] [Summary of Embodiments and Modifications] The disclosures herein include the following imaging devices, control methods, information processing devices, and programs. (Item 1) An imaging device used for medical imaging, An imaging means for imaging a patient, A first acquisition means for acquiring medical information relating to the aforementioned patient, A setting means for setting imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, The setting means changes the settings related to focus bracket imaging based on the medical information acquired by the first acquisition means. An imaging device characterized by the following features. (Item 2) The system further includes a means for identifying the medical department for which medical imaging is performed on the patient, based on the medical information. The setting means changes the settings related to focus bracket imaging based on the medical department identified by the identification means. The imaging device described in item 1, characterized by the features described herein. (Item 3) The aforementioned medical information is the electronic medical record information of the patient. The aforementioned identification means identifies the medical department based on the medical history information contained in the electronic medical record information. The imaging device described in item 2, characterized by the features described herein. (Item 4) The aforementioned medical information consists of preliminary images taken of the examination site of the patient. The aforementioned identification means identifies the medical department based on the preliminary image. The imaging device described in item 2, characterized by the features described herein. (Item 5) The system further includes a designation means for specifying the examination site of the patient, The setting means further changes the settings related to focus bracket imaging based on the inspection area specified by the designation means. An imaging device according to any one of items 1 to 4, characterized in that it is an imaging device. (Item 6) The system further includes a second acquisition means for acquiring the positional relationship between the inspection site and the imaging device, The setting means changes the settings related to focus bracketing based on the positional relationship between the inspection site and the imaging device. The imaging device described in item 5, characterized by the features described herein. (Item 7) The setting means changes the settings for focus bracket imaging based on the depth distribution of the inspection area. The imaging device according to item 5 or 6, characterized in that it is an imaging device. (Item 8) The system further includes a selection means for selecting the purpose of examination for the patient, The setting means further changes the settings related to focus bracketing based on the inspection objective selected by the selection means. An imaging device according to any one of items 1 to 7, characterized in that it is an imaging device. (Item 9) The aforementioned medical information consists of preliminary images taken of the examination site of the patient. The imaging device further includes inference means for inferring symptoms appearing in the examination area based on the preliminary image, The setting means further changes the settings related to focus bracketing based on the inference results from the inference means. An imaging device according to any one of items 1 to 7, characterized in that it is an imaging device. (Item 10) The aforementioned medical information includes information on the patient's age, The setting means further modifies the settings related to focus bracket imaging based on the patient's age. An imaging device according to any one of items 1 to 9, characterized in that it is an imaging device. (Item 11) The setting means changes the settings for focus bracketing to shorten the imaging period for medical imaging when the patient's age falls below a threshold. The imaging device according to item 10, characterized in that it is a imaging device. (Item 12) The settings for focus bracketing include at least one of the following: information on whether or not to perform focus bracketing, the number of shots, and the step size. An imaging device according to any one of items 1 to 11, characterized in that it is the same as described in item 1 to 11. (Item 13) The settings for focus bracketing further include information on whether or not to perform exposure smoothing. The imaging device according to item 12, characterized in that it is a imaging device. (Item 14) The setting means modifies the settings related to focus bracket imaging to perform focus bracket imaging when the clinical department is dentistry. An imaging device according to any one of items 2 to 4, characterized in that it is an imaging device. (Item 15) The setting means switches whether or not to perform focus bracket imaging depending on whether the entire dentition is the target of medical imaging or only some teeth or gums are the target of medical imaging. The imaging device according to item 14, characterized in that it is a imaging device. (Item 16) The system further includes an output means for outputting images obtained through medical imaging as examination images. When focus bracketing is performed, the output means outputs a composite image, which is a composite of multiple images obtained by the focus bracketing, as the inspection image. An imaging device according to any one of items 1 to 15, characterized in that it is an imaging device. (Item 17) It further has a third means of obtaining information regarding the schedule of medical imaging, The output means, when performing focus bracketing, switches between outputting the composite image as the inspection image or outputting at least a portion of the multiple images as the inspection image, based on the schedule information. The imaging device described in item 16, characterized by the features described herein. (Item 18) An information processing device for setting imaging conditions for medical imaging in an imaging device used for medical imaging, Means of obtaining medical information about patients, A determination means for determining the imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, The determination means changes the settings related to focus bracket imaging based on the medical information acquired by the acquisition means. An information processing device characterized by the following: (Item 19) A control method for an imaging device used in medical imaging, The imaging process involves imaging the patient, A process for obtaining medical information about the aforementioned patient, A setting step for setting imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, In the setting step, the settings for focus bracket imaging are changed based on the medical information acquired in the acquisition step. A control method characterized by the following: (Item 20) A control method for an information processing device used in medical imaging, which sets imaging conditions for medical imaging, The process of acquiring medical information about patients, A determination step for determining the imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, In the determination step, the settings for focus bracket imaging are changed based on the medical information acquired in the acquisition step. A control method characterized by the following: (Item 21) A program for causing a computer to function as one of the means of an imaging apparatus described in any one of items 1 through 17. (Item 22) A program to cause a computer to function as one of the means of the information processing device described in item 18.
[0211] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]
[0212] 101: Imaging device, 104: Electronic medical record system, 105: Image management system, 106: Information processing device, 200: Imaging unit, 201: CPU, 301: CPU
Claims
1. An imaging device used for medical imaging, An imaging means for imaging a patient, A first acquisition means for acquiring medical information relating to the aforementioned patient, A setting means for setting imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, The setting means changes the settings related to focus bracket imaging based on the medical information acquired by the first acquisition means. An imaging device characterized by the following features.
2. The system further includes a means for identifying the medical department for which medical imaging is performed on the patient, based on the medical information. The setting means changes the settings related to focus bracket imaging based on the medical department identified by the identification means. The imaging apparatus according to feature 1.
3. The aforementioned medical information is the electronic medical record information of the patient. The aforementioned identification means identifies the medical department based on the medical history information contained in the electronic medical record information. The imaging device according to feature 2.
4. The aforementioned medical information consists of preliminary images taken of the examination site of the patient. The aforementioned identification means identifies the medical department based on the preliminary image. The imaging device according to feature 2.
5. The system further includes a designation means for specifying the examination site of the patient, The setting means further changes the settings related to focus bracket imaging based on the inspection area specified by the designation means. The imaging apparatus according to feature 1.
6. The system further includes a second acquisition means for acquiring the positional relationship between the inspection site and the imaging device, The setting means changes the settings related to focus bracketing based on the positional relationship between the inspection site and the imaging device. The imaging apparatus according to feature 5.
7. The setting means changes the settings for focus bracket imaging based on the depth distribution of the inspection area. The imaging apparatus according to feature 5.
8. The system further includes a selection means for selecting the purpose of examination for the patient, The setting means further changes the settings related to focus bracketing based on the inspection objective selected by the selection means. The imaging apparatus according to feature 1.
9. The aforementioned medical information consists of preliminary images taken of the examination site of the patient. The imaging device further includes inference means for inferring symptoms appearing in the examination area based on the preliminary image, The setting means further changes the settings related to focus bracketing based on the inference results from the inference means. The imaging apparatus according to feature 1.
10. The aforementioned medical information includes information on the patient's age, The setting means further modifies the settings related to focus bracket imaging based on the patient's age. The imaging apparatus according to feature 1.
11. The setting means changes the settings for focus bracket imaging to shorten the imaging period for medical imaging when the patient's age falls below a threshold. The imaging apparatus according to feature 10.
12. The settings for focus bracketing include at least one of the following: information on whether or not to perform focus bracketing, the number of shots, and the step size. The imaging apparatus according to feature 1.
13. The settings for focus bracketing further include information on whether or not to perform exposure smoothing. The imaging apparatus according to feature 12.
14. The setting means modifies the settings related to focus bracket imaging to perform focus bracket imaging when the clinical department is dentistry. The imaging device according to feature 2.
15. The setting means switches whether or not to perform focus bracket imaging depending on whether the entire dentition is the target of medical imaging or only some teeth or gums. The imaging apparatus according to feature 14.
16. The system further includes an output means for outputting images obtained through medical imaging as examination images. When focus bracketing is performed, the output means outputs a composite image, which is a composite of multiple images obtained by the focus bracketing, as the inspection image. The imaging apparatus according to feature 1.
17. It further has a third means of obtaining information regarding the schedule of medical imaging, The output means, when performing focus bracketing, switches between outputting the composite image as the inspection image or outputting at least a portion of the multiple images as the inspection image, based on the schedule information. The imaging device according to feature 16.
18. An information processing device for setting imaging conditions for medical imaging in an imaging device used for medical imaging, Means of obtaining medical information about patients, A determination means for determining the imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, The determination means changes the settings related to focus bracket imaging based on the medical information acquired by the acquisition means. An information processing device characterized by the following:
19. A control method for an imaging device used in medical imaging, The imaging process involves imaging the patient, A process for obtaining medical information about the aforementioned patient, A setting step for setting imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, In the setting step, the settings for focus bracket imaging are changed based on the medical information acquired in the acquisition step. A control method characterized by the following:
20. A control method for an information processing device used in medical imaging, which sets imaging conditions for medical imaging, The process of acquiring medical information about patients, A determination step for determining the imaging conditions for medical imaging performed on the aforementioned patient, It has, The aforementioned imaging conditions include settings related to focus bracketing, In the determination step, the settings for focus bracket imaging are changed based on the medical information acquired in the acquisition step. A control method characterized by the following:
21. A program for causing a computer to function as one of the means of an imaging apparatus according to any one of claims 1 to 17.
22. A program for causing a computer to function as each of the means of the information processing apparatus described in claim 18.
Citation Information
Patent Citations
Imaging device
JP2022129358A