Image viewing method, electronic equipment and storage medium

Abstract

The invention provides an image viewing method, electronic equipment and a storage medium. A human-computer interaction interface of the electronic equipment comprises an image list and an image inspection window. The method comprises the following steps: acquiring an image; in response to a call of a user to the images, arranging the called images in the image list in sequence according to the imaging time of the images; in response to a movement operation of a user on a preset control in the image list, controlling the preset control in movement to intersect with at least one image; calculating an area ratio between the preset control in movement and the intersected image; and displaying the image corresponding to the area ratio greater than a preset threshold value in the image inspection window. By using the method, not only can a plurality of images be continuously displayed, but also the convenience of image display operation and the display efficiency of the images can be improved.

Description

Technical Field

[0001] This application relates to the field of image processing, and more particularly to an image inspection method, electronic device, and storage medium. Background Technology

[0002] In the medical field, to facilitate the tracking of diseased areas, it is often necessary to magnify and display multiple consecutive medical images of the same patient. However, the current method requires doctors to click multiple times to display multiple medical images. This method is cumbersome, time-consuming, affects the display efficiency of medical images, and makes it difficult to display multiple medical images continuously, which is not conducive to disease tracking. Summary of the Invention

[0003] In view of the above, it is necessary to provide an image viewing method, electronic device and storage medium that can solve the technical problems of poor image display efficiency and difficulty in displaying multiple images sequentially.

[0004] On one hand, this application provides an image inspection method applied to an electronic device. The human-computer interaction interface of the electronic device includes an image list and an image inspection window. The method includes: acquiring an image; responding to a user's call for the image; arranging the called images in the image list according to their imaging time; responding to a user's movement operation on a preset control in the image list; controlling the moving preset control to intersect with at least one image; calculating the area ratio between the moving preset control and the intersecting image; and displaying the image corresponding to the area ratio greater than a preset threshold in the image inspection window.

[0005] In some embodiments of this application, the method further includes: responding to a user's movement operation of a preset control in the image list, controlling the moved preset control to intersect with at least one image, calculating the area ratio between the moved preset control and the intersecting image, displaying the image corresponding to the area ratio greater than a preset threshold in the image inspection window, and moving the preset control so that the area ratio corresponding to the image displayed in the image inspection window reaches 100%.

[0006] In some embodiments of this application, the method further includes: controlling the image list to scroll downwards in response to the user moving the preset control to the bottom of the window of the human-computer interaction interface, and controlling the image list to scroll upwards in response to the user moving the preset control to the top of the window of the human-computer interaction interface.

[0007] In some embodiments of this application, the method further includes: in response to a user's click operation on an image in the image list, displaying the clicked image in the image view window, and moving the preset control so that the area ratio corresponding to the clicked image reaches 100%.

[0008] In some embodiments of this application, before responding to the movement operation, the method further includes: acquiring user information of the image; determining whether to segment the image based on the user information; if it is determined that the image should be segmented, calling a preset segmentation model to segment the image to obtain multiple segmentation regions; determining a first feature region from the multiple segmentation regions; and adjusting the image based on the first feature region and a second feature region corresponding to the first feature region in a reference image.

[0009] In some embodiments of this application, adjusting the image based on the first feature region and the second feature region corresponding to the first feature region in the reference image includes: calculating the area ratio between the second feature region and the first feature region as a scaling ratio, scaling the image according to the scaling ratio, determining the third feature region corresponding to the first feature region in the scaled image, calculating the area intersection-union ratio between the second feature region and the third feature region, and transforming the scaled image according to the area intersection-union ratio.

[0010] In some embodiments of this application, transforming the scaled image according to the area intersection-union ratio includes: transforming the scaled image if the area intersection-union ratio is less than or equal to a preset configuration value, until the area intersection-union ratio between the third feature region and the second feature region corresponding to the transformed image is greater than the preset configuration value, and then stopping the transformation of the scaled image.

[0011] In some embodiments of this application, calculating the area ratio between the moving preset control and the intersecting image includes: calculating the intersection area between the preset control and the intersecting image, and using the ratio between the intersection area and the image area of ​​the intersecting image as the area ratio.

[0012] On the other hand, this application provides an electronic device, which includes: a memory storing at least one instruction; and a processor executing at least one instruction to implement the image viewing method.

[0013] On the other hand, this application provides a computer-readable storage medium storing at least one instruction, which is executed by a processor in an electronic device to implement the image inspection method described above.

[0014] Through the above embodiments, this application provides an image list and an image viewing window. The image list includes preset controls that can be moved / draged, allowing users to flexibly select the images they need to view. Since all images selected in the image list are displayed in the image viewing window, when a user drags the preset controls in the image list, multiple images can be selected and displayed sequentially in the image viewing window without the need for time-consuming image switching, thus improving operational convenience and image display efficiency. Furthermore, in medical applications, arranging images sequentially in the image list according to imaging time facilitates tracking the changing trends of diseases. In addition, displaying medical images corresponding to area ratios greater than a preset threshold can improve the accuracy of image display. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0016] Figure 2 This is a flowchart of an image inspection method provided in an embodiment of this application.

[0017] Figure 3 This is a schematic diagram of a fundus image provided in an embodiment of this application.

[0018] Figure 4 This is a schematic diagram of a human-computer interaction interface provided in an embodiment of this application.

[0019] Figure 5 This is a schematic diagram showing the intersection of a preset control and multiple medical images provided in an embodiment of this application.

[0020] Figure 6 This is a flowchart of an image processing method provided in an embodiment of this application.

[0021] Figure 7 This is a schematic diagram of the network structure of a segmentation model provided in an embodiment of this application.

[0022] Figure 8 This is a schematic diagram of the first feature region and the second feature region provided in an embodiment of this application.

[0023] Figure 9 This is a flowchart of a method for generating medical images according to an embodiment of this application.

[0024] Figure 10 This is a schematic diagram illustrating the generation of a medical image according to an embodiment of this application.

[0025] Figure 11 This is a flowchart of an image inspection method provided in another embodiment of this application. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of this application clearer, the application will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0027] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects, not to describe a specific order or sequence.

[0028] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0029] In the medical field, to facilitate the tracking of diseased areas, it is often necessary to magnify and display multiple consecutive medical images of the same patient. However, the current method requires doctors to click multiple times to display multiple medical images. This method is cumbersome, time-consuming, affects the display efficiency of medical images, and makes it difficult to display multiple medical images continuously, which is not conducive to disease tracking.

[0030] To address the aforementioned technical problems, this application provides an image inspection method, an electronic device, and a storage medium, capable of displaying multiple images sequentially, thereby improving the convenience of image display operations and the efficiency of image display. The image inspection method provided in this application can be applied to one or more electronic devices.

[0031] The image can be a medical image, a daily life image, an engineering image, or any other image, and this application embodiment does not impose any restrictions on the specific type of image.

[0032] Electronic devices can be any electronic product that allows human-computer interaction, such as mobile phones, tablets, laptops, and computers.

[0033] Electronic devices may also include network devices and / or user devices. Network devices include, but are not limited to, a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of hosts or network servers. The network in which the electronic device operates includes, but is not limited to, the Internet, a wide area network (WAN), a metropolitan area network (MAN), a local area network (LAN), and a virtual private network (VPN). This application embodiment does not impose any restrictions on the specific type of electronic device.

[0034] like Figure 1 The diagram shown is a structural schematic of an electronic device provided in an embodiment of this application. Figure 1 The electronic device 10 may include a communication module 101, a memory 102, a processor 103, an input / output (I / O) interface 104, and a bus 105. The processor 103 is coupled to the communication module 101, the memory 102, and the input / output interface 104 via the bus 105.

[0035] Communication module 101 may include a wired communication module and / or a wireless communication module. The wired communication module may provide one or more wired communication solutions such as Universal Serial Bus (USB) and Controller Area Network (CAN). The wireless communication module may provide one or more wireless communication solutions such as Wireless Fidelity (Wi-Fi), Bluetooth (BT), mobile communication networks, Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR).

[0036] Memory 102 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM). The RAM can be directly read and written by the processor 103, and can be used to store executable programs (e.g., machine instructions) of other running programs, as well as user and application data. The RAM may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0037] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110. Non-volatile memory can include disk storage devices and flash memory.

[0038] Memory 102 is used to store one or more computer programs. The one or more computer programs are configured to be executed by processor 103. The one or more computer programs include multiple instructions that, when executed by processor 103, enable an image viewing method to be executed on electronic device 10.

[0039] In other embodiments, such as Figure 1 The electronic device 10 shown also includes an external memory interface for connecting to an external memory to expand the storage capacity of the electronic device 10.

[0040] Processor 103 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0041] The processor 103 provides computing and control capabilities. For example, the processor 103 is used to execute computer programs stored in the memory 102 to implement the image inspection method described above.

[0042] The input / output interface 104 is used to provide a channel for user input or output. For example, the input / output interface 104 can be used to connect various input / output devices, such as a mouse, keyboard, touch device, display screen, etc., so that users can enter information or visualize information.

[0043] Bus 105 is used at least to provide a channel for communication between communication modules 101, memory 102, processor 103, and input / output interface 104 in electronic device 10.

[0044] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 10. In other embodiments of this application, the electronic device 10 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0045] like Figure 2 The diagram shown is a flowchart of an image inspection method provided in one embodiment of this application. In one embodiment of this application, the application scenario is a hospital, and the image is a medical image. The following description will use a medical image as an example. Depending on different needs, the order of the steps in this flowchart can be adjusted according to actual requirements, and some steps can be omitted. The execution subject of the image inspection method is an electronic device, such as... Figure 1 The electronic device 10 shown.

[0046] S11, obtain medical images, user information of medical images, and image information.

[0047] In some embodiments of this application, medical images refer to images obtained by scanning or photographing (imaging) a patient using medical imaging equipment, and multiple medical images may be acquired. User information includes, but is not limited to, the patient's name, gender, age, social security card number, and the location of the ailment. Image information includes, but is not limited to, the imaging time of the medical image, the name of the imaging physician, and the name of the imaging hospital.

[0048] In some embodiments of this application, the electronic device can connect to medical imaging equipment, receive images transmitted from the medical imaging equipment as medical images, and use the information from the transmitted images as user information. The electronic device can connect to the medical imaging equipment via wireless fidelity (Wi-Fi), Bluetooth (BT), or Universal Serial Bus (USB). For example, the electronic device can receive one or more fundus images transmitted from a fundus camera as medical images. Figure 3 The image shown is a schematic diagram of a fundus image provided in an embodiment of this application. Figure 3 The fundus image shown includes the macula, optic disc, and retinal vessels.

[0049] In some embodiments of this application, medical imaging equipment includes, but is not limited to, magnetic resonance imaging (MR), fundus camera, optical coherence tomography (OCT), computed tomography (CT), and positron emission tomography (PET).

[0050] In other embodiments of this application, user information can also be obtained by recognizing patient identification images sent from medical imaging equipment via electronic devices. These identification images include, but are not limited to, images of social security cards or ID cards. The identification images can be obtained by photographing the patient's social security card or ID card using medical imaging equipment.

[0051] In some embodiments of this application, the electronic device can store the acquired medical images into an image database.

[0052] In some embodiments of this application, the electronic device provides a human-computer interaction interface (HCI) including an image list and an image viewing window. This interface is used to manage medical images. For example, the image list can display thumbnails of multiple medical images for easy browsing and selection by the user. The image list includes a preset control, which can be a drag-and-drop button. The user can drag the button directly in the image list or using a mouse or keyboard. The image viewing window displays the medical image selected by the user in the image list. The HCI can also receive various editing operations from the user on the displayed medical images, their image information, and user information through multiple menus. Examples include annotation, commenting, and editing operations.

[0053] For example, such as Figure 4 The image shown is a schematic diagram of a human-computer interaction interface provided in an embodiment of this application. Figure 4 The human-computer interaction interface includes an image list and an image viewer window; the image list includes preset controls. In addition... Figure 4 The human-computer interaction interface also includes a menu bar, which contains multiple menus to facilitate various editing operations by the user.

[0054] S12, in response to the user's call for medical images, arranges the called medical images in the image list according to the imaging time in the image information.

[0055] In some embodiments of this application, a call can be an operation in which a user selects medical images from an image database.

[0056] In some embodiments of this application, based on user information, the electronic device can group medical images of the same user into one category, and based on time information, the electronic device can display medical images of the same user in chronological order in an image list.

[0057] In related technologies, medical images are typically categorized based on the date they were received. This categorization method can lead to confusion among medical images of multiple patients, making it difficult to track and locate the symptoms of the same patient. In this embodiment, by acquiring user information for medical images, medical images corresponding to the same patient can be grouped into one category based on the user information. Medical images of the same user can then be displayed in the image list in chronological order, facilitating the tracking and location of the symptoms of the same patient.

[0058] S13, in response to the user's movement operation of a preset control in the image list, controls the moving preset control to intersect with at least one medical image.

[0059] In some embodiments of this application, the medical images corresponding to the image list can be processed before responding to the movement operation. The specific processing flow can be found below. Figure 6 and Figure 8 The description.

[0060] In some embodiments of this application, the electronic device can directly receive and respond to the user's movement operation on the preset control, control the movement of the preset control, and make the moving preset control intersect (overlap) with one or more medical images.

[0061] In other embodiments of this application, the electronic device can receive user movement operations on preset controls via a mouse and / or keyboard, controlling the movement of the preset controls so that the moving preset controls intersect with one or more medical images. Here, "moving preset controls" indicates that the preset controls are in a moving state, meaning that the user has not yet released the movement operation on the preset controls. For example, the user's finger is still dragging the preset controls on the human-computer interaction interface, or the user is still moving the preset controls via a mouse or keyboard.

[0062] In this embodiment, the medical images to be displayed can be flexibly selected through preset controls.

[0063] In some embodiments of this application, the image list can be scrolled up and down by moving a preset control. For example, in response to the user moving the preset control to the bottom of the window of the human-computer interaction interface, the electronic device controls the image list to scroll down, and in response to the user moving the preset control to the top of the window of the human-computer interaction interface, the electronic device controls the image list to scroll up.

[0064] S14, calculate the area ratio between the moving preset control and the intersecting medical image.

[0065] In some embodiments of this application, if a preset control intersects with multiple medical images, the electronic device can calculate the intersection area between the preset control and each intersecting medical image, and use the ratio between each intersection area and the image area of ​​the corresponding intersecting medical image as an area ratio.

[0066] For example, such as Figure 5 The diagram shown is a schematic representation of the intersection of a preset control and multiple medical images according to an embodiment of this application. Figure 5In the image, a preset control intersects with a second fundus image and a third medical image arranged from top to bottom. The electronic device can calculate the first intersection area between the preset control and the second medical image, and the second intersection area between the preset control and the third medical image. The ratio between the first intersection area and the image area of ​​the second medical image is calculated as the first area ratio, and the ratio between the second intersection area and the image area of ​​the third medical image is calculated as the second area ratio.

[0067] In this embodiment, when a preset control intersects with multiple medical images, the area ratio is calculated to provide a basis for more accurately determining which medical images need to be displayed.

[0068] S15, display the medical image corresponding to the area ratio greater than the preset threshold, the user information of the medical image, and the image information in the image inspection window.

[0069] In some embodiments of this application, the preset threshold can be set independently, and this application does not impose any restrictions on it. For example, the preset threshold can be 0.5.

[0070] In some embodiments of this application, by receiving user operations on a preset control, the moving preset control can simultaneously cover one or more medical images (intersecting medical images). By comparing the area ratio corresponding to each intersecting medical image with a preset threshold, the medical images that need to be displayed can be accurately determined.

[0071] For example, following the above embodiments, Figure 4 The image list includes thumbnails of four fundus images dated August 17, 2023, and three fundus images dated July 13, 2023. Because the preset controls completely intersect with the third fundus image from top to bottom, therefore... Figure 4 The third fundus image is displayed in the image viewer (see details). Figure 4 The image viewing window displays labels 3 / 4 at the bottom, along with user information and image information for the third fundus image. The user information for the third fundus image includes the patient's name (Wang XX), age (1990 / 01 / 21), and the affected area (left eye). The image information for the third fundus image includes the imaging time (2023-08-17), the imaging physician's name (XXX), and the imaging hospital's name (XX Hospital).

[0072] In other embodiments of this application, in addition to selecting medical images from the image list via preset controls, the electronic device can also directly receive user clicks on medical images in the image list, display the clicked medical image, the user information of the medical image, and the image information in the image viewing window, and move the preset controls so that the area ratio corresponding to the clicked medical image reaches 100%.

[0073] In this case, a 100% area ratio for the medical image displayed in the image viewer indicates that the preset control and the thumbnail of the displayed medical image in the image list completely overlap.

[0074] In this embodiment, since the clicked medical image is random, the electronic device moves the preset control so that the moved preset control completely overlaps with the thumbnail of the medical image displayed in the image viewer window in the image list, thereby ensuring that the medical image displayed in the image viewer window is the same as the medical image indicated by the preset control.

[0075] Through the above embodiments, this application provides an image list and an image viewing window. The image list includes preset controls that can be moved / draged, allowing users to flexibly select the images they need to view. Since all images selected in the image list are displayed in the image viewing window, when a user drags the preset controls in the image list, multiple images can be selected and displayed sequentially in the image viewing window without the need for time-consuming image switching, thus improving operational convenience and image display efficiency. Furthermore, in medical applications, arranging images sequentially in the image list according to imaging time facilitates tracking the changing trends of diseases. In addition, displaying medical images corresponding to area ratios greater than a preset threshold improves the accuracy of image display. Displaying user information and image information in the viewing window facilitates doctors' diagnosis by combining multiple pieces of information.

[0076] In some embodiments of this application, the medical images in the image list can be processed before responding to the user's movement operation on the preset control, such as... Figure 6 The diagram shown is a flowchart of an image processing method provided in an embodiment of this application, which specifically includes the following steps:

[0077] S131, determine whether to segment the medical image based on user information.

[0078] In some embodiments of this application, the electronic device determines whether to segment a medical image based on user information, including: the electronic device queries a preset storage space to determine whether information matching the user information exists in the preset storage space; if information matching the user information exists in the electronic device, the electronic device determines to segment the medical image; or, if information matching the user information does not exist in the electronic device, the electronic device determines not to segment the medical image.

[0079] The preset storage space can be set by the user, and this application does not impose any restrictions on it. For example, the preset storage space can be a local database storing user information in the electronic device, and the local database can be established in the storage device of the electronic device. The preset storage space can also be a cloud server accessed by the electronic device through a network. The information in the electronic device that matches the user information can be the same as the user information.

[0080] In some embodiments of this application, if it is determined that the medical image should be segmented, the electronic device performs step S132; or if it is determined that the medical image should not be segmented, the electronic device performs step S134.

[0081] In this embodiment, if the electronic device is receiving user information sent by the medical imaging device for the first time, it can be determined that there is no information matching the user information in the electronic device, and the medical image is not segmented. Alternatively, since the electronic device stores the user information received each time to a preset storage space, if the electronic device has previously received information that is the same as the user information, the electronic device can find the information matching the user information in the preset storage space.

[0082] S132, call the preset segmentation model to segment the medical image to obtain multiple segmentation regions, and determine the first feature region from the multiple segmentation regions.

[0083] In one embodiment of this application, the segmentation model can be obtained by pre-training a segmentation network using training data. The segmentation network can be configured independently, and this application does not impose any limitations on it. The training data can be various medical images. For example, the segmentation network can be an improved U-Net network, and the segmentation model obtained by training the improved U-Net network can be a U-Net model.

[0084] In some embodiments of this application, the segmentation model includes an input layer, an encoder, a decoder, and an output layer. The encoder includes multiple encoding layers, and the decoder includes a decoding layer corresponding to each encoding layer. There are four skip layers between the input and output layers. Except for the last encoding layer and the first decoding layer, each encoding layer and its corresponding decoding layer includes at least one skip layer. Each skip layer processes the feature map output by the corresponding encoding layer to obtain a processed feature map. Except for the first decoding layer, the input data for each decoding layer consists of the feature map output by the previous decoding layer and a fused feature map. The fused feature map is obtained by fusing (e.g., adding) each processed feature map and the feature map output by the corresponding encoding layer. The process of an electronic device using the segmentation model to process medical images can be referred to [reference needed]. Figure 7 Network structure diagram of the mid-segmentation model.

[0085] like Figure 7The diagram shown is a schematic representation of the network structure of a segmentation model provided in an embodiment of this application. Figure 7 In this segmentation model, the input layer, encoder, decoder, and output layer are sequentially connected. The input and output layers, as well as the encoder's encoding layer and the decoder's decoding layer, are connected via at least one skip layer. The input layer includes a convolutional layer (Conv), a ReLU activation function layer, and a batch normalization layer. Each encoding layer in the encoder includes a pooling layer, a convolutional layer, a ReLU activation function layer, and a batch normalization layer. Each skip layer includes a convolutional layer, an activation function layer, and a batch normalization layer. The first decoding layer in the decoder is an upsampling layer. Subsequent decoding layers include a concatenation layer, a convolutional layer, a ReLU activation function layer, multiple batch normalization layers, and an upsampling layer. The output layer includes a concatenation layer, multiple convolutional layers, multiple ReLU activation function layers, multiple batch normalization layers, and a Sigmoid activation function layer. Both the upsampling layer and the concatenation layer contain convolutional layers. Figure 7 The numbers in the text represent the number of convolutional kernels in the convolutional layer. Figure 7 The circular "+" symbol in the diagram represents the addition of multiple feature maps. Connector layers are used to fuse multiple feature maps.

[0086] In this embodiment, the first feature region is a region that reflects the condition of a lesion, and it is determined based on a medical image. For example, if the medical image is a fundus image, the first feature region could be the optic disc region and / or the macula region, etc. The optic disc region is the area occupied by the optic disc in the fundus image, and the macula region is the area occupied by the macula in the fundus image. By segmenting the first feature region from the medical image, a basis is provided for identifying the presence of a lesion and for locating and tracking the lesion. By using skip layers between segmentation models, multiple feature maps between the encoder and decoder can be fused, thereby improving the segmentation accuracy of the medical image.

[0087] S133, Adjust the medical image based on the first feature region and the second feature region corresponding to the first feature region in the reference image.

[0088] In some embodiments of this application, the reference image can be a first medical image of the patient received by the electronic device, or the reference image can be a pre-configured medical image, corresponding to the medical image. For example, if the medical image is a fundus image, then the reference image is also a fundus image. The electronic device can adjust the medical image based on the difference between a first feature region and a second feature region to obtain the medical image. The difference between the first feature region and the second feature region includes differences in region area and differences in region location, etc.

[0089] In some embodiments of this application, the second feature region corresponds to the first feature region. For example, if the first feature region is a disc region, then the second feature region is also a disc region. The generation process of the second feature region is basically the same as that of the first feature region, so it will not be described again in this application. For example, as Figure 8 The diagram shown is a schematic diagram of the first feature region and the second feature region provided in an embodiment of this application. Figure 8 (a) in the image represents a medical image. Figure 8 In the image (b), the reference image is shown. Both the medical image and the reference image are fundus images. The first feature region and the second feature region are both optic disc regions.

[0090] In this embodiment, by adjusting the medical image based on the second feature region of the reference image, it can be ensured that each adjusted medical image is in the same position as the lesion area in the reference image, thereby improving the speed and convenience of lesion localization, as well as the ease of observing the changing trend of the lesion site.

[0091] S134, the medical image is not segmented, and the medical image is used as the reference image.

[0092] In this embodiment, when there is no information matching the user information in the electronic device, it means that the electronic device has received the medical image corresponding to the user information for the first time. Therefore, the medical image received for the first time is stored in the image database as a reference image. This not only facilitates medical staff to examine the medical images, but also provides a basis for adjusting the medical images received later based on the reference image.

[0093] In some embodiments of this application, such as Figure 9 The diagram shown is a flowchart of a method for generating medical images according to an embodiment of this application, specifically including the following steps:

[0094] S1341, calculate the area ratio between the second feature region and the first feature region as the scaling ratio.

[0095] In some embodiments of this application, the number of all first pixels corresponding to the first feature region in the medical image can be calculated as the first region area of ​​the first feature region, and the number of all second pixels corresponding to the second feature region in the reference image can be calculated as the second region area of ​​the second feature region. The ratio between the second region area and the second region area is determined as the scaling ratio.

[0096] For example, if the area of ​​the second feature region is 10 square millimeters (mm) 2 The area of ​​the first feature region is 8 square millimeters (mm²). 2 The area ratio between the second feature region and the first feature region is 1.25 = 10 / 8.

[0097] S1342, scale the medical image according to the scaling ratio.

[0098] For example, following the above embodiment, if the scaling ratio is 1.25, the width of the medical image is 6 cm and the height is 8 cm, and the medical image with a width of 6 cm and a height of 8 cm is scaled according to the scaling ratio of 1.25, the width of the scaled medical image is 9 cm and the height is 12 cm.

[0099] In this embodiment, after scaling the medical image by a scaling ratio, the size of the scaled medical image is made to be the same as the size of the reference image.

[0100] S1343, determine the third feature region corresponding to the first feature region in the scaled medical image, and calculate the area intersection-union ratio between the second and third feature regions.

[0101] In some embodiments of this application, if the medical image is a fundus image and the first feature region is the optic disc region, then the scaled medical image is an adjusted fundus image, and the third feature region is the optic disc region of the adjusted fundus image. The area intersection-union ratio is the ratio between the intersection area between the second and third feature regions and the union area between the second and third feature regions. The intersection area refers to the area of ​​the overlapping portion between the second and third feature regions, and the union area refers to the area of ​​the region after the second and third feature regions are merged.

[0102] Specifically, the electronic device can acquire the second pixel position of each second pixel constituting the second feature region in the reference image, and acquire the third pixel position of each third pixel constituting the third feature region in the scaled medical image. The electronic device determines the intersection area by the number of identical second and third pixel positions. The electronic device calculates the difference between the number of all third pixel positions and the number of identical third and second pixel positions, and determines the union area by the sum of the number of all second pixel positions and the difference in number.

[0103] In this embodiment, since the area intersection-union ratio is calculated by the second pixel position of each second pixel point constituting the second feature region in the reference image and the third pixel position of each third pixel point constituting the third feature region in the scaled medical image, the area intersection-union ratio can reflect whether the position of the third feature region in the scaled medical image is the same as the position of the second feature region in the reference image.

[0104] S1344, transforms the scaled medical image based on area intersection-union comparison.

[0105] In some embodiments of this application, the transformations performed on the scaled medical images include translation and rotation.

[0106] In some embodiments of this application, the electronic device transforms the scaled medical image based on the area intersection-union ratio (IU) to obtain the medical image. This process includes: if the IU is less than or equal to a preset configuration value, transforming the scaled medical image until the IU between the third feature region and the second feature region corresponding to the transformed medical image is greater than the preset configuration value, at which point the transformation of the scaled medical image stops. The preset configuration value can be set arbitrarily, and this application does not impose any restrictions on it. For example, the preset configuration value can be 0.9.

[0107] For example, such as Figure 10 The figure shown is a schematic diagram of the generation of a medical image according to an embodiment of this application. In the figure, the third feature region in the transformed medical image almost completely overlaps with the second feature region in the reference image.

[0108] In this embodiment, since the area intersection-union ratio (OU) reflects whether the position of the third feature region in the scaled medical image is the same as the position of the second feature region in the reference image, transforming the scaled medical image using the OU ensures that the position of the third feature region in the transformed medical image is the same as the position of the second feature region in the reference image. Furthermore, since the third feature region reflects the lesion condition, transforming the scaled medical image ensures that the lesion region in the transformed medical image is in the same position as the lesion region in the reference image, thereby improving the speed and convenience of lesion localization and the ease of observing the changing trend of the lesion site.

[0109] In some embodiments of this application, such as Figure 11 The diagram shown is a flowchart of an image inspection method according to another embodiment of this application. The order of the steps in the flowchart can be adjusted according to different needs, and some steps can be omitted. The image inspection method is executed by an electronic device, for example... Figure 1 The electronic device 10 shown.

[0110] S21, Obtain medical images, user information of medical images, and image information.

[0111] In this embodiment, the method for acquiring medical images, user information, and image information can be referred to the description in step S11, and will not be repeated here.

[0112] S22, in response to the user's call for medical images, arranges the called medical images in the image list according to the imaging time in the image information.

[0113] In this embodiment, the process of arranging the medical images to be called in the image list can be referred to the description in step S12, and will not be repeated here.

[0114] S23, in response to the user's movement operation of a preset control in the image list, controls the moved preset control to intersect with at least one medical image.

[0115] In some embodiments of this application, a moving preset control indicates that the preset control has stopped moving, signifying that the user has released the movement operation on the preset control. For example, the user's finger has left the preset control, or the user has released the mouse or keyboard.

[0116] S24, calculate the area ratio between the moved preset control and the intersecting medical image.

[0117] In this embodiment, the method for calculating the area ratio can be referred to the description in step S14, and will not be repeated here.

[0118] S25, display the medical image corresponding to the area ratio greater than the preset threshold, the user information of the medical image, and the image information in the image viewing window.

[0119] In this embodiment, displaying the medical image corresponding to the area ratio greater than a preset threshold, the user information of the medical image, and the image information in the image viewing window can be referred to step S15, which will not be described again in this application.

[0120] S26, Move the preset control so that the area ratio of the medical image displayed in the image inspection window reaches 100%.

[0121] In some embodiments of this application, an area ratio of 100% for the medical image displayed in the image viewer represents that the preset control and the thumbnail of the medical image displayed in the image viewer completely overlap in the image list.

[0122] In this embodiment, since the position of the preset control after being moved is random, the electronic device can move the preset control so that the preset control and the thumbnail of the displayed medical image in the image list completely overlap, thereby making the medical image displayed in the image viewing window the same as the medical image indicated by the preset control.

[0123] In other embodiments of this application, in addition to selecting medical images from the image list via preset controls, the electronic device can also directly receive user clicks on medical images in the image list, display the clicked medical image, the user information of the medical image, and the image information in the image viewing window, and move the preset controls so that the area ratio corresponding to the clicked medical image reaches 100%.

[0124] In this embodiment, since the clicked medical image is random, the electronic device moves the preset control so that the moved preset control completely overlaps with the thumbnail of the medical image displayed in the image viewer window in the image list, thereby ensuring that the medical image displayed in the image viewer window is the same as the medical image indicated by the preset control.

[0125] Through the above embodiments, this application provides an image list and an image viewing window. The image list includes preset controls that can be moved / draged, allowing users to flexibly select the images they need to view. Since all images selected in the image list are displayed in the image viewing window, when a user drags the preset controls in the image list, multiple images can be selected and displayed sequentially in the image viewing window without the need for time-consuming image switching, thus improving operational convenience and image display efficiency. Furthermore, in medical applications, arranging images sequentially in the image list according to imaging time facilitates tracking the changing trends of diseases. In addition, displaying medical images corresponding to area ratios greater than a preset threshold improves the accuracy of image display. Displaying user information and image information in the viewing window facilitates doctors' diagnosis by combining multiple pieces of information.

[0126] This application also provides a computer-readable storage medium storing a computer program. The computer program includes program instructions, and the method implemented when the program instructions are executed can refer to the methods in the above embodiments of this application. The computer-readable storage medium can be the internal memory of the electronic device described in the above embodiments, such as the hard disk or memory of the electronic device. Alternatively, the computer-readable storage medium can be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., equipped on the electronic device.

[0127] In some embodiments, a computer-readable storage medium may include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function, etc.; and the stored data area may store data created based on the use of the electronic device, etc.

[0128] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. In the above embodiments, the descriptions of each embodiment have their own emphasis; parts not described in detail or in a certain embodiment can be referred to in the relevant descriptions of other embodiments.

[0129] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0130] In the embodiments provided in this application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings or direct couplings or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0131] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0132] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An image inspection method applied to an electronic device, wherein the human-computer interaction interface of the electronic device includes an image list and an image inspection window, characterized in that, The method includes: Acquire images; In response to a user's request for an image, the images to be requested are arranged in the image list according to their imaging time. In response to a user's movement operation on a preset control in the image list, the moving preset control is controlled to intersect with at least one image; Calculate the area ratio between the moving preset control and the intersecting image; The images corresponding to area ratios greater than a preset threshold are displayed in the image inspection window.

2. The image inspection method as described in claim 1, characterized in that, The method further includes: In response to a user's movement operation on a preset control in the image list, the moved preset control is controlled to intersect with at least one image; Calculate the area ratio between the moved preset control and the intersecting image; The image corresponding to the area ratio greater than the preset threshold is displayed in the image inspection window; Move the preset control so that the area ratio of the image displayed in the image inspection window reaches 100%.

3. The image inspection method as described in claim 1, characterized in that, The method further includes: In response to the user moving the preset control to the bottom of the window of the human-computer interaction interface, the image list is controlled to scroll down; In response to the user moving the preset control to the top of the window of the human-computer interaction interface, the image list is controlled to scroll upwards.

4. The image inspection method as described in claim 1, characterized in that, The method further includes: In response to a user's click on an image in the image list, the clicked image is displayed in the image view window, and the preset control is moved so that the area ratio of the clicked image reaches 100%.

5. The image inspection method as described in claim 1, characterized in that, Before responding to the movement operation, the method further includes: Obtain user information for the image; Determine whether to segment the image based on the user information; If it is determined that the image needs to be segmented, a preset segmentation model is called to segment the image to obtain multiple segmentation regions, and a first feature region is determined from the multiple segmentation regions. The image is adjusted based on the first feature region and the second feature region corresponding to the first feature region in the reference image.

6. The image inspection method as described in claim 5, characterized in that, The adjustment of the image based on the first feature region and the second feature region corresponding to the first feature region in the reference image includes: The area ratio between the second feature region and the first feature region is calculated as the scaling ratio, and the image is scaled according to the scaling ratio. Determine the third feature region corresponding to the first feature region in the scaled image, calculate the area intersection-union ratio between the second feature region and the third feature region, and transform the scaled image according to the area intersection-union ratio.

7. The image inspection method as described in claim 6, characterized in that, The transformation of the scaled image based on the area intersection-union ratio includes: If the area intersection-union ratio is less than or equal to a preset configuration value, the scaled image is transformed until the area intersection-union ratio between the third feature region and the second feature region of the transformed image is greater than the preset configuration value, at which point the transformation of the scaled image is stopped.

8. The image inspection method as described in claim 1, characterized in that, The calculation of the area ratio between the moving preset control and the intersecting image includes: Calculate the intersection area between the preset control and the intersecting image, and use the ratio between the intersection area and the image area of ​​the intersecting image as the area ratio.

9. An electronic device, characterized in that, The electronic device includes: Memory, storing at least one instruction; and The processor retrieves instructions stored in the memory to implement the image inspection method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-readable instructions that are executed by a processor in an electronic device to implement the image inspection method as described in any one of claims 1 to 8.

Images