Optical compensation method and system for orthopedic acquisition

Abstract

The invention discloses an optical compensation method and system for orthopedic acquisition, and the method comprises the steps: obtaining multi-angle first image information of an orthopedic instrument, and the first image information comprises a plurality of initial images; analyzing optical characteristic parameters in the initial image, and determining a compensation area and compensation parameters which need to be subjected to optical adjustment; on the basis of the compensation parameters, illumination data of illumination equipment are adjusted, multi-angle second image information of the orthopedic instrument is taken again, and the second image information comprises a plurality of final images; and inputting the final image into an optimization model, and obtaining optimized image data. According to the invention, the problem of poor image acquisition effect caused by the light source problem in the actual image acquisition process of the existing orthopedic instrument can be effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of orthopedic image acquisition, and in particular to an optical compensation method and system for orthopedic acquisition. Background Art

[0002] Orthopedic implants require high temperature and high pressure sterilization before surgery. Since orthopedic instruments and equipment are in an unpacked and uncoded (naked) state, it is impossible to accurately identify, accept, manage and trace the instruments, which brings greater management and medical risks.

[0003] In the actual recognition process of orthopedic instruments, image recognition technology is usually used to identify and confirm the equipment. However, due to the influence of the recognition environment, the orthopedic instruments need to be illuminated in the actual recognition process to ensure that the image information of the orthopedic instruments can be accurately obtained.

[0004] At present, whether a single light source or multiple light sources are used for fill lighting, reflections or shadows will occur, so that existing orthopedic instruments have poor effects in the image acquisition process and cannot truly reflect the specific conditions of the orthopedic instruments. Summary of the invention

[0005] In view of the above shortcomings of the prior art, the purpose of the present invention is to disclose an optical compensation method and system for orthopedic acquisition, so as to improve the problem of poor image acquisition effect caused by light source problems in the actual image acquisition process of current orthopedic instruments.

[0006] To achieve the above-mentioned purpose and other related purposes, the present invention discloses an optical compensation method for orthopedic acquisition, which comprises:

[0007] Step S10, acquiring first image information of the orthopedic instrument at multiple angles, wherein the first image information includes a plurality of initial images;

[0008] Step S20, analyzing the optical characteristic parameters in the initial image to determine the compensation area and compensation parameters that need to be optically adjusted;

[0009] Step S30, adjusting the illumination data of the illumination device based on the compensation parameter, and obtaining multi-angle second image information of the orthopedic instrument again, wherein the second image information includes a plurality of final images;

[0010] Step S40: input the final image into the optimization model and obtain optimized image data.

[0011] In one embodiment of the present invention, the initial image includes at least one main image and a plurality of side images, wherein the main image is located directly above the orthopedic instrument, and the plurality of side images are located on both sides of the main image;

[0012] Wherein, the shooting angles of the main image and the side image are set at an included angle.

[0013] In one solution of the present invention, step S20 includes:

[0014] The initial image is divided into multiple segmented regions, and the color feature mean M of each segmented region is calculated. i , i is a positive integer from 1 to n;

[0015] based on Get the color feature mean M of the entire initial image;

[0016] Based on ΔM=M i -M, to obtain the color feature mean difference ΔM between different segmented regions and the initial image;

[0017] When ΔM≤0, obtaining the position coordinates corresponding to the separation area and marking it as a compensation area;

[0018] Based on a preset color feature mean difference-adjustment parameter comparison table, the compensation parameters required to be adjusted for the current initial image are obtained.

[0019] In one embodiment of the present invention, the color feature mean Among them, L * i 、a * i 、b * i They respectively represent the hue, saturation and brightness parameters of different segmented areas, and k1, k2 and k3 are the correction coefficients of hue, saturation and brightness respectively.

[0020] In one embodiment of the present invention, the process of segmenting the initial image into a plurality of segmented regions includes:

[0021] Converting the initial image from the initial color space to the HSV color space, and determining at least one segmentation parameter based on the characteristics of the HSV color space, including:

[0022] Analyze the color distribution characteristics of the sample image in the HSV color space;

[0023] Determining the segmentation parameter according to the color distribution characteristics;

[0024] Performing segmentation processing on the converted image according to the segmentation parameters to obtain at least one segmentation region;

[0025] The image data of the segmented area is output.

[0026] In one embodiment of the present invention, the segmentation parameter includes at least one of a hue threshold range, a saturation threshold range, and a brightness threshold range.

[0027] In one embodiment of the present invention, the step of segmenting the converted image according to the segmentation parameters to obtain at least one segmented area includes:

[0028] Performing image segmentation based on at least one of a threshold segmentation method, a region growing method or a clustering algorithm;

[0029] Wherein, when a clustering algorithm is used for segmentation processing, the clustering algorithm is a K-Means clustering algorithm or a fuzzy C-means clustering algorithm.

[0030] In one solution of the present invention, the step S40 includes:

[0031] Adjusting the brightness distribution of the final image to increase the contrast of the image;

[0032] Applying filters to remove noise from the image; and

[0033] The Laplacian operator is used to enhance the edge and details of the image, and the final image is sharpened.

[0034] The present invention also discloses an optical compensation system for orthopedic acquisition applied to any of the optical compensation methods for orthopedic acquisition as described above, comprising:

[0035] An image initial acquisition module, which is used to acquire multi-angle first image information of the orthopedic instrument, wherein the first image information includes a plurality of initial images;

[0036] An image analysis module, which is used to analyze the optical characteristic parameters in the initial image and determine the compensation area and compensation parameters that need to be optically adjusted;

[0037] an image final acquisition module, which is used to adjust the illumination data of the illumination device based on the compensation parameter, and obtain the second image information of the orthopedic instrument at multiple angles again, wherein the second image information includes a plurality of final images; and

[0038] The image optimization module is used to input the final image into the optimization model and obtain optimized image data.

[0039] In summary, the present invention discloses an optical compensation method and system for orthopedic acquisition. The optical compensation method for orthopedic acquisition can be used in the image acquisition process of orthopedic instruments to adjust the illumination information in the actual image acquisition process based on the initial image, and generate a corresponding illumination compensation strategy, so as to improve the quality of the final image taken again. At the same time, by optimizing the final image, the image quality of the orthopedic instrument taken can be further improved, and the actual situation of the orthopedic instrument can be truly reflected. Through two image acquisitions, the processing requirements for the final image processing can be reduced, and the actual processing speed and effect can be improved. It can avoid the situation that the image of the orthopedic instrument is prone to being too dark or over-exposure during the actual acquisition process. It can effectively improve the problem of poor image acquisition effect caused by light source problems in the actual image acquisition process of current orthopedic instruments. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0041] Figure 1 It is a schematic diagram of a flow chart of an optical compensation method for orthopedic acquisition in one embodiment of the present invention;

[0042] Figure 2 FIG. 4 is a schematic diagram of modules of an optical compensation system for orthopedic acquisition in one embodiment of the present invention.

[0043] Component number description

[0044] 100. Optical compensation system for orthopedic acquisition; 10. Image initial acquisition module; 20. Image analysis module; 30. Image final acquisition module; 40. Image optimization module.

[0045] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0047] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.

[0048] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of the features.

[0049] See also Figure 1 to Figure 2 It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the conditions under which the present invention can be implemented. Therefore, they have no substantive technical significance. Any modification of the structure, change in the proportion relationship or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the effects and purposes that can be achieved by the present invention.

[0050] See also Figure 1 The present invention provides an optical compensation method for orthopedic acquisition, which is applied to an orthopedic acquisition device. The device includes a material placement platform, an image acquisition unit, a lighting device and at least one interaction unit. The interaction unit includes at least one interaction interface, which allows human-computer interaction to be performed on the orthopedic acquisition device through the interaction unit. The interaction unit can be any electronic product that performs human-computer interaction with a user, such as a personal computer, a tablet computer, a smart phone, a personal digital assistant (PDA), an interactive network television (IPTV), etc.

[0051] The electronic device may also include a network device and / or a user device, wherein the network device includes, but is not limited to, a single network server, a server group consisting of multiple network servers, or a cloud consisting of a large number of hosts or network servers based on cloud computing.

[0052] The network where the electronic device is located includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (VPN), etc.

[0053] Specifically, the orthopedic instrument used for image acquisition is arranged on the material placement platform, and the lighting device can be used for the image acquisition unit to perform fill light processing on the orthopedic instrument when acquiring the image of the orthopedic instrument, so as to improve the image quality of the orthopedic instrument acquired by the image acquisition device. It should be noted that the image acquisition unit includes multiple high-definition lenses, and at least one of them is located directly above the material placement platform. At the same time, the lighting device is located above the material placement platform, and the lighting device is a structure with multiple light sources and adjustable angles. So as to adjust the lighting angle or light source intensity of the lighting device according to the image taken by the image acquisition unit.

[0054] See also Figure 1 , further explaining the optical compensation method for orthopedic acquisition disclosed in the present invention.

[0055] Specifically, the optical compensation method for orthopedic acquisition includes at least the following steps.

[0056] First, step S10 is performed to obtain multi-angle first image information of the orthopedic instrument, wherein the first image information includes multiple initial images. When the orthopedic instrument is placed on the material placement platform, the orthopedic instrument is photographed by the image acquisition unit to obtain the first image information. It can be understood that since the image acquisition unit includes multiple lenses, it is possible to photograph the orthopedic instrument at different angles.

[0057] For example, in one embodiment, the image acquisition unit includes three groups of cameras, one group is a main camera, and the other two groups are auxiliary cameras. The main camera is located directly above the orthopedic instrument and is used to obtain the main camera image. The two groups of auxiliary cameras are located on both sides of the main camera and are used to obtain side images. It should be noted that the main camera and the auxiliary camera are set at an angle to facilitate the acquisition of image information of the medical device at different angles.

[0058] Therefore, in order to improve the accuracy of orthopedic instrument identification, the image acquisition unit first acquires multi-angle first image information of the orthopedic instrument. It can be understood that the first image information includes initial images taken by multiple cameras. Secondly, based on the shooting conditions of the initial image, the lighting device can be adjusted to achieve a certain fill light effect.

[0059] Next, step S20 is performed to analyze the optical characteristic parameters in the initial image and determine the compensation area and compensation parameters that need to be optically adjusted.

[0060] Specifically, after the initial image is acquired, the initial image is analyzed to obtain the position where fill light is required, and a corresponding fill light strategy is generated.

[0061] Further, in some embodiments, step S20 may include the following steps.

[0062] Step S210, the initial image is divided into a plurality of segmented regions, and the color feature mean M of each segmented region is calculated. i , i is a positive integer from 1 to n. By dividing the initial image into regions, it is convenient to further analyze the initial image and obtain the actual region where fill light is required.

[0063] Among them, for the color feature mean M of different segmented areas i , the color feature mean Among them, L * i 、a * i 、b * i They respectively represent the hue, saturation and brightness parameters of different segmented areas, and k1, k2 and k3 are the correction coefficients of hue, saturation and brightness respectively.

[0064] By performing vector processing on the hue, saturation and brightness parameters of different segmented areas, it is possible to more accurately determine the segmented areas that need to be adjusted.

[0065] Step S220, based on Get the color feature mean M of the entire initial image. By obtaining the color feature mean of the entire initial image, it is convenient to compare with different segmented areas.

[0066] Step S230, based on ΔM=M i -M, to obtain the color feature mean difference ΔM between the different segmented regions and the initial image. The color status of the different segmented regions can be determined according to the color feature mean difference ΔM.

[0067] For example, in step S240, when ΔM≤0, the position coordinates corresponding to the separated area are obtained and marked as the compensation area. When ΔM≤0, the position of the initial photo that needs to be adjusted and light-filled can be accurately obtained, and the light-filling strategy of the lighting device can be generated.

[0068] Finally, step S250 is performed to obtain the compensation parameters required for adjusting the current initial image based on the preset color feature mean difference-adjustment parameter comparison table. The color feature mean difference-adjustment parameter comparison table can be manually set based on daily adjustment habits, or can be trained using a neural network model based on daily adjustment parameters.

[0069] It should be noted that in some embodiments, the compensation parameters are the adjustment angle and illumination intensity of the illumination device. The illumination angle and illumination intensity of the illumination device are adjusted to improve the image quality of the orthopedic instrument during image acquisition and avoid shadow areas.

[0070] In some embodiments, in the process of segmenting the initial image into a plurality of segmented regions, the initial image may be converted from an initial color space to an HSV color space, and at least one segmentation parameter may be determined based on the characteristics of the HSV color space. It should be noted that the segmentation parameter includes at least one of a hue threshold range, a saturation threshold range, and a brightness threshold range.

[0071] Specifically, the color distribution characteristics of the sample image in the HSV color space are analyzed. The segmentation parameters are determined according to the color distribution characteristics, and the converted image is segmented according to the segmentation parameters to obtain at least one segmentation area. In the actual segmentation process, at least one of the threshold segmentation method, the region growing method or the clustering algorithm can be used for image segmentation. Among them, when the clustering algorithm is used for segmentation, the clustering algorithm is a K-Means clustering algorithm or a fuzzy C-means clustering algorithm. However, it is not limited to this, and the corresponding algorithm type can be selected according to actual needs.

[0072] Finally, the image data of the segmented area is output.

[0073] It should be noted that after the adjustment data is generated based on the initial image, the compensation area and its corresponding compensation parameters are acquired based on the initial image. The image acquisition process is performed again on the orthopedic instrument to obtain optimized image information.

[0074] Therefore, it is allowed to execute step S30, adjust the illumination data of the illumination device based on the compensation parameter, and obtain the second image information of the orthopedic instrument at multiple angles again, wherein the second image information includes multiple final images.

[0075] It is understandable that the second image information is taken at the same angle as the first image information, and the difference lies in the lighting conditions of the orthopedic instrument by the lighting device. Therefore, compared with the initial image, the final image is the image information of the orthopedic instrument taken after lighting optimization compensation.

[0076] Finally, step S40 is performed to input the final image into the optimization model and obtain optimized image data. The brightness distribution of the final image is adjusted to increase the contrast of the image. In order to further improve the image quality, the final image may be optimized to further improve the actual image acquisition quality.

[0077] Specifically, an optimization model may be used to remove noise from the final image using a filter; and a Laplacian operator may be used to enhance the edge and details of the image, thereby performing a sharpening process on the final image.

[0078] By optimizing the final image, the algorithm process in the image processing can be effectively reduced, the optimization efficiency can be improved, and the quality of the final image can be ensured.

[0079] It should be noted that the step division of the above methods is only for clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps as long as they contain the same logical relationship.

[0080] See also Figure 2 The present invention also provides an optical compensation system 100 for orthopedic acquisition applied to the optical compensation method for orthopedic acquisition in the above-mentioned embodiment.

[0081] The optical compensation system 100 for orthopedic acquisition includes an initial image acquisition module 10, an image analysis module 20, a final image acquisition module 30 and an image optimization module 40. The module referred to in the present invention refers to a series of computer program segments that can be executed by a processor and can complete fixed functions, which are stored in a memory.

[0082] Specifically, the image initial acquisition module 10 is used to acquire the first image information of the orthopedic instrument at multiple angles, and the first image information includes multiple initial images. The image analysis module 20 is used to analyze the optical characteristic parameters in the initial image and determine the compensation area and compensation parameters that need to be optically adjusted. The image final acquisition module 30 is used to adjust the illumination data of the illumination device based on the compensation parameters, and to obtain the second image information of the orthopedic instrument at multiple angles again, and the second image information includes multiple final images. And the image optimization module 40 is used to input the final image into the optimization model and obtain the optimized image data.

[0083] In summary, the present invention discloses an optical compensation method and system for orthopedic acquisition. The optical compensation method for orthopedic acquisition can be used in the image acquisition process of orthopedic instruments to adjust the illumination information in the actual image acquisition process based on the initial image, and generate a corresponding illumination compensation strategy, so as to improve the quality of the final image taken again. At the same time, by optimizing the final image, the image quality of the orthopedic instrument taken can be further improved, and the actual situation of the orthopedic instrument can be truly reflected. Through two image acquisitions, the processing requirements for the final image processing can also be reduced, and the actual processing speed and effect can be improved. It is avoided that the image of the orthopedic instrument is prone to being too dark or over-exposure during the actual acquisition process.

[0084] Therefore, the problem of poor image acquisition effect caused by light source problems in the actual image acquisition process of current orthopedic instruments can be effectively improved.

[0085] Therefore, the present invention effectively overcomes some practical problems in the prior art and thus has high utilization value and use significance.

[0086] The above description is only an exemplary embodiment of the present invention, and does not limit the patent scope of the present invention. All equivalent structural changes made by using the contents of the present invention specification and drawings under the technical concept of the present invention, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present invention.

[0087] In addition, if "and / or" or "and / or" appears in the full text, its meaning includes three parallel solutions. Taking "A and / or B" as an example, it includes solution A, solution B, or solutions that satisfy both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such combination of technical solutions does not exist and is not within the protection scope required by the present invention.

Claims

1. An optical compensation method for orthopedic acquisition, characterized in that: include: Step S10, acquiring first image information of the orthopedic instrument at multiple angles, wherein the first image information includes a plurality of initial images; Step S20, analyzing the optical characteristic parameters in the initial image to determine the compensation area and compensation parameters that need to be optically adjusted; Step S30, adjusting the illumination data of the illumination device based on the compensation parameter, and obtaining multi-angle second image information of the orthopedic instrument again, wherein the second image information includes a plurality of final images; Step S40: input the final image into the optimization model and obtain optimized image data.

2. The optical compensation method for orthopedic acquisition according to claim 1, characterized in that: The initial image at least includes a set of main images and a plurality of side images, wherein the main images are located directly above the orthopedic instrument, and the plurality of side images are located on both sides of the main images; Wherein, the shooting angles of the main image and the side image are set at an included angle.

3. The optical compensation method for orthopedic acquisition according to claim 1, characterized in that: In the step S20, it includes: The initial image is divided into multiple segmented regions, and the color feature mean M of each segmented region is calculated. i , i is a positive integer from 1 to n; based on Get the color feature mean M of the entire initial image; Based on ΔM=M i -M, to obtain the color feature mean difference ΔM between different segmented regions and the initial image; When ΔM≤0, obtaining the position coordinates corresponding to the separation area and marking it as a compensation area; Based on a preset color feature mean difference-adjustment parameter comparison table, the compensation parameters required to be adjusted for the current initial image are obtained.

4. The optical compensation method for orthopedic acquisition according to claim 3, characterized in that: The color feature mean in, They respectively represent the hue, saturation and brightness parameters of different segmented areas, and k1, k2 and k3 are the correction coefficients of hue, saturation and brightness respectively.

5. The optical compensation method for orthopedic acquisition according to claim 3, characterized in that: The process of segmenting the initial image into a plurality of segmented regions includes: Converting the initial image from the initial color space to the HSV color space, and determining at least one segmentation parameter based on the characteristics of the HSV color space, including: Analyze the color distribution characteristics of the sample image in the HSV color space; Determining the segmentation parameter according to the color distribution characteristics; Performing segmentation processing on the converted image according to the segmentation parameters to obtain at least one segmentation region; The image data of the segmented area is output.

6. The optical compensation method for orthopedic acquisition according to claim 5, characterized in that: The segmentation parameter includes at least one of a hue threshold range, a saturation threshold range, and a brightness threshold range.

7. The optical compensation method for orthopedic acquisition according to claim 5, characterized in that: The step of segmenting the converted image according to the segmentation parameters to obtain at least one segmented area includes: Performing image segmentation based on at least one of a threshold segmentation method, a region growing method or a clustering algorithm; Wherein, when a clustering algorithm is used for segmentation processing, the clustering algorithm is a K-Means clustering algorithm or a fuzzy C-means clustering algorithm.

8. The optical compensation method for orthopedic acquisition according to claim 1, characterized in that: In the step S40, it includes: Adjusting the brightness distribution of the final image to increase the contrast of the image; Applying filters to remove noise from the image; and The Laplacian operator is used to enhance the edge and details of the image, and the final image is sharpened.

9. An optical compensation system for orthopedic acquisition applied to the optical compensation method for orthopedic acquisition as claimed in any one of claims 1 to 8, characterized in that: include: An image initial acquisition module, which is used to acquire multi-angle first image information of the orthopedic instrument, wherein the first image information includes a plurality of initial images; An image analysis module, which is used to analyze the optical characteristic parameters in the initial image and determine the compensation area and compensation parameters that need to be optically adjusted; an image final acquisition module, which is used to adjust the illumination data of the illumination device based on the compensation parameter, and obtain the second image information of the orthopedic instrument at multiple angles again, wherein the second image information includes a plurality of final images; and The image optimization module is used to input the final image into the optimization model and obtain optimized image data.

Images