Data fusion processing method and device

Abstract

The present invention provides a data fusion processing method and device, which performs real-time registration processing on dynamic images and static images based on positioning units in a data fusion model to obtain registered dynamic images and registered static images, obtains targets in the registered dynamic images according to a fusion display strategy selected by a management end, determines multiple display areas according to the targets, the fusion display strategy includes a step display strategy and a specific display strategy, determines the transparency of each display area based on the display unit in the data fusion model, performs differentiated display adjustment on each display area based on the transparency to obtain a dynamically adjusted image, performs fusion processing on the dynamically adjusted image and the registered static image according to the fusion unit in the data fusion model, obtains a fused display image and sends it to the management end.

Description

Technical Field

[0001] The present invention relates to data fusion processing technology, and in particular to a data fusion processing method. Background Art

[0002] With the continuous development of medical technology, various high-precision imaging devices are widely used in clinical practice. These devices can produce a large number of detailed medical images, providing important support for medical diagnosis.

[0003] Currently, in order to fully understand the patient's condition, multiple types of medical images are usually taken for the patient. However, since different types of medical images often need to be viewed and analyzed independently, the viewing efficiency of medical images is low.

[0004] Therefore, how to improve the viewing efficiency of various types of medical images has become an urgent problem that needs to be solved today. Summary of the invention

[0005] The present invention provides a data fusion processing method and device, which can improve the viewing efficiency of various types of medical images.

[0006] A first aspect of the present invention provides a data fusion processing method, comprising:

[0007] Based on the positioning unit in the data fusion model, the dynamic image and the static image are registered in real time to obtain the registered dynamic image and the registered static image;

[0008] Acquire a target object in the registered dynamic image according to a fusion display strategy selected by the management end, and determine a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy;

[0009] Determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differential display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image;

[0010] The dynamically adjusted image and the registered static image are fused according to the fusion unit in the data fusion model to obtain a fused display image which is sent to the management terminal.

[0011] Optionally, in a possible implementation manner of the first aspect, a target object in the registered dynamic image is obtained according to a fusion display strategy selected by a management end, and a plurality of display areas are determined according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy, including:

[0012] Acquire the fusion display strategy selected by the management end, and acquire the target contour corresponding to the target object based on the fusion display strategy;

[0013] Determine the area where the target outline is located as the target display area according to the step display strategy, and generate multiple background display areas based on the target outline, wherein the display area includes a target display area and a background display area; or

[0014] Based on the specific display strategy, each of the target contours is displayed and grouped to obtain a plurality of collaborative display groups, a segmentation line corresponding to the collaborative display group is determined, and the registered dynamic image is divided according to the segmentation line to obtain a target display area and a background display area.

[0015] Optionally, in a possible implementation manner of the first aspect, determining, according to the step display strategy, the area where the target outline is located as the target display area, generating multiple background display areas based on the target outline, the display areas including the target display area and the background display area, including:

[0016] Acquire the area of ​​the target display area according to the step display strategy, and obtain the range adjustment coefficient according to the ratio of the area of ​​the target display area to the reference area;

[0017] Obtaining a background range distance according to the product of the range adjustment coefficient and the reference range distance, determining a preset number of divisions of the background range distance, and obtaining a unit distance according to a ratio of the background range distance to the number of divisions;

[0018] Extending each contour point in the target contour outward by the unit distance in turn to obtain an extension point, and generating a plurality of extension contours according to the extension points;

[0019] The area adjacent to the outward-expanding contour and between the adjacent target contour and the outward-expanding contour is determined as the background display area.

[0020] Optionally, in a possible implementation manner of the first aspect, displaying and grouping the target contours based on the specific display strategy to obtain a plurality of collaborative display groups, determining a segmentation line corresponding to the collaborative display group, and dividing the registered dynamic image according to the segmentation line to obtain a target display area and a background display area, including:

[0021] Determine the contour distance between the target contours according to the center points of the target contours, and obtain the target contours whose contour distance is smaller than the reference contour distance as the same collaborative display group;

[0022] Obtaining a comprehensive center point corresponding to each target outline in the collaborative display group, and generating a center baseline based on the comprehensive center point and an initial direction corresponding to an initial angle;

[0023] The central baseline is rotated according to the rotation direction, and a dividing line corresponding to the collaborative display group at each rotation angle is generated based on the central baseline, and an optimal angle is determined according to the pending area divided by the dividing line, wherein the rotation angle includes an initial angle;

[0024] The registered dynamic image is divided based on the dividing lines at the optimal angle, and the area between the dividing lines corresponding to each of the collaborative display groups is determined as the target display area, and the area in the registered dynamic image except the target display area is the background display area.

[0025] Optionally, in a possible implementation manner of the first aspect, determining the rotation angle by the following steps includes:

[0026] Determine the initial angle as the first rotation angle, and determine the next rotation angle based on the rotation angle and the rotation direction;

[0027] Obtaining the intersection contour length corresponding to the center baseline at the next rotation angle, and obtaining an angle adjustment coefficient according to the ratio of the reference contour length to the intersection contour length;

[0028] Obtaining an adjusted rotation angle according to the product of the angle adjustment coefficient and the preset rotation angle, and taking the rotation angle as a reference, continuing to determine the next rotation angle according to the rotation direction and the adjusted rotation angle;

[0029] Repeat the above steps of determining the rotation angle according to the adjusted rotation angle until the sum of all the rotation angles is greater than or equal to the preset full angle, and then stop determining the rotation angle.

[0030] Optionally, in a possible implementation of the first aspect, the central baseline is rotated according to a rotation direction, and a dividing line corresponding to the collaborative display group at each rotation angle is generated based on the central baseline, and an optimal angle is determined according to a pending area divided by the dividing line, including:

[0031] Acquire the direction of the central baseline corresponding to each of the rotation angles as a first direction, and determine a second direction perpendicular to the first direction;

[0032] Acquire two extreme value coordinate values ​​corresponding to the collaborative display group in the second direction, and generate a segmentation line parallel to the first direction according to each of the extreme value coordinate values;

[0033] The area between the parallel segmentation lines is determined as a pending area, the area except the target contour in the pending area is obtained as an interference area, and the rotation angle corresponding to the minimum interference area is determined as an optimal angle.

[0034] Optionally, in a possible implementation manner of the first aspect, determining the transparency of each display area based on a display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image includes:

[0035] Determine, according to the display unit, that a preset transparency value is the transparency of the remaining areas except the display area, that a preset opacity value is the transparency of the target display area, and that the center point of the target display area is determined as the positioning point;

[0036] Obtaining the sub-interval distances between each contour point and the positioning point in the outward-expanded contour corresponding to the outer side of each background display area, and obtaining the interval distance between each background display area and the target display area according to the average value of the sub-interval distances;

[0037] Obtaining a transparency adjustment coefficient based on a ratio of the spacing distance to a reference distance, and obtaining the transparency of each of the background display areas according to a product of the transparency adjustment coefficient and a reference transparency value;

[0038] The transparency of each display area is adjusted according to the transparency corresponding to the display area to obtain a dynamically adjusted image.

[0039] Optionally, in a possible implementation manner of the first aspect, determining the transparency of each display area based on a display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image includes:

[0040] Determining a preset opacity value as the transparency of the target display area according to the display unit, acquiring the background display area adjacent to the target display area as a first background area;

[0041] Acquire the background display area adjacent to the first background area as the second background area, and determine the background display area adjacent to the second background area as the next first background area;

[0042] Repeat the above steps of alternately determining the first background area and the second background area until all the background display areas are determined;

[0043] The opaque value is determined to be the transparency corresponding to the first background area, the preset transparent value is determined to be the transparency of the second background area, and the transparency of each display area is adjusted according to the transparency corresponding to each display area to obtain a dynamically adjusted image.

[0044] Optionally, in a possible implementation manner of the first aspect, determining the transparency of each display area based on a display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image includes:

[0045] Determine, according to the display unit, a preset opaque value as the transparency of the target display area, and determine a preset transparent value as the transparency of the background display area;

[0046] The transparency of each display area is adjusted based on the transparency corresponding to each display area to obtain a dynamically adjusted image.

[0047] A second aspect of the present invention provides a data fusion processing device, comprising:

[0048] A registration module is used to perform real-time registration processing on the dynamic image and the static image based on the positioning unit in the data fusion model to obtain a registered dynamic image and a registered static image;

[0049] An acquisition module, used for acquiring a target object in the registered dynamic image according to a fusion display strategy selected by a management terminal, and determining a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy;

[0050] An adjustment module, used for determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differential display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image;

[0051] A fusion module is used to fuse the dynamically adjusted image and the registered static image according to the fusion unit in the data fusion model to obtain a fused display image and send it to the management end.

[0052] The beneficial effects of the present invention are as follows:

[0053] 1. The present invention can register and fuse dynamic images with static images in accordance with the needs of management personnel, and can combine two different image information to complement each other, so as to provide more comprehensive and accurate image information for medical staff. The present invention can finely adjust the transparency of dynamic images in accordance with the needs of management personnel, and can highlight the target image to be observed during the display process, and automatically make the non-target area transparent, so as to ensure that the dynamic image and the static image can be better integrated during the fusion process.

[0054] 2. The present invention provides two different fusion display strategies when fusion displaying the registered dynamic images. The manager can select the corresponding fusion display strategy according to the needs, adopt different transparency adjustment methods according to the corresponding fusion display strategy, and display the adjusted fusion image. When the manager selects the step display strategy, the present invention can perform a gradual blurred display of the background display area around the target object, or perform an intermittent transparent display of the background display area, thereby reducing the visual interference when observing the target object. When the manager selects a specific display strategy, the present invention can group the target contours corresponding to multiple targets that are close to each other in the registered dynamic image, divide the target contours that are close to each other into the same collaborative display group, and perform collaborative display of multiple targets corresponding to the same collaborative display group, so as to obtain more comprehensive image data.

[0055] 3. When the present invention divides the registered dynamic image into regions under a specific display strategy, the central baseline corresponding to the collaborative display group can be generated according to the comprehensive center point, and the corresponding segmentation line can be generated according to the central baseline. The central baseline can be rotated according to the rotation direction to generate multiple central baselines at different rotation angles, and then the segmentation lines at different rotation angles can be generated. The registered dynamic image can be divided into a pending area and an interference area by the segmentation lines. By comparing the size of the interference area at different rotation angles, a rotation angle that minimizes the interference area can be found. The registered dynamic image is divided into regions by the segmentation lines corresponding to the rotation angle, which can reduce the interference part during image display and improve the accuracy of image display. The present invention can also adaptively adjust the rotation angle, thereby improving efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 It is a flowchart of a data fusion processing method provided by an embodiment of the present invention;

[0057] Figure 2 is a schematic diagram of a display area corresponding to a step display strategy provided by an embodiment of the present invention;

[0058] Figure 3 is a schematic diagram of a display area corresponding to a specific display strategy provided by an embodiment of the present invention;

[0059] Figure 4 is a schematic diagram of a dynamically adjusted image corresponding to a step display strategy provided by an embodiment of the present invention;

[0060] Figure 5 is a schematic diagram of a dynamically adjusted image corresponding to another step display strategy provided by an embodiment of the present invention;

[0061] Figure 6It is a structural schematic diagram of a data fusion processing device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0062] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0063] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0064] See also Figure 1 , is a schematic diagram of a data fusion processing method provided by an embodiment of the present invention, Figure 2 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows:

[0065] S1, based on the positioning unit in the data fusion model, the dynamic image and the static image are registered in real time to obtain a registered dynamic image and a registered static image.

[0066] In practical applications, dynamic images and static images are medical images from different imaging devices. For example, the dynamic image may be a B-ultrasound image acquired in real time, and the static image may be a CT image. The dynamic B-ultrasound image can display the internal structure of the human body in real time, but its display capability for subtle tissue structures is limited. The static CT image can provide high-resolution internal structure images, clearly displaying subtle tissue structures, and some image data can be displayed by B-ultrasound images but cannot be displayed by CT images. Therefore, this solution can align and fuse the dynamic B-ultrasound image with the static CT image in accordance with the needs of the management personnel, thereby combining the two different image information to complement each other and provide more comprehensive and accurate information for medical staff.

[0067] Specifically, in the fusion process, the B-ultrasound image and the CT image must first be registered, and then the two types of image information must be fused. This solution can combine the positioning unit in the data fusion model to perform real-time registration processing on dynamic images and static images from different times and different imaging devices. For example, their corresponding spatial positions can be aligned so that the images obtained correspond to each other for subsequent fusion processing.

[0068] When performing real-time registration processing, the dynamic B-ultrasound image and the static CT image can be registered in real time through a multimodal registration method to ensure that the B-ultrasound image and the CT image are corresponding, and a registered dynamic image and a registered static image can be obtained.

[0069] The data fusion model refers to a model for fusing dynamic images and static images, the positioning unit refers to a unit for registering dynamic images and static images, the dynamic image may be an ultrasound image, the static image may be a CT image, the registered dynamic image refers to a dynamic ultrasound image after registration, and the registered static image refers to a static CT image after registration.

[0070] S2, acquiring a target object in the registered dynamic image according to a fusion display strategy selected by the management end, and determining a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy.

[0071] In the actual fusion process, since the display data of the B-ultrasound image is different from that of the CT image, if the B-ultrasound image is fully displayed, the B-ultrasound image may block the CT image during fusion, resulting in excessive interference when viewing the fused image data. In order to obtain a more comprehensive fused image, this solution can adjust the transparency of the B-ultrasound image based on the needs of the management personnel to ensure that the B-ultrasound image and the CT image can be better fused during the fusion process.

[0072] Specifically, this solution has two different display adjustment methods when making display adjustments. Each display adjustment method has a corresponding fusion display strategy. Managers can select the corresponding fusion display strategy based on their needs. After determining the fusion display strategy, they can identify the target objects in the B-ultrasound image, divide the B-ultrasound image into multiple display areas according to the position and size of these target objects, and use different display adjustment methods for multiple display areas in combination with the corresponding fusion display strategy.

[0073] The management end refers to the terminal held by the manager who has image fusion needs. The fusion display strategy refers to the strategy for displaying and adjusting the registered dynamic image, including the step display strategy and the specific display strategy. The step display strategy refers to the strategy for displaying and adjusting a single target object. The specific display strategy refers to the strategy for jointly displaying and adjusting multiple targets. The target object refers to the object that the manager wants to view. For example, when the manager wants to view a tumor, the target object can be a tumor. The display area refers to the area where the target object is displayed.

[0074] Based on the above embodiment, the specific implementation of step S2 may be:

[0075] S21, obtaining the fusion display strategy selected by the management end, and obtaining the target contour corresponding to the target object based on the fusion display strategy.

[0076] In some embodiments, when acquiring the target contour, the contour of the target object may be extracted by a contour extraction technique. For example, the target contour corresponding to the target object may be acquired by an edge detection method.

[0077] The target contour refers to the contour corresponding to the target object that the manager wants to view. For example, when the target object that the manager wants to view is a tumor, the target contour may be the contour of the tumor.

[0078] S22, determining, according to the step display strategy, the area where the target outline is located as the target display area, and generating a plurality of background display areas based on the target outline, wherein the display area includes a target display area and a background display area.

[0079] It is understandable that when managers want to view each individual target object and its surroundings separately, they can choose a stepped display strategy, and subsequently can adopt corresponding display adjustment methods for the image information of the individual target object and its surroundings in combination with the stepped display strategy. When displaying, in order to be able to display the target object and the image data within a certain range around the target object and obtain more comprehensive information, the area where the target outline is located can be divided into a target display area and a background display area. The target display area is fully displayed to highlight the target object, and the background display area is adjusted in a corresponding display adjustment method to adjust the transparency, so that image information that is more closely related to the target object can be obtained.

[0080] Specifically, when managers choose a step display strategy, this solution can expand the target outline in sequence according to a certain distance to obtain the corresponding expanded area, that is, the background display area. Subsequently, the transparency of the background display area can be adjusted in different ways. Managers can clearly see the image data corresponding to the target object, as well as the image data within a certain range around the target object.

[0081] The target display area refers to the area where the target object is displayed and adjusted, and the area can be fully displayed later, and the background display area refers to the associated area around the target object.

[0082] In some embodiments, step S22 includes S221 to S224, which are specifically as follows:

[0083] S221, obtaining the area of ​​the target display area according to the step display strategy, and obtaining a range adjustment coefficient according to a ratio of the area to a reference area.

[0084] In practical applications, tumors will have a certain impact on the surrounding tissue structures. The larger the tumor, the greater the impact. During the diagnosis of the tumor, observing the outer expansion area around the tumor can obtain more comprehensive tumor-related information. Therefore, when observing the target object, this solution can also observe the image information of the target object and a certain area around the target object, so as to obtain more comprehensive target object related data.

[0085] Specifically, this solution can pre-configure a standard area, namely, a reference area. After obtaining the area corresponding to the target object, the range adjustment coefficient for adjusting the size of the expanded area can be obtained by calculating the ratio of the area to the reference area.

[0086] Among them, the regional area refers to the area corresponding to the target display area, the reference area refers to the preset standard area of ​​the target display area, and the range adjustment coefficient refers to the coefficient for adjusting the range size of the expanded area.

[0087] S222, obtaining a background range distance according to the product of the range adjustment coefficient and the reference range distance, determining a preset number of divisions of the background range distance, and obtaining a unit distance according to a ratio of the background range distance to the number of divisions.

[0088] In some embodiments, a standard outward expansion distance corresponding to a standard area, i.e., a reference range distance, can be pre-configured, and the reference area can be set corresponding to the reference range distance, so that the reference range distance can be offset according to the area of ​​the area, and multiple range intervals can be pre-configured, and each interval can be configured with a corresponding number of divisions based on demand. Since the correlation between different areas around the target object and the target object is different, a certain area around the target object can be divided again according to the number of divisions, so that the area with a higher correlation with the target object can be displayed more prominently.

[0089] Specifically, by multiplying the range adjustment coefficient by the baseline range distance, the background range distance after the baseline range distance is offset can be obtained. By traversing multiple range intervals through the background range distance, the range interval corresponding to the background range distance is determined, so that the number of divisions corresponding to the background range distance can be obtained. By calculating the ratio of the background range distance to the number of divisions, the unit distance corresponding to each background display area can be obtained.

[0090] Among them, the benchmark range distance refers to the distance of the standard outward expansion range corresponding to the preset benchmark area, the background range distance refers to the range distance after the benchmark range distance is offset. The larger the area, the larger the corresponding background range distance will be. The number of divisions refers to the number of divisions of the background range distance, which corresponds to the number of background display areas. The larger the background range distance, the more corresponding divisions can be. The unit distance refers to the division distance corresponding to a single background display area.

[0091] S223, sequentially extending each contour point in the target contour outward by the unit distance to obtain an extension point, and generating a plurality of extension contours according to the extension points.

[0092] In practical applications, the target contour corresponds to multiple contour points. After obtaining the unit distance, each contour point on the target contour can be extended outward according to the unit distance to obtain multiple corresponding extension points. By connecting the multiple extension points, a new contour, i.e., an extension contour, can be obtained. After obtaining the new extension contour, the new extension contour can be extended outward by a unit distance in the same way as above to obtain a second extension contour. By analogy, multiple extension contours can be obtained.

[0093] See also Figure 2, which is a schematic diagram of a display area corresponding to a step display strategy provided by an embodiment of the present invention, such as Figure 2 As shown in , after the target contour is extended outward by a unit distance, an extended contour 1 can be obtained. Similarly, after the extended contour 1 is extended outward by a unit distance, an extended contour 2 can be obtained.

[0094] The expansion point refers to the point corresponding to the contour point moved outward by a unit distance, and the expansion contour refers to the contour after the target contour is extended outward by a unit distance.

[0095] S224: Determine an area adjacent to the outward-expanding outline and an area between the adjacent target outline and the outward-expanding outline as the background display area.

[0096] like Figure 2 As shown, the area between the target outline and the outward-expanded outline 1 is the background display area 1, the area between the outward-expanded outline 1 and the outward-expanded outline 2 is the background display area 2, and the area between the outward-expanded outline 2 and the outward-expanded outline 3 is the background display area 3.

[0097] Through the above implementation, image data within a certain range around the target object can be displayed, and more comprehensive relevant information of the target object can be obtained.

[0098] S23, or, based on the specific display strategy, display grouping the target contours to obtain a plurality of collaborative display groups, determining a segmentation line corresponding to the collaborative display group, and dividing the registered dynamic image according to the segmentation line to obtain a target display area and a background display area.

[0099] It is understandable that there may be multiple targets in the registered dynamic image. When the multiple targets are close to each other, the correlation between the multiple targets may be strong. Therefore, the corresponding multiple targets can be displayed in a coordinated manner, thereby providing more comprehensive data. When managers want to display multiple targets in a coordinated manner, they can select a specific display strategy, and then they can use the specific display strategy to display the multiple targets and their surrounding image information in a corresponding manner.

[0100] Specifically, when the manager selects a specific display strategy, the target contours corresponding to multiple targets in the registered dynamic image can be grouped in combination with the specific display strategy, and targets that are close to each other can be divided into the same collaborative display group. Multiple collaborative display groups can be obtained, and corresponding dividing lines can be generated according to the collaborative display groups to divide the registered dynamic image into a target display area and a background display area.

[0101] Among them, the collaborative display group refers to a group that performs collaborative display adjustment on multiple targets, the dividing line refers to the line that divides the display area of ​​the registered dynamic image, the corresponding target display area under a specific display strategy refers to the area for collaborative display of multiple targets, and the background display area refers to other areas in the registered dynamic image except the target display area.

[0102] Based on the above embodiment, the specific implementation of step S23 may be:

[0103] S231 , determining the contour distance between the target contours according to the center points of the target contours, and acquiring the target contours whose contour distances are smaller than the reference contour distance as the same collaborative display group.

[0104] In practical applications, we can first determine the center point corresponding to each target contour. By obtaining the distance between the center points, we can get the contour distance between each target contour. Then we can compare the contour distance with the preset reference contour distance. If the contour distance is smaller than the reference contour distance, it means that the corresponding target contours are closer, and the corresponding target contours can be divided into the same collaborative display group.

[0105] The contour distance refers to the interval distance between target contours, and the reference contour distance refers to the threshold used to determine whether the distance between target contours is too close.

[0106] S232, obtaining a comprehensive central point corresponding to each of the target contours in the collaborative display group, and generating a central baseline based on the comprehensive central point and an initial direction corresponding to the initial angle.

[0107] After the collaborative display group is obtained, firstly, a central baseline corresponding to the collaborative display group may be generated according to the comprehensive central point, and then a corresponding segmentation line may be generated according to the central baseline.

[0108] Specifically, when obtaining the comprehensive center point, the contour points corresponding to all target contours in the collaborative display group can be obtained, and the contour points corresponding to the target contours can be coordinateized to determine the maximum coordinate value and the minimum coordinate value of multiple contour points in the initial direction, as well as the maximum coordinate value and the minimum coordinate value in the direction perpendicular to the initial direction. By calculating the average of the maximum coordinate value and the minimum coordinate value in the initial direction, the coordinate value of the comprehensive center point in the initial direction can be obtained. By calculating the average of the maximum coordinate value and the minimum coordinate value in the direction perpendicular to the initial direction, the coordinate value of the comprehensive center point in the direction perpendicular to the initial direction can be obtained. Coordinate values, for example, when the initial direction is consistent with the x-axis direction, the maximum coordinate value and the minimum coordinate value corresponding to the contour point in the initial direction can be the maximum x-axis coordinate value and the minimum x-axis coordinate value, then the coordinate value of the comprehensive center point in the initial direction is the average value of the maximum x-axis coordinate value and the minimum x-axis coordinate value, when the direction perpendicular to the initial direction is consistent with the y-axis direction, the maximum coordinate value and the minimum coordinate value corresponding to the contour point in the direction perpendicular to the initial direction can be the maximum y-axis coordinate value and the minimum y-axis coordinate value, then the coordinate value of the comprehensive center point in the direction perpendicular to the initial direction is the average value of the maximum y-axis coordinate value and the minimum y-axis coordinate value. With the comprehensive center point as the reference point, the center baseline is generated according to the initial direction. For example, when the initial direction is consistent with the horizontal direction, the corresponding initial angle can be 0 degrees, then the corresponding center baseline can be generated in the horizontal direction, and the corresponding segmentation line can be generated in combination with the center baseline.

[0109] Among them, the comprehensive center point refers to the regional center point of the area occupied by all target contours in the collaborative display area, the initial angle refers to the starting angle when generating the central baseline, the initial direction refers to the direction corresponding to the initial angle, and the central baseline refers to the line generated based on the center point and the initial direction.

[0110] S233, rotating the central baseline according to the rotation direction, generating a dividing line corresponding to the collaborative display group at each rotation angle based on the central baseline, and determining an optimal angle according to the pending area divided by the dividing line, wherein the rotation angle includes an initial angle.

[0111] After obtaining the central baseline, in order to find the best angle for dividing the collaborative display group, the central baseline can be rotated according to the rotation direction. For example, the central baseline can be rotated in a clockwise direction. The dividing lines at different angles can be generated according to the central baseline, so that the pending areas at different rotation angles can be obtained. Since the image data displayed by the pending areas corresponding to different rotation angles are different, and the interference data in the image data displayed by different pending areas are also different, the image data in multiple pending areas can be compared, and the rotation angle corresponding to the pending area with the least interference data can be determined as the best angle.

[0112] Among them, the rotation direction refers to the direction of rotation of the central baseline, the rotation angle refers to the angle of rotation of the central baseline, the pending area refers to the area image corresponding to the collaborative display group at different angles, and the optimal angle refers to the rotation angle with the best observation angle. The interference data in the pending area at the optimal angle is the least.

[0113] In some embodiments, the step S233 of "rotating the central baseline according to the rotation direction, generating a dividing line corresponding to the collaborative display group at each rotation angle based on the central baseline, and determining the optimal angle according to the pending area divided by the dividing line" includes the following steps:

[0114] S2331, obtaining the direction of the central baseline corresponding to each of the rotation angles as a first direction, and determining a second direction perpendicular to the first direction.

[0115] For example, when the rotation angle corresponding to the central baseline is 0°, the first direction may be a horizontal direction, and the second direction may be a vertical direction.

[0116] S2332: Obtain two extreme value coordinate values ​​corresponding to the collaborative display group in the second direction, and generate a segmentation line parallel to the first direction according to each of the extreme value coordinate values.

[0117] In some embodiments, when the first direction is consistent with the x-axis direction and the second direction is consistent with the y-axis direction, the two extreme coordinate values ​​corresponding to the contour points in the collaborative display group in the second direction can be the maximum y-axis coordinate value and the minimum y-axis coordinate value, and two dividing lines perpendicular to the y-axis can be generated by the maximum y-axis coordinate value and the minimum y-axis coordinate value, and these two dividing lines are parallel to the x-axis, that is, parallel to the first direction.

[0118] S2333, determining the area between the parallel segmentation lines as a pending area, obtaining the area in the pending area except the target contour as an interference area, and determining the rotation angle corresponding to the minimum interference area as an optimal angle.

[0119] Specifically, the registered dynamic image can be divided into multiple areas through dividing lines, and the area surrounded by two adjacent parallel dividing lines can be determined as a pending area. In addition to the target contour, each pending area may also have other blank areas. The blank areas except the target contour can be determined as interference areas. Since the central baseline can be rotated to different angles, the corresponding interference areas under multiple rotation angles can be obtained, and the size of each interference area can be obtained. By comparing the sizes of interference areas under different rotation angles, a rotation angle that minimizes the interference area can be found, and the rotation angle can be determined as the optimal angle.

[0120] Through the above implementation, the interference area can be minimized and the accuracy of the fused image data can be improved.

[0121] In some embodiments, the rotation angle may be determined by:

[0122] A1, determine the initial angle as the first rotation angle, take the rotation angle as a reference, and determine the next rotation angle according to the preset rotation angle and the rotation direction.

[0123] For example, when the initial angle is 0°, the rotation direction is clockwise, and the preset rotation angle is 5°, then the corresponding first rotation angle is 0°, and by rotating 5° clockwise, the second rotation angle can be 5°.

[0124] The preset rotation angle refers to the standard angle of each rotation preset by the center baseline.

[0125] A2, obtaining the intersection contour length corresponding to the center baseline at the next rotation angle, and obtaining the angle adjustment coefficient according to the ratio of the reference contour length and the intersection contour length.

[0126] It can be understood that in order to improve the flexibility of angle rotation, the rotation angle can be dynamically adjusted according to the part where the center baseline intersects with the target contour. If the part where the center baseline intersects with the target contour is small, then after the center baseline is rotated significantly, there is still a high possibility that the center baseline will not intersect with other contours. It can be considered that there are more interference areas in this area. The next time the center baseline is rotated, the rotation amplitude can be increased.

[0127] Specifically, the coefficient for adjusting the preset rotation angle can be obtained by calculating the ratio of the baseline contour length to the intersection contour length. The larger the intersection contour length, the smaller the angle adjustment coefficient, and the smaller the rotation amplitude of the center baseline can be; the smaller the intersection contour length, the larger the angle adjustment coefficient, and the larger the rotation amplitude of the center baseline can be.

[0128] Among them, the intersection contour length refers to the sum of the lengths of the intersections of each target contour with the central baseline, and the reference contour length refers to the standard length of the intersection of the preset target contour with the central baseline. The reference contour length can be set corresponding to the preset rotation angle, so that the preset rotation angle can be offset.

[0129] A3, obtaining an adjusted rotation angle according to the product of the angle adjustment coefficient and the preset rotation angle, taking the rotation angle as a reference, and continuing to determine the next rotation angle according to the rotation direction and the adjusted rotation angle.

[0130] The angle adjustment coefficient can be used to offset the preset rotation angle to obtain the adjusted rotation angle. The center baseline is rotated again according to the adjusted rotation angle to determine the next rotation angle. For example, when the rotation direction is clockwise and the adjusted rotation angle is 6°, then based on the current rotation angle of 5°, the next rotation angle can be 11° by rotating clockwise by 6°. The adjusted rotation angle refers to the angle after the preset rotation angle is offset.

[0131] A4, repeat the above steps of determining the rotation angle according to the adjusted rotation angle until the sum of all the rotation angles is greater than or equal to the preset full angle, and then stop determining the rotation angle.

[0132] Among them, the preset full angle refers to the angle of one rotation, that is, 360°. Continue to obtain the intersection contour length of the center baseline and the target contour at the next rotation angle, calculate the corresponding angle adjustment coefficient and adjust the rotation angle, and continue to offset the next rotation angle according to the adjusted rotation angle to obtain a new rotation angle. Repeat the above steps of obtaining the rotation angle until the sum of the rotation angles is greater than or equal to 360 degrees, which means that the center baseline has rotated one circle. At this time, the step of obtaining the rotation angle can be stopped.

[0133] Through the above implementation, frequent adjustment of the rotation angle can be avoided, thereby improving the flexibility of adjusting the rotation angle.

[0134] S234, dividing the registered dynamic image based on the dividing lines at the optimal angle, determining that the area between the dividing lines corresponding to each of the collaborative display groups is a target display area, and the area in the registered dynamic image other than the target display area is a background display area.

[0135] After obtaining the best angle, the registered dynamic image can be divided into regions according to the segmentation lines corresponding to the best angle, see Figure 3 , which is a schematic diagram of a display area corresponding to a specific display strategy provided in an embodiment of the present invention, such as Figure 3 As shown in , dividing line 1 and dividing line 2 are corresponding dividing lines at the optimal angle, the area between dividing line 1 and dividing line 2 is the target display area, and other areas in the registered dynamic image are the background display area.

[0136] S3, determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differentiated display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image.

[0137] Specifically, after the registered dynamic image is divided into regions, the transparency of each display area can be adjusted by the display unit in the data fusion model to obtain a dynamically adjusted image.

[0138] Among them, the display unit refers to the unit for display adjustment of the display area, transparency refers to a transparency value between 0 and 100, 0 represents complete opacity, and 100 represents complete transparency, differentiated display adjustment refers to the transparency adjustment of the display area, and the dynamically adjusted image refers to the image after the transparency of the registered dynamic image is adjusted.

[0139] In some embodiments, under the step display strategy, the dynamically adjusted image can be obtained by:

[0140] S3A1, according to the display unit, determining that a preset transparency value is the transparency of the remaining areas except the display area, a preset opacity value is the transparency of the target display area, and determining the center point of the target display area as the positioning point.

[0141] It can be understood that in order to highlight the target object, the target display area corresponding to the target object can be fully displayed. Therefore, the preset opaque value can be used as the transparency corresponding to the target display area, and the preset transparent value can be used as the transparency of the remaining areas except the display area. Only data within a certain range around the target object can be displayed, and visual interference during observation can be reduced. In order to make the transparency between each background display area more naturally connected, the transparency of each background display area can be adjusted in combination with the distance between the target display area and the background display area. Specifically, the center point of the target display area can be determined as the positioning point, and the distance between the target display area and the background display area can be determined through the positioning point.

[0142] S3A2, obtaining the sub-interval distances between each contour point and the positioning point in the outward expansion contour corresponding to the outer side of each background display area, and obtaining the interval distance between each background display area and the target display area according to the average value of the sub-interval distances.

[0143] In practical applications, within a certain range around a target object, an area with a smaller distance from the target object may contain information that is more closely related to the target object, and an area with a larger distance from the target object may contain information that is less closely related to the target object. When displaying the registered dynamic image, in order to obtain more relevant information of the target object, the area with a smaller distance can be displayed with a lower transparency, and the area with a larger distance can be displayed with a higher transparency. Therefore, different transparencies can be used to adjust the display of each background display area, and the transparency corresponding to each background display area can be adjusted according to the distance between the background display area and the target display area.

[0144] See also Figure 4 , is a schematic diagram of a dynamically adjusted image corresponding to a step display strategy provided by an embodiment of the present invention, such as Figure 4As shown in , the contours corresponding to the background display area 2 are the outward-expanded contour 1 and the outward-expanded contour 2, and the outward-expanded contour 2 is the contour corresponding to the outside of the background display area 2. Therefore, the distance between each contour point in the outward-expanded contour 2 and the positioning point can be determined as the sub-interval distance. By calculating the average of multiple sub-interval distances, the interval distance between each background display area and the target display area can be obtained. Since the interval distance between the background display area 1 and the target display area is small, the background display area 1 is almost opaque when displayed. The interval distance between the background display area 3 and the target display area is large, so the background display area 3 is relatively transparent when displayed.

[0145] Among them, the sub-interval distance refers to the distance between the contour point and the positioning point, and the interval distance refers to the distance between the outer contour of the background display area and the outer contour of the target display area.

[0146] S3A3, obtaining a transparency adjustment coefficient based on the ratio of the spacing distance to the reference distance, and obtaining the transparency of each background display area according to the product of the transparency adjustment coefficient and the reference transparency value.

[0147] In practical applications, when the interval distance is larger, the corresponding transparency adjustment coefficient is larger, and the transparency obtained by offsetting the transparency adjustment coefficient is also correspondingly larger, so the corresponding background display area is more transparent when displayed; when the interval distance is smaller, the corresponding transparency adjustment coefficient is smaller, and the transparency obtained by offsetting the transparency adjustment coefficient is also correspondingly smaller, so the corresponding background display area is more opaque when displayed, so that image data with strong correlation around the target object can be observed.

[0148] The reference distance may be set corresponding to the reference transparency value, so that the reference transparency value may be offset by the interval distance to obtain the transparency corresponding to each background display area.

[0149] S3A4, adjusting the transparency of each display area according to the transparency corresponding to the display area to obtain a dynamically adjusted image.

[0150] Specifically, the transparency of each display area is adjusted according to the transparency of each background display area, and the following can be obtained: Figure 4 Dynamically resized image shown.

[0151] Through the above implementation, the background display area around the target object can be displayed in a gradually blurred manner, which can reduce visual interference when observing the target object.

[0152] In some other embodiments, under the step display strategy, the dynamically adjusted image can also be obtained in the following manner:

[0153] S3B1, according to the display unit, determining that a preset transparent value is the transparency of the remaining areas except the display area, a preset opaque value is the transparency of the target display area, and obtaining the background display area adjacent to the target display area as the first background area.

[0154] In some embodiments, the multiple background display areas may be adjusted for display at intervals, that is, transparent background display areas and opaque background display areas are displayed alternately.

[0155] The first background area refers to the background display area for prominent display, see Figure 5 , which is a schematic diagram of a dynamically adjusted image corresponding to another step display strategy provided by an embodiment of the present invention, such as Figure 5 As shown in , the background display area 1 is adjacent to the target display area, so the background display area 1 can be determined as the first background area.

[0156] S3B2, acquiring the background display area adjacent to the first background area as the second background area, and determining the background display area adjacent to the second background area as the next first background area.

[0157] like Figure 5 As shown in , background display area 2 is adjacent to background display area 1, so background display area 2 can be used as the second background area, and since background display area 3 is a background display area adjacent to the second background area, background display area 3 can be used as the next first background area. The second background area refers to the background area for transparent display.

[0158] S3B3, repeat the above steps of alternately determining the first background area and the second background area until all the background display areas are determined.

[0159] The first background area and the second background area are repeatedly obtained according to the same steps as above until all the background display areas are determined.

[0160] S3B4, determining that the opaque value is the transparency corresponding to the first background area, determining that the preset transparent value is the transparency of the second background area, and adjusting the transparency of each display area according to the transparency corresponding to each display area to obtain a dynamically adjusted image.

[0161] like Figure 5As shown in , the preset opacity value is displayed as the transparency of the first background area, and the preset transparency value is displayed as the transparency of the second background area. For example, when the preset opacity value is 0, the transparency of the first background area is 0, and the first background area is displayed opaquely. When the preset transparency value is 100, the transparency of the second background area is 100, and the second background area is displayed completely transparently. By alternately adjusting the transparency of the background display area, the corresponding dynamically adjusted image can be obtained.

[0162] Through the above implementation, the dynamically adjusted image can be made to fit more closely with the registered static image, so that it can be better integrated with the registered static image.

[0163] In some embodiments, under a specific display strategy, a dynamically adjusted image can be obtained by:

[0164] S3C1, determining a preset opaque value as the transparency of the target display area and a preset transparent value as the transparency of the background display area according to the display unit.

[0165] Specifically, under a specific display strategy, in order to highlight the target display area and reduce the visual interference caused by the background display area during observation, after determining the target display area and the background display area, the preset opacity value can be combined with the display unit to display the transparency of the target display area and the preset transparency value can be used as the transparency of the background display area. For example, when the preset opacity value is 0, the transparency of the target display area is 0, and an opaque display is performed; when the preset transparency value is 100, the transparency of the background display area is 100, and a transparent display is performed.

[0166] S3C2, adjusting the transparency of each display area based on the transparency corresponding to each display area to obtain a dynamically adjusted image.

[0167] Specifically, by adjusting the transparency according to the transparency corresponding to each display area, a dynamically adjusted image corresponding to a specific display strategy can be obtained.

[0168] Through the above implementation, the transparency of the target display area and the background display area can be adjusted, thereby reducing visual interference during observation.

[0169] S4, performing a fusion process on the dynamically adjusted image and the registered static image according to the fusion unit in the data fusion model, obtaining a fused display image and sending it to the management terminal.

[0170] After the dynamically adjusted image is obtained, the fusion unit in the data fusion model can be used to perform image fusion processing on the dynamically adjusted image and the registered static image to obtain a fused display image, which is sent to the management personnel. The management personnel can obtain more comprehensive and accurate information through the fused display image.

[0171] The fusion unit refers to a unit for fusing a dynamic image with a static image, and the fused display image refers to an image obtained by fusing a dynamic adjustment image with a registered static image.

[0172] Through the above implementation, two different image information can be combined, so that more comprehensive information can be obtained.

[0173] See also Figure 6 , is a structural diagram of a data fusion processing device provided by an embodiment of the present invention. The data processing system based on the data fusion processing device includes:

[0174] A registration module is used to perform real-time registration processing on the dynamic image and the static image based on the positioning unit in the data fusion model to obtain a registered dynamic image and a registered static image;

[0175] An acquisition module, used for acquiring a target object in the registered dynamic image according to a fusion display strategy selected by a management terminal, and determining a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy;

[0176] An adjustment module, used for determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differential display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image;

[0177] A fusion module is used to fuse the dynamically adjusted image and the registered static image according to the fusion unit in the data fusion model to obtain a fused display image and send it to the management end.

[0178] Figure 6 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.

[0179] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data fusion processing method, characterized in that: include: Based on the positioning unit in the data fusion model, the dynamic image and the static image are registered in real time to obtain a registered dynamic image and a registered static image; Acquire a target object in the registered dynamic image according to a fusion display strategy selected by the management end, and determine a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy; Determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differential display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image; According to the fusion unit in the data fusion model, the dynamically adjusted image and the registered static image are fused to obtain a fused display image and send it to the management end; According to the fusion display strategy selected by the management end, a target object in the registered dynamic image is obtained, and a plurality of display areas are determined according to the target object. The fusion display strategy includes a step display strategy and a specific display strategy, including: Acquire the fusion display strategy selected by the management end, and acquire the target contour corresponding to the target object based on the fusion display strategy; According to the step display strategy, determine the area where the target outline is located as the target display area, and generate multiple background display areas based on the target outline, wherein the display area includes a target display area and a background display area; Based on the specific display strategy, each of the target contours is displayed and grouped to obtain a plurality of collaborative display groups, a segmentation line corresponding to the collaborative display group is determined, and the registered dynamic image is divided according to the segmentation line to obtain a target display area and a background display area; According to the step display strategy, the area where the target outline is located is determined as the target display area, and multiple background display areas are generated based on the target outline. The display area includes a target display area and a background display area, including: Acquire the area of ​​the target display area according to the step display strategy, and obtain the range adjustment coefficient according to the ratio of the area of ​​the target display area to the reference area; Obtaining a background range distance according to the product of the range adjustment coefficient and the reference range distance, determining a preset number of divisions of the background range distance, and obtaining a unit distance according to a ratio of the background range distance to the number of divisions; Extending each contour point in the target contour outward by the unit distance in turn to obtain an extension point, and generating a plurality of extension contours according to the extension points; Determine the area adjacent to the outward-expanding outline and between the adjacent target outline and the outward-expanding outline as the background display area; The target contours are grouped for display based on the specific display strategy to obtain a plurality of collaborative display groups, a segmentation line corresponding to the collaborative display group is determined, and the registered dynamic image is divided according to the segmentation line to obtain a target display area and a background display area, including: Determine the contour distance between the target contours according to the center points of the target contours, and obtain the target contours whose contour distance is smaller than the reference contour distance as the same collaborative display group; Obtaining a comprehensive center point corresponding to each target outline in the collaborative display group, and generating a center baseline based on the comprehensive center point and an initial direction corresponding to an initial angle; The central baseline is rotated according to the rotation direction, and a dividing line corresponding to the collaborative display group at each rotation angle is generated based on the central baseline, and an optimal angle is determined according to the pending area divided by the dividing line, wherein the rotation angle includes an initial angle; The registered dynamic image is divided based on the dividing lines at the optimal angle, and the area between the dividing lines corresponding to each of the collaborative display groups is determined as the target display area, and the area in the registered dynamic image except the target display area is the background display area.

2. The method according to claim 1, characterized in that The rotation angle is determined by the following steps, including: A1. Determine the initial angle as the first rotation angle, and determine the next rotation angle based on the rotation angle and the rotation direction; A2, obtaining the intersecting contour length corresponding to the center baseline at the next rotation angle, and obtaining an angle adjustment coefficient according to the ratio of the reference contour length to the intersecting contour length; A3, obtaining an adjusted rotation angle according to the product of the angle adjustment coefficient and the preset rotation angle, taking the current rotation angle as a reference, and continuing to determine the next rotation angle according to the rotation direction and the adjusted rotation angle; Repeat steps A2 to A3 until the sum of all actual rotation angles is greater than or equal to the preset full angle, and then stop determining the rotation angle.

3. The method according to claim 2, characterized in that The central baseline is rotated according to the rotation direction, and a dividing line corresponding to the collaborative display group at each rotation angle is generated based on the central baseline, and the optimal angle is determined according to the pending area divided by the dividing line, including: Acquire the direction of the central baseline corresponding to each of the rotation angles as a first direction, and determine a second direction perpendicular to the first direction; Acquire two extreme value coordinate values ​​corresponding to the collaborative display group in the second direction, and generate a segmentation line parallel to the first direction according to each of the extreme value coordinate values; The area between the parallel segmentation lines is determined as a pending area, the area except the target contour in the pending area is obtained as an interference area, and the rotation angle corresponding to the minimum interference area is determined as an optimal angle.

4. The method according to claim 1, characterized in that: Determining the transparency of each display area based on the display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image, including: Determine that a preset transparency value is the transparency of the remaining areas except the display area, a preset opacity value is the transparency of the target display area, and determine that the center point of the target display area is the positioning point; Obtaining the sub-interval distances between each contour point and the positioning point in the outward-expanded contour corresponding to the outer side of each background display area, and obtaining the interval distance between each background display area and the target display area according to the average value of the sub-interval distances; Obtaining a transparency adjustment coefficient based on a ratio of the spacing distance to a reference distance, and obtaining the transparency of each of the background display areas according to a product of the transparency adjustment coefficient and a reference transparency value; The transparency of each display area is adjusted according to the corresponding transparency of each display area to obtain a dynamically adjusted image, wherein the dynamically adjusted image is an image obtained by adjusting the transparency of each display area in combination with the spacing distance under a step display strategy.

5. The method according to claim 1, characterized in that Determining the transparency of each display area based on the display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image, including: Determine a preset opacity value as the transparency of the target display area, and obtain the background display area adjacent to the target display area as the first background area; Acquire the background display area adjacent to the first background area as the second background area, determine the background display area adjacent to the second background area as the next first background area, alternately determine the first background area and the second background area until all the background display areas are determined; Determine the opaque value as the transparency corresponding to the first background area, determine the preset transparent value as the transparency of the second background area, adjust the transparency of each display area according to the transparency corresponding to each display area to obtain a dynamically adjusted image, wherein the dynamically adjusted image is an image obtained by adjusting the transparency of each display area in an interval manner under a step display strategy.

6. The method according to claim 1, characterized in that Determining the transparency of each display area based on the display unit in the data fusion model, and performing differential display adjustment on each display area based on the transparency to obtain a dynamically adjusted image, including: Determine a preset opaque value as the transparency of the target display area, and determine a preset transparent value as the transparency of the background display area; The transparency of each display area is adjusted based on the transparency corresponding to each display area to obtain a dynamically adjusted image, wherein the dynamically adjusted image is an image obtained by adjusting the transparency of each display area under a specific display strategy.

7. A data fusion processing device used in the data fusion processing method according to claim 1, characterized in that: include: A registration module, used for performing real-time registration processing on the dynamic image and the static image based on the positioning unit in the data fusion model to obtain a registered dynamic image and a registered static image; An acquisition module, used for acquiring a target object in the registered dynamic image according to a fusion display strategy selected by a management terminal, and determining a plurality of display areas according to the target object, wherein the fusion display strategy includes a step display strategy and a specific display strategy; An adjustment module, used for determining the transparency of each of the display areas based on the display unit in the data fusion model, and performing differential display adjustment on each of the display areas based on the transparency to obtain a dynamically adjusted image; A fusion module is used to fuse the dynamically adjusted image and the registered static image according to the fusion unit in the data fusion model to obtain a fused display image and send it to the management end.

Images