Image processing method and device, computer device, storage medium and product

Abstract

The application provides an image processing method and device, computer equipment, storage medium and product, and belongs to the technical field of image processing. The method comprises the following steps: acquiring a first image of an abnormal part of a target object, the first image comprising a plurality of waveform signals, each waveform signal being a one-dimensional waveform signal obtained by signal acquisition on a plurality of collection parts corresponding to the abnormal part, and each waveform signal corresponding to an axis generated by connection of a collection part and the abnormal part; determining a plurality of orthogonal signals from the plurality of waveform signals, the axes corresponding to the plurality of orthogonal signals being perpendicular to each other; fusing the plurality of orthogonal signals to obtain an equivalent vector signal; and generating a second image based on the plurality of waveform signals and the equivalent vector signal, the second image being used to reflect an abnormal condition of the abnormal part. The method reflects the abnormal condition of the abnormal part by combining the equivalent vector signal and the plurality of waveform signals to form a new image, and can improve the accuracy of the reflected abnormal condition of the abnormal part.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to an image processing method, apparatus, computer equipment, storage medium and product. Background Technology

[0002] In daily life, some parts of a target object may exhibit abnormal conditions. Therefore, it is necessary to acquire images of these abnormal parts to obtain target images that reflect their abnormal conditions. The target object can refer to various entities, such as equipment or the human body.

[0003] In related technologies, multiple acquisition components are used to acquire data from multiple acquisition points of an abnormal area, obtaining a one-dimensional waveform signal corresponding to each acquisition point. This one-dimensional waveform signal is then plotted onto an image to obtain the target image. Since abnormal areas are generally three-dimensional, the one-dimensional waveform signal corresponding to each acquisition point of the abnormal area is the result of two projections of the overall three-dimensional signal of the abnormal area.

[0004] In related technologies, since the three-dimensional signals of abnormal parts are relatively weak, the one-dimensional waveform signals obtained by projecting the three-dimensional signals twice will have signal loss. As a result, the target image generated based on multiple one-dimensional waveform signals cannot accurately reflect the abnormal condition of the abnormal parts, that is, the accuracy of the target image in reflecting the abnormal condition of the abnormal parts is poor. Summary of the Invention

[0005] This application provides an image processing method, apparatus, computer device, storage medium, and product, which can improve the accuracy of reflecting abnormal conditions in abnormal areas. The technical solution is as follows:

[0006] On the one hand, an image processing method is provided, the method comprising:

[0007] A first image of an abnormal part of a target object is obtained. The first image includes multiple waveform signals. Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part. Each waveform signal corresponds to an acquisition point and an axis line generated by connecting the abnormal part.

[0008] Multiple orthogonal signals are determined from the plurality of waveform signals, wherein the axes corresponding to the plurality of orthogonal signals are perpendicular to each other;

[0009] By fusing the multiple orthogonal signals, an equivalent vector signal is obtained;

[0010] Based on the multiple waveform signals and the equivalent vector signal, a second image is generated, which is used to reflect the abnormal condition of the abnormal part.

[0011] In one possible implementation, the plurality of waveform signals include a plurality of first part signals and a plurality of second part signals, wherein the plurality of first part signals are waveform signals corresponding to the frontal surface of the abnormal part, and the plurality of second part signals are waveform signals corresponding to the transverse surface of the abnormal part, wherein the frontal surface and the transverse surface are perpendicular to each other.

[0012] The step of determining multiple orthogonal signals from the plurality of waveform signals includes:

[0013] By acquiring one signal from a first location corresponding to the forehead and two signals from two second locations corresponding to the horizontal plane, three orthogonal signals are obtained, wherein the axes of the two second location signals corresponding to the horizontal plane are perpendicular to each other; or,

[0014] Two first part signals corresponding to the forehead and one second part signal corresponding to the transverse surface are obtained respectively to obtain three orthogonal signals, and the axes of the two first part signals corresponding to the forehead are perpendicular to each other.

[0015] In one possible implementation, the first site signal includes a first standard signal, a second standard signal, a third standard signal, a first pressure signal, a second pressure signal, and a third pressure signal. The first standard signal and the first pressure signal correspond to the signal of the left upper limb of the target object, the second standard signal and the second pressure signal correspond to the signal of the right upper limb of the target object, and the third standard signal and the third pressure signal correspond to the signal of the left lower limb of the target object. The first pressure signal, the second pressure signal, and the third pressure signal are all signals acquired by enhancing the acquisition voltage. The plurality of second site signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal correspond to the signals of six different positions on the anterior chest of the target object.

[0016] The process involves acquiring a first location signal corresponding to the forehead and two second location signals corresponding to the transverse surface, resulting in three orthogonal signals, including:

[0017] The third pressurization signal, the second position signal, and the sixth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the second position signal and the sixth position signal are perpendicular to each other; or,

[0018] The second standard signal, the first position signal, and the fifth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the first position signal and the fifth position signal are perpendicular to each other.

[0019] In one possible implementation, fusing the multiple orthogonal signals to obtain an equivalent vector signal includes:

[0020] Obtain the signal value of each orthogonal signal at each sampling time;

[0021] For each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of the multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0022] The equivalent vector signal is generated based on each sampling time and the vector value at each sampling time.

[0023] In one possible implementation, acquiring the first image of the abnormal part of the target object includes:

[0024] Obtain the original image of the abnormal area, the original image including multiple original waveform signals;

[0025] The multiple original waveform signals are filtered and amplified to obtain multiple analog signals;

[0026] The multiple analog signals are converted from analog to digital to obtain multiple digital signals;

[0027] The first image is obtained by plotting the one-dimensional waveform corresponding to each digital signal.

[0028] In one possible implementation, generating the second image based on the plurality of waveform signals and the equivalent vector signal includes:

[0029] The equivalent vector signal is added to the first image to obtain the second image.

[0030] In one possible implementation, the method further includes:

[0031] Based on the second image, the operational status of the abnormal area is determined.

[0032] In one possible implementation, each waveform signal includes multiple waveforms, and determining the operational status of the abnormal region based on the second image includes:

[0033] Based on the equivalent vector signal, the start and end points of multiple waveforms in each waveform signal are determined;

[0034] Based on the start and end points of the multiple waveforms, the waveform characteristics of each waveform are determined;

[0035] Based on the waveform characteristics of the multiple waveform signals, the operating status of the abnormal part is determined.

[0036] On the other hand, an image processing apparatus is provided, the apparatus comprising:

[0037] The acquisition module is used to acquire a first image of an abnormal part of a target object. The first image includes multiple waveform signals. Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part. Each waveform signal corresponds to an acquisition point and an axis line generated by connecting the abnormal part.

[0038] A first determining module is configured to determine a plurality of orthogonal signals from the plurality of waveform signals, wherein the axes corresponding to the plurality of orthogonal signals are perpendicular to each other.

[0039] The fusion module is used to fuse the multiple orthogonal signals to obtain an equivalent vector signal;

[0040] The generation module is used to generate a second image based on the plurality of waveform signals and the equivalent vector signal, the second image being used to reflect the abnormal condition of the abnormal part.

[0041] In one possible implementation, the plurality of waveform signals include a plurality of first location signals and a plurality of second location signals, wherein the plurality of first location signals are waveform signals corresponding to the forehead surface of the abnormal location, and the plurality of second location signals are waveform signals corresponding to the transverse surface of the abnormal location, wherein the forehead surface and the transverse surface are perpendicular to each other; the first determining module includes:

[0042] The first acquisition unit is used to acquire a first part signal corresponding to the forehead and two second part signals corresponding to the horizontal surface respectively, to obtain three orthogonal signals, wherein the axes of the two second part signals corresponding to the horizontal surface are perpendicular to each other.

[0043] The second acquisition unit is used to acquire two first part signals corresponding to the forehead and one second part signal corresponding to the horizontal surface, respectively, to obtain three orthogonal signals, wherein the axes of the two first part signals corresponding to the forehead are perpendicular to each other.

[0044] In one possible implementation, the first site signal includes a first standard signal, a second standard signal, a third standard signal, a first pressure signal, a second pressure signal, and a third pressure signal. The first standard signal and the first pressure signal correspond to the signal of the left upper limb of the target object, the second standard signal and the second pressure signal correspond to the signal of the right upper limb of the target object, and the third standard signal and the third pressure signal correspond to the signal of the left lower limb of the target object. The first pressure signal, the second pressure signal, and the third pressure signal are all signals acquired by enhancing the acquisition voltage. The plurality of second site signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal correspond to signals at six different positions on the anterior chest of the target object. The first acquisition unit is used for:

[0045] The third pressurization signal, the second position signal, and the sixth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the second position signal and the sixth position signal are perpendicular to each other; or,

[0046] The second standard signal, the first position signal, and the fifth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the first position signal and the fifth position signal are perpendicular to each other.

[0047] In one possible implementation, the fusion module is used to:

[0048] Obtain the signal value of each orthogonal signal at each sampling time;

[0049] For each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of the multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0050] The equivalent vector signal is generated based on each sampling time and the vector value at each sampling time.

[0051] In one possible implementation, the acquisition module is configured to:

[0052] Obtain the original image of the abnormal area, the original image including multiple original waveform signals;

[0053] The multiple original waveform signals are filtered and amplified to obtain multiple analog signals;

[0054] The multiple analog signals are converted from analog to digital to obtain multiple digital signals;

[0055] The first image is obtained by plotting the one-dimensional waveform corresponding to each digital signal.

[0056] In one possible implementation, the generation module is used to add the equivalent vector signal to the first image to obtain the second image.

[0057] In one possible implementation, the device further includes:

[0058] The second determining module is used to determine the operational status of the abnormal part based on the second image.

[0059] In one possible implementation, each waveform signal includes multiple waveforms, and the second determining module is used to:

[0060] Based on the equivalent vector signal, the start and end points of multiple waveforms in each waveform signal are determined;

[0061] Based on the start and end points of the multiple waveforms, the waveform characteristics of each waveform are determined;

[0062] Based on the waveform characteristics of the multiple waveform signals, the operating status of the abnormal part is determined.

[0063] On the other hand, a computer device is provided, the computer device including one or more processors and one or more memories, the one or more memories storing at least one piece of program code, the at least one piece of program code being loaded and executed by the one or more processors to implement the image processing method described in any of the above implementations.

[0064] On the other hand, a computer-readable storage medium is provided, wherein at least one piece of program code is stored therein, the at least one piece of program code being loaded and executed by a processor to implement the image processing method described in any of the above implementations.

[0065] On the other hand, a computer program product is provided, the computer program product including at least one piece of program code, the at least one piece of program code being loaded and executed by a processor to implement the image processing method described in any of the above implementations.

[0066] The beneficial effects of the technical solutions provided in this application include at least the following:

[0067] This application provides an image processing method that fuses multiple orthogonal signals from multiple waveform signals to obtain an equivalent vector signal. This makes the equivalent vector signal able to represent the comprehensive change trend of the waveform signal in three dimensions and more accurately reflect the change trend of the waveform signal. Furthermore, the equivalent vector signal is combined with multiple waveform signals to form a new image to reflect the abnormal condition of the abnormal part, which can improve the accuracy of reflecting the abnormal condition of the abnormal part. Attached Figure Description

[0068] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0069] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application;

[0070] Figure 2 This is a flowchart of an image processing method provided in an embodiment of this application;

[0071] Figure 3 This is a flowchart of an image processing method provided in an embodiment of this application;

[0072] Figure 4 This is a schematic diagram of a six-axis limb lead system provided in an embodiment of this application;

[0073] Figure 5 This is a schematic diagram of a six-axis chest lead system provided in an embodiment of this application;

[0074] Figure 6 This is a schematic diagram of a first image provided in an embodiment of this application;

[0075] Figure 7 This is a schematic diagram of a component for acquiring a first image provided in an embodiment of this application;

[0076] Figure 8 This is a schematic diagram of a three-dimensional electrocardiogram (ECG) signal projection provided in an embodiment of this application;

[0077] Figure 9 This is a schematic diagram of a 13-lead electrocardiogram provided in an embodiment of this application;

[0078] Figure 10 This is a flowchart of an image processing method provided in an embodiment of this application;

[0079] Figure 11 This is a block diagram of an image processing apparatus provided in an embodiment of this application;

[0080] Figure 12 This is a block diagram of a terminal provided in an embodiment of this application;

[0081] Figure 13 This is a block diagram of a server provided in an embodiment of this application. Detailed Implementation

[0082] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0083] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0084] The image processing method provided in this application embodiment can be used in a computer device. Optionally, the computer device is a terminal or a server. Optionally, the server is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Optionally, the terminal is a smartphone, tablet computer, laptop computer, desktop computer, etc., but is not limited to these.

[0085] In one possible implementation, the computer program involved in the embodiments of this application may be deployed and executed on a computer device, or executed on multiple computer devices located in one location, or executed on multiple computer devices distributed in multiple locations and interconnected through a communication network. Multiple computer devices distributed in multiple locations and interconnected through a communication network can form a blockchain system.

[0086] This application's embodiments are applied to computer devices. In the first scenario, the computer device is provided as a terminal, and the terminal executes the image processing method provided in this application's embodiments; wherein the terminal can be at least one of a smartphone, tablet, laptop, or desktop computer. In the second scenario, the computer device is provided as a server, and the server executes the image processing method provided in this application's embodiments; wherein the server is a single server, or a server cluster consisting of several servers, including at least one of a cloud server, cloud computing platform, and virtualization center. In the third scenario, the computer device is provided as both a terminal and a server, and the terminal and server jointly execute the image processing method provided in this application. The following description uses the example of the computer device being provided as both a terminal and a server. Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application. See also... Figure 1 The implementation environment includes: terminal 10 and server 20.

[0087] Terminal 10 has a target application installed on it, which is provided by server 20. Terminal 10 can perform functions such as data transmission and information interaction through this target application. The target application can be an application within the operating system of terminal 10 or an application provided by a third party. For example, the target application could be a medical application. Terminal 10 can interact with server 20 through the medical application to perform image processing. Server 20 provides background services to terminal 10.

[0088] In one possible implementation, terminal 10 acquires multiple one-dimensional waveform signals from the abnormal parts of the target object and sends these signals to server 20. Server 20 then generates an image reflecting the abnormal condition of the abnormal parts based on these signals. In another possible implementation, the terminal acquires multiple one-dimensional waveform signals from the abnormal parts of the target object and generates an image reflecting the abnormal condition of the abnormal parts based on these signals.

[0089] The image processing method provided in this application embodiment can be applied to any of the following image processing scenarios.

[0090] In the first scenario, the target object is the human body, and this image processing method is used to obtain images reflecting abnormal conditions in abnormal parts of the body. For example, if the target object is a human body (patient), and the abnormal part is the heart, then the computer device will acquire images of the patient's heart to obtain images reflecting the abnormal condition of the patient's heart.

[0091] In the second scenario, the target object is a device, and the image processing method is used to obtain an image reflecting the abnormal condition of the abnormal part of the device. For example, if the target object is a device (a component malfunctions), and the abnormal part is the part of the device where the abnormal condition occurs, then the computer device acquires an image of the abnormal part of the device to obtain an image reflecting the abnormal condition of the abnormal part of the device.

[0092] Figure 2 This is a flowchart illustrating an image processing method provided in an embodiment of this application. The execution subject of this embodiment is a computer device; see [link to relevant documentation]. Figure 2 The method includes:

[0093] Step 201: Obtain a first image of the abnormal part of the target object. The first image includes multiple waveform signals. Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part. Each waveform signal corresponds to an axis line generated by connecting an acquisition point and the abnormal part.

[0094] Step 202: Determine multiple orthogonal signals from multiple waveform signals, where the axes corresponding to the multiple orthogonal signals are perpendicular to each other.

[0095] Step 203: Fuse multiple orthogonal signals to obtain an equivalent vector signal.

[0096] Step 204: Based on multiple waveform signals and equivalent vector signals, generate a second image, which is used to reflect the abnormal condition of the abnormal part.

[0097] In one possible implementation, the multiple waveform signals include multiple first part signals and multiple second part signals, wherein the multiple first part signals are waveform signals corresponding to the frontal surface of the abnormal part, and the multiple second part signals are waveform signals corresponding to the transverse surface of the abnormal part, and the frontal surface and the transverse surface are perpendicular to each other.

[0098] Determine multiple orthogonal signals from multiple waveform signals, including:

[0099] By acquiring one signal from the first part corresponding to the forehead and two signals from the second part corresponding to the horizontal plane, three orthogonal signals are obtained, with the axes of the two second part signals corresponding to the horizontal plane being perpendicular to each other; or,

[0100] Two first-part signals corresponding to the frontal surface and one second-part signal corresponding to the transverse surface are obtained respectively to obtain three orthogonal signals. The axes of the two first-part signals corresponding to the frontal surface are perpendicular to each other.

[0101] In one possible implementation, the first site signal includes a first standard signal, a second standard signal, a third standard signal, a first pressure signal, a second pressure signal, and a third pressure signal. The first standard signal and the first pressure signal correspond to the signal of the left upper limb of the target object, the second standard signal and the second pressure signal correspond to the signal of the right upper limb of the target object, and the third standard signal and the third pressure signal correspond to the signal of the left lower limb of the target object. The first pressure signal, the second pressure signal, and the third pressure signal are all signals acquired by enhancing the acquisition voltage. The multiple second site signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal correspond to the signals of six different positions on the front chest of the target object.

[0102] By acquiring one signal from the first part corresponding to the forehead and two signals from the second part corresponding to the horizontal plane, three orthogonal signals are obtained, including:

[0103] The third pressurization signal, the second position signal, and the sixth position signal are acquired respectively, resulting in three orthogonal signals, with the axes of the second and sixth position signals perpendicular to each other; or,

[0104] The second standard signal, the first position signal, and the fifth position signal are acquired respectively to obtain three orthogonal signals, with the axes of the first position signal and the fifth position signal being perpendicular to each other.

[0105] In one possible implementation, multiple orthogonal signals are fused to obtain an equivalent vector signal, including:

[0106] Obtain the signal value of each orthogonal signal at each sampling time;

[0107] For each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0108] An equivalent vector signal is generated based on each sampling time and the vector value at each sampling time.

[0109] In one possible implementation, obtaining a first image of the abnormal region of the target object includes:

[0110] Acquire the original image of the abnormal area; the original image includes multiple original waveform signals.

[0111] Multiple original waveform signals are filtered and amplified separately to obtain multiple analog signals;

[0112] Multiple analog signals are converted to digital signals separately to obtain multiple digital signals;

[0113] Draw the one-dimensional waveform corresponding to each digital signal to obtain the first image.

[0114] In one possible implementation, a second image is generated based on multiple waveform signals and equivalent vector signals, including:

[0115] An equivalent vector signal is added to the first image to obtain the second image.

[0116] In one possible implementation, the method also includes:

[0117] Based on the second image, the operational status of the abnormal area is determined.

[0118] In one possible implementation, each waveform signal includes multiple waveforms, and based on the second image, the operational status of abnormal parts is determined, including:

[0119] Based on the equivalent vector signal, the start and end points of multiple waveforms in each waveform signal are determined;

[0120] Based on the start and end points of multiple waveforms, determine the waveform characteristics of each waveform;

[0121] Based on the waveform characteristics of multiple waveform signals, the operational status of abnormal parts is determined.

[0122] This application provides an image processing method that fuses multiple orthogonal signals from multiple waveform signals to obtain an equivalent vector signal. This makes the equivalent vector signal able to represent the comprehensive change trend of the waveform signal in three dimensions and more accurately reflect the change trend of the waveform signal. Furthermore, the equivalent vector signal is combined with multiple waveform signals to form a new image to reflect the abnormal condition of the abnormal part, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0123] Figure 3 This is a flowchart illustrating an image processing method provided in an embodiment of this application. The execution subject of this embodiment is a computer device. Taking the human body as the target object, the heart as the abnormal part, and an electrocardiogram (ECG) image as the first image, the explanation is as follows: [See attached diagram]. Figure 3 The method includes:

[0124] Step 301: The computer device acquires a first image of the abnormal part of the target object, which is a human body, and the first image includes multiple waveform signals.

[0125] Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal area, and each waveform signal corresponds to an axis generated by connecting an acquisition point and the abnormal area. In this embodiment, the target object is the human body, the abnormal area is the heart, and the first image is an electrocardiogram (ECG) image. Therefore, the multiple waveform signals included in the first image are multiple lead signals.

[0126] In one implementation, the first image is a 12-lead electrocardiogram (ECG). The multiple lead signals are the 12 lead signals included in the 12-lead ECG. The multiple acquisition sites are the upper left limb, upper right limb, lower left limb, and six surface locations on the anterior chest. These six surface locations are: V1 at the right sternal border in the fourth intercostal space; V2 at the left sternal border in the fourth intercostal space; V4 at the intersection of the left midclavicular line and the fifth intercostal space; V3 at the midpoint of V2 and V4; V5 at the intersection of V4 and the anterior axillary line; and V6 at the intersection of V4 and the midaxillary line. The multiple axes correspond to multiple lead axes of the heart, including six lead axes in the limb lead six-axis system and six lead axes in the chest lead six-axis system.

[0127] The limb lead six-axis system is a system of six leads generated by imagining lines connecting the two upper limbs and the left lower limb to the heart. Specifically, three points equidistant from the two upper limbs and the left lower limb form an equilateral triangle on the frontal plane of the torso, with the heart at the center. The three sides of the equilateral triangle represent three standard limb lead axes, and the three perpendicular diagonals within the triangle represent three augmented unipolar lead axes. These three standard limb lead axes and three augmented unipolar lead axes constitute the limb lead six-axis system. (See also...) Figure 4 , Figure 4 This is a schematic diagram of a six-axis limb lead system. The three standard limb lead axes are designated as Standard I, Standard II, and Standard III. The three compression unipolar lead axes are designated as the compression left limb lead axis, the compression right limb lead axis, and the compression lower limb lead axis. The lead signals corresponding to these six lead axes are Standard I signal, Standard II signal, Standard III signal, compression left limb lead signal AVL, compression right limb lead signal AVR, and compression lower limb lead signal AVF, respectively. Figure 4 The multiple lead axes in the diagram are represented by I, II, III, AVL, AVR, and AVF, respectively.

[0128] The six-axis precordial lead system is a lead axis system formed by drawing lines from six locations on the chest to an imaginary heart, creating six lead axes. See also... Figure 5 , Figure 5This is a schematic diagram of a six-axis system with chest leads. The six lead axes are the chest V1, chest V2, chest V3, chest V4, chest V5, and chest V6 leads. The multiple lead signals corresponding to these six lead axes are the chest V1 lead signal, chest V2 lead signal, chest V3 lead signal, chest V4 lead signal, chest V5 lead signal, and chest V6 lead signal, respectively. Figure 5 The multiple lead axes in the diagram are represented by V1, V2, V3, V4, V5, and V6, respectively.

[0129] In this embodiment of the application, the computer device acquires the first image by including the following steps (1)-(4):

[0130] (1) The computer device acquires the original image of the abnormal part, which includes multiple original waveform signals.

[0131] In one implementation, the computer device acquires the raw waveform signal through a signal acquisition component.

[0132] Optionally, the signal acquisition component includes multiple electrodes, each electrode being connected to multiple acquisition sites on the target object, for extracting bioelectrical signals from the body surface of the acquisition site, and transmitting the bioelectrical signals to the acquisition circuit through a lead wire to obtain multiple raw waveform signals, which are unprocessed signals; optionally, the multiple raw waveform signals are all one-dimensional waveform signals.

[0133] (2) The computer equipment filters and amplifies the multiple original waveform signals to obtain multiple analog signals.

[0134] In one implementation, the computer device filters and amplifies multiple raw waveform signals through an acquisition circuit to obtain multiple analog signals, and then sends the multiple analog signals to an A / D analog-to-digital converter.

[0135] (3) The computer equipment performs analog-to-digital conversion on multiple analog signals to obtain multiple digital signals.

[0136] In one implementation, the computer device converts multiple analog signals into multiple digital signals using an A / D analog-to-digital converter, and then transmits these multiple digital signals to a digital processing software component.

[0137] (4) The computer equipment draws the one-dimensional waveform corresponding to each digital signal to obtain the first image.

[0138] In one implementation, the computer device processes and analyzes each digital signal based on digital processing software components, generates a one-dimensional waveform diagram corresponding to each digital signal, obtains a first image, and displays the multiple waveform signals included in the first image; see also Figure 6 , Figure 6 This is a schematic diagram of a first image, which is a 12-lead electrocardiogram, including 12 lead signals.

[0139] See Figure 7 , Figure 7 This diagram illustrates how a computer device acquires an original image via a signal acquisition component, and then sequentially passes the original image through an acquisition circuit, an A / D analog-to-digital converter, and digital processing software to obtain a first image. The computer device effectively processes the original image through the signal acquisition component, acquisition circuit, A / D analog-to-digital converter, and digital processing software, resulting in a first image that is easy to analyze, display, and process, thereby improving the efficiency of obtaining multiple orthogonal signals based on the first image in subsequent processes.

[0140] In this embodiment of the application, by processing the original image, multiple waveform signals including the first image are obtained, thereby improving the efficiency of determining multiple orthogonal signals based on multiple waveform signals in subsequent processes, and thus improving the efficiency of obtaining equivalent vector signals based on orthogonal signals in subsequent processes, thereby improving the efficiency of image processing.

[0141] Step 302: The computer device determines multiple orthogonal signals from multiple waveform signals, and the axes corresponding to the multiple orthogonal signals are perpendicular to each other.

[0142] In some embodiments, the multiple waveform signals include multiple first part signals and multiple second part signals, wherein the multiple first part signals are waveform signals corresponding to the frontal surface of the abnormal part, and the multiple second part signals are waveform signals corresponding to the transverse surface of the abnormal part, with the frontal surface and the transverse surface being perpendicular to each other; then the computer device determines multiple orthogonal signals from the multiple waveform signals, including the following two implementation methods:

[0143] In one implementation, the computer device acquires a first part signal corresponding to the front face and two second part signals corresponding to the side face, respectively, to obtain three orthogonal signals, wherein the axes of the two second part signals corresponding to the side face are perpendicular to each other. In another implementation, the computer device acquires two first part signals corresponding to the front face and one second part signal corresponding to the side face, respectively, to obtain three orthogonal signals, wherein the axes of the two first part signals corresponding to the front face are perpendicular to each other.

[0144] In this embodiment of the application, since the first part signal and the second part signal correspond to the frontal plane and the horizontal plane respectively, and the axes of the frontal plane and the horizontal plane are perpendicular to each other, by obtaining the three orthogonal signals corresponding to the frontal plane and the horizontal plane respectively, the three orthogonal signals obtained represent the comprehensive change trend of the waveform signal in three dimensions, so that the multiple orthogonal signals among the determined multiple waveform signals have high comprehensiveness and good representativeness.

[0145] In some embodiments, the first site signal includes a first standard signal, a second standard signal, a third standard signal, a first pressurized signal, a second pressurized signal, and a third pressurized signal. The first standard signal and the first pressurized signal correspond to the signal of the left upper limb of the target object, the second standard signal and the second pressurized signal correspond to the signal of the right upper limb of the target object, and the third standard signal and the third pressurized signal correspond to the signal of the left lower limb of the target object. The first pressurized signal, the second pressurized signal, and the third pressurized signal are all signals acquired by enhancing the acquisition voltage. The multiple second site signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal correspond to signals at six different locations on the front chest of the target object.

[0146] In some embodiments, the first image is a 12-lead electrocardiogram. The first standard signal and the first pressurized signal are respectively the lead I signal and the pressurized left limb lead signal AVL corresponding to the left upper limb. The second standard signal and the second pressurized signal are respectively the lead II signal and the pressurized right limb lead signal AVR corresponding to the right upper limb. The third standard signal and the third pressurized signal are respectively the lead III signal and the pressurized lower limb lead signal AVF corresponding to the left lower limb. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal are respectively the chest V1, chest V2, chest V3, chest V4, chest V5, and chest V6 leads corresponding to the anterior chest of the person.

[0147] In this embodiment, the computer device acquires the chest V2 lead signal, the compressed lower limb lead signal AVF, and the chest V6 lead signal respectively to obtain three orthogonal signals; or, the computer device acquires the standard II lead signal, the chest V1 lead signal, and the chest V5 lead signal respectively to obtain three orthogonal signals.

[0148] In this embodiment, since the heart is a three-dimensional structure, the electrocardiogram (ECG) signal is the manifestation of the electrical signals generated during myocardial contraction and relaxation on the body surface. Simultaneously, around the body surface, a 12-lead ECG based on the Wilson lead system represents the ECG changes on the anterior surface of the human body. Each lead signal represents a secondary projection of the three-dimensional ECG signal of the heart at that acquisition site. A schematic diagram of the projection of the three-dimensional ECG signal of the heart is shown below. Figure 8As shown. Since the three-dimensional electrocardiogram (ECG) signal of the heart is generally quite weak, the signals from multiple leads obtained after secondary projection will suffer varying degrees of loss, resulting in signal gaps in each lead and thus making the ECG image inaccurate in reflecting cardiac abnormalities. However, in this embodiment, by selecting three orthogonal leads from the 12 leads, each representing the signal distribution along an axis in a different direction, the three orthogonal signals can represent the three-dimensional reflection of the heart's electrical signals, providing good comprehensiveness and higher accuracy.

[0149] Step 303: The computer device acquires the signal value of each orthogonal signal at each sampling time.

[0150] It should be noted that each orthogonal signal is a time-domain signal, with the horizontal axis representing the sampling time and the vertical axis representing the signal value.

[0151] In some embodiments, the first image is a 12-lead electrocardiogram, and the signal value at each sampling time in the orthogonal signal is the signal value of the voltage corresponding to that sampling time.

[0152] Step 304: For each sampling time, the computer device sums the squares of the signal values ​​of each orthogonal signal to obtain the sum of squares of multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0153] In this embodiment, the equivalent vector signal is obtained at each sampling time by taking the square root of the sum of the squares of the signal values ​​of multiple orthogonal signals. This ensures that the vector value of the equivalent vector signal obtained at each sampling time in the subsequent process represents the comprehensive signal value in the three-dimensional direction. As a result, the equivalent vector signal can represent the comprehensive change trend of the waveform signal in the three-dimensional direction, improving the fusion effect and making the equivalent vector signal more representative. Consequently, the second image composed of the equivalent vector signal in the subsequent process reflects the abnormal condition of the abnormal part, which can improve the accuracy of the reflected abnormal condition.

[0154] In one implementation, the computer device equates the axes corresponding to the three orthogonal signals to the X-axis, Y-axis, and Z-axis, respectively, forming an equivalent three-dimensional lead axis. Continuing with the example of a 12-lead electrocardiogram (ECG) as the first image, the three orthogonal signals are the T2 lead signal, the AVF (lower limb compression) lead signal, and the T6 lead signal. The axes corresponding to these signals are equated to the X-axis, Y-axis, and Z-axis, respectively, forming an equivalent three-dimensional lead axis. The vector value of the equivalent vector signal at each sampling time can then be obtained using the following equivalent formula.

[0155] Equivalent formula:

[0156] For each sampling time, V6 represents the signal value of the chest V6 lead at that time; V2 represents the signal value of the chest V2 lead at that time; AVF represents the signal value of the compressed lower limb lead AVF at that time; and M represents the signal value of the equivalent vector signal at that time, with the absolute value of this signal value used as the vector value.

[0157] Step 305: The computer device generates an equivalent vector signal based on each sampling time and the vector value at each sampling time.

[0158] The computer device plots an image using the value of each sampling time as the horizontal axis and the vector value of each sampling time as the vertical axis, thus obtaining an equivalent vector signal with the sampling time as the horizontal axis and the vector value as the vertical axis.

[0159] In some embodiments, the first image is a 12-lead electrocardiogram. It should be noted that, since the equivalent vector signal in this embodiment has a positive vector value at any time, the Wilson center terminal of the Wilson system is equivalent to a zero voltage value, and all QRS waves representing ventricular contraction are converted into positive waves. Such a transformation is not only beneficial for analyzing lead signals, but also more beneficial for automatic analysis by current computer equipment, greatly reducing the computational load of waveform analysis. Therefore, applying the method provided in this application embodiment to a wearable miniaturized electrocardiogram analysis system will improve the computational efficiency and application efficiency of the wearable miniaturized electrocardiogram analysis system.

[0160] Step 306: The computer device generates a second image based on multiple waveform signals and equivalent vector signals.

[0161] The second image is used to reflect the abnormal condition of the abnormal part. In one implementation, the computer device adds an equivalent vector signal to the first image to obtain the second image. This makes the second image include both the equivalent vector signal and multiple waveform signals, and thus, based on the multiple waveform signals and the equivalent vector signal, the abnormal condition of the abnormal part can be reflected together, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0162] In some embodiments, if the first image is a 12-lead electrocardiogram, then an equivalent vector signal is added to the 12-lead electrocardiogram to obtain a second image, which is an image including 13 waveform signals.

[0163] In one implementation, the 12 lead signals and the equivalent vector signal are displayed on the same interface; for example, see [link to implementation]. Figure 9 , Figure 9This is a schematic diagram of a 13-lead electrocardiogram (ECG) consisting of 12 lead signals and an equivalent vector signal. The equivalent vector signal is arranged at the bottom of the 12 lead signals as an auxiliary lead signal to aid in the analysis of the 12 lead signals. For example, if the signal in lead II (standard II) is missing at a certain sampling time, the vector value corresponding to that sampling time in the equivalent vector signal can be assigned to lead II to compensate for the missing signal. In another implementation, the abnormal condition of the heart is reflected directly based on the waveform characteristics of multiple waveforms in the equivalent vector signal.

[0164] Step 307: The computer device determines the operating status of the abnormal part based on the second image.

[0165] Each waveform signal includes multiple waveforms. In this embodiment, the computer device determines the start and end points of the multiple waveforms in each waveform signal based on the equivalent vector signal. Based on the start and end points of the multiple waveforms, the computer device determines the waveform characteristics of each waveform. Based on the waveform characteristics of the multiple waveform signals, the computer device determines the operating status of abnormal parts.

[0166] In some embodiments, the first image is a 12-lead electrocardiogram (ECG), where each waveform signal is a lead signal. The horizontal axis of the lead signal represents the sampling time, and the vertical axis represents the voltage signal value. Each lead signal includes multiple waveforms, namely the P wave, QRS complex, and T wave; where the P wave is the atrial depolarization wave, the QRS complex is the ventricular depolarization wave, and the T wave is the ventricular repolarization wave. It should be noted that the start and end points of each waveform are used to determine the duration of each waveform. Once the duration of each waveform is determined, the lead signal can be segmented to obtain multiple waveforms. The waveform shape and duration of each waveform within its duration can represent the waveform characteristics of that waveform. For example, the duration of the P wave generally does not exceed 0.11 seconds, and the voltage amplitude does not exceed 0.25 millivolts; if the duration of the P wave exceeds 0.11 seconds, or the voltage amplitude exceeds 0.25 milliseconds, it is determined that there is an abnormality in the operation of the atrium.

[0167] It should be noted that because the three-dimensional electrocardiogram (ECG) signal, after secondary projection, will have varying losses in the multiple leads, and changes in ECG signals caused by certain heart diseases will also result in different losses when projected onto each lead, it is difficult to locate the start and end points of each waveform. Consequently, when using ECG images, doctors need to rely on experience and combine multiple lead signals to determine the characteristic changes of each lead signal, increasing the complexity and difficulty for doctors to analyze heart diseases based on ECG images, thus reducing the efficiency of reflecting abnormal cardiac conditions based on ECG images. In this embodiment, by using a three-dimensional equivalent coordinate system, the one-dimensional ECG signal is inverted into a spatial ECG vector signal. Thus, when reflecting abnormal cardiac conditions and determining the operational status based on a new ECG image composed of multiple lead signals and the equivalent vector signal, the equivalent vector signal can assist in the analysis of abnormal cardiac conditions; for example, the equivalent vector signal can be used to determine the start and end points of multiple lead signals, thereby improving the efficiency of reflecting abnormal cardiac conditions based on ECG images.

[0168] This application provides an image processing method that fuses multiple orthogonal signals from multiple waveform signals to obtain an equivalent vector signal. This makes the equivalent vector signal able to represent the comprehensive change trend of the waveform signal in three dimensions and more accurately reflect the change trend of the waveform signal. Furthermore, the equivalent vector signal is combined with multiple waveform signals to form a new image to reflect the abnormal condition of the abnormal part, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0169] It should be noted that the above embodiments are described with the target object being the human body. In other embodiments, the target object may also be animals or other organisms. In this application, no specific limitation is made in this regard.

[0170] Figure 10 This is a flowchart illustrating an image processing method provided in an embodiment of this application. The execution subject of this embodiment is a computer device; the description will be based on the device as the target object. See [link to documentation]. Figure 10 The method includes:

[0171] Step 1001: The computer device acquires a first image of the abnormal part of the target object, the target object being the device, and the first image includes multiple waveform signals.

[0172] The first image is an image of the abnormal part of the device, which is the part of the device where an abnormal condition occurs. Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part, and each waveform signal corresponds to an axis line generated by connecting an acquisition point and the abnormal part. The method of acquiring the first image by the computer device is the same as the method of acquiring the first image in step 301, and will not be repeated here.

[0173] In some embodiments, the device is a radio frequency antenna, the abnormal part is the transmitter where the radio frequency antenna is malfunctioning, and the multiple acquisition points are transmitting antennas facing multiple directions. Then each waveform signal corresponds to an electromagnetic wave signal generated by the axis of the transmitting antenna and the transmitter.

[0174] Step 1002: The computer device determines multiple orthogonal signals from multiple waveform signals, and the axes corresponding to the multiple orthogonal signals are perpendicular to each other.

[0175] In some embodiments, the multiple acquisition points are multiple locations located at the top, bottom, left, right, front, and rear of the abnormal location. If the abnormal location is taken as the center of the device, the multiple acquisition points include multiple locations at the top, bottom, left, right, front, and rear of the device; multiple waveform signals correspond to an axis generated by connecting an acquisition point and the abnormal location.

[0176] In one embodiment, the computer device acquires signals from multiple waveform signals corresponding to the axes formed by connecting the acquisition points located at the top, bottom, and left side of the abnormal region with the abnormal region, resulting in three orthogonal signals whose axes are perpendicular to each other. In another implementation, the computer device acquires signals from multiple waveform signals corresponding to the axes formed by connecting the acquisition points located to the left, right, and bottom of the abnormal region with the abnormal region, resulting in three orthogonal signals whose axes are perpendicular to each other.

[0177] In some embodiments, the device is a radio frequency antenna, the abnormal part is the transmitter where the radio frequency antenna malfunctions, and the multiple acquisition points are transmitting antennas facing multiple directions. The computer device acquires signals corresponding to the axes generated by the connection between the transmitting antennas located on the left, right, and top of the transmitter and the transmitter, respectively, to obtain three orthogonal signals.

[0178] In this embodiment of the application, the computer device acquires three orthogonal signals whose axes are perpendicular to each other in multiple waveform signals. Since the three orthogonal signals are signals corresponding to axes in different directions, the three orthogonal signals represent the comprehensive changes of the waveform signals in three dimensions. Based on the three orthogonal signals, an equivalent vector signal is obtained in the subsequent process, which can obtain an equivalent vector signal with good representativeness and high comprehensiveness.

[0179] Step 1003: The computer device acquires the signal value of each orthogonal signal at each sampling time.

[0180] It should be noted that each orthogonal signal is a time-domain signal, with the horizontal axis representing the sampling time and the vertical axis representing the signal value.

[0181] In some embodiments, the device is a radio frequency antenna and the orthogonal signal is an electromagnetic wave signal. Then, the signal value of the electromagnetic wave at each sampling time is the energy value of the electromagnetic wave corresponding to that sampling time.

[0182] Step 1004: For each sampling time, the computer device sums the squares of the signal values ​​of each orthogonal signal to obtain the sum of squares of multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0183] In some embodiments, the device is a radio frequency antenna and the orthogonal signal is an electromagnetic wave signal. The signal value of the electromagnetic wave at each sampling time is the energy value of the electromagnetic wave corresponding to that sampling time. For each sampling time, the computer device sums the squares of the energy values ​​of each electromagnetic wave signal to obtain the sum of squares of multiple electromagnetic wave signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0184] In this embodiment, the equivalent vector signal is obtained at each sampling time by taking the square root of the sum of the squares of the signal values ​​of multiple orthogonal signals. This ensures that the vector value of the equivalent vector signal at each sampling time represents the comprehensive signal value in the three-dimensional direction. Consequently, the equivalent vector signal can represent the comprehensive change trend of the electromagnetic wave signal of the device in the three-dimensional direction, making the equivalent vector signal more representative. Therefore, in subsequent processes, the second image composed of the equivalent vector signal reflects the abnormal condition of the abnormal part, which can improve the accuracy of the reflected abnormal condition.

[0185] Step 1005: The computer device generates an equivalent vector signal based on each sampling time and the vector value at each sampling time.

[0186] The computer device plots an image using the value of each sampling time as the horizontal axis and the vector value of each sampling time as the vertical axis, thus obtaining an equivalent vector signal with the sampling time as the horizontal axis and the vector value as the vertical axis.

[0187] Step 1006: The computer device generates a second image based on multiple waveform signals and equivalent vector signals.

[0188] The second image is used to reflect the abnormal condition of the abnormal part. In one implementation, the computer device adds an equivalent vector signal to the first image to obtain the second image. This makes the second image include both the equivalent vector signal and multiple waveform signals, and thus, based on the multiple waveform signals and the equivalent vector signal, the abnormal condition of the abnormal part can be reflected together, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0189] In some embodiments, the device is a radio frequency antenna, the abnormal part is the transmitter where the radio frequency antenna malfunctions, and the multiple waveform signals are electromagnetic wave signals. In one implementation, multiple electromagnetic wave signals and equivalent vector signals are displayed on the same interface, thereby facilitating the reflection of the abnormal condition of the abnormal part based on multiple electromagnetic wave signals and equivalent vector signals.

[0190] Step 1007: The computer equipment determines the operating status of the abnormal part based on the second image.

[0191] Each waveform signal includes multiple waveforms. In this embodiment, the computer device determines the start and end points of the multiple waveforms in each waveform signal based on an equivalent vector signal. Based on the start and end points of the multiple waveforms, the computer device determines the waveform characteristics of each waveform. Based on the waveform characteristics of the multiple waveform signals, the computer device determines the operational status of the abnormal part. It should be noted that the start and end points of each waveform are used to determine the duration of each waveform. Once the duration of each waveform is determined, the lead signal can be segmented to obtain multiple waveforms. The waveform shape and duration of each waveform within its duration can represent the waveform characteristics of that waveform.

[0192] In this embodiment of the application, the waveform characteristics of each waveform are determined by determining the start and end points of multiple waveforms. Since the start and end points of multiple waveforms can represent the duration of each waveform, and the waveform range of each waveform can only be determined after determining the start and end points of each waveform, and the frequency of the waveform can also be determined based on the start and end points of each waveform, the waveform characteristics of the waveform can be determined based on the waveform fluctuations, duration, and frequency, and the accuracy of the determined waveform characteristics can be improved.

[0193] This application provides an image processing method that fuses multiple orthogonal signals from multiple waveform signals to obtain an equivalent vector signal. This makes the equivalent vector signal able to represent the comprehensive change trend of the waveform signal in three dimensions and more accurately reflect the change trend of the waveform signal. Furthermore, the equivalent vector signal is combined with multiple waveform signals to form a new image to reflect the abnormal condition of the abnormal part, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0194] This application also provides an image processing apparatus, see [link to relevant documentation]. Figure 11 The device includes:

[0195] The acquisition module 1101 is used to acquire a first image of the abnormal part of the target object. The first image includes multiple waveform signals. Each waveform signal is a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part. Each waveform signal corresponds to an axis line generated by connecting an acquisition point and the abnormal part.

[0196] The first determining module 1102 is used to determine multiple orthogonal signals from multiple waveform signals, wherein the axes corresponding to the multiple orthogonal signals are perpendicular to each other.

[0197] The fusion module 1103 is used to fuse multiple orthogonal signals to obtain an equivalent vector signal;

[0198] The generation module 1104 is used to generate a second image based on multiple waveform signals and equivalent vector signals. The second image is used to reflect the abnormal condition of the abnormal part.

[0199] In one possible implementation, the multiple waveform signals include multiple first part signals and multiple second part signals, wherein the multiple first part signals are waveform signals corresponding to the frontal surface of the abnormal part, and the multiple second part signals are waveform signals corresponding to the transverse surface of the abnormal part, with the frontal surface and the transverse surface being perpendicular to each other; the first determining module 1102 includes:

[0200] The first acquisition unit is used to acquire a first part signal corresponding to the forehead and two second part signals corresponding to the horizontal plane respectively, to obtain three orthogonal signals, and the axes of the two second part signals corresponding to the horizontal plane are perpendicular to each other.

[0201] The second acquisition unit is used to acquire two first part signals corresponding to the forehead and one second part signal corresponding to the horizontal plane respectively, to obtain three orthogonal signals, wherein the axes of the two first part signals corresponding to the forehead are perpendicular to each other.

[0202] In one possible implementation, the first site signal includes a first standard signal, a second standard signal, a third standard signal, a first pressure signal, a second pressure signal, and a third pressure signal. The first standard signal and the first pressure signal correspond to the signal of the left upper limb of the target object, the second standard signal and the second pressure signal correspond to the signal of the right upper limb of the target object, and the third standard signal and the third pressure signal correspond to the signal of the left lower limb of the target object. The first pressure signal, the second pressure signal, and the third pressure signal are all signals acquired by enhancing the acquisition voltage. The multiple second site signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal. The first position signal, the second position signal, the third position signal, the fourth position signal, the fifth position signal, and the sixth position signal correspond to signals at six different positions on the front chest of the target object. The first acquisition unit is used for:

[0203] The third pressurization signal, the second position signal, and the sixth position signal are acquired respectively, resulting in three orthogonal signals, with the axes of the second and sixth position signals perpendicular to each other; or,

[0204] The second standard signal, the first position signal, and the fifth position signal are acquired respectively to obtain three orthogonal signals, with the axes of the first position signal and the fifth position signal being perpendicular to each other.

[0205] In one possible implementation, the fusion module 1103 is used for:

[0206] Obtain the signal value of each orthogonal signal at each sampling time;

[0207] For each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of multiple orthogonal signals. The square root of the sum of squares is then taken to obtain the vector value at the sampling time.

[0208] An equivalent vector signal is generated based on each sampling time and the vector value at each sampling time.

[0209] In one possible implementation, module 1101 is used for:

[0210] Acquire the original image of the abnormal area; the original image includes multiple original waveform signals.

[0211] Multiple original waveform signals are filtered and amplified separately to obtain multiple analog signals;

[0212] Multiple analog signals are converted to digital signals separately to obtain multiple digital signals;

[0213] Draw the one-dimensional waveform corresponding to each digital signal to obtain the first image.

[0214] In one possible implementation, the generation module 1104 is used to add an equivalent vector signal to the first image to obtain a second image.

[0215] In one possible implementation, the device further includes:

[0216] The second determination module is used to determine the operational status of abnormal parts based on the second image.

[0217] In one possible implementation, each waveform signal includes multiple waveforms, and a second determining module is used for:

[0218] Based on the equivalent vector signal, the start and end points of multiple waveforms in each waveform signal are determined;

[0219] Based on the start and end points of multiple waveforms, determine the waveform characteristics of each waveform;

[0220] Based on the waveform characteristics of multiple waveform signals, the operational status of abnormal parts is determined.

[0221] Figure 12A structural block diagram of a terminal 1200 provided in an exemplary embodiment of this application is shown. The terminal 1200 may be a portable mobile terminal, such as a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 1200 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or other names.

[0222] Typically, terminal 1200 includes a processor 1201 and a memory 1202.

[0223] Processor 1201 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1201 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1201 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1201 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1201 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0224] The memory 1202 may include one or more computer-readable storage media, which may be non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 are used to store at least one program code, which is executed by the processor 1201 to implement the image processing method provided in the method embodiments of this application.

[0225] In some embodiments, the terminal 1200 may also optionally include a peripheral device interface 1203 and at least one peripheral device. The processor 1201, memory 1202, and peripheral device interface 1203 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1203 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1204, a display screen 1205, a camera assembly 1206, an audio circuit 1207, a positioning assembly 1208, and a power supply 1209.

[0226] Peripheral device interface 1203 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1201 and memory 1202. In some embodiments, processor 1201, memory 1202 and peripheral device interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1201, memory 1202 and peripheral device interface 1203 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0227] The radio frequency (RF) circuit 1204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1204 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1204 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1204 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1204 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0228] Display screen 1205 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1205 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1201 for processing. In this case, display screen 1205 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1205, disposed on the front panel of terminal 1200; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 1200 or in a folded design; in still other embodiments, display screen 1205 may be a flexible display screen, disposed on a curved or folded surface of terminal 1200. Furthermore, display screen 1205 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1205 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0229] The camera assembly 1206 is used to acquire images or videos. Optionally, the camera assembly 1206 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1206 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0230] The audio circuit 1207 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1201 for processing, or input to the radio frequency circuit 1204 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1200. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1207 may also include a headphone jack.

[0231] The positioning component 1208 is used to locate the current geographical location of the terminal 1200 in order to enable navigation or LBS (Location Based Service). The positioning component 1208 can be a positioning component based on the US GPS (Global Positioning System), China's BeiDou system, or Russia's Galileo system.

[0232] Power supply 1209 is used to power the various components in terminal 1200. Power supply 1209 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1209 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0233] In some embodiments, the terminal 1200 further includes one or more sensors 1210. The one or more sensors 1210 include, but are not limited to: an accelerometer 1211, a gyroscope 1212, a pressure sensor 1213, a fingerprint sensor 1214, an optical sensor 1215, and a proximity sensor 1216.

[0234] Accelerometer 1211 can detect the magnitude of acceleration along the three coordinate axes of a coordinate system established with terminal 1200. For example, accelerometer 1211 can be used to detect the components of gravitational acceleration along the three coordinate axes. Processor 1201 can control display screen 1205 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1211. Accelerometer 1211 can also be used for games or for acquiring user motion data.

[0235] The gyroscope sensor 1212 can detect the orientation and rotation angle of the terminal 1200. The gyroscope sensor 1212 can work in conjunction with the accelerometer sensor 1211 to collect the user's 3D movements on the terminal 1200. Based on the data collected by the gyroscope sensor 1212, the processor 1201 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0236] The pressure sensor 1213 can be disposed on the side bezel of the terminal 1200 and / or on the lower layer of the display screen 1205. When the pressure sensor 1213 is disposed on the side bezel of the terminal 1200, it can detect the user's grip signal on the terminal 1200, and the processor 1201 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1213. When the pressure sensor 1213 is disposed on the lower layer of the display screen 1205, the processor 1201 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 1205. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0237] The fingerprint sensor 1214 is used to collect a user's fingerprint. The processor 1201 identifies the user based on the fingerprint collected by the fingerprint sensor 1214, or vice versa. When the user's identity is identified as trusted, the processor 1201 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 1214 can be located on the front, back, or side of the terminal 1200. When the terminal 1200 has physical buttons or a manufacturer's logo, the fingerprint sensor 1214 can be integrated with the physical buttons or manufacturer's logo.

[0238] The optical sensor 1215 is used to collect ambient light intensity. In one embodiment, the processor 1201 can control the display brightness of the display screen 1205 based on the ambient light intensity collected by the optical sensor 1215. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1205 is increased; when the ambient light intensity is low, the display brightness of the display screen 1205 is decreased. In another embodiment, the processor 1201 can also dynamically adjust the shooting parameters of the camera assembly 1206 based on the ambient light intensity collected by the optical sensor 1215.

[0239] The proximity sensor 1216, also known as a distance sensor, is typically mounted on the front panel of the terminal 1200. The proximity sensor 1216 is used to detect the distance between the user and the front of the terminal 1200. In one embodiment, when the proximity sensor 1216 detects that the distance between the user and the front of the terminal 1200 is gradually decreasing, the processor 1201 controls the display screen 1205 to switch from a screen-on state to a screen-off state; when the proximity sensor 1216 detects that the distance between the user and the front of the terminal 1200 is gradually increasing, the processor 1201 controls the display screen 1205 to switch from a screen-off state to a screen-on state.

[0240] Those skilled in the art will understand that Figure 12 The structure shown does not constitute a limitation on terminal 1200 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0241] Figure 13 This is a block diagram of a server provided in an embodiment of this disclosure. The server 1300 can vary significantly due to differences in configuration or performance. It may include one or more Central Processing Units (CPUs) 1301 and one or more memories 1302. The memories 1302 are used to store executable program code, and the processors 1301 are configured to execute the executable program code to implement the image processing methods provided in the various method embodiments described above. Of course, the server may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be elaborated here.

[0242] In an exemplary embodiment, a storage medium including program code is also provided, such as a memory 1302 including program code, which can be executed by the processor 1301 of the server 1300 to complete the image processing method described above. Optionally, the storage medium can be a non-transitory computer-readable storage medium, such as ROM (Read-Only Memory), RAM (Random Access Memory), CD-ROM (Compact Disc Read-Only Memory), magnetic tape, floppy disk, and optical data storage device.

[0243] This application also provides a computer-readable storage medium storing at least one piece of program code, which is loaded and executed by a processor to implement the image processing method of any of the above implementations.

[0244] This application also provides a computer program product, which includes at least one piece of program code, which is loaded and executed by a processor to implement the image processing method described in any of the above implementations.

[0245] In some embodiments, the computer program product involved in the present application can be deployed and executed on a computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed in multiple locations and interconnected through a communication network. Multiple computer devices distributed in multiple locations and interconnected through a communication network can form a blockchain system.

[0246] This application provides an image processing method that fuses multiple orthogonal signals from multiple waveform signals to obtain an equivalent vector signal. This makes the equivalent vector signal able to represent the comprehensive change trend of the waveform signal in three dimensions and more accurately reflect the change trend of the waveform signal. Furthermore, the equivalent vector signal is combined with multiple waveform signals to form a new image to reflect the abnormal condition of the abnormal part, which can improve the accuracy of reflecting the abnormal condition of the abnormal part.

[0247] The above are merely optional embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An image processing method, characterized in that, The method includes: A first image of an abnormal region of a target object is acquired. The first image includes multiple waveform signals, each a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal region. Each waveform signal corresponds to an acquisition point and an axis formed by connecting the abnormal region. The multiple waveform signals are multiple lead signals included in a 12-lead electrocardiogram. The multiple waveform signals include multiple first region signals and multiple second region signals. The multiple first region signals are waveform signals corresponding to the frontal plane of the abnormal region, and the multiple second region signals are waveform signals corresponding to the transverse plane of the abnormal region. The frontal plane and the transverse plane are perpendicular to each other. The first region signals include... The system comprises a first standard signal, a second standard signal, a third standard signal, a first pressurized signal, a second pressurized signal, and a third pressurized signal. The first standard signal and the first pressurized signal correspond to the signals of the left upper limb of the target object, the second standard signal and the second pressurized signal correspond to the signals of the right upper limb of the target object, and the third standard signal and the third pressurized signal correspond to the signals of the left lower limb of the target object. The first pressurized signal, the second pressurized signal, and the third pressurized signal are all signals acquired by enhancing the acquisition voltage. The plurality of second part signals include six position signals, which correspond to signals at six different positions on the front chest of the target object. Three orthogonal signals are obtained by acquiring one first part signal corresponding to the forehead and two second part signals corresponding to the horizontal surface, respectively, with the axes of the two second part signals corresponding to the horizontal surface being perpendicular to each other; or, three orthogonal signals are obtained by acquiring two first part signals corresponding to the forehead and one second part signal corresponding to the horizontal surface, respectively, with the axes of the two first part signals corresponding to the forehead being perpendicular to each other. For the three orthogonal signals obtained, the signal value of each orthogonal signal at each sampling time is acquired; for each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of the three orthogonal signals, and the square root of the sum of squares is taken to obtain the vector value at the sampling time; based on each sampling time and the vector value at each sampling time, an equivalent vector signal is generated. The equivalent vector signal is added to the first image to obtain a second image, which is used to reflect the abnormal condition of the abnormal part.

2. The method according to claim 1, characterized in that, The six position signals include a first position signal, a second position signal, a third position signal, a fourth position signal, a fifth position signal, and a sixth position signal; by acquiring one first part signal corresponding to the forehead and two second part signals corresponding to the transverse surface, three orthogonal signals are obtained, including: The third pressurization signal, the second position signal, and the sixth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the second position signal and the sixth position signal are perpendicular to each other; or, The second standard signal, the first position signal, and the fifth position signal are acquired respectively to obtain the three orthogonal signals, wherein the axes of the first position signal and the fifth position signal are perpendicular to each other.

3. The method according to claim 1, characterized in that, The acquisition of the first image of the abnormal part of the target object includes: Obtain the original image of the abnormal area, the original image including multiple original waveform signals; The multiple original waveform signals are filtered and amplified to obtain multiple analog signals; The multiple analog signals are converted from analog to digital to obtain multiple digital signals; The first image is obtained by plotting the one-dimensional waveform corresponding to each digital signal.

4. The method according to claim 1, characterized in that, The method further includes: Based on the second image, the operational status of the abnormal area is determined.

5. The method according to claim 4, characterized in that, Each waveform signal includes multiple waveforms, and determining the operational status of the abnormal part based on the second image includes: Based on the equivalent vector signal, the start and end points of multiple waveforms in each waveform signal are determined; Based on the start and end points of the multiple waveforms, the waveform characteristics of each waveform are determined; Based on the waveform characteristics of the multiple waveform signals, the operating status of the abnormal part is determined.

6. An image processing apparatus, characterized in that, The device includes: The acquisition module is used to acquire a first image of an abnormal part of a target object. The first image includes multiple waveform signals, each waveform signal being a one-dimensional waveform signal obtained by acquiring signals from multiple acquisition points corresponding to the abnormal part. Each waveform signal corresponds to an acquisition point and an axis generated by connecting the abnormal part. The multiple waveform signals are multiple lead signals included in a 12-lead electrocardiogram. The multiple waveform signals include multiple first part signals and multiple second part signals. The multiple first part signals are waveform signals corresponding to the frontal plane of the abnormal part, and the multiple second part signals are waveform signals corresponding to the transverse plane of the abnormal part. The frontal plane and the transverse plane are perpendicular to each other. The signals include a first standard signal, a second standard signal, a third standard signal, a first pressurized signal, a second pressurized signal, and a third pressurized signal. The first standard signal and the first pressurized signal correspond to the signals of the left upper limb of the target object, the second standard signal and the second pressurized signal correspond to the signals of the right upper limb of the target object, and the third standard signal and the third pressurized signal correspond to the signals of the left lower limb of the target object. The first pressurized signal, the second pressurized signal, and the third pressurized signal are all signals acquired by enhancing the acquisition voltage. The plurality of second part signals include six position signals, which correspond to the signals of six different positions on the front chest of the target object. The first determining module is used to acquire a first part signal corresponding to the forehead and two second part signals corresponding to the horizontal surface respectively, to obtain three orthogonal signals, wherein the axes of the two second part signals corresponding to the horizontal surface are perpendicular to each other; or, to acquire two first part signals corresponding to the forehead and one second part signal corresponding to the horizontal surface respectively, to obtain three orthogonal signals, wherein the axes of the two first part signals corresponding to the forehead are perpendicular to each other. The fusion module is used to obtain the signal value of each of the three orthogonal signals at each sampling time; for each sampling time, the squares of the signal values ​​of each orthogonal signal are summed to obtain the sum of squares of the three orthogonal signals, and the square root of the sum of squares is taken to obtain the vector value at the sampling time; based on each sampling time and the vector value at each sampling time, an equivalent vector signal is generated. The generation module is used to add the equivalent vector signal to the first image to obtain a second image, which is used to reflect the abnormal condition of the abnormal part.

7. A computer device, characterized in that, The computer device includes one or more processors and one or more memories, wherein at least one piece of program code is stored in the one or more memories, and the at least one piece of program code is loaded and executed by the one or more processors to implement the image processing method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The storage medium stores at least one piece of program code, which is loaded and executed by a processor to implement the image processing method as described in any one of claims 1 to 5.

Images