A method and system for acquiring feedback signals from a Thermage host.

Abstract

This invention provides a method and system for acquiring feedback signals from a Thermage device, belonging to the field of medical and beauty device technology. The method includes: receiving first image data sent by a camera device; extracting and processing the first image data to obtain at least one second image data; filtering the second image data according to a preset rule to obtain third image data; performing character recognition on the third image data to obtain character data; and deriving the host feedback signal based on the character data. This invention overcomes the technical problem that when the interface of the Thermage device is not open or is damaged, the controller of the robotic arm cannot successfully acquire the feedback signal from the Thermage device. Furthermore, the external camera device in this invention does not affect the user's normal viewing of the host display screen and does not require precise calibration of the installation position and angle, making it easy to use.

Description

Technical Field

[0001] This invention relates to the field of medical and cosmetic device technology, and more specifically, to a method and system for acquiring feedback signals from a Thermage host. Background Technology

[0002] Thermage is a medical aesthetic procedure that can tighten and stretch the skin, and it is highly safe and does not cause wounds. This procedure primarily utilizes radiofrequency heating technology. The tip of the Thermage treatment head is aligned with relevant points on the skin's surface, the Thermage unit is activated to emit radiofrequency energy, and then the treatment head is quickly pressed against the facial skin to create a conductive circuit (the patient's body forms a circuit with the Thermage unit through a conductive adhesive patch). This allows the radiofrequency energy to heat the superficial collagen layer of the skin at the contact point, achieving a physiological stimulation effect.

[0003] When using a Thermage device for marking operations, feedback signals from the Thermage host (such as fault codes, number of markings received, etc.) are required for implementation. However, on the one hand, some Thermage device manufacturers do not provide the corresponding interface for the host, causing the controller of the marking robot arm to be unable to successfully obtain feedback signals from the Thermage host; on the other hand, even if the host interface is open, the interface may be damaged, in which case the controller of the marking robot arm still cannot successfully obtain feedback signals from the Thermage host. Summary of the Invention

[0004] In order to solve the technical problems existing in the background art, the present invention provides a method, system, electronic device and storage medium for obtaining feedback signals of Thermage host.

[0005] The first aspect of the present invention provides a method for obtaining feedback signals from a Thermage host, comprising the following steps:

[0006] Receive the first image data sent by the camera device;

[0007] The first image data is extracted to obtain at least one second image data.

[0008] The second image data is filtered according to preset rules to obtain the third image data;

[0009] Character recognition is performed on the third image data to obtain character data, and the host feedback signal is derived based on the character data.

[0010] Preferably, before receiving the first image data sent by the camera device, the method further includes:

[0011] Determine whether the host feedback signal has been received. If not, then:

[0012] The system generates prompt signals based on the coordinate data of each component of the dotting robot arm and the host display screen in the basic coordinate system;

[0013] The control output device outputs a prompt signal.

[0014] Preferably, the step of extracting the first image data to obtain at least one second image data includes:

[0015] Connected component extraction is performed on the first image data to obtain the contour data of each connected component;

[0016] Calculate the similarity between the contour data of each connected component and the preset contour template data, and use the image data corresponding to the connected component with a similarity greater than or equal to a first threshold as the second image data.

[0017] Preferably, the step of calculating the similarity between the contour data of each connected component and the preset contour template data, and using the image data corresponding to the connected components with a similarity greater than or equal to a first threshold as the second image data, includes:

[0018] Calculate the first similarity between the contour data of the connected component and the preset contour template data. If the largest first similarity is greater than or equal to a first threshold, then the image data corresponding to the connected component is used as the second image data.

[0019] If the largest first similarity is less than the first threshold and greater than or equal to the second threshold, then the contour template data corresponding to the first similarity is deformed using a correction coefficient, and the second similarity between the contour data of the connected component and the deformed contour template data is calculated again; if the second similarity is greater than or equal to the first threshold, then the image data corresponding to the connected component is used as the second image data.

[0020] Preferably, the correction coefficient is determined in the following manner:

[0021] Calculate the first difference between the first threshold and the first similarity, and determine the first correction coefficient based on the first difference;

[0022] Calculate the second difference between the largest first similarity and the other first similarities, and determine the second correction coefficient based on the second difference;

[0023] The correction factor is determined based on the first correction factor and the second correction factor.

[0024] Preferably, the first correction coefficient is negatively correlated with the first difference, and the second correction coefficient is positively correlated with the second difference.

[0025] Preferably, the step of filtering the second image data according to a preset rule to obtain the third image data includes:

[0026] A uniformity analysis is performed on the contour regions of each of the second image data, and the second image data whose uniformity is greater than or equal to a third threshold is determined as the third image data.

[0027] A second aspect of the present invention provides a system for acquiring feedback signals from a Thermage treatment unit. The system includes a processing module, a storage module, and a camera device, wherein the processing module is connected to both the storage module and the camera device; wherein...

[0028] The storage module stores computer programs;

[0029] The camera device is used to capture first image data and send it to each of the processing modules;

[0030] The processing module is used to call the computer program to implement the method described in any of the preceding methods.

[0031] A third aspect of the invention provides a computer storage medium storing a computer program that, when executed by a processor, performs the method described in any of the preceding claims.

[0032] A fourth aspect of the present invention provides an electronic device including a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, performs the method as described in any of the preceding claims.

[0033] In the technical solution of this invention, the solution overcomes the technical problem that when the interface of the Thermage host device is not open to the outside or the interface is damaged, the controller of the dotting robotic arm cannot successfully obtain the feedback signal of the Thermage host. Moreover, the external camera device in this invention will not affect the user's normal viewing of the host display screen, nor does it require precise calibration of the installation position and angle, making it easy to use. Attached Figure Description

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 This is a flowchart illustrating a method for obtaining feedback signals from a Thermage host disclosed in an embodiment of the present invention;

[0036] Figure 2 This is a schematic diagram of the structure of a system for acquiring feedback signals from a Thermage host disclosed in an embodiment of the present invention;

[0037] Figure 3 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention. Detailed Implementation

[0038] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0039] Example 1

[0040] Please see Figure 1 , Figure 1 This is a schematic flowchart illustrating a method for obtaining feedback signals from a Thermage host, as disclosed in an embodiment of the present invention. Figure 1 As shown, an embodiment of the present invention provides a method for obtaining feedback signals from a Thermage host, comprising the following steps:

[0041] Receive the first image data sent by the camera device;

[0042] The first image data is extracted to obtain at least one second image data.

[0043] The second image data is filtered according to preset rules to obtain the third image data;

[0044] Character recognition is performed on the third image data to obtain character data, and the host feedback signal is derived based on the character data.

[0045] In this embodiment of the invention, as described in the background art, when the interface of the Thermage host device is not open to the outside or the interface is damaged, the controller of the Thermage device's dotting robotic arm cannot successfully obtain the feedback signal from the Thermage host, and therefore cannot achieve effective dotting operations. To address this technical problem, this invention provides an external camera device. To avoid the camera device obstructing the user's normal observation of the host display screen, this invention preferably places the camera device on the dotting robotic arm, and the user only needs to adjust the angle of the camera device to roughly align it with the host display screen. During operation, several second image data that may belong to the host display screen can be identified from the first image data captured by the camera device, and then filtered to finally determine the third image data of the host display screen. Character recognition can then be performed to extract the corresponding characters, thereby determining the host's feedback signal. Therefore, the solution of the present invention overcomes the technical problem that when the interface of the Thermage host device is not open to the outside or the interface is damaged, the controller of the dotting robotic arm cannot successfully obtain the feedback signal of the Thermage host device. Moreover, the external camera device in the present invention will not affect the user's normal viewing of the host display screen, nor does it require precise calibration of the installation position and angle, making it easy to use.

[0046] The character recognition can employ any existing OCR recognition technology, which will not be elaborated upon in this invention.

[0047] Understandably, this method can be applied to the controller of a Thermage treatment robotic arm, as well as to a server located remotely. The controller can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components; it can even be other intelligent hardware devices such as smartphones, personal computers, tablets, wearable devices, and intelligent robots. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Data transmission between the server and the processing module can be achieved through appropriate communication methods. The processing module sends the acquired image data to the server, which then processes the data and sends corresponding control commands back to the processing module. For communication methods, wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and other wireless communication solutions can be adopted.

[0048] Preferably, before receiving the first image data sent by the camera device, the method further includes:

[0049] Determine whether the host feedback signal has been received. If not, then:

[0050] The system generates prompt signals based on the coordinate data of each component of the dotting robot arm and the host display screen in the basic coordinate system;

[0051] The control output device outputs a prompt signal.

[0052] In this embodiment of the invention, before or during the marking operation of the Thermage device, the system detects whether a feedback signal from the host computer can be obtained. If no signal is received, the aforementioned scheme of the invention is triggered. Based on the coordinate data of the components of the marking robotic arm and the host display screen in the base coordinate system, a prompt signal can be determined, which may include the optimal installation position and angle of the camera device. The base coordinate system can be a geodetic coordinate system or the coordinate system of the Thermage device / marking robotic arm; the invention does not limit this.

[0053] It should be noted that the output device can be the host display screen, other dedicated display screens, or voice output devices.

[0054] Preferably, the step of extracting the first image data to obtain at least one second image data includes:

[0055] Connected component extraction is performed on the first image data to obtain the contour data of each connected component;

[0056] Calculate the similarity between the contour data of each connected component and the preset contour template data, and use the image data corresponding to the connected component with a similarity greater than or equal to a first threshold as the second image data.

[0057] In this embodiment of the invention, the display screen is generally a specific shape such as square or circle, and rarely has complex irregular shapes. Therefore, this invention pre-establishes several contour template data, and uses the similarity of each connected component in the first image data to filter out several second image data that may be the host display screen.

[0058] The connected component extraction method is a conventional technique in the field of image recognition, and will not be elaborated upon here. Similarity can be calculated using Euclidean distance, Manhattan distance, Hamming distance, etc., and this invention does not impose specific limitations on this method.

[0059] Preferably, the step of calculating the similarity between the contour data of each connected component and the preset contour template data, and using the image data corresponding to the connected components with a similarity greater than or equal to a first threshold as the second image data, includes:

[0060] Calculate the first similarity between the contour data of the connected component and the preset contour template data. If the largest first similarity is greater than or equal to a first threshold, then the image data corresponding to the connected component is used as the second image data.

[0061] If the largest first similarity is less than the first threshold and greater than or equal to the second threshold, then the contour template data corresponding to the first similarity is deformed using a correction coefficient, and the second similarity between the contour data of the connected component and the deformed contour template data is calculated again; if the second similarity is greater than or equal to the first threshold, then the image data corresponding to the connected component is used as the second image data.

[0062] In this embodiment of the invention, the preset contour template data are established by collecting data according to standard angles (e.g., top view) and standard shapes (e.g., standard squares, circles, ellipses, etc.). However, the installation position and angle of the camera device indicated by the output device are only approximate ranges. This leads to a certain degree of distortion in the first image data of the captured host display screen, thereby reducing the first similarity. To address this problem, the present invention further sets a second threshold. Contour template data whose first similarity does not meet the first threshold but still meets the second threshold undergo a certain degree of deformation correction processing, for example, deforming it to resemble the shape of a connected component. Then, the similarity between the connected component and the contour template is recalculated. In this way, the probability of omissions or errors in the identification of host display screen areas caused by non-optimal installation positions and angles of the camera device can be reduced.

[0063] For deformation correction processing, a circle can be deformed into an approximate ellipse, a square into an approximate parallelogram / rhombus, or a segment of the ellipse's contour data can be deleted (to make it appropriately close to the contour of a connected region), and so on. The correction coefficient determines the degree of deformation.

[0064] Preferably, the correction coefficient is determined in the following manner:

[0065] Calculate the first difference between the first threshold and the first similarity, and determine the first correction coefficient based on the first difference;

[0066] Calculate the second difference between the largest first similarity and the other first similarities, and determine the second correction coefficient based on the second difference;

[0067] The correction factor is determined based on the first correction factor and the second correction factor.

[0068] Preferably, the first correction coefficient is negatively correlated with the first difference, and the second correction coefficient is positively correlated with the second difference.

[0069] In this embodiment of the invention, the correction coefficient is determined by combining a first correction coefficient and a second correction coefficient. The first correction coefficient describes the deviation distance between the first threshold and the first similarity. The smaller the deviation distance, the higher the similarity between the contour data of the connected component and the corresponding contour template data (but it may be because other objects have interfered with the key contour, resulting in the failure to reach the first threshold). In this case, a smaller degree of correction is appropriate. Conversely, the higher the deviation distance, the lower the similarity between the contour data of the connected component and the corresponding contour template data. In this case, a larger degree of correction is appropriate (a small correction may not be able to eliminate distortion and interference from other objects). That is, the first correction coefficient is negatively correlated with the first difference.

[0070] The second correction coefficient describes the overall deviation between the contour data of the connected component and other contour template data. A higher overall deviation indicates that the connected component is less likely to be a non-host display screen, and correspondingly, more likely to be a host display screen (possibly due to distortion or occlusion by other objects preventing it from reaching the first threshold). Therefore, the larger the second difference, the larger the second correction coefficient is set, which improves the deformation processing of the contour template data to make it closer in shape to the connected component, thereby overcoming interference from distortion, occlusion by other objects, etc. In other words, the second correction coefficient is positively correlated with the second difference.

[0071] It should be noted that the first and second correction coefficients can each be assigned weights. For example, when the number of preset contour template data is greater than the preset value, if a certain connected component is highly dissimilar to other contour templates, it means that its matching probability with the contour template corresponding to the highest first similarity is higher. In this case, the weight of the second correction coefficient can be set to be greater to increase the confidence ratio of the second correction coefficient. Conversely, the weight of the first correction coefficient can be set to be greater to reduce the confidence ratio of the second correction coefficient.

[0072] Preferably, the step of filtering the second image data according to a preset rule to obtain the third image data includes:

[0073] A uniformity analysis is performed on the contour regions of each of the second image data, and the second image data whose uniformity is greater than or equal to a third threshold is determined as the third image data.

[0074] In this embodiment of the invention, relying solely on the outline shape to identify the host display screen is unreliable, as other components on the Thermage device may also conform to structural features such as square or circular shapes. To address this, the present invention further analyzes the uniformity of the outline regions of each second image data. The determination of uniformity mainly considers dimensional data such as continuity, length, and / or width. For example, the host display screen typically has a black border, and this black border exists continuously at the edge of the host display screen, with its length and / or width being roughly the same. In this case, a comprehensive analysis of the continuity and dimensional data of this black border can be performed to determine its uniformity.

[0075] Example 2

[0076] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a system for acquiring feedback signals from a Thermage host, as disclosed in an embodiment of the present invention. Figure 2 As shown in the figure, an embodiment of the present invention provides a system for acquiring feedback signals from a Thermage host. The system includes a processing module 101, a storage module 102, and a camera device 103. The processing module 101 is connected to the storage module 102 and the camera device 103, respectively.

[0077] The storage module 102 stores a computer program;

[0078] The camera device 103 is used to capture first image data and send it to each of the processing modules 101;

[0079] The processing module 101 is used to call the computer program to implement the method as described in Embodiment 1.

[0080] The specific functions of the Thermage host feedback signal acquisition system in this embodiment are the same as those in Embodiment 1 above. Since the system in this embodiment adopts all the technical solutions of the above embodiments, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be described in detail here.

[0081] Example 3

[0082] Please see Figure 3 , Figure 3 This invention discloses an electronic device comprising: a memory storing executable program code; a processor coupled to the memory; the processor calling the executable program code stored in the memory to execute the method described in Embodiment 1.

[0083] Example 4

[0084] This invention also discloses a computer storage medium storing a computer program, which is executed by a processor as described in Embodiment 1.

[0085] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0086] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0087] In addition, in the various embodiments of the present invention, each functional unit can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0088] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0089] Alternatively, if the integrated units of the present invention are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0090] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for acquiring feedback signals from a Thermage host, characterized in that, The methods and steps include the following: Receive the first image data sent by the camera device; The first image data is extracted to obtain at least one second image data that may belong to the host display screen; The second image data is filtered according to preset rules to obtain the third image data belonging to the host display screen; Character recognition is performed on the third image data to obtain character data, and the host feedback signal is derived based on the character data; The step of extracting and processing the first image data to obtain at least one second image data includes: Connected component extraction is performed on the first image data to obtain the contour data of each connected component; Calculate the similarity between the contour data of each connected component and the preset contour template data, and use the image data corresponding to the connected component with a similarity greater than or equal to a first threshold as the second image data; The step of calculating the similarity between the contour data of each connected component and the preset contour template data, and using the image data corresponding to the connected components with a similarity greater than or equal to a first threshold as the second image data, includes: Calculate the first similarity between the contour data of the connected component and the preset contour template data. If the largest first similarity is greater than or equal to a first threshold, then the image data corresponding to the connected component is used as the second image data. If the largest first similarity is less than the first threshold and greater than or equal to the second threshold, then a correction coefficient is used to deform the contour template data corresponding to the first similarity toward the shape of the corresponding connected component, and the second similarity between the contour data of the connected component and the deformed contour template data is calculated again; if the second similarity is greater than or equal to the first threshold, then the image data corresponding to the connected component is used as the second image data.

2. The method for acquiring feedback signals from a Thermage host according to claim 1, characterized in that: Before receiving the first image data sent by the camera device, the method further includes: Determine whether the host feedback signal has been received. If not, then: The system generates prompt signals based on the coordinate data of each component of the dotting robot arm and the host display screen in the basic coordinate system; The control output device outputs a prompt signal.

3. The method for acquiring feedback signals from a Thermage host according to claim 1, characterized in that: The correction factor is determined in the following manner: Calculate the first difference between the first threshold and the first similarity, and determine the first correction coefficient based on the first difference; Calculate the second difference between the largest first similarity and the other first similarities, and determine the second correction coefficient based on the second difference; The correction factor is determined based on the first correction factor and the second correction factor.

4. The method for obtaining feedback signals from a Thermage host according to claim 3, characterized in that: The first correction coefficient is negatively correlated with the first difference, and the second correction coefficient is positively correlated with the second difference.

5. A method for acquiring feedback signals from a Thermage host according to any one of claims 1-4, characterized in that: The step of filtering the second image data according to a preset rule to obtain the third image data includes: A uniformity analysis is performed on the contour regions of each of the second image data, and the second image data whose uniformity is greater than or equal to a third threshold is determined as the third image data.

6. A system for acquiring feedback signals from a Thermage treatment unit, the system comprising a processing module, a storage module, and a camera device, wherein the processing module is connected to the storage module and the camera device respectively; wherein, The storage module stores computer programs; The camera device is used to capture first image data and send it to each of the processing modules; The characteristic feature is that the processing module is used to call the computer program to implement the method as described in any one of claims 1-5.

7. A computer storage medium storing a computer program, characterized in that: The computer program is executed by the processor to perform the method as described in any one of claims 1-5.

8. An electronic device comprising a processor and a memory, wherein a computer program is stored in the memory, characterized in that: The computer program is executed by the processor to perform the method as described in any one of claims 1-5.

Images