Driving method of height-adjustable biological signal measuring device

Abstract

The driving method of the height-adjustable biological signal measuring device comprises the following steps: identifying inherent information of a user; if the user finishes identification, setting the focus of the image measuring instrument according to the set value; when the focus of the image measuring instrument is set, the image measuring instrument shoots and acquires an image of a user; image data is obtained from shot image data, and an image processing unit preprocesses an image; if the image is pre-processed, the pre-processed image is used for recognizing the face according to the state of the user; after the state and the face of the user are recognized, whether the face of the user is the center of a picture or not is judged; when it is judged that the face of the user is the center of the picture, the position of the terminal is fixed, and biological information of the user is measured; when biological information of a user is measured, a light output unit of a terminal irradiates the face of the user with near-infrared rays, and the biological signal of the user is measured by analyzing an image with an image measuring instrument for the irradiated near-infrared rays.

Description

Technical Field

[0001] The present invention relates to a method for measuring biological signals, and more particularly, to a driving method for a biological signal measuring device that can be adjusted in height according to the height of a user. Background Art

[0002] The most general technique for measuring by photoplethysmography (PPG) using light is a method of analyzing the amount of transmitted light of light irradiated onto the human body, which can be explained by the Lambert-Beer law that the absorbance is proportional to the concentration of the absorbing substance and the thickness of the absorption layer. According to this law, it is derived that the change in transmitted light becomes a signal proportional to the volume change of the transmitted substance, so PPG can be used to grasp the state of the heart, etc. even when the absorbance of the substance is unknown.

[0003] Recently, the technology has further developed from the technology using PPG to the technology using rPPG (remote Photoplethysmography). As the most popular technology for using PPG to grasp signals related to heart pulsation, if a technology is developed to directly irradiate light onto the human body by bringing a device such as a smartphone with a camera and illumination installed nearby into contact with the human body and immediately measure the transmitted light to obtain PPG, recently, people have been continuously researching and developing rPPG-related technologies for grasping the change in blood vessel volume through the signals obtained from the images captured by the camera.

[0004] The technology using rPPG does not require contact between the object and the measuring device, so it can be applied in various ways in devices and places equipped with cameras such as airport immigration management offices and remote medical treatments.

[0005] However, the noise generated by the surrounding light and the movement of the object during the process of using the camera to capture the object has a great impact on the signal in rPPG-related technologies, and it is necessary to develop a technology that can easily move the product and set values for the convenience of users.

[0006] Prior Art Documents

[0007] Patent Documents

[0008] (Patent Document 0001) Korean Patent Publication No. 10-2021-0084400A Summary of the Invention

[0009] (1) Technical Problems to be Solved

[0010] The present invention aims to solve the problems as described above. The object of the present invention is to provide a driving method for a bio-signal measuring device with adjustable height, which automatically adjusts the height according to the user's body length so that the face is located in the center of the camera.

[0011] Moreover, another object of the present invention is to provide a driving method for a bio-signal measuring device with adjustable height, which irradiates the user with a laser of infrared wavelength and an RGB camera, captures the reflected R value and the change of the laser of infrared wavelength as an image, and analyzes the image to measure the user's bio-signal.

[0012] (II) Technical solution

[0013] The driving method for a bio-signal measuring device with adjustable height according to the present invention that can achieve the above object includes the following steps: identifying the user's unique information; if the user is identified, setting the focus of the image measuring instrument with a preset value; if the focus of the image measuring instrument is set, the image measuring instrument captures and obtains the user's image; obtaining image data from the captured image data, and the image processing unit preprocesses the image; if the image is preprocessed, identifying the face according to the preprocessed image based on the user's state; after performing the user state and face recognition processing, determining whether the user's face is the center of the screen; when it is determined that the user's face is the center of the screen, fixing the position of the terminal and measuring the user's bio-information; and when measuring the user's bio-information, the light output unit of the terminal irradiates the user's face with near-infrared rays, and analyzes the image with the image measuring instrument for the irradiated near-infrared rays to measure the user's bio-signal.

[0014] The method for the object identifier to identify the user's unique information can be performed by using at least one of radio frequency identification (RFID), quick response code (QR), bar code, and fingerprint.

[0015] In the step of setting the focus of the image measuring instrument with a preset value, the set focus is a focus setting based on the distance between the terminal and the object to be photographed. The focus setting value based on the distance between the terminal and the object to be photographed is stored in the central server and can be changed according to the installed environment.

[0016] In the step of the image measuring instrument capturing and obtaining the user's image, the image can be captured by the terminal while adjusting the height by moving from the upper end to the lower end of the placement rack.

[0017] The step of obtaining an image from the captured image data and preprocessing the image. In this step, the image preprocessing is a process of transforming the image in the RGB channel into hue saturation value (HSV, H: Hue, S: Saturation, V: Value). For the obtained image, the RGB values and HSV values can be digitized to generate a table.

[0018] Regarding the range of RGB values and HSV values to be obtained, values within a preset range are obtained, which vary according to the user's settings. However, the invention of the present application can obtain the RGB values corresponding to the coordinate positions of the analysis object.

[0019] The step of identifying the user's state and face is as follows: By comparing the data tables of the RGB values and HSV values of a plurality of standard images in which the user's face is at the center of the screen in the central server with the RGB values and HSV values of the obtained image, the user's state and face can be identified.

[0020] The driving method of the adjustable-height biosignal measuring device may include the following steps: The data tables of the RGB values and HSV values of a plurality of standard images in the central server are implemented by the image processing unit. First, a standard image in which the user's face is at the center of the screen is retrieved from the central server and inserted; the inserted RGB-channel image is subjected to HSV transformation; the image area after the HSV transformation is segmented; the RGB values and HSV values corresponding to the analysis object coordinates in the plurality of segmented images are analyzed and digitized in the image processing unit and stored in the central server in the form of a table; the RGB values and HSV values corresponding to the analysis object coordinates of the user image to be analyzed that has undergone image preprocessing are matched in the data matching unit using the data table stored in the central server; when the tables of the RGB values and HSV values of the central server learned as described above and the tables of the RGB values and HSV values of the user image to be analyzed are matched, it is determined whether the image to be processed is matched; and if the image to be processed is matched, the step of fixing the position of the fixed terminal and measuring the user's biological information is executed.

[0021] In the step of segmenting the image area after the HSV transformation, the number of segments can be one of 2, 4, 6, or 8.

[0022] Continuously and repeatedly executing the steps from retrieving the standard image in which the user's face is at the center of the screen from the central server and inserting it to analyzing the image and storing the data, the result data can be accumulated in the central server, learned, and then training data is stored.

[0023] A plurality of the standard images are stored in the central server, and the images can be analyzed sequentially or randomly.

[0024] In the step of matching the RGB values and HSV values of the analysis object coordinates corresponding to the user image to be analyzed that has undergone image pre - processing with the data stored in the central server in the data matching unit, the inherent RGB values and HSV values of the hue of the entire analysis object coordinates can be compared.

[0025] The step of determining whether the image to be processed is matched when matching the table of RGB values and HSV values of the central server learned as described above with the table of RGB values and HSV values of the user image to be analyzed may further include the following steps: if the image to be processed is not matched, matching the values in the first area, second area, and third area among the RGB values and HSV values within the analysis object coordinates.

[0026] The driving method of the adjustable - height biological signal measurement device further includes the following steps: determining whether the area data of the image to be processed is matched when the values of the first area to the third area are matched; and if the area data of the image to be processed is matched, fixing the position of the fixed terminal and measuring the biological information of the user.

[0027] In the step of determining whether the area data of the image to be processed is matched when the values of the first area to the third area are matched, if the area data of the image to be processed is not matched, execute the step of re - obtaining the image of the user from the image measuring instrument.

[0028] (III) Beneficial Effects

[0029] The present invention can adjust the height of the terminal according to the respective heights of the users, thereby reducing the error caused by the image data collection angle, and thus improving the reliability of the result value.

[0030] Moreover, by adjusting the height regardless of the state of the user being photographed, the user's face is located in the center of the image, so that a highly reliable result can be obtained. Brief Description of the Drawings

[0031] Figure 1 It is a composition diagram of an adjustable - height biological signal measurement device according to an embodiment of the present invention.

[0032] Figure 2 It is a sequence diagram of a driving method of an adjustable - height biological signal measurement device according to an embodiment of the present invention.

[0033] Figure 3 It is an illustration of bisecting the area of the HSV - transformed image.

[0034] Figure 4 It is an illustration of quartering the area of the HSV - transformed image.

[0035] Figure 5 It is an illustration diagram of six equal divisions in the field of HSV transformed images.

[0036] Description of Reference Numerals

[0037] 10: Central server 100: Terminal

[0038] 110: Power supply unit 120: Control unit

[0039] 130: Communication unit 141: Object recognizer

[0040] 142: Image measuring instrument 150: Image processing unit

[0041] 160: Data matching unit 170: Fixing unit

[0042] 180: Light output unit 200: Shelf

[0043] 210: Motor drive unit 220: Motor Detailed Description of the Invention

[0044] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains can easily implement it. However, the present invention can be implemented in various different forms, and thus the present invention should not be limited to the embodiments described herein. Also, parts irrelevant to the description in the drawings are omitted for clarity of the present invention, and like elements are denoted by like reference numerals throughout the specification.

[0045] Throughout the specification, when it is mentioned that a certain part is "connected (connected to, in contact with, combined with)" to another part, it means not only the case of "direct connection" but also the case of "indirect connection" with other components intervening therebetween. Also, when it is mentioned that a certain part "includes" other parts, unless otherwise specifically stated to the contrary, it does not exclude other elements but can also include other elements.

[0046] The terms used in this specification are only for describing specific embodiments and are not intended to limit the present invention. Unless clearly distinguishable in the context of the sentence, the singular form also includes the plural case. In this specification, terms such as "including" or "having" only specify the existence of the features, numbers, steps, actions, elements, parts, or combinations thereof described in the specification, and shall not be construed as precluding the existence or additional possibility of one or more other features, numbers, steps, actions, elements, parts, or combinations thereof.

[0047] Hereinafter, with reference to Figure 1 and Figure 2 a driving method of an adjustable-height biological signal measuring device according to an embodiment of the present invention will be described.

[0048] Figure 1 is a component diagram of a bio-signal measurement device with adjustable height according to an embodiment of the present invention, Figure 2 is a sequence diagram of a driving method of a bio-signal measurement device with adjustable height according to an embodiment of the present invention. Figure 3 is a bisecting illustration diagram of the field of HSV-transformed images, Figure 4 is a quartering illustration diagram of the field of HSV-transformed images, Figure 5 is a sextupling illustration diagram of the field of HSV-transformed images.

[0049] Please refer to Figure 1 and Figure 5 , the bio-signal measurement device with adjustable height includes a central server 10, a terminal 100, and a placement rack 200 to which the terminal can be attached.

[0050] The terminal 100 includes: a power supply unit 110 that supplies power after receiving power to enable all operations; a control unit 120 that operates after receiving power from the power supply unit 110 and controls all operations; a communication unit 130 that enables communication to send and receive data with the central server 10; an object identifier 141 that operates after receiving power from the power supply unit 110 and identifies the user's unique information; an image measurer 142 that captures an image of the user shared with the central server 10; an image processing unit 150 that processes the image measured by the image measurer 142; a data matching unit 160 that matches the image processed by the image processing unit 150 with the data of the central server 10; a fixing unit 170 that enables connection with the placement rack 200; and an optical output unit 180 that irradiates the user with near-infrared light.

[0051] The placement rack 200 includes: a fixing member (not shown) that enables connection with the fixing unit 170 of the terminal 100; a motor driving unit 210 that operates under the control of the control unit 120 after receiving power from the power supply unit 110 of the terminal 100; and a motor 220 that operates according to the signal of the motor driving unit 210 to adjust the height of the placement rack.

[0052] The object identifier 141 can identify at least one of radio frequency identification (RFID), quick response code (QR), bar code, and fingerprint, but the present invention is not limited thereto.

[0053] Preferably, the image measurer 142 uses an RGB camera and a thermal imaging camera, but the present invention is not limited thereto.

[0054] The control unit 120 determines whether the user's face in the image measuring instrument 142 is located at the center of the image measuring instrument 142. At this time, the control unit 120 measures the biological signal using the near-infrared light output by the light output unit 180 and the R value in RGB.

[0055] Preferably, the wavelength of the near-infrared laser output by the light output unit 180 is the wavelength of 660 nm and 940 nm, but the present invention is not limited thereto.

[0056] The placement rack 200 may further include a moving member 240 that allows movement. Moreover, if fixation is required instead of movement, a placement rack fixing unit (not shown) that can be fixed to the floor or wall may also be included.

[0057] The method for measuring biological signals with adjustable height first identifies the user's unique information in the terminal 100 by the object identifier 141 (step S100).

[0058] The method for the object identifier 141 to identify the user's unique information may be performed by using at least one of radio frequency identification (RFID), quick response code (QR), bar code, and fingerprint, but the present invention is not limited thereto.

[0059] If the user is identified (step S100), the focus of the image measuring instrument 142 is set with a preset value (step S110). At this time, the set focus is a focus setting based on the distance between the terminal and the photographed object. The focus setting value based on the distance between the terminal and the photographed object is stored in the central server 10 and can be changed according to the installed environment.

[0060] If the focus of the image measuring instrument 142 is set (step S110), the image measuring instrument 142 photographs and acquires the user's image (step S120). At this time, for the photographing of the image, the terminal 100 adjusts the height while photographing while moving from the upper end to the lower end of the placement rack 200. Image data is acquired from the photographed image data, and the image processing unit 150 preprocesses the image (step S130).

[0061] If the image is preprocessed (step S130), the face is recognized based on the preprocessed image according to the user's state (step S140). At this time, in terms of the user's state, face recognition processing continues according to the sitting state, the wheelchair-bound state, the posture based on the bone structure, the standing state, etc. That is, if it is the sitting state, the moving distance of the terminal 100 when moving from the upper end to the lower end of the placement rack 200 will be relatively long, and if it is the standing state, the moving distance of the terminal 100 when moving from the upper end to the lower end of the placement rack 200 will be relatively short.

[0062] After performing the status and face recognition processing of the user, the central server 10 determines whether the face of the user is at the center of the screen (step S150). When it is determined that the face of the user is at the center of the screen, the position of the fixed terminal 100 is fixed and the user's biological information is measured (step S160).

[0063] When measuring the biological information of the user, the light output unit (182) of the terminal 100 irradiates near-infrared light on the face of the user, and the irradiated near-infrared light is analyzed by the image measuring instrument 142 to measure the biological signal of the user.

[0064] The step of obtaining an image from the captured image data and performing pre-processing on the image (step S130). In this step, the image pre-processing is a process of transforming the image of the RGB channel into hue saturation value (HSV, H: Hue, S: Saturation, V: Value). At this time, for the obtained image, the RGB values and HSV values are digitized and a table is generated. At this time, regarding the range of RGB values and HSV values to be obtained, values within a preset range are obtained, which varies according to the user's settings, but the invention of this application obtains the RGB values corresponding to the position of the analysis object coordinate 20.

[0065] In the step of recognizing the user's status and face (step S140), pre-processing is performed by the image processing unit 150, and the status and face of the user are recognized by using the data table of the RGB values and HSV values of the analysis object coordinate 20.

[0066] Before the step of recognizing the user's status and face (step S140), the data table of the RGB values and HSV values of a plurality of standard images in which the face of the user in the central server 10 is at the center of the screen is compared with the data of the RGB values and HSV values of the obtained image to recognize the status and face of the user.

[0067] The data table of the RGB values and HSV values of a plurality of standard images in the central server 10 is implemented by the image processing unit 150. First, the standard image in which the face of the user is at the center of the screen is retrieved from the central server 10 and inserted (step S10), and the inserted RGB channel image is subjected to HSV transformation (step S11).

[0068] At this time, the mathematical formula for transforming from the RBG channel model to the HSV model is as follows.

[0069]

Mathematical formula 1

[0070]

[0071]

[0072]

[0073] Divide the image area of the HSV transformation (step S12). At this time, the number of divisions is one of 2, 4, 6, or 8, but the present invention is not limited thereto.

[0074] Please refer to Figure 3 , the area of the image is divided into a first divided screen 1 and a second divided screen 2, Figure 4 is divided into a first divided screen 1, a second divided screen 2, a third divided screen 3, and a fourth divided screen 4, Figure 5 is divided into a first divided screen 1, a second divided screen 2, a third divided screen 3, a fourth divided screen 4, a fifth divided screen 5, and a sixth divided screen 6. It will vary according to the preset value.

[0075] Analyze and digitize the RGB value and HSV value corresponding to the analysis object coordinate 20 in the plural images with divided areas in the image processing unit 150 and store them in the form of a table in the central server 10 (step S13). At this time, the H value, S value, and V value of the analysis object coordinate 20 in the divided screen are stored in the central server 10.

[0076] Retrieve the standard image with the user's face located at the center of the screen from the central server 10 and insert it (step S10), and continue to repeatedly perform the steps of analyzing the image and storing data (step S13), accumulate the result data in the central server 10 and perform learning, and then store the training data. At this time, there are plural standard images stored in the central server 10, and the images are analyzed sequentially or randomly.

[0077] Using the data table stored in the central server 10, match the RGB value and HSV value corresponding to the analysis object coordinate 20 of the user image to be analyzed that has undergone image preprocessing in the data matching unit 160 (step S15). At this time, compare the inherent RGB value and HSV value of the hue of the entire analysis object coordinate 20. When matching the table of the RGB value and HSV value of the central server 10 learned as described above with the table of the RGB value and HSV value of the user image to be analyzed, determine whether the image to be processed is matched (step S16).

[0078] If the image to be processed is matched, execute the steps of fixing the position of the fixed terminal and measuring the user's biological information (step S160).

[0079] If the image to be processed is not matched, the values in the first area A, the second area B, and the third area C of the RGB value and the HSV value within the matching analysis object coordinates 20 are determined (step S17). At this time, the first area A is designated as the philtrum between the nose and the lips, the second area B is designated as the lips, and the third area C is designated as the chin, but the present invention is not limited thereto.

[0080] When the values of the first area A to the third area C are matched, it is determined whether the area data of the image to be processed is matched (step S18).

[0081] If the area data of the image to be processed is matched, the step of fixing the position of the fixed terminal and measuring the user's biological information is executed (step S160).

[0082] If the area data of the image to be processed is not matched, the step of obtaining the user's image from the image measuring instrument 142 is executed again (step S120).

[0083] The embodiments of the present invention have been described in detail above, but the scope of the rights of the present invention is not limited thereto, and various modifications and improvements implemented by those skilled in the art using the basic concepts of the present invention defined in the claims of the present invention should be construed as belonging to the scope of the rights of the present invention.

Claims

1. A driving method for a biological signal measuring device with adjustable height, characterized in that, Including the following steps: Identify the user's inherent information; If the user is identified, set the focus of the image measuring instrument with a preset value; If the focus of the image measuring instrument is set, the image measuring instrument captures and obtains the user's image; Obtain image data from the captured image data, and the image processing unit pre-processes the image; If the image is pre-processed, identify the face based on the pre-processed image according to the user's state; After performing the user state and face recognition processing, determine whether the user's face is at the center of the screen; When it is determined that the user's face is at the center of the screen, fix the position of the terminal and measure the user's biological information; and, When measuring the user's biological information, the light output unit of the terminal irradiates the user's face with near-infrared rays, and analyzes the image of the irradiated near-infrared rays with the image measuring instrument to measure the user's biological signal.

2. The driving method of the adjustable-height biological signal measuring device according to claim 1, characterized in that The method for the object identifier to identify the user's inherent information uses at least one of radio frequency identification (RFID), quick response code (QR), bar code, and fingerprint for identification.

3. The driving method of the adjustable-height biological signal measuring device according to claim 1, characterized in that In the step of setting the focus of the image measuring instrument with a preset value, the set focus is a focus setting based on the distance between the terminal and the object to be photographed. The focus setting value based on the distance between the terminal and the object to be photographed is stored in the central server and can be changed according to the installed environment.

4. The driving method of the adjustable-height biological signal measuring device according to claim 1, characterized in that In the step of the image measuring instrument capturing and obtaining the user's image, the image is captured while the terminal moves from the upper end to the lower end of the placement rack to adjust the height.

5. The driving method of the adjustable-height biological signal measuring device according to claim 1, characterized in that In the step of obtaining an image from the captured image data and pre-processing the image, in this step, the image pre-processing is a process of transforming the image of the RGB channel into hue saturation value (HSV, H: Hue, S: Saturation, V: Value). For the obtained image, the RGB values and HSV values are digitized and a table is generated.

6. The driving method of the adjustable-height biological signal measuring device according to claim 5, characterized in that Regarding the range of RGB values and HSV values to be obtained, obtain the values within the preset range, which will vary according to the user's settings, but the invention of this application obtains the RGB values corresponding to the coordinate positions of the analysis object.

7. The driving method of the adjustable-height biological signal measuring device according to claim 1, characterized in that The steps of identifying the user's status and face are as follows: Compare the RGB values and HSV values of a plurality of standard images with the user's face at the center of the screen in the central server with the RGB values and HSV values of the acquired image to identify the user's status and face.

8. The driving method of the adjustable-height biological signal measuring device according to claim 7, wherein The steps include: The implementation of the RGB value and HSV value data table for a plurality of standard images in the central server is achieved by the image processing unit. First, the standard image with the user's face at the center of the screen is retrieved from the central server and inserted. Perform HSV transformation on the inserted RGB channel image. Segment the image area after the HSV transformation. Analyze and digitize the RGB values and HSV values corresponding to the analysis object coordinates in the plurality of segmented images in the image processing unit, and store them in the central server in the form of a table. Match the RGB values and HSV values corresponding to the analysis object coordinates of the user image to be analyzed after the image preprocessing using the data table stored in the central server in the data matching unit. When matching the RGB value and HSV value tables of the central server learned as described above with the RGB value and HSV value tables of the user image to be analyzed, determine whether the image to be processed is matched; and, If the image to be processed is matched, perform the steps of fixing the position of the fixed terminal and measuring the user's biological information.

9. The driving method of the adjustable-height biological signal measuring device according to claim 8, characterized in that In the step of segmenting the image area after the HSV transformation, the number of segments is one of 2, 4, 6, and 8.

10. The driving method of the adjustable-height biological signal measuring device according to claim 8, characterized in that Continuously and repeatedly execute the steps from retrieving the standard image with the user's face at the center of the screen from the central server and inserting it to analyzing the image and storing the data, accumulate the result data in the central server, and perform learning and then store the training data.

11. The driving method of the adjustable-height biological signal measuring device according to claim 10, characterized in that A plurality of the standard images are stored in the central server, and the images are analyzed sequentially or randomly.

12. The driving method of the adjustable-height biological signal measuring device according to claim 8, characterized in that In the step of matching the RGB values and HSV values corresponding to the analysis object coordinates of the user image to be analyzed after the image preprocessing using the data table stored in the central server in the data matching unit, compare the inherent RGB values and HSV values of the hues of the entire analysis object coordinates.

13. The driving method of the adjustable-height biological signal measuring device according to claim 8, characterized in that When matching the table of RGB values and HSV values of the central server learned as described above with the table of RGB values and HSV values of the user image to be analyzed, the step of determining whether the image to be processed is matched further includes the following steps, that is, if the image to be processed is not matched, matching the values in the first domain, the second domain, and the third domain among the RGB values and HSV values within the analysis target coordinates.

14. The driving method of the adjustable-height biological signal measuring device according to claim 13, wherein, It further includes the following steps: When the values in the first to third domains are matched, determining whether the domain data of the image to be processed is matched; and, If the domain data of the image to be processed is matched, fixing the position of the fixed terminal and measuring the biological information of the user.

15. The driving method of the adjustable-height biological signal measuring device according to claim 14, characterized in that In the step of determining whether the domain data of the image to be processed is matched when the values in the first to third domains are matched, If the domain data of the image to be processed is not matched, performing the step of re-acquiring the image of the user from the image measuring instrument.

Images