Physiological sign detection method, terminal device and storage medium

Abstract

The present application discloses a physiological sign detection method, terminal device and storage medium, which belongs to the field of physiological detection technology. The method includes: controlling the display screen to display the preview screen of the camera, the preview screen includes the effective working area of ​​the radar, and when the organism moves into the shooting range of the camera, the preview screen about the organism can be intuitively displayed through the display screen to assist in aligning the target part of the organism and improve the alignment efficiency. The effective working area is the mapping of the effective working space of the radar in the preview screen, and the depth range of the effective working space is obtained according to the target working distance and preset offset of the radar. When it is detected that the target part of the organism is not located in the effective working space, a prompt message is issued to prompt the moving position so that the target part is located in the effective working space, and then the physiological signs of the target part are detected. By intuitively displaying the effective working area of ​​the radar, the alignment is assisted, and the efficiency of physiological sign detection is improved.

Description

Technical Field

[0001] The present application relates to the field of physiological detection technology, and in particular to a physiological sign detection method, terminal equipment and storage medium. Background Art

[0002] Radar-type physiological sign detection equipment uses electromagnetic waves as carriers and has the function of detecting human physiological signs, such as breathing, heartbeat, etc. This physiological sign detection equipment can be integrated into terminal equipment, which greatly facilitates people's daily life. However, due to the influence of the beam width of the antenna field of view in the radar, when detecting physiological signs, the best working area of ​​the radar in the physiological sign detection equipment needs to be aligned with the best body detection part of the user, so that the radar works in the best working condition to achieve better detection effect.

[0003] At present, schematic diagrams are usually added to the instructions for use of physiological sign detection devices, which guide users to move the body part to be detected to a specific position in front of the physiological sign detection device when using the physiological sign detection device. However, in actual operation, users do not know whether the body part to be detected has moved to the specific position, making it difficult to achieve correct alignment, resulting in low efficiency of physiological sign detection. Summary of the invention

[0004] The present application provides a physiological sign detection method, terminal device and storage medium, which can improve the physiological sign detection efficiency and user experience. The technical solution is as follows:

[0005] In the first aspect, a physiological sign detection method is provided, which is applied to a terminal device, the terminal device is integrated with a physiological sign detection function, the terminal device includes a radar and a camera, the distance between the camera and the receiving antenna and the transmitting antenna in the radar is less than a first preset distance, the overlapping area between the receiving antenna and the transmitting antenna is the effective working area of ​​the radar, the camera, the receiving antenna and the transmitting antenna are set within a certain range, that is, the distance between them is close enough, so that the field of view angle range of the camera can cover the effective working area of ​​the radar. The terminal device includes a display screen (for example, a mobile phone, a TV, etc.) or the terminal device is connected to the display screen. The method includes: controlling the display screen to display a preview screen of the camera, the preview screen includes the effective working area of ​​the radar, when the creature moves into the shooting range of the camera, the preview screen about the creature can be intuitively displayed through the display screen to assist in aligning the target part of the creature (the best body detection part) and improve the alignment efficiency. The effective working area is the mapping of the effective working space of the radar in the preview screen, and the depth range of the effective working space is obtained according to the target working distance and preset offset of the radar, wherein the target working distance indicates the distance between the spatial point and the radar when the performance parameters of the radar meet the preset indicators in the free space. The target working distance is the attribute of the radar itself, and the preset offset is added to provide redundancy for the position of the spatial point. Since the effective working space is constructed according to the effective working area and the depth range, it is possible to determine whether the organism is located in the effective working space by detecting whether the imaging of the organism in the preview screen is within the effective working area and whether the organism is within the depth range. When it is detected from the preview screen that the target part of the organism is not located in the effective working space, a prompt message is issued; the prompt message is used to prompt the moving position so that the target part is located in the effective working space. Until the target part is detected to be located in the effective working space, the physiological signs of the target part are detected. By intuitively displaying the effective working area of ​​the radar, the optimal detection part (i.e., the target part) of the organism is assisted to align with the radar, thereby improving the efficiency of physiological sign detection and the user experience. In this way, the radar also works in the best working condition, which improves the accuracy of physiological sign detection.

[0006] It should be noted that the process of judging whether the target part of the organism is located in the effective workspace provided by the embodiment of the present application runs through the entire detection process and is a periodically refreshed process. That is to say, in the process of detecting the physiological signs of the target part, the target part of the organism is continuously detected to see whether it is located in the effective workspace. Before the detection is completed, if it is detected that the target part of the organism is not located in the effective workspace, a prompt message is continuously issued to prompt the target part to move to the effective workspace until the target part is detected to be located in the effective workspace, and the physiological signs of the target part are continuously detected until the detection is completed.

[0007] In a possible implementation, the target part of the organism can be guided into the effective working space in the following manner. When it is detected that the target part of the organism in the preview screen is not located in the effective working area, a first prompt message is issued; the first prompt message is used to prompt the moving position so that the target part is located in the effective working area. After the first prompt message is issued, the moved target part continues to be identified according to the preview screen to obtain the position information of the moved target part in the preview screen; until it is determined that the moved target part is located in the effective working area according to the position information after the move and the position of the effective working area in the display screen. The preview screen of the organism can be intuitively displayed through the display screen, and the first prompt message issued in a loop can assist the organism to align with the target part as quickly as possible, thereby improving the alignment efficiency.

[0008] Then the distance between the organism and the radar is detected. If the distance is outside the depth range, a second prompt message is issued; the second prompt message is used to prompt the organism to move away from or close to the radar so that the organism moves into the depth range. After the second prompt message is issued, the distance between the moved organism and the radar continues to be detected until the moved organism is in the depth range. By detecting the distance to determine whether the organism exceeds the depth range, and adding the second prompt message issued in a loop, the organism can be assisted to move into the depth range as soon as possible, thereby improving the alignment efficiency. In the preview screen, when the target part is located in the effective working area and the distance between the organism and the radar is in the depth range, it is determined that the target part is located in the effective working space, and then the physiological signs are detected. Compared with the guidance method without feedback in the schematic diagram, by displaying the effective working area and distance prompts, guiding in steps and giving feedback in time, and repeatedly adjusting the position of the organism, the efficiency of physiological sign detection and the user experience are effectively improved. In this way, the radar also works in the best working condition, which improves the accuracy of physiological sign detection.

[0009] In a possible implementation, the depth range is within the interval formed by the minimum limit value and the maximum limit value of the radar, the maximum limit value is greater than the upper limit value of the depth range, and the minimum limit value is less than the lower limit value of the depth range. The second prompt information includes approach prompt information, distance prompt information and fine-tuning prompt information; the above process of judging whether the distance is outside the depth range can be implemented in the following way. When the distance is greater than the maximum limit value of the radar, it means that the distance is too far and needs to be moved significantly. Approach prompt information is issued to prompt the organism to approach the radar by a first distance so that the organism moves into the depth range. The first distance is the difference between the distance and the maximum limit value; when the distance is less than the minimum limit value of the radar, it means that the distance is too close and needs to be moved significantly. Distance prompt information is issued to prompt the organism to move away from the radar by a second distance so that the organism moves into the depth range. The second distance is the difference between the minimum limit value and the distance. When the distance is greater than or equal to the minimum limit value and less than or equal to the lower limit value of the depth range; or, when the distance is greater than or equal to the upper limit value of the depth range and less than or equal to the maximum limit value, it means that the creature is close to the depth range and does not need to move significantly, and a fine-tuning prompt message is issued. The fine-tuning prompt message is used to prompt the creature to move slightly forward or backward (that is, move slightly) to move the creature into the depth range.

[0010] In the embodiment of the present application, the organism is guided to move into the depth range step by step through approach prompt information, distance prompt information and fine-tuning prompt information, and the amplitude of each movement (for example, the first distance, the second distance, slightly moving forward or backward) is prompted, and feedback is given in time to achieve rapid movement, thereby effectively improving the efficiency of physiological sign detection and user experience.

[0011] In a possible implementation, the first radiation area of ​​the receiving antenna, the second radiation area of ​​the transmitting antenna, and the field of view angle range of the camera are obtained, and the radiation area of ​​the antenna is the radiation direction area where the antenna gain meets the performance requirements. Since the radar needs to be able to receive the signal when detecting physiological signs, the overlapping area between the first radiation area of ​​the receiving antenna and the second radiation area of ​​the transmitting antenna is used as the effective space area, and the field of view angle range covers the effective space area to guide the position of the organism. The field of view angle range and the overlapping area are three-dimensional spaces, and the target working distance of the radar indicates the distance between the position where the radar detection accuracy meets the requirements and the position (that is, the distance between the spatial point and the radar when the performance parameters of the radar meet the preset indicators in the free space). According to the target working distance, a two-dimensional plane is determined in the field of view angle range and the overlapping area, and the position proportion of the overlapping area in the field of view angle range is determined in the two-dimensional plane. The image display area in the display screen is divided according to the position proportion and the resolution of the display screen (that is, the resolution of the image display area in the display screen), that is, the overlapping area is mapped to the display screen to obtain the effective working area of ​​the radar, wherein the image display area indicates the area when the preview screen is displayed in full screen. The effective working area of ​​the radar is displayed on the display screen. In this way, with the help of the camera preview picture, the user can intuitively see whether he is in the effective working area, thereby assisting in aligning the user's target part and improving alignment efficiency.

[0012] In a possible implementation, the position ratio includes a horizontal position ratio and a vertical position ratio. The above step of determining the position ratio of the overlapping area in the field of view angle range can be implemented in the following manner. A two-dimensional plane is determined in the field of view angle range according to the target working distance, the two-dimensional plane is perpendicular to the optical axis of the camera, wherein the optical axis of the camera represents a line perpendicular to the camera, and the two-dimensional plane includes a horizontal direction and a vertical direction, and the horizontal component and the vertical component of the field of view angle range on the two-dimensional plane are determined. According to the above two-dimensional plane, the first component in the horizontal direction and the second component in the vertical direction of the overlapping area on the two-dimensional plane are determined. Since the field of view angle range includes the overlapping area, the first component is a part of the horizontal component and the second component is a part of the vertical component. The first component divides the horizontal component into three sections, which sequentially include a first boundary distance corresponding to the first end of the horizontal component to the first end of the first component, a first component, and a second boundary distance corresponding to the second end of the horizontal component from the second end of the first component; the second component divides the vertical component into three sections, which sequentially include a third boundary distance corresponding to the first end of the vertical component to the first end of the second component, a second component, and a fourth boundary distance corresponding to the second end of the second component from the second end of the second component to the second end of the vertical component. The horizontal position ratio is calculated according to the first boundary distance, the first component and the second boundary distance, which includes a first ratio corresponding to the first boundary distance, a second ratio corresponding to the first component and a third ratio corresponding to the second boundary distance. Similarly, the vertical position ratio is calculated according to the third boundary distance, the second component and the fourth boundary distance, which includes a fourth ratio corresponding to the third boundary distance, a fifth ratio corresponding to the second component and a sixth ratio corresponding to the fourth boundary distance.

[0013] In the embodiment of the present application, the two-dimensional plane perpendicular to the optical axis is determined by the target working distance, and then the components of the field of view angle range and the overlapping area on the two-dimensional plane are determined respectively, and the horizontal position ratio of the overlapping area in the field of view angle range is determined in the horizontal direction, and the vertical position ratio of the overlapping area in the field of view angle range is determined in the vertical direction. The position ratio reflects the position ratio relationship between the overlapping area and the field of view angle range, so that the overlapping area can be mapped to the display screen according to the position ratio to obtain the effective working area of ​​the radar. The effective working area is displayed on the display screen to assist in aligning the target part of the organism and improve the alignment efficiency.

[0014] In a possible implementation, after determining the position ratio, the working area determined according to the position and the resolution of the display screen is used as the initial working area of ​​the radar, and then the effective working area of ​​the radar is determined based on the initial working area of ​​the radar. In one implementation, the initial working area of ​​the radar is used as the effective working area of ​​the radar to improve the efficiency of determining the effective working area; in another implementation, the effective working area of ​​the radar is obtained after adjusting the initial working area of ​​the radar to improve the accuracy of the effective working area.

[0015] In a possible implementation, the resolution of the display screen includes a horizontal resolution and a vertical resolution. The horizontal resolution (i.e., the horizontal resolution of the image display area in the display screen) indicates the number of pixels that can be displayed in the horizontal direction of the image display area; the vertical resolution (i.e., the vertical resolution of the image display area in the display screen) indicates the number of pixels that can be displayed in the vertical direction of the image display area. The above-mentioned step of mapping the overlapping area to the display screen according to the position ratio to obtain the effective working area of ​​the radar can be implemented in the following manner. The number of pixels displayed in the horizontal direction is divided into three parts according to the first ratio, the second ratio and the third ratio. The first part includes the product of the first ratio and the number of pixels in the horizontal direction, the second part includes the product of the second ratio and the number of pixels in the horizontal direction, and the third part includes the product of the third ratio and the number of pixels in the horizontal direction. In this way, the two endpoints of the second part are used as two horizontal boundary points. Similarly, the number of pixels displayed in the vertical direction is divided into three parts according to the fourth ratio, the fifth ratio, and the sixth ratio. The first part includes the product of the fourth ratio and the number of pixels in the vertical direction, the second part includes the product of the fifth ratio and the number of pixels in the horizontal direction, and the third part includes the product of the sixth ratio and the number of pixels in the vertical direction. In this way, the two endpoints of the second part are used as two vertical boundary points. The effective working area is constructed according to the two horizontal boundary points and the two vertical boundary points.

[0016] In the embodiment of the present application, according to the first ratio, the second ratio, the third ratio and the horizontal resolution in the horizontal direction, the fourth ratio, the fifth ratio, the sixth ratio and the vertical resolution in the vertical direction, the overlapping area is mapped to the display screen, and the effective working area of ​​the radar can be obtained. Then, the effective working area is displayed on the display screen to assist in aligning the target part of the organism and improve the alignment efficiency.

[0017] In a possible implementation, the process of determining the effective working area according to the initial working area can be implemented in the following manner. The initial working area is expanded according to the position information of the initial working area in the preview screen to obtain a candidate working area in the preview screen, and the initial working area is enclosed in the candidate working area. At the working distance from the radar target, an object is moved in the horizontal direction and the vertical direction of the preview screen respectively. When the object moves into the candidate working area, multiple signal-to-noise ratios of the radar are recorded. The multiple signal-to-noise ratios are compared with the preset signal-to-noise ratio. The larger the signal-to-noise ratio, the better the performance of the radar. Based on this, the candidate working area is adjusted according to the relationship between the signal-to-noise ratio and the preset signal-to-noise ratio to obtain the effective working area. The effective working area is obtained by adjusting the initial working area, which improves the accuracy of the effective working area.

[0018] In a possible implementation, at the target working distance of the radar, an object is moved along the horizontal direction of the preview screen (from the first side to the second side of the preview screen, the first side and the second side are parallel) so that the vertical distance between the moving track of the object and the radar is the target working distance, and the first signal-to-noise ratio of each of the multiple points of the radar is recorded. Similarly, at the target working distance of the radar, an object is moved along the vertical direction of the preview screen (from the third side to the fourth side of the preview screen, the third side and the fourth side are parallel) so that the vertical distance between the moving track of the object and the radar is the target working distance, and the second signal-to-noise ratio of each of the multiple points is recorded. A first point close to the first side and having a signal-to-noise ratio greater than a preset signal-to-noise ratio is determined in the first signal-to-noise ratio of each of the multiple points; a second point close to the second side and having a signal-to-noise ratio greater than a preset signal-to-noise ratio is determined in the first signal-to-noise ratio of each of the multiple points. Similarly, a third point close to the third side and having a signal-to-noise ratio greater than a preset signal-to-noise ratio is determined in the second signal-to-noise ratio of each of the multiple points; a fourth point close to the fourth side and having a signal-to-noise ratio greater than a preset signal-to-noise ratio is determined in the second signal-to-noise ratio of each of the multiple points. The functions of the first point, the second point, the third point and the fourth point are the same as those of the two vertical boundary points mentioned above, and they are all important boundary points that constitute the effective working area.

[0019] In the embodiment of the present application, the object is moved along the preview screen at a distance from the radar target working distance, so as to screen out points with a signal-to-noise ratio greater than a preset value, and the first point, the second point, the third point and the fourth point constituting the area are selected from these points, and the effective working area of ​​the radar is constructed based on the four points. Then, the effective working area is displayed on the display screen to assist in aligning the target part of the organism and improve the alignment efficiency.

[0020] In a possible implementation, the distance between the organism and the radar can be obtained through the following example.

[0021] Example 1: A creature is displayed in the preview screen, and the creature is imaged through the camera to obtain an image containing the creature. The image can be identified by using the biometric recognition function to identify the creature and obtain the plane coordinates of the creature in the image. The distance dot map detected by the radar includes the three-dimensional coordinates of multiple three-dimensional points, and the three-dimensional coordinates include two-dimensional coordinates and depth coordinates. According to the two-dimensional coordinates of each three-dimensional point, a three-dimensional point that matches the plane coordinates of the creature is selected, so that at least one three-dimensional point can be selected in the distance dot map, and the distance between the creature and the radar can be determined according to the depth coordinates of at least one three-dimensional point.

[0022] In the embodiment of the present application, there are not only living things but also other objects in the physiological sign detection scene. The radar can measure the distance between the object and the radar sensor, but it cannot distinguish which points are living things. By recognizing the image captured by the camera, the plane coordinates of the living thing can be identified, but the distance of the living thing cannot be obtained. Based on this, according to the plane coordinates of the living thing detected by the camera, combined with the distance dot matrix of the radar, the distance between the living thing and the radar can be obtained, which improves the accuracy of distance detection.

[0023] Example 2: Set the physiological sign detection scene, for example, in an empty room, the distance between other objects and the radar should be far enough, that is, the preview screen includes the organism and the background, and the background is far enough from the radar so that there are no other interfering objects between the organism and the radar. In this way, the distance between the organism and the radar can be determined using the distance dot matrix detected by the radar. The radar's distance dot matrix includes multiple three-dimensional points, each of which includes two-dimensional coordinates and depth coordinates. The minimum depth coordinate value is determined from the radar's distance dot matrix. Since the background is far enough from the radar, the point corresponding to the minimum depth coordinate value is the point where the organism is located. Based on this, the minimum depth coordinate value is used as the distance between the organism and the radar. Alternatively, after finding the depth coordinate value, find one or more other candidate depth coordinates, the difference between these candidate depth coordinates and the minimum depth coordinate value is less than the preset difference, and the point corresponding to the candidate depth coordinate is also the point where the organism is located. Any depth coordinate in the candidate depth coordinates is used as the distance between the organism and the radar, or the minimum depth coordinate value and the average of the candidate depth coordinates are used as the distance between the organism and the radar.

[0024] Usually, the radar can detect several points that represent organisms. The depth coordinates in the distance dot map are arranged in ascending order, and the first depth coordinate (that is, the minimum depth coordinate) is directly taken as the distance between the organism and the radar, which improves the detection efficiency of the distance. Alternatively, the average of the first few depth coordinates with similar depths is taken as the distance between the organism and the radar, which improves the accuracy of distance detection.

[0025] Example 3: The distance dot map of the radar can not only detect the three-dimensional coordinates of the three-dimensional points, but also the motion information of the three-dimensional points. These motion information can reflect the regular movement of the parts of the organism. Based on this, at least one three-dimensional point whose motion information meets the requirements of regular motion is determined in the distance dot map of the radar; any depth coordinate of the depth coordinate of at least one three-dimensional point is used as the distance between the organism and the radar, or the average of the depth coordinates of at least one three-dimensional point is used as the distance between the organism and the radar. Based on the physiological signs that distinguish organisms from other objects, the motion information of the three-dimensional points can be detected to distinguish the organism from other objects, and the distance between the organism and the radar can be obtained, which increases the diversity and efficiency of distance detection.

[0026] In a possible implementation, whether the target part is located in the effective working area can be determined in the following manner. A creature is displayed in the preview screen, and the creature is imaged by a camera to obtain an image containing the creature. The target part of the creature can be identified by using the biometric recognition function to identify the image, and the position information of the target part in the image can be obtained. The preview screen is displayed on the display screen, and the preview screen includes the effective working area. According to the position information of the target part in the preview screen and the position of the effective working area in the display screen (i.e., the preview screen), it can be determined whether the target part is located in the effective working area, thereby obtaining the position relationship between the target part and the effective working area, and the position relationship is that the target part is located in the effective working area or the target part is not located in the effective working area. The judgment process of whether the target part is located in the effective working area is converted into the position relationship between the imaging position of the target part in the preview screen and the effective working area, and in the scene where the user faces the display screen, the user can also intuitively see whether the target part is located in the effective working area, thereby improving the accuracy and intuitiveness of the judgment result.

[0027] In a possible implementation, the area of ​​the effective working area is proportional to the area of ​​the preview screen. When the preview screen is not displayed in full screen, the area of ​​the preview screen is reduced, and the effective working area of ​​the radar is reduced according to the size of the preview screen. The preview screen can be at any position in the display screen, and the display position of the effective working area in the display screen is adjusted according to the relative position between the effective working area and the preview screen and the position of the preview screen in the display screen. Then, the effective working area after the size and display position are adjusted is displayed on the display screen.

[0028] For a terminal device that can rotate, the display screen rotates when the terminal device rotates. When the display screen rotates, the display position of the effective working area in the display screen is rotated in the same manner according to the relative position between the effective working area and the preview screen and the position of the preview screen in the display screen. Then, the effective working area after rotation is displayed on the display screen.

[0029] By adjusting the rotation, size and display position, the physiological sign detection method can be adapted to different user needs, increasing the diversity and richness of physiological sign detection scenarios.

[0030] In a second aspect, a terminal device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, a physiological sign detection method as described in the first aspect or any one of the implementations of the first aspect is implemented.

[0031] In a third aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer executes the physiological sign detection method involved in the first aspect or any one of the implementations of the first aspect.

[0032] In a fourth aspect, an embodiment of the present application provides a chip system, which can be applied to a terminal device. The chip system includes one or more processors, which are used to call computer instructions so that the terminal device executes the physiological sign detection method described in the first aspect or any one of the implementation methods of the first aspect.

[0033] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the physiological sign detection method described in the first aspect or any one of the implementations of the first aspect.

[0034] The technical effects obtained by the above-mentioned second, third, fourth and fifth aspects are similar to the technical effects obtained by the corresponding technical means in the above-mentioned first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a schematic diagram of a device usage instruction provided in an embodiment of the present application;

[0036] Figure 2 This is a schematic diagram of the positions of a radar and a camera in a mobile phone provided in an embodiment of the present application;

[0037] Figure 3 This is a schematic diagram of the positions of a radar and a camera in a television provided in an embodiment of the present application;

[0038] Figure 4 is a schematic diagram of the radiation direction of an antenna in a radar provided in an embodiment of the present application;

[0039] Figure 5 It is a structural diagram of a terminal device provided in an embodiment of the present application;

[0040] Figure 6 is a block diagram of a software system of a terminal device provided in an embodiment of the present application;

[0041] Figure 7 This is a schematic diagram of the viewing angles of a radar and a camera in a mobile phone provided in an embodiment of the present application;

[0042] Figure 8 is a schematic diagram of an optimal working area of ​​a radar in the horizontal direction provided by an embodiment of the present application;

[0043] Fig. 9 This is a schematic diagram of an optimal working area of ​​a radar in the vertical direction provided by an embodiment of the present application;

[0044] Fig.10 This is a schematic diagram of an optimal working area prompt on a display screen provided in an embodiment of the present application;

[0045] Fig.11 This is a schematic diagram of reducing the display area of ​​the best working area on a display screen provided by an embodiment of the present application;

[0046] Fig.12 is a schematic diagram of a display screen provided in an embodiment of the present application showing a rotating optimal working area;

[0047] Fig.13 is a schematic diagram of a physiological sign detection scenario provided in an embodiment of the present application;

[0048] Fig.14 is a flow chart of a physiological sign detection method provided in an embodiment of the present application;

[0049] Fig.15 is a flow chart of an auxiliary alignment method of a terminal device provided in an embodiment of the present application;

[0050] Fig.16 An exemplary flow chart of an interactive method for physiological sign detection provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0052] It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of this application, the words "first" and "second" are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not limit them to be different.

[0053] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0054] The physiological sign detection method provided in the embodiment of the present application can be applied to terminal devices, including radars and cameras, and the terminal devices include but are not limited to mobile phones, mobile phones, folding phones, smart wearable devices, tablet computers (portable android devices, PADs), personal computers (personal computers, PCs), handheld computers, netbooks, laptops, desktops, portable computers, handheld computers, wireless terminal devices, smart home devices, smart TVs, communication devices, digital broadcast receivers, personal digital assistants (personal digital assistants, PDAs), portable multimedia players (portable media player, PMPs), ultra-mobile personal computers (ultra-mobile personal computers, UMPCs), virtual reality devices and other electronic devices with physiological sign detection functions. The embodiment of the present application does not limit the specific type of the terminal device.

[0055] The radar in the embodiment of the present application may be a millimeter wave radar, an ultra wide band (UWB) radar, a laser radar, etc., which is not limited by the embodiment of the present application. The radar usually includes one or more non-omnidirectional antennas, which can be functionally divided into a transmitting antenna and a receiving antenna. The overlapping area of ​​the radiation area of ​​the transmitting antenna and the radiation area of ​​the receiving antenna serves as the effective working area of ​​the radar. The camera may be a wide-angle camera or an ultra-wide-angle camera so that the field of view angle range of the camera can cover the overlapping area.

[0056] When the terminal device is performing physiological sign detection, it has high requirements for the signal-to-noise ratio of the radar received signal. Therefore, in order to obtain better detection results, the user needs to be in the effective working area. The effective working area is the optimal detection range, that is, the optimal radiation range of the antenna or the highest gain range.

[0057] Currently, schematic diagrams are added to the instructions for use of physiological sign detection in terminal devices to guide users to place the best body detection part (usually the chest) in the correct position, such as Figure 1 As shown, Figure 1 is a schematic diagram of a device usage description provided in an embodiment of the present application. Taking the terminal device as a mobile phone as an example, Figure 1 Mobile phones have the function of detecting physiological signs. The transmitting antenna and receiving antenna of the radar are located at the bottom of the mobile phone. Its optimal working area (i.e., effective working area) is about 90 degrees, and it is emitted from the bottom. Therefore, the chest of the human body needs to be located in the optimal working area to achieve a better detection effect. However, the mobile phone cannot give users an intuitive display, and users cannot intuitively understand the optimal radiation range of the antenna, and do not know whether they are in the optimal radiation range. In addition, with different antenna designs and installation angles, the shape and position of the optimal radiation range will also vary greatly, making it difficult to efficiently guide users to complete physiological sign detection.

[0058] Based on the above-mentioned problem of low efficiency in physiological sign detection, an embodiment of the present application provides a terminal device, in which the antenna in the radar can be located at any position of the terminal device, but the position needs to have a camera or can be covered by the field of view of other cameras. Taking the terminal device as a mobile phone as an example, the mobile phone has a front-view camera and a rear-view camera, and the antenna can be located on the back shell or front of the mobile phone. The antenna located on the front can be located at the top or bottom of the mobile phone, or the antenna can be located inside the screen as a screen antenna, which does not affect the normal use of the screen. The antenna located on the back shell such as Figure 2 As shown, Figure 2 This is a schematic diagram of the positions of a radar and a camera in a mobile phone provided in an embodiment of the present application. Figure 2 Figure A in the figure shows a UWB radar in a mobile phone. The UWB radar can use two patch antennas, or a frame antenna and a patch antenna. Figure 2 Figure B shows the millimeter wave radar in a mobile phone, which includes a 1-transmitter and 3-receiver (1T3R) antenna unit.

[0059] For example, if the terminal device is a TV, a device for detecting physiological signs is integrated in the TV, and the display screen of the TV is used to guide the user to locate in the effective working space of the device. Figure 3 As shown, Figure 3 The diagram is a schematic diagram of the positions of radar and camera in a TV provided in an embodiment of the present application. The TV is integrated with a UWB radar or a millimeter wave radar, and a camera, which can be a wide-angle camera or an ultra-wide-angle camera. Figure 3 The figure shows a millimeter wave radar, which may include 1 transmit and 3 receive antenna units. The distance between the antenna and the camera in the radar is much smaller than the distance between the human body and the radar to ensure the accuracy of the effective working space.

[0060] Of course, the above Figure 3 The device for detecting physiological signs function can also be an independent device connected to a television or other device with a display screen, and the television or other device is used to guide the user to be located in the effective working space of the device.

[0061] The antenna in the radar is usually a patch antenna, which is a non-omnidirectional antenna, such as Figure 4 As shown, Figure 4 It is a schematic diagram of the radiation direction of an antenna in a radar provided in an embodiment of the present application. Figure 4 The radiation pattern of the patch antenna in the UWB radar is shown in Figure 4 middle x , y , z represents the spatial coordinate, and dbi represents the gain intensity of the patch antenna. Figure 4 It can be seen that the antenna field of view of the radar has a certain beam width, and the radiation intensity is strong in some areas, that is, the gain is high. These areas are regarded as the effective working area of ​​the radar, and the radar can achieve the best working state in the effective working area. Based on this, when detecting physiological signs, it is necessary to guide the user to be in this area to improve the accuracy of the detection results.

[0062] Based on the problem of low efficiency of physiological sign detection mentioned above, an embodiment of the present application provides a physiological physical examination detection method, which is applied to a terminal device, the terminal device is integrated with a physiological sign detection function, the terminal device includes a radar and a camera, the distance between the camera and the receiving antenna and the transmitting antenna in the radar is less than the first preset distance, the camera, the receiving antenna and the transmitting antenna are set within a certain range, that is, the distance between each other is close enough, so that the field of view angle range of the camera can cover the effective working area of ​​the radar (that is, the overlapping area between the receiving antenna and the transmitting antenna). The terminal device includes a display screen (that is, the display screen is integrated in the terminal device) or the terminal device is connected to the display screen (that is, the terminal device is an independent device with a physiological sign detection function). The display screen is controlled to display a preview screen of the camera, and the preview screen includes the effective working area of ​​the radar. When the organism moves into the shooting range of the camera, the preview screen about the organism can be intuitively displayed through the display screen to assist in aligning the target part of the organism and improve the alignment efficiency. The effective working area is the mapping of the effective working space of the radar in the preview screen, and the depth range of the effective working space is obtained according to the target working distance of the radar and the preset offset, wherein the target working distance indicates the distance between the spatial point and the radar when the performance parameters of the radar meet the preset indicators in the free space. Since the effective working space is constructed according to the effective working area and the depth range, it is possible to determine whether the organism is located in the effective working space by detecting whether the imaging of the organism in the preview screen is within the effective working area and whether the organism is within the depth range. If it is detected according to the preview screen that the target part of the organism is not located in the effective working space, a prompt message is issued; the prompt message is used to prompt the moving position so that the target part is located in the effective working space. Until the target part is detected to be located in the effective working space, the physiological signs of the target part are detected. By intuitively displaying the effective working area of ​​the radar, the target part of the organism is assisted to align with the radar, thereby improving the efficiency of physiological sign detection and user experience.

[0063] Before explaining in detail the physiological sign detection method provided in the embodiment of the present application, the terminal device involved in the embodiment of the present application is first explained.

[0064] Figure 5 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. Figure 5The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0065] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0066] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0067] The controller may be the nerve center and command center of the terminal device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0068] The processor 110 may also be provided with a memory for storing instructions and data.

[0069] In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0070] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0071] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0072] In some embodiments, antenna 1 of terminal device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that terminal device 100 can communicate with the network and other devices through wireless communication technology.

[0073] The terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0074] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicrOLED, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is an integer greater than 1.

[0075] The terminal device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0076] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0077] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is an integer greater than 1.

[0078] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0079] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0080] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created by the terminal device 100 during use (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0081] The terminal device 100 can implement audio functions, such as music playback, recording, etc., through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D and the application processor.

[0082] The distance sensor 180F is used to measure the distance. The terminal device 100 can measure the distance by infrared or laser. In some embodiments, in a shooting scene, the terminal device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0083] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the terminal device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The terminal device 100 can support 1 or N SIM card interfaces, where N is an integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0084] Next, the software system of the terminal device 100 will be described.

[0085] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software system of the terminal device 100.

[0086] Figure 6 1 is a block diagram of a software system of a terminal device 100 provided in an embodiment of the present application. Figure 6 The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, the Android runtime (Android Runtime) and the system layer, and the kernel layer.

[0087] The application layer can include a series of application packages. Figure 6 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and other applications. The application layer may also include a physiological sign detection application. The user may click or touch the application icon of the physiological sign detection application to open the physiological sign detection application. The user may also open the physiological sign detection application through a physical button (e.g., a remote control). After the physiological sign detection application is started, the physiological sign detection application calls the camera to shoot, and then calls the display screen to display the preview screen of the camera, which includes the effective working area of ​​the radar.

[0088] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 6 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make these data accessible to applications. These data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build the display interface of the application, and the display interface can be composed of one or more views, for example, including a view for displaying a text message notification icon, including a view for displaying text, and including a view for displaying pictures. The phone manager is used to provide communication functions of the terminal device 100, such as management of call status (including connecting, hanging up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, such as a notification of an application running in the background. The notification manager can also be a notification that appears on the screen in the form of a dialog window, such as a text message in the status bar, a reminder sound, an electronic device vibrating, an indicator light flashing, etc.

[0089] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system. The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0090] The system library can include multiple functional modules, such as: surface manager, media library, 3D graphics processing library (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc. The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0091] The system library also includes an algorithm engine, which is used to obtain the preview image captured by the camera and the distance between the organism detected by the radar and the radar, and execute the physiological sign detection method provided in the embodiment of the present application based on the preview image and distance obtained above.

[0092] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, radar driver, and display driver.

[0093] The hardware layer includes cameras, radars, and displays.

[0094] In this application, by calling the hardware interface in the application framework layer, the connection between the application layer above the application framework layer, the system library below the application framework layer, the kernel layer and the hardware layer can be realized to realize data transmission and processing.

[0095] The following is an illustrative description of the software and hardware workflow of the terminal device 100 in conjunction with the capture and photo shooting scene.

[0096] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the raw input event. For example, if the touch operation is a single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer, starts the camera application, and then calls the kernel layer to start the camera driver to capture static images or videos through the camera 193.

[0097] Combine the following Figure 7-Figure 9 The effective working area of ​​the radar in the embodiment of the present application is described.

[0098] In the embodiment of the present application, the effective working area of ​​the radar can be determined through the following two examples.

[0099] Example 1: Obtain the first radiation area of ​​the receiving antenna, the second radiation area of ​​the transmitting antenna, and the field of view angle range of the camera. The radiation area of ​​the antenna is the radiation direction area where the antenna gain meets the performance requirements, which can also be called the field of view (FOV) of the antenna. The radiation area of ​​the antenna can be obtained by simulation. The field of view angle range of the camera can be obtained through the working parameters of the camera. Since the radar needs to be able to receive the signal when detecting physiological signs, the overlapping part between the radiation area of ​​the receiving antenna and the transmitting antenna (that is, the overlapping area between the first radiation area and the second radiation area) is used as the effective space area. The field of view angle range covers the effective space area to guide the position of the organism so that the organism is located in the effective space area. According to the field of view angle range, the target working distance of the radar, and the overlapping area, the position proportion of the overlapping area in the field of view angle range is determined. The field of view angle range and the overlapping area are three-dimensional space. The target working distance of the radar indicates the distance between the position where the radar detection accuracy reaches the requirement and the position. According to the target working distance, a two-dimensional plane is determined in the field of view angle range and the overlapping area, and the position proportion of the overlapping area in the field of view angle range is determined in the two-dimensional plane. The effective working area of ​​the radar is determined according to the position ratio and the resolution of the display screen (i.e., the resolution of the image display area on the display screen). The image display area on the display screen is divided according to the position ratio and the resolution of the display screen, that is, the overlapping area is mapped to the display screen to obtain the effective working area of ​​the radar.

[0100] Among them, since it is highly likely that not all of the display screen is used to display a preview screen, there will be display frames such as control bars at the top and bottom of the display screen. Therefore, the resolution of the display screen should refer to the resolution of the camera preview image on the display screen, that is, a part of the display screen is used to display the image, and this area is called the image display area. The resolution of the display screen indicates the resolution of the image display area. Similarly, the horizontal resolution of the display screen indicates the horizontal resolution of the image display area, and the vertical resolution of the display screen indicates the vertical resolution of the image display area.

[0101] Taking the human body as an example, the effective working area of ​​the radar can be displayed on the display screen. In this way, with the help of the camera preview screen, the user can intuitively see whether he is in the effective working area, thereby assisting in aligning the user's target part (the best body detection part) and improving alignment efficiency.

[0102] The above-mentioned step of determining the position proportion of the overlapping area in the field of view angle range can be achieved in the following manner. According to the field of view angle range and the target working distance of the radar, determine the horizontal component of the field of view angle range in the horizontal direction and the vertical component in the vertical direction at the target working distance; that is, determine a two-dimensional plane in the field of view angle range according to the target working distance, the two-dimensional plane is perpendicular to the optical axis of the camera, and the two-dimensional plane includes a horizontal direction and a vertical direction, and determine the horizontal component and vertical component of the field of view angle range on the two-dimensional plane. According to the overlapping area and the target working distance of the radar, determine the first component of the overlapping area in the horizontal direction and the second component in the vertical direction at the target working distance; that is, according to the above-mentioned two-dimensional plane, determine the first component and the second component of the overlapping area on the two-dimensional plane. Since the field of view angle range includes the overlapping area, the first component is part of the horizontal component and the second component is part of the vertical component. The first component divides the horizontal component into three sections, including the first boundary distance corresponding to the first end of the horizontal component to the first end of the first component, the first component, and the second boundary distance corresponding to the second end of the horizontal component; the second component divides the vertical component into three sections, including the third boundary distance corresponding to the first end of the vertical component to the first end of the second component, the second component, and the fourth boundary distance corresponding to the second end of the vertical component. The horizontal position ratio is calculated according to the first boundary distance, the first component, and the second boundary distance. For example, the first boundary distance, the first component, and the second boundary distance are respectively divided by the horizontal component (that is, the sum of the first boundary distance, the first component, and the second boundary distance) to obtain the first ratio, the second ratio, and the third ratio. The horizontal position ratio includes the first ratio, the second ratio, and the third ratio. The vertical position ratio is calculated according to the third boundary distance, the second component, and the fourth boundary distance. For example, the third boundary distance, the second component, and the fourth boundary distance are respectively divided by the vertical component to obtain the fourth ratio, the fifth ratio, and the sixth ratio. The vertical position ratio includes the fourth ratio, the fifth ratio, and the sixth ratio. The position ratio of the overlapping area in the field of view angle range includes a horizontal position ratio and a vertical position ratio.

[0103] It should be noted that the sum of the first ratio, the second ratio and the third ratio is 1, and the sum of the fourth ratio, the fifth ratio and the sixth ratio is 1. Therefore, any two of the first ratio, the second ratio and the third ratio can be selected as the horizontal position ratio, and any two of the fourth ratio, the fifth ratio and the sixth ratio can be selected as the vertical position ratio.

[0104] In the embodiment of the present application, the two-dimensional plane perpendicular to the optical axis is determined by the target working distance, and then the components of the field of view angle range and the overlapping area on the two-dimensional plane are determined respectively. The horizontal position ratio of the overlapping area in the field of view angle range is determined in the horizontal direction, and the vertical position ratio of the overlapping area in the field of view angle range is determined in the vertical direction. The position ratio includes the horizontal position ratio and the vertical position. The position ratio reflects the position ratio relationship between the overlapping area and the field of view angle range, so that the overlapping area can be mapped to the display screen according to the position ratio to obtain the effective working area of ​​the radar. The effective working area is displayed on the display screen to assist in aligning the target part of the organism (the best body detection part) and improve the alignment efficiency.

[0105] For example, Figure 7 As shown, Figure 7 is a schematic diagram of the viewing angles of a radar and a camera in a mobile phone provided in an embodiment of the present application, Figure 7 In this example, the terminal device is a mobile phone and the radar is a UWB radar. The mobile phone includes a camera and a radar. The radar includes two patch antennas: a receiving antenna and a transmitting antenna, which are located on both sides of the camera. The overlapping radiation area between the receiving antenna and the transmitting antenna is the effective area, that is, the overlapping part of the FOV of the radar's transmitting antenna and the receiving antenna is taken as the radar's optimal working area (that is, the radar's effective working area). Figure 7 It can be seen that the camera's field of view angle range (i.e., antenna field of view angle) can cover the effective area and provide visual cues for the radar's alignment.

[0106] Based on the above Figure 7 ,like Figure 8 As shown, Figure 8 It is a schematic diagram of an optimal working area of ​​a radar in the horizontal direction provided by an embodiment of the present application. The field of view (FOV) of the antenna indicates the radiation direction area where the antenna gain meets the performance requirements. Figure 8 The FOV of the transmitting antenna, receiving antenna and camera in the horizontal direction (horizontal, h) are shown in FIG. Figure 8The target working distance of the radar, i.e. the optimal working distance L_opt, is also shown. Based on the target working distance (L_opt), the field of view of the transmitting antenna, receiving antenna and camera are quantified. The field of view of the camera in the horizontal direction (L_cam_h) can cover the horizontal overlapping area of ​​the transmitting antenna and the receiving antenna (i.e., the overlapping horizontal field of view L_camant_h). The horizontal overlapping area (L_camant_h) is also the first component. The horizontal overlapping area divides the field of view of the camera (L_cam_h) into three sections: the first boundary distance (L_camleft_h), the first component (L_camant_h), and the second boundary distance (L_camright_h). L_cam_h is equal to the sum of L_camleft_h, L_camant_h and L_camright_h. Based on L_camleft_h, L_camant_h, L_camright_h and L_cam_h, the horizontal position ratio of the overlapping area in the field of view angle range can be calculated, including a first ratio (L_camleft_h / L_cam_h), a second ratio (L_camant_h / L_cam_h), and a third ratio (L_camright_h / L_cam_h).

[0107] Based on the above Figure 7 ,like Fig. 9 As shown, Fig. 9 This is a schematic diagram of an optimal working area of ​​a radar in the vertical direction provided by an embodiment of the present application; Fig. 9 The vertical (v) field of view of the transmitting antenna, receiving antenna, and camera are shown in Fig. Fig. 9The target working distance of the radar, i.e., the optimal working distance L_opt, is also shown in FIG. Based on the target working distance (L_opt), the field of view of the transmitting antenna, receiving antenna, and camera is quantified. The field of view of the camera in the vertical direction (L_cam_v) can cover the vertical overlapping area of ​​the transmitting antenna and the receiving antenna (i.e., the overlapping vertical field of view L_camant_v). The vertical overlapping area (L_camant_v) is also the second component. The vertical overlapping area divides the field of view of the camera (L_cam_v) into three sections: the third boundary distance (L_camup_v), the second component (L_camant_v), and the fourth boundary distance (L_camdown_v). L_cam_v is equal to the sum of L_camup_v, L_camant_v, and L_camdown_v. Based on L_camup_v, L_camant_v, L_camdown_v and L_cam_v, the vertical position ratio of the overlapping area in the field of view angle range can be calculated, including a fourth ratio (L_camup_v / L_cam_v), a fifth ratio (L_camant_v / L_cam_v), and a sixth ratio (L_camdown_v / L_cam_v).

[0108] Since the target working distance of the radar is much larger than the physical distance between the antenna and the camera, it can be approximated by Figure 8 The horizontal overlap area (L_camant_h) is determined in the manner shown, using Fig. 9 The illustrated method determines the vertical overlapping area (L_camant_v), and uses the rectangular area formed by L_camant_h and L_camant_v as the optimal working area for human detection (ie, the effective working area of ​​the radar).

[0109] It should be noted that, ideally, Figure 7 and Figure 8 When the vertices of the three triangles are grouped as one point (for example, the center positions of the radar and the camera are consistent), no matter what the target working distance of the radar is, the calculated position proportion of the overlapping area in the field of view angle range is the same. In the embodiment of the present application, the distance between the camera and the radar is set close enough, that is, the distance between the camera and the receiving antenna and the transmitting antenna in the radar is less than the first preset distance, so that the radiation starting points of the camera, the receiving antenna and the transmitting antenna are approximately at the same position, and the vertices of the three triangles are basically grouped as one point. In this way, it can be ensured that the position proportion will not vary greatly with the change of the target working distance.

[0110] The resolution of the display screen includes horizontal resolution and vertical resolution. The horizontal resolution (i.e., the horizontal resolution of the image display area in the display screen) is also called horizontal clarity, indicating the number of pixels that can be displayed in the horizontal direction of the image display area; the vertical resolution (i.e., the vertical resolution of the image display area in the display screen) is also called vertical clarity, indicating the number of pixels that can be displayed in the vertical direction of the image display area. The above-mentioned step of mapping the overlapping area to the display screen according to the position ratio to obtain the effective working area of ​​the radar can be implemented in the following manner. According to the first ratio, the second ratio, the third ratio and the horizontal resolution, the horizontal frame of the display screen is divided into three segments, and the two endpoints of the middle segment of the three segments are used as two horizontal boundary points. That is, according to the first ratio, the second ratio and the third ratio, the number of pixels displayed in the horizontal direction is divided into three parts, the first part includes the product of the first ratio and the number of pixels in the horizontal direction, the second part includes the product of the second ratio and the number of pixels in the horizontal direction, and the third part includes the product of the third ratio and the number of pixels in the horizontal direction. In this way, the intersection of the first part and the second part and the intersection of the second part and the third part are used as two horizontal boundary points.

[0111] Similarly, according to the fourth ratio, the fifth ratio, the sixth ratio and the vertical resolution, the vertical frame of the display screen is divided into three segments, and the two endpoints of the middle segment of the three segments are used as two vertical boundary points. That is, according to the fourth ratio, the fifth ratio and the sixth ratio, the number of pixels displayed in the vertical direction is divided into three parts, the first part includes the product of the fourth ratio and the number of pixels in the vertical direction, the second part includes the product of the fifth ratio and the number of pixels in the horizontal direction, and the third part includes the product of the sixth ratio and the number of pixels in the vertical direction. In this way, the intersection point of the first part and the second part and the intersection point of the second part and the third part are used as two vertical boundary points.

[0112] Then, according to the two horizontal boundary points and the two vertical boundary points, the effective working area of ​​the radar is determined. In one implementation, two horizontal lines are drawn along the two horizontal boundary points, and two vertical lines are drawn along the two vertical boundary points, and the two lines intersect to obtain a rectangle, and the rectangle is used as the effective working area of ​​the radar. In another implementation, the two horizontal boundary points and the two vertical boundary points are connected in sequence to obtain a rhombus, and the rhombus is used as the effective working area of ​​the radar. In another implementation, since the field of view angle range of the camera and the overlapping area of ​​the antenna are theoretically a sphere or ellipsoid, the effective working area of ​​the radar should be an ellipse or a circle in theory. Based on this, an ellipse is constructed according to the two horizontal boundary points and the two vertical boundary points, and the ellipse is used as the effective working area of ​​the radar. Whether it is a rectangle, a rhombus or an ellipse, it can reflect the center position of the effective working area. When aiming at the target part of the organism, the target part is usually located at the center of the effective working area, not at the edge. Therefore, the shape of the effective working area can be rich and varied, as long as the important boundary points can be indicated, for example, two horizontal boundary points and two vertical boundary points.

[0113] In the embodiment of the present application, according to the first ratio, the second ratio, the third ratio and the horizontal resolution in the horizontal direction, the fourth ratio, the fifth ratio, the sixth ratio and the vertical resolution in the vertical direction, the overlapping area is mapped to the display screen, and the effective working area of ​​the radar can be obtained. Then, the effective working area is displayed on the display screen to assist in aligning the target part of the organism (the best body detection part) and improve the alignment efficiency.

[0114] For example, Fig.10 As shown, Fig.10 is a schematic diagram of an optimal working area prompt on a display screen provided in an embodiment of the present application, Fig.10The screen preview of the terminal device is shown in . Taking the complete display of the preview screen on the display screen as an example, the overlapping area is mapped to the display screen according to the position ratio (including the horizontal position ratio and the vertical position ratio) obtained above. According to the first ratio (L_camleft_h / L_cam_h), the second ratio (L_camant_h / L_cam_h), the third ratio (L_camright_h / L_cam_h) and the horizontal resolution, the horizontal frame of the display screen is divided into three sections: horizontal resolution × L_camleft_h / L_cam_h, horizontal resolution × L_camant_h / L_cam_h, horizontal resolution × L_camright_h / L_cam_h. According to the fourth ratio (L_camup_v / L_cam_v), the fifth ratio (L_camant_v / L_cam_v), the sixth ratio (L_camdown_v / L_cam_v) and the vertical resolution, the vertical frame of the display screen is divided into three sections: vertical resolution × L_camup_v / L_cam_v, vertical resolution × L_camant_v / L_cam_v, vertical resolution × L_camdown_v / L_cam_v. In this way, the effective working area of ​​the radar can be obtained, such as Fig.10 Take the target part of the creature as the upper body of a person as an example. Fig.10 A prompt may also be displayed in the dotted frame: Please try to keep your upper body completely within the dotted frame to ensure the best measurement accuracy, to remind the user to move left and right to move the target part into the dotted frame.

[0115] For example, the resolution of the camera preview on the display screen is Resolution_h×Resolution_v, that is, the horizontal resolution is Resolution_h and the vertical resolution is Resolution_v. In this way, the length of the effective working area of ​​the radar is Resolution_h×L_camleft_h / L_cam_h, and the width is Resolution_v×L_camant_v / L_cam_v.

[0116] It should be noted that the preview image of the camera has been processed by the corresponding algorithm, and the preview scene is consistent with the actual scene. Fig.10 As shown, the image processor has pre-processed the effects of inversion, mirroring, stretching and distortion during the camera imaging process.

[0117] After determining the position ratio, the working area determined according to the position and the resolution of the display screen (i.e., the resolution of the image display area in the display screen) is used as the initial working area of ​​the radar, and then the effective working area of ​​the radar is determined according to the initial working area of ​​the radar. In one implementation, the initial working area of ​​the radar is used as the effective working area of ​​the radar, that is, the radiation area of ​​the antenna is obtained by simulating the receiving antenna and the transmitting antenna. Since the radiation area of ​​the antenna and the field of view angle range of the camera are both theoretical values, they can represent the working characteristics. Therefore, the effective working area is determined directly according to the position ratio of the overlapping area between the radiation area of ​​the receiving antenna and the transmitting antenna in the field of view angle range of the camera, and the resolution of the display screen. It is no longer necessary to adjust the signal-to-noise ratio to meet the accuracy of the effective working area, thereby improving the efficiency of determining the effective working area; in another implementation, after adjusting the initial working area of ​​the radar, the effective working area of ​​the radar is obtained, thereby improving the accuracy of the effective working area. The adjustment process of the initial working area of ​​the radar is described below. The initial working area is expanded according to the position information of the initial working area in the preview screen. The edge of the initial working area can be extended outward by several pixels (for example, 3, 5, 10, etc.) to obtain the candidate working area in the preview screen. The initial working area is surrounded by the candidate working area, and the area of ​​the candidate working area is slightly larger than the area of ​​the initial working area. At the working distance from the radar target, an object is moved along the horizontal direction and the vertical direction of the preview screen respectively. When the object moves into the candidate working area, multiple signal-to-noise ratios of the radar are recorded, that is, multiple signal-to-noise ratios of the radar are obtained during the movement of the object in the candidate working area in the preview screen. The multiple signal-to-noise ratios are compared with the preset signal-to-noise ratio. The larger the signal-to-noise ratio, the better the performance of the radar. Based on this, the candidate working area is adjusted according to the relationship between the signal-to-noise ratio and the preset signal-to-noise ratio to obtain the effective working area. For example, find the points where the signal-to-noise ratio is greater than the preset signal-to-noise ratio, and the area formed by these points is used as the effective working area. By adjusting the initial working area, the accuracy of the effective working area is improved.

[0118] The preset signal-to-noise ratio can be appropriately set by those skilled in the art according to actual conditions, as long as it can characterize the performance of the radar and meet the requirements. For example, if the preset signal-to-noise ratio is set to be larger, the area of ​​the effective working area will be reduced accordingly, thereby increasing the accuracy of the effective working area; if the preset signal-to-noise ratio is set to be smaller, the area of ​​the effective working area will be reduced accordingly, thereby increasing the comprehensiveness of the effective working area.

[0119] Example 2: At the target working distance of the radar, move an object along the horizontal direction of the preview screen (from the first side to the second side of the preview screen, the first side and the second side are parallel) so that the vertical distance between the moving track of the object and the radar is the target working distance, and record the first signal-to-noise ratio of each of the multiple points of the radar. At the target working distance of the radar, move an object along the vertical direction of the preview screen (from the third side to the fourth side of the preview screen, the third side and the fourth side are parallel) so that the vertical distance between the moving track of the object and the radar is the target working distance, and record the second signal-to-noise ratio of each of the multiple points of the radar.

[0120] Taking the first side as the left side of the preview screen and the second side as the right side of the preview screen as an example, a first point close to the left side and greater than the preset signal-to-noise ratio is determined in the first signal-to-noise ratio of each of the multiple points; a second point close to the right side and greater than the preset signal-to-noise ratio is determined in the first signal-to-noise ratio of each of the multiple points. In other words, multiple points greater than the preset signal-to-noise ratio are determined in the first signal-to-noise ratio of each of the multiple points. There are many points greater than the preset signal-to-noise ratio. Here, the first point close to the leftmost side and the second point close to the rightmost side are determined in the multiple points. The functions of the first point and the second point are the same as those of the two horizontal boundary points mentioned above, and they are both important boundary points constituting the effective working area.

[0121] Taking the third side as the upper side of the preview screen and the fourth side as the lower side of the preview screen as an example, a third point close to the upper side and greater than the preset signal-to-noise ratio is determined in the second signal-to-noise ratio of each of the multiple points; a fourth point close to the lower side and greater than the preset signal-to-noise ratio is determined in the second signal-to-noise ratio of each of the multiple points. In other words, multiple points greater than the preset signal-to-noise ratio are determined in the second signal-to-noise ratio of each of the multiple points. There are many points greater than the preset signal-to-noise ratio. Here, the third point close to the uppermost side and the fourth point close to the lowermost side are determined in the multiple points. The role of the third point and the fourth point is the same as that of the above-mentioned two vertical boundary points, and they are both important boundary points constituting the effective working area.

[0122] Then, according to the first point, the second point, the third point and the fourth point, the effective working area of ​​the radar is determined. In one implementation, two horizontal lines are drawn along the first point and the second point, and two vertical lines are drawn along the third point and the fourth point, and the two lines intersect to obtain a rectangle, and the rectangle is used as the effective working area of ​​the radar. In another implementation, the first point, the second point, the third point and the fourth point are connected in sequence to obtain a rhombus, and the rhombus is used as the effective working area of ​​the radar. In another implementation, an ellipse is constructed according to the first point, the second point, the third point and the fourth point, and the ellipse is used as the effective working area of ​​the radar.

[0123] It should be noted that, in the embodiment of the present application, multiple points having a signal-to-noise ratio greater than a preset signal-to-noise ratio can be determined from the first signal-to-noise ratio of each of the multiple points and the second signal-to-noise ratio of each of the multiple points, and the area formed by these points can be used as the effective working area of ​​the radar.

[0124] In the embodiment of the present application, the object is moved along the preview screen at a distance from the radar target working distance, so as to screen out points with a signal-to-noise ratio greater than a preset value, and the area formed by these points is used as the effective working area of ​​the radar, or four points (i.e., the first point, the second point, the third point, and the fourth point) constituting the area are selected from these points, and the effective working area of ​​the radar is constructed according to the four points. This example does not require the antenna to be simulated to obtain its radiation area, which improves the efficiency of determining the effective working area. The effective working area is then displayed on the display screen to assist in aligning the target part of the organism (the best body detection part) and improve the alignment efficiency.

[0125] After determining the effective working area of ​​the radar through the above example 1 or example 2, turn on the physiological sign detection function, and display the effective working area on the display screen. The area of ​​the effective working area is proportional to the area of ​​the preview screen. When the preview screen is not displayed in full screen, the area of ​​the preview screen is reduced, and the effective working area of ​​the radar is reduced according to the size of the preview screen. The preview screen can be at any position on the display screen. According to the relative position between the effective working area and the preview screen and the position of the preview screen on the display screen, the display position of the effective working area on the display screen is adjusted. Then the effective working area after the size and display position are adjusted is displayed on the display screen.

[0126] For example, Fig.11 As shown, Fig.11 is a schematic diagram of reducing the display area of ​​the best working area on a display screen provided by an embodiment of the present application, such as Fig.11 As shown in Figure A, the display screen fully displays the preview screen. The size and position of the effective working area in the preview screen are calculated according to the position ratio and the resolution of the display screen (including horizontal resolution and vertical resolution). Please refer to the above Fig.10 Based on the description in Fig.11 In Figure A, reduce the preview screen by half, such as Fig.11As shown in Figure B, the size of the effective working area in the preview screen is also reduced by half, and the position of the effective working area is also changed. For example, the effective working area is horizontally resolved × L_camleft_h / L_cam_h / 2 from the left side of the preview screen, and horizontally resolved × L_camright_h / L_cam_h / 2 from the right side of the preview screen. The effective working area is vertically resolved × L_camup_v / L_cam_v / 2 from the top of the preview screen, and vertically resolved × L_camdown_v / L_cam_v / 2 from the bottom of the preview screen. The length of the effective working area is horizontally resolved × L_camant_h / L_cam_h / 2, and the width is vertically resolved × L_camant_v / L_cam_v / 2.

[0127] By adjusting the size and display position, the physiological sign detection method can be adapted to different user needs, increasing the diversity and richness of physiological sign detection scenarios.

[0128] For a terminal device that can rotate (for example, a mobile phone), the display screen rotates when the terminal device rotates. When the display screen rotates, the display position of the effective working area in the display screen is rotated in the same manner according to the relative position between the effective working area and the preview screen and the position of the preview screen in the display screen. The effective working area after rotation is then displayed on the display screen.

[0129] For example, as shown in 12, Fig.12 is a schematic diagram of a display screen provided in an embodiment of the present application that displays an optimal working area in rotation, compared with Fig.10 When the terminal device rotates 90°, the effective working area (i.e., the optimal working area) also rotates, and the relative position between the effective working area and the display screen remains unchanged, but the person in the preview screen is Fig.10 The position and movement of the person in the video are consistent and will not rotate accordingly. In other words, whether the terminal device is placed in landscape or portrait orientation, the optimal position marking area (i.e., the effective working area) is the same.

[0130] Through rotation, the physiological sign detection method can be adapted to different user needs, thereby increasing the diversity and richness of physiological sign detection scenarios.

[0131] The following is an explanation of the distance between the organism and the radar in the embodiment of the present application.

[0132] In the embodiment of the present application, the distance between the organism and the radar can be detected through the following three examples.

[0133] Example 1: Identify the organism based on the preview image to obtain the plane coordinates of the organism; determine at least one three-dimensional point corresponding to the plane coordinates in the radar's distance dot map; determine the distance between the organism and the radar based on the depth coordinates of the at least one three-dimensional point.

[0134] In the embodiment of the present application, a creature is displayed in the preview screen, and the creature is imaged by a camera to obtain an image containing the creature. The image can be identified by using a biometric recognition function (for example, a portrait recognition model, a human upper body recognition model, etc.), and the creature can be identified and shown in the form of a target frame, so as to obtain the coordinates of the creature in the image (i.e., plane coordinates). The radar can detect multiple three-dimensional points, which are shown in the form of a distance dot matrix. The distance dot matrix includes the three-dimensional coordinates of multiple three-dimensional points, and the three-dimensional coordinates include two-dimensional coordinates and depth coordinates. According to the two-dimensional coordinates of each three-dimensional point, a three-dimensional point matching the plane coordinates of the creature is selected. For example, the three-dimensional point falls within the plane coordinates of the creature, and the three-dimensional point represents the creature. By analogy, at least one three-dimensional point can be selected in the distance dot matrix, and the depth coordinate of any three-dimensional point can be used as the distance between the creature and the radar, or the mean of the depth coordinates of at least one three-dimensional point can be used as the distance between the creature and the radar, or the maximum or minimum value of the depth coordinates of at least one three-dimensional point can be used as the distance between the creature and the radar, and so on. The embodiment of the present application is not limited to this.

[0135] In the embodiment of the present application, in the physiological sign detection scene, there will be not only living things, but also other objects, such as stools, sofas, coffee tables, beds, vases and other sundries. The radar can measure the distance between the object and the radar sensor, but it cannot distinguish which points are living things. By recognizing the image captured by the camera, the plane coordinates (including horizontal position coordinates and vertical position coordinates) of the living thing can be identified, but the distance of the living thing cannot be obtained. That is, recognizing the preview image captured by the camera can assist in determining the horizontal position coordinates and vertical position coordinates of the living thing, that is, the plane coordinates (P_h, P_v). Based on this, according to the plane coordinates (P_h, P_v) of the living thing detected by the camera, combined with the distance dot matrix of the radar, the distance P_distance between the living thing and the radar can be obtained, thereby improving the accuracy of distance detection.

[0136] Example 2: Set the physiological sign detection scene, for example, in an empty room, the distance between other objects and the radar should be far enough, that is, the preview screen includes the organism and the background, the distance between the background and the radar is greater than the second preset distance, and the background is far away from the radar, that is, the background and the radar are far enough. Among them, the second preset distance can be appropriately set by those skilled in the art according to the actual situation. Exemplarily, the second preset distance is much larger than the target working distance, for example, it is 1.5 times, 2 times, 3 times, etc. of the target working distance, so that there are no other interfering objects between the organism and the radar. In this way, the distance dot matrix detected by the radar can be used to determine the distance between the organism and the radar. The distance dot matrix of the radar includes multiple three-dimensional points, each of which includes two-dimensional coordinates and depth coordinates. The minimum depth coordinate value is determined from the distance dot matrix of the radar. Since the background is far enough from the radar, the point corresponding to the minimum depth coordinate value is the point where the organism is located. Based on this, the minimum depth coordinate value is used as the distance between the organism and the radar. Alternatively, after finding the depth coordinate value, find one or more other candidate depth coordinates, the difference between these candidate depth coordinates and the minimum depth coordinate value is less than the preset difference, and the point corresponding to the candidate depth coordinate is also the point where the organism is located. Any depth coordinate among the candidate depth coordinates is used as the distance between the organism and the radar, or the minimum depth coordinate value and the average of the candidate depth coordinates are used as the distance between the organism and the radar.

[0137] For example, Fig.13 Show, Fig.13 It is a schematic diagram of a physiological sign detection scenario provided in an embodiment of the present application. In this physiological sign detection scenario, a person and a background are included. The distance between the background and the radar is far enough, which can be an empty room. In this way, there are no other interfering objects between the person and the radar. The distance between the person and the radar can be detected using the distance dot matrix.

[0138] Usually, the radar can detect several points that represent organisms. The depth coordinates in the distance dot map are arranged in ascending order, and the first depth coordinate (that is, the minimum depth coordinate) is directly taken as the distance between the organism and the radar, which improves the detection efficiency of the distance. Alternatively, the average of the first few depth coordinates with similar depths is taken as the distance between the organism and the radar, which improves the accuracy of distance detection.

[0139] Example 3: The distance dot map of the radar can not only detect the three-dimensional coordinates of the three-dimensional point (including two-dimensional coordinates and depth coordinates), but also the motion information of the three-dimensional point. These motion information can reflect the regular motion of the parts of the organism, such as heartbeat, breathing, micro-movement, etc. Based on this, at least one three-dimensional point whose motion information meets the requirements of regular motion is determined in the distance dot map of the radar; any depth coordinate of the depth coordinate of at least one three-dimensional point is used as the distance between the organism and the radar, or the mean of the depth coordinate of at least one three-dimensional point is used as the distance between the organism and the radar. Based on the physiological signs that distinguish organisms from other objects, the distance between the organism and the radar can be obtained by detecting the motion information of the three-dimensional point to distinguish it from other objects, thereby increasing the diversity and efficiency of distance detection.

[0140] The following is an explanation of how to determine whether the target part is located in the effective working area in the embodiment of the present application.

[0141] In an embodiment of the present application, the target part of the organism is identified based on the preview screen to obtain the position information of the target part in the preview screen; based on the position information and the position of the effective working area in the display screen, the positional relationship between the target part and the effective working area is determined, and the positional relationship is that the target part is located in the effective working area or the target part is not located in the effective working area.

[0142] In an embodiment of the present application, a living being is displayed in the preview screen, and the living being is imaged by a camera to obtain an image containing the living being. By using a biological recognition function (for example, a portrait recognition model, a human upper body recognition model, etc.) to recognize the image, the target part of the living being can be identified, which can be shown in the form of a target frame, thereby obtaining the coordinates of the target part in the image (that is, the position information of the target part in the preview screen). The preview screen is displayed on the display screen, and the preview screen includes an effective working area. According to the position information of the target part in the preview screen and the position of the effective working area in the display screen (that is, the preview screen), it can be determined whether the target part is located in the effective working area, thereby obtaining the positional relationship between the target part and the effective working area.

[0143] The process of judging whether the target part is located in the effective working area is converted into the positional relationship between the imaging position of the target part and the effective working area in the preview screen. In addition, in the scene where the user faces the display screen, the user can also intuitively see whether the target part is located in the effective working area, thereby improving the accuracy and intuitiveness of the judgment result.

[0144] The physiological sign detection process in the embodiment of the present application is described below.

[0145] like Fig.14 As shown, Fig.14This is a flow chart of a physiological sign detection method provided in an embodiment of the present application. The physiological sign detection method includes S101-S105.

[0146] S101. Displaying a preview image of the camera on a display screen, where the preview image includes an effective working area of ​​the radar.

[0147] The effective working area of ​​the radar can be Figure 7-Figure 9 According to any of the embodiments described above, the effective working area of ​​the radar is displayed in the preview screen, and when the creature moves into the shooting range of the camera, the creature is also displayed in the preview screen, as described above. Figure 10-13 shown.

[0148] S102: When it is detected that the target part of the organism in the preview image is not located in the effective working area, a first prompt message is issued; the first prompt message is used to prompt a moving position so that the target part is located in the effective working area.

[0149] Please refer to the above description on determining whether the target part is located in the effective working area, which will not be repeated here.

[0150] The moving mode in the embodiments of the present application can be that the organism does not move and the terminal device is moved so that the target part is located in the effective working space, or the terminal device is fixed and the organism moves so that the target part is located in the effective working space, or both move at the same time so that the target part is located in the effective working space.

[0151] For example, taking the human body as an example, for a scenario where the camera, radar, and display screen are all facing the user, for example, Figure 3 In the TV shown in the figure, and the antenna is located in the mobile phone screen, the user is photographed by the front camera of the mobile phone, and the user under test can intuitively see whether he is in the effective working area on the display screen. In these scenarios, the terminal device is fixed, and the user under test moves so that the target part (for example, the chest) is in the effective working area.

[0152] Exemplarily, taking the human body as an example, for a scenario where the camera and radar face the user and the display screen faces away from the user, for example, the antenna is located inside the back shell of the mobile phone, and the user's scene is photographed using the rear-view camera of the mobile phone. In one implementation, the user holds a handheld terminal device to aim at the user under test. In this scenario, the user under test does not move, and the user holds the terminal device to move so that the target part of the user under test is located in the effective working area; or, the terminal device is fixed, and the user or the terminal device sends a voice to guide the user under test to move so that the target part of the user under test is located in the effective working area. In another implementation, the terminal device is fixed, and the voice sent by the terminal device guides the target part of the user under test to be located in the effective working area. Of course, both the user under test and the terminal device can move, as long as the target part of the user under test can be located in the effective working area, and this embodiment of the present application is not limited to this.

[0153] The first prompt information is used to prompt the creature to move left or right or the terminal device to move left or right so that the target part of the creature is located in the effective working area.

[0154] S103. After the first prompt information is issued, if it is detected from the preview image that the target part is located in the effective working area, the distance between the creature and the radar is detected.

[0155] After the first prompt information is sent, the moved target part is continuously identified according to the preview image to obtain the position information of the moved target part in the preview image until it is determined that the moved target part is located in the effective working area according to the position information after the move and the position of the effective working area in the display screen. When it is detected that the target part in the preview image is located in the effective working area, the distance between the organism and the radar is detected.

[0156] Any of the above embodiments can be used to detect the distance between the organism and the radar. For example, a camera is used to identify the position of the organism, and the depth coordinate is determined in combination with the distance dot map of the radar, so as to obtain the distance between the organism and the radar; or, in a detection scene where the background is far enough from the radar, there are no other interfering objects between the organism and the radar, and the depth coordinate is directly determined according to the distance dot map of the radar, so as to obtain the distance between the organism and the radar; or, the position of the organism is determined according to the motion information of the three-dimensional points in the distance dot map of the radar, so as to use the depth coordinate of the organism as the distance between the organism and the radar. I will not repeat it here.

[0157] S104. When the distance is outside the depth range, a second prompt message is issued; the second prompt message is used to prompt the organism to move away from or close to the radar so that the organism can move into the depth range. The depth range is obtained based on the target working distance of the radar and a preset offset. The preset offset is much smaller than the target working distance. The target working distance indicates the distance between the spatial point and the radar in free space when the performance parameters of the radar meet the preset indicators.

[0158] The distance between the organism and the radar is outside the depth range, that is, the distance between the organism and the radar is less than the lower limit of the depth range, or the distance between the organism and the radar is greater than the upper limit of the depth range.

[0159] The process of the organism moving away from or approaching the radar can refer to the process of the target part of the organism moving into the effective working area in the above S102, which will not be repeated here.

[0160] The second prompt information is used to prompt the creature to move forward or backward, or the terminal device to move forward or backward, so that the creature moves to the depth range.

[0161] In the embodiment of the present application, the first prompt information and the second prompt information may be in the form of one or more of voice, text, flash, etc.

[0162] It should be noted that the target working distance of the radar indicates the distance between the position where the radar detection accuracy reaches the requirement and the position, and the target working distance of the radar can be set by those skilled in the art according to the actual situation, for example, 1.5 meters (m), 2m, 1m, etc., and the preset offset can be set by those skilled in the art according to the actual situation, as long as the preset offset is much smaller than the target working distance, for example, 0.1m, 0.2m, 0.15m, 0.05m, etc. The embodiments of the present application are not limited to this.

[0163] In some embodiments, the second prompt information includes approach prompt information and distance prompt information; the above-mentioned step of issuing the second prompt information when the distance is outside the depth range can be implemented in the following manner. When the distance is greater than the upper limit of the depth range, approach prompt information is issued to prompt the organism to approach the radar so that the organism moves into the depth range; when the distance is less than the lower limit of the depth range, distance prompt information is issued to prompt the organism to move away from the radar so that the organism moves into the depth range. By guiding the organism to move into the depth range through approach prompt information and distance prompt information, the physiological sign detection can be completed efficiently, thereby improving the efficiency of physiological sign detection and the user experience.

[0164] In some embodiments, the depth range is within the interval formed by the minimum limit value and the maximum limit value of the radar, the maximum limit value is greater than the upper limit value of the depth range, and the minimum limit value is less than the lower limit value of the depth range. The second prompt information includes approach prompt information, distance prompt information and fine-tuning prompt information; the above-mentioned step of issuing the second prompt information when the distance is outside the depth range can be implemented in the following way. When the distance is greater than the maximum limit value of the radar, it means that the distance is too far and needs to be moved significantly. Approach prompt information is issued to prompt the organism to approach the radar by a first distance so that the organism moves into the depth range. The first distance is the difference between the distance and the maximum limit value; when the distance is less than the minimum limit value of the radar, it means that the distance is too close and needs to be moved significantly. A distance prompt information is issued to prompt the organism to move away from the radar by a second distance so that the organism moves into the depth range. The second distance is the difference between the minimum limit value and the distance. When the distance is greater than or equal to the minimum limit value and less than or equal to the lower limit value of the depth range; or, when the distance is greater than or equal to the upper limit value of the depth range and less than or equal to the maximum limit value, it means that the creature is close to the depth range and does not need to move significantly, and a fine-tuning prompt message is issued. The fine-tuning prompt message is used to prompt the creature to move slightly forward or backward (for example, move one or two steps in small increments) to move the creature into the depth range.

[0165] For example, if the distance between the radar and the creature is P_distance, the maximum limit value of the radar is Radar_max, the minimum limit value of the radar is Radar_min, the lower limit value of the depth range is Radar_opt_min, and the upper limit value of the depth range is Radar_opt_max, if P_distance is greater than the maximum working distance range of the radar, then the prompt "out of effective range, too far, at least P_distance- Radar_max closer to the terminal device". If P_distance is less than the minimum working distance range of the radar Radar_min, then the prompt "too close, at least Radar_min-P_distance away from the terminal device". If P_distance is not within the optimal working range of the radar (ie, depth range) [Radar_opt_min, Radar_opt_max], then the prompt "it is recommended that the user move to the optimal area".

[0166] In the embodiment of the present application, the organism is guided to move within the depth range by means of approach prompt information, distance prompt information and fine-tuning prompt information, and the amplitude of each movement (for example, the first distance, the second distance, slightly moving forward or backward) is prompted. Compared with the above-mentioned single solution of prompting the organism to approach or move away from the radar, a faster movement process is achieved, thereby improving the efficiency of physiological sign detection and the user experience.

[0167] S105. After the second prompt information is issued, if it is detected that the distance between the organism and the radar is within the depth range, the physiological signs of the target part are detected.

[0168] After the second prompt message is sent, the distance between the moving creature and the radar continues to be detected until the moving creature is within the depth range.

[0169] It should be noted that the process of judging whether the target part of the organism is located in the effective working area and judging whether the distance between the organism and the radar is within the depth range provided in the embodiment of the present application runs through the entire detection process and is a periodically refreshed process. That is to say, in the process of detecting the physiological signs of the target part, it is continuously detected whether the target part of the organism is located in the effective working area and whether the distance between the organism and the radar is within the depth range. Before the detection is completed, if it is detected that the target part of the organism is not located in the effective working area, the first prompt information is continuously issued to prompt the moving position so that the target part is located in the effective working area, or if it is detected that the distance between the organism and the radar is outside the depth range, the second prompt information is continuously issued to prompt the moving position so that the distance between the organism and the radar is within the depth range, until it is detected that the target part is located in the effective working area and the distance between the organism and the radar is within the depth range, the physiological signs of the target part are continuously detected until the detection is completed.

[0170] In the embodiment of the present application, when the target part of the organism in the preview screen is located in the effective working area and the distance between the organism and the radar is within the depth range, it means that the target part is located in the effective working space, and the effective working area is the mapping of the effective working space of the radar in the preview screen, that is, the depth range indicates the depth range of the effective working space. Then, the physiological signs of the target part are detected.

[0171] It should be noted that the above process of issuing prompt information so that the target part is located in the effective working space is to first prompt the user to move left or right into the effective working area based on the first prompt information, and then prompt the user to move forward or backward into the depth range based on the second prompt information. Of course, the user can also be prompted to move forward or backward into the depth range first, and then prompt the user to move left or right into the effective working area. Exemplarily, when it is detected that the distance between the organism and the radar is not within the depth range, the second prompt information is issued; the second prompt information is used to prompt to move away from or close to the radar so that the organism moves into the depth range. When it is detected that the distance between the organism and the radar is within the depth range based on the second prompt information, it is detected whether the target part of the organism in the preview screen is located in the effective working area. When it is detected that the target part of the organism in the preview screen is not located in the effective working area, the first prompt information is issued; the first prompt information is used to prompt the moving position so that the target part is located in the effective working area. When it is detected that the target part is located in the effective working area based on the first prompt information, the physiological signs of the target part are detected.

[0172] In an embodiment of the present application, a camera is used to capture a preview image of a creature, and an effective working area of ​​the radar is pre-set. The effective working area in the preview image is used to send a first prompt message when it is detected that the target part of the creature in the preview image is not located in the effective working area, so as to guide the creature to have its target part within the effective working area of ​​the radar when detecting physiological signs. Then the distance between the creature and the radar is detected, and when the distance is outside the depth range, a second prompt message is sent to guide the creature to move within the depth range, so as to achieve radar alignment, and then detect the physiological signs of the target part. By intuitively displaying the effective working area of ​​the radar, the target part of the creature is assisted to align with the radar, thereby improving the efficiency of physiological sign detection and the user experience. In this way, the radar also works in the best working condition, which improves the accuracy of physiological sign detection.

[0173] In the embodiment of the present application, during the design stage of the terminal device, the distance between the camera and the receiving antenna and the transmitting antenna can be set close enough, for example, much smaller than the distance between the organism and the radar, so that the camera's field of view angle range can cover the radar's effective working area. Exemplarily, the radar antenna in the terminal device is as close as possible to a camera with a large FOV, for example, an ultra-wide-angle camera, so that the position ratio will not vary greatly with the change of the target working distance, that is, the deviation of the position and size of the effective working area is less affected by the target working distance, thereby improving the accuracy of the effective working area.

[0174] In some embodiments, during the design phase of the terminal device, the FOV of the camera, the FOV of each antenna of the radar, and their relative positions can also be used. Figure 7-Figure 12 The calculation method of the effective working area on the display screen is provided in the embodiment of the present invention, or the parameter values ​​of the display screen (including the size and position of the effective working area) are obtained by using simulation software.

[0175] In the embodiment of the present application, during the design phase of the terminal device, the installation errors of the camera and radar, as well as the fluctuations of the antenna itself in the radar, can also be considered to adjust parameters, such as the position of the camera, receiving antenna and transmitting antenna in the terminal device, the target working distance of the radar, etc., to complete the calibration and testing of the effective working area and improve the accuracy of the effective working area. Of course, during the production test phase of the terminal device, the calibration and testing of the effective working area can also be completed. Figure 8 and Fig. 9 The position and FOV of the camera, receiving antenna and transmitting antenna, as well as the target working distance of the radar are calibrated and tested to calibrate the effective working area to improve the accuracy of the effective working area.

[0176] Based on the above Figure 7-Figure 14 As shown, during the user use stage, the embodiment of the present application provides an auxiliary alignment method for a terminal device, such as Fig.15 shown.

[0177] S201. The user turns on the physiological sign detection function of the terminal device, and displays the best working area (ie, the effective working area of ​​the radar) in the preview screen of the display screen to guide the user to enter the best working area.

[0178] The user can open the physiological sign detection application on the terminal device by clicking, pressing, touching or selecting a key, enter the physiological sign detection process, and call the above Figure 10-12 Any of the guide interfaces shown in the figure will display the guide interface on the display screen.

[0179] S202: After the user enters the optimal working area, the preview image captured by the camera is identified to obtain the plane coordinates of the organism.

[0180] In the embodiment of the present application, the above description on judging whether the target part is located in the effective working area can be used to judge whether the user has entered the optimal working area, which will not be repeated here. After the user enters the optimal working area, the plane coordinates of the organism in the preview screen are identified.

[0181] S203. Calculate the distance P_distance between the organism and the radar based on the plane coordinates of the organism and the distance dot map of the radar.

[0182] The distance dot matrix includes the three-dimensional coordinates of multiple three-dimensional points, and the three-dimensional coordinates include two-dimensional coordinates and depth coordinates. According to the two-dimensional coordinates of each three-dimensional point, at least one three-dimensional point matching the plane coordinates of the organism is selected, and the distance between the organism and the radar is calculated according to the depth coordinates of at least one three-dimensional point.

[0183] S204. Determine whether P_distance exceeds the effective range of the radar.

[0184] The effective range of the radar includes the optimal range of the radar. The effective range indicates the effective working range of the radar, and the optimal range is the depth range of the radar, indicating the optimal working range of the radar. The effective range is the interval consisting of the minimum limit value Radar_min and the maximum limit value Radar_max, and the optimal range is the interval consisting of the lower limit value Radar_opt_min and the upper limit value Radar_opt_max. Among them, Radar_min is less than Radar_opt_min, and Radar_max is greater than Radar_opt_max.

[0185] If not, execute S206. If yes, execute S205.

[0186] S205: Guide the user to enter the effective range of the radar.

[0187] Exemplarily, an approach prompt message or a distance prompt message is issued to prompt the user to approach the radar by a first distance or to move away from the radar by a second distance. The first distance is P_distance- Radar_max, and the second distance is Radar_min-P_distance.

[0188] After executing S205 , continue to execute S203 - S204 until P_distance is within the effective range of the radar, and then execute S206 .

[0189] S206. Determine whether P_distance exceeds the optimal range of the radar.

[0190] If not, execute S209. If yes, execute S207 and, after executing S207 and S208, continue to execute S206 until P_distance is within the optimal range of the radar.

[0191] S207. Guide the user to enter the optimal range of the radar.

[0192] Exemplarily, a fine-tuning prompt message is issued to prompt the user to move slightly forward or backward.

[0193] It should be noted that after the above S203, the embodiment of the present application can also execute S206 instead of S204-S205. That is, directly determine whether P_distance exceeds the optimal range of the radar? And when it exceeds the optimal range of the radar, guide the user into the optimal range of the radar, and repeat the steps of calculating the distance, determining whether it exceeds the optimal range of the radar, and guiding the user into the optimal range of the radar until P_distance is within the optimal range of the radar, and then execute S209.

[0194] S208. Continue to calculate the distance P_distance between the organism and the radar based on the plane coordinates of the organism and the distance dot map of the radar.

[0195] After executing S208 , S206 - S208 are continuously executed in a loop until P_distance is within the optimal range of the radar, and then S209 is executed.

[0196] S209: Display a prompt message on the display screen to prompt that the user is currently in the best measurement position (ie, effective working space) and can start physiological sign detection.

[0197] Generate a prompt message and display it on the display screen to prompt the user that he has entered the valid workspace and meets the detection conditions, and the terminal device starts to detect physiological signs.

[0198] It should be noted that the process of judging whether the target part of the user is located in the optimal working area and judging whether P_distance exceeds the optimal range of the radar provided in this example runs through the entire detection process and is a periodically refreshed process. That is to say, after S209, in the process of detecting physiological signs of the target part, it is continuously detected whether the target part of the user is located in the optimal working area and whether P_distance exceeds the optimal range of the radar. Before the detection is completed, if it is detected that the target part of the user is not located in the optimal working area, a prompt message (i.e., a first prompt message) is continuously issued to prompt the user to move the position so that the target part is located in the optimal working area, or if it is detected that P_distance exceeds the optimal range of the radar, a fine-tuning prompt message is continuously issued to prompt the user to move the position so that P_distance is located in the optimal range of the radar, until it is detected that the target part is located in the optimal working area and P_distance is located in the optimal range of the radar, the physiological signs of the target part are continuously detected until the detection is completed.

[0199] In the embodiment of the present application, a camera is used to capture the preview screen, and the effective working area of ​​the radar is pre-set, and the radar auxiliary alignment function in the terminal device is realized through the effective working area. The effective working area in the preview screen is used to guide the user to be in the optimal working area of ​​the radar when detecting physiological signs. Then the distance between the user and the radar is detected, the user is guided to enter the effective range of the radar, and then the user is further guided to enter the optimal range of the radar. At this point, the user is in the best measurement position (i.e., the effective working space) and can start the detection of physiological signs.

[0200] By intuitively displaying the effective working area of ​​the radar, the target part of the organism is oriented to the radar. Then, by detecting the distance between the radar and the user and comparing it with the effective range and optimal range of the radar, the user is guided into the optimal range of the radar, thus improving the efficiency of physiological sign detection and user experience. In this way, the radar also works in the best working condition, improving the accuracy of physiological sign detection.

[0201] Based on the above Figure 7-Figure 15 The physiological sign detection method described above is combined with the above Figure 6 The software system framework diagram in the embodiment of the present application provides an exemplary flow chart of a physiological sign detection interaction method, such as Fig.16 The hardware layer of the terminal device includes the camera, display screen, and radar. Next, the interaction between the various layers of the software system is described.

[0202] S301. The user starts a physiological sign detection application on the interface displayed by the terminal device.

[0203] The user may click or touch the application icon of the physiological sign detection application to open the physiological sign detection application, or may open the physiological sign detection application through a physical button.

[0204] S302: Start the algorithm engine.

[0205] S303. Start the radar.

[0206] After the physiological sign detection application is started, the physiological sign detection application starts the algorithm engine to execute the physiological sign detection method provided in the embodiment of the present application, and starts the radar to obtain the radar distance dot matrix.

[0207] S304, start the camera.

[0208] S305. Control the image display area of ​​the display screen to display the effective working area of ​​the radar.

[0209] The physiological sign detection application calls the camera to take pictures. The display screen is usually turned on. The physiological sign detection interface is displayed in the image display area of ​​the display screen. The physiological sign detection interface includes the effective working area of ​​the radar.

[0210] S306: Send real-time image.

[0211] The camera sends the real-time image to the display screen to display a preview of the real-time image in the physiological sign detection interface.

[0212] S307: Send real-time image.

[0213] The camera sends real-time images to the algorithm engine.

[0214] S308: Displaying a preview image of the camera and an effective working area of ​​the radar in the image display area of ​​the display screen.

[0215] The preview screen includes the radar's effective operating area.

[0216] S309. Identify the target part of the organism according to the preview screen to obtain the position information of the target part in the preview screen; when it is determined that the target part is not located in the effective working area according to the position information and the position of the effective working area in the display screen, issue a first prompt message to make the target part of the organism located in the effective working area.

[0217] The algorithm engine determines whether the target part is located in the effective working area based on the real-time image (i.e., preview image) sent by the camera and the effective working area on the display screen. If the target part is not located in the effective working area, the algorithm engine issues a first prompt message to prompt the creature to move the target part to the effective working area. The algorithm engine continues to receive the real-time image sent by the camera and determines whether the target part is located in the effective working area. If the target part of the creature is not located in the effective working area, the algorithm engine continues to issue the first prompt message until the target part of the creature is located in the effective working area.

[0218] S310, sending the radar distance dot map.

[0219] The radar sends its detected distance dot map to the algorithm engine.

[0220] S311. When the target part is detected to be in the effective working area according to the preview image, the organism is identified according to the preview image to obtain the plane coordinates of the organism; the distance between the organism and the radar is determined in combination with the distance dot map of the radar. When the distance is outside the depth range, a second prompt message is issued to move the organism into the depth range.

[0221] The algorithm engine calculates the distance between the organism and the radar based on the preview image and the distance dot map, and if the distance is outside the depth range, it sends a second prompt message to prompt the organism to move into the depth range, continues to receive real-time images sent by the camera and the distance dot map sent by the radar, and determines whether the distance is within the depth range. If the distance is outside the depth range, it continues to send the second prompt message until the organism moves into the depth range.

[0222] S312: When it is detected that the distance between the organism and the radar is within the depth range, a detection instruction is sent to the radar.

[0223] When the target part of the organism is in the effective working area and the distance is within the depth range, it means that the physiological signs can be detected. The algorithm engine sends a detection instruction to the radar.

[0224] S313: Detect physiological signs of the target part based on the detection instruction.

[0225] The radar detects physiological signs of the target site in response to the detection instruction.

[0226] In the embodiment of the present application, the algorithm engine determines whether the target part of the organism is located in the effective working area based on the real-time image sent by the camera and the effective working area in the preview screen, and sends a first prompt message when the target part of the organism is not located in the effective working area to assist the target part of the organism to align with the radar. In addition, the distance between the organism and the radar is calculated in combination with the distance dot matrix sent by the radar, and it is determined whether the distance is within the depth range, and when the distance is outside the depth range, a second prompt message is sent to guide the user into the optimal range of the radar. Then, the physiological signs of the target part are detected to improve the efficiency of physiological sign detection and the user experience.

[0227] It should be noted that the process of judging whether the target part of the organism is located in the effective working area and judging whether the distance between the organism and the radar is within the depth range provided in the embodiment of the present application runs through the entire detection process and is a periodically refreshed process. That is to say, in the process of executing S313, it is continuously detected whether the target part of the organism is located in the effective working area and whether the distance between the organism and the radar is within the depth range. Before the detection is completed, if it is detected that the target part of the organism is not located in the effective working area, the first prompt message is continuously issued to prompt the moving position so that the target part is located in the effective working area, or if it is detected that the distance between the organism and the radar is outside the depth range, the second prompt message is continuously issued to prompt the moving position so that the distance between the organism and the radar is within the depth range, until it is detected that the target part is located in the effective working area and the distance between the organism and the radar is within the depth range, the physiological signs of the target part are continuously detected until the detection is completed.

[0228] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (such as: coaxial cable, optical fiber, data subscriber line (Digital Subscriber Line, DSL)) or wireless (such as: infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access, or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a digital versatile disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)).

[0229] The above are optional embodiments provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the technical scope disclosed in the present application shall be included in the protection scope of the present application.

Claims

1. A method for detecting physiological signs, characterized in that: The method is applied to a terminal device, the terminal device includes a radar and a camera, the distance between the camera and a receiving antenna and a transmitting antenna in the radar is less than a first preset distance, the field of view angle range of the camera covers the overlapping area between a first radiation area of ​​the receiving antenna and a second radiation area of ​​the transmitting antenna, and the terminal device includes a display screen or the terminal device is connected to the display screen; The method comprises: Controlling the display screen to display a preview screen of the camera, wherein the preview screen includes an effective working area of ​​the radar, wherein the effective working area is a mapping of the effective working space of the radar in the preview screen, wherein the depth range of the effective working space is obtained according to a target working distance of the radar and a preset offset, wherein the target working distance indicates a distance between a spatial point and the radar in free space when a performance parameter of the radar meets a preset index; and the effective working area is related to the target working distance; In the case where it is detected according to the preview screen that the target part of the organism is not located in the effective working space, a prompt message is issued until it is detected that the target part is located in the effective working space; the prompt message is used to prompt a moving position so that the target part is located in the effective working space; wherein, the target part of the organism is not located in the effective working space includes that the target part of the organism is not located in the effective working area, and / or the distance between the organism and the radar is outside the depth range; The physiological signs of the target site are detected.

2. The method according to claim 1, characterized in that The method of sending a prompt message when it is detected according to the preview screen that the target part of the organism is not located in the valid working space until it is detected that the target part is located in the valid working space includes: When it is detected that the target part of the organism in the preview image is not located in the effective working area, a first prompt message is issued; the first prompt message is used to prompt a moving position so that the target part is located in the effective working area; After the first prompt information is issued, if it is detected that the target part in the preview image is located in the effective working area, detecting the distance between the creature and the radar; When the distance is outside the depth range, a second prompt information is issued; the second prompt information is used to prompt the creature to move away from or close to the radar so that the creature moves into the depth range, and the prompt information includes the first prompt information and the second prompt information; After the second prompt information is issued, when it is detected that the distance between the creature and the radar is within the depth range, it is determined that the target part is located in the effective working space.

3. The method according to claim 2, characterized in that The second prompt information includes approach prompt information, distance prompt information and fine-tuning prompt information; When the distance is outside the depth range, issuing a second prompt message includes: In the case where the distance is greater than the maximum limit value of the radar, the approach prompt information is issued; the approach prompt information is used to prompt the creature to approach the radar by a first distance so that the creature moves into the depth range, the first distance being the difference between the distance and the maximum limit value, and the maximum limit value being greater than the upper limit value of the depth range; In the case where the distance is less than the minimum limit value of the radar, the stay away prompt information is issued; the stay away prompt information is used to prompt the creature to stay away from the radar by a second distance so that the creature moves into the depth range, and the second distance is the difference between the minimum limit value and the distance; the minimum limit value is less than the lower limit value of the depth range; When the distance is greater than or equal to the minimum limit value and less than or equal to the lower limit value of the depth range; or when the distance is greater than or equal to the upper limit value of the depth range and less than or equal to the maximum limit value, the fine-tuning prompt information is issued, and the fine-tuning prompt information is used to prompt the organism to move forward or backward so that the organism moves into the depth range.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Acquire a first radiation area of ​​the receiving antenna, a second radiation area of ​​the transmitting antenna, and a field of view angle range of the camera; Determine, according to the overlapping area between the first radiation area and the second radiation area, the field of view angle range, and the target working distance of the radar, the position proportion of the overlapping area in the field of view angle range; The effective working area of ​​the radar is determined according to the position ratio and the resolution of the display screen; the resolution of the display screen indicates the resolution of the image display area in the display screen.

5. The method according to claim 4, characterized in that The determining, according to the overlapping area between the first radiation area and the second radiation area, the field of view angle range, and the target working distance of the radar, a position proportion of the overlapping area in the field of view angle range includes: Determine, according to the field of view angle range and the target working distance of the radar, a horizontal component of the field of view angle range in the horizontal direction and a vertical component in the vertical direction at the target working distance; Determine, according to the overlapping area and the target working distance of the radar, a first component of the overlapping area in the horizontal direction and a second component in the vertical direction at the target working distance; the first component is a part of the horizontal component, and the second component is a part of the vertical component; Determine, according to the first boundary distance, the first component, and the second boundary distance, a first ratio, a second ratio, and a third ratio of the first boundary distance, the first component, and the second boundary distance to the horizontal component in a one-to-one correspondence, respectively; wherein the first boundary distance indicates the distance between the first end of the horizontal component and the first end of the first component, and the second boundary distance indicates the distance between the second end of the first component and the second end of the horizontal component; According to the third boundary distance, the second component and the fourth boundary distance, determine the fourth ratio, the fifth ratio and the sixth ratio of the third boundary distance, the second component and the fourth boundary distance corresponding to the vertical component respectively; wherein the third boundary distance indicates the distance between the first end of the vertical component and the first end of the second component, and the fourth boundary distance indicates the distance between the second end of the second component and the second end of the vertical component; and the position proportion of the overlapping area in the field of view angle range includes the first ratio, the second ratio, the third ratio, the fourth ratio, the fifth ratio and the sixth ratio.

6. The method according to claim 5, characterized in that The determining the effective working area of ​​the radar according to the position ratio and the resolution of the display screen includes: Determining an initial working area of ​​the radar according to the position ratio and the resolution of the display screen; An effective working area of ​​the radar is determined according to an initial working area of ​​the radar.

7. The method according to claim 6, characterized in that The resolution of the display screen includes horizontal resolution and vertical resolution; The determining the initial working area of ​​the radar according to the position ratio and the resolution of the display screen includes: Divide the horizontal frame of the display screen into three segments according to the first ratio, the second ratio, the third ratio and the horizontal resolution, and use two endpoints of a middle segment as two horizontal boundary points; Dividing the vertical frame of the display screen into three segments according to the fourth ratio, the fifth ratio, the sixth ratio and the vertical resolution, and using two endpoints of a middle segment as two vertical boundary points; An initial working area of ​​the radar is determined according to the two horizontal boundary points and the two vertical boundary points.

8. The method according to claim 6, characterized in that The determining, according to the initial working area of ​​the radar, the effective working area of ​​the radar comprises: Determining a candidate working area in the preview picture according to the position information of the initial working area in the preview picture; the initial working area is enclosed in the candidate working area; Acquire multiple signal-to-noise ratios of the radar during the movement of the object in the candidate working area in the preview image; The candidate working area is adjusted according to the multiple signal-to-noise ratios and a preset signal-to-noise ratio to obtain the effective working area.

9. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Acquire a first signal-to-noise ratio of each of a plurality of points of the radar when the object moves from a first side to a second side of the preview screen, and a second signal-to-noise ratio of each of a plurality of points of the radar when the object moves from a third side to a fourth side of the preview screen; the vertical distance between the moving track of the object and the radar is the target working distance, the first side is parallel to the second side, and the third side is parallel to the fourth side; Determine, from the first signal-to-noise ratios of the plurality of points, a first point close to the first side and having a signal-to-noise ratio greater than a preset signal-to-noise ratio, and a second point close to the second side and having a signal-to-noise ratio greater than the preset signal-to-noise ratio; Determine, from the second signal-to-noise ratios of the plurality of points, a third point close to the third side and having a signal-to-noise ratio greater than the preset signal-to-noise ratio, and a fourth point close to the fourth side and having a signal-to-noise ratio greater than the preset signal-to-noise ratio; An effective working area of ​​the radar is determined according to the first point, the second point, the third point and the fourth point.

10. The method according to claim 2 or 3, characterized in that: The detecting the distance between the creature and the radar comprises: Identify the creature according to the preview image to obtain the plane coordinates of the creature; Determine at least one three-dimensional point corresponding to the plane coordinates in the range dot map of the radar; The distance between the creature and the radar is determined according to the depth coordinate of the at least one three-dimensional point.

11. The method according to claim 2 or 3, characterized in that: The preview image includes the creature and a background, and the distance between the background and the radar is greater than a second preset distance; The detecting the distance between the creature and the radar comprises: Determine the minimum depth coordinate from the range dot map of the radar; the range dot map of the radar includes a plurality of three-dimensional points, each of which includes a two-dimensional coordinate and a depth coordinate; The distance between the creature and the radar is determined according to the minimum depth coordinate value and / or at least one depth coordinate whose difference with the minimum depth coordinate value is less than a preset difference value.

12. The method according to claim 2 or 3, characterized in that: The range dot map of the radar includes a plurality of three-dimensional points, each of which includes a two-dimensional coordinate, a depth coordinate and motion information; The detecting the distance between the creature and the radar comprises: Determine at least one three-dimensional point in the range dot map of the radar whose motion information meets the regular motion requirement; The distance between the creature and the radar is determined according to the depth coordinate of the at least one three-dimensional point.

13. The method according to claim 2 or 3, characterized in that: The method further comprises: Identify the target part of the organism according to the preview image to obtain position information of the target part in the preview image; According to the position information and the position of the effective working area in the display screen, the positional relationship between the target part and the effective working area is determined, and the positional relationship is that the target part is located in the effective working area or the target part is not located in the effective working area.

14. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When the preview picture is not displayed in full screen, reducing the effective working area of ​​the radar according to the size of the preview picture, and adjusting the display position of the effective working area in the display screen according to the position of the preview picture in the display screen; When the display screen rotates, the display position of the effective working area in the display screen is adjusted according to the position of the preview image in the display screen.

15. The method according to claim 2 or 3, characterized in that: After the first prompt information is issued, the method further includes: Continue to identify the moved target part according to the preview picture to obtain position information of the moved target part in the preview picture; Until it is determined that the moved target part is located in the effective working area according to the position information after the movement and the position of the effective working area in the display screen.

16. The method according to claim 2 or 3, characterized in that: After sending the second prompt information, the method further includes: The distance between the moved living thing and the radar is continuously detected until the moved living thing is located in the depth range.

17. A terminal device, characterized in that: The terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the method according to any one of claims 1 to 16 when executed by the processor.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 16.

19. A computer program product comprising instructions, characterized in that When the method is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 16.

Images