Automatic interaction reminding method of hospital guide system

By introducing automatic interactive reminder methods in the diagnosis guide system, using the camera and voice recognition technology of the intelligent diagnosis guide device, seamless interaction between users is achieved between different devices, solving the problem of repeated operations in the existing technology, and improving user experience and system efficiency.

CN119673397APending Publication Date: 2025-03-21GUANGDONG SKYNET SMART CITY TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202411334485.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-24
Publication Date
2025-03-21

AI Technical Summary

Technical Problem

The existing diagnosis guidance equipment and intelligent diagnosis guidance management methods require users to interact according to specific operating procedures, resulting in users repeatedly operating between different devices, failing to improve the efficiency of medical services or the patient's medical experience, and causing redundant workload to artificial intelligence services and wasting computing power.

Method used

By introducing automatic interactive reminder methods in the guidance system, using the camera and voice recognition technology of the intelligent guidance device, collect and analyze user information, the server compares data and pushes the target data set to the corresponding equipment, the equipment activates the active response function, and actively displays the response information to the user.

Benefits of technology

It realizes seamless interaction between users among different intelligent diagnosis and guidance devices, reduces repetitive operations, improves user experience and system efficiency, and saves system computing power.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119673397A_ABST
    Figure CN119673397A_ABST
Patent Text Reader

Abstract

The invention discloses an automatic interaction reminding method of a hospital guide system, which comprises the following steps that: after a user uses one intelligent hospital guide device and interacts, the intelligent hospital guide device collects face identification information of the user through a camera device; the intelligent hospital guide equipment integrates collected face recognition information and conversation information between a user and the intelligent hospital guide equipment into a target data set, the target data set is uploaded to a server, and the multiple intelligent hospital guide equipment generates multiple different target data sets in a working state; the intelligent hospital guide equipment continuously collects crowd images in a recognition range in a standby state, performs face recognition on the crowd images, extracts face information of a plurality of individuals and uploads the face information of the individuals to the server, the server compares the face information of the individuals with the target data sets one by one, and the face information of the individuals is obtained. When one piece of individual face information is matched with one piece of target data set information, the server calibrates the individual face information as a service target and sends the service target and the corresponding target data set to the corresponding intelligent hospital guide equipment; after receiving the service target, the intelligent hospital guide equipment in the standby state judges whether the service target is an active response object or not, and if yes, the active response function is activated. The invention aims to overcome the defects in the prior art, and provides an automatic interactive reminding method for a hospital guide system, so as to improve the use efficiency and experience of a user and save the computing power of the system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention specifically relates to an automatic interactive reminder method for a medical guidance system. Background Art

[0002] With the continuous growth of demand for medical services and technological advancement, hospitals are facing the important challenge of how to improve service quality and optimize patients' medical experience. The traditional medical process usually involves multiple links, including registration, waiting for the call, medical treatment, examination and medication, etc. This series of processes is not only time-consuming, but also often requires patients to run back and forth between different departments of the hospital, which brings great inconvenience to patients, especially elderly patients and those with limited mobility. Therefore, generally large-scale hospitals have introduced intelligent electronic diagnosis and treatment systems to improve patients' medical experience, such as the patent scheme of hospital diagnosis and treatment management system and method with patent number CN201910745328.9; at the same time, intelligent electronic guidance equipment and intelligent guidance management methods have also been introduced, such as the patent scheme of a hospital intelligent guidance device and method with patent number CN201810093728.1, which provides services to patients by setting up self-service terminals.

[0003] With the rise and popularity of artificial intelligence, the inventor has developed an intelligent medical guidance device based on an artificial intelligence big model. The intelligent medical guidance device trains the artificial intelligence big model through information such as hospital diagnosis and treatment processes to obtain an intelligent response system that can communicate with users. The system can respond to user questions. You can also refer to the patent number CN202111102698.4, entitled A medical graded diagnosis and treatment registration management method and system based on artificial intelligence.

[0004] However, the existing medical guidance equipment and intelligent medical guidance management methods still require users to interact with the medical guidance equipment according to specific operating procedures. When users operate back and forth in the processes of calling numbers, seeing doctors, checking and picking up medicines, if medical guidance equipment is used, patients are still required to repeat specific operating procedures multiple times on different medical guidance equipment. This not only fails to further improve the efficiency of medical services and enhance the patient's medical experience, but also creates redundant workload for artificial intelligence services and causes a huge waste of computing power.

[0005] The present invention is just produced based on the above-mentioned shortcomings. Summary of the invention

[0006] The purpose of the present invention is to overcome the deficiencies of the prior art and provide an automatic interactive reminder method for a medical guidance system to improve the efficiency and experience of user use and save system computing power.

[0007] The present invention is achieved through the following technical solutions:

[0008] An automatic interactive reminder method for a medical guidance system includes a server and a plurality of intelligent medical guidance devices arranged in different areas of a hospital. The intelligent medical guidance devices are provided with a camera device for collecting user image information, a sound receiving device for collecting user voice information, a sound generating device for sound output, and a display device for displaying virtual characters and images or text information. The intelligent medical guidance devices are also provided with an intelligent answering system for conducting voice dialogues with users.

[0009] The automatic interactive reminder method of the medical guidance system comprises the following steps:

[0010] S1. After the user uses one of the intelligent medical guidance devices and interacts with it, the intelligent medical guidance device collects the user's facial recognition information through a camera device. The intelligent medical guidance device integrates the collected facial recognition information and the conversation information between the user and the intelligent medical guidance device into a target data set, and uploads the target data set to the server. Multiple intelligent medical guidance devices generate multiple different target data sets in a working state.

[0011] S2. The intelligent medical guidance device continuously collects crowd images within its recognition range in standby mode, performs facial recognition on the crowd images and extracts multiple individual facial information, and uploads the individual facial information to the server. The server compares each individual facial information with each target data set one by one. When a body facial information matches one of the target data set information, the server marks the individual facial information as a service target, and sends the service target and its corresponding target data set to the corresponding intelligent medical guidance device;

[0012] S3. After receiving the service target, the intelligent medical guidance device in the standby state determines whether the service target is an active response object. If so, the active response function is activated.

[0013] In the above-mentioned automatic interactive reminder method of the medical guidance system, in step S3, the method by which the intelligent medical guidance device determines whether the service target is an active response target includes: the intelligent medical guidance device is preset with a usage time condition, and if the service target has not entered the recognition range of the intelligent medical guidance device within the preset time, it is determined that the service target meets the usage time condition; the intelligent medical guidance device is preset with a user demand condition, and the intelligent medical guidance device extracts the demand information of the service target through the target data set, and if the service target needs to reach other areas, it is determined that the service target meets the user demand condition;

[0014] If the service target meets both the usage time condition and the user demand condition, the service target is judged to be an active response object.

[0015] As described in the automatic interactive reminder method of the medical guidance system according to claim 2, the intelligent medical guidance device is provided with a map storage module for storing location information of locations in different areas of the venue. When the user asks about other location information in the venue, the intelligent medical guidance device extracts the location information of the location from the map storage module and broadcasts or displays it through a sound device or a display device;

[0016] In step S3, the intelligent medical guidance device extracts dialogue information according to the target data set corresponding to the service target. If the user has asked about location information and the intelligent medical guidance device has broadcast or displayed the location information through a sound device or a display device, it is determined that the service target needs to reach other areas, which meets the user's demand conditions.

[0017] As described in the automatic interactive reminder method of the medical guidance system according to claim 1, in step S3, the intelligent medical guidance device is preset with an active response database. When the intelligent medical guidance device activates the active response function, the intelligent medical guidance device extracts the response information from the active response database and broadcasts or displays it through a sound device or a display device.

[0018] According to the automatic interactive reminder method of the medical guidance system of claim 1, the server is connected to the hospital's intelligent electronic medical treatment system, and the intelligent electronic medical treatment system is connected to integrate the facial recognition information of the patient and the medical treatment process information of the patient into a patient data set, which is shared to the server;

[0019] In step S2, the server compares each individual facial information with each patient data set one by one. When a body facial information matches one of the patient data sets, the server marks the individual facial information as a patient target, and sends the patient target and its corresponding patient data set to the corresponding intelligent medical guidance device;

[0020] In step S3, after receiving the patient target, the intelligent medical guidance device in the standby state marks the patient target as an active response object and activates the active response function.

[0021] As described above, according to the automatic interactive reminder method of the medical guidance system according to claim 2, the camera device is a binocular camera.

[0022] As described in the automatic interactive reminder method of the medical guidance system according to claim 6, the intelligent medical guidance device is based on the horizontal viewing angle γ of the binocular camera and the collection distance D preset by the intelligent medical guidance device. y Calculate the image acquisition area S of the smart device y , image acquisition area S yThe intelligent medical guidance device is provided with a distance calculation module for calculating the distance between the collected characters and the intelligent medical guidance device. In step S2, the distance calculation module calculates the distance D of each character in the crowd according to the parallax principle. 1 , when the distance between the characters is D 1 ≤D y , that is, it is determined that the person is within the recognition range of the intelligent medical guidance device.

[0023] As described in the automatic interactive reminder method of the medical guidance system according to claim 7, in step B, the distance calculation module derives the formula D according to the parallax principle. 1 = / Calculate the distance D 1 , where f is the camera focal length of the stereo camera, b is the baseline distance between the two cameras of the stereo camera, d is the disparity, and ps is the size of a single pixel in the image sensor.

[0024] As described in the automatic interactive reminder method of the medical guidance system according to claim 7, the intelligent medical guidance device is provided with a facial steering angle calculation module for identifying and calculating the facial orientation of the person, and the facial steering angle calculation module of the intelligent medical guidance device calculates the horizontal rotation angle β1 of the line between the facial orientation of the person and the intelligent medical guidance device, and the intelligent medical guidance device is provided with a preset angle value β0;

[0025] In step S3, the intelligent medical guidance device is preset with an attention condition. If the horizontal rotation angle β1 corresponding to the face orientation of the service target is ≤ the preset angle β0, the service target is judged to meet the attention condition;

[0026] In step S3, if the service target meets the usage time condition, the user demand condition and the attention condition at the same time, the service target is determined to be an active response object.

[0027] As described in the automatic interactive reminder method of the medical guidance system according to claim 7, the facial steering angle calculation module includes an inertial measurement unit IMU composed of a gyroscope and an accelerometer, and the specific method for the facial steering angle calculation module to calculate the horizontal rotation angle β includes:

[0028] 1) The facial turning angle calculation module determines the facial features of the face area in the individual facial information. The facial features include the geometric midpoint of the left eye, the geometric midpoint of the right eye, the geometric midpoint of the nose, the left end point of the mouth, and the right end point of the mouth;

[0029] 2) The facial turning angle calculation module calculates the distance between the geometric midpoint of the left eye and the geometric midpoint of the nose, the distance between the geometric midpoint of the right eye and the geometric midpoint of the nose, the distance between the left end point of the mouth and the geometric midpoint of the nose, the distance between the right end point of the mouth and the geometric midpoint of the nose, the distance between the geometric midpoint of the left eye and the geometric midpoint of the right eye, and the distance between the left end point of the mouth and the right end point of the mouth.

[0030] 3) The face turning angle calculation module calculates the difference De between the geometric midpoint of the left eye and the geometric midpoint of the right eye relative to the geometric midpoint of the nose, the distance De0 between the geometric midpoint of the left eye and the geometric midpoint of the right eye, and the ratio of De to De0 = T e =D e / D e0 , the difference Dn between the left and right endpoints of the mouth relative to the geometric midpoint of the nose, the distance Dn0 between the left and right endpoints of the mouth, the ratio of Dn to Dn0 = T n =D n / D n0 , according to the preset calculation formula β 1 =(T e +T n )*90°, and calculate the horizontal rotation angle β1 of the service target face orientation and the line connecting the service target and the intelligent medical guidance device.

[0031] Compared with the prior art, the present invention has the following advantages:

[0032] The automatic interactive reminder method of the medical guidance system of the present invention can integrate and analyze the information collected by different intelligent medical guidance devices, and when the same user uses different intelligent medical guidance devices, the intelligent medical guidance devices activate the active response function. After the active response function is activated, the intelligent medical guidance device extracts user information according to the retrieved target data set and actively displays the response information, thereby eliminating the need for the same user to repeatedly perform multiple operations on different intelligent medical guidance devices, thereby improving efficiency, enhancing user experience, and saving system computing power. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a schematic diagram of the principle of the server and several intelligent medical guidance devices of the present invention;

[0034] Figure 2 It is a schematic diagram of the principle of arranging several intelligent medical guidance devices of the present invention in different areas of a hospital;

[0035] Figure 3 It is a schematic diagram of the principle of the identification area of ​​the intelligent medical guidance device of the present invention;

[0036] Figure 4 It is a flow chart of the automatic interactive reminder method of the medical guidance system of the present invention. DETAILED DESCRIPTION

[0038] The invention will be further described below in conjunction with the accompanying drawings:

[0039] The directions described in the specification of the invention, such as "up", "down", "left", "right", "front", "back", etc., are based on the directions of the drawings and are intended to facilitate the description of the relationship between the various components. They do not indicate the unique or absolute positional relationship between the various components. They are only one of the implementation methods of the invention and are not a limitation on its implementation method.

[0040] An automatic interactive reminder method for a medical guidance system, such as Figure 1 As shown, this system includes a server 1 and multiple intelligent medical guidance devices 2, and the intelligent medical guidance devices 2 and the server 1 are connected to each other by wired or wireless means; Figure 2 As shown, each intelligent medical guidance device 2 is arranged in different areas of the hospital. Figure 2 The figure shows an embodiment of one arrangement, in which the hospital site A is divided into areas such as A1, A2, A3, A4, etc. In the example, different areas can represent outpatient departments, consulting rooms, pharmacies, laboratories, etc. Figure 1 As shown, the intelligent medical guidance device 2 is provided with a camera device 21 for collecting user image information, a sound receiving device 22 for collecting user voice information, a sound generating device 23 for sound output, and a display device 24 for displaying virtual characters and images or text information. The intelligent medical guidance device 2 is also provided with an intelligent response system for conducting voice conversations with the user, wherein; the intelligent response system is an intelligent response model constructed based on a recurrent neural network. In addition, the intelligent response system can also refer to patent number CN202410722371.4, and the name is a medical service platform guidance analysis method and system based on intelligent response.

[0041] The automatic interactive reminder method of the medical guidance system comprises the following steps:

[0042] S1. After the user uses one of the intelligent medical guidance devices 2 and interacts with it, the intelligent medical guidance device 2 collects the user's facial recognition information through the camera device 21. The intelligent medical guidance device 2 integrates the collected facial recognition information and the conversation information between the user and the intelligent medical guidance device 2 into a target data set, and uploads the target data set to the server 1. Multiple intelligent medical guidance devices 2 generate multiple different target data sets in the working state, that is, each user who uses and interacts with the intelligent medical guidance device 2 generates a corresponding target data set;

[0043] S2. The intelligent medical guidance device 2 continuously collects crowd images within its recognition range in the standby state, performs facial recognition on the crowd images and extracts multiple individual facial information, wherein reference may be made to the patent scheme of CN201910483312.5, entitled A method and system for intelligent image optimization based on group image selection; the intelligent medical guidance device 2 uploads each extracted individual facial information to the server 1, and the server 1 compares each individual facial information with each target data set one by one. When a body facial information matches one of the target data set information, the server 1 marks the individual facial information as a service target, and sends the service target and its corresponding target data set to the corresponding intelligent medical guidance device 2, wherein the corresponding intelligent medical guidance device 2 is the intelligent medical guidance device 2 that has collected the service target; wherein the working state of the intelligent medical guidance device 2 indicates that the intelligent medical guidance device 2 is in a state of interacting with the user, and the standby state of the intelligent medical guidance device 2 indicates that the intelligent medical guidance device 2 is in a state of not interacting with the user;

[0044] S3. After receiving the service target, the smart medical guidance device 2 in the standby state determines whether the service target is an active response object. If so, the active response function is activated. After the active response function is activated, the smart medical guidance device 2 is in a working state and actively displays picture or sound information to the user.

[0045] When a user uses the intelligent medical guidance device 2, when a user interacts with one of the intelligent medical guidance devices 2, the intelligent medical guidance device 2 uploads the target data set of the user to the server. When the user reaches the recognition range of another intelligent medical guidance device 2, the other intelligent medical guidance device 2 uploads the individual facial information of the user to the server. After comparison, the server finds that the individual facial information of the user matches the target data set of the user, then the server sends the target data set of the user to the other intelligent medical guidance device 2. After the other intelligent medical guidance device 2 calculates and determines that the user is an active response object, the other intelligent medical guidance device 2 activates the active response function, thereby actively displaying the response information to the user.

[0046] In step S3, the method by which the intelligent medical guidance device 2 determines whether the service target is an active response target includes:

[0047] 1. The intelligent medical guidance device 2 is preset with a usage time condition. If the service target has not entered the recognition range of the intelligent medical guidance device 2 within the preset time, the service target is judged to meet the usage time condition. The preset time is the time length preset by the intelligent medical guidance device 2. For example, the intelligent medical guidance device 2 is preset with a preset time of 1 minute. When the service target has not entered the recognition range of the intelligent medical guidance device 2 within 1 minute, the intelligent medical guidance device 2 determines that the service target meets the usage time condition.

[0048] 2. The intelligent medical guidance device 2 is preset with user demand conditions. The intelligent medical guidance device 2 extracts the demand information of the service target through the target data set. If the service target needs to reach other areas, it is determined that the service target meets the user demand conditions. Among them, the demand information about the target, such as the user asks "need to reach XX location", "where is XX location", "how to get to XX location", the intelligent response system extracts the demand information that the service target needs to reach a certain location.

[0049] In step S3, if the service target meets both the usage time condition and the user demand condition, the service target is determined to be an active response object.

[0050] To this end, the intelligent medical guidance device 2 is provided with a map storage module for storing location information of locations in different areas of the venue. When the user asks about other location information in the venue, the intelligent medical guidance device 2 extracts the location information of the location from the map storage module and announces or displays it through the sound device 23 or the display device 24;

[0051] In step S3, the intelligent medical guidance device 2 extracts dialogue information according to the target data set corresponding to the service target. If the user has asked about location information and the intelligent medical guidance device 2 has broadcast or displayed the location information through the sound device 23 or the display device 24, it is determined that the service target needs to reach other areas, which meets the user's demand conditions.

[0052] In step S3, the intelligent medical guidance device 2 is preset with an active response database. When the intelligent medical guidance device 2 activates the active response function, the intelligent medical guidance device 2 extracts the response information from the active response database and broadcasts or displays it through the sound device 23 or the display device 24. For example, the active response database is preset with voice or text information such as "Do you need to go to XX location?" and "Do you have any questions that need consultation?", then the information will be displayed to the user when the intelligent medical guidance device 2 activates the response function.

[0053] As a preferred implementation scheme, server 1 is connected to the hospital's intelligent electronic diagnosis and treatment system, wherein the intelligent electronic diagnosis and treatment system can refer to the patent scheme with patent number CN201910745328.9 and the name of the hospital diagnosis and treatment management system and method. The intelligent electronic diagnosis and treatment system integrates the facial recognition information of the patient and the patient's medical process information into a patient data set and shares it to server 1;

[0054] In step S2, the server 1 compares each individual facial information with each patient data set one by one. When a body facial information matches one of the patient data sets, the server 1 marks the individual facial information as a patient target, and sends the patient target and its corresponding patient data set to the corresponding intelligent medical guidance device 2;

[0055] In step S3, after receiving the patient target, the intelligent medical guidance device 2 in the standby state marks the patient target as an active response object and activates the active response function.

[0056] In this embodiment, after receiving the service target, the smart medical guidance device 2 in the standby state needs to determine whether the service target meets the usage time conditions, user demand conditions and attention conditions at the same time. If so, the service target is determined to be an active response object; after receiving the patient target, the smart medical guidance device 2 in the standby state does not need to determine whether the patient target meets the usage time conditions, user demand conditions or attention conditions, and marks the patient target as an active response object, or only needs to determine whether the patient target meets the attention conditions, and if so, marks the patient target as an active response object.

[0057] Regarding determining whether a target meets the attention condition, this embodiment includes the following solutions:

[0058] The camera device 2112 is a binocular camera.

[0059] like Figure 3 As shown, the intelligent medical guidance device 2 is based on the horizontal viewing angle γ of the binocular camera and the preset collection distance D of the intelligent medical guidance device 2. y Calculate the image acquisition area S of the smart device y , image acquisition area S y That is, the recognition range of the intelligent medical guidance device 2. The intelligent medical guidance device 2 is provided with a distance calculation module for calculating the distance of the collected person relative to the intelligent medical guidance device 2. In step S2, the distance calculation module calculates the distance D of each person in the crowd according to the parallax principle. 1 , when the distance between the characters is D 1 ≤D y , that is, it is determined that the person is within the recognition range of the intelligent medical guidance device 2.

[0060] like Figure 3 As shown, in step B, the distance calculation module derives formula D according to the parallax principle 1 =f·b / d·ps to calculate the distance D 1 , where f is the camera focal length of the stereo camera, b is the baseline distance between the two cameras of the stereo camera, d is the disparity, and ps is the size of a single pixel in the image sensor.

[0061] In this embodiment, the intelligent medical guidance device 2 is provided with a facial steering angle calculation module for identifying and calculating the facial orientation of a person. The facial steering angle calculation module of the intelligent medical guidance device 2 calculates the horizontal rotation angle β1 of the line between the facial orientation of the person and the intelligent medical guidance device 2. The intelligent medical guidance device 2 is preset with a preset angle value β0;

[0062] In step S3, the intelligent medical guidance device 2 is preset with an attention condition. If the horizontal rotation angle β1 corresponding to the face orientation of the service target is ≤ the preset angle β0, the service target is judged to meet the attention condition;

[0063] The face steering angle calculation module includes an inertial measurement unit IMU composed of a gyroscope and an accelerometer, such as Figure 3 As shown, for a person P within the recognition range of the intelligent medical guidance device 2, the specific method for the face steering angle calculation module to calculate the horizontal rotation angle β includes:

[0064] 1. The face steering angle calculation module determines the facial features of the face area in the individual facial information. The facial features include the geometric midpoint of the left eye, the geometric midpoint of the right eye, the geometric midpoint of the nose, the left end point of the mouth, and the right end point of the mouth;

[0065] 2. The facial turning angle calculation module calculates the distance between the geometric midpoint of the left eye and the geometric midpoint of the nose, the distance between the geometric midpoint of the right eye and the geometric midpoint of the nose, the distance between the left end point of the mouth and the geometric midpoint of the nose, the distance between the right end point of the mouth and the geometric midpoint of the nose, the distance between the geometric midpoint of the left eye and the geometric midpoint of the right eye, and the distance between the left end point of the mouth and the right end point of the mouth;

[0066] 3. The face turning angle calculation module calculates the distance difference D between the geometric midpoint of the left eye and the geometric midpoint of the right eye relative to the geometric midpoint of the nose. e , the distance D between the left eye geometric midpoint and the right eye geometric midpoint e0 , D e With D e0 The ratio T e =D e / D e0 , the distance difference D between the left end point of the mouth and the right end point of the mouth relative to the geometric midpoint of the nose n , the distance D between the left end point of the mouth and the right end point of the mouth n0 , D n With D n0 The ratio T n =D n / D n0 , according to the preset calculation formula β 1 =(T e +T n)*90°, calculate the horizontal rotation angle β of the service target face direction and the line connecting the service target and the intelligent medical guidance device 2 1 .

[0067] The above is only an embodiment of the present invention, and the common knowledge such as the known specific structure and characteristics in the scheme is not described in detail here. It should be pointed out that for those skilled in the art, several deformations and improvements can be made without departing from the structure of the present invention, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicality of the patent. The scope of protection required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.

Claims

1. An automatic interactive reminder method for a medical guidance system, characterized in that: The invention comprises a server (1) and a plurality of intelligent medical guidance devices (2) arranged in different areas of a hospital. The intelligent medical guidance devices (2) are provided with a camera device (21) for collecting user image information, a sound receiving device (22) for collecting user voice information, a sound generating device (23) for sound output, and a display device (24) for displaying a virtual character and image or text information. The intelligent medical guidance devices (2) are also provided with an intelligent answering system for conducting a voice dialogue with the user. The automatic interactive reminder method of the medical guidance system comprises the following steps: S1. After a user uses one of the intelligent medical guidance devices (2) and interacts with the user, the intelligent medical guidance device (2) collects the user's facial recognition information through a camera device (21). The intelligent medical guidance device (2) integrates the collected facial recognition information and the conversation information between the user and the intelligent medical guidance device (2) into a target data set, and uploads the target data set to a server (1). The multiple intelligent medical guidance devices (2) generate multiple different target data sets in a working state. S2, the intelligent medical guidance device (2) continuously collects crowd images within its recognition range in a standby state, performs facial recognition on the crowd images and extracts multiple individual facial information, and uploads the individual facial information to the server (1). The server (1) compares each individual facial information with each target data set one by one. When a piece of individual facial information matches one of the target data sets, the server (1) marks the individual facial information as a service target, and sends the service target and its corresponding target data set to the corresponding intelligent medical guidance device (2); S3. After receiving the service target, the intelligent medical guidance device (2) in the standby state determines whether the service target is an active response object, and if so, activates the active response function.

2. The automatic interactive reminder method of the medical guidance system according to claim 1, characterized in that: In step S3, the method for the intelligent medical guidance device (2) to determine whether the service target is an active response target includes: the intelligent medical guidance device (2) is preset with a usage time condition, and if the service target has not entered the recognition range of the intelligent medical guidance device (2) within the preset time, it is determined that the service target meets the usage time condition; the intelligent medical guidance device (2) is preset with a user demand condition, and the intelligent medical guidance device (2) extracts the demand information of the service target through the target data set, and if the service target needs to reach other areas, it is determined that the service target meets the user demand condition; If the service target meets both the usage time condition and the user demand condition, the service target is judged to be an active response object.

3. The automatic interactive reminder method of the medical guidance system according to claim 2, characterized in that: The intelligent medical guidance device (2) is provided with a map storage module for storing location information of locations in different areas of a place. When a user asks about information about other locations in the place, the intelligent medical guidance device (2) extracts the location information of the location from the map storage module and announces or displays it through a sound device (23) or a display device (24); In step S3, the intelligent medical guidance device (2) extracts dialogue information based on the target data set corresponding to the service target. If the user has asked about location information and the intelligent medical guidance device (2) has broadcast or displayed the location information through the sound device (23) or the display device (24), it is determined that the service target needs to reach other areas, which meets the user's demand conditions.

4. The automatic interactive reminder method of the medical guidance system according to claim 1, characterized in that: In step S3, the intelligent medical guidance device (2) is preset with an active response database. When the intelligent medical guidance device (2) activates the active response function, the intelligent medical guidance device (2) extracts response information from the active response database and broadcasts or displays it through the sound device (23) or the display device (24).

5. The automatic interactive reminder method of the medical guidance system according to claim 1, characterized in that: The server (1) is connected to the hospital's intelligent electronic diagnosis and treatment system, and the intelligent electronic diagnosis and treatment system is connected to the hospital to integrate the facial recognition information of the patient and the patient's medical process information into a patient data set, and share it with the server (1); In step S2, the server (1) compares each individual facial information with each patient data set one by one. When a body facial information matches one of the patient data sets, the server (1) marks the individual facial information as a patient target, and sends the patient target and its corresponding patient data set to the corresponding intelligent medical guidance device (2); In step S3, after receiving the patient target, the intelligent medical guidance device (2) in the standby state marks the patient target as an active response object and activates the active response function.

6. The automatic interactive reminder method of the medical guidance system according to claim 2, characterized in that: The camera device (21) (12) is a binocular camera.

7. The automatic interactive reminder method of the medical guidance system according to claim 6, characterized in that: The intelligent medical guidance device (2) is configured to obtain a predetermined collection distance D of the intelligent medical guidance device (2) according to the horizontal viewing angle γ of the binocular camera. y Calculate the image acquisition area S of the smart device y , image acquisition area S y That is, the recognition range of the intelligent medical guidance device (2). The intelligent medical guidance device (2) is provided with a distance calculation module for calculating the distance of the collected person relative to the intelligent medical guidance device (2). In step S2, the distance calculation module calculates the distance D1 of each person in the crowd according to the parallax principle. When the distance D1 of the person is less than or equal to D y , that is, it is determined that the person is within the recognition range of the intelligent medical guidance device (2).

8. The automatic interactive reminder method of the medical guidance system according to claim 7, characterized in that: In step B, the distance calculation module calculates the distance D1 by deriving the formula D1=(f·b) / (d·ps) according to the parallax principle, where f is the focal length of the binocular camera, b is the baseline distance between the two cameras of the binocular camera, d is the parallax, and ps is the size of a single pixel in the image sensor.

9. The automatic interactive reminder method of the medical guidance system according to claim 7, characterized in that: The intelligent medical guidance device (2) is provided with a facial orientation calculation module for identifying and calculating the facial orientation of a person. The facial orientation calculation module of the intelligent medical guidance device (2) calculates a horizontal rotation angle β1 of a line between the facial orientation of the person and the intelligent medical guidance device (2). The intelligent medical guidance device (2) is provided with a preset angle value β0; In step S3, the intelligent medical guidance device (2) is preset with an attention condition. If the horizontal rotation angle β1 corresponding to the face orientation of the service target is less than or equal to the preset angle β0, it is determined that the service target meets the attention condition. In step S3, if the service target meets the usage time condition, the user demand condition and the attention condition at the same time, the service target is determined to be an active response object.

10. The automatic interactive reminder method of the medical guidance system according to claim 7, characterized in that: The face orientation calculation module includes an inertial measurement unit IMU composed of a gyroscope and an accelerometer. The specific method of the face orientation calculation module to calculate the horizontal rotation angle β includes: 1) The facial turning angle calculation module determines the facial features of the face area in the individual facial information. The facial features include the geometric midpoint of the left eye, the geometric midpoint of the right eye, the geometric midpoint of the nose, the left end point of the mouth, and the right end point of the mouth; 2) The facial turning angle calculation module calculates the distance between the geometric midpoint of the left eye and the geometric midpoint of the nose, the distance between the geometric midpoint of the right eye and the geometric midpoint of the nose, the distance between the left end point of the mouth and the geometric midpoint of the nose, the distance between the right end point of the mouth and the geometric midpoint of the nose, the distance between the geometric midpoint of the left eye and the geometric midpoint of the right eye, and the distance between the left end point of the mouth and the right end point of the mouth; 3) The face orientation calculation module calculates the distance difference D between the geometric midpoint of the left eye and the geometric midpoint of the right eye relative to the geometric midpoint of the nose e , the distance D between the left eye geometric midpoint and the right eye geometric midpoint e0 , D e With D e0 The ratio T e =D e / D e0 , the distance difference D between the left end point of the mouth and the right end point of the mouth relative to the geometric midpoint of the nose n , the distance D between the left end point of the mouth and the right end point of the mouth n0 , D n With D n0 The ratio T n =D n / D n0 According to the preset calculation formula β1=(T e +T n )*90°, and calculate the horizontal rotation angle β1 of the service target face orientation and the line connecting the service target and the intelligent medical guidance device (2).

Citation Information

Patent Citations

  • A hospital intelligent medical guidance device and method

    CN108346455B

  • Intelligent image optimization method and system based on crowd image selection

    CN110335207A

  • Hospital diagnosis and treatment management system and method

    CN111477307A

  • Medical hierarchical diagnosis and treatment registration management method and system based on artificial intelligence

    CN114255855A

  • Medical service platform hospital guide analysis method and system based on intelligent response

    CN118538430A