An intelligent mobile robot based on the Internet of Things and a control method thereof

By designing an intelligent mobile robot based on the Internet of Things and integrating multi-function modules, the problems of large workload and low efficiency of delivery of medicines are solved, intelligent drug delivery and environmental monitoring between pharmacies and wards are realized, and the work efficiency of the hospital is improved. and data transmission capability.

CN115454087BActive Publication Date: 2024-12-06BEIJING ZHONGXUAN TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211182078.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-27
Publication Date
2024-12-06
Estimated Expiration
2042-09-27

AI Technical Summary

Technical Problem

Medical personnel have a large workload and lack of work, and the existing technology is difficult to efficiently realize the delivery tasks between pharmacies and wards, and lacks real-time environmental detection and data transmission capabilities.

Method used

Design an intelligent mobile robot based on the Internet of Things, integrating drug detection module, environmental detection module, path inspection module, ward recognition module, voice broadcast module, etc., and real-time connection with cloud servers through the Internet of Things communication module to realize drug delivery and Environmental monitoring, and dynamic obstacle avoidance and tracking are achieved using ultrasonic detectors and omnidirectional wheels.

Benefits of technology

Without changing the construction structure of the hospital, intelligent delivery of medicine between the pharmacy and the ward will be achieved, reducing the time for medical staff to deliver medicine, improving work efficiency, and integrating multifunctional modules such as graphics processing, dynamic obstacle avoidance, real-time tracking and environmental detection , realize the collaborative work of multiple robots.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115454087B_ABST
    Figure CN115454087B_ABST
Patent Text Reader

Abstract

The present invention discloses an intelligent mobile robot based on the Internet of Things and a control method thereof, the control method comprising the following steps: S1: setting a continuous line patrol path, sending medicine delivery information to a server and an intelligent mobile robot, finding medicine and putting it into the intelligent mobile robot; S2: parsing a data frame to obtain ward information, and judging whether there is medicine in the medicine box; S3: the robot starts the line patrol task and delivers medicine; S4: during the line patrol task, the robot continuously identifies the ward number until it moves to the target ward; S5: the intelligent mobile robot arrives at the target ward, prompts to take medicine, judges whether to take medicine, and finally returns to the pharmacy according to the stored path information. The present invention utilizes the Internet of Things technology to realize multi-robot real-time cloud monitoring, real-time human-computer interaction and multi-machine interaction; thereby realizing the medicine delivery task between the pharmacy and the ward, and greatly reducing the medicine delivery time of medical staff.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of hospital equipment, and in particular to an intelligent mobile robot based on the Internet of Things and a control method thereof. Background Art

[0002] The concepts of smart healthcare, "Internet healthcare" and "medical information" all reflect the application of electronic information technology in the medical field.

[0003] In order to alleviate the problems of shortage of medical personnel and heavy workload of medical personnel, an intelligent mobile robot based on the Internet of Things is provided. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides an intelligent mobile robot based on the Internet of Things and a control method thereof, which realize the task of delivering medicines between pharmacies and wards, and constantly utilize cloud technology to transmit the real-time environmental data of the hospital obtained by the environmental detection module to the cloud server, thereby realizing real-time detection of the status information of the mobile robot and the hospital environmental information, and ensuring long-term preservation of the data.

[0005] In order to achieve the above-mentioned invention object, the technical scheme adopted by the present invention is: it includes a bottom plate and a top plate fixed above the bottom plate, and a front baffle plate, a left plate, a right plate and a rear plate of the outer shell are also fixed between the bottom plate and the top plate, a camera bin support arm is fixed on the front baffle plate of the outer shell, a camera bin support arm is installed with a camera bin bracket, a camera bin is fixed on the camera bin bracket, and a ward identification module and a path patrol module are arranged in the camera bin bracket; a medicine box is fixed on the rear plate, and a drug detection module is installed inside the medicine box; an ultrasonic detector bracket is also arranged on the bottom plate; a number of omnidirectional wheels, a photoelectric encoder motor for driving the omnidirectional wheels and a five-way grayscale sensor module are arranged at the bottom of the bottom plate; a control module, a power supply module, a motor drive module, an environmental detection module, a positioning module, a liquid crystal display module, an Internet of Things communication module and a voice broadcast module are also arranged between the bottom plate and the top plate.

[0006] Furthermore, the control module, the positioning module, the liquid crystal display module and the Internet of Things communication module are integrated on the same circuit board, and the power module and the motor drive module are integrated on the same circuit board; the control module is respectively connected to the power module, the motor drive module, the environmental detection module, the positioning module, the liquid crystal display module, the Internet of Things communication module, the voice broadcast module, the path patrol module, the grayscale sensor module, the ward identification module, the anti-collision radar module, the drug detection module, and the photoelectric encoder motor; the motor drive module is connected to the photoelectric encoder motor; the power module provides power to the control module, the motor drive module, the path patrol module, the grayscale sensor module, the ward identification module, the anti-collision radar module and the photoelectric encoder motor.

[0007] Furthermore, an anti-collision radar module is arranged on the ultrasonic detector bracket, and a 360-degree steering gear for driving the ultrasonic detector bracket is also arranged on the bottom plate.

[0008] The control method of the intelligent mobile robot based on the Internet of Things includes the following steps:

[0009] S1: Set the continuous patrol path, send the medicine delivery information to the server and the intelligent mobile robot, and find the medicine and put it into the intelligent mobile robot;

[0010] S11: A continuous patrol route from the pharmacy to each ward is set on the ground of the hospital, and the ward staff sends data including the ward number and the drug list to the pharmacy server through the server;

[0011] S12: The pharmacy staff searches for the medicines according to the medicine list received from the server and puts the medicines into the medicine storage box of the intelligent mobile robot. Meanwhile, the pharmacy server sends the ward number information of the medicines to the intelligent mobile robot through the IoT communication module.

[0012] S2: The control module parses the data frame carrying the ward number information to obtain the ward information and determines whether there is medicine in the medicine box;

[0013] S21: The Internet of Things communication module of the intelligent mobile robot sends the received data frame of the ward number information to the control module;

[0014] S22: The control module receives and stores the data frame sent by the IoT communication module, parses the frame header and each byte of the data frame, and stores the information to obtain the target ward information;

[0015] S23: The medicine detection module detects the weight of the medicine box and determines whether there is medicine in the medicine box:

[0016] If no medicine is detected, a voice prompt of "Please put in medicine" is issued through the voice broadcast module; if medicine is detected, a voice prompt of "Start delivering medicine" is issued through the voice broadcast module, and step S3 is entered;

[0017] S3: The robot starts patrolling the line, delivering medicines, and identifying the ward number until it moves to the target ward;

[0018] S4: The intelligent mobile robot arrives at the target ward, prompts the patient to pick up the medicine, and determines whether the medicine is picked up successfully. After the medicine is picked up successfully, the robot returns to the pharmacy according to the stored path information.

[0019] Furthermore, step S3 also includes the following steps:

[0020] Step S31: the line patrol module starts the line patrol task, and the camera detects the line patrol path trajectory and feeds back data;

[0021] The line patrol module divides the camera's field of view into five ROI areas and determines whether the line patrol path is detected in the five ROI areas:

[0022] If the line patrol path is detected in the ROI area, the line patrol module sends a command "1" to the robot's control module. If the line patrol path is not detected in the ROI area, the line patrol module sends a command "0" to the robot's control module.

[0023] The robot's line patrol module transmits a string of 5-bit binary numbers to the control module. The order of the binary numbers represents the feedback data corresponding to the 5 ROI areas detected by the line patrol module.

[0024] Step S32: The control module calculates the robot's posture adjustment data U(k) based on the feedback data;

[0025] The robot's control module receives the feedback data and makes a judgment to obtain the e(k) value;

[0026] Substitute the e(k) value into the posture adjustment formula to obtain the robot's posture adjustment data U(k); the robot's posture adjustment formula is:

[0027]

[0028] Step S31: the robot identifies the ward number on the patrol path, obtains the position and orientation of the target ward, and obtains the posture adjustment data U(k) until it moves to the target ward;

[0029] The robot's ward recognition module starts to identify the ward number on the patrol path. The ward recognition module uses the YOLOv2 target detection algorithm to detect the ward information. The ward recognition module obtains the position and type of the output bounding box of the ward information in the output layer through scanning, obtains the ward number and the center coordinates of the bounding box, and sends the ward number to the server.

[0030] The server obtains the corresponding location information according to the ward number, and feeds the location information back to the intelligent mobile robot, so that the intelligent mobile robot obtains the location and orientation of the target ward;

[0031] The intelligent mobile robot continuously moves along the patrol path and continuously calculates and obtains the posture adjustment data U(k) until the intelligent mobile robot moves to the target ward.

[0032] Furthermore, in step S32, the method for obtaining the value of e(k) corresponding to the feedback data is as follows:

[0033] S321: If the feedback data received by the control module of the robot is "00100", the current center position of the robot is directly above the road track, that is, the robot is driving normally according to the route, and e(k) is set to 0;

[0034] If the feedback data received by the robot's control module is "01000 or 10000", the current center position of the robot is on the left side of the path trajectory, and the robot's posture needs to be adjusted. At this time, set e(k) = x;

[0035] If the feedback data received by the robot's control module is: "00010 or 00001", it means that the current center position of the robot is on the left side of the path trajectory, so the robot's posture needs to be adjusted, so e(k)=-x.

[0036] Furthermore, the line patrol module is an OpenMV visual processing module, the ward identification module is a K210 visual processing module, and the drug detection module is a weight sensor.

[0037] The beneficial effects of the present invention are:

[0038] 1. Make full use of the existing building structure resources of the hospital and deploy intelligent mobile robots without changing the hospital building structure and ward distribution.

[0039] 2. Integrate multifunctional modules such as graphics processing, Internet of Things, dynamic obstacle avoidance, real-time tracking, voice broadcast, environmental detection, emergency call, and real-time location update.

[0040] 3. Realize multi-robot collaborative work to solve the defect of low work efficiency caused by occupying the drug delivery path.

[0041] 4. Use the Internet of Things technology to achieve real-time cloud monitoring of multiple robots, real-time human-machine interaction, and multi-machine interaction. This will enable the task of delivering medicines between pharmacies and wards, greatly reducing the time it takes for medical staff to deliver medicines. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is a mechanical structure diagram of the intelligent mobile robot based on the Internet of Things of the present invention.

[0043] Figure 2 This is a diagram of the internal structure of the intelligent mobile robot based on the Internet of Things of the present invention.

[0044] Figure 3 This is a hardware circuit structure diagram of the intelligent mobile robot based on the Internet of Things of the present invention.

[0045] Figure 4 The figure is a working principle diagram of the line patrol module of the intelligent mobile robot based on the Internet of Things of the present invention.

[0046] Figure 5 This is a functional schematic diagram of the ward identification module of the intelligent mobile robot based on the Internet of Things of the present invention.

[0047] Figure 6 The present invention is a flowchart of the intelligent mobile robot based on the Internet of Things.

[0048] Figure 7 This is a diagram of the Internet of Things communication structure of the intelligent mobile robot based on the Internet of Things of the present invention.

[0049] The main components in the figure are described as follows:

[0050] 1. Bottom plate; 2. Top plate; 3. Front baffle of the shell; 4. Left side plate; 5. Back plate; 6. Medicine box; 7. Camera compartment support arm; 8. Camera compartment bracket; 9. Camera compartment; 10. Omnidirectional wheel; 11. Ultrasonic detector bracket;

[0051] 20. Control module; 21. Power module; 22. Motor drive module; 23. Environmental monitoring module; 24. Positioning module; 25. LCD display module; 26. Internet of Things communication module; 27. Voice broadcast module; 28. Path patrol module; 29. ​​Grayscale sensor module; 30. Ward identification module; 31. Anti-collision radar module; 32. Drug detection module; 33. Photoelectric encoder motor. DETAILED DESCRIPTION

[0052] The specific embodiments of the present invention are described below to facilitate those skilled in the art to understand the present invention. However, it should be clear that the present invention is not limited to the scope of the specific embodiments. For those skilled in the art, as long as various changes are within the spirit and scope of the present invention defined and determined by the attached claims, these changes are obvious, and all inventions and creations using the concept of the present invention are protected.

[0053] like Figure 1 and 2 As shown, the intelligent mobile robot based on the Internet of Things includes a bottom plate 1 and a top plate 2 fixed above the bottom plate 1, and a shell front baffle 3, a left side plate 4, a right side plate and a rear plate 5 are also fixed between the bottom plate 1 and the top plate 2. A camera bin support arm 7 is fixed on the shell front baffle 3, and a camera bin bracket 8 is installed on the camera bin support arm 7. A camera bin 9 is fixed on the camera bin bracket 8, and a ward identification module 30 and a path patrol module 28 are arranged in the camera bin bracket 8. The camera bin 9 and the camera bin bracket 8 are connected by a U-shaped bracket, and the camera bin bracket 8 is provided with a vertically arranged strip through hole, and the U-shaped bracket is fixed to the camera bin bracket 8 by bolts. The drug detection module 21 is installed at the bottom of the medicine box 6, and the drug detection module 32 is preferably a weight sensor.

[0054] A medicine box 6 is fixed on the rear plate 5, and a medicine detection module 32 is installed inside the medicine box 6; an ultrasonic detector bracket 11 is also provided on the base plate 1; a plurality of omnidirectional wheels 10, a photoelectric encoder motor 33 for driving the omnidirectional wheels 10, and a five-way grayscale sensor module 29 are provided at the bottom of the base plate 1.

[0055] A control module 20 , a power module 21 , a motor drive module 22 , an environment detection module 23 , a positioning module 24 , a liquid crystal display module 25 , an Internet of Things communication module 26 and a voice broadcast module 27 are also provided between the bottom plate 1 and the top plate 2 .

[0056] The control module 20, the positioning module 24, the liquid crystal display module 25 and the Internet of Things communication module 26 are integrated on the same circuit board, and the power module 21 and the motor drive module 22 are integrated on the same circuit board; the control module 20 is respectively connected with the power module 21, the motor drive module 22, the environment detection module 23, the positioning module 24, the liquid crystal display module 25, the Internet of Things communication module 26, the voice broadcast module 27, the path patrol module 28, the grayscale sensor module 29, the ward identification module 30, the anti-collision radar module 31, the drug detection module 32, and the photoelectric encoder motor 33; the motor drive module 22 is connected with the photoelectric encoder motor 33; the power module 21 provides power for the control module 20, the motor drive module 22, the path patrol module 28, the grayscale sensor module 29, the ward identification module 30, the anti-collision radar module 31 and the photoelectric encoder motor 33. Figure 3 This is a hardware circuit structure diagram of the intelligent mobile robot based on the Internet of Things of the present invention.

[0057] An anti-collision radar module 31 is arranged on the ultrasonic detector bracket 11 , and a 360-degree steering gear for driving the ultrasonic detector bracket 11 is also arranged on the bottom plate 1 .

[0058] The line patrol module is preferably an OpenMV visual processing module, the ward identification module is preferably a K210 visual processing module, and the drug detection module is preferably a weight sensor.

[0059] Furthermore, the voice broadcast module 27 is a speaker, and the voice broadcast module 27 is used to remind pedestrians and prompt drug delivery information; the control module is a STM32F407ZGT6 controller;

[0060] Furthermore, the Internet of Things communication module 26 is used for data transmission between the cloud server and the medicine delivery vehicle, and for the control module to transmit data to the remote server or for the remote server to issue instructions to the vehicle;

[0061] Furthermore, the anti-collision radar module 31 is an ultrasonic radar module, which cooperates with a 360-degree steering engine to realize a large-range rotation scanning obstacle information, and is used for the intelligent mobile robot to transmit the surrounding obstacle information to the control module 20 when performing the medicine delivery task;

[0062] Furthermore, the ward identification module 11 uses a camera module to identify the ward number and sends the identified ward information to the control module for processing, and the path patrol module uses a camera module to identify the path information and sends the identified path information to the control module for processing;

[0063] Furthermore, the environment detection module 23 includes a temperature and humidity detection module and a toxic gas detection module, which are used for the temperature, humidity, and harmful gases of the hospital environment and send the detection information to the control module;

[0064] Furthermore, the liquid crystal display module 25 is used to display information such as medicine delivery information, temperature, humidity, time and date, and current ward;

[0065] Furthermore, the positioning module 24 is a GPS module for monitoring the real-time position of the intelligent mobile robot.

[0066] The control module is preferably an STM32F407ZGT6 chip, the motor drive module is preferably a BTS7960 high-power DC motor drive, the environmental monitoring module is preferably a DHT22 temperature and humidity module and a CO2 detection module, the positioning module is preferably a GPS module, the LCD display module is preferably a tft LCD display module, the Internet of Things communication module is preferably an ESP8266 module, the voice broadcast module is preferably a speaker, the path patrol module is preferably an OPenMV visual module, the grayscale sensor module is preferably a five-way grayscale sensor, the ward identification module is preferably a K210 module, the anti-collision radar module is preferably an ultrasonic radar, and the drug detection module is preferably a gravity sensor module.

[0067] S1: Set up a continuous patrol path, send medicine delivery information to the server and the intelligent mobile robot, and find the medicine and put it into the intelligent mobile robot; Figure 6 As shown, this is the flow chart of the automatic line patrol program design of the intelligent mobile robot;

[0068] S11: A continuous patrol route from the pharmacy to each ward is set on the ground of the hospital, and the ward staff sends data including the ward number and the drug list to the pharmacy server through the server;

[0069] S12: The pharmacy staff searches for the medicines according to the medicine list received from the server and puts the medicines into the medicine storage box of the intelligent mobile robot. Meanwhile, the pharmacy server sends the ward number information of the medicines to the intelligent mobile robot through the IoT communication module.

[0070] A continuous patrol route from the pharmacy to each ward is set up on the ground of the hospital. The ward staff sends data including the ward number and the drug list to the pharmacy server through the server. The pharmacy staff finds the drugs according to the drug list received by the server and puts the drugs into the medicine storage box of the intelligent mobile robot. At the same time, the pharmacy server sends the ward number information of the delivered drugs to the intelligent mobile robot through the Internet of Things communication module; the information sent by the cloud server to the intelligent mobile robot mainly includes ward information, time and date, and related instructions, and a data frame with a length of 7 bytes is used to transmit information; the first byte is the data frame header, the second and third bytes are time information, the fourth and fifth bytes are date information, the sixth byte is instruction information, and the seventh byte is the data frame tail;

[0071] S2: The control module parses the data frame carrying the ward number information to obtain the ward information and determines whether there is medicine in the medicine box; Figure 7 As shown, it is a communication schematic diagram between the control module and the server;

[0072] S21: The Internet of Things communication module of the intelligent mobile robot sends the received data frame of the ward number information to the control module;

[0073] S22: The control module receives and stores the data frame sent by the IoT communication module, parses the frame header and each byte of the data frame, and stores the information to obtain the target ward information;

[0074] S23: The medicine detection module detects the weight of the medicine box and determines whether there is medicine in the medicine box:

[0075] If no medicine is detected, a voice prompt of "Please put in medicine" is issued through the voice broadcast module; if medicine is detected, a voice prompt of "Start delivering medicine" is issued through the voice broadcast module, and step S3 is entered;

[0076] The IoT communication module of the intelligent mobile robot sends the received data to the control module. The control module stores the data frame sent by the IoT communication module and starts parsing the frame header of the data frame, as well as parsing each byte of the data frame and storing the information. The target ward information is obtained through the parsing. The drug detection module detects the weight of the medicine box to determine whether there is medicine in the medicine box. If no medicine is detected, the voice prompt "Please put in the medicine" is issued through the voice broadcast module; if medicine is detected, the voice prompt "Start delivering medicine" is issued through the voice broadcast module.

[0077] S3: The robot starts patrolling the line, delivering medicines, and identifying the ward number until it moves to the target ward;

[0078] Step S31: the line patrol module starts the line patrol task, and the camera detects the line patrol path trajectory and feeds back data;

[0079] The line patrol module divides the camera's field of view into five ROI areas and determines whether the line patrol path is detected in the five ROI areas:

[0080] If the line patrol path is detected in the ROI area, the line patrol module sends a command "1" to the robot's control module. If the line patrol path is not detected in the ROI area, the line patrol module sends a command "0" to the robot's control module. Figure 4 As shown, it is a working principle diagram of the line patrol module of the intelligent mobile robot based on the Internet of Things of the present invention;

[0081] The robot's line patrol module transmits a string of 5-bit binary numbers to the control module. The order of the binary numbers represents the feedback data corresponding to the 5 ROI areas detected by the line patrol module.

[0082] Step S32: The control module calculates the robot's posture adjustment data U(k) based on the feedback data;

[0083] The robot's control module receives the feedback data and makes a judgment to obtain the e(k) value;

[0084] Substitute the e(k) value into the posture adjustment formula to obtain the robot's posture adjustment data U(k); the robot's posture adjustment formula is:

[0085]

[0086] When the feedback data received by the robot's control module is "00100", it means that the current center position of the robot is directly above the road track, that is, the robot is driving normally according to the route. At this time, set e(k) = 0;

[0087] If the feedback data received by the robot's control module is: "01000 or 10000", it means that the current center position of the robot is on the left side of the path trajectory, so the robot's posture needs to be adjusted, so e(k)=x;

[0088] If the feedback data received by the robot's control module is: "00010 or 00001", it means that the current center position of the robot is on the left side of the path trajectory, so the robot's posture needs to be adjusted, so e(k)=-x.

[0089] If the feedback data received by the robot's control module contains multiple "1" data, such as "11100 or 00111", it means that the robot is currently at a crossroads. At this time, the robot's control system will judge the data according to the priority algorithm. The third bit of data has the highest priority, the first priority is higher than the second bit, the second priority is higher than the fourth bit, and the fourth priority is higher than the fifth bit. Therefore, the robot's control module will prioritize the third bit of data information, and then judge the first bit, the second bit, the fourth bit, and the fifth bit in turn. And set e(k) accordingly.

[0090] The line patrol module OpenMV stores the data of each ROI module in a character array variable with a length of 7. The first byte is the frame header of the data frame, the second byte represents the ROI area value of L2, the third byte represents the ROI area value of L1, the fourth byte represents the ROI area value of M, the fifth byte represents the ROI area value of R1, the sixth byte represents the ROI area value of R2, and the seventh byte is the end of the data frame; the data processing center of the control module outputs the corresponding action based on this information. The specific control method is as follows:

[0091] When the second byte (byte2) is 0, the third byte (byte3) is 0, the fourth byte (byte4) is 1, the fifth byte (byte5) is 0, and the sixth byte (byte6) is 0, it means that the car is currently driving in the center of the path, and the position error is 0;

[0092] When the second byte (byte2) is 1, the third byte (byte3) is 0, the fourth byte (byte4) is 0, the fifth byte (byte5) is 0, and the sixth byte (byte6) is 0, it means that the car is currently traveling on the rightmost side of the path and the position error is large;

[0093] When the second byte (byte2) is 0, the third byte (byte3) is 1, the fourth byte (byte4) is 0, the fifth byte (byte5) is 0, and the sixth byte (byte6) is 0, it means that the car is currently traveling on the right side of the path and the position error is small;

[0094] When the second byte (byte2) is 0, the third byte (byte3) is 0, the fourth byte (byte4) is 0, the fifth byte (byte5) is 1, and the sixth byte (byte6) is 0, it means that the car is currently driving on the leftmost side of the path and the position error is large;

[0095] When the second byte (byte2) is 0, the third byte (byte3) is 0, the fourth byte (byte4) is 0, the fifth byte (byte5) is 0, and the sixth byte (byte6) is 1, it means that the car is currently traveling on the left side of the path and the position error is small;

[0096] When multiple ROI values ​​are all 1, the control module of the intelligent robot will process according to the priority algorithm. The fourth byte (byte4) has the highest priority, the second byte (byte2) has a higher priority than the third byte (byte3), the third byte (byte3) has a higher priority than the fifth byte (byte5), and the fifth byte (byte5) has a higher priority than the sixth byte (byte6). Therefore, when the control module receives the data frame sent back by the line patrol module, the control module will first judge the fourth byte (byte4), and then judge the second byte (byte2), the third byte (byte3), the fifth byte (byte5), and the sixth byte (byte6) in turn, and make a corresponding response.

[0097] Step S31: the robot identifies the ward number on the patrol path, obtains the position and orientation of the target ward, and obtains the posture adjustment data U(k) until it moves to the target ward;

[0098] The robot's ward recognition module starts to recognize the ward number. The ward recognition module uses the YOLOv2 target detection algorithm to detect the ward information. The ward recognition module obtains the position and type of the ward information output bounding box in the output layer through scanning; t x ,t y ,t w ,t h are the horizontal coordinate, vertical coordinate, cell width and cell length of the cell center coordinates respectively; c x 、c y are the distances from the center of the bounding box to the upper left corner of the grid; p h 、p w are the width and height of the anchor box respectively; is the sigmoid function; b x and b y are the horizontal and vertical coordinates of the center coordinates of the bounding box to be predicted, respectively, w and b hare the width and height of the bounding box to be predicted respectively; obtain the ward number and the center coordinates of the bounding box, and send the ward number to the server. The server obtains the corresponding location information based on the ward number, and feeds the location information back to the intelligent mobile robot, so that the intelligent mobile robot obtains the location and orientation of the target ward. The intelligent mobile robot continuously moves along the patrol path and continuously calculates and obtains the posture adjustment data U(k) until the intelligent mobile robot moves to the target ward.

[0099] The algorithm program design process of the ward identification module is as follows: the control module of the mobile robot will parse the data received from the Internet of Things module, and send the target ward to the ward identification module. The ward identification module starts to identify the ward number of each ward and verify the identified ward number with the target ward. If the ward is identified to contain the target ward, the relative coordinates of the identified target ward and the target ward number in the entire field of view are stored in an integer array of length 5. The first array element is the data frame header, the second array element is the identified target ward, the third array element is the x-coordinate of the center coordinate of the ward number, the fourth array element is the y-coordinate of the center coordinate of the ward number, and the fifth array element is the data frame tail. After receiving the data, the control module of the mobile robot will first verify whether the identified target ward is correct. If it is wrong, the data will be discarded. If it is correct, the center coordinates of the target ward will be processed; for example: the second array data element is 3, the third array data element is 100, and the fourth array data element is 100. , it means that the identified target ward number is 3, and the middle coordinate of the bounding box is (100, 100); if the control module of the intelligent mobile robot receives data from the ward identification module containing the target ward, the control module of the intelligent mobile robot will read the third array element of the data, determine the orientation in the horizontal plane coordinate system of the ward, drive the motor to perform the corresponding steering operation, and store the path information of its own movement until the car reaches the target ward;

[0100] S4: The intelligent mobile robot arrives at the target ward, prompts the patient to pick up the medicine, determines whether to pick up the medicine, and finally returns to the pharmacy according to the stored path information;

[0101] When the intelligent mobile robot arrives at the target ward, the voice broadcast module of the intelligent mobile robot will issue a voice prompt of "Please take out the medicine". At the same time, the drug detection module in the medicine storage box of the intelligent mobile robot determines whether the medicine is taken out by detecting the weight of the medicine box; if the drug detection module detects that the weight of the medicine box is greater than the weight of the medicine box itself, it means that the medicine has not been taken out. If the drug detection module detects that the weight of the medicine box is less than or equal to the weight of the medicine box itself, it means that the medicine has been taken out. The intelligent mobile robot executes the next step of the return mission and transmits the completion information of the medicine delivery mission to the cloud server. Finally, the intelligent mobile robot returns to the pharmacy according to the stored path information and waits for the next medicine delivery mission.

[0102] like Figure 5 As shown, t x ,t y ,t w ,t h are the horizontal coordinate, vertical coordinate, cell width and cell length of the cell center coordinates respectively; c x 、c y are the distances from the center of the bounding box to the upper left corner of the grid; ph, p w are the width and height of the anchor box respectively; is the sigmoid function; b x and b y are the horizontal and vertical coordinates of the center coordinates of the bounding box to be predicted, respectively, w and b h are the width and height of the bounding box to be predicted.

Claims

1. A control method for an intelligent mobile robot based on the Internet of Things, the intelligent mobile robot based on the Internet of Things comprising a bottom plate (1) and a top plate (2) fixed above the bottom plate (1), a housing front baffle (3), a left side plate (4), a right side plate and a rear plate (5) being fixed between the bottom plate (1) and the top plate (2), a camera bin support arm (7) being fixed on the housing front baffle (3), a camera bin bracket (8) being installed on the camera bin support arm (7), a camera bin (9) being fixed on the camera bin bracket (8), and a ward identification module (30) and a path patrol module (28) being arranged in the camera bin bracket (8) A medicine box (6) is fixed on the rear plate (5), and a medicine detection module (32) is installed inside the medicine box (6); an ultrasonic detector bracket (11) is also provided on the bottom plate (1); a plurality of omnidirectional wheels (10), a photoelectric encoder motor (33) for driving the omnidirectional wheels (10), and a five-way grayscale sensor module (29) are provided at the bottom of the bottom plate (1); a control module (20), a power supply module (21), a motor drive module (22), an environment detection module (23), a positioning module (24), a liquid crystal display module (25), an Internet of Things communication module (26) and a control module (20) are also provided between the bottom plate (1) and the top plate (2). The control module (20), the positioning module (24), the liquid crystal display module (25), and the Internet of Things communication module (26) are integrated on the same circuit board, and the power module (21) and the motor drive module (22) are integrated on the same circuit board; the control module (20) is respectively connected to the power module (21), the motor drive module (22), the environment detection module (23), the positioning module (24), the liquid crystal display module (25), the Internet of Things communication module (26), the voice broadcast module (27), the path patrol module (28), the grayscale sensor module (29), and the ward identification module (30). , an anti-collision radar module (31), a drug detection module (32), and a photoelectric encoder motor (33); the motor drive module (22) is connected to the photoelectric encoder motor (33); the power supply module (21) provides power to the control module (20), the motor drive module (22), the path patrol module (28), the grayscale sensor module (29), the ward identification module (30), the anti-collision radar module (31), and the photoelectric encoder motor (33); the ultrasonic detector bracket (11) is provided with an anti-collision radar module (31), and the bottom plate (1) is also provided with a 360-degree steering gear for driving the ultrasonic detector bracket (11); It is characterized in that The steps include: S1: Set the continuous patrol path, send the medicine delivery information to the server and the intelligent mobile robot, and find the medicine and put it into the intelligent mobile robot; S11: A continuous patrol route from the pharmacy to each ward is set on the ground of the hospital, and the ward staff sends data including the ward number and the drug list to the pharmacy server through the server; S12: The pharmacy staff searches for the medicines according to the medicine list received from the server and puts the medicines into the medicine storage box of the intelligent mobile robot. Meanwhile, the pharmacy server sends the ward number information of the medicines to the intelligent mobile robot through the IoT communication module. S2: The control module parses the data frame carrying the ward number information to obtain the ward information and determines whether there is medicine in the medicine box; S21: The Internet of Things communication module of the intelligent mobile robot sends the received data frame of the ward number information to the control module; S22: The control module receives and stores the data frame sent by the IoT communication module, parses the frame header and each byte of the data frame, and stores the information to obtain the target ward information; S23: The medicine detection module detects the weight of the medicine box and determines whether there is medicine in the medicine box: If no medicine is detected, a voice prompt of "Please put in medicine" is issued through the voice broadcast module; if medicine is detected, a voice prompt of "Start delivering medicine" is issued through the voice broadcast module, and step S3 is entered; S3: The robot starts patrolling the line, delivering medicines, and identifying the ward number until it moves to the target ward. The specific steps include the following: Step S31: the line patrol module starts the line patrol task, and the camera detects the line patrol path trajectory and feeds back data; The line patrol module divides the camera's field of view into five ROI areas and determines whether the line patrol path is detected in the five ROI areas: If the line patrol path is detected in the ROI area, the line patrol module sends a command "1" to the robot's control module; if the line patrol path is not detected in the ROI area, the line patrol module sends a command "0" to the robot's control module; The robot's line patrol module transmits a string of 5-bit binary numbers to the control module. The order of the binary numbers represents the feedback data corresponding to the 5 ROI areas detected by the line patrol module. Step S32: The control module calculates the robot's posture adjustment data based on the feedback data ; The robot's control module receives the feedback data and makes a judgment to obtain the value. value; Will Substitute the value into the posture adjustment formula to obtain the posture adjustment data of the robot ; The robot's posture adjustment formula is: When the feedback data received by the robot's control module is: "00100", the current center position of the robot is directly above the path track, that is, the robot is driving normally according to the route. ; If the feedback data received by the robot's control module is: "01000 or 10000", the current center position of the robot is on the left side of the path trajectory, and the robot's posture is adjusted. At this time, set ; If the feedback data received by the robot's control module is: "00010 or 00001", the current center position of the robot is on the left side of the path trajectory, so adjust the robot's posture. At this time, set ; If the feedback data received by the robot's control module is "11100 or 00111", the robot is currently at a crossroads. At this time, the robot's control system judges the data according to the priority algorithm; the third bit of the data has the highest priority, the first priority is higher than the second bit, the second priority is higher than the fourth bit, and the fourth priority is higher than the fifth bit; therefore, the robot's control module prioritizes the third bit of information, and then judges the first bit, the second bit, the fourth bit, and the fifth bit in turn; and sets the corresponding ; Step S31: The robot identifies the ward number on the patrol path, obtains the location and orientation of the target ward, and obtains the posture adjustment data , until moving to the target ward; The robot's ward recognition module starts to identify the ward number on the patrol path. The ward recognition module uses the YOLOv2 target detection algorithm to detect the ward information. The ward recognition module obtains the position and type of the output bounding box of the ward information in the output layer through scanning, obtains the ward number and the center coordinates of the bounding box, and sends the ward number to the server. The server obtains the corresponding location information according to the ward number, and feeds the location information back to the intelligent mobile robot, so that the intelligent mobile robot obtains the location and orientation of the target ward; The intelligent mobile robot continuously moves along the patrol path and continuously calculates and obtains posture adjustment data. , until the intelligent mobile robot moves to the target ward; S4: The intelligent mobile robot arrives at the target ward, prompts the patient to pick up the medicine, and determines whether the medicine is picked up successfully. After the medicine is picked up successfully, the robot returns to the pharmacy according to the stored path information.

2. The control method of the intelligent mobile robot based on the Internet of Things according to claim 1 is characterized in that: In step S32, the feedback data corresponds to The value is obtained as follows: S321: If the feedback data received by the robot's control module is "00100", the current center position of the robot is directly above the path, that is, the robot is driving normally according to the route. ; If the feedback data received by the robot's control module is "01000 or 10000", the current center position of the robot is on the left side of the path trajectory, and the robot's posture needs to be adjusted. At this time, set ; If the feedback data received by the robot's control module is: "00010 or 00001", it means that the current center position of the robot is on the left side of the path trajectory, so the robot's posture needs to be adjusted. .

3. The control method of the intelligent mobile robot based on the Internet of Things according to claim 1 is characterized in that: The line patrol module is an OpenMV visual processing module, the ward identification module is a K210 visual processing module, and the drug detection module is a weight sensor.

Citation Information

Patent Citations

  • Intelligent walking medicine delivery vehicle and delivery method thereof

    CN114668607A

  • Intelligent medical care service medicine delivery system

    CN217213486U