Intelligent emergency ambulance system based on voice control and operation method

Abstract

The invention discloses an intelligent emergency ambulance system based on voice control and an operation method, and the system comprises a determination module which collects a voice signal of a medical worker and judges whether the voice signal is a voice instruction, if yes, the instruction attribute of the voice instruction is analyzed, and the advancing destination demand and the operation item demand are determined according to the instruction attribute; the reminding module plans a moving path based on the traveling destination demand, displays a navigation route, monitors the position parameters of the emergency ambulance in the traveling process and reminds the arrival of the destination based on the position parameters; the recording module is used for determining first-aid equipment and first-aid medicines according to operation item requirements and recording operation duration parameters and operation process parameters of medical staff on the first-aid equipment and the first-aid medicines; and the generation module uploads the operation duration parameter and the operation process parameter to a medical information system, carries out inventory checking on first-aid equipment and first-aid medicines, generates a replenishment list and uploads the replenishment list to a logistics system. Accurate recognition work of multiple types of voice instructions can be ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent control of emergency vehicles, and in particular to an intelligent emergency vehicle system and an operation method based on voice control. Background Art

[0002] At present, with the acceleration of the urbanization process and the frequent occurrence of public health emergencies, the limitations of traditional emergency vehicle systems in response speed, operation coordination, and intelligent decision-making capabilities have become increasingly prominent. In the prior art, the fragmented design of internal equipment control, information interaction, and rescue processes in emergency vehicles has become the core bottleneck restricting emergency rescue efficiency. The specific technical defects are as follows: Due to the simplification of voice commands, the system only supports simple commands (such as "start navigation"), unable to perform complex parameter adjustment or cross-device linkage operations, and manual recording of the emergency process is required, reducing work efficiency and stability. Summary of the Invention

[0003] In view of the problems shown above, the present invention provides an intelligent emergency vehicle system and an operation method based on voice control to solve the problems mentioned in the background art, such as the system only supporting simple commands due to the simplification of voice commands, being unable to perform complex parameter adjustment or cross-device linkage operations, and manual recording of the emergency process, reducing work efficiency and stability.

[0004] An intelligent emergency vehicle system based on voice control, the system includes:

[0005] A determination module, configured to collect the voice signal of medical staff and determine whether it is a voice command. If so, analyze the command attribute of the voice command, and determine the travel destination requirement and operation item requirement according to the command attribute;

[0006] A reminder module, configured to plan a moving path based on the travel destination requirement and display a navigation route, monitor the position parameters of the emergency vehicle during driving, and perform destination arrival reminder based on the position parameters;

[0007] A recording module, configured to determine emergency equipment and emergency drugs according to the operation item requirement, and record the operation duration parameter and operation process parameter of medical staff for the emergency equipment and emergency drugs;

[0008] A generation module, configured to upload the operation duration parameter and operation process parameter to the medical information system, and perform an inventory check of the emergency equipment and emergency drugs, and generate a replenishment list and upload it to the logistics system.

[0009] Preferably, the determination module includes:

[0010] A collection sub-module, configured to collect the voice signal of medical staff according to a high-sensitivity microphone array, and preprocess the voice signal;

[0011] A judgment sub-module for performing voice energy detection and wake-word detection on the pre-processed voice signal, and judging whether it is a voice command according to the detection results;

[0012] A recognition sub-module for performing voice recognition on the voice command according to the Transformer model, and recognizing the intention and entity of the voice command according to the recognition result and in combination with natural language processing technology;

[0013] An extraction sub-module for parsing the command attributes of the voice command according to the intention and entity of the voice command, and extracting keywords and information related to travel and operation according to the command attributes;

[0014] A first determination sub-module for determining the travel destination requirement and the operation item requirement according to the keywords and information;

[0015] Preferably, the judgment sub-module performs voice energy detection and wake-word detection on the pre-processed voice signal, including:

[0016] Framing the pre-processed voice signal at a preset time interval, and calculating the energy value of each frame according to the energy calculation formula;

[0017] Judging the voice activity segment according to the energy value and in combination with a preset energy threshold, and realizing the voice energy detection of the voice signal according to the voice activity segment;

[0018] Obtaining the voice data of a preset number of wake words and performing annotation of word attributes and word classification, and extracting features from the annotated voice data according to the Mel spectrogram;

[0019] Constructing a wake-word template according to the extracted voice data features, and determining the similarity between the input voice and the wake-word template based on the dynamic time warping algorithm;

[0020] Realizing the wake-word detection of the voice signal according to the similarity;

[0021] Preferably, the reminder module includes:

[0022] A planning sub-module for planning a moving path based on a path planning algorithm and real-time road condition information according to the travel destination requirement, and displaying the moving path based on a navigation system;

[0023] A first acquisition sub-module for obtaining the position information of the ambulance in real time according to the Beidou positioning system and in combination with the displayed route, and obtaining the speed and driving direction of the ambulance according to the position information of the ambulance;

[0024] A reminder sub-module, configured to draw the driving trajectory of the emergency vehicle according to the speed and driving direction of the emergency vehicle, estimate the time to reach the destination according to the driving trajectory, and remind the driver and medical staff through a reminder mechanism.

[0025] Preferably, the recording module includes:

[0026] A second determination sub-module, configured to obtain the operation type according to the operation item requirements, determine the risk level of the operation item according to the operation type, and identify possible emergencies according to the risk level;

[0027] A third determination sub-module, configured to determine first-aid equipment and first-aid drugs according to the possible emergencies;

[0028] A second acquisition sub-module, configured to obtain the operation duration parameters of the first-aid equipment and first-aid drugs according to the equipment usage automatic recording system and the intelligent access record system of the medicine cabinet;

[0029] A capture sub-module, configured to monitor the operating state of the first-aid equipment in real time according to a state sensor, and obtain the hand movement data of the medical staff using the first-aid equipment and first-aid drugs according to a hand movement capture system;

[0030] A fourth determination sub-module, configured to determine the operation process parameters of the first-aid equipment and first-aid drugs according to the operating state and the hand movement data;

[0031] Preferably, monitoring the operating state of the first-aid equipment in real time according to a state sensor includes:

[0032] Collecting the operating data of the equipment in real time according to a state sensor, and preprocessing the operating data;

[0033] Decomposing and separating the vibration signal according to the preprocessing result and combining empirical mode analysis and independent component analysis, and obtaining the characteristic signal in the operation process of the first-aid equipment according to the processing result;

[0034] Constructing a convolutional neural network model, and extracting key features from the characteristic signal in the operation process of the first-aid equipment;

[0035] Monitoring the operating state of the first-aid equipment in real time according to the extracted key features.

[0036] Preferably, the generation module includes:

[0037] A processing sub-module, configured to perform parameter preprocessing and formatting on the operation duration parameters and operation process parameters, and obtain data in a data format compatible with the medical information system;

[0038] An import sub-module for importing data in a data format compatible with the medical information system according to the API interface of the medical information system;

[0039] A third acquisition sub-module for taking inventory of first-aid equipment and first-aid drugs according to the import result, and obtaining the usage situation and inventory level of the first-aid equipment and first-aid drugs according to the inventory result;

[0040] A generation sub-module for generating a replenishment list based on the usage situation and inventory level and uploading it to the logistics system.

[0041] Preferably, after planning the moving path based on the path planning algorithm and real-time road condition information according to the requirements of the travel destination, the system is further used for:

[0042] Counting the number parameter of turning points and the statistical quantity parameter of multi-type lanes of the intelligent first-aid vehicle according to the moving path;

[0043] Obtaining the surrounding building complex information of each turning point based on the number parameter of turning points, determining the crowd gathering attribute according to the building complex information, and determining the turning decision influence weight based on the crowd gathering attribute;

[0044] Determining the turning time cost index when the intelligent first-aid vehicle passes through each turning point according to the turning decision influence weight, and determining the recommendation degree of each turning point according to the turning time cost index;

[0045] Selecting qualified turning points and unqualified turning points based on the recommendation degree of each turning point, and determining the alternative roads for each unqualified turning point;

[0046] Adjusting the moving path based on the alternative roads to obtain the first moving path, and determining the road-level path according to the statistical quantity parameter of multi-type lanes;

[0047] Converting the road-level path into a lane-level path, determining the lane-changing level convenience of the intelligent first-aid vehicle according to the lane-level path, and determining the multi-lane ratio qualification based on the lane-changing level convenience;

[0048] Determining the heading offset parameter of the intelligent first-aid vehicle according to the multi-lane ratio qualification and the preset planning duration parameter, and determining the offset compensation coefficient based on the heading offset parameter and the preset lane offset suppression factor;

[0049] Substituting the offset compensation coefficient into the preset offset compensation function to determine the theoretical offset direction within the preset planning duration;

[0050] Determining the multi-lane distribution parameter in the theoretical offset direction, and generating a lane-level information model and a road-level information model according to the multi-lane distribution parameter;

[0051] Plan multi-lane travel trajectories according to the lane layer information model and the road layer information model through the target search algorithm;

[0052] Adjust the first movement path according to the multi-lane travel trajectories to obtain a second movement path, and confirm the second movement path as the final movement path of the intelligent ambulance.

[0053] Preferably, the system is also used for:

[0054] Determine the in-station number of each first aid station to which the intelligent ambulance belongs, and determine the dynamic first aid response factors of each first aid station based on the in-station number through the first aid station database;

[0055] Determine the first aid status benefit index of each first aid station according to the dynamic first aid response factors, and determine the dispatching recommendation coefficient of each first aid station based on the first aid status benefit index:

[0056]

[0057] Among them, S i Represents the dispatching recommendation coefficient of the i-th first aid station, p i Represents the first aid status benefit index of the i-th first aid station, Ni represents the number of first aid adaptation targets of the i-th first aid station, j represents the j-th first aid adaptation target, d j Represents the decision variable complexity of the ambulance dispatching strategy corresponding to the j-th first aid adaptation target, e represents the natural constant, with a value of 2.72, Q i Represents the influence weight of the dispatching interference factor of the k-th first aid adaptation target, F i Represents the multiple first aid synchronization factors of the i-th first aid station, θ i Represents the ambulance dispatching task response index of the i-th first aid station;

[0058] Select the target first aid station with the highest dispatching recommendation index, determine the idle intelligent ambulances in the target first aid station, and generate a dispatching plan for the idle ambulances;

[0059] Based on the dispatching plan, conduct comprehensive dispatching of the idle ambulances.

[0060] An intelligent ambulance operation method based on voice control, including the following steps:

[0061] Collect the voice signals of medical staff and judge whether they are voice commands. If so, analyze the command attributes of the voice commands, and determine the travel destination requirements and operation item requirements according to the command attributes;

[0062] Plan the movement path based on the travel destination requirements and display the navigation route, monitor the position parameters of the ambulance during driving, and give a destination arrival reminder based on the position parameters;

[0063] Determine first-aid equipment and first-aid drugs according to the requirements of operation items, and record the operation duration parameters and operation process parameters of medical staff for the first-aid equipment and first-aid drugs;

[0064] Upload the operation duration parameters and operation process parameters to the medical information system, and conduct an inventory check of the first-aid equipment and first-aid drugs to generate a replenishment list and upload it to the logistics system.

[0065] Other features and advantages of the present invention will be described in the following specification, and, in part, will become apparent from the specification, or will be understood by implementing the present invention. The objectives and other advantages of the present invention can be achieved and obtained by the structures specifically pointed out in the written specification and the accompanying drawings.

[0066] The technical solutions of the present invention will be further described in detail below through the accompanying drawings and embodiments. Description of the Drawings

[0067] The drawings are used to provide a further understanding of the present invention, and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention.

[0068] Figure 1 It is a schematic structural diagram of an intelligent first-aid vehicle system based on voice control provided by the present invention;

[0069] Figure 2 It is a schematic structural diagram of a determination module in an intelligent first-aid vehicle system based on voice control provided by the present invention;

[0070] Figure 3 It is a schematic structural diagram of a generation module in an intelligent first-aid vehicle system based on voice control provided by the present invention;

[0071] Figure 4 It is a working flowchart of an operation method of an intelligent first-aid vehicle based on voice control provided by the present invention. Detailed Embodiments

[0072] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0073] At present, with the acceleration of the urbanization process and the frequent occurrence of public health emergencies, the limitations of traditional emergency ambulance systems in response speed, operation coordination, and intelligent decision-making capabilities have become increasingly prominent. In the existing technology, the fragmented design of internal equipment control, information interaction, and rescue processes in ambulances has become the core bottleneck restricting emergency rescue efficiency. The specific technical defects are as follows: Due to the simplification of voice commands, the system only supports simple commands (such as "start navigation"), unable to perform complex parameter adjustment or cross-device linkage operations, and manual recording of the emergency process is required, reducing work efficiency and stability. To solve the above problems, this embodiment discloses an intelligent emergency ambulance system based on voice control.

[0074] An intelligent emergency ambulance system based on voice control, as Figure 1 shown, the system includes:

[0075] A determination module 101, configured to collect the voice signal of medical staff and determine whether it is a voice command. If so, parse the command attributes of the voice command, and determine the travel destination requirements and operation item requirements according to the command attributes;

[0076] A reminder module 102, configured to plan a moving path based on the travel destination requirements and display a navigation route, monitor the position parameters of the ambulance during driving, and perform destination arrival reminders based on the position parameters;

[0077] A recording module 103, configured to determine emergency equipment and emergency drugs according to the operation item requirements, and record the operation duration parameters and operation process parameters of medical staff for the emergency equipment and emergency drugs;

[0078] A generation module 104, configured to upload the operation duration parameters and operation process parameters to a medical information system, perform an inventory check of the emergency equipment and emergency drugs, and generate a replenishment list and upload it to a logistics system.

[0079] The working principle of the above technical solution is as follows: First, the determination module collects the voice signal of medical staff and determines whether it is a voice command. If so, parse the command attributes of the voice command, and determine the travel destination requirements and operation item requirements according to the command attributes; Second, use the reminder module to plan a moving path based on the travel destination requirements and display a navigation route, monitor the position parameters of the ambulance during driving, and perform destination arrival reminders based on the position parameters; Then, based on the recording module, determine the emergency equipment and emergency drugs according to the operation item requirements, and record the operation duration parameters and operation process parameters of medical staff for the emergency equipment and emergency drugs; Finally, use the generation module to upload the operation duration parameters and operation process parameters to a medical information system, perform an inventory check of the emergency equipment and emergency drugs, and generate a replenishment list and upload it to a logistics system.

[0080] The beneficial effects of the above technical solution are as follows: By intelligently analyzing the voice commands issued by medical staff to determine operation requirements and movement requirements, various types of requirements of medical staff can be accurately obtained in real time, ensuring the accurate recognition of various types of voice commands, improving practicability and reliability. Further, by intelligently recording the usage parameters of drugs and equipment during the first aid process and then conducting statistics and inventory replenishment, the first aid process can be recorded by machine, improving work efficiency and stability, and solving the problems mentioned in the prior art that due to the simplification of voice commands, the system only supports simple commands, cannot implement complex parameter adjustment or cross-device linkage operations, and requires manual recording of the first aid process, reducing work efficiency and stability.

[0081] In one embodiment, as Figure 2 shown, the determination module 101 includes:

[0082] An acquisition sub-module 1011, configured to acquire the voice signal of medical staff according to a high-sensitivity microphone array and preprocess the voice signal;

[0083] A judgment sub-module 1012, configured to perform voice energy detection and wake-up word detection on the preprocessed voice signal, and judge whether it is a voice command according to the detection result;

[0084] An identification sub-module 1013, configured to perform voice recognition on the voice command according to the Transformer model, and identify the intention and entity of the voice command according to the recognition result and in combination with natural language processing technology;

[0085] An extraction sub-module 1014, configured to analyze the command attributes of the voice command according to the intention and entity of the voice command, extract keywords and information related to movement and operation according to the command attributes, and determine the travel destination requirements and operation item requirements according to the keywords and information.

[0086] In this embodiment, the high-sensitivity microphone array is a system composed of multiple high-sensitivity microphones arranged and combined according to a specific geometry, which can improve the signal-to-noise ratio and directivity.

[0087] In this embodiment, the command attributes include: operation commands or driving commands.

[0088] In this embodiment, the keywords and information related to movement can be: go to ward 101, go to the operating room.

[0089] In this embodiment, the keywords and information related to operation can be: prepare surgical instruments, view the patient's medical record.

[0090] The beneficial effects of the above technical solution are as follows: By recognizing the voice signals of medical staff, determining the intent and entities of voice commands, parsing the command attributes of voice commands, and obtaining keywords and information related to movement and operation, different needs can be quickly recognized, thus enabling accurate decision-making and improving the intelligence and safety of the first-aid system.

[0091] In one embodiment, the judgment sub-module performs voice energy detection and wake-word detection on the preprocessed voice signal, including:

[0092] Frame the preprocessed voice signal at a preset time interval, and calculate the energy value of each frame according to the energy calculation formula;

[0093] Judge the voice activity segment according to the energy value and in combination with a preset energy threshold, and realize the voice energy detection of the voice signal according to the voice activity segment;

[0094] Obtain the voice data of a preset number of wake words and perform annotation of word attributes and word classification, and extract features from the annotated voice data according to the Mel spectrogram;

[0095] Construct a wake-word template according to the extracted voice data features, and determine the similarity between the input voice and the wake-word template based on the dynamic time warping algorithm;

[0096] Realize the wake-word detection of the voice signal according to the similarity.

[0097] In this embodiment, the energy value of each frame refers to the sum of the squares of the signals within each frame after the audio signal is divided into several short time periods (frames), which reflects the intensity or energy level of the signal in this frame.

[0098] In this embodiment, the voice energy detection is used to judge whether there is voice activity in the voice signal and distinguish the voice segment and the non-voice segment.

[0099] In this embodiment, the word attribute of the wake word refers to the characteristics possessed by a specific word or phrase used to wake up the device and start the voice interaction function, such as: easy to pronounce, syllable difference.

[0100] The beneficial effects of the above technical solution are as follows: By judging the voice activity segment according to the energy value and in combination with a preset energy threshold to realize the voice energy detection of the voice signal, the voice processing efficiency is improved, the voice segment is accurately located, and the recognition error is reduced. Further, the wake-word detection of the voice signal is realized according to the similarity between the input voice and the wake-word template, which can accurately wake up the intelligent first-aid vehicle system, improve the recognition accuracy, and ensure the reliability of the first-aid vehicle system.

[0101] In one embodiment, the reminder module includes:

[0102] A planning sub-module for planning a moving path based on a path planning algorithm and real-time road condition information according to the travel destination requirement, and displaying the moving path based on a navigation system;

[0103] A first acquisition sub-module for acquiring the position information of the ambulance in real time according to the Beidou positioning system and in combination with the displayed route, and acquiring the speed and driving direction of the ambulance according to the position information of the ambulance;

[0104] A reminder sub-module for drawing the driving trajectory of the ambulance according to the speed and driving direction of the ambulance, estimating the time to reach the destination according to the driving trajectory, and reminding the driver and medical staff through a reminder mechanism.

[0105] In this embodiment, the reminder mechanism can be: voice, text.

[0106] The beneficial effects of the above technical solution are: planning a moving path according to the travel destination and path planning algorithm, acquiring the position information and driving direction of the ambulance, and estimating the time to reach the destination according to the driving trajectory of the ambulance, and sending a reminder, which can realize seamless connection between pre-hospital first aid and in-hospital treatment and improve the success rate of patient treatment.

[0107] In one embodiment, the recording module includes:

[0108] A second determination sub-module for acquiring an operation type according to the operation item requirement, determining the risk level of the operation item according to the operation type, and identifying possible emergency situations according to the risk level;

[0109] A third determination sub-module for determining first aid equipment and first aid drugs according to the possible emergency situations;

[0110] A second acquisition sub-module for acquiring the operation duration parameters of first aid equipment and first aid drugs according to an equipment usage automatic recording system and a medicine cabinet intelligent access recording system;

[0111] A capture sub-module for monitoring the operating state of first aid equipment in real time according to a state sensor, and acquiring the hand movement data of medical staff using first aid equipment and first aid drugs according to a hand movement capture system;

[0112] A fourth determination sub-module for determining the operation process parameters of first aid equipment and first aid drugs according to the operating state and hand movement data.

[0113] The beneficial effects of the above technical solution are as follows: First aid equipment and first aid drugs are determined according to the risk level, and the operation duration parameters and operation process parameters of the equipment and drugs are determined based on the equipment usage automatic recording system, the intelligent access record system of the medicine cabinet, and the status sensor, which can standardize the treatment process, avoid abnormal situations caused by improper operation or operation duration, improve the medical quality, and ensure the safe use of the equipment and drugs.

[0114] In one embodiment, the operation status of the first aid equipment is monitored in real time according to the status sensor, including:

[0115] The operation data of the equipment is collected in real time according to the status sensor, and the operation data is preprocessed.

[0116] The vibration signal is decomposed and separated according to the preprocessing result and combined with empirical mode analysis and independent component analysis, and the characteristic signal during the operation of the first aid equipment is obtained according to the processing result.

[0117] A convolutional neural network model is constructed, and key features are extracted from the characteristic signals during the operation of the first aid equipment.

[0118] The operation status of the first aid equipment is monitored in real time according to the extracted key features.

[0119] The beneficial effects of the above technical solution are as follows: By preprocessing the operation data of the first aid equipment, the characteristic signals during the operation of the first aid equipment are obtained and key features are extracted, so as to monitor the operation status of the first aid equipment in real time, quickly discover the abnormal operation status of the equipment, and ensure the reliability and safety of the equipment.

[0120] In one embodiment, as Figure 3 shown, the generation module 104 includes:

[0121] The processing sub-module 1041 is used to perform parameter preprocessing and formatting on the operation duration parameters and operation process parameters, and obtain data in a data format compatible with the medical information system.

[0122] The import sub-module 1042 is used to import the data in a data format compatible with the medical information system according to the API interface of the medical information system.

[0123] The third acquisition sub-module 1043 is used to count the first aid equipment and first aid drugs according to the import result, and obtain the usage situation and inventory level of the first aid equipment and first aid drugs according to the counting result.

[0124] The generation sub-module 1044 is used to generate a replenishment list according to the usage situation and inventory level and upload it to the logistics system.

[0125] The beneficial effects of the above technical solution are as follows: By importing data in a data format compatible with the medical information system and determining the inventory results of first aid equipment and first aid drugs based on the import results, a replenishment list can be generated, enabling timely and accurate understanding of the usage and inventory status of equipment and drugs, and timely replenishment to avoid medical accidents caused by insufficient inventory.

[0126] In one embodiment, after planning a moving path based on the path planning algorithm and real-time road condition information according to the travel destination requirements, the system is further configured to:

[0127] Count the number of turning points parameter and the statistical quantity parameters of multiple types of lanes of the intelligent first aid vehicle according to the moving path;

[0128] Obtain the surrounding building complex information of each turning point based on the number of turning points parameter, determine the crowd gathering attribute according to the building complex information, and determine the turning decision influence weight based on the crowd gathering attribute;

[0129] Determine the turning time cost index when the intelligent first aid vehicle passes through each turning point according to the turning decision influence weight, and determine the recommendation degree of each turning point according to the turning time cost index;

[0130] Select qualified turning points and unqualified turning points based on the recommendation degree of each turning point, and determine the alternative roads for each unqualified turning point;

[0131] Adjust the moving path based on the alternative roads to obtain the first moving path, and determine the road-level path according to the statistical quantity parameters of multiple types of lanes;

[0132] Convert the road-level path into a lane-level path, determine the lane-changing convenience of the intelligent first aid vehicle according to the lane-level path, and determine the qualified ratio of multiple lanes based on the lane-changing convenience;

[0133] Determine the heading offset parameter of the intelligent first aid vehicle according to the qualified ratio of multiple lanes and the preset planning duration parameter, and determine the offset compensation coefficient based on the heading offset parameter and the preset lane offset suppression factor;

[0134] Substitute the offset compensation coefficient into the preset offset compensation function to determine the theoretical offset direction within the preset planning duration;

[0135] Determine the multiple-lane distribution parameter in the theoretical offset direction, and generate a lane-level information model and a road-level information model according to the multiple-lane distribution parameter;

[0136] Plan a multi-lane travel trajectory through the target search algorithm according to the lane-level information model and the road-level information model;

[0137] Adjust the first moving path according to the multi-lane travel trajectory to obtain the second moving path, and confirm the second moving path as the final moving path of the intelligent emergency vehicle.

[0138] The beneficial effects of the above technical solution are as follows: By evaluating the turning points and multi-lanes on the moving path and then selecting alternative lanes, the traffic efficiency and stability of the intelligent emergency vehicle at the destination can be effectively guaranteed, and the time utilization rate can be maximized to improve the emergency efficiency.

[0139] In one embodiment, the system is further configured to:

[0140] Determine the in-station number of each first-aid station to which the intelligent emergency vehicle belongs, and determine the dynamic emergency response factors of each first-aid station through the first-aid station database based on the in-station number;

[0141] Determine the emergency status benefit index of each first-aid station according to the dynamic emergency response factors, and determine the scheduling recommendation coefficient of each first-aid station based on the emergency status benefit index:

[0142]

[0143] Where S i represents the scheduling recommendation coefficient of the i-th first-aid station, p i represents the emergency status benefit index of the i-th first-aid station, Ni represents the number of emergency adaptation targets of the i-th first-aid station, j represents the j-th emergency adaptation target, and d j represents the decision variable complexity of the emergency vehicle scheduling strategy corresponding to the j-th emergency adaptation target, e represents the natural constant, with a value of 2.72, Q i represents the scheduling interference factor influence weight of the k-th emergency adaptation target, F i represents the multiple emergency synchronization factors of the i-th first-aid station, and θ i represents the emergency vehicle scheduling task response index of the i-th first-aid station;

[0144] Select the target first-aid station with the highest scheduling recommendation index, determine the idle intelligent emergency vehicles in the target first-aid station, and generate a scheduling plan for the idle intelligent emergency vehicles;

[0145] Comprehensively schedule the idle emergency vehicles based on the scheduling plan.

[0146] The beneficial effects of the above technical solution are as follows: By calculating the scheduling recommendation coefficient of each first-aid station and then selecting the target first-aid station, the rapid response of each emergency battle to the emergency task and the emergency vehicle scheduling situation can be comprehensively evaluated based on the emergency target response parameters and synchronous emergency status parameters of each first-aid station, ensuring the scheduling efficiency of the emergency vehicle.

[0147] In one embodiment, this embodiment also discloses an intelligent first aid vehicle operation method based on voice control, as Figure 4 shown, including the following steps:

[0148] Step S401: Collect the voice signal of the medical staff and determine whether it is a voice command. If so, analyze the command attribute of the voice command, and determine the travel destination requirement and operation item requirement according to the command attribute;

[0149] Step S402: Plan a moving path based on the travel destination requirement and display the navigation route, monitor the position parameters of the first aid vehicle during driving, and give a destination arrival reminder based on the position parameters;

[0150] Step S403: Determine the first aid equipment and first aid drugs according to the operation item requirement, and record the operation duration parameter and operation process parameter of the medical staff for the first aid equipment and first aid drugs;

[0151] Step S404: Upload the operation duration parameter and operation process parameter to the medical information system, and conduct an inventory check of the first aid equipment and first aid drugs to generate a replenishment list and upload it to the logistics system.

[0152] The working principle and beneficial effects of the above technical solution have been described in the system embodiment, and will not be elaborated here.

[0153] Those skilled in the art should understand that the first and second in the present invention refer to different application stages.

[0154] After considering the specification and practicing the disclosure here, those skilled in the art will easily think of other implementation schemes of the present disclosure. This application aims to cover any variations, uses, or adaptive changes of the present disclosure, and these variations, uses, or adaptive changes follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0155] It should be understood that the present disclosure is not limited to the exact structure already described and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. An intelligent emergency ambulance system based on voice control, characterized in that, The system includes: A determination module, configured to collect the voice signal of medical staff and determine whether it is a voice command. If so, analyze the command attributes of the voice command, and determine the travel destination requirement and operation item requirement according to the command attributes; A reminder module, configured to plan a moving path based on the travel destination requirement and display a navigation route, monitor the position parameters of the ambulance during driving, and give a destination arrival reminder based on the position parameters; A recording module, configured to determine first-aid equipment and first-aid drugs according to the operation item requirement, and record the operation duration parameter and operation process parameter of the medical staff for the first-aid equipment and first-aid drugs; A generation module, configured to upload the operation duration parameter and operation process parameter to the medical information system, and conduct an inventory check of the first-aid equipment and first-aid drugs to generate a replenishment list and upload it to the logistics system.

2. The intelligent first-aid vehicle system based on voice control according to claim 1, wherein The determination module includes: A collection sub-module, configured to collect the voice signal of medical staff according to a high-sensitivity microphone array, and preprocess the voice signal; A judgment sub-module, configured to conduct voice energy detection and wake word detection on the preprocessed voice signal, and determine whether it is a voice command according to the detection result; An identification sub-module, configured to conduct voice recognition on the voice command according to a Transformer model, and identify the intention and entity of the voice command according to the recognition result and in combination with natural language processing technology; An extraction sub-module, configured to analyze the command attributes of the voice command according to the intention and entity of the voice command, and extract keywords and information related to travel and operation according to the command attributes; A first determination sub-module, configured to determine the travel destination requirement and operation item requirement according to the keywords and information.

3. The intelligent first-aid vehicle system based on voice control according to claim 2, characterized in that, The judgment sub-module conducts voice energy detection and wake word detection on the preprocessed voice signal, including: Framing the preprocessed voice signal at a preset time interval, and calculating the energy value of each frame according to an energy calculation formula; Judging a voice activity segment according to the energy value and in combination with a preset energy threshold, and realizing voice energy detection of the voice signal according to the voice activity segment; Obtaining the voice data of a preset number of wake words and conducting annotation of word attributes and word classification, and extracting features from the annotated voice data according to a Mel spectrogram; Constructing a wake word template according to the extracted voice data features, and determining the similarity between the input voice and the wake word template based on a dynamic time warping algorithm; Realizing wake word detection of the voice signal according to the similarity.

4. The intelligent first-aid vehicle system based on voice control according to claim 1, characterized in that, The reminder module includes: A planning sub-module, configured to plan a moving path based on the travel destination requirement according to a path planning algorithm and real-time road condition information, and display the moving path on a navigation system; A first acquisition sub-module, configured to obtain the position information of the ambulance in real time according to a Beidou positioning system and in combination with the displayed route, and obtain the speed and driving direction of the ambulance according to the position information of the ambulance; A reminder sub-module, configured to draw the driving trajectory of the ambulance according to the speed and driving direction of the ambulance, estimate the time to reach the destination according to the driving trajectory, and remind the driver and medical staff through a reminder mechanism.

5. The intelligent first-aid vehicle system based on voice control according to claim 1, characterized in that, The recording module includes: The second determination sub-module is used to obtain the operation type according to the operation item requirements, determine the risk level of the operation item according to the operation type, and identify the possible emergencies according to the risk level; The third determination sub-module is used to determine the first-aid equipment and first-aid drugs according to the possible emergencies; The second acquisition sub-module is used to obtain the operation duration parameters of the first-aid equipment and first-aid drugs according to the equipment use automatic recording system and the intelligent access record system of the medicine cabinet; The capture sub-module is used to monitor the running state of the first-aid equipment in real time according to the state sensor, and obtain the hand movement data of the medical staff using the first-aid equipment and first-aid drugs according to the hand movement capture system; The fourth determination sub-module is used to determine the operation process parameters of the first-aid equipment and first-aid drugs according to the running state and the hand movement data; 6. The intelligent first-aid vehicle system based on voice control according to claim 5, wherein Monitoring the running state of the first-aid equipment in real time according to the state sensor includes: Collecting the running data of the equipment in real time according to the state sensor, and preprocessing the running data; Decomposing and separating the vibration signal according to the preprocessing result and combining empirical mode analysis and independent component analysis, and obtaining the characteristic signal in the running process of the first-aid equipment according to the processing result; Constructing a convolutional neural network model, and extracting key features from the characteristic signals in the running process of the first-aid equipment; Monitoring the running state of the first-aid equipment in real time according to the extracted key features.

7. The intelligent first aid vehicle system based on voice control according to claim 1, wherein, The generation module includes: The processing sub-module is used to perform parameter preprocessing and formatting on the operation duration parameters and operation process parameters, and obtain data in a data format compatible with the medical information system; The import sub-module is used to import the data in a data format compatible with the medical information system according to the API interface of the medical information system; The third acquisition sub-module is used to count the first-aid equipment and first-aid drugs according to the import result, and obtain the usage and inventory level of the first-aid equipment and first-aid drugs according to the counting result; The generation sub-module is used to generate a replenishment list according to the usage and inventory level and upload it to the logistics system.

8. The intelligent first-aid vehicle system based on voice control according to claim 4, characterized in that, After planning the moving path based on the path planning algorithm and the real-time road condition information according to the traveling destination requirements, the system is also used for: Counting the number of turning points parameter and the multi-type lane statistics number parameter of the intelligent first-aid vehicle according to the moving path; Obtaining the surrounding building complex information of each turning point based on the number of turning points parameter, determining the crowd gathering attribute according to the building complex information, and determining the turning decision influence weight based on the crowd gathering attribute; Determining the turning time cost index when the intelligent first-aid vehicle passes through each turning point according to the turning decision influence weight, and determining the recommendation degree of each turning point according to the turning time cost index; Selecting qualified turning points and unqualified turning points based on the recommendation degree of each turning point, and determining the alternative roads for each unqualified turning point; Adjusting the moving path based on the alternative roads to obtain the first moving path, and determining the road-level path according to the multi-type lane statistics number parameter; Converting the road-level path into a lane-level path, determining the lane-changing level convenience of the intelligent first-aid vehicle according to the lane-level path, and determining the multi-lane proportion qualification based on the lane-changing level convenience; Determine the heading offset parameter of the intelligent first aid vehicle according to the multi-lane ratio qualification and the preset planning duration parameter, and determine the offset compensation coefficient based on the heading offset parameter and the preset lane offset suppression factor; Substitute the offset compensation coefficient into the preset offset compensation function to determine the theoretical offset direction within the preset planning duration; Determine the multi-lane distribution parameters in the theoretical offset direction, and generate a lane layer information model and a road layer information model according to the multi-lane distribution parameters; Plan the multi-lane travel trajectory through the target search algorithm according to the lane layer information model and the road layer information model; Adjust the first movement path according to the multi-lane travel trajectory to obtain the second movement path, and confirm the second movement path as the final movement path of the intelligent first aid vehicle.

9. The intelligent first-aid vehicle system based on voice control according to claim 1, wherein, The system is also used for: Determine the in-station number of each first aid station to which the intelligent first aid vehicle belongs, and determine the dynamic first aid response factor of each first aid station based on the in-station number through the first aid station database; Determine the first aid status benefit index of each first aid station according to the dynamic first aid response factor, and determine the scheduling recommendation coefficient of each first aid station based on the first aid status benefit index: Among them, S i represents the scheduling recommendation coefficient of the i-th first aid station, p i represents the first aid status benefit index of the i-th first aid station, Ni represents the number of first aid adaptation targets of the i-th first aid station, j represents the j-th first aid adaptation target, d j represents the decision variable complexity of the ambulance scheduling strategy corresponding to the j-th first aid adaptation target, e represents the natural constant, with a value of 2.72, Q i represents the influence weight of the scheduling interference factor of the k-th first aid adaptation target, F i represents the multiple first aid synchronization factor of the i-th first aid station, θ i represents the ambulance scheduling task response index of the i-th first aid station; Select the target first aid station with the highest scheduling recommendation index, determine the idle intelligent first aid vehicle in the target first aid station, and generate a scheduling plan for the idle intelligent first aid vehicle; Comprehensively schedule the idle first aid vehicle based on the scheduling plan.

10. An intelligent first aid vehicle operation method based on voice control, characterized in that, Including the following steps: Collect the voice signal of the medical staff and judge whether it is a voice command. If so, analyze the command attribute of the voice command, and determine the travel destination requirement and the operation item requirement according to the command attribute; Plan the movement path based on the travel destination requirement and display the navigation route, monitor the position parameter of the first aid vehicle during driving, and give a destination arrival reminder based on the position parameter; Determine the first aid equipment and first aid drugs according to the operation item requirement, and record the operation duration parameter and the operation process parameter of the medical staff for the first aid equipment and first aid drugs; Upload the operation duration parameter and the operation process parameter to the medical information system, and conduct an inventory check of the first aid equipment and first aid drugs to generate a replenishment list and upload it to the logistics system.

Images