Converged communication method, system and terminal based on voice dispatch, and storage medium

Abstract

The application provides a voice dispatching-based converged communication method, system, terminal and storage medium, the method comprising: determining a target image acquisition device according to an accident dispatching voice; displaying images of an accident scene according to the target image acquisition device, establishing an accident communication conference for the accident scene; storing conference voice in the accident communication conference, determining an accident dispatching instruction according to the conference voice; executing an accident personnel dispatching according to the accident dispatching instruction, obtaining an accident dispatching result and an accident processing result of the accident personnel dispatching for the accident scene; performing dispatching quality inspection analysis on the accident dispatching instruction according to the accident dispatching result and the accident processing result, and generating an event dispatching suggestion according to the dispatching quality inspection analysis result. The embodiment of the application can automatically perform dispatching quality inspection analysis on the accident dispatching instruction based on the accident dispatching result and the accident processing result, without using a manual dispatching quality inspection analysis method, thereby improving the accuracy of the accident dispatching instruction quality inspection.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a converged communication method, system, terminal and storage medium based on voice scheduling. Background Technology

[0002] Originating in the media field, smart cities refer to the application of intelligent computing technologies such as the Internet of Things, cloud computing, big data, and geospatial information integration in urban planning, design, construction, management, communication, and operation. This makes key infrastructure components and services of cities, including urban management, education, healthcare, real estate, transportation, public utilities, and public safety, more interconnected, efficient, and intelligent. This provides citizens with better living and working services, creates a more favorable business environment for enterprises, and empowers governments with more efficient operation and management mechanisms. In the process of building a safe environment for smart cities, a certain command, dispatch, and communication system is needed to quickly handle dangerous and major incidents, thereby ensuring the safety of the smart city.

[0003] In existing command and dispatch communication processes, the quality inspection and analysis of accident dispatch instructions are generally carried out manually, which is highly subjective and reduces the accuracy of accident dispatch instruction quality inspection in the process of integrated command and dispatch communication. Summary of the Invention

[0004] The purpose of this invention is to provide a converged communication method, system, terminal, and storage medium based on voice dispatch, aiming to solve the problem of low accuracy in the quality inspection of accident dispatch instructions in the existing command and dispatch communication process.

[0005] This invention is implemented as follows: a converged communication method based on voice scheduling, the method comprising:

[0006] Acquire the accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice;

[0007] The target image acquisition device displays images of the accident scene and establishes an accident communication conference for the accident scene;

[0008] Store the conference audio from the incident communication conference, and determine the incident dispatch instructions based on the conference audio;

[0009] The personnel dispatch is executed according to the accident dispatch instructions, and the accident dispatch results and accident handling results for the accident site are obtained.

[0010] Based on the accident scheduling results and the accident handling results, the accident scheduling instructions are subjected to scheduling quality inspection analysis, and event scheduling suggestions are generated based on the scheduling quality inspection analysis results.

[0011] Preferably, the scheduling quality inspection analysis of the accident scheduling instruction is performed based on the accident scheduling result and the accident handling result, including:

[0012] Based on the accident dispatch results and the accident handling results, determine the changes in the situation, and query the primary and secondary factors of the changes in the situation;

[0013] A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors.

[0014] The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction.

[0015] Preferably, determining the situation change based on the accident scheduling result and the accident handling result includes:

[0016] Obtain the expected scheduling result of the personnel dispatch in the accident, and compare and analyze the accident scheduling result with the expected scheduling result to obtain the accident scheduling efficiency;

[0017] Based on the accident scene, determine the accident handling requirements, and analyze the accident handling results based on the accident handling requirements to obtain the accident handling efficiency.

[0018] The situation change is generated based on the incident handling efficiency and the incident scheduling efficiency.

[0019] Preferably, establishing an accident communication conference for the accident site includes:

[0020] The type of accident is determined based on the accident footage from the accident scene, and the accident address of the accident scene is obtained;

[0021] Based on the accident address and the accident type, the meeting participants are determined, and accident meeting information is sent to each participant.

[0022] The incident communication conference is established based on the received response to the incident conference information, and the identities of each participant are marked in the incident communication conference.

[0023] Preferably, determining the incident dispatch instruction based on the conference voice includes:

[0024] The conference audio is filtered based on suggested words, and it is determined whether the filtered conference audio contains execution words.

[0025] If the conference audio contains execution words, then determine whether the conference audio contains a command identifier, which is used to represent the command authority of the conference personnel corresponding to the conference audio.

[0026] If the conference audio contains a command identifier, a confirmation instruction is sent to the conference participant corresponding to the command identifier based on the conference audio.

[0027] If a response to the confirmation instruction is received, the conference voice is identified as the incident dispatch instruction.

[0028] Preferably, the method for determining the target image acquisition device based on the accident dispatch voice includes:

[0029] The accident dispatch voice is subjected to speech recognition to obtain the first voice text, and entity recognition is performed on the first voice text.

[0030] The target words in the first speech text are determined based on the entity recognition results, and a device lookup table is determined based on the target words.

[0031] The target image acquisition device is determined based on the device communication address in the device lookup table.

[0032] Another objective of this invention is to provide a converged communication system based on voice scheduling, the system comprising:

[0033] The device determination module is used to acquire accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice;

[0034] The conference setup module is used to display images of the accident scene based on the target image acquisition device and to establish an accident communication conference for the accident scene.

[0035] The instruction determination module is used to store the conference voice in the accident communication conference and determine the accident dispatch instruction based on the conference voice;

[0036] The personnel dispatch module is used to execute accident personnel dispatch according to the accident dispatch instructions, and to obtain the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site;

[0037] The quality inspection and analysis module is used to perform scheduling quality inspection and analysis on the accident scheduling instructions based on the accident scheduling results and the accident handling results, and to generate event scheduling suggestions based on the scheduling quality inspection and analysis results.

[0038] Preferably, the quality inspection and analysis module is further used for:

[0039] Based on the accident dispatch results and the accident handling results, determine the changes in the situation, and query the primary and secondary factors of the changes in the situation;

[0040] A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors.

[0041] The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction.

[0042] Another objective of this invention is to provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method described above.

[0043] Another objective of this invention is to provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described method.

[0044] In this embodiment of the invention, the target image acquisition device can be automatically identified based on the accident dispatch voice, and the accident scene can be displayed based on the target image acquisition device. An accident communication conference can be automatically established for the accident site, improving the efficiency of voice dispatch. By storing the conference voice in the accident communication conference, the accident dispatch instructions can be automatically determined based on the conference voice. The accident personnel dispatch can be automatically executed based on the accident dispatch instructions. By obtaining the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site, the dispatch quality inspection analysis of the accident dispatch instructions can be automatically performed, eliminating the need for manual dispatch quality inspection analysis and improving the accuracy of accident dispatch instruction quality inspection. Attached Figure Description

[0045] Figure 1 This is a flowchart of the voice-based converged communication method provided in the first embodiment of the present invention;

[0046] Figure 2 This is a flowchart of the voice-based converged communication method provided in the second embodiment of the present invention;

[0047] Figure 3 This is a schematic diagram of the structure of the converged communication system based on voice scheduling provided in the third embodiment of the present invention;

[0048] Figure 4 This is a schematic diagram illustrating the specific implementation steps of the converged communication system based on voice scheduling provided in the third embodiment of the present invention;

[0049] Figure 5This is a schematic diagram of the structure of the terminal device provided in the fourth embodiment of the present invention. Detailed Implementation

[0050] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0051] To illustrate the technical solution described in this invention, specific embodiments are described below.

[0052] Example 1

[0053] Please see Figure 1 This is a flowchart of a voice-based converged communication method provided in the first embodiment of the present invention. This voice-based converged communication method can be applied to any terminal device or system. The voice-based converged communication method includes the following steps:

[0054] Step S10: Obtain the accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice;

[0055] Among them, the emergency dispatch voice can quickly dispatch the opening and closing of the corresponding target image acquisition device. The target image acquisition device can be a camera or a device carrying a camera. The emergency dispatch voice stores image acquisition dispatch instructions, such as "open camera No. 1, open the southeast exit camera", etc. If the camera has a pan-tilt operation, it can also quickly operate commands such as "zoom in, zoom out, turn left, turn right, screenshot" through voice.

[0056] Step S20: Display images of the accident scene using the target image acquisition device, and establish an accident communication conference for the accident scene;

[0057] Once the accident communication conference is established, the accident scene will be automatically displayed synchronously. In this step, the converged communication command system and equipment can be quickly dispatched based on voice, such as voice commands like "connect to Sub-center No. 1, contact the fire rescue captain, group call" to quickly dispatch the command console, avoiding cumbersome manual operation and being overwhelmed.

[0058] Optionally, an accident communication conference is established for the accident site, including:

[0059] The accident type is determined based on the accident footage from the accident scene, and the accident address is obtained. Specifically, the accident footage is analyzed to determine the accident type, which includes traffic accidents, geological disasters, medical hazards, etc. The accident address is determined by identifying the accident objects in the accident footage and based on the addresses of the accident objects.

[0060] Meeting attendees are determined based on the accident address and accident type, and accident meeting information is sent to each attendee; wherein, the accident address and accident type are matched with a pre-stored personnel lookup table to determine meeting attendees, and accident meeting information is sent to each attendee to notify them to attend the meeting;

[0061] The incident communication conference is established based on the received response to the incident conference information, and the identities of each participant are marked in the incident communication conference.

[0062] Step S30: Store the conference voice in the accident communication conference, and determine the accident dispatch instruction based on the conference voice;

[0063] Among these features, by recording the audio of the accident communication conference in real time and transcribing it into text, the subsequent dispatch and quality inspection analysis was ensured to determine whether there were any violations or unauthorized misdirection that could have amplified the impact of the incident. Furthermore, it provided objective and accurate review and archive data afterward to prevent information tampering.

[0064] Optionally, determining incident dispatch instructions based on the conference voice recording includes:

[0065] The meeting audio is filtered based on suggested words, and it is determined whether the filtered meeting audio contains execution words; wherein, the suggested words include words such as "suggestion", "in my opinion", and "try", and the execution words include words such as "execute", "carry out", and "immediately";

[0066] If the conference audio contains execution words, then determine whether the conference audio contains command identifiers; wherein, the command identifiers are used to represent the command authority of the conference personnel corresponding to the conference audio.

[0067] If the conference audio contains a command identifier, a confirmation instruction is sent to the conference participant corresponding to the command identifier based on the conference audio.

[0068] If a response to the confirmation instruction is received, the conference voice is identified as the incident dispatch instruction.

[0069] Step S40: Execute the accident personnel dispatch according to the accident dispatch instruction, and obtain the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site;

[0070] Among them, the dispatch of accident personnel is carried out based on the accident dispatch instructions. This dispatch of accident personnel includes the dispatch of emergency duty rooms, the dispatch of rescue personnel, the dispatch of special rescue vehicles, and the release of emergency information. In this step, by obtaining the accident dispatch results and accident handling results of the accident personnel dispatch at the accident site, the data foundation for subsequent dispatch quality inspection and analysis is improved.

[0071] Step S50: Perform scheduling quality inspection analysis on the accident scheduling instruction based on the accident scheduling result and the accident handling result, and generate event scheduling suggestions based on the scheduling quality inspection analysis result;

[0072] Among them, based on the accident scheduling results and accident handling results, the system can automatically perform scheduling quality inspection and analysis on accident scheduling instructions, eliminating the need for manual scheduling quality inspection and improving the accuracy of accident scheduling instruction quality inspection.

[0073] Optionally, the scheduling quality inspection analysis of the accident scheduling instruction is performed based on the accident scheduling result and the accident handling result, including:

[0074] Based on the accident scheduling results and the accident handling results, the situation changes are determined, and the primary and secondary factors of the situation changes are queried. Specifically, the situation changes and accident types are matched with a factor lookup table to obtain the primary and secondary factors. This factor lookup table stores the correspondence between different situation changes and accident types and the corresponding primary and secondary factors.

[0075] A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors.

[0076] The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction;

[0077] Specifically, the changes in the situation and the type of accident, as well as the primary and secondary factors, are matched with the score lookup table to obtain the first quality inspection score and the second quality inspection score. By weighting the first and second quality inspection scores, the total quality inspection score is obtained, and the scheduling quality inspection analysis results are generated based on the total quality inspection score.

[0078] Furthermore, determining the situation change based on the accident dispatch results and the accident handling results includes:

[0079] Obtain the expected scheduling result of the personnel dispatch in the accident, and compare and analyze the accident dispatch result with the expected scheduling result to obtain the accident dispatch efficiency;

[0080] Based on the accident scene, determine the accident handling requirements, and analyze the accident handling results based on the accident handling requirements to obtain the accident handling efficiency.

[0081] The situation change is generated based on the incident handling efficiency and the incident scheduling efficiency.

[0082] In this embodiment, through voice recognition and semantic understanding, it is possible to quickly schedule and link IoT-related converged communication devices and surveillance cameras, enabling efficient, convenient, and intelligent command and dispatch management during the event, and providing voice recording and text transcription after the event for accident investigation review and archiving.

[0083] The voice recognition and converged communication systems are interconnected, transforming complex manual operation methods into a single voice command that organizes a series of operational instructions, providing command and dispatch personnel with fast, convenient, and accurate support. Voice commands are recorded in real time for easy post-event troubleshooting, and voice-to-text transcription facilitates daily workflow and management. Voice commands also enable real-time quality inspection and analysis, and timely correction of command personnel's instructions.

[0084] In this embodiment, the target image acquisition device can be automatically identified based on the accident dispatch voice, and the accident scene can be displayed based on the target image acquisition device. An accident communication conference can be automatically established for the accident site, improving the efficiency of voice dispatch. By storing the conference voice in the accident communication conference, the accident dispatch instructions can be automatically determined based on the conference voice. The accident personnel dispatch can be automatically executed based on the accident dispatch instructions. By obtaining the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site, the dispatch quality inspection analysis of the accident dispatch instructions can be automatically performed, eliminating the need for manual dispatch quality inspection analysis and improving the accuracy of the accident dispatch instruction quality inspection.

[0085] Example 2

[0086] Please see Figure 2 This is a flowchart of a voice-based converged communication method provided in the second embodiment of the present invention. This embodiment further refines step S10 in the first embodiment, including the following steps:

[0087] Step S11: Perform speech recognition on the accident dispatch speech to obtain the first speech text, and perform entity recognition on the first speech text;

[0088] Specifically, entity recognition is performed on the first speech text to determine the entity type of each word in the first speech text.

[0089] Step S12: Determine the target words in the first speech text based on the entity recognition result, and determine the device lookup table based on the target words;

[0090] Specifically, the entity recognition results are matched with a type whitelist to determine the target words in the first voice text. The target words are then matched with a query table database to obtain a device query table. The target words can be numbers, letters, or addresses, etc.

[0091] Step S13: Determine the target image acquisition device according to the device communication address in the device lookup table;

[0092] Optionally, this embodiment can adopt an offline voice & online voice (calling cloud services) fusion mechanism. Offline voice solves the problem of accurate command recognition, does not rely on the network, and improves the system response speed. If the offline voice fails, online voice recognition will be used through the network. Its advantages are strong generalization ability and support users' common command habits.

[0093] In this embodiment, entity recognition is performed on the first speech text to determine the entity type of each word in the first speech text. By determining the target words in the first speech text, the device lookup table can be automatically determined based on the target words, thereby improving the accuracy of the target image acquisition device determination.

[0094] Example 3

[0095] Please see Figure 3 This is a schematic diagram of the structure of a voice-based converged communication system 100 provided in the third embodiment of the present invention, including: a device determination module 10, a conference establishment module 11, an instruction determination module 12, a personnel scheduling module 13, and a quality inspection and analysis module 14, wherein:

[0096] The device determination module 10 is used to acquire accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice.

[0097] Optionally, the device determination module 10 is further configured to: perform speech recognition on the accident dispatch voice to obtain a first voice text, and perform entity recognition on the first voice text;

[0098] The target words in the first speech text are determined based on the entity recognition results, and a device lookup table is determined based on the target words.

[0099] The target image acquisition device is determined based on the device communication address in the device lookup table.

[0100] The conference setup module 11 is used to display images of the accident scene based on the target image acquisition device and to establish an accident communication conference for the accident scene.

[0101] Optionally, the meeting establishment module 11 is also used to: determine the accident type based on the accident scene footage, and obtain the accident address of the accident scene;

[0102] Based on the accident address and the accident type, the meeting participants are determined, and accident meeting information is sent to each participant.

[0103] The incident communication conference is established based on the received response to the incident conference information, and the identities of each participant are marked in the incident communication conference.

[0104] The instruction determination module 12 is used to store the conference voice in the accident communication conference and determine the accident dispatch instruction based on the conference voice.

[0105] Optionally, the instruction determination module 12 is further configured to: filter the conference audio based on suggested words, and determine whether the filtered conference audio contains execution words;

[0106] If the conference audio contains execution words, then determine whether the conference audio contains a command identifier, which is used to represent the command authority of the conference personnel corresponding to the conference audio.

[0107] If the conference audio contains a command identifier, a confirmation instruction is sent to the conference participant corresponding to the command identifier based on the conference audio.

[0108] If a response to the confirmation instruction is received, the conference voice is identified as the incident dispatch instruction.

[0109] The personnel scheduling module 13 is used to execute accident personnel scheduling according to the accident scheduling instruction, and to obtain the accident scheduling results and accident handling results of the accident personnel scheduling for the accident site.

[0110] The quality inspection and analysis module 14 is used to perform scheduling quality inspection and analysis on the accident scheduling instruction based on the accident scheduling result and the accident handling result, and generate event scheduling suggestions based on the scheduling quality inspection and analysis result.

[0111] Optionally, the quality inspection and analysis module 14 is also used to: determine the situation change based on the accident scheduling result and the accident handling result, and query the main and secondary factors of the situation change;

[0112] A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors.

[0113] The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction.

[0114] Furthermore, the quality inspection and analysis module 14 is also used to: obtain the expected scheduling result of the accident personnel scheduling, and compare and analyze the accident scheduling result and the expected scheduling result to obtain the accident scheduling efficiency;

[0115] Based on the accident scene, determine the accident handling requirements, and analyze the accident handling results based on the accident handling requirements to obtain the accident handling efficiency.

[0116] The situation change is generated based on the incident handling efficiency and the incident scheduling efficiency.

[0117] Please see Figure 4 When an accident occurs, cameras can be quickly invoked via voice to capture images of the accident scene. The captured images are uploaded to the command center in real time, establishing an accident communication conference for the accident scene. Experts at various branch venues can collaborate to determine accident dispatch instructions, and emergency command and dispatch (emergency duty room, rescue personnel, special rescue vehicles, emergency information release and notification) can be carried out based on the accident dispatch instructions.

[0118] In this embodiment, the target image acquisition device can be automatically identified based on the accident dispatch voice, and the accident scene can be displayed based on the target image acquisition device. An accident communication conference can be automatically established for the accident site, improving the efficiency of voice dispatch. By storing the conference voice in the accident communication conference, the accident dispatch instructions can be automatically determined based on the conference voice. The accident personnel dispatch can be automatically executed based on the accident dispatch instructions. By obtaining the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site, the dispatch quality inspection analysis of the accident dispatch instructions can be automatically performed, eliminating the need for manual dispatch quality inspection analysis and improving the accuracy of accident dispatch instruction quality inspection.

[0119] Example 4

[0120] Figure 5 This is a structural block diagram of a terminal device 2 provided in the fourth embodiment of this application. For example... Figure 5 As shown, the terminal device 2 in this embodiment includes a processor 20, a memory 21, and a computer program 22 stored in the memory 21 and executable on the processor 20, such as a program for a voice-based converged communication method. When the processor 20 executes the computer program 22, it implements the steps in the various embodiments of the voice-based converged communication method described above.

[0121] For example, the computer program 22 may be divided into one or more modules, which are stored in the memory 21 and executed by the processor 20 to complete this application. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 22 in the terminal device 2. The terminal device may include, but is not limited to, the processor 20 and the memory 21.

[0122] The processor 20 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0123] The memory 21 can be an internal storage unit of the terminal device 2, such as a hard drive or memory of the terminal device 2. The memory 21 can also be an external storage device of the terminal device 2, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the terminal device 2. Furthermore, the memory 21 can include both internal and external storage units of the terminal device 2. The memory 21 is used to store the computer program and other programs and data required by the terminal device. The memory 21 can also be used to temporarily store data that has been output or will be output.

[0124] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0125] If an integrated module is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. This computer-readable storage medium can be non-volatile or volatile. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the contents of a computer-readable storage medium may be appropriately added to or subtracted from the contents as required by the legislation and patent practice in a jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, a computer-readable storage medium may not include electrical carrier signals and telecommunication signals.

[0126] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A converged communication method based on voice scheduling, characterized in that, The method includes: Acquire the accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice; The target image acquisition device displays images of the accident scene and establishes an accident communication conference for the accident scene; Store the conference audio from the incident communication conference, and determine the incident dispatch instructions based on the conference audio; The personnel dispatch is executed according to the accident dispatch instructions, and the accident dispatch results and accident handling results for the accident site are obtained. Based on the accident scheduling results and the accident handling results, the accident scheduling instructions are subjected to scheduling quality inspection analysis, and event scheduling suggestions are generated based on the scheduling quality inspection analysis results. Based on the conference voice recording, incident dispatch instructions are determined, including: The conference audio is filtered based on suggested words, and it is determined whether the filtered conference audio contains execution words. If the conference audio contains execution words, then determine whether the conference audio contains a command identifier, which is used to represent the command authority of the conference personnel corresponding to the conference audio. If the conference audio contains a command identifier, a confirmation instruction is sent to the conference participant corresponding to the command identifier based on the conference audio. If a response to the confirmation instruction is received, the conference voice is identified as the incident dispatch instruction.

2. The voice-based converged communication method as described in claim 1, characterized in that, Based on the accident scheduling results and the accident handling results, a scheduling quality inspection analysis is performed on the accident scheduling instructions, including: Based on the accident dispatch results and the accident handling results, determine the changes in the situation, and query the primary and secondary factors of the changes in the situation; A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors. The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction.

3. The voice-based converged communication method as described in claim 2, characterized in that, Determining the change in situation based on the accident dispatch results and the accident handling results includes: Obtain the expected scheduling result of the personnel dispatch in the accident, and compare and analyze the accident scheduling result with the expected scheduling result to obtain the accident scheduling efficiency; Based on the accident scene, determine the accident handling requirements, and analyze the accident handling results based on the accident handling requirements to obtain the accident handling efficiency. The situation change is generated based on the incident handling efficiency and the incident scheduling efficiency.

4. The converged communication method based on voice scheduling as described in claim 1, characterized in that, Establish an accident communication conference for the accident site, including: The type of accident is determined based on the accident footage from the accident scene, and the accident address of the accident scene is obtained; Based on the accident address and the accident type, the meeting participants are determined, and accident meeting information is sent to each participant. The incident communication conference is established based on the received response to the incident conference information, and the identities of each participant are marked in the incident communication conference.

5. The voice-based converged communication method according to any one of claims 1 to 4, characterized in that, The target image acquisition device is determined based on the accident dispatch voice, including: The accident dispatch voice is subjected to speech recognition to obtain the first voice text, and entity recognition is performed on the first voice text. The target words in the first speech text are determined based on the entity recognition results, and a device lookup table is determined based on the target words. The target image acquisition device is determined based on the device communication address in the device lookup table.

6. A converged communication system based on voice scheduling, characterized in that, The system includes: The device determination module is used to acquire accident dispatch voice and determine the target image acquisition device based on the accident dispatch voice; The conference setup module is used to display images of the accident scene based on the target image acquisition device and to establish an accident communication conference for the accident scene. The instruction determination module is used to store the conference voice in the accident communication conference and determine the accident dispatch instruction based on the conference voice; The personnel dispatch module is used to execute accident personnel dispatch according to the accident dispatch instructions, and to obtain the accident dispatch results and accident handling results of the accident personnel dispatch for the accident site; The quality inspection and analysis module is used to perform scheduling quality inspection and analysis on the accident scheduling instructions based on the accident scheduling results and the accident handling results, and to generate event scheduling suggestions based on the scheduling quality inspection and analysis results. The instruction determination module is also used to: filter the conference audio based on suggested words, and determine whether the filtered conference audio contains execution words; If the conference audio contains execution words, then determine whether the conference audio contains a command identifier, which is used to represent the command authority of the conference personnel corresponding to the conference audio. If the conference audio contains a command identifier, a confirmation instruction is sent to the conference participant corresponding to the command identifier based on the conference audio. If a response to the confirmation instruction is received, the conference voice is identified as the incident dispatch instruction.

7. The unified communication system based on voice scheduling as described in claim 6, characterized in that, The quality inspection and analysis module is also used for: Based on the accident dispatch results and the accident handling results, determine the changes in the situation, and query the primary and secondary factors of the changes in the situation; A first quality inspection score is determined based on the changes in the situation, and a second quality inspection score is determined based on the primary and secondary factors. The first quality inspection score and the second quality inspection score are weighted and calculated to obtain the scheduling quality inspection analysis result of the accident scheduling instruction.

8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 5.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 5.

Images