A system, method and electronic device for voice notification confirmation in mining area

Abstract

The present application discloses a system, method, electronic device and medium for voice notification confirmation in a mining area. After receiving a first voice file, an application server sends a call signaling, and sends the IP address and port of the notification recipient to a virtual voice agent module; the voice agent module sends the first voice file to the virtual voice agent module in response to the notification recipient connecting the call; the virtual voice agent module configures DTMF key confirmation information for each notification recipient, and generates a second voice file after appending it to the content of the first voice file in a voice coding format and sends it to the voice agent module; the voice agent module receives the second voice file and sends it to the notification recipient, receives the DTMF key information file and sends it to the virtual voice agent module, thereby judging whether the DTMF key information is consistent with the DTMF key confirmation information. The present invention realizes quantitative statistics on the complete rate of answering important notifications.

Description

Technical Field

[0001] The present application relates to the field of signal transmission and reception, and in particular to a method, device, electronic device and storage medium for voice notification confirmation in a mining area. Background Art

[0002] At present, the way to notify underground workers of important information in the coal mining industry is generally through voice broadcasting. Whether it is broadcast through the radio or through a landline or dedicated network mobile phone, there is a problem, that is, it is impossible to confirm whether the workers have listened to the complete information. This makes it impossible to quantify the listening completeness rate of important notifications, which may lead to serious safety accidents. Summary of the invention

[0003] The embodiments of the present application provide a method, device, electronic device and storage medium for confirming voice notification in a mining area, which are used to solve the technical problem in the prior art that it is impossible to confirm whether the other party has listened to the complete message.

[0004] In a first aspect of the present application, a communication system for voice notification confirmation in a mining area is provided, comprising:

[0005] an application server for receiving a message from a notification sender and generating a first voice file, sending a call signaling to all notification recipients, and sending an IP address and a port of the notification recipient to the virtual voice agent module, and for sending the first voice file to the virtual voice agent module in response to the notification recipient connecting the call;

[0006] A virtual voice agent module is used to receive the IP address, port and first voice file of the notification recipient, configure DTMF key confirmation information for each notification recipient, and append the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and send the second voice file to the voice agent module; and is used to receive the DTMF key information file forwarded from the voice agent module, determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determine that the corresponding notification recipient has completed the complete listening to the voice;

[0007] The voice agent module is used to receive the second voice file and send it to the notification recipient to prompt the notification recipient to press keys to confirm and generate a DTMF key information file after playing the second voice file, and is used to receive the DTMF key information file and send it to the virtual voice agent module.

[0008] Further, the application server includes a transceiver module, which is used to send the text message to the text-to-speech module and receive the first voice file from the text-to-speech module when the message received from the notification sender is a text message;

[0009] The text-to-speech module is used to receive the first message, convert the first message into a first voice file, and send the first voice file to the application server.

[0010] Furthermore, the virtual voice agent module is used to configure DTMF key confirmation information for each notification recipient, including:

[0011] The first random generation module is used to randomly generate DTMF key confirmation information for each notification recipient, and store the IP address, port and DTMF key confirmation information of the notification recipient in correspondence.

[0012] Furthermore, the virtual voice agent module further includes:

[0013] The timing module is used to start timing after sending the second voice file to the voice agent module, and to receive DTMF key information consistent with the DTMF key confirmation information before the timing reaches a preset time or stop timing after the timing reaches a preset time.

[0014] Further, the virtual voice agent module is used to receive the DTMF key information file from the voice agent module, and determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, including:

[0015] A receiving and parsing module, used for continuously receiving DTMF key information files, and parsing the corresponding DTMF key information in each of the DTMF key information files;

[0016] A deduplication integration module is used to deduplicate a plurality of identical DTMF key information files whose timestamp interval is less than a first time threshold according to the receiving timestamp of the DTMF key information file, and combine all the deduplicated DTMF key information files into the first DTMF key information in the order of the receiving timestamps;

[0017] The comparison and judgment module is used to compare the first DTMF key information with the DTMF key confirmation information and judge whether they are consistent.

[0018] The second aspect of the present application provides a communication method for voice notification confirmation in a mining area, comprising:

[0019] The application server receives the message from the notification sender and generates a first voice file, sends a call signaling to all notification recipients, and sends the IP address and port of the notification recipient to the virtual voice agent module;

[0020] The voice agent module sends the first voice file to the virtual voice agent module in response to notifying the recipient that the call is connected;

[0021] The virtual voice agent module receives the IP address, port and first voice file of the notification recipient, configures DTMF key confirmation information for each notification recipient, appends the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and sends the second voice file to the voice agent module;

[0022] The voice agent module receives the second voice file and sends it to the notification recipient to prompt the notification recipient to press a key to confirm the generation of a DTMF key information file after playing the second voice file, receives the DTMF key information file and sends it to the virtual voice agent module;

[0023] The virtual voice agent module receives the DTMF key information file forwarded by the voice agent module, determines whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determines that the corresponding notification recipient has completed listening to the voice completely.

[0024] Further, configuring DTMF key confirmation information for each notification recipient includes:

[0025] DTMF key confirmation information is randomly generated for each notification recipient, and the IP address, port and DTMF key confirmation information of the notification recipient are correspondingly saved.

[0026] Furthermore, after sending the second voice file to the voice agent module, the following steps are included:

[0027] The timing is started, and the DTMF key information consistent with the DTMF key confirmation information is received before the timing reaches the preset time, or the timing is stopped after the timing reaches the preset time.

[0028] Further, the receiving of the DTMF key information file from the voice agent module and determining whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information include:

[0029] Continuously receiving DTMF key information files, and parsing corresponding DTMF key information in each of the DTMF key information files;

[0030] According to the receiving timestamp of the DTMF key information file, multiple identical DTMF key information with a timestamp interval less than a first time threshold are deduplicated, and all the deduplicated DTMF key information are combined into the first DTMF key information in the order of the receiving timestamps;

[0031] The first DTMF key information is compared with the DTMF key confirmation information to determine whether they are consistent.

[0032] The third aspect of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic device implements the method described in the second aspect of the present application.

[0033] The fourth aspect of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer executes the method described in the second aspect of the present application.

[0034] In an embodiment of the present application, a communication system for voice notification confirmation in a mining area is adopted, including: an application server, which is used to receive a message from a notification sender and generate a first voice file, send a call signaling to all notification recipients, and send the IP address and port of the notification recipient to a virtual voice agent module, and send the first voice file to the virtual voice agent module in response to the notification recipient connecting the call; the virtual voice agent module is used to receive the IP address, port and first voice file of the notification recipient, configure DTMF key confirmation information for each notification recipient, and append the DTMF key confirmation information to the content of the first voice file in a voice coding format. The second voice file is generated after the second voice file is played, and the second voice file is sent to the voice agent module; and it is used to receive the DTMF key information file forwarded from the voice agent module, and determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information. If they are consistent, it is determined that the corresponding notification recipient has completed the complete listening to the voice; the voice agent module is used to receive the second voice file and send it to the notification recipient to prompt the notification recipient to confirm the key after playing the second voice file to generate the DTMF key information file, and to receive the DTMF key information file and send it to the virtual voice agent module.

[0035] This application introduces a virtual voice agent module, breaks through the inherent voice information notification process, analyzes and processes the dynamic DTMF signal carried by RTP, breaks through the inherent voice information notification process, realizes quantitative statistics of the completion rate of important notifications, and provides a basis for operations such as timed retransmission, providing strong security guarantees for safe production in mining areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0037] Figure 1 It is a module diagram of a mining area voice communication system in the prior art according to the present application.

[0038] Figure 2 It is a module diagram of a communication system for voice notification confirmation in a mining area according to an embodiment of the present application.

[0039] Figure 3 It is a flow chart of a communication method for voice notification confirmation in a mining area according to an embodiment of the present application.

[0040] Figure 4 is a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0042] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0043] In order to better understand the present application, the following terms related to the present application are briefly explained as follows:

[0044] 1. IMS: The abbreviation of IP Multimedia Subsystem, is the core network architecture that supports rich communication services in 5G networks.

[0045] 2. AS: Application Server (application server) is the top application layer device in the IMS system, providing basic services and supplementary services, multimedia conferencing, converged communications, SMS gateways, standard attendant consoles, etc. The IMS network is an open system based on IP bearer that provides users with various multimedia services. The AS network element interacts with the CSCF (Call Session Control Function) through the standard SIP protocol to trigger and execute various network services.

[0046] 3. TTS: Text-to-Speech (text to speech). It is a technology that converts written text into audible speech.

[0047] 4. RTP: Real-time Transport Protocol is a network transmission protocol that is mainly used to provide real-time transmission services on IP networks, such as real-time transmission of multimedia data such as audio and video. It is often used in streaming media systems, video conferencing, IP phones and other applications.

[0048] 5. DTMF: Dual-Tone Multi-Frequency is a signal method widely used in telephone systems. When a telephone button is pressed, two tones of different frequencies are generated, and their combination represents different numbers or functions.

[0049] 6. RTP carries DTMF: In IP telephone systems, the Real-time Transport Protocol (RTP) is widely used to transmit audio and video data. The dual-tone multi-frequency signal (DTMF) is used to transmit telephone key information. In order to integrate DTMF signals into RTP-based communication systems, a mechanism is needed to encapsulate DTMF data in RTP packets. This process is called RTP carries DTMF. RFC 2833 is the RTP payload format for transmitting DTMF (dual-tone multi-frequency) signals, telephone tones, and telephone signals. It specifies the specific format of carrying DTMF events in RTP packets, which mainly includes the following aspects:

[0050] Event package: DTMF events are encapsulated into a special RTP packet.

[0051] Event Type: defines different event types, such as DTMF digit, DTMF start, DTMF end, etc.

[0052] DTMF Digit: Specifies the DTMF digit pressed.

[0053] Duration: Indicates the duration of the DTMF signal.

[0054] like Figure 1 As shown in the figure, the traditional private network fusion communication system used for voice notification in the mining area establishes communication between the operation console and the user terminal (shown as a solid state drive and a mobile phone in the figure), and sends the voice or text notification issued by the operation console to the user terminal in the form of voice notification. However, the prior art cannot count whether the user has completely listened to the above voice notification, so some important notifications may not be fully delivered, thereby causing safety hazards.

[0055] like Figure 2 As shown, it is a schematic diagram of a communication system for voice notification confirmation in a mining area according to an embodiment of the present application, and the communication system for voice notification confirmation in a mining area is applied to notify underground workers in the coal mining industry and to count the listening completeness rate. Figure 2 As shown, the communication system has two-way communication with the operating console and the user terminal (landline and mobile phone in the figure), which can not only send the voice or text notification issued by the operating console to the user terminal in the form of voice notification, but also detect in real time whether the user has completed listening, so as to obtain the completion rate, facilitate timely supplementary notifications and reduce safety hazards.

[0056] like Figure 2 As shown, a communication system for voice notification confirmation in a mining area described in this embodiment includes the following components:

[0057] The application server is used to receive a message from a notification sender and generate a first voice file, send call signaling to all notification recipients, and send the IP address and port of the notification recipient to the virtual voice agent module, and send the first voice file to the virtual voice agent module in response to the notification recipient connecting the call.

[0058] The application server is AS. Figure 2 The central location is not shown separately in the IMS.

[0059] The party giving the said notice is Figure 2 The operation console in the mining industry is an important component for monitoring and dispatching management. The message sent by the notification sender includes the called number, text notification or recorded audio notification.

[0060] The application server confirms the notification recipient through the called number contained in the message of the notification sender, and sends SIP call signaling to all called numbers through the IMS system. The interaction of SIP signaling will complete the process of calling, ringing and answering. Different from the prior art, the application server sends the IP address, port and first voice file of the notification recipient to the virtual voice agent module, so that the virtual voice module can process the above-mentioned first voice file before sending it to the notification recipient, thereby increasing the information contained in the first voice file, that is, the information requiring feedback after the notification listening is completed. In addition, since what is sent to the notification recipient in this application is a voice signal, the IP address and port of the notification recipient are the IP address and port used by the notification recipient to receive the voice stream (RTP data packet).

[0061] The virtual voice agent module is used to receive the IP address, port and first voice file of the notification recipient, configure DTMF key confirmation information for each notification recipient, and append the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and send the second voice file to the voice agent module; and is used to receive the DTMF key information file forwarded from the voice agent module, determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determine that the corresponding notification recipient has completed the complete listening to the voice.

[0062] The voice agent module is used to receive the second voice file and send it to the notification recipient to prompt the notification recipient to press keys to confirm and generate a DTMF key information file after playing the second voice file, and is used to receive the DTMF key information file and send it to the virtual voice agent module.

[0063] Wherein, the DTMF key information file is in DFTM protocol format (RFC2833) and is carried by RTP protocol, and is sent back to the voice agent module. The IP address and port of the notified recipient are also sent back to the voice agent module together with the DTMF key information file. The voice agent module packages the above information together with the DTMF key information file and sends a virtual voice agent module. Before judging whether the DTMF key information meets the requirements, the virtual voice agent module will first identify which terminal the DTMF key information comes from according to the IP address and port, and then judge whether it meets the requirements.

[0064] The embodiment of the present application adds a virtual voice module between the application server and the voice agent module, which is used to add relevant information requesting the user terminal to confirm the key press, namely, DTMF key press confirmation information, as the second voice file at the end of the first voice file sent from the application server, and finally sends the second voice file to the user terminal through the voice agent module. Then the virtual voice module analyzes the user key press operation received by the voice agent module to identify whether the key press operation is a correct operation corresponding to the response to the second voice file, so as to determine whether the user has actually completed the listening to the notification.

[0065] In some preferred embodiments, the application server includes a transceiver module for sending the text message to a text-to-speech module and receiving a first voice file from the text-to-speech module when the message received from the notification sender is a text message; the text-to-speech module, namely Figure 2 The TTS in the application server is used to receive the first message and convert the first message into a first voice file and send the first voice file to the application server.

[0066] In some preferred embodiments, the virtual voice agent module is used to configure DTMF key confirmation information for each notification recipient, including:

[0067] The first random generation module is used to randomly generate DTMF key confirmation information for each notification recipient, and store the IP address, port and DTMF key confirmation information of the notification recipient in correspondence.

[0068] For example, the first random generation module generates random 3 to 5 DTMF key confirmation information (1-9 numeric keys and asterisk key * and pound key #) for each terminal, such as "123*" or "1357#". Then the virtual voice agent module adds the DTMF key confirmation information generated for the terminal in voice coding format together with the prompt tone prefix to the end of the voice content, such as "The content has been listened to, please press the key to confirm: 1357#".

[0069] In some preferred embodiments, the virtual voice agent module further includes:

[0070] The timing module is used to start timing after sending the second voice file to the voice agent module, and to receive DTMF key information consistent with the DTMF key confirmation information before the timing reaches a preset time or stop timing after the timing reaches a preset time.

[0071] Ideally, after the voice notification is completed, the key operation is performed according to the DTMF key confirmation information. If the key is uploaded after exceeding the preset time, it is considered abnormal and the terminal should not be directly determined to have completed the complete voice listening. In addition, uploading the wrong key is not considered to have completed the complete voice listening. Therefore, in the above embodiment, the key information that meets the requirements is received before the countdown of the timing module stops, which is considered to have completed the complete voice listening. After the timing reaches the preset time, it is determined that the complete voice listening is not completed, and the terminal status is marked as "unfinished".

[0072] Since the console may make the same or different voice notifications multiple times as needed, each voice notification should be timed separately to determine whether the key information received before the end of the timing interval meets the requirements.

[0073] In some preferred embodiments, after receiving the RTP packet from the voice agent module, the virtual voice agent module parses out the DTMF protocol field therein, wherein each RTP packet contains only one DTMF key information, and the virtual voice agent creates a DTMF buffer for each terminal, storing the DTMF information carried by each RTP packet. Therefore, the virtual voice agent module is used to receive the DTMF key information file from the voice agent module, and determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, including:

[0074] The receiving and parsing module is used to continuously receive DTMF key information files and parse the corresponding DTMF key information in each of the DTMF key information files.

[0075] The deduplication integration module is used to deduplicate a plurality of identical DTMF key information files whose timestamp interval is less than a first time threshold according to the receiving timestamp of the DTMF key information file, and combine all the deduplicated DTMF key information files into the first DTMF key information in the order of the receiving timestamps.

[0076] The comparison and judgment module is used to compare the first DTMF key information with the DTMF key confirmation information and judge whether they are consistent.

[0077] Due to the differences in the way different people use mobile phone buttons, for example, some people press short and some people press long, so DTMF case information files are continuously generated. In particular, long press operations will generate a lot of repeated DTMF key information. Therefore, it is necessary to perform deduplication operations before identifying whether they are consistent. If the comparison is consistent, it means that the terminal has completely listened to the voice content, and the terminal status is marked as "completed". If the comparison is inconsistent, it is determined that the terminal has not completely listened to the voice content, and the terminal status is marked as "unfinished".

[0078] In some optional embodiments, the virtual voice agent module is also used to send all terminal states to the operation console through the application server after all terminal states corresponding to the message of the notification sender are identified. The operation console sends the same message again to the notification recipient marked as "unfinished" in the received terminal state. The virtual voice agent module is also used to identify whether the same first voice file is received N times by the IP address and port of the same notification recipient within a first preset time range, N is greater than 1. If so, the virtual voice agent module is used to configure DTMF key confirmation information for each notification recipient, including:

[0079] The second random generation module is used to configure notification number prompt information for each notification recipient.

[0080] The first preset time range is a preset time range that can be used to repeatedly send information. If it is found that the status of any terminal is "unfinished" within this range, try to repeatedly send information to these terminals.

[0081] For information sent for the second time or more, the virtual voice agent module appends the notification number prompt information in voice coding format before the content of the first voice file, and appends the DTMF key confirmation information in voice coding format after the content of the first voice file, and generates a second voice file together, and sends the second voice file to the voice agent module. For example: the second random generation module configures the notification number prompt information "This is the third notification" for a terminal that receives the same first voice file for the third time. Then the virtual voice agent module generates the second voice file as follows "This is the third notification,..., the content has been listened to, please press the key to confirm: 1357#".

[0082] In some optional embodiments, the operation console obtains the first location of the notification recipient marked as "unfinished" in the terminal status. Based on the first location, the operation console obtains the notification recipient marked as "completed" in the terminal status and whose location is within a predetermined distance range from the first location. The operation console sends a first message to the notification recipient within the predetermined distance range. The first message is used to prompt the notification recipient who receives the message to assist in checking the working status of the notification recipient whose status is "unfinished". Since the function and content of the first message are different from the notification that needs to be confirmed in this embodiment, after the first message is sent to the application server, the application server sends the first message in the form of a voice file to the voice agent module and sends it to the corresponding notification recipient.

[0083] Based on the same inventive concept as the above-mentioned communication system embodiment, the present application also provides a communication method for voice notification confirmation in a mining area, the method comprising the following steps:

[0084] Step S101: The application server receives a message from a notification sender and generates a first voice file, sends a call signaling to all notification receivers, and sends the IP address and port of the notification receiver to the virtual voice agent module.

[0085] Step S102: In response to notifying the recipient that the call is connected, the voice agent module sends the first voice file to the virtual voice agent module.

[0086] Step S103, the virtual voice agent module receives the IP address, port and first voice file of the notification recipient, configures DTMF key confirmation information for each notification recipient, and appends the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and sends the second voice file to the voice agent module.

[0087] Step S104, the voice agent module receives the second voice file and sends it to the notification recipient to prompt the notification recipient to press keys to confirm the generation of a DTMF key information file after playing the second voice file, receives the DTMF key information file and sends it to the virtual voice agent module.

[0088] Step S105, the virtual voice agent module receives the DTMF key information file forwarded by the voice agent module, determines whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determines that the corresponding notification recipient has completed listening to the voice completely.

[0089] Through the above method, with the help of the virtual voice agent module added in the communication system, the DTMF key confirmation information is attached to the notification sent by the operation console, and the judgment of whether the complete listening to the voice is completed is made according to the feedback of the user terminal. The above method has little modification to the network, strong functional practicality, and reduces the safety hazards in the mining area.

[0090] In some preferred embodiments, the application server receives a message from a notification sender and generates a first voice file, including:

[0091] When the message received from the notification sender is a text message, the text message is sent to the text-to-speech module so that the text-to-speech module converts the first message into a first voice file and then sends the first voice file to the application server.

[0092] In some preferred embodiments, configuring DTMF key confirmation information for each notification recipient includes:

[0093] DTMF key confirmation information is randomly generated for each notification recipient, and the IP address, port and DTMF key confirmation information of the notification recipient are correspondingly saved.

[0094] In some preferred embodiments, after sending the second voice file to the voice agent module, the method further comprises:

[0095] The timing is started, and the DTMF key information consistent with the DTMF key confirmation information is received before the timing reaches the preset time, or the timing is stopped after the timing reaches the preset time.

[0096] In some preferred embodiments, the receiving of the DTMF key information file from the voice agent module and determining whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information include:

[0097] S1051, continuously receiving DTMF key information files, and parsing corresponding DTMF key information in each of the DTMF key information files.

[0098] S1052: De-duplicate a plurality of identical DTMF key information files whose timestamp interval is less than a first time threshold according to the receiving timestamp of the DTMF key information file, and combine all the de-duplicated DTMF key information files into first DTMF key information in the order of receiving timestamps.

[0099] S1053: Compare the first DTMF key press information with the DTMF key press confirmation information to determine whether they are consistent.

[0100] In some preferred embodiments, the receiving of the DTMF key information file includes: the DTMF key information file is an RTP protocol packet in RFC2833 format.

[0101] In some optional embodiments, the method further includes: after all terminal states corresponding to the message of the notification sender are identified, all terminal states are sent to the operation console through the application server. The operation console resends the same message to the notification recipient marked as "unfinished" in the received terminal state. The virtual voice agent module is also used to identify whether the same first voice file is received N times at the same IP address and port of the notification recipient within a first preset time range, where N is greater than 1. If so, the virtual voice agent module configures DTMF key confirmation information for each notification recipient, including:

[0102] The second random generation module configures notification number prompt information for each notification recipient.

[0103] The first preset time range is a preset time range that can be used to repeatedly send information. If it is found that the status of any terminal is "unfinished" within this range, try to repeatedly send information to these terminals.

[0104] For information sent for the second time or more, the virtual voice agent module appends the notification number prompt information in voice coding format before the content of the first voice file, and appends the DTMF key confirmation information in voice coding format after the content of the first voice file, and generates a second voice file together, and sends the second voice file to the voice agent module. For example: the second random generation module configures the notification number prompt information "This is the third notification" for a terminal that receives the same first voice file for the third time. Then the virtual voice agent module generates the second voice file as follows "This is the third notification,..., the content has been listened to, please press the key to confirm: 1357#".

[0105] In some optional embodiments, the operation console obtains the first location of the notification recipient marked as "unfinished" in the terminal status. Based on the first location, the operation console obtains the notification recipient marked as "completed" in the terminal status and whose location is within a predetermined distance range from the first location. The operation console sends a first message to the notification recipient within the predetermined distance range. The first message is used to prompt the notification recipient who receives the message to assist in checking the working status of the notification recipient whose status is "unfinished". Since the function and content of the first message are different from the notification that needs to be confirmed in this embodiment, after the first message is sent to the application server, the application server sends the first message in the form of a voice file to the voice agent module and sends it to the corresponding notification recipient.

[0106] It should be noted that, although several units or subunits of the device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more units described above can be embodied in one unit. Conversely, the features and functions of one unit described above can be further divided into multiple units to be embodied.

[0107] Based on the same inventive concept as the above-mentioned method embodiment, an electronic device is also provided in an embodiment of the present application, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the electronic device implements the control method in the above-mentioned embodiment.

[0108] In one embodiment, the electronic device may be a server. In this embodiment, the structure of the electronic device may be as follows: Figure 3 As shown, it includes a memory 2001 , a communication module 2003 and one or more processors 2002 .

[0109] The memory 2001 is used to store computer programs executed by the processor 2002. The memory 2001 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and programs required for running the instant messaging function, etc.; the data storage area may store various instant messaging information and operation instruction sets, etc.

[0110] The memory 2001 may be a volatile memory, such as a random-access memory (RAM); the memory 2001 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); or the memory 2001 may be any other medium that can be used to carry or store a desired computer program in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2001 may be a combination of the above memories.

[0111] The processor 2002 may include one or more central processing units (CPU) or a digital processing unit, etc. The processor 2002 is used to implement the above-mentioned audio data processing method when calling the computer program stored in the memory 2001 .

[0112] The communication module 2003 is used to communicate with terminal devices and other servers.

[0113] The specific connection medium between the memory 2001, the communication module 2003 and the processor 2002 is not limited in the embodiment of the present application. Figure 3 In the embodiment, the memory 2001 and the processor 2002 are connected via a bus 2004. The bus 2004 is Figure 3 The arrows in the figure are used to describe the connection between other components, which is only for illustrative purposes and is not intended to be limiting. Bus 2004 can be divided into address bus, data bus, control bus, etc. For ease of description, Figure 3 The diagram shows that only one arrow is used, but this does not mean that there is only one bus or only one type of bus.

[0114] Based on the same inventive concept as the above method embodiment, an embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium is used to store a computer program, when the computer program is run on a computer, the electronic device implements the control method in the above embodiment. The computer-readable storage medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0115] Based on the same inventive concept as the above-mentioned method embodiment, an embodiment of the present invention further provides a computer program product, the computer program product including a computer program. When the program product is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of the control method according to various exemplary embodiments of the present application described above in this specification. The program product may adopt any combination of one or more readable media. These computer program commands may be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the commands executed by the processor of the computer or other programmable data processing device generate commands for implementing the steps in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0116] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

Claims

1. A communication system for voice notification confirmation in a mining area, characterized in that: an application server for receiving a message from a notification sender and generating a first voice file, sending a call signaling to all notification recipients, and sending an IP address and a port of the notification recipient to the virtual voice agent module, and for sending the first voice file to the virtual voice agent module in response to the notification recipient connecting the call; A virtual voice agent module is used to receive the IP address, port and first voice file of the notification recipient, configure DTMF key confirmation information for each notification recipient, and append the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and send the second voice file to the voice agent module; and is used to receive the DTMF key information file forwarded from the voice agent module, determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determine that the corresponding notification recipient has completed the complete listening to the voice; The voice agent module is used to receive the second voice file and send it to the notification recipient to prompt the notification recipient to press keys to confirm and generate a DTMF key information file after playing the second voice file, and is used to receive the DTMF key information file and send it to the virtual voice agent module.

2. The system according to claim 1, characterized in that The application server comprises a transceiver module, which is used to send the text message to the text-to-speech module and receive the first voice file from the text-to-speech module when the message received from the notification sender is a text message; The text-to-speech module is used to receive the first message, convert the first message into a first voice file, and send the first voice file to the application server.

3. The system according to claim 1, characterized in that The virtual voice agent module is used to configure DTMF key confirmation information for each notification recipient, including: The first random generation module is used to randomly generate DTMF key confirmation information for each notification recipient, and store the IP address, port and DTMF key confirmation information of the notification recipient in correspondence.

4. The system according to claim 1, characterized in that The virtual voice agent module further includes: The timing module is used to start timing after sending the second voice file to the voice agent module, and to receive DTMF key information consistent with the DTMF key confirmation information before the timing reaches a preset time or stop timing after the timing reaches a preset time.

5. The system according to claim 1, characterized in that The virtual voice agent module is used to receive the DTMF key information file from the voice agent module, and determine whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, including: A receiving and parsing module, used for continuously receiving DTMF key information files, and parsing the corresponding DTMF key information in each of the DTMF key information files; A deduplication integration module is used to deduplicate a plurality of identical DTMF key information files whose timestamp interval is less than a first time threshold according to the receiving timestamp of the DTMF key information file, and combine all the deduplicated DTMF key information files into the first DTMF key information in the order of the receiving timestamps; The comparison and judgment module is used to compare the first DTMF key information with the DTMF key confirmation information and judge whether they are consistent.

6. A communication method for voice notification confirmation in a mining area, characterized in that , The application server receives the message from the notification sender and generates a first voice file, sends a call signaling to all notification recipients, and sends the IP address and port of the notification recipient to the virtual voice agent module; The voice agent module sends the first voice file to the virtual voice agent module in response to notifying the recipient that the call is connected; The virtual voice agent module receives the IP address, port and first voice file of the notification recipient, configures DTMF key confirmation information for each notification recipient, appends the DTMF key confirmation information to the content of the first voice file in a voice coding format to generate a second voice file, and sends the second voice file to the voice agent module; The voice agent module receives the second voice file and sends it to the notification recipient to prompt the notification recipient to press a key to confirm the generation of a DTMF key information file after playing the second voice file, receives the DTMF key information file and sends it to the virtual voice agent module; The virtual voice agent module receives the DTMF key information file forwarded by the voice agent module, determines whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information, and if they are consistent, determines that the corresponding notification recipient has completed listening to the voice completely.

7. The method according to claim 6, characterized in that The step of configuring DTMF key confirmation information for each notification recipient includes: DTMF key confirmation information is randomly generated for each notification recipient, and the IP address, port and DTMF key confirmation information of the notification recipient are correspondingly saved.

8. The method according to claim 6, characterized in that After sending the second voice file to the voice agent module, the method includes: The timing is started, and the DTMF key information consistent with the DTMF key confirmation information is received before the timing reaches the preset time, or the timing is stopped after the timing reaches the preset time.

9. The method according to claim 6, characterized in that The receiving of the DTMF key information file from the voice agent module and determining whether the DTMF key information contained in the DTMF key information file is consistent with the DTMF key confirmation information include: Continuously receiving DTMF key information files, and parsing corresponding DTMF key information in each of the DTMF key information files; According to the receiving timestamp of the DTMF key information file, multiple identical DTMF key information with a timestamp interval less than a first time threshold are deduplicated, and all the deduplicated DTMF key information are combined into the first DTMF key information in the order of the receiving timestamps; The first DTMF key information is compared with the DTMF key confirmation information to determine whether they are consistent.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the electronic device implements the method according to any one of claims 6 to 9.

Images