Exploder with voice engine, method, computer equipment and storage medium

Abstract

The invention relates to the technical field of exploder interaction, in particular to an exploder with a voice engine, and the exploder comprises a TTS voice engine which is integrated in an exploder control module and is used for converting text information into voice signals in real time; the resource scheduling module is in control connection with the TTS voice engine and is used for providing a running environment for an external application program and controlling communication of the TTS voice engine; the voice interface protocol library is connected with the TTS voice engine and is used for defining a standardized interface for calling the TTS voice engine by an application program; and the real-time voice feedback channel is connected with the TTS voice engine and the resource scheduling system and is used for ensuring the instantaneity of user operation and system state voice broadcast through a priority queue mechanism. According to the application, the TTS is applied to the exploder and is very friendly to interaction, the TTS serves as a text-to-voice technology, operation items and operation results can be broadcasted through operation, the importance of visual interaction in the using process of the detonation software is reduced, and the method is compatible with more users of different ages and different culture levels.

Description

Technical Field

[0001] The present application relates to the field of initiator interaction technology, and in particular to an initiator and method with a voice engine, a computer device, and a storage medium. Background Art

[0002] Interacting with the detonator requires several steps, including detonator authorization, detonator registration, and network detonation. Traditional detonation software operations primarily involve page changes and pop-up notifications. Operation results are typically displayed via on-screen notifications or the playback of "correct" and "error" sounds. Operators at blasting sites are often older and may not be able to clearly see or understand prompts, leading to the risk of misoperation or even ignoring them. Furthermore, the detonation site environment can be harsh, potentially hindering visibility due to light interference, or other factors that may prevent operators from noticing or recognizing the risks and anomalies presented by the detonation software.

[0003] How to provide a solution to the problem of light interference causing the blasting workers to have difficulty seeing the screen, and the elderly workers to have difficulty seeing the text or reading difficulties is a technical problem that needs to be solved by those skilled in the art. Summary of the Invention

[0004] Based on this, it is necessary to provide a detonator and method with a voice engine, a computer device and a storage medium to address the above technical problems.

[0005] A detonator with a voice engine, comprising: TTS speech engine, which is integrated into the detonator control module and is used to convert text information into speech signals in real time; Resource scheduling module, which controls the connection to the TTS speech engine, is used to provide a running environment for external applications and control the communication of the TTS speech engine; The voice interface protocol library is connected to the TTS voice engine and is used to define the standardized interface for applications to call the TTS voice engine; The real-time voice feedback channel connects the TTS voice engine and the resource scheduling system, and is used to ensure the immediacy of user operations and system status voice broadcasts through a priority queue mechanism.

[0006] In one embodiment, the TTS speech engine supports multi-language text parsing and dynamically configures speech parameters, including speech rate, pitch, and volume; the resource scheduling module includes a hardware acceleration unit for optimizing the allocation of computing resources for speech synthesis.

[0007] In one embodiment, the TTS speech engine includes: a TTS initialization unit, which completes the loading of the speech engine and the adaptation of acoustic parameters when the software is started, including: an operation instruction conversion module, which converts the operation instructions input by the user into a standardized first text data stream; a result generation module, which generates a structured second text data stream according to the operation execution status; and a voice broadcast controller, which submits the first text data stream and the second text data stream to the TTS speech engine for speech synthesis output by calling the voice interface protocol library.

[0008] In one embodiment, the operation instruction conversion module includes: an operation type classifier that marks the danger level of the operation instruction based on preset rules; and a voice broadcast controller that dynamically adjusts the priority and alarm frequency of the voice broadcast according to the danger level mark.

[0009] In one embodiment, the result generation module integrates an error code mapping table to convert the error code returned by the system into a preset voice prompt text; the result generation module supports multimodal output and synchronously triggers the voice broadcast and the status update of the visual interface.

[0010] In one embodiment, a detonation control method based on a TTS speech engine includes: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0011] In one embodiment, monitoring the operation execution process and generating a second text data stream containing a status code includes: Real-time collection of sensor data during operation; Determine whether the operation meets the safety threshold through a preset algorithm; Encode the judgment result into a machine-readable status identifier.

[0012] In one embodiment, triggering a secondary voice announcement according to a preset announcement strategy includes: A confirmation voice message including a verification code is broadcast for successful operations; Broadcasts an alarm voice message containing error codes and repair suggestions for abnormal operations; Insert a second voice confirmation link for high-risk operations.

[0013] A computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the above steps when executing the computer program: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0014] A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above steps: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0015] Beneficial effect: The above-mentioned detonator with a voice engine includes: a TTS voice engine, which is integrated into the detonator control module and is used to convert text information into voice signals in real time; a resource scheduling module, which controls the connection to the TTS voice engine and is used to provide a running environment for external applications and control the communication of the TTS voice engine; a voice interface protocol library, which is connected to the TTS voice engine and is used to define a standardized interface for applications to call the TTS voice engine; a real-time voice feedback channel, which connects the TTS voice engine and the resource scheduling system and is used to ensure the immediacy of user operations and system status voice broadcasts through a priority queue mechanism. This application applies TTS to the detonator, which is very friendly to interaction. As a text-to-speech technology, TTS can broadcast operation items and operation results through operations, reducing the importance of visual interaction in the use of the detonator software and being compatible with more users of different ages and cultural levels. At the same time, this solution avoids the interference of the light environment on visual interaction and increases the adaptability of the detonator software in complex light environments. The enhanced nature of prompts, unlike traditional visual interactive prompts, can deepen user impressions and enhance the effectiveness of prompts. While improving user experience, it can also allow users to effectively notice the results, risks, and anomalies of prompts. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 1. A flowchart of a method for controlling an initiator with a voice engine according to an embodiment of the present invention; Figure 2 FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0017] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0018] This application is applicable to the operational interaction and result broadcasting of processes such as detonator registration, detonator networking, detonator initiation, and detonator authorization. This application aims to achieve the intelligence of the initiation software interaction and adaptability to noisy and bright light scenes through TTS technology. This application provides a TTS interactive function that can voice broadcast prompts for each step of the staff's operation. At the same time as the prompt is given, the result of the operation is broadcast. This means that in terms of operational interactivity, the user can clearly hear the operation they are performing at each step of the operation. In terms of resistance to environmental interference, users can perform normal operations through voice prompts in an environment with light interference. In terms of user-friendliness, it meets the problem of older staff who cannot see text clearly or have reading difficulties. In terms of warnings and prompts, different from traditional visual prompts, the design of this software not only provides visual prompts but also adds broadcast prompts. It can better warn users and prompt users of operation results and abnormal risks.

[0019] In one embodiment, a detonator with a voice engine includes: a TTS voice engine, which is integrated into a detonator control module and is used to convert text information into voice signals in real time; a resource scheduling module, which controls the connection to the TTS voice engine and is used to provide an operating environment for external applications and control the communication of the TTS voice engine; a voice interface protocol library, which is connected to the TTS voice engine and is used to define a standardized interface for applications to call the TTS voice engine; and a real-time voice feedback channel, which is connected to the TTS voice engine and the resource scheduling system and is used to ensure the immediacy of user operations and system status voice broadcasts through a priority queue mechanism.

[0020] Specifically, a detonator with a voice engine includes an operating system platform integrated with a TTS voice engine and detonator software adapted to TTS, enabling a voice broadcast function. The operating system platform with a TTS voice engine includes an operating system integrated with the TTS voice engine and an operating platform that supports the detonator software. The detonator software integrated with the TTS engine includes initializing and operating the TTS voice engine: the detonator software has been integrated and adapted to the TTS voice engine, enabling initialization upon startup and invoking the voice broadcast function as needed.

[0021] In this embodiment, a detonator with a voice engine includes: a text-to-speech (TTS) voice engine integrated into the detonator control module for converting text information into voice signals in real time; a resource scheduling module that controls and connects to the TTS voice engine, providing a runtime environment for external applications and controlling the TTS voice engine's communications; a voice interface protocol library that interfaces with the TTS voice engine and defines a standardized interface for applications to call the TTS voice engine; and a real-time voice feedback channel that connects the TTS voice engine and the resource scheduling system and ensures the immediacy of user operations and system status voice announcements through a priority queue mechanism. This application utilizes TTS in the detonator for user-friendly interaction. As a text-to-speech technology, TTS allows for the display of operation items and results through user interaction, reducing the importance of visual interaction in the detonator software and making it compatible with users of different ages and educational levels. This solution also mitigates the interference of ambient lighting on visual interaction and increases the detonator software's adaptability to complex lighting environments. The enhanced nature of prompts, unlike traditional visual interactive prompts, can deepen user impressions and enhance the effectiveness of prompts. While improving user experience, it can also allow users to effectively notice the results, risks, and anomalies of prompts.

[0022] In one embodiment, a detonator with a speech engine uses a text-to-speech (TTS) speech engine that supports multilingual text parsing and dynamically configures speech parameters, including speech rate, pitch, and volume. The resource scheduling module includes a hardware acceleration unit for optimizing computational resource allocation for speech synthesis. The TTS speech engine comprises a TTS initialization unit, which loads the speech engine and adapts acoustic parameters upon software startup. It also includes an operation instruction conversion module, which converts user-entered operation instructions into a standardized first text data stream; a result generation module, which generates a structured second text data stream based on the operation execution status; and a voice announcement controller, which, by invoking a voice interface protocol library, submits the first and second text data streams to the TTS speech engine for speech synthesis output. The operation instruction conversion module includes an operation type classifier, which assigns a hazard level to operation instructions based on preset rules; and a voice announcement controller, which dynamically adjusts the priority and alarm frequency of voice announcements based on the hazard level. The result generation module integrates an error code mapping table, converting error codes returned by the system into preset voice prompt text. The result generation module supports multimodal output, synchronously triggering voice announcements and status updates of the visual interface.

[0023] Specifically, a detonator with a voice engine features an operating system platform with a TTS engine and detonator software that has integrated the TTS engine. The operating system platform with a TTS engine has a built-in TTS voice engine that converts text messages into spoken audio. This functionality enables real-time voice feedback on user operations and system status. The platform provides a stable and compatible environment for deploying and running the detonator software, ensuring seamless collaboration with the TTS voice engine.

[0024] A detonator with a voice engine has integrated detonator software with a TTS engine. The detonator software has been integrated and adapted to the TTS voice engine, completing initialization upon startup and invoking the voice announcement function on demand. The detonator software generates corresponding operation text based on user actions and uses the TTS voice engine to convert the text into speech for announcement. The detonator software also converts the results of user actions into result text and announces them via the TTS voice engine, ensuring that users are informed of the operation status and results in a timely manner.

[0025] In this embodiment, a detonator with a voice engine is suitable for open-pit and underground mines, especially open-pit mines, to avoid erroneous operations caused by users not being able to see the operating steps clearly due to interference from sunlight. It has good interactivity and the user operation content and results are broadcast in real time, realizing the operation and response broadcast content is short and easy to understand. It has strong warning and prompting capabilities, and provides clear voice warnings when executing key or important steps to ensure that important information is not missed and the operating steps are accurately executed. It has strong adaptability and can still provide accurate voice broadcasts even in noisy environments. It has strong scalability and can switch to the local language system according to the area where the detonator software is used, and supports users to define the speech speed and volume themselves.

[0026] In one embodiment, a detonation control method based on a TTS speech engine includes: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0027] In one embodiment, monitoring the operation execution process and generating a second text data stream containing a status code includes: Real-time collection of sensor data during operation; Determine whether the operation meets the safety threshold through a preset algorithm; Encode the judgment result into a machine-readable status identifier.

[0028] In one embodiment, triggering a secondary voice announcement according to a preset announcement strategy includes: A confirmation voice message including a verification code is broadcast for successful operations; Broadcasts an alarm voice message containing error codes and repair suggestions for abnormal operations; Insert a second voice confirmation link for high-risk operations.

[0029] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. In addition, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0030] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 2 As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as regional twin models, drone twin models, target positions, initial positions and target rescue paths. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, it realizes a detonator with a voice engine.

[0031] Those skilled in the art will understand that Figure 2 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0032] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0033] A computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to monitor the execution process of an operation and generate a second text data stream containing a status code, including: Real-time collection of sensor data during operation; Determine whether the operation meets the safety threshold through a preset algorithm; Encode the judgment result into a machine-readable status identifier.

[0034] A computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor triggers a secondary voice broadcast according to a preset broadcast strategy when executing the computer program, including: A confirmation voice message including a verification code is broadcast for successful operations; Broadcasts an alarm voice message containing error codes and repair suggestions for abnormal operations; Insert a second voice confirmation link for high-risk operations.

[0035] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

[0036] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the computer program monitors the execution process of an operation and generates a second text data stream containing a status code, including: Real-time collection of sensor data during operation; Determine whether the operation meets the safety threshold through a preset algorithm; Encode the judgment result into a machine-readable status identifier.

[0037] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, a secondary voice announcement is triggered according to a preset announcement strategy, including: A confirmation voice message including a verification code is broadcast for successful operations; Broadcasts an alarm voice message containing error codes and repair suggestions for abnormal operations; Insert a second voice confirmation link for high-risk operations.

[0038] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0039] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0040] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. A detonator with a voice engine, characterized in that: include: A TTS speech engine, which is integrated into the detonator control module and is used to convert text information into speech signals in real time; A resource scheduling module, which controls the connection to the TTS speech engine, is used to provide an operating environment for external applications and control the communication of the TTS speech engine; A voice interface protocol library, which is connected to the TTS voice engine and is used to define a standardized interface for an application to call the TTS voice engine; A real-time voice feedback channel connects the TTS voice engine and the resource scheduling system, and is used to ensure the immediacy of user operations and system status voice broadcasts through a priority queue mechanism.

2. The detonator with a voice engine according to claim 1, characterized in that: The TTS speech engine supports multi-language text parsing and dynamically configures speech parameters, including speech speed, pitch, and volume. The resource scheduling module includes: a hardware acceleration unit for optimizing the allocation of computing resources for speech synthesis.

3. The detonator with a voice engine according to claim 1, characterized in that: The TTS speech engine includes: a TTS initialization unit, which completes the loading of the speech engine and the adaptation of acoustic parameters when the software is started, including: An operation instruction conversion module converts the operation instruction input by the user into a standardized first text data stream; A result generation module generates a structured second text data stream according to the operation execution status; The voice broadcast controller submits the first text data stream and the second text data stream to the TTS voice engine for voice synthesis output by calling the voice interface protocol library.

4. The detonator with a voice engine according to claim 3, characterized in that: The operation instruction conversion module includes: an operation type classifier, which marks the danger level of the operation instruction based on preset rules; The voice broadcast controller dynamically adjusts the priority and alarm frequency of the voice broadcast according to the danger level mark.

5. The detonator with a voice engine according to claim 3, characterized in that: The result generation module integrates an error code mapping table to convert the error code returned by the system into a preset voice prompt text; The result generation module supports multimodal output and synchronously triggers voice broadcast and status update of the visual interface.

6. A detonation control method based on a TTS voice engine, characterized in that: include: Complete the startup configuration of the speech engine through the TTS initialization unit; receiving a user operation instruction and generating a first text data stream; Call the voice interface protocol library of the operating system platform to perform the first voice broadcast; monitoring the operation execution process and generating a second text data stream including a status code; Trigger secondary voice broadcast according to the preset broadcast strategy; The voice broadcast log is associated with the operation record and stored.

7. The detonation control method based on a TTS voice engine according to claim 6, characterized in that: The monitoring operation execution process generates a second text data stream containing a status code, including: Real-time collection of sensor data during operation; Determine whether the operation meets the safety threshold through a preset algorithm; Encode the judgment result into a machine-readable status identifier.

8. The detonation control method based on a TTS voice engine according to claim 6, characterized in that: The triggering of the secondary voice broadcast according to the preset broadcast strategy includes: A confirmation voice message including a verification code is broadcast for successful operations; Broadcasts an alarm voice message containing error codes and repair suggestions for abnormal operations; Insert a second voice confirmation link for high-risk operations.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 6 to 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 6 to 8 are implemented.

Images