Voice control method and system for engineering machinery, engineering machinery and electronic equipment

Abstract

The invention discloses a voice control method and system for engineering machinery, the engineering machinery and electronic equipment, and relates to the technical field of engineering machinery. The method is applied to the engineering machinery which adopts an integrated voice driving module to respectively drive different sound equipment, so that after a preset scene where the engineering machinery is located is determined based on acquired state information of the engineering machinery, corresponding voice data and audio control instructions can be called based on the preset scene where the engineering machinery is located. And based on the integrated voice driving module, the called voice data is sent out by sound equipment corresponding to a preset scene where the engineering machinery is located in the sound equipment of the engineering machinery, and an audio control instruction is executed. Therefore, the problems that the man-machine interaction experience feeling is poor and the driving safety cannot be substantially improved due to the fact that different sound equipment of an existing engineering machine is independently and passively triggered are solved.

Description

Technical Field

[0001] The present application relates to the technical field of engineering machinery, and more specifically, to a voice control method and system for engineering machinery, engineering machinery, and electronic equipment. Background Art

[0002] At present, different audio devices of construction machinery, such as: external voice alarm, multimedia speakers in the cab, and instrument sound alarm devices, are all passively triggered. That is, the corresponding audio devices will be triggered only when actual operations occur. There are problems such as poor human-machine interaction experience and inability to substantially improve driving safety. Summary of the invention

[0003] In view of this, the embodiments of the present application are committed to providing a voice control method, system, engineering machinery and electronic equipment for engineering machinery, so as to solve the problem that the human-computer interaction experience is poor and driving safety cannot be substantially improved due to the different audio equipment of existing engineering machinery being independently and passively triggered.

[0004] In a first aspect, the present invention provides a voice control method for engineering machinery, which is applied to an engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, and the method comprises:

[0005] Acquiring status information, wherein the status information includes: a state of the construction machinery and a posture of the driver;

[0006] Based on the state information, determining a preset scene in which the engineering machinery is located;

[0007] Calling voice data and audio control instructions corresponding to a preset scene in which the engineering machinery is located;

[0008] The integrated voice driving module is controlled to send the called voice data through the target audio device and execute the audio control instruction. The target audio device is an audio device among the audio devices of the engineering machinery, corresponding to the preset scene in which the engineering machinery is located.

[0009] In a possible implementation manner, the status information further includes: working environment and voice instructions.

[0010] In a possible implementation, the voice control method for engineering machinery further includes:

[0011] Defining the preset scenario;

[0012] Setting the voice data by at least one of the following methods;

[0013] Associating each of the preset scenes with the corresponding voice data and channels, and connecting the integrated voice drive module to different audio devices of the engineering machinery through different channels;

[0014] The method includes:

[0015] Custom entry;

[0016] Imported by a corresponding interface of the engineering machinery;

[0017] The voice package provided by the construction machinery when it leaves the factory is called.

[0018] In a possible implementation, the voice control method for engineering machinery further includes:

[0019] Defining the priority of each of the preset scenarios;

[0020] The controlling the integrated voice driving module to send the called voice data through the target audio device and execute the audio control instruction includes:

[0021] Determine whether the preset scene in which the engineering machinery is located is greater than one;

[0022] When it is determined that the preset scenes for the engineering machinery are greater than one and have different priorities, the integrated voice drive module is controlled to send the called voice data in sequence through the corresponding target audio equipment according to the priority order of the preset scenes for the engineering machinery, and execute the corresponding audio control instructions.

[0023] In a possible implementation manner, after determining whether the preset scene in which the engineering machinery is located is greater than one, the method further includes:

[0024] When it is determined that the engineering machinery is in more than one preset scene and has the same priority, the integrated voice drive module is controlled to send the called voice data through the corresponding target audio device in a polling playback manner and execute the corresponding audio control instruction.

[0025] In a second aspect, the present invention provides a voice control system for engineering machinery, which is applied to engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, and the system includes:

[0026] A scene recognition unit, the scene recognition unit is connected to the vehicle interface of the engineering machine, and is used to obtain state information, and based on the state information, determine the preset scene in which the engineering machine is located, the state information including: the state of the engineering machine and the posture of the driver;

[0027] A voice drive unit, the voice drive unit is connected to the integrated voice drive module, and is used to call the voice data and audio control instructions corresponding to the preset scene in which the engineering machinery is located, and control the integrated voice drive module to send the called voice data through the target audio device and execute the audio control instructions. The target audio device is the audio device of the engineering machinery, which corresponds to the preset scene in which the engineering machinery is located.

[0028] In a possible implementation, the vehicle-machine interface includes: a CAN bus, an Ethernet bus, a hard line, a camera, and a microphone.

[0029] In a possible implementation, the audio equipment includes: an external vehicle voice alarm, an instrument voice alarm, and a multimedia speaker.

[0030] In a third aspect, the present invention provides an engineering machine, comprising an engineering machine body and a voice control system for the engineering machine provided in the second aspect of the present invention;

[0031] Among them, the engineering machinery body adopts an integrated voice drive module to drive different audio equipment respectively.

[0032] In a fourth aspect, the present invention provides an electronic device, the electronic device comprising:

[0033] processor;

[0034] a memory for storing instructions executable by the processor;

[0035] The processor is used to execute the voice control method for engineering machinery provided in the first aspect of the present invention.

[0036] According to the voice control method for engineering machinery provided by the present invention, the preset scene in which the engineering machinery is located is determined by acquiring the state information of the engineering machinery and then based on the state information of the engineering machinery. At the same time, because the voice control method for engineering machinery is applied to engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, after calling the voice data corresponding to the preset scene in which the engineering machinery is located, the called voice data can be sent out through the audio device of the engineering machinery by controlling the integrated voice drive module, corresponding to the target audio device in the preset scene in which the engineering machinery is located. On the one hand, active identification of the scene in which the engineering machinery is located and active driving of multiple audio devices are realized, thereby improving driving safety and human-computer interaction experience. On the other hand, by allowing the engineering machinery to drive different audio devices respectively through an integrated voice drive module, some voice chips configured on the engineering machinery can be removed, thereby not only improving the performance of voice control but also reducing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0038] Figure 1 Shown is a flow chart of a voice control method for engineering machinery provided by an embodiment of the present invention.

[0039] Figure 2 Shown is a structural diagram of a voice control system for engineering machinery provided by an embodiment of the present invention.

[0040] Figure 3 Shown is a structural diagram of another voice control system for engineering machinery provided by an embodiment of the present invention.

[0041] Figure 4 Shown is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0042] Unless otherwise defined, the technical terms or scientific terms used in the embodiments of this specification shall have the common meanings understood by persons with ordinary skills in the field to which this specification belongs. The words "first", "second" and similar words used in the embodiments of this specification do not indicate any order, quantity or importance, but are only used to avoid confusion of constituent elements.

[0043] Unless the context requires otherwise, throughout the specification, "plurality" means "at least two", and "including" is interpreted as an open, inclusive meaning, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "examples", "specific examples" or "some examples" are intended to indicate that a particular feature, structure, material or characteristic associated with the embodiment or example is included in at least one embodiment or example of the specification. The schematic representation of the above terms does not necessarily refer to the same embodiment or example.

[0044] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0045] At present, the audio equipment of construction machinery is usually controlled by passive triggering, which not only has a poor human-machine interaction experience, but also has little effect on improving driving safety. For example, the multimedia speaker or instrument sound alarm device in the cab will only be triggered to issue a voice prompt related to "Do not drive while fatigued" when the construction machinery has been driving for a preset time.

[0046] At the same time, the control of the audio equipment of construction machinery is currently independent of each other, that is, for different audio equipment such as the external voice alarm, the multimedia speaker in the cab, and the instrument sound alarm device, not only do they need to be equipped with voice chips separately, which makes the cost of the whole vehicle high, but also makes the control of the audio equipment not smart enough, affecting the improvement of driving safety. For example: when the multimedia speaker is playing, if the construction machinery is judged to be pre-reversing based on the state of the construction machinery, only the external voice alarm will be triggered to give voice prompts related to reversing, while the multimedia speaker in the cab will continue to play, which cannot serve as a warning to the driver.

[0047] Based on this, a control method based on monitoring the status of construction machinery to actively trigger the operation of audio equipment has also emerged. However, although this control method realizes the active triggering of audio equipment, thereby improving driving safety and human-computer interaction experience, the control of each audio equipment is still independent of each other, that is, there is still a problem that the control of audio equipment is not intelligent enough, which affects the improvement of driving safety.

[0048] The present invention aims to solve the above-mentioned problem by setting a voice control method for engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, so that after determining the preset scene of the engineering machinery based on the acquired state information of the engineering machinery, the corresponding voice data and audio control instructions can be called based on the preset scene of the engineering machinery, and the called voice data is sent out through the audio device of the engineering machinery corresponding to the preset scene of the engineering machinery based on the integrated voice drive module, and the audio control instructions are executed, thereby, on the one hand, actively identifying the preset scene of the engineering machinery and driving multiple audio devices, thereby improving driving safety and human-computer interaction experience; on the other hand, the voice chips of some audio devices can be removed, so that the driving functions of the audio devices are integrated together, with lower costs, more powerful functions and better experience.

[0049] Furthermore, the voice control method for engineering machinery provided by the present invention is executed on an electronic device. For example, the electronic device may be a controller integrated in a central control or instrument of the engineering machinery.

[0050] Based on the above content, the embodiment of the present invention provides a voice control method for engineering machinery using an integrated voice driving module to drive different audio devices respectively. Figure 1 , Figure 1 : is a flow chart of a voice control method for an engineering machine provided by an embodiment of the present invention. The flow of the voice control method for an engineering machine provided by this embodiment may include:

[0051] S100: Obtain status information.

[0052] The status information includes: the status of the construction machinery and the posture of the driver.

[0053] Specifically, the status information of the construction machinery can be obtained through the vehicle computer interface on the construction machinery. For example, the driver's posture can be obtained through a camera; the status of the construction machinery can be obtained through a CAN (Controller Area Network) bus and an Ethernet bus.

[0054] S110: Determine a preset scene in which the construction machinery is located based on the status information.

[0055] Specifically, the state of the construction machinery can directly reflect the driver's current operation of the construction machinery, as well as the failures and alarms of the construction machinery, while the driver's posture can directly reflect the driver's driving intention and state. Therefore, after pre-defining the scene, the scene in which the construction machinery is located can be determined by obtaining the state of the construction machinery and the driver's posture.

[0056] For example, through the status of the construction machinery, it can be determined whether the construction machinery is in reversing, turning left, turning right, etc.; through the driver's posture, it can be determined whether the construction machinery is in a fatigue driving state.

[0057] It is understandable that during the operation of construction machinery, if voice reminders can be triggered in time when someone enters the operation coverage of the construction machinery, safety accidents can be effectively avoided, thereby improving driving safety. Similarly, if corresponding voice reminders can be triggered based on voice commands when the driver issues voice commands, the human-computer interaction experience can be improved.

[0058] Based on this, in a possible embodiment, the status information also includes: working environment and voice instructions.

[0059] Among them, the working environment can be obtained through the camera, and the voice commands can be obtained through the microphone.

[0060] Specifically, by acquiring the working environment and voice commands, it can be further determined whether the construction machinery is in a scenario where pedestrians are approaching on the left, pedestrians are approaching on the right, music is playing, etc.

[0061] S120: Calling voice data and audio control instructions corresponding to a preset scene in which the construction machinery is located.

[0062] Specifically, after determining the preset scene of the construction machinery based on the status information, since corresponding voice data and audio control instructions are associated with various preset scenes, for example, the preset scene "reversing" is associated with voice data "pay attention when reversing" and audio control instruction "mute the multimedia system"; the preset scene "driver fatigue" is associated with voice data "please take a rest in time" and audio control instruction "play the multimedia system". Therefore, the voice data and audio control instructions corresponding to the preset scene of the construction machinery can be called.

[0063] In an optional embodiment, the voice control method for engineering machinery further includes:

[0064] Define preset scenarios;

[0065] Setting the voice data by at least one of the following methods;

[0066] Each preset scene is associated with the corresponding voice data and channel, and the integrated voice driver module is connected to different audio equipment of the construction machinery through different channels;

[0067] Among them, the methods include:

[0068] Custom entry;

[0069] Imported from the corresponding interface of the construction machinery;

[0070] Call the voice package that comes with the construction machinery when it leaves the factory.

[0071] Specifically, preset scenarios may be predefined including: "reversing", "pedestrian approaching on the left", "driver fatigue", "vehicle failure", etc.

[0072] More specifically, voice data can be set based on custom input, imported through the corresponding interface of the construction machinery, and called by the voice package that comes with the construction machinery when it leaves the factory. This allows voice data to expand multiple sound sources, making the voice data of the construction machinery flexibly enriched and compatible with more languages, such as dialects, different languages, etc., thereby improving the user experience.

[0073] Furthermore, because the integrated voice drive module of the engineering machinery is connected to different audio devices through different channels, by associating each preset scene with the corresponding voice data and channel, different audio devices can be driven through different channels by controlling the integrated voice drive module, thereby achieving the purpose of driving and controlling the corresponding audio devices based on the preset scene in which the engineering machinery is located.

[0074] In some possible embodiments, custom input of voice data may be achieved by allowing the user to input voice data through a microphone in the cab of the engineering machinery; importing voice data through the corresponding interface of the engineering machinery may be achieved by importing voice files through the USB interface of the engineering machinery, and by importing voice files through wireless communication methods such as Bluetooth or WIFI.

[0075] It should be noted that when setting voice data through custom entry, generally only custom permissions are open for external voice alarms, that is, voice data used to remind pedestrians and vehicles outside the vehicle. Because the voice data emitted by the instrument voice alarm involves driver safety, custom permissions are not open for the voice data of the instrument voice alarm to improve the safety of voice control using the voice control method for engineering machinery provided in an embodiment of the present invention.

[0076] S130, controlling the integrated voice driving module to send the called voice data through the target audio device and execute the audio control instruction.

[0077] The target audio device is an audio device of the engineering machinery, which corresponds to an audio device of a preset scene in which the engineering machinery is located.

[0078] In this embodiment, by setting a voice control method for engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, after determining the preset scene of the engineering machinery based on the acquired state information of the engineering machinery, the corresponding voice data and audio control instructions can be called based on the preset scene of the engineering machinery, and the called voice data is sent out through the audio device of the engineering machinery corresponding to the preset scene of the engineering machinery based on the integrated voice drive module, and the audio control instructions are executed, so that on the one hand, by actively identifying the preset scene of the engineering machinery, multiple audio devices are driven, and the driving safety and human-computer interaction experience are improved; on the other hand, the voice chips of some audio devices can be removed, so that the driving functions of the audio devices are integrated together, for example: when the integrated voice drive module is integrated into the central control of the engineering machinery, the voice chips of the instrument and the voice alarm outside the vehicle can be removed; when the integrated voice drive module is integrated into the instrument of the engineering machinery, the voice chips of the central control and the voice alarm outside the vehicle can be removed. Thereby, the cost of the engineering machinery is lower, the voice function is more powerful, and the experience is better.

[0079] It is understandable that when the status information satisfies the conditions of different scenes preset for the engineering machinery at the same time, it can be determined that the engineering machinery is in more than one preset scene. At this time, if after calling the voice data and audio control instructions corresponding to the preset scene where the engineering machinery is located, the integrated voice drive module is controlled to send all the called voice data through the target audio device and execute all the audio control instructions, it is possible to cause conflicts between the data and the control instructions. For example: when the preset scene "reversing" corresponds to the voice data "please pay attention to reversing" issued by the external voice alarm and the audio control instruction "multimedia system mute" executed by the multimedia speaker, and the preset scene "driver fatigue" corresponds to the voice data "please take a rest in time" issued by the instrument voice alarm and the audio control instruction "multimedia system play" executed by the multimedia speaker, if it is determined based on the status information that the preset scene where the engineering machinery is located includes "reversing" and "driver fatigue", the audio control instructions to be executed by the multimedia speaker conflict.

[0080] Based on this, in a possible embodiment, the voice control method for engineering machinery further includes:

[0081] Define the priority of each preset scenario;

[0082] The control integrated voice driver module sends the called voice data through the target audio device and executes the audio control instructions, including:

[0083] Determine whether the preset scene where the construction machinery is located is greater than 1;

[0084] When it is determined that the engineering machinery is in more than one preset scene and the priorities are different, the integrated voice drive module is controlled to send the called voice data through the corresponding target audio equipment in sequence according to the priority order of the preset scenes in which the engineering machinery is located, and execute the corresponding audio control instructions.

[0085] Specifically, by defining the priority of the preset scene when defining the preset scene, when it is determined based on the state information that the engineering machinery is in more than one preset scene, the integrated voice drive module can be controlled to play and execute the called voice data and audio control instructions in order of priority, thereby avoiding conflicts in the playback of voice data and / or the execution of audio control instructions. At the same time, it also ensures that the playback of voice data and the execution of audio control instructions meet the needs of urgency, thereby further improving driving safety.

[0086] It is understandable that when the priorities of the preset scenes in which the engineering machinery is located are the same, controlling the integrated voice drive module to call the voice data and audio control instruction playback and execution in order of priority may still cause conflicts in the voice data playback and / or audio control instruction execution.

[0087] Based on this, in a possible embodiment, after determining whether the preset scene in which the engineering machinery is located is greater than one, the process further includes:

[0088] When it is determined that the engineering machinery is in more than one preset scene and has the same priority, the integrated voice drive module is controlled to send the called voice data through the corresponding target audio device in a polling playback manner and execute the corresponding audio control instructions.

[0089] In this embodiment, when it is determined that the engineering machinery is in more than one preset scene and has the same priority, the integrated voice drive module is controlled to play the called voice data through the corresponding target audio device in a polling manner and execute the corresponding audio control instructions, thereby further avoiding conflicts in voice data playback and / or audio control instruction execution.

[0090] The following is a further description of the process of voice control of engineering machinery using the voice control method of engineering machinery provided by the embodiment of the present invention in combination with examples. It can be understood that the preset scenes included below are only specific examples provided for the convenience of understanding, and are not all preset scenes that can be defined. The types of preset scenes can be flexibly set according to actual needs and can be expanded at any time.

[0091] Among them, step 1, removes the voice chip of the instrument and external voice alarm on the existing engineering machinery, and integrates the integrated voice driver module into the central control of the engineering machinery, and then connects the external voice alarm, instrument voice alarm and multimedia speaker of the engineering machinery through different channels: channel 1 drives the external voice alarm on the chassis, channel 2 drives the instrument voice alarm of the main driving accessory, and channel 3 drives the multimedia speaker.

[0092] Step 2: Define preset scenarios: "Reversing", "Pedestrian approaching on the left", "Driver fatigue", "Fire alarm". At the same time, define the priority of each preset scenario: "Fire alarm" > "Reversing" = "Pedestrian approaching on the left" > "Driver fatigue". For each preset scenario, associate specific channels and voice data, as shown in Table 1.

[0093] Table 1 Preset scenario definitions

[0094]

[0095]

[0096] Step 3: Set voice data: After selecting a preset scene on the central control interface, the user can enter voice data through the microphone, import voice files through the USB interface, and / or use the factory-provided voice package.

[0097] Step 4: Obtain the status of the construction machinery, driving environment, driver posture, voice commands and other status information through the vehicle-computer interface (CAN bus, Ethernet bus, hard wire, camera, microphone and other interfaces), and comprehensively judge the preset scene in which the construction machinery is currently located based on the status information.

[0098] Step 5, call the voice data and audio control instructions in the preset scene of the engineering machinery, send the corresponding signal from the corresponding channel, drive and control different audio equipment. When the engineering machinery is in more than one preset scene, the voice data is played and the audio control instructions are executed according to the priority of the preset scene. That is, the voice data corresponding to the preset scene with a high priority is played first, the audio control instructions are executed first, and the voice data corresponding to the preset scenes with the same priority are played in turn, and the audio control instructions are executed in turn. For example: when the preset scene is "reversing", channel 1 (external voice alarm) calls the voice data and plays "Please pay attention to reversing", and channel 3 (multimedia speaker) is muted to avoid disturbing the driver. When the preset scenes are "reversing" and "pedestrians approaching on the left", channel 1 (external voice alarm) calls the voice data and polls and plays "Please pay attention to reversing" and "Please pay attention to vehicle operation", channel 2 (instrument voice alarm) calls the voice data and plays "Pay attention to pedestrians on the left", and channel 3 (multimedia speaker) calls the audio control instruction to control the multimedia system to mute.

[0099] It can be understood that the above steps 1-3 only need to be executed when the voice control method for engineering machinery provided by the embodiment of the present invention is applied for the first time, that is, no changes are required when there is no need to expand the preset scene. The subsequent steps 4 and 5 are executed in real time each time the engineering machinery is running to ensure driving safety and improve the human-computer interaction experience.

[0100] A voice control system for engineering machinery provided in an embodiment of the present invention is introduced below. The voice control system for engineering machinery described below can be considered as a module architecture for implementing a voice control method for engineering machinery provided in an embodiment of the present invention; the content described below can be cross-referenced with the above.

[0101] See also Figure 2 , Figure 2 : is a structural block diagram of a voice control system for engineering machinery provided by an embodiment of the present invention. The system is applied to engineering machinery that uses an integrated voice drive module to drive different audio devices respectively, and may include:

[0102] A scene recognition unit 10, which is connected to the vehicle interface of the construction machinery and is used to obtain state information and determine the preset scene of the construction machinery based on the state information, wherein the state information includes: the state of the construction machinery and the posture of the driver;

[0103] The voice drive unit 20 is connected to the integrated voice drive module, and is used to call the voice data and audio control instructions corresponding to the preset scene in which the engineering machinery is located, and control the integrated voice drive module to send the called voice data through the target audio device and execute the audio control instructions. The target audio device is the audio device of the engineering machinery, which corresponds to the preset scene in which the engineering machinery is located.

[0104] In an optional embodiment, the vehicle interface includes: a CAN bus, an Ethernet bus, a hard line, a camera, and a microphone.

[0105] In an optional embodiment, the audio equipment includes: an external vehicle voice alarm, an instrument voice alarm and a multimedia speaker.

[0106] Optionally, the status information also includes: operating environment and voice commands.

[0107] Optional, such as Figure 3 As shown, the voice control system of the engineering machinery also includes:

[0108] A voice data processing unit 30, used to define a preset scenario;

[0109] Setting the voice data by at least one of the following methods;

[0110] Each preset scene is associated with the corresponding voice data and channel, and the integrated voice driver module is connected to different audio equipment of the construction machinery through different channels;

[0111] Among them, the methods include:

[0112] Custom entry;

[0113] Imported from the corresponding interface of the construction machinery;

[0114] Call the voice package that comes with the construction machinery when it leaves the factory.

[0115] Optionally, the voice data processing unit 30 is further used to define the priority of each preset scene;

[0116] The voice driving unit 20 is specifically used to determine whether the preset scene in which the engineering machinery is located is greater than one;

[0117] When it is determined that the engineering machinery is in more than one preset scene and the priorities are different, the integrated voice drive module is controlled to send the called voice data through the corresponding target audio equipment in sequence according to the priority order of the preset scenes in which the engineering machinery is located, and execute the corresponding audio control instructions.

[0118] Optionally, the voice drive unit 20 is also specifically used to control the integrated voice drive module to send the called voice data through the corresponding target audio device in a polling playback manner and execute corresponding audio control instructions when it is determined that the engineering machinery is in more than one preset scene with the same priority.

[0119] Optionally, an embodiment of the present invention further provides an engineering machinery, comprising an engineering machinery body and a voice control system of the engineering machinery as provided in any of the aforementioned embodiments; and the engineering machinery body of the engineering machinery adopts an integrated voice drive module to drive different audio devices respectively.

[0120] Below, reference Figure 4 To describe the electronic device provided by the embodiment of the present application, the electronic device provided by the embodiment may include: at least one processor 100, at least one communication interface 200, at least one memory 300 and at least one communication bus 400;

[0121] In the embodiment of the present invention, the number of the processor 100, the communication interface 200, the memory 300, and the communication bus 400 is at least one, and the processor 100, the communication interface 200, and the memory 300 communicate with each other through the communication bus 400; obviously, Figure 4 The communication connections shown for the processor 100, the communication interface 200, the memory 300, and the communication bus 400 are merely optional;

[0122] Optionally, the communication interface 200 may be an interface of a communication module, such as an interface of a GSM module; the processor 100 may be a central processing unit CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention.

[0123] The memory 300 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0124] The processor 100 is specifically used to execute the application program in the memory to implement the steps of the above-mentioned voice control method for engineering machinery.

[0125] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0126] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0127] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0128] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0129] It should be understood that the qualifiers "first", "second", "third", "fourth", "fifth" and "sixth" used in the description of the embodiments of the present application are only used to more clearly explain the technical solutions and cannot be used to limit the scope of protection of the present application.

[0130] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A voice control method for engineering machinery, characterized in that: Applied to engineering machinery using an integrated voice drive module to drive different audio devices respectively, the method comprises: Acquiring status information, wherein the status information includes: a state of the construction machinery and a posture of the driver; Based on the state information, determining a preset scene in which the engineering machinery is located; Calling voice data and audio control instructions corresponding to a preset scene in which the engineering machinery is located; The integrated voice driving module is controlled to send the called voice data through the target audio device and execute the audio control instruction. The target audio device is an audio device among the audio devices of the engineering machinery, corresponding to the preset scene in which the engineering machinery is located.

2. The method according to claim 1, characterized in that The status information also includes: operating environment and voice instructions.

3. The method according to claim 1, characterized in that Also includes: Defining the preset scenario; Setting the voice data by at least one of the following methods; Associating each of the preset scenes with the corresponding voice data and channels, and connecting the integrated voice drive module to different audio devices of the engineering machinery through different channels; The method includes: Custom entry; Imported by a corresponding interface of the engineering machinery; The voice package provided by the construction machinery when it leaves the factory is called.

4. The method according to claim 1, characterized in that: Also includes: Defining the priority of each of the preset scenarios; The controlling the integrated voice driving module to send the called voice data through the target audio device and execute the audio control instruction includes: Determine whether the preset scene in which the engineering machinery is located is greater than one; When it is determined that the preset scenes for the engineering machinery are greater than one and have different priorities, the integrated voice drive module is controlled to send the called voice data in sequence through the corresponding target audio equipment according to the priority order of the preset scenes for the engineering machinery, and execute the corresponding audio control instructions.

5. The method according to claim 4, characterized in that After determining whether the preset scene in which the engineering machinery is located is greater than one, the method further includes: When it is determined that the engineering machinery is in more than one preset scene and has the same priority, the integrated voice drive module is controlled to send the called voice data through the corresponding target audio device in a polling playback manner and execute the corresponding audio control instruction.

6. A voice control system for engineering machinery, characterized in that: Applicable to engineering machinery using an integrated voice drive module to drive different audio devices respectively, the system comprises: A scene recognition unit, the scene recognition unit is connected to the vehicle interface of the engineering machine, and is used to obtain state information, and based on the state information, determine the preset scene in which the engineering machine is located, the state information including: the state of the engineering machine and the posture of the driver; A voice drive unit, the voice drive unit is connected to the integrated voice drive module, and is used to call the voice data and audio control instructions corresponding to the preset scene in which the engineering machinery is located, and control the integrated voice drive module to send the called voice data through the target audio device and execute the audio control instructions. The target audio device is the audio device of the engineering machinery, which corresponds to the preset scene in which the engineering machinery is located.

7. The system according to claim 6, characterized in that The vehicle computer interface includes: CAN bus, Ethernet bus, hard wire, camera and microphone.

8. The system according to claim 6, characterized in that The audio equipment includes: an external voice alarm, an instrument voice alarm and a multimedia speaker.

9. An engineering machine, characterized in that: It comprises an engineering machine body and a voice control system for the engineering machine as claimed in claim 8; Among them, the engineering machinery body adopts an integrated voice drive module to drive different audio equipment respectively.

10. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; The processor is used to execute the method according to any one of claims 1 to 5.

Images