Voice command creation device and computer-readable storage medium

Abstract

This voice command creation device receives designation of voice content for operating an industrial machine, receives designation of operation content corresponding to the voice content, receives designation of an image indicating the operation content, and creates a voice command in which the designated voice content, operation content, and image are associated with each other.

Description

Voice command creation device and computer-readable storage medium

[0001] The present disclosure relates to a voice command creation device and a computer-readable storage medium.

[0002] Conventionally, there are voice command devices that operate using human voices. In a voice command device, associations between commands called voice commands and the operations of a machine are stored, and the operations spoken by a user are executed by the machine. Examples of voice command devices include automobiles and mobile phones. There are also voice command devices for industrial machines in factories (for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2020-42420

[0004] A voice command device stores associations between voice content and operations. The voice command device has a voice recognition function and operates according to the recognized voice content when it acquires a voice close to the registered voice content. To operate an industrial machine by voice, it is necessary to memorize the voice content that serves as a command. There are limits to a user's memory and also limits to the number of voice contents that can be used. Also, using incorrect voice content can cause malfunction.

[0005] At the site, it is desired to improve the operability of voice commands.

[0006] A voice command creation device according to one aspect of the present disclosure includes a voice specification reception unit that receives a specification of voice content for operating an industrial machine, an operation specification reception unit that receives a specification of operation content corresponding to the voice content, an image specification reception unit that receives a specification of an image indicating the operation content, and a command creation unit that creates a voice command associating the specified voice content, operation content, and image.

[0007] This is a schematic diagram showing the relationship between the voice command creation device and the voice command device. This is a block diagram of the voice command creation device of the first embodiment. This is a diagram showing the specified voice content. This is a diagram showing the specified operation content. This is a diagram showing an example of an image. This is a diagram showing an example of a voice command. This is a diagram showing the functions of the voice command of this embodiment. This is a diagram showing an example of a list display of images. This is a flowchart explaining the operation of the voice command creation device. This is a diagram showing an example of a numbered image. This is a diagram showing an example of a voice command in which numbers are used as voice content and associated with operation content. This is a hardware configuration diagram of the voice command creation device.

[0008] Embodiments of this disclosure will be described below with reference to the drawings. In the following description, components having the same or similar functions will be denoted by the same reference numerals. Duplication of these components may be omitted.

[0009] In this application, "based on XX" means "based on at least XX," and includes cases where it is based on another element in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on something that has been calculated or processed. "XX" is any element (for example, any information).

[0010] The voice command creation device 100 can be implemented on, for example, a numerical control device, a personal computer attached to the numerical control device, or a personal computer, cell computer, fog computer, cloud server, or other computer connected to the numerical control device via a wired / wireless network.

[0011] Figure 1 shows the relationship between the voice command creation device 100 and the voice command device. The voice command creation device creates voice commands that will function on the voice command device. The voice command device recognizes the voice content and executes the action associated with the voice content. The operation details of the industrial machine are provided in advance by the industrial machine manufacturer or the like. The voice command creation device creates a voice command by associating the provided operation details with the voice content and user information.

[0012] Voice command systems are industrial machines used in manufacturing facilities. Industrial machines include machine tools and numerical control devices. Voice command systems encompass not only the industrial machines themselves, but also remote controllers for operating them remotely, pendants, and computers attached to the machines.

[0013] [First Embodiment] Figure 2 is a block diagram of the voice command creation device 100 according to the first embodiment. The voice command creation device 100 comprises a voice specification receiving unit 1, an operation specification receiving unit 2, an image specification receiving unit 3, an image storage unit 4, and a command creation unit 5.

[0014] The voice specification reception unit 1 receives the specification of voice content. The voice content can be specified by voice or text. Figure 3 shows an example of specified voice content. In the example in Figure 3, the specified voice content includes "Tool management screen," "Tool change 4," and "Interior light ON."

[0015] The operation specification reception unit 2 receives specifications for the operation of the industrial machine. A list of industrial machine operations is provided in advance by the industrial machine manufacturer, etc. The operation specification reception unit 2 receives specifications for the operation content from the user. The operation content can be entered as text or selected using tabs. Figure 4 shows an example of specified operation content. In the example in Figure 4, the specified operation content is "Switch to tool management screen", "Switch to tool number 4", "Turn on the machine light", etc.

[0016] The image selection reception unit 3 accepts the selection of an image to be stored in the image storage unit. The image storage unit 4 has images registered that evoke the operation of industrial machinery.

[0017] The image is image data that evokes the operation of the industrial machine. There are no restrictions on the format of the image. The image can be a video, a still image, or text. Examples include the management screen of the industrial machine, an image of the industrial machine's operation, a description of the operation, and a video explaining the operation.

[0018] The image selection reception unit 3 may also present images as selection candidates that are associated with the audio content received by the audio selection reception unit 1. For example, it may present images associated with audio content similar to the specified audio content, or images associated with actions that contain phrases similar to the specified audio content, as selection candidates. The operation list of industrial machinery contains many operations. When selecting an image, it is burdensome for the user to select the desired action from among many actions. By presenting image candidates according to the specified audio content, the burden on the user to select an image can be reduced.

[0019] Figure 5 shows examples of images. The leftmost image in Figure 5 is the tool management screen of the numerical control device. This image makes it clear that the operation is the display of the tool management screen. The middle image is an image of tool change. The tool in this image displays tool number "4". This image makes it clear that the operation is switching to tool number 4. The rightmost image is an image of the machine's interior light turning on. This image makes it clear that the operation is turning on the machine's interior light. The user selects an image that evokes the audio content and the operation content.

[0020] The command creation unit 5 creates a voice command by associating the specified voice content, action content, and image. Figure 6 shows an example of a voice command. The data format can be a table, or it can be associated by ID, as in non-SQL. In the first voice command, the voice content "Tool management screen", action content "Switch to tool management screen", and image "Image of tool management screen" are associated. In the second voice command, the voice content "Tool change 4", action content "Switch to tool number 4", and image "Arrow and tool number 4" are associated. In the third voice command, the voice content "Interior light ON", action content "Turn on the interior light", and image "Lighted light bulb and the word ON" are associated.

[0021] The voice command in this embodiment includes a function to display an image. Figure 7 shows the functions of the voice command. The functions of the voice command include: "operation history acquisition function," "image list display function," "image filtering function," "image sorting function," "image display function showing recognition result," and "request acceptance function."

[0022] This section explains "Image List Display," "Image Filtering," and "Image Sorting." Figure 8 shows an example of the image list display. Voice commands display a list of images associated with the voice content and action content. Each image has the text "Voice Content" and "Action Content" attached to it. The leftmost image in Figure 8 has the text "Voice Content: "Tool Management Screen"" and "Action Content: Switch to Tool Management Screen" attached, the middle image has the text "Voice Content: "Tool Change 4" and "Action Content: Switch to Tool No. 4" attached, and the rightmost image has the text "Voice Content: "Interior Light ON" and "Action Content: Turn on Interior Light."

[0023] There are no particular restrictions on the types of images to display or their display order, but the display may be optimized by sorting or filtering. For example, by "getting the operation history" and "sorting the images," the images can be rearranged in order of frequency of use. Adding a scrolling function to the display area allows images of less frequently used voice commands to be displayed as well.

[0024] Image filtering includes methods such as "user filtering" and "machine status filtering." User filtering retrieves images associated with the user. For example, if the user has customized the voice content, it retrieves images of the voice commands customized by the user.

[0025] "Filtering by machine status" retrieves status information of industrial machinery. There is a relationship between the operation content and the status information. By obtaining information that links the operation content and the status information, "filtering by machine status" becomes possible. Voice commands may also have a function to combine multiple filters. For example, after performing "filtering by user," images of voice commands previously operated by the user may be retrieved based on the operation history. The filtered images may be sorted by frequency of use.

[0026] Next, we will explain "Display of images indicating recognition results." "Display of images indicating recognition results" is a function that displays images associated with the voice recognition results on the display unit of the industrial machine. The user can use the image to confirm whether the industrial machine is operating as expected. If an unexpected image is displayed, the user can also interrupt the operation using voice commands.

[0027] Next, we will explain the "Request Acceptance Function." The Request Acceptance Function is a function that allows you to request assistance in operating voice commands using voice commands. The Request Acceptance Function has registered voice commands such as "Help" and "List Display" as voice content. For example, if the voice command "Help" is recognized, the system will display instructions on how to use the voice command, and if the voice command "List Display" is recognized, it will display a list of text and images that indicate the action to be performed.

[0028] Figure 9 is a flowchart illustrating the operation of the voice command creation device 100. The voice specification reception unit 1, the action specification reception unit 2, and the image specification reception unit 3 receive specifications for voice content, action content, and image (step S1).

[0029] The command creation unit 5 associates the specified audio content with the action content and the image (step S2).

[0030] The command creation unit 5 adds functions such as "operation history acquisition function," "request acceptance function," "image list display function," "image filtering function," "image sorting function," and "image display function showing recognition result" to the voice command (step S3). This completes the voice command with an image display function (step S4).

[0031] As described above, the voice command creation device 100 of the first embodiment creates voice commands that associate "images" with "voice content" and "action content". The voice commands of this embodiment have a function to display the "images" associated with the "voice content" and "action content". When a user forgets the "voice content" or wants to check the "voice content", the "image" can be displayed to help them recall the "voice content".

[0032] Voice commands will now include features such as "image filtering" and "image sorting." This will limit the number of images displayed and optimize the display order, making it easier to search for images.

[0033] Furthermore, a function will be added to display an image associated with the recognized "audio content" to verify whether the speech recognition result is correct. This will help avoid misrecognition of speech content and incorrect utterances.

[0034] [Second Embodiment] The voice command creation device 100 of the second embodiment creates voice commands, equipped with a numbering function for a list of displayed images and a voice command addition function. Figure 10 shows an example of a list of numbered images. A number is added to each image. In Figure 10, the leftmost image is labeled "1", the middle image is labeled "2", and the rightmost image is labeled "3". Note that numbers are added here for explanatory purposes, but symbols or text may also be used.

[0035] [Correction based on Rule 91 08.05.2026] The voice command addition function is a function that adds voice commands that associate numbers with actions. Figure 11 shows a newly created voice command. In a newly created voice command, the "number" that the voice command has assigned to the image list display is also assigned as "voice content". This "number" is a voice command that can be used temporarily when displaying the image list. When the user speaks the "number" assigned to the image, the "action content" associated with the "number" is executed. This allows the user to operate industrial machinery using voice commands even if they forget the "voice content".

[0036] The hardware configuration of the voice command creation device 100 to which this disclosure applies will be described below. Figure 12 is a hardware configuration diagram of the voice command creation device 100. As shown in Figure 12, the voice command creation device 100 includes a CPU 111 that controls the voice command creation device 100 as a whole, a ROM 112 that records programs and data, and a RAM 113 for temporarily expanding data. The CPU 111 reads the system program recorded in the ROM 112 via the bus and determines the consistency between the block and the tool.

[0037] The non-volatile memory 114 is backed up, for example, by a battery (not shown), so that its stored state is maintained even when the power to the voice command creation device 100 is turned off. Various data such as programs read from the external device 120 via interfaces 115, 118, and 119, and operation inputs entered via the input device 20 are stored in the non-volatile memory 114. Programs and data for executing the voice command creation device 100 of this embodiment may also be stored in the non-volatile memory 114.

[0038] Interface 115 is an interface for connecting the voice command creation device 100 to an external device 120 such as an adapter. Programs and various parameters are read from the external device 120. Interface 118 is an interface for connecting the voice command creation device 100 to a display device 30 such as a liquid crystal display. The display device 30 displays data obtained as a result of the execution of various data, programs, etc., that have been read into memory. Interface 119 is an interface for connecting the voice command creation device 100 to an input device 20 such as a keyboard or pointing device. The input device 20 passes commands, data, etc., based on operations by the operator to the CPU 111 via interface 119.

[0039] While this disclosure has been described in detail, it is not limited to the individual embodiments described above. These embodiments can be added, replaced, modified, partially deleted, etc., in any way that does not depart from the gist of this disclosure or from the spirit of this disclosure derived from the claims and their equivalents. These embodiments can also be implemented in combination. For example, the order of operations and processes in the embodiments described above are given as examples only and are not limited thereto.

[0040] The following are additional notes regarding embodiments of the present disclosure. (Note 1) The voice command creation device (100) includes a voice specification receiving unit (1) that receives the specification of voice content for operating an industrial machine, an operation specification receiving unit (2) that receives the specification of operation content corresponding to the voice content, an image specification receiving unit (3) that receives the specification of an image representing the operation content, and a command creation unit (5) that creates a voice command associating the specified voice content, operation content, and image. (Note 2) The voice command has a function to cause the industrial machine to display a list of images associated with the voice content. (Note 3) The voice command has a numbering function that causes the industrial machine to display a list of images with at least one of a number or a symbol attached to the images, and a voice command adding function that causes the industrial machine to execute a process to add a voice command associating the number or symbol with operation content as voice content. (Note 4) The voice command includes an operation history acquisition function that causes the industrial machine to acquire an operation history based on the voice command, and an image sorting function that causes the industrial machine to sort images according to their frequency of use based on the operation history. (Note 5) The voice command includes a filtering function that causes the industrial machine to perform a process to retrieve images associated with the user of the industrial machine. (Note 6) The voice command includes a recognition result display function that causes the industrial machine to display an image showing the result of voice recognition. (Note 7) The voice specification receiving unit (1) accepts the specification of voice content, and the image specification receiving unit (3) presents images that are similar to the voice content and are associated with already registered voice content as selection candidates. (Note 8) The computer-readable storage medium (112, 113, 114) stores instructions for one or more processors (111) to receive a specification of voice content for operating an industrial machine, a specification of action content corresponding to the voice content, a specification of an image representing the action content, and to create a voice command associating the specified voice content, action content, and image.

[0041] 100 Voice command creation device 1 Voice specification receiving unit 2 Action specification receiving unit 3 Image specification receiving unit 4 Image storage unit 5 Command creation unit 111 CPU 112 ROM 113 RAM 114 Non-volatile memory

Claims

1. A voice command creation device comprising: a voice specification receiving unit that receives the specification of voice content for operating industrial machinery; an action specification receiving unit that receives the specification of action content corresponding to the voice content; an image specification receiving unit that receives the specification of an image representing the action content; and a command creation unit that creates a voice command associating the specified voice content, action content, and image.

2. The voice command creation device according to claim 1, further comprising a function to cause the industrial machine to display a list of images associated with the voice content of the voice command.

3. The voice command creation device according to claim 1, comprising: a numbering function that causes the industrial machine to display a list display in which at least one of numbers or symbols is attached to an image; and a voice command addition function that causes the industrial machine to perform a process of adding a voice command in which the number or symbol is used as voice content and associated with an operation content.

4. The voice command creation device according to claim 1, comprising: an operation history acquisition function that causes the industrial machine to acquire an operation history based on the voice command; and an image sorting function that causes the industrial machine to sort images according to their frequency of use based on the operation history.

5. The voice command creation device according to claim 1, further comprising a filtering function that causes the industrial machine to perform a process of retrieving an image associated with the user using the industrial machine.

6. The voice command creation device according to claim 1, further comprising a recognition result display function that causes the industrial machine to display an image showing the result of voice recognition for the voice command.

7. The voice command creation device according to claim 1, wherein the voice specification receiving unit receives a specification of voice content, and the image specification receiving unit presents as a selection candidate an image that is similar to the voice content and is associated with already registered voice content.

8. A computer-readable storage medium that stores instructions for one or more processors to execute a process that receives a specification of voice content for operating an industrial machine, a specification of action content corresponding to the voice content, a specification of an image representing the action content, and creates a voice command associating the specified voice content, action content, and image.

Images