Information processing device and program

By implementing priority control of voice processing requests in the information processing device, the problem of setting conflicts in user voice requests is solved, ensuring that the settings of processing use user intentions are set, and the consistency and accuracy of processing are improved.

JP7655105B2Active Publication Date: 2025-04-02FUJIFILM BUSINESS INNOVATION CORP
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2021099486
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-15
Publication Date
2025-04-02
Estimated Expiration
2041-06-15

AI Technical Summary

Technical Problem

When a user processes through a voice request, if there is a conflicting relationship in the settings, the prior art may not ensure that the processing uses the settings intended by the user, especially if there is a set priority conflict between screen operations and voice operations.

Method used

By implementing priority control of voice processing requests in the information processing device, it is ensured that when there are conflicting settings in the voice request, the previous utterance settings are processed first, unless subsequent utterance settings are clearly distinguished in the voice or have higher priority.

Benefits of technology

Improves the possibility of setting consistency during user voice request processing, ensures that the settings used by the user are intended, and reduces processing errors caused by setting conflicts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007655105000001
    Figure 0007655105000001
  • Figure 0007655105000002
    Figure 0007655105000002
  • Figure 0007655105000003
    Figure 0007655105000003
Patent Text Reader

Abstract

To enhance the possibility that processing is performed according to a setting intended by a user as compared with a configuration in which when a request for processing based on a voice uttered by a user includes settings in a prohibition relationship, processing is performed according to the setting selected when a request for processing based on an operation of a display has settings in a prohibition relationship.SOLUTION: An information processing device comprises a processor. The processor receives a request for processing based on a voice uttered by a user and when the request includes a first setting and a second setting in a prohibition relationship, if the first setting is uttered prior to the second setting in an uttered voice, performs control such that processing is executed according to the first setting.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] Patent document 1 describes a speech device with a speech function, which includes a determination means for determining whether there are two or more speech data that can be spoken at the time of speech, for speech data for which a period during which speech can be spoken is preset, and a speech means for preferentially speaking speech data with a high priority that is pre-associated with each of the two or more speech data that can be spoken at the time of speech, when the determination means determines that there are two or more speech data that can be spoken at the time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-227951 A Summary of the Invention [Problem to be solved by the invention]

[0004] A processing request based on a user's voice may include settings that are in a forbidden relationship. In this case, if the processing is performed using the setting selected when the processing request based on a screen operation includes settings that are in a forbidden relationship, the processing may not be performed using the setting intended by the user. For example, when a processing request based on a screen operation includes settings that are in a forbidden relationship, the setting that was set later is generally selected. In contrast, when a processing request based on a user's voice includes settings that are in a forbidden relationship, the setting that was set earlier is often important, so if the setting that was set later is selected, the setting that was set later may not necessarily be the setting intended by the user.

[0005] The object of the present invention is to increase the likelihood that processing will be performed with the settings intended by the user when a processing request based on a user's spoken voice includes settings that are in a forbidden relationship, compared to a configuration in which processing is performed with the settings selected when a processing request based on a screen operation includes settings that are in a forbidden relationship. [Means for solving the problem]

[0006] The invention described in claim 1 includes a processor, the processor receiving a request for processing based on a user's speech, the request including a first setting and a second setting that are in a prohibition relationship. fruit In the speech, the first setting is uttered before the second setting. In case , the speech includes the first setting, the second setting, and a request for the first setting and the second setting; Controlling the process so that it is performed in the first setting and controlling the processing to be performed in the second setting on the condition that the speech voice includes a first speech unit including the first setting and a request for the first setting, and a second speech unit including the second setting and a request for the second setting in a distinguishable manner. The information processing device is characterized by: The invention described in claim 2 further comprises: When the process is controlled to be performed under the first setting, In the first setting The Control to output a response voice indicating that processing is being performed and when controlling the process to be performed in the second setting, controlling the process to output a response voice indicating that the process will be performed in the second setting. The information processing device according to claim 1, further comprising: Claim 3 The invention described in is characterized in that the processor controls the processing to be performed under the second setting under the further condition that the second utterance unit is uttered after the response voice output in response to the first utterance unit. Claim 1 The present invention relates to an information processing device. Claim 4 The invention described in a processor, the processor receiving a processing request based on a speech voice of a user, and when the request includes a first setting and a second setting that are in a forbidden relationship with each other, if the first setting is spoken before the second setting in the speech voice, the processor controls so that the processing is performed with the first setting, and if the first setting is spoken before the second setting in the speech voice and the first setting and the second setting are spoken within one speech unit, the processor controls so that the processing is performed with the second setting, The second setting being spoken in a manner that is distinguishable from the first setting includes the second setting being spoken with a predetermined wording added thereto. Characterized by It is an information processing device. Claim 5 The invention described in the above provides a method for making a computer include a function for receiving a processing request based on a user's speech, and a first setting and a second setting in which the request is in a prohibited relationship. fruit In the speech, the first setting is uttered before the second setting. In case , the speech includes the first setting, the second setting, and a request for the first setting and the second setting; Controlling the process so that it is performed in the first setting and controlling the processing to be performed in the second setting on the condition that the speech voice includes a first speech unit including the first setting and a request for the first setting, and a second speech unit including the second setting and a request for the second setting in a distinguishable manner. It is a program to realize the functions described above. Effect of the Invention

[0007] According to the invention of claim 1, when a processing request based on a user's voice includes settings that are in a prohibited relationship, the setting that was spoken first is used. Or later spoken settings The processing can be performed in this way. According to the invention of claim 2, the previously uttered setting Or later spoken settings This allows the user to be informed that processing will be performed. Claim 3 According to the invention, when an earlier uttered setting and a later uttered setting are divided into different utterance units depending on the response, processing can be performed using the later uttered setting. Claim 4 According to the invention, when an earlier uttered setting and a later uttered setting are present in one utterance unit, it becomes easy to perform processing using the later uttered setting. Claim 5 According to the invention, when a processing request based on a user's voice includes settings that are in a prohibited relationship, the setting that was spoken first is used. Or later spoken settings The processing can be performed in this way. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of the overall configuration of a printing system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a smart speaker according to an embodiment of the present invention. [Diagram 3] FIG. 2 illustrates an example of a hardware configuration of a server according to an embodiment of the present invention. [Figure 4] FIG. 2 illustrates an example of a hardware configuration of a printing apparatus according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram for explaining a first schematic operation of the embodiment of the present invention. [Figure 6] FIG. 11 is a diagram for explaining a second schematic operation of the embodiment of the present invention. [Figure 7] FIG. 11 is a diagram for explaining a third schematic operation of the embodiment of the present invention. [Figure 8] FIG. 2 is a block diagram showing an example of a functional configuration of a server according to an embodiment of the present invention. [Figure 9] 10 is a flowchart showing an example of the operation of a server according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0010] [Outline of this embodiment] This embodiment provides an information processing device that accepts a processing request based on a user's spoken voice, and when the request includes a first setting and a second setting that are in a forbidden relationship, if the first setting is spoken before the second setting in the spoken voice, controls the processing to be performed using the first setting.

[0011] On the other hand, when the first setting is performed before the second setting by the operation on the screen, the information processing device generally controls so that the processing is performed with the second setting. That is, this embodiment also provides an information processing device that receives a processing request based on a user's speech voice, and when the request includes the first setting and the second setting that are in a forbidden relationship, controls so that the processing is performed with one of the first setting and the second setting that is different from the one selected when the processing request based on the operation on the screen is received.

[0012] Here, the process may be anything that can be executed by various devices such as a computer, but in the following, printing will be taken as an example of the process. The setting is the condition for executing the process. When the process is printing, the setting is a print setting.

[0013] In addition, two settings being in an incompatible relationship means that the two settings are in a competitive relationship with each other, that is, the two settings are in a relationship where they cannot coexist. Here, we focus on two settings that are in an incompatible relationship, but we may also focus on two settings out of three or more settings that are in an incompatible relationship.

[0014] Furthermore, in a printing system including a smart speaker that collects the user's voice and a printing device that prints according to instructions from the smart speaker, the information processing device may be either a smart speaker or a printing device. However, in the following, a server that relays between the smart speaker and the printing device is provided, and this server is used as an example of the information processing device.

[0015] [Overall configuration of the printing system] 1 is a diagram showing an example of the overall configuration of a printing system 1 in this embodiment. As shown in the figure, this printing system 1 is configured by connecting a smart speaker 10, a server 20, and a printing device 40 to a communication line 80. Note that while the figure shows only one each of the smart speaker 10, the server 20, and the printing device 40, two or more of each device may be provided.

[0016] The smart speaker 10 is a speaker with a voice assistant function that can obtain various information via a communication line 80 to respond to voice questions from a user, and can control the operation of various devices. The smart speaker 10 is also called an AI speaker. In particular, in this embodiment, when a user makes a print request by voice, the smart speaker 10 recognizes the print request, generates request information for requesting printing based on the result, and transmits the request information to the server 20.

[0017] The server 20 performs various processes based on the information transmitted from the smart speaker 10. In particular, in this embodiment, the server 20 receives request information requesting printing from the smart speaker 10, and transmits a print instruction based on this request information to the printing device 40. In this embodiment, the server 20 is provided as an example of an information processing device.

[0018] The printing device 40 prints an image on a recording medium such as paper. In particular, in this embodiment, the printing device 40 prints an image on the recording medium based on a print instruction transmitted from the server 20.

[0019] The communication line 80 is a line used for information communication between the smart speaker 10 and the server 20, and between the server 20 and the printing device 40. As the communication line 80, for example, the Internet may be used.

[0020] [Smart speaker hardware configuration] 2 is a diagram showing an example of a hardware configuration of the smart speaker 10 in the present embodiment. As shown in the figure, the smart speaker 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a communication interface (hereinafter, referred to as "communication I / F") 14, a speaker 15, and a microphone 16.

[0021] The processor 11 loads various programs stored in the ROM 13 etc. into the RAM 12 and executes them to realize processing for inputting and outputting voice. Such processing includes, for example, processing for generating voice data for outputting voice from the speaker 15, and processing for recognizing voice of a print request collected by the microphone 16 and converting it into request information.

[0022] The RAM 12 is a memory used as a working memory for the processor 11. The ROM 13 is a memory that stores various programs executed by the processor 11.

[0023] The communication I / F 14 transmits and receives various information to and from the server 20 via a communication line 80 .

[0024] The speaker 15 outputs to the outside a sound based on the sound data generated by the processor 11. The microphone 16 collects a sound generated from the outside.

[0025] [Server hardware configuration] 3 is a diagram showing an example of a hardware configuration of the server 20 according to the present embodiment. As shown in the figure, the server 20 includes a processor 21, a RAM 22, a hard disk drive (HDD) 23, a communication I / F 24, a display device 25, and an input device 26.

[0026] The processor 21 executes various software such as an OS (Operating System) and applications, and realizes various functions described below.

[0027] The RAM 22 is a memory used as a working memory for the processor 21. The HDD 23 is, for example, a magnetic disk device that stores input data for various software programs and output data from various software programs.

[0028] The communication I / F 24 transmits and receives various information to and from the smart speaker 10 or the printing device 40 via the communication line 80.

[0029] The display device 25 is, for example, a display that displays various information. The input device 26 is, for example, a keyboard or a mouse that the user uses to input information.

[0030] [Printing device hardware configuration] 4 is a diagram showing an example of the hardware configuration of a printing device 40 according to the present embodiment. As shown in the figure, the printing device 40 includes a processor 41, a RAM 42, a ROM 43, a HDD 44, an operation panel 45, a printing unit 46, and a communication I / F 47.

[0031] The processor 41 loads various programs stored in the ROM 43 or the like into the RAM 42 and executes them to realize processing for printing in the printing unit 46.

[0032] The RAM 42 is a memory used as a working memory for the processor 41. The ROM 43 is a memory that stores various programs executed by the processor 41. The HDD 44 is, for example, a magnetic disk device that stores print data used in printing by the printing unit 46.

[0033] The operation panel 45 is, for example, a touch panel that displays various information and accepts operation input from the user. Here, the operation panel 45 is composed of a display on which various information is displayed and a position detection sheet that detects a position indicated by an indication means such as a finger or a stylus pen. Alternatively, a display and a keyboard may be used instead of the touch panel.

[0034] The printing unit 46 prints an image on a recording medium such as paper. Here, the printing unit 46 is, for example, a printer, and it is preferable to use an electrophotographic system in which toner attached to a photoreceptor is transferred to a recording medium to form an image, or an inkjet system in which ink is ejected onto a recording medium to form an image.

[0035] The communication I / F 47 transmits and receives various information to and from the server 20 via a communication line 80 .

[0036] [Overview of operation of this embodiment] 5 to 7 are diagrams for explaining the general operation of this embodiment. However, these diagrams do not include the server 20, and show a print instruction being sent directly from the smart speaker 10 to the printing device 40. Furthermore, when a user asks the smart speaker 10 a question, the user generally issues a call to start using the voice assistant function of the smart speaker 10, but this call is omitted in the diagrams.

[0037] In this specification, the settings for final printing on the printing device 40 are referred to as print settings, and the print settings included in a print request when a user makes a print request are referred to as requested settings.

[0038] 5 shows a first schematic operation of the printing system 1. In this first schematic operation, when a user utters a print request and the print request contains two request settings that have a conflict, the conflict is resolved according to the order of utterance as a priority, that is, the request setting that was uttered first is determined as the print setting, and printing is performed.

[0039] In the figure, first, the user U requests the smart speaker 10 to print the document using the printing device 40 with stapling and folding in half (step 111). Here, it is assumed that stapling and folding in half are prohibited. In this case, stapling, which is spoken first, is selected as the print setting. Therefore, the smart speaker 10 informs the user U that stapling only will be printed since stapling and folding in half cannot be specified at the same time (step 112). Then, a print instruction is sent from the smart speaker 10 to the printing device 40 to instruct printing with stapling (step 113). As a result, the printing device 40 prints the stapled printed matter P (step 114).

[0040] In the above, after the smart speaker 10 informs the user U that printing will be performed with staples only in step 112, a print instruction is sent to the printing device 40 in step 113 without waiting for the user's response, but this is not limited to the above. The smart speaker 10 may inquire of the user U as to whether printing with staples only in step 112, and if the user U responds that printing with staples only is OK, a print instruction may be sent to the printing device 40 in step 113. However, the following will be described taking as an example a case where a print instruction is sent to the printing device 40 without waiting for the user's response.

[0041] In the above, when a user makes a print request by speech, the requested setting that is spoken first is determined as the print setting, but this is not limited to the above. Even when a user makes a print request by speech, if it is set in advance that the requested setting that is spoken later is given priority, the requested setting that is spoken later may be determined as the print setting. However, in the following, it is basically described that when a user makes a print request by speech, the requested setting that is spoken first is determined as the print setting.

[0042] FIG. 6 shows a second schematic operation of the printing system 1. This second schematic operation is obtained by adding the operation of a modified example to the first schematic operation. In this modified operation, when a user utters a print request in two speech units and two request settings that are in a prohibited relationship are included in different speech units, the request setting that is later in the speech order is determined as the print setting and printing is performed. In addition to the two request settings that are in a prohibited relationship being included in different speech units, the condition for determining the request setting that is later in the speech order as the print setting is that the smart speaker 10 has responded between the two speech units.

[0043] In the figure, first, the user U is requesting the smart speaker 10 to print the document by setting it to staple on the printing device 40 (step 121). In response to this, the smart speaker 10 responds briefly (step 122). After that, the user U requests to set it to fold in half and print (step 123). Here, it is assumed that stapling and folding in half are prohibited. In this case, folding in half, which is spoken later, is selected as the print setting. Therefore, the smart speaker 10 informs the user U that stapling and folding in half cannot be specified at the same time, so that only folding in half will be printed (step 124). Then, a print instruction is sent from the smart speaker 10 to the printing device 40 to instruct printing in half (step 125). As a result, the printing device 40 prints the printed matter P folded in half (step 126).

[0044] In the above, when two request settings in a forbidden relationship are included in different speech units and the smart speaker 10 responds between the speech units, the request setting that comes later in the speech order is determined to be the print setting, but this is not limited to the above. When two request settings in a forbidden relationship are included in different speech units, the request setting that comes later in the speech order may be determined to be the print setting even if the smart speaker 10 does not respond between the speech units. For example, when two request settings in a forbidden relationship are included in different speech units and the length of time between the speech units is equal to or longer than a reference, the request setting that comes later in the speech order may be determined to be the print setting. However, in the following, an example will be described in which when two request settings in a forbidden relationship are included in different speech units and the smart speaker 10 responds between the speech units, the request setting that comes later in the speech order is determined to be the print setting.

[0045] In the above, when two request settings that are in a forbidden relationship are included in different speech units, the request setting that is later in the speech order is determined as the print setting, but this is not limited to the above. Even when two request settings that are in a forbidden relationship are included in different speech units, if it is set in advance that the request setting that is earlier in the speech order is given priority, the request setting that is earlier in the speech order may be determined as the print setting. However, in the following, an example will be described in which when two request settings that are in a forbidden relationship are included in different speech units, the request setting that is later in the speech order is determined as the print setting.

[0046] Furthermore, in the above, the number of speech units uttered by the user is two, but this is not limited to this. The number of speech units uttered by the user may be three or more. However, the following description will be given taking as an example a case where the number of speech units uttered by the user is two.

[0047] 7 shows a third schematic operation of the printing system 1. This third schematic operation is also obtained by adding a modified operation to the first schematic operation. In this modified operation, when a user issues a print request and the print request contains multiple request settings that have a conflict relationship, a keyword is added to the request settings to change the priority order, and the conflict is resolved to perform printing.

[0048] In this case, the keyword may be added to the request setting that is spoken earlier or later, but the following will take the latter as an example. Also, the keyword may be added either before or after the request setting, but the following will take the case where it is added before the request setting as an example. Furthermore, adding a keyword may lower or raise the priority. For example, it is possible to raise the priority by adding "must" before a request setting that is spoken later. For example, it is possible to lower the priority by adding "later" before a request setting that is spoken later. Incidentally, such keywords may be determined and stored in advance.

[0049] In the figure, first, the user U requests the smart speaker 10 to print the document on the printing device 40 with stapling and folding in half as a must (step 131). Here, it is assumed that stapling and folding in half are prohibited. In this case, folding in half with the addition of "mandatory" is selected as the print setting. Therefore, the smart speaker 10 informs the user U that stapling and folding in half cannot be specified at the same time, so that only folding in half will be printed (step 132). Then, a print instruction is sent from the smart speaker 10 to the printing device 40 to instruct printing in half (step 133). As a result, the printing device 40 prints the printed matter P folded in half (step 134).

[0050] In the above, the priority order is changed by adding a keyword to the request setting, but this is not limited to the above. The priority order may be changed by speaking a request setting that is spoken earlier in the order of speech in a manner that allows distinction between the request setting that is spoken later and the request setting that is spoken later. For example, when a request setting that is spoken later is spoken with emphasis compared to the request setting that is spoken earlier, the request setting that is spoken later may be determined as the print setting. Here, an example of speaking a request setting with emphasis is speaking the request setting in a loud voice.

[0051] In addition, in the above, it was stated that it is possible to emphasize either the request setting that comes earlier in the speech order or the request setting that comes later in the speech order, but below, we will explain an example of a case where the request setting that comes later in the speech order is decided as the print setting by emphasizing the request setting that comes later in the speech order.

[0052] [Server Functionality Configuration] 8 is a block diagram showing an example of the functional configuration of the server 20 in this embodiment. As shown in the figure, the server 20 includes a receiving unit 31, a prohibition relationship storage unit 32, a request information analysis unit 33, a print setting determination unit 34, a document file acquisition unit 35, a print data generation unit 36, and a transmission unit 37.

[0053] The receiving unit 31 receives request information from the smart speaker 10. Here, when a user makes a print request by voice, the smart speaker 10 recognizes the print request by voice, generates and transmits information requesting printing based on the result of the voice recognition. In this embodiment, the request information is used as an example of a processing request based on the user's voice, and the processing of the receiving unit 31 is performed as an example of accepting this processing request.

[0054] The incompatibility storage unit 32 stores information about incompatibility between print settings. For example, the incompatibility storage unit 32 stores information that the stapling and folding in half shown in Figs. 5 to 7 are incompatibility with each other.

[0055] The request information analysis unit 33 receives the request information received by the receiving unit 31 and analyzes the request information.

[0056] Specifically, first, the request information analysis unit 33 judges whether the request information includes a plurality of request settings and whether the plurality of request settings includes two request settings that are in a forbidden relationship. In the present embodiment, this process is performed by the request information analysis unit 33 as an example of judging that the request includes a first setting and a second setting that are in a forbidden relationship.

[0057] Furthermore, when the request information analysis unit 33 determines that the request information includes a plurality of request settings and that the plurality of request settings include two request settings that are in a forbidden relationship, the request information analysis unit 33 determines whether the two request settings that are in a forbidden relationship are included in different speech units. Here, the speech unit refers to a group of speech uttered by the user. For example, the request information analysis unit 33 may treat an utterance including a voice indicating the content of the request setting and a voice indicating a request to perform the request setting as an utterance unit. In Figs. 5 to 7, the content of the request setting is, for example, "staple" and "fold in half," and the request to perform the request setting is, for example, "set." In this embodiment, the request information analysis unit 33 performs this process as an example of determining that the first speech unit including the first setting is different from the second speech unit including the second setting, and as an example of identifying the speech unit including the first setting and the request for the first setting as the first speech unit, and identifying the speech unit including the second setting and the request for the second setting as the second speech unit.

[0058] Furthermore, when the request information includes a plurality of request settings, the plurality of request settings include two request settings that are in a forbidden relationship, and the two request settings that are in a forbidden relationship are determined to be within one utterance unit, the request information analysis unit 33 determines whether the later uttered request setting is uttered with emphasis. In this embodiment, the request information analysis unit 33 performs this process as an example of determining that the first setting and the second setting are uttered within one utterance unit and that the second setting is uttered in a manner that can be distinguished from the first setting. Here, the later uttered request setting being uttered with emphasis includes, for example, the later uttered request setting being uttered with a keyword added thereto. In this case, the later uttered request setting being uttered with a keyword added thereto is an example of the second setting being uttered with a predetermined wording added thereto.

[0059] The print setting determination unit 34 determines one of the request settings as the print setting based on the analysis result from the request information analysis unit 33, the utterance order of the request settings in the request information, and information from the transmission unit 37.

[0060] Specifically, first consider a case where the analysis result from the request information analysis unit 33 indicates that the request information includes multiple request settings, and the multiple request settings include two request settings that are in a forbidden relationship. In this case, the print setting determination unit 34 determines the request setting that is uttered first of the two forbidden request settings as the print setting. In this embodiment, when a request includes a first setting and a second setting that are in a forbidden relationship, if the first setting is uttered in the uttered voice before the second setting, this process of the print setting determination unit 34 is performed as an example of control so that processing is performed with the first setting.

[0061] Also, consider a case where the analysis result from the request information analysis unit 33 indicates that the request information includes a plurality of request settings, the plurality of request settings include two request settings that are in a forbidden relationship, and the two request settings that are in a forbidden relationship are included in different speech units. In this case, the print setting determination unit 34 determines the request setting that is uttered later among the two request settings that are in a forbidden relationship as the print setting. In this embodiment, even if the first setting is uttered before the second setting in the speech voice, this process of the print setting determination unit 34 is performed as an example of control so that the process is performed with the second setting on the condition that the first speech unit including the first setting and the second speech unit including the second setting are different. Alternatively, in addition to the above, when the smart speaker 10 responds between the earlier speech unit and the later speech unit, the print setting determination unit 34 may determine the request setting that is uttered later among the two request settings that are in a forbidden relationship as the print setting. Here, it is preferable that the transmission unit 37 notifies the smart speaker 10 that it has responded between the previous utterance unit and the subsequent utterance unit. In this embodiment, this process by the print setting determination unit 34 is performed as an example of control to perform processing with the second setting under the additional condition that the second utterance unit is uttered after the response voice output in response to the first utterance unit. Note that, if the smart speaker 10 has not responded between the previous utterance unit and the subsequent utterance unit, the print setting determination unit 34 determines the requested setting that was uttered first as the print setting out of the two requested settings that are in a prohibited relationship.

[0062] Further, consider a case where the analysis result from the request information analysis unit 33 indicates that the request information includes a plurality of request settings, the plurality of request settings include two request settings that are in a forbidden relationship, the two request settings that are in a forbidden relationship are in one speech unit, and the request setting that was spoken later is emphasized. In this case, the print setting determination unit 34 determines the request setting that was spoken later as the print setting among the two request settings that are in a forbidden relationship. In this embodiment, even if the first setting is spoken before the second setting in the speech voice, and the first setting and the second setting are spoken in one speech unit, if the second setting is spoken in a manner that can be distinguished from the first setting, this process of the print setting determination unit 34 is performed as an example of control to perform processing with the second setting. Note that, if the request setting that was spoken later is not emphasized, the print setting determination unit 34 determines the request setting that was spoken earlier as the print setting among the two request settings that are in a forbidden relationship.

[0063] The document file acquisition unit 35 receives the request information received by the receiving unit 31, and acquires the document to be printed that is included in the request information.

[0064] When the print setting determination unit 34 determines the print settings and the document file acquisition unit 35 acquires the document file, the print data generation unit 36 ​​generates print data that instructs printing the document file with the print settings.

[0065] When the print data generating unit 36 ​​generates the print data, the transmitting unit 37 transmits, to the smart speaker 10, response information instructing a response to the effect that the document file acquired by the document file acquiring unit 35 is to be printed with the print settings determined by the print settings determining unit 34. In the present embodiment, the processing of the transmitting unit 37 is performed as an example of control to output a response voice indicating that processing is performed with the first settings.

[0066] Furthermore, when the print data generating unit 36 ​​generates the print data, the transmitting unit 37 transmits the print data to the printing device 40 .

[0067] Furthermore, when the receiving unit 31 receives request information, the transmitting unit 37 may transmit, to the smart speaker 10, response information instructing the smart speaker 10 to respond to the request information. In this case, the transmitting unit 37 notifies the print setting determination unit 34 that the response information has been transmitted to the smart speaker 10.

[0068] [Server 20 operation] FIG. 9 is a flowchart showing an example of the operation of the server 20 in this embodiment.

[0069] As shown in the figure, in the server 20, first, the receiving unit 31 receives request information from the smart speaker 10 (step 201).

[0070] Next, the request information analysis unit 33 determines whether the request information received in step 201 includes a plurality of request settings (step 202).

[0071] If it is determined in step 202 that the request information includes a plurality of request settings, the request information analysis unit 33 determines whether the plurality of request settings includes two request settings that are in a forbidden relationship (step 203).

[0072] If it is determined in step 203 that the multiple request settings include two request settings that are in a forbidden relationship, the request information analysis unit 33 determines whether the two request settings that are in a forbidden relationship are included in different speech units (step 204).

[0073] Assume that it is determined in step 204 that the two request settings in a forbidden relationship are not included in different speech units. In other words, it is determined that the two request settings in a forbidden relationship are included in one speech unit. Then, the request information analysis unit 33 determines whether the request setting uttered later was uttered with emphasis (step 205). For example, the request information analysis unit 33 determines whether the request information uttered later was uttered with a keyword added thereto.

[0074] If it is determined in step 205 that the later uttered requested setting is not emphasized, the print setting determination unit 34 determines print settings that include the earlier uttered requested setting (step 206). In other words, the print setting determination unit 34 determines print settings that include the earlier uttered requested setting and other requested settings that are not in a prohibited relationship, but do not include the later uttered requested setting.

[0075] If it is determined in step 205 that the later uttered requested setting was emphasized, the print setting determination unit 34 determines print settings that include the later uttered requested setting (step 208). That is, the print setting determination unit 34 determines print settings that include the later uttered requested setting and other requested settings that are not in a prohibited relationship, but do not include the earlier uttered requested setting.

[0076] If it is determined in step 204 that the two request settings in a forbidden relationship are included in different speech units, the print setting determination unit 34 determines whether the smart speaker 10 responded between the earlier speech unit and the later speech unit (step 207). If it is determined that the smart speaker 10 responded between the earlier speech unit and the later speech unit, the print setting determination unit 34 determines the print setting including the later uttered request setting (step 208). If it is determined that the smart speaker 10 did not respond between the earlier speech unit and the later speech unit, the print setting determination unit 34 determines the print setting including the earlier uttered request setting (step 206).

[0077] If it is determined in step 202 that the request information does not include multiple requested settings, the print setting determination unit 34 determines print settings that include all of the requested settings (step 209). In other words, if it is determined that the request information includes one requested setting, the print setting determination unit 34 determines print settings that include that requested setting, and even if it is determined in step 203 that the multiple requested settings do not include two requested settings that are in a prohibited relationship, the print setting determination unit 34 determines print settings that include all of the requested settings (step 209).

[0078] Next, the document file acquisition unit 35 acquires the document file specified by the request information received in step 201 (step 210).

[0079] As a result, the print data generating unit 36 ​​generates print data from the print settings determined in step 206, step 208, or step 209 and the document file acquired in step 210 (step 211).

[0080] Thereafter, the transmitting unit 37 transmits, to the smart speaker 10, response information instructing the smart speaker 10 to print the document file with the print settings (step 212). The transmitting unit 37 also transmits the print data generated in step 211 to the printing device 40 (step 213). As a result, the printing device 40 prints an image based on the print data on a recording medium.

[0081] [Processor] In this embodiment, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0082] In addition, the operations of the processor in this embodiment may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. The order of the operations of the processor is not limited to the order described in this embodiment, and may be changed.

[0083] [program] The processes performed by the server 20 in this embodiment are prepared as a program such as application software, for example.

[0084] In other words, the first program for realizing this embodiment can be understood as a program for causing a computer to realize the following functions: accepting a processing request based on a user's spoken voice; and, when the request includes a first setting and a second setting which are in a forbidden relationship, controlling the processing to be performed using the first setting if the first setting is spoken before the second setting in the spoken voice.

[0085] Furthermore, the second program for realizing this embodiment can be understood as a program for causing a computer to realize a function of accepting a processing request based on a user's speech and, when the request includes a first setting and a second setting that are in a forbidden relationship, a function of controlling the processing to be performed using one of the first setting and the second setting other than the one selected when the processing request based on the screen operation is accepted.

[0086] The program for realizing the present embodiment can be provided not only by communication means but also by being stored in a recording medium such as a CD-ROM. [Explanation of symbols]

[0087] 10: smart speaker; 20: server; 31: receiving unit; 32: prohibition relationship storage unit; 33: request information analysis unit; 34: print setting determination unit; 35: document file acquisition unit; 36: print data generation unit; 37: transmission unit

Claims

1. A processor is provided. The processor, Accepting a processing request based on a user's speech; When the request includes a first setting and a second setting which are in a forbidden relationship and the first setting is uttered prior to the second setting in the uttered voice, control is performed so that the processing is performed in the first setting on condition that the uttered voice includes the first setting, the second setting, and requests for the first setting and the second setting, and control is performed so that the processing is performed in the second setting on condition that the uttered voice includes a first utterance unit including the first setting and a request for the first setting, and a second utterance unit including the second setting and a request for the second setting in a distinguishable manner.

23. An information processing apparatus comprising:

2. The information processing device according to claim 1, characterized in that when the processor controls the processing to be performed in the first setting, it controls so that a response voice indicating that the processing will be performed in the first setting is output, and when the processor controls so that the processing will be performed in the second setting, it controls so that a response voice indicating that the processing will be performed in the second setting is output.

3. The information processing device according to claim 1, characterized in that the processor controls the processing to be performed with the second setting, with the further condition that the second utterance unit is spoken after the response voice output in response to the first utterance unit.

4. A processor, The processor, Accepting a processing request based on a user's speech; When the request includes a first setting and a second setting that are in a forbidden relationship with each other, if the first setting is uttered in the uttered voice prior to the second setting, control is performed so that the processing is performed with the first setting; the processor controls so that, even if the first setting is uttered before the second setting in the uttered voice and the first setting and the second setting are uttered within one utterance unit, if the second setting is uttered in a manner distinguishable from the first setting, the processing is performed with the second setting; An information processing device characterized in that the second setting being spoken in a manner distinguishable from the first setting includes the second setting being spoken with the addition of predetermined wording.

5. On the computer, A function of receiving a processing request based on a user's speech; a function of controlling, when the request includes a first setting and a second setting which are in a forbidden relationship with each other and the first setting is uttered prior to the second setting in the uttered voice, to perform the processing in the first setting on condition that the uttered voice includes the first setting, the second setting, and requests for the first setting and the second setting, and controlling, when the uttered voice includes a first utterance unit including the first setting and a request for the first setting, and a second utterance unit including the second setting and a request for the second setting, in a distinguishable manner, to perform the processing in the second setting; A program to achieve this.

Citation Information

Patent Citations

  • Control system and control method

    JP2003051887A

  • Server, system, method and program for extracting significant word

    JP2009238199A

  • Information processor, method for controlling information processor and computer program

    JP2014092897A

  • Speech production device, speech production control device, speech production control system, control method of speech production device, control method of speech production control device, and control program

    JP2015227951A

  • Instruction execution device, server, instruction executing system, instruction executing method, and instruction execution program

    JP2018151554A