Voice control method, apparatus and storage medium of an image forming device

Abstract

The application provides a voice control method and device of an image forming equipment and a storage medium. The voice control method comprises the following steps: determining a printing action currently performed by the image forming equipment; judging whether the printing action currently performed is a trigger prompt action; further judging whether a trigger condition is met if the printing action currently performed is the trigger prompt action; and outputting voice operation prompt information if the trigger condition is met, for guiding correct operation. Thus, when the printing action currently performed by the image forming equipment is the trigger prompt action and the trigger condition is met, the voice operation prompt information can be actively output to the user in an early prediction manner, so that the user's re-operation error can be effectively avoided, and the work efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of image forming technology, and in particular to a voice control method, apparatus and storage medium for an image forming device. Background Technology

[0002] Traditional printers typically have passive voice modules that require user activation. Once activated, the module parses the user's speech and performs corresponding actions. Most lack active voice output functionality, resulting in incomplete voice capabilities. Summary of the Invention

[0003] This application provides a voice control method, apparatus, and storage medium for an image forming device, which determines the currently executed printing action and thereby actively outputs prompt information based on the currently executed printing action and triggering conditions.

[0004] In one aspect, this embodiment provides a voice control method for an image forming apparatus, comprising: determining the currently executed printing action; when the printing action is a trigger prompt action and a trigger condition is met, outputting corresponding voice operation prompt information to play correct printing operation guidance; wherein the trigger condition is: the number of times an abnormal state of the image forming apparatus associated with the trigger prompt action occurs is greater than a first preset value.

[0005] In embodiments of this application, the method further includes: using a printing action that causes an abnormal state as a trigger prompt action; obtaining voice operation prompt information corresponding to the trigger prompt action; wherein the abnormal state, the trigger prompt action, and the voice operation prompt information are associated with each other.

[0006] In the embodiments of this application, the printing action that will cause an abnormal state is used as the trigger prompt action, which includes: obtaining the number of times the abnormal state of the image forming device occurs; when the number of occurrences is greater than or equal to a first preset value, determining the printing action that will cause an abnormal state as the trigger prompt action.

[0007] In the embodiments of this application, abnormal states include any one or a combination of the following: paper tray not installed properly, mismatched paper types placed in the same paper tray, light leakage when scanning images, front / side door not closed, abnormal paper feeding, abnormal installation of consumables, and no print jobs issued for a long time.

[0008] In the embodiments of this application, outputting corresponding voice operation prompts includes: determining the user's personalized information; the user's personalized information is obtained from historical voice interaction data; and outputting voice operation prompts with different playback styles based on the user's personalized information.

[0009] In embodiments of this application, the method further includes: obtaining the number of times an abnormal state of the image forming device occurs; when the number of times an abnormal state occurs is greater than a second preset value, sending the abnormal state as a high-frequency abnormal event and associating it with the device information of the image forming device to the cloud.

[0010] In embodiments of this application, the method further includes: obtaining high-frequency abnormal events through the cloud; determining the currently executed printing action; and then further includes: outputting corresponding voice operation prompt information when the printing action is associated with a high-frequency abnormal event.

[0011] In another aspect, this embodiment provides a voice control device for an image forming apparatus, including: an action determination module, which is used to determine the currently executed printing action; and an action recognition and voice output module, which is used to output corresponding voice operation prompt information when the printing action is a trigger prompt action and the trigger condition is met, for playing the correct printing operation guidance; wherein, the trigger condition is: the number of times the abnormal state of the image forming apparatus associated with the trigger prompt action occurs is greater than a first preset value.

[0012] In another aspect, this embodiment provides an image forming apparatus, including: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the machine-readable instructions being executed by the processor to perform the steps of the voice control method of the image forming apparatus as claimed.

[0013] In another aspect, this embodiment provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, which, when executed by a processor, performs the steps of the voice control method for the image forming apparatus described above.

[0014] According to an embodiment of this application, a voice control method, apparatus, and storage medium for an image forming apparatus are provided. When the number of times an abnormal state of the image forming apparatus occurs is greater than or equal to a first preset value, the printing action corresponding to the abnormal state of the image forming apparatus is used as a trigger prompt action. This allows user's habitual erroneous operations to be marked as trigger prompt actions, enabling timely and proactive prompts and preventing the user from performing the same erroneous operation again. Furthermore, by determining the currently executed printing action of the image forming apparatus, it is further determined whether the currently executed printing action is a trigger prompt action. If it is a trigger prompt action, it is further determined whether the triggering condition has been met, i.e., whether the number of occurrences of the trigger prompt action is greater than the first preset value. If the number of occurrences of the trigger prompt action is greater than the first preset value, a voice operation prompt message is output. Therefore, by proactively outputting a voice operation prompt message to the user when it is anticipated that the trigger prompt action may cause the image forming apparatus to re-enter the corresponding abnormal state, it is possible to effectively prevent the user from making further operational errors, thereby improving work efficiency. Attached Figure Description

[0015] The above and other objects, features, and advantages of this application will become more apparent from the more detailed description of the embodiments of this application in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of this application and form part of the specification. They are used together with the embodiments of this application to explain this application and do not constitute a limitation thereof. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0016] Figure 1 This is an application scenario diagram of an embodiment of this application.

[0017] Figure 2 This is a flowchart illustrating a voice control method for an image forming apparatus according to an embodiment of this application.

[0018] Figure 3 This is a flowchart illustrating another voice control method for an image forming apparatus according to an embodiment of this application.

[0019] Figure 4 This is a flowchart illustrating the voice operation prompts corresponding to the output of an embodiment of this application.

[0020] Figure 5 A flowchart of another voice control method for an image forming apparatus provided in an embodiment of this application.

[0021] Figure 6 This is a flowchart illustrating another voice control method for an image forming apparatus according to an embodiment of this application.

[0022] Figure 7 This is a schematic diagram of a cloud-based large model provided in an embodiment of this application.

[0023] Figure 8 A block diagram of a voice control device for an image forming apparatus provided in an embodiment of this application.

[0024] Figure 9 This is a block diagram of an image forming apparatus provided in an embodiment of this application.

[0025] Figure 10 A block diagram of another image forming apparatus provided in an embodiment of this application.

[0026] Figure 11 A block diagram of a computer-readable storage medium provided in an embodiment of this application. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of this application more apparent, exemplary embodiments according to this application will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this application, and not all embodiments of this application. It should be understood that this application is not limited to the exemplary embodiments described herein.

[0028] When using image forming equipment such as printers in daily life, manual operation often results in errors. These errors include forgetting to push the paper tray back into its original position after inserting the printing media, mismatch between the inserted printing media (such as paper) and the paper tray's limiters, and the scanner lid not being fully closed during flatbed scanning. These improper operations can lead to poor print quality, repeated operations, and other unpleasant experiences.

[0029] Traditional printers' smart voice modules are often passive, meaning the user needs to wake them up. Only when the smart voice module is woken up will it analyze the user's speech and then perform corresponding actions, such as printing or scanning documents.

[0030] Because the intelligent voice module of traditional printers is activated by passive response, when the image forming equipment encounters errors such as those described above, the intelligent voice module often fails to provide timely prompts, thus not significantly improving the user experience and failing to achieve its intelligent function.

[0031] Based on this, embodiments of this application provide a voice control method for an image forming apparatus. Figure 1 This is an application scenario diagram of an embodiment of this application.

[0032] like Figure 1 As shown, the image forming apparatus 101, such as a printer, can receive scanning and printing requests and begin performing scanning and printing jobs. Throughout the entire process of the job performed by the image forming apparatus 101, the image forming apparatus 101 can detect the currently performed printing action through its built-in sensors. For example, before, during, and after the printing job is performed, the built-in sensors of the image forming apparatus 101 can detect the currently performed printing action, such as the current paper tray being opened or closed.

[0033] Furthermore, the image forming apparatus 101 can determine whether the currently executed printing action is a trigger prompt action. When the currently executed printing action is a trigger prompt action and the trigger condition is met, the image forming apparatus 101 can provide corresponding prompts, such as outputting corresponding voice operation prompt information through the intelligent voice module, to further guide the user to perform corresponding operations based on the voice operation prompt information.

[0034] Next, this article will combine Figures 2-11 The voice control method of this application is described in detail.

[0035] Figure 2 This is a flowchart illustrating a voice control method for an image forming apparatus according to an embodiment of this application.

[0036] like Figure 2 As shown in the embodiment of this application, the voice control method for an image forming apparatus is applied to an image forming apparatus, and the method includes: S201. Determine the currently executing printing action.

[0037] In some embodiments, the currently performed printing action refers to the action taken by the user while operating the image forming device, or the action performed by the image forming device during the printing process. This includes, but is not limited to, actions such as opening and closing the front / side door of the image forming device, opening and closing the paper tray of the image forming device, opening and closing the scanner cover, paper jam, fixing, and scanning head movement.

[0038] In the embodiments of this application, the image forming apparatus can monitor the position, opening / closing, and movement states of various components of the image forming apparatus using internally installed state detection devices such as phototubes and Hall elements. This allows the main control chip to determine the current printing action being performed by the image forming apparatus based on the position, opening / closing, and movement states of each component. The state detection device can collect two types of state information from the image forming apparatus: the first type is external physical state information generated through interaction with the image forming apparatus, and the second type is the operational state information of the internal components of the image forming apparatus during operation. The state detection device can transmit the collected state information to the main control chip through a detection circuit, such as a comparison circuit or an amplification circuit. The main control chip can then judge the signal output by the detection circuit and determine the currently performed printing action.

[0039] S202. When the printing action is a trigger prompt action and the trigger condition is met, output the corresponding voice operation prompt information to play the correct printing operation guidance; wherein, the trigger condition is: the number of times the abnormal state of the image forming device associated with the trigger prompt action occurs is greater than a first preset value.

[0040] In the embodiments of this application, an abnormal state of the image forming apparatus can refer to the image forming apparatus's inability to perform the current job normally, such as the inability to perform the current printing or scanning job normally. An abnormal state of the image forming apparatus can be divided into two categories: the first category is caused by the interaction with the image forming apparatus, resulting in an abnormal state of external physical components of the image forming apparatus; the second category is caused by the abnormal state of internal components of the image forming apparatus. An abnormal state of external physical components of the image forming apparatus includes, for example, the scanner cover not being in the closed position, or the paper tray not being in the closed position. That is, the external physical components of the image forming apparatus that can be operated by the user (such as the paper tray being opened or the scanner cover being opened by the user) are in an abnormal state, thus causing the image forming apparatus to be unable to perform the current job normally. An abnormal state of internal components of the image forming apparatus includes, for example, abnormal paper feeding timing, abnormal printhead movement speed, or abnormal internal temperature and humidity. That is, the internal components of the image forming apparatus used to perform the printing job are in an abnormal state, thus causing the image forming apparatus to be unable to perform the current job normally.

[0041] The main control chip can analyze the status information collected by multiple status detection devices to determine whether the image forming equipment is in an abnormal state. For example, when the user pushes the paper tray in, the paper tray positioning sensor can monitor in real time whether the paper tray is fully inserted. For instance, when the paper tray is fully inserted, the front end of the paper tray will precisely press down on the metal spring of the paper tray positioning sensor. If the paper tray positioning sensor detects that the metal spring has been pressed down, it can send an analog signal to the main control chip. The main control chip can then determine that the paper tray is fully inserted based on this analog signal. Based on this principle, the image forming equipment may experience the following situation: if the paper tray positioning sensor detects that the metal spring has been released at the first moment, it can send an analog signal to the main control chip. The main control chip can then determine that the printing action currently being performed by the image forming equipment at the first moment, i.e., "the paper tray is open," based on this analog signal. Furthermore, if the paper tray positioning sensor continues to monitor and fails to detect that the metal spring has been pressed down within a predetermined time period, i.e., the paper tray remains in an open state, the main control chip can determine that the image forming equipment is in an abnormal state based on the continuously transmitted analog signal from the paper tray positioning sensor.

[0042] In the embodiments of this application, the trigger prompt action can refer to an action that causes the image forming device to enter an abnormal state. For example, during the process of a user opening and closing the paper tray, the image forming device can determine the currently executed printing action, such as "paper tray is opened" or "paper tray is closed," through multiple state detection devices. If, during this process, the user fails to close the paper tray properly, the image forming device will be in an abnormal state of "paper tray not closed properly." In this case, "paper tray is opened" can be the trigger prompt action corresponding to the "paper tray not closed properly" abnormal state.

[0043] In some embodiments, the identifier information for triggering a prompt action can be pre-set in the main control chip of the image forming apparatus to indicate that the corresponding printing action is a trigger prompt action. For example, the identifier information for trigger prompt actions can be pre-set based on user operating habits. The identifier information for trigger prompt actions can also be added or deleted in real time during the operation of the image forming apparatus. For example, if the image forming apparatus performs a printing action that would cause the image forming apparatus to be in an abnormal state more than three times, the main control chip can determine that the printing action is a trigger prompt action. If a printing action determined to be a trigger prompt action is not triggered within a preset time, the trigger prompt action can be deleted.

[0044] In the embodiments of this application, the triggering condition may refer to the number of times the abnormal state of the image forming device corresponding to the trigger prompt action occurs being greater than a first preset value. For example, if the main control chip determines that the currently executed printing action is "paper tray is opened", it can further match whether the currently executed printing action is a trigger prompt action. If it is found that the currently executed printing action is not a trigger prompt action, the corresponding voice operation prompt information will not be output. If it is found that "paper tray is opened" is a trigger prompt action, the relationship between the number of times the abnormal state of "paper tray not closed in place" corresponding to the trigger prompt action occurs and the first preset value can be obtained. For example, if the first preset value is three, if the number of times "paper tray is opened" causes the image forming device to be in the abnormal state of "paper tray not closed in place" is the fourth time, the corresponding voice operation prompt information can be output. That is, since the first three executions of "paper tray is opened" caused the image forming device to be in the abnormal state of "paper tray not closed in place", the printing action "paper tray is opened" is determined to be a trigger prompt action. When the current printing action is determined to be "paper tray is opened" for the fourth time, the triggering condition is met, and the corresponding voice operation prompt information is output.

[0045] In some embodiments, the triggering condition may also refer to the number of times the trigger prompt action corresponding to the abnormal state of the image forming device occurs within a preset time period being greater than a first preset value. For example, if the first preset value is three times, within a one-month time period, if the image forming device performs the "paper tray is opened" trigger prompt action for the fourth time (i.e., the image forming device is in the abnormal state of "paper tray not closed properly" for the fourth time), the corresponding voice operation prompt information will be output.

[0046] In the embodiments of this application, voice operation prompts can be used to play correct printing operation instructions, such as correct operating steps and the reasons why the image forming equipment is in an abnormal state. The voice operation prompts can be played through the language playback module of the image forming equipment, displayed through the display panel of the image forming equipment, or sent to the user's terminal device.

[0047] According to an embodiment of this application, by determining the printing action currently being performed by the image forming device, it is further determined whether the currently performed printing action is a trigger prompt action. If it is a trigger prompt action, it is further determined whether the triggering condition has been met, that is, whether the number of times the image forming device is in an abnormal state due to the trigger prompt action is greater than a first preset value. If the number of occurrences is greater than the first preset value, a voice operation prompt message is output to guide the correct operation. Therefore, by predicting in advance when the printing action currently being performed by the image forming device is a trigger prompt action and the triggering condition has been met, a voice operation prompt message is proactively output to the user, thereby effectively avoiding further user errors and improving work efficiency.

[0048] Figure 3 This is a flowchart illustrating another voice control method for an image forming apparatus according to an embodiment of this application.

[0049] like Figure 3 As shown, another voice control method for an image forming apparatus provided in this application embodiment, in addition to including the above-described S201 and S202, also includes: S301, The printing action that causes an abnormal state to occur will be used as the trigger prompt action.

[0050] In embodiments of this application, the main control chip can judge the signal output by the detection circuit to match the corresponding state of the image forming device. For example, the main control chip can receive the electrical signal transmitted by the state detection device through the detection circuit and compare the electrical signal with a preset normal electrical signal to determine whether the image forming device is currently in a normal or abnormal state. Further, if it is determined that the image forming device is currently in an abnormal state, the printing action that causes the abnormal state can be used as a trigger prompt action. In some embodiments, since the printing action that causes the abnormal state is a combination of multiple series of printing actions, the starting printing action of the multiple series of printing actions can be used as the trigger prompt action.

[0051] For example, if a user opens the scanner lid to place the original document, but presses the scan button before closing the lid completely or after a preset time, the image forming device will perform a series of printing actions during this process: The sensor (status detection device) installed on the scanner lid detects that the lid is open, and the main control chip determines the current printing action performed by the image forming device as "opening the scanner lid" via an electrical signal. If, for a subsequent period, the sensor continuously monitors the scanner lid as remaining open, the current printing action performed by the image forming device will still be "opening the scanner lid." When the image forming device receives a scan command, the main control chip can determine that the current printing action performed by the image forming device is "starting scan." Therefore, during the user's scanning operation, "opening the scanner lid" and "starting scan" together constitute the printing action performed by the image forming device.

[0052] Furthermore, the main control chip can determine whether the image forming device is in an abnormal state based on multiple printing actions. In the example above, since the sensor installed on the scanning cover did not detect that the scanning cover was closed, the main control chip can determine that the image forming device is in an abnormal state, and can also use "opening the scanning cover" as a trigger prompt action, corresponding to the abnormal state of "the scanning cover is not closed properly".

[0053] It should be noted that the image forming apparatus can determine the current printing action being performed by the image forming apparatus through signals transmitted by multiple state detection devices, and determine whether the current printing action being performed by the image forming apparatus will cause the image forming apparatus to be in an abnormal state.

[0054] S302. Obtain the voice operation prompt information corresponding to the triggered prompt action; wherein, the abnormal state, the triggered prompt action, and the voice operation prompt information are associated accordingly.

[0055] In embodiments of this application, the image forming apparatus may pre-store multiple printing actions, the corresponding abnormal state of the image forming apparatus when each printing action is determined to be a trigger prompt action, and the corresponding voice operation prompt information for each trigger prompt action. For example, the image forming apparatus may pre-store the printing action "scanning cover is open," the corresponding abnormal state of the image forming apparatus for this printing action as "scanning cover abnormal," and the corresponding voice operation prompt information as "after placing the paper to be scanned, please close the scanning cover." Then, when the printing action "scanning cover is open" is used as a trigger prompt action, the corresponding voice operation prompt information for this trigger prompt action can be obtained as "after placing the paper to be scanned, please close the scanning cover."

[0056] According to an embodiment of this application, by using a printing action that would cause an abnormal state as a trigger prompt action, a voice operation prompt message can be output to the user in advance when the printing action is performed on the image forming device. This avoids the situation where the user has already performed an incorrect operation and caused the image forming device to be in an abnormal state again before the voice operation prompt message is output.

[0057] In the embodiments of this application, before the above-described S301, the method includes: acquiring the number of times an abnormal state of the image forming device occurs; and, when the number of occurrences is greater than or equal to a first preset value, determining a printing action that will cause an abnormal state as a trigger prompt action.

[0058] In some embodiments, when the image forming device is in an abnormal state, the main control chip can generate a corresponding abnormal state record, including the time when the abnormal state occurred, the corresponding printing action performed by the image forming device, the number of times it occurred, and the abnormal state of the image forming device. For example, the abnormal state record generated by the main control chip may include the time when the abnormal state occurred ("Date XX Time"), the printing action that caused the abnormal state as "scanning cover opened", the number of times the abnormal state of the image forming device occurred as "three times", and the abnormal state of the image forming device as "scanning cover abnormal".

[0059] In some embodiments, the main control chip can record the aforementioned abnormal state into the storage unit of the image forming device. The storage unit can be an internal storage block of the main control chip, an external storage chip, or a storage unit within the intelligent voice module. Correspondingly, the abnormal state record can be directly written to the internal storage block of the main control chip by the main control chip, or the main control chip can instruct the intelligent voice module to write the abnormal state record into the storage unit within the intelligent voice module.

[0060] In some embodiments, the main control chip can determine the printing action corresponding to an occurrence number greater than or equal to a first preset value as a trigger prompt action based on the abnormal state record. For example, in the above example, if the first preset value is "twice", then when the image forming device performs the printing action "scanning the top cover is open" for the second time, the printing action "scanning the top cover is open" can be determined as a trigger prompt action.

[0061] According to the embodiments of this application, printing actions that occur more than or equal to a first preset value are used as trigger prompt actions. This allows for the targeted setting of trigger prompt actions based on the user's operating habits, thereby meeting the user's personalized needs.

[0062] In the embodiments of this application, abnormal states of the image forming device include, but are not limited to, any one or a combination of the following: paper tray not installed properly, mismatched paper types placed in the same paper tray, light leakage when scanning images, front / side door not closed, abnormal paper feeding, abnormal installation of consumables, and no print jobs issued for a long time.

[0063] An abnormal state of an image forming apparatus can refer to the inability of the image forming apparatus to perform the current job normally. This inability can include a variety of abnormal states. When the image forming apparatus is in any one or more abnormal states, it can cause the image forming apparatus to be unable to perform the current job normally.

[0064] In some embodiments, "paper tray not installed correctly" can mean that the paper tray is not in a properly closed state. For example, the paper tray may not be fully pushed into the printer body, the paper tray may be tilted, or the paper tray may be opened and not pushed back in, all of which can cause the image forming device to be in an abnormal state where the paper tray is not installed correctly. "Mismatched paper types placed in the same paper tray" can mean that different types of paper are placed in the paper tray when performing the same incomplete print job. "Light leakage during image scanning" can mean that light leakage occurs during flatbed scanning, such as the scanner cover not being fully closed or improper placement of the scanned document causing light leakage at the edges. "Front / side door not closed" can refer to the printer's user-interactive doors. If not closed properly, the printer will not function properly. For example, the front door (consumables side door) can be located on the front of the printer body, allowing the user to replace printing consumables such as toner cartridges, ink cartridges, etc.; the side door (paper feed side door) can be located on the side of the printer, allowing the user to handle paper jams in the paper feed path and clean foreign objects from the paper feed rollers, fuser rollers, and other paper feed components. Paper feed abnormalities (such as paper jams) can refer to abnormal paper feed timing or position, such as too much paper in the paper tray, excessive paper accumulation at the output, curled paper, or excessively wet paper. Consumable installation abnormalities can refer to consumable components not being properly installed or consumables having abnormal identities, such as consumables not being fully pushed in, incorrect installation orientation, or the current consumable being a non-original / illegal consumable. Prolonged periods without print jobs can mean that the image forming device has not received new job instructions within a preset time after completing the previous job.

[0065] Table 1 illustrates the correspondence between some trigger prompt actions, abnormal states, trigger conditions, and voice operation prompts.

[0066] Table 1. Correspondence between Trigger Prompt Actions

[0067] It should be noted that n in Table 1 is the first preset value. The same trigger prompt action can correspond to different abnormal states, and different abnormal states correspond to different trigger conditions and voice operation prompt information. For example, the trigger prompt action "paper tray is opened" can correspond to the abnormal state "paper tray not installed in place" or the abnormal state "the types of paper placed in the same paper tray do not match". Therefore, for more detailed differentiation, the trigger prompt action can be a combination of multiple printing actions. This can determine whether the trigger prompt action "paper tray is opened" corresponds to the abnormal state "paper tray not installed in place", or whether the trigger prompt action "paper tray is opened, and the first paper type A is placed, and the second paper type B is placed" corresponds to the abnormal state "the types of paper placed in the same paper tray do not match".

[0068] Figure 4 This is a flowchart illustrating the voice operation prompts corresponding to the output of an embodiment of this application.

[0069] like Figure 4 As shown, the voice operation prompts output in S202 above include: S401. Determine the user's personalized information; the user's personalized information is obtained from historical voice interaction data.

[0070] In the embodiments of this application, personalized information about a user can be obtained through historical voice interaction data. This personalized information can be used to describe the user's interests, preferences, tone of voice, and personality. Personalized information can be constructed from aspects such as speech rate, intonation, and frequently used words in historical voice interaction data. For example, by analyzing the number of words spoken, pause intervals, pitch, volume, and tone of a user's voice commands, personalized information can be obtained, including but not limited to speech rate, volume, and intonation.

[0071] S402. Based on the user's personalized information, output voice operation prompts with different playback styles.

[0072] In the embodiments of this application, based on the determined personalized information of the user, the intelligent voice module of the image forming device can adjust the speech rate, tone, and volume of the voice operation prompts. For example, for users who speak quickly and loudly, a simple, direct, and loud playback style can be used to output the voice operation prompts. For users who speak slowly and loudly, a detailed and gentle playback style can be used to output the voice operation prompts.

[0073] According to embodiments of this application, by analyzing a user's historical voice interaction data, the user's personalized information can be determined, thereby dynamically adjusting different playback styles to meet the usage needs of users with different personalities and improve user experience and satisfaction.

[0074] Figure 5 This is a flowchart illustrating another voice control method for an image forming apparatus according to an embodiment of this application.

[0075] S501, Obtain the number of times the abnormal state of the image forming device occurs.

[0076] In the embodiments of this application, the number of times the image forming device occurs can be obtained through the abnormal state record generated by the main control chip.

[0077] S502. When the number of occurrences of abnormal states exceeds the second preset value, the abnormal state is treated as a high-frequency abnormal event and sent to the cloud in association with the device information of the image forming device.

[0078] In embodiments of this application, when the number of times the printing action causes the image forming device to be in an abnormal state exceeds a second preset value, the corresponding abnormal state can be regarded as a high-frequency abnormal event, and the trigger prompt action associated with the abnormal state can be regarded as a high-frequency abnormal printing action. The second preset value can be set in advance, and the second preset value is greater than the first preset value.

[0079] In some embodiments, the image forming apparatus can associate high-frequency abnormal printing actions, high-frequency abnormal events, and apparatus information, and send them to the cloud. The cloud can receive the aforementioned association information sent by multiple image forming apparatuses and generate a corresponding cloud-based large model based on the association information. The cloud can also, based on the cloud-based large model, distribute high-frequency abnormal events from multiple image forming apparatuses to each image forming apparatus via the network, thereby providing alerts to multiple image forming apparatuses. For example, if the cloud-based large model discovers that multiple image forming apparatuses belonging to a certain series all exhibit the same high-frequency abnormal printing action and high-frequency abnormal event, it can be determined that alert information needs to be sent to other users to facilitate their use and advance awareness. The cloud-based large model can then promptly remind users to pay attention to relevant operations by updating voice operation prompts in real time and distributing updated voice operation prompts to the image forming apparatuses.

[0080] According to embodiments of this application, by sending high-frequency abnormal events and their association with the device information of the image forming equipment to the cloud, the abnormal states of multiple image forming devices can be integrated, thereby facilitating unified maintenance of multiple image forming devices by the manufacturer.

[0081] Figure 6 This is a flowchart illustrating another voice control method for an image forming apparatus according to an embodiment of this application.

[0082] S601. Detect the current state of the image forming apparatus. Multiple state detection devices can work together to detect the current state of the image forming apparatus.

[0083] S602. Determine whether the current state of the image forming equipment is abnormal. The main control chip can determine whether the image forming equipment is currently in an abnormal state based on the detection results of multiple state detection devices. For example, the main control chip detects whether the paper tray closes in place within a predetermined time based on the paper tray position sensor and the time sensor. If the paper tray does not close in place within the predetermined time, it determines that the image forming equipment is in an abnormal state and executes S603. If it determines that the image forming equipment is in a normal state, it executes S601.

[0084] S603. Write to the storage unit. When the image forming device is in an abnormal state, an abnormal state record can be generated and written to the storage unit of the image forming device. The abnormal state record records the number of times the abnormal state has occurred.

[0085] S604. Determine whether the number of times an abnormal state occurs is greater than a first preset value. If the number of times an abnormal state occurs is greater than the first preset value, execute S605; if the number of times an abnormal state occurs is less than the first preset value, execute S601.

[0086] S605. Determine the trigger prompt action. The printing action that causes the image forming device to enter the abnormal state in S604 is used as the trigger prompt action. Preferably, the starting printing action in a series of printing actions that cause the image forming device to enter the abnormal state in S604 is used as the trigger prompt action. Further, the image forming device can also form a user prompt model based on multiple trigger prompt actions, the abnormal states corresponding to the multiple trigger prompt actions, and the corresponding voice operation prompt information.

[0087] S606. Has the trigger condition been met? When the image forming device is performing a job, determine the printing action currently being performed by the image forming device, and then determine whether the currently performed printing action is a trigger prompt action, and at the same time determine whether the trigger condition has been met. If the trigger condition has been met, proceed to S607; otherwise, proceed to S601.

[0088] S607. Output voice operation prompts. When the printing action currently being performed by the image forming device is a trigger prompt action and the triggering condition is met, a voice operation prompt is output. For example, if the abnormal state of the image forming device is "paper tray not closed properly" twice within a month, and the initial printing action in the series of printing actions leading to the "paper tray not closed properly" abnormal state is "paper tray opened," if the first preset value is twice, then when the abnormal state occurs for the second time, "paper tray opened" is determined as the trigger prompt action. When the image forming device's third currently performed printing action is "paper tray opened," that is, when the user opens the paper tray for the third time, the triggering condition is met: the number of trigger prompt actions exceeds the first preset value, and a voice operation prompt is output.

[0089] In some embodiments, after outputting voice operation prompts, the main control chip continuously detects whether the image forming device is in a normal state and intermittently prompts the user.

[0090] In the embodiments of this application, such as Figure 5 The voice control method shown also includes: obtaining high-frequency abnormal events through the cloud; determining the currently executed printing action; and then further includes: outputting corresponding voice operation prompts when the printing action is associated with a high-frequency abnormal event.

[0091] The image forming device can acquire high-frequency abnormal events, corresponding high-frequency abnormal printing actions, and corresponding voice operation prompts from the cloud. The high-frequency abnormal events acquired from the cloud can include those uploaded by other image forming devices. Then, after the current image forming device determines the currently executed printing action, it can determine, based on the high-frequency abnormal printing actions and high-frequency abnormal events, whether the currently executed printing action triggers a prompt. If it does, it outputs the corresponding voice operation prompt.

[0092] In some embodiments, the cloud can transmit high-frequency abnormal events, corresponding high-frequency abnormal printing actions, and corresponding voice operation prompts to the newly connected image forming device via a network. When a user performs related operations on the newly connected image forming device, the device can determine whether the currently executed printing action is a prompt-triggered action based on the acquired high-frequency abnormal events and corresponding high-frequency abnormal printing actions. If it is determined to be a prompt-triggered action, the image forming device can output corresponding voice operation prompts, thereby anticipating potential user errors and providing timely guidance to the user to avoid a negative user experience.

[0093] For example, some image forming equipment users might experience instances where the paper tray isn't properly closed dozens of times a month. By analyzing the correlation information uploaded from multiple image forming equipment, a cloud-based big data model can identify "paper tray not closed properly" as a high-frequency anomaly event, and the corresponding printing actions that might lead to this abnormal state as high-frequency abnormal printing actions. If a new image forming equipment in this series is connected to the cloud, it can obtain this high-frequency anomaly event and the corresponding high-frequency abnormal printing actions. Therefore, when a new user opens the paper tray for the first time, the image forming equipment can output a voice prompt message, "Please place the paper and close the paper tray properly," eliminating the need to wait until the new user makes several mistakes before providing a prompt.

[0094] According to embodiments of this application, by acquiring high-frequency abnormal events from the cloud, the abnormal states of multiple image forming devices and their corresponding trigger prompts can be integrated. This prevents abnormal states that occur on other image forming devices but not on this one from occurring on the current image forming device. By proactively notifying the user in advance, when the current image forming device executes a trigger prompt action but is not yet in an abnormal state, voice operation prompts are output, thereby preventing abnormal states from occurring on the image forming device and improving user accuracy.

[0095] Figure 7 This is a schematic diagram of a cloud-based large model provided in an embodiment of this application.

[0096] like Figure 7 As shown, image forming apparatus A 701 can store user prompt models for multiple users, such as user prompt model a, user prompt model b, etc. Each user prompt model can be tailored to a specific user and can include multiple trigger prompt actions, corresponding abnormal states for the trigger prompt actions, and corresponding voice operation prompt information. The user prompt model can be used to reflect the operating habits of a specific user. Multiple image forming apparatuses can send their stored user prompt models for multiple users to the cloud via a network, such as image forming apparatus B 702 and image forming apparatus C 703. The cloud can generate and update a large cloud model based on the user prompt models for multiple users sent by the multiple image forming apparatuses, and then send the updated data back to the multiple image forming apparatuses via the network.

[0097] Figure 8 A block diagram of a voice control device for an image forming apparatus provided in an embodiment of this application.

[0098] Figure 8 As shown, the voice control device 800 of the image forming apparatus includes a motion determination module 801 and a motion recognition and voice output module 802.

[0099] The action determination module 801 is used to determine the currently executed printing action; the action recognition and voice output module 802 is used to output the corresponding voice operation prompt information when the printing action is a trigger prompt action and the trigger condition is met, so as to play the correct printing operation guidance; wherein, the trigger condition is: the number of abnormal states of the image forming device associated with the trigger prompt action is greater than a first preset value.

[0100] Figure 9 This is a block diagram of an image forming apparatus provided in an embodiment of this application.

[0101] like Figure 9As shown, the image forming apparatus 900 includes a processor 901 and a memory 902. The memory 902 stores machine-readable instructions that can be executed by the processor 901. When the machine-readable instructions are executed by the processor 901, the steps of the voice control method of the image forming apparatus described above are performed.

[0102] Figure 10 A block diagram of another image forming apparatus provided in an embodiment of this application.

[0103] like Figure 10 As shown, the image forming apparatus 1000 includes a state detection device 1001, a detection circuit 1002, a main control chip 1003, an intelligent voice module 1004, a storage unit 1005, and a speaker 1006.

[0104] The status detection device 1001 may include photoelectric sensors, temperature sensors, humidity sensors, pressure sensors, limit switches, trigger switches, etc., and can collect sensor data in real time. The status detection device 1001 is connected to the main control chip 1003 through a detection circuit 1002, thereby converting the sensor data collected by the status detection device 1001 into signals that the main control chip 1003 can recognize. The main control chip 1003 can determine whether the image forming device 1000 is in an abnormal state and determine the current printing action being performed by the image forming device 1000 based on the signals transmitted by the status detection device 1001. When the main control chip 1003 determines that the image forming device 1000 is in an abnormal state, it can generate an abnormal state record and write it to the storage unit 1005. The storage unit 1005 can also store voice operation prompts corresponding to the triggered prompt actions.

[0105] The intelligent voice module 1004 can retrieve voice operation prompts from the storage unit 1005 and play them through the speaker 1006. The intelligent voice module 1004 can receive the currently executing printing action determined by the main control chip 1003, and retrieve the trigger prompt action and corresponding trigger conditions from the storage unit 1005. When it determines that voice operation prompts need to be output, it plays them through the speaker 1006. The intelligent voice module 1004 can also receive instructions from the main control chip 1003 regarding whether to output voice operation prompts. Specifically, the main control chip 1003 determines the currently executing printing action, retrieves the trigger prompt action and corresponding trigger conditions from the storage unit 1005, and when it determines that voice operation prompts need to be output, it sends an instruction to the intelligent voice module 1004 to output voice operation prompts, so that the intelligent voice module 1004 retrieves the voice operation prompts from the storage unit 1005 and plays them through the speaker 1006.

[0106] In some embodiments, the intelligent voice module 1004 may be composed of an AI processing chip and a voice driver chip, or it may be composed of an AI chip that combines both, or the intelligent voice module 1004 may also be the AI ​​processing module of the main control chip 1003.

[0107] In some embodiments, the main control chip 1003 can also determine the abnormal state of the image forming device based on the received printing parameters. For example, when a user issues a print job through a mobile terminal 1007, the main control chip 1003 can receive the printing parameters set by the user and record the document identifier, printing parameters (color / black and white printing, paper size, single / double-sided printing, number of copies, scaling ratio, etc.) and execution result (printing success / failure) for each print job. If the main control chip 1003 detects that the same document is issued two or more print jobs in a short period of time (e.g., within 5 minutes) and the printing parameters are different, it can determine that the image forming device is in an abnormal state, that is, multiple print jobs are issued for the same document, but the printing parameters are inconsistent, which can be determined as the first print parameter setting being incorrect, resulting in invalid reprint.

[0108] Therefore, the main control chip 1003 can generate corresponding abnormal status records, such as the abnormal status "printing parameter error", the trigger prompt "this document is being prepared for printing for the first time", and the number of times it occurred. Furthermore, if the image forming device experiences the above-mentioned abnormal status three times within a month, that is, if the user has made three errors in setting the printing parameters, then when the user opens the document for the fourth time to prepare for printing, the trigger condition will be met. At this time, the intelligent voice module 1004 will broadcast a message such as "You modified the paper size when you last printed this document. Please confirm whether the current paper size is correct", thereby preventing the user from printing incorrectly again.

[0109] It should be noted that the above is only an example. The main control chip 1003 can also determine whether the image forming device is in an abnormal state by receiving other printing parameters sent by the user, and then determine the corresponding trigger prompt action and trigger conditions.

[0110] Figure 11 A block diagram of a computer-readable storage medium provided in an embodiment of this application.

[0111] like Figure 11 As shown, a computer program 1101 is stored on a computer-readable storage medium 1100. When the computer program 1101 is run by a processor, it performs the steps of the voice control method for the image forming apparatus described above.

[0112] The basic principles of this application have been described above with reference to specific embodiments. It should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details of the above application are for illustrative and facilitative purposes only, and are not limitations. The above details do not limit the application to the necessity of adopting the above specific details for implementation.

[0113] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0114] Additionally, as used herein, the "or" used in a list of items beginning with "at least one" indicates a separate list, such that a list of, for example, "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word "exemplary" does not imply that the described example is preferred or better than other examples. Various changes, substitutions, and modifications to the techniques described herein may be made without departing from the techniques taught by the appended claims as defined herein.

[0115] Furthermore, the scope of the claims of this application is not limited to the specific aspects of the processes, machines, manufacturing, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufacturing, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described above can be utilized. Therefore, the appended claims include such processes, machines, manufacturing, events, means, methods, or actions within their scope.

[0116] The above description of the claimed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, this application is not intended to be limited to the aspects shown herein, but rather to be applied within the widest scope consistent with the principles and novel features of this application.

[0117] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this application to the forms described herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A voice control method for an image forming apparatus, characterized in that, include: Determine the currently executing printing action; When the printing action is a trigger prompt action and the triggering conditions are met, the corresponding voice operation prompt information is output to play the correct printing operation guidance; The triggering condition is that the number of times the abnormal state of the image forming device associated with the triggering prompt action occurs is greater than a first preset value.

2. The voice control method for the image forming apparatus according to claim 1, characterized in that, Also includes: The printing action that causes the abnormal state will be used as the triggering prompt action; Obtain the voice operation prompt information corresponding to the triggered prompt action; The abnormal state, the trigger prompt action, and the voice operation prompt information are associated with each other.

3. The voice control method for the image forming apparatus according to claim 2, characterized in that, The printing action that causes the abnormal state to occur will be used as the triggering prompt action, preceded by: The number of times the abnormal state of the image forming device occurs is obtained; When the number of occurrences is greater than or equal to the first preset value, a printing action that will lead to the abnormal state is determined as a trigger prompt action.

4. The voice control method for the image forming apparatus according to claim 1, characterized in that, The abnormal conditions include any one or a combination of the following: paper tray not installed properly, mismatched paper types placed in the same paper tray, light leakage when scanning images, front / side door not closed, abnormal paper feeding, abnormal installation of consumables, and no print jobs issued for a long period of time.

5. The voice control method for the image forming apparatus according to claim 1, characterized in that, Output the corresponding voice operation prompts, including: Determine the user's personalized information; the user's personalized information is obtained from historical voice interaction data; Based on the user's personalized information, voice operation prompts with different playback styles are output.

6. The voice control method for the image forming apparatus according to any one of claims 1 to 5, characterized in that, Also includes: The number of times the abnormal state of the image forming device occurs is obtained; When the number of occurrences of the abnormal state exceeds a second preset value, the abnormal state is treated as a high-frequency abnormal event and associated with the device information of the image forming device and sent to the cloud.

7. The voice control method for the image forming apparatus according to claim 6, characterized in that, Also includes: The high-frequency abnormal events are obtained through the cloud; The current printing action is determined, followed by: When the printing action is associated with the high-frequency abnormal event, the corresponding voice operation prompt information is output.

8. A voice control device for an image forming apparatus, characterized in that, include: An action determination module is used to determine the currently executed printing action; The action recognition and voice output module is used to output corresponding voice operation prompt information when the printing action is a trigger prompt action and the triggering condition is met, so as to play the correct printing operation guidance. The triggering condition is that the number of times the abnormal state of the image forming device associated with the triggering prompt action occurs is greater than a first preset value.

9. An image forming apparatus, characterized in that, include: The processor and memory, the memory storing machine-readable instructions executable by the processor, which, when executed by the processor, perform the steps of the voice control method of the image forming apparatus as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the voice control method for the image forming apparatus as described in any one of claims 1 to 7.

Images