Printing system and method based on voice interaction

Abstract

The invention relates to the technical field of printing data processing, and discloses a printing system and method based on voice interaction, and the system comprises a printing device which is used for printing an electronic document on paper in an ink-jet manner, and is used for obtaining document data which needs to be printed and is printed from a data providing device of a user, the data acquisition module is used for acquiring a user and acquiring feedback data of the user, the data processing module is used for processing the acquired data, the interaction module is used for enabling the user to interact with the printing equipment, the settlement module is used for carrying out price settlement on a document printed by the user, and the interaction module comprises a voice prompt module. The data acquisition module acquires related data, the data processing module and the interaction module process the data and form a document analysis strategy, and the printing system and method based on voice interaction perform real-time feedback and interaction, and automatically identify whether a basic problem exists in document printing and correct the basic problem.

Description

Technical Field

[0001] The present invention relates to the technical field of printing data processing, and in particular to a printing system and method based on voice interaction. Background Art

[0002] The printing system based on voice interaction is a technology that uses voice commands to control the printer to perform printing operations. It combines related technologies such as speech recognition, semantic understanding and print control, allowing users to easily perform printing operations through voice commands, improving user experience and operating efficiency. Specifically, it includes speech recognition technology, semantic understanding technology, print control technology, sound processing and speech synthesis technology.

[0003] Speech recognition technology is the basis for implementing a printing system based on voice interaction. By converting the user's voice instructions into text, the system can understand the user's intentions and perform corresponding operations. In recent years, with the development of technologies such as deep learning and neural networks, the accuracy of speech recognition has been greatly improved, providing reliable support for the application of speech interaction technology. Semantic understanding technology is used to parse and understand user voice instructions to determine the user's intentions and needs. By training models and using natural language processing technology, the system can convert voice instructions into specific printing operations, such as printing files, printing copies, selecting printers, etc. The accuracy and efficiency of semantic understanding technology are crucial to providing a good user experience. Printing control technology refers to the technology that controls the printer to perform printing operations. In a voice interactive printing system, printing control technology can send the user's print request to the printer and ensure that the parameters such as the printed file format and page layout meet the user's requirements. At the same time, printing control technology can also monitor information such as printer status and print queue to manage and optimize the system. In order to provide a good voice interaction experience, the printing system also needs audio processing and speech synthesis technology. Audio processing technology can enhance the quality of voice signals and improve the accuracy of speech recognition; while speech synthesis technology can convert the system's response into natural and fluent voice output to interact with users.

[0004] Existing printing systems and methods based on voice interaction have disadvantages such as insufficient voice recognition accuracy, few supported languages, inaccurate context understanding and deep semantic processing, little real-time feedback and interactive experience, and insufficient privacy and security considerations. They are also unable to automatically identify whether there are basic problems in document printing and correct them, and are therefore lacking in practicality. Summary of the invention

[0005] The present invention provides a printing system and method based on voice interaction, which promotes the solution of the automatic recognition problem mentioned in the above background technology, obtains the document information that the user needs to print, scans the document information, obtains the picture and table information in the document, determines whether there are pictures and tables in the document, obtains the layout and clarity of the pictures and tables, and determines whether the pictures and tables have layout problems due to differences in document software.

[0006] The present invention provides the following technical solution: a printing system based on voice interaction, comprising:

[0007] Printing equipment: used to print electronic documents on paper using inkjet;

[0008] Data collection module: used to obtain the document data to be printed and printed from the user's data providing device, and to obtain the user's feedback data;

[0009] Data processing module: used to process the collected data;

[0010] Interaction module: used to allow users to interact with the printing device;

[0011] Settlement module: used to settle prices for documents printed by users.

[0012] As the present invention also discloses a method of using a printing system based on voice interaction, which includes: the interaction module includes a voice prompt, the data acquisition module acquires relevant data, the data processing module and the interaction module process the data and form a document analysis strategy;

[0013] The document analysis strategy includes a first analysis strategy;

[0014] The first analysis strategy: obtain the document information that the user needs to print, scan the document information, obtain the image and table information in the document, determine whether there are images and tables in the document, form a judgment strategy based on the judgment result, and form a printing strategy based on the judgment strategy.

[0015] As an optional solution of the method of using a printing system based on voice interaction of the present invention, wherein: the document analysis strategy includes a second analysis strategy;

[0016] The second analysis strategy: obtain the size of the image in the document and its layout position in the text, obtain the page margins and text continuity set in the document, and determine the text fluency of the upper and lower paragraphs where the image is inserted, that is, determine whether the text description before the image is interrupted due to the insertion of the image, and the text description at the beginning of the text after the image is incomplete, etc., and determine whether the image is incompletely printed due to its large size. If it is determined that there is a problem with the image layout, the printing device pops up a window to ask the user whether the image layout and size need to be adjusted. If the user chooses to adjust, proceed to the next step to form a layout solution strategy. If the user chooses not to adjust, the third analysis strategy is formed;

[0017] The layout solution strategy includes the first pop-up window inquiry strategy, the automatic layout strategy and the manual layout strategy;

[0018] First pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic typesetting or manual typesetting;

[0019] Automatic layout strategy: The printing device automatically rearranges the image, and after automatic layout, the user is asked to preview and confirm whether it meets the user's requirements. If it meets the requirements, the third analysis strategy is continued. If it does not meet the requirements, the first pop-up window inquiry strategy is performed again;

[0020] Manual layout strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to change the layout directly on the printing device display screen. After changing the layout and confirming the change, the third analysis strategy is continued.

[0021] As an optional solution of the method of using a printing system based on voice interaction of the present invention, wherein: the document analysis strategy further includes a third analysis strategy;

[0022] The third analysis strategy: obtaining the clarity of the image, segmenting the image, segmenting the image into several sub-images, detecting the segmented sub-images, determining whether they are blurred, classifying the blur judgment of the sub-images, and recording data of the sub-images determined to be clear and blurred respectively. If more than 80% of the sub-images are determined to be clear images, the image is determined to be a clear image. If less than 80% of the sub-images are determined to be clear images, the image is determined to be a blurred image. The color of the image is obtained, and it is determined whether the image printing will be affected by the ink output when printing the image, resulting in an unsatisfactory image printing effect. If the image is blurred or the printing effect is unsatisfactory, an image processing strategy is formed;

[0023] The image processing strategy includes a second pop-up window inquiry strategy, a third pop-up window inquiry strategy, an automatic adjustment strategy, and a manual adjustment strategy;

[0024] Second pop-up window inquiry strategy: The printing device pops up a window to ask the user whether the image clarity needs to be adjusted. If adjustment is required, the third pop-up window inquiry strategy is implemented. If adjustment is not required, the printing strategy is implemented;

[0025] Third pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic adjustment or manual adjustment;

[0026] Automatic adjustment strategy: The printing device automatically adjusts the clarity and color of the image, and allows the user to preview it and confirm whether it meets the user's requirements. If it meets the requirements, the printing strategy is implemented. If it does not meet the requirements, the third pop-up window inquiry strategy is implemented again;

[0027] Manual adjustment strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to modify the image directly on the printing device display screen. After modifying the image and confirming the changes, the printing strategy continues.

[0028] As an optional solution of the method of using the printing system based on voice interaction of the present invention, wherein: the document analysis strategy further includes a fourth analysis strategy;

[0029] The fourth analysis strategy: obtain the layout position in the table in the document and in the text, obtain the table layout and text continuity set in the document, determine the text fluency of the upper and lower paragraphs where the table is inserted, that is, determine whether the text description before the table is interrupted due to the insertion of the table, and the text description at the beginning of the text after the table is incomplete, etc., determine whether the font, size, and position of the text in the table are unified. If it is determined that there is a problem with the table layout, the printing device will pop up a window to ask the user whether the table layout needs to be adjusted. If the user chooses to adjust it, it will be adjusted. If the user chooses not to adjust it, the printing strategy will continue.

[0030] As an optional solution of the method of using the printing system based on voice interaction described in the present invention, wherein: the settlement module obtains the number of pages of the document that the user needs to print, and after the printing strategy is implemented, a pop-up window prompt is displayed to the user, prompting the user to check whether there is any problem with the printed document, and a feedback interface pops up after a set time to form a feedback strategy, and a settlement strategy is formed according to the feedback strategy, and then the user is charged;

[0031] Feedback strategy: The feedback interface asks the user whether they are satisfied with the printing and whether there are any problems with the printing. If the user reports a problem, the printing device obtains the final version of the printed file and reviews the scanned copy of the printed file during the printing process to obtain the file location of the problem. A pop-up window will be displayed to ask the user whether the problem location is correct. If correct, the specific classification of the problem will be obtained and a troubleshooting strategy will be formed. If incorrect, the user will be asked whether to choose to manually search for the problem page. If the user chooses manual search, the user will find the problem page through the touch screen of the printing device and reprint it. If the user chooses automatic search, the printing device will continue to automatically search for the problem page.

[0032] As an optional solution of the method of using the printing system based on voice interaction described in the present invention, wherein: the troubleshooting strategy first determines the specific situation of the printing problem page, then troubleshoots the printing device itself, obtains the usage of the ink cartridge of the printing device and the usage of the inkjet device of the printing device, so as to determine whether the ink output of the printing device is normal and whether the ink output amount is normal. If the ink cartridge and the ink output device of the printing device are normal, then whether to reprint the page is selected according to the specific problem, and a settlement strategy is formed;

[0033] The settlement strategies include a first settlement strategy, a second settlement strategy and a third settlement strategy;

[0034] First settlement strategy: some fonts are blurred but do not affect reading or use. A pop-up window is displayed to ask the user to choose to reprint or reduce the fee. If the user chooses to reduce the fee, a preferential strategy is formed based on the ratio of the number of problematic pages d to the total number of pages e of the entire document. The user is charged the first total fee a according to the preferential strategy. If the user chooses to reprint, the second settlement strategy is adopted.

[0035] Second settlement strategy: if the text is missing and affects reading or use, the problem page will be reprinted, and no fee will be charged for the reprinted part. The user will be charged the second total fee b, and the second total fee b = the third total fee c;

[0036] The third settlement strategy: if there is no problem with the printed document, the user is charged the third total fee c normally, and the price of each print is set to f, the third total fee c = the price of each print f × the total number of pages of the whole document e;

[0037] Preferential policy: Set the printing price per page to f, then the first total cost a = (1-number of problem pages d / total number of pages in the whole document e) × (printing price per page f × total number of pages in the whole document e).

[0038] As an optional solution of the method of using the printing system based on voice interaction of the present invention, wherein: the judgment strategy includes a first judgment strategy, a second judgment strategy and a third judgment strategy;

[0039] First judgment strategy: if there is at least one picture and at least one table in the document, the first printing strategy is adopted;

[0040] Second judgment strategy: if there is at least one picture or table in the document, the second printing strategy is adopted;

[0041] The third judgment strategy: if there are no pictures or tables in the document, the third printing strategy is adopted.

[0042] As an optional solution of the method of using the printing system based on voice interaction described in the present invention, wherein: the printing strategy analyzes and processes the document image and the table according to different judgment strategies, and the printing strategy includes a first printing strategy, a second printing strategy and a third printing strategy;

[0043] First printing strategy: Analyze the images and tables of the document one by one in the order of the document to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill.

[0044] Second printing strategy: Analyze the pictures or tables of the document one by one to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill;

[0045] The third printing strategy: After the user previews and confirms the printing, the printing device will print and settle the bill.

[0046] The present invention has the following beneficial effects:

[0047] 1. The printing system and method based on voice interaction facilitates user use through voice prompts of the interactive module, making it more convenient for some users with disabilities to use the printing system.

[0048] 2. The printing system and method based on voice interaction can analyze the document through document analysis strategy to determine whether there are layout problems with the pictures and tables in the document. If there are problems, the user can choose to correct them automatically or manually.

[0049] 3. The printing system and method based on voice interaction, through the settlement module and feedback strategy, determines whether there is a problem with printing, troubleshoots the problem according to the problem, and solves the problem. After the problem is solved, the user's printing is settled. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 The figure is a block diagram of the printing system based on voice interaction of the present invention. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] In the related art, the troubleshooting strategy first determines the specific situation of the printing problem page, such as blurring, missing, etc., and then troubleshoots the printing device itself, obtains the usage of the printing device's ink cartridges, obtains the usage of the printing device's inkjet device, etc., so as to determine whether the printing device's ink output is normal, whether the ink output amount is normal, etc. If the printing device's ink cartridge and ink output device are normal, then choose whether to reprint the page based on the specific problem, and form a settlement strategy, which includes a first settlement strategy, a second settlement strategy, and a third settlement strategy.

[0053] Among them, some fonts are blurred and do not affect reading or use. A pop-up window asks the user to choose to reprint or reduce the fee. If the user chooses to reduce the fee, a preferential strategy is formed according to the ratio of the number of problem pages d to the total number of pages e of the entire document. The user is charged a first total fee a according to the preferential strategy. If the user chooses to reprint, the second settlement strategy is adopted.

[0054] Among them, if text is missing and affects reading or use, the problem page will be reprinted, and no charge will be charged for the reprinted part. The user will be charged a second total fee b, then the second total fee b = the third total fee c.

[0055] If there is no problem with the printed document, the user is charged the third total fee c normally, and the price per print is set to f. The third total fee c = price per print f × total number of pages in the document e.

[0056] In the embodiment of the present application, the printing price per page is set to f, and the first total fee a = (1-number of problem pages d / total number of pages in the whole document e) × (printing price per page f × total number of pages in the whole document e).

[0057] Embodiment 1, a printing system based on voice interaction, comprising:

[0058] Printing equipment: used to print electronic documents on paper using inkjet or other methods;

[0059] Data collection module: used to obtain the document data to be printed and printed from the user's data providing device, and to obtain the user's feedback data;

[0060] Data processing module: used to process the collected data;

[0061] Interaction module: used to allow users to interact with the printing device;

[0062] Settlement module: used to settle prices for documents printed by users.

[0063] The interactive module includes voice prompts, the data acquisition module acquires relevant data, and the data processing module and the interactive module process the data and form a document analysis strategy;

[0064] The document analysis strategy includes a first analysis strategy;

[0065] The first analysis strategy: obtain the document information that the user needs to print, scan the document information, obtain the image and table information in the document, determine whether there are images and tables in the document, form a judgment strategy based on the judgment result, and form a printing strategy based on the judgment strategy.

[0066] The document analysis strategy includes a second analysis strategy;

[0067] The second analysis strategy: obtain the size of the image in the document and its layout position in the text, obtain the page margins and text continuity set in the document, the text continuity refers to whether a paragraph of text contains spaces, pictures, tables, line breaks, etc. If there are spaces, pictures, tables, line breaks, etc., it means that the text is discontinuous. If not, it means that the text is continuous. Determine the text fluency of the upper and lower paragraphs where the image is inserted, that is, determine whether the text description before the image is interrupted due to the insertion of the image, and the text description at the beginning of the text after the image is incomplete, etc. Determine whether the image is incompletely printed due to its large size. If it is determined that there is a problem with the image layout, the printing device pops up a window to ask the user whether it needs to adjust the image layout and size. If the user chooses to adjust, proceed to the next step to form a layout solution strategy. If the user chooses not to adjust, the third analysis strategy is formed.

[0068] The layout solution strategy includes the first pop-up window inquiry strategy, the automatic layout strategy and the manual layout strategy;

[0069] First pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic typesetting or manual typesetting;

[0070] Automatic layout strategy: The printing device automatically rearranges the image, and after automatic layout, the user is asked to preview and confirm whether it meets the user's requirements. If it meets the requirements, the third analysis strategy is continued. If it does not meet the requirements, the first pop-up window inquiry strategy is performed again;

[0071] Manual layout strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to change the layout directly on the printing device display screen. After changing the layout and confirming the change, the third analysis strategy is continued.

[0072] The document analysis strategy also includes a third analysis strategy;

[0073] The third analysis strategy: obtaining the clarity of the image, segmenting the image, segmenting the image into several sub-images, detecting the segmented sub-images, determining whether they are blurred, classifying the blur judgment of the sub-images, and recording data of the sub-images determined to be clear and blurred respectively. If more than 80% of the sub-images are determined to be clear images, the image is determined to be a clear image. If less than 80% of the sub-images are determined to be clear images, the image is determined to be a blurred image. The color of the image is obtained, and it is determined whether the image printing will be affected by the ink output when printing the image, resulting in an unsatisfactory image printing effect. If the image is blurred or the printing effect is unsatisfactory, an image processing strategy is formed;

[0074] The image processing strategy includes a second pop-up window inquiry strategy, a third pop-up window inquiry strategy, an automatic adjustment strategy, and a manual adjustment strategy;

[0075] Second pop-up window inquiry strategy: The printing device pops up a window to ask the user whether the image clarity needs to be adjusted. If adjustment is required, the third pop-up window inquiry strategy is implemented. If adjustment is not required, the printing strategy is implemented;

[0076] Third pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic adjustment or manual adjustment;

[0077] Automatic adjustment strategy: The printing device automatically adjusts the clarity and color of the image, and allows the user to preview it and confirm whether it meets the user's requirements. If it meets the requirements, the printing strategy is implemented. If it does not meet the requirements, the third pop-up window inquiry strategy is implemented again;

[0078] Manual adjustment strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to modify the image directly on the printing device display screen. After modifying the image and confirming the changes, the printing strategy continues.

[0079] The document analysis strategy also includes a fourth analysis strategy;

[0080] The fourth analysis strategy: obtain the layout position in the table in the document and in the text, obtain the table layout and text continuity set in the document, the text continuity refers to whether a paragraph of text contains spaces, pictures, tables, line breaks and other operations. If there are spaces, pictures, tables, line breaks and other operations, it means that the text is discontinuous. If not, it means that the text is continuous. Determine the smoothness of the text in the upper and lower paragraphs where the table is inserted, that is, determine whether the document text is interrupted before the table due to the insertion of the table, and the text at the beginning of the text after the table is incomplete, etc. Determine whether the font, size, and position of the text in the table are unified. If it is determined that there is a problem with the table layout, the printing device will pop up a window to ask the user whether the table layout needs to be adjusted. If the user chooses to adjust, then the adjustment is made. If the user chooses not to adjust, then the printing strategy continues.

[0081] In the printing system based on voice interaction, the settlement module obtains the number of pages of the document that the user needs to print. After the printing strategy is implemented, a pop-up window prompt is displayed to the user, prompting the user to check whether there is any problem with the printed document. After a set time, a feedback interface pops up to form a feedback strategy, and a settlement strategy is formed according to the feedback strategy, and then the user is charged;

[0082] Feedback strategy: The feedback interface asks the user whether they are satisfied with the printing and whether there are any problems with the printing. If the user reports a problem, the printing device obtains the final version of the printed file and reviews the scanned copy of the printed file during the printing process to obtain the file location of the problem. A pop-up window will be displayed to ask the user whether the problem location is correct. If correct, the specific classification of the problem is obtained, such as fuzzy, missing, etc., and a troubleshooting strategy is formed. If incorrect, the user is asked whether to choose to manually search for the problem page. If the user chooses manual search, the user will find the problem page through the touch screen of the printing device and reprint it. If the user chooses automatic search, the printing device will continue to automatically search for the problem page.

[0083] In this embodiment, the troubleshooting strategy first determines the specific situation of the printing problem page, such as blur, missing, etc., and then troubleshoots the printing device itself, obtains the usage of the ink cartridge of the printing device and the usage of the inkjet device of the printing device, so as to determine whether the ink output of the printing device is normal and whether the ink output amount is normal. If the ink cartridge and the ink output device of the printing device are normal, it is determined whether to reprint the page according to the specific problem, and a settlement strategy is formed;

[0084] The settlement strategies include a first settlement strategy, a second settlement strategy and a third settlement strategy;

[0085] First settlement strategy: some fonts are blurred but do not affect reading or use. A pop-up window is displayed to ask the user to choose to reprint or reduce the fee. If the user chooses to reduce the fee, a preferential strategy is formed based on the ratio of the number of problematic pages d to the total number of pages e of the entire document. The user is charged the first total fee a according to the preferential strategy. If the user chooses to reprint, the second settlement strategy is adopted.

[0086] Second settlement strategy: if the text is missing and affects reading or use, the problem page will be reprinted, and no fee will be charged for the reprinted part. The user will be charged the second total fee b, and the second total fee b = the third total fee c;

[0087] The third settlement strategy: if there is no problem with the printed document, the user is charged the third total fee c normally, and the price of each print is set to f, the third total fee c = the price of each print f × the total number of pages of the whole document e;

[0088] Preferential policy: Set the printing price per page to f, then the first total cost a = (1-number of problem pages d / total number of pages in the whole document e) × (printing price per page f × total number of pages in the whole document e).

[0089] This embodiment also provides that the judgment strategy includes a first judgment strategy, a second judgment strategy and a third judgment strategy;

[0090] First judgment strategy: if there is at least one picture and at least one table in the document, the first printing strategy is adopted;

[0091] Second judgment strategy: if there is at least one picture or table in the document, the second printing strategy is adopted;

[0092] The third judgment strategy: if there are no pictures or tables in the document, the third printing strategy is adopted.

[0093] This embodiment also provides that the printing strategy analyzes and processes the document image and the table according to different judgment strategies, and the printing strategy includes a first printing strategy, a second printing strategy and a third printing strategy;

[0094] First printing strategy: Analyze the images and tables of the document one by one in the order of the document to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill.

[0095] Second printing strategy: Analyze the pictures or tables of the document one by one to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill;

[0096] The third printing strategy: After the user previews and confirms the printing, the printing device will print and settle the bill.

[0097] The data providing device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a laptop computer, a PAD (tablet computer), a vehicle-mounted terminal (eg, a vehicle-mounted navigation terminal), etc., and a fixed terminal.

[0098] The data providing device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and data required for the operation of the data providing device are also stored. The processing device, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0099] Typically, the following devices may be connected to the I / O interface: input devices including, for example, a touch screen, a touch pad, an image sensor, a microphone, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, etc.; storage devices including, for example, a magnetic tape, a hard disk, etc.; and communication devices. The communication devices may allow the data providing device to communicate with other devices wirelessly or by wire to exchange data.

[0100] The embodiment of the present disclosure also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the voice interaction-based printing system in the aforementioned method embodiment.

[0101] It should be noted that more specific examples of computer-readable storage media may include portable computer disks, hard disks, erasable programmable read-only memories (EPROMs or flash memories), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the present disclosure, computer-readable storage media may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device. The computer-readable medium may be included in the data providing device; or it may exist independently without being assembled into the data providing device.

[0102] The computer-readable medium carries one or more programs. When the one or more programs are executed by the data providing device, the data providing device can implement the solution provided by the method embodiment.

[0103] Computer program code for performing operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, and may be executed entirely on a user's computer, partially on a user's computer, as a stand-alone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0104] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0105] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A printing system based on voice interaction, characterized in that: include: Printing equipment: used to print electronic documents on paper using inkjet; Data collection module: used to obtain the document data to be printed and printed from the user's data providing device, and to obtain the user's feedback data; Data processing module: used to process the collected data; Interaction module: used to allow users to interact with the printing device; Settlement module: used to settle prices for documents printed by users.

2. A method for using the printing system based on voice interaction according to claim 1, characterized in that: The interactive module includes voice prompts, the data acquisition module acquires relevant data, and the data processing module and the interactive module process the data and form a document analysis strategy; The document analysis strategy includes a first analysis strategy; The first analysis strategy: obtain the document information that the user needs to print, scan the document information, obtain the image and table information in the document, determine whether there are images and tables in the document, form a judgment strategy based on the judgment result, and form a printing strategy based on the judgment strategy.

3. The method of the printing system based on voice interaction according to claim 2, characterized in that: The document analysis strategy includes a second analysis strategy; The second analysis strategy: obtain the size of the image in the document and its layout position in the text, obtain the page margins and text continuity set in the document, and determine the text fluency of the upper and lower paragraphs where the image is inserted, that is, determine whether the text description before the image is interrupted due to the insertion of the image, and the text description at the beginning of the text after the image is incomplete, and determine whether the image is incompletely printed due to its large size. If it is determined that there is a problem with the image layout, the printing device pops up a window to ask the user whether the image layout and size need to be adjusted. If the user chooses to adjust, proceed to the next step to form a layout solution strategy. If the user chooses not to adjust, the third analysis strategy is formed. The layout solution strategy includes the first pop-up window inquiry strategy, the automatic layout strategy and the manual layout strategy; First pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic typesetting or manual typesetting; Automatic layout strategy: The printing device automatically rearranges the image, and after automatic layout, the user is asked to preview and confirm whether it meets the user's requirements. If it meets the requirements, the third analysis strategy is continued. If it does not meet the requirements, the first pop-up window inquiry strategy is performed again; Manual layout strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to change the layout directly on the printing device display screen. After changing the layout and confirming the change, the third analysis strategy is continued.

4. The method of the printing system based on voice interaction according to claim 3, characterized in that: The document analysis strategy also includes a third analysis strategy; The third analysis strategy: obtaining the clarity of the image, segmenting the image, segmenting the image into several sub-images, detecting the segmented sub-images, determining whether they are blurred, classifying the blur judgment of the sub-images, and recording data of the sub-images determined to be clear and blurred respectively. If more than 80% of the sub-images are determined to be clear images, the image is determined to be a clear image. If less than 80% of the sub-images are determined to be clear images, the image is determined to be a blurred image. The color of the image is obtained, and it is determined whether the image printing will be affected by the ink output when printing the image, resulting in an unsatisfactory image printing effect. If the image is blurred or the printing effect is unsatisfactory, an image processing strategy is formed; The image processing strategy includes a second pop-up window inquiry strategy, a third pop-up window inquiry strategy, an automatic adjustment strategy, and a manual adjustment strategy; Second pop-up window inquiry strategy: The printing device pops up a window to ask the user whether the image clarity needs to be adjusted. If adjustment is required, the third pop-up window inquiry strategy is implemented. If adjustment is not required, the printing strategy is implemented; Third pop-up inquiry strategy: The printing device pops up a window to ask the user to choose automatic adjustment or manual adjustment; Automatic adjustment strategy: The printing device automatically adjusts the clarity and color of the image, and allows the user to preview it and confirm whether it meets the user's requirements. If it meets the requirements, the printing strategy is implemented. If it does not meet the requirements, the third pop-up window inquiry strategy is implemented again; Manual adjustment strategy: The data acquisition module collects user gesture information and transmits the collected information data to the printing device, allowing the user to modify the image directly on the printing device display screen. After modifying the image and confirming the changes, the printing strategy continues.

5. The method of the printing system based on voice interaction according to claim 3, characterized in that: The document analysis strategy also includes a fourth analysis strategy; The fourth analysis strategy: obtain the layout position in the table in the document and in the text, obtain the table layout and text continuity set in the document, determine the text fluency of the upper and lower paragraphs where the table is inserted, that is, determine whether the document text is interrupted before the table due to the insertion of the table, and the text at the beginning of the text after the table is incomplete, determine whether the font, size and position of the text in the table are unified, if it is determined that there is a problem with the table layout, the printing device will pop up a window to ask the user whether the table layout needs to be adjusted. If the user chooses to adjust it, it will be adjusted. If the user chooses not to adjust it, the printing strategy will continue.

6. The method of the printing system based on voice interaction according to claim 2, characterized in that: The settlement module obtains the number of pages of the document that the user needs to print. After the printing strategy is implemented, a pop-up window prompt is displayed to the user, prompting the user to check whether there is any problem with the printed document. A feedback interface is displayed in a pop-up window after a set time, and a feedback strategy is formed. A settlement strategy is formed according to the feedback strategy, and then the user is charged; Feedback strategy: The feedback interface asks the user whether they are satisfied with the printing and whether there are any problems with the printing. If the user reports a problem, the printing device obtains the final version of the printed file and reviews the scanned copy of the printed file during the printing process to obtain the file location of the problem. A pop-up window will be displayed to ask the user whether the problem location is correct. If correct, the specific classification of the problem will be obtained and a troubleshooting strategy will be formed. If incorrect, the user will be asked whether to choose to manually search for the problem page. If the user chooses manual search, the user will find the problem page through the touch screen of the printing device and reprint it. If the user chooses automatic search, the printing device will continue to automatically search for the problem page.

7. The method of the printing system based on voice interaction according to claim 6, characterized in that: The troubleshooting strategy first determines the specific situation of the printing problem page, then troubleshoots the printing device itself, obtains the usage of the ink cartridge of the printing device and the usage of the inkjet device of the printing device, so as to determine whether the ink output of the printing device is normal and whether the ink output amount is normal. If the ink cartridge and the ink output device of the printing device are normal, then choose whether to reprint the page according to the specific problem, and form a settlement strategy; The settlement strategies include a first settlement strategy, a second settlement strategy and a third settlement strategy; First settlement strategy: some fonts are blurred but do not affect reading or use. A pop-up window is displayed to ask the user to choose to reprint or reduce the fee. If the user chooses to reduce the fee, a preferential strategy is formed based on the ratio of the number of problematic pages d to the total number of pages e of the entire document. The user is charged the first total fee a according to the preferential strategy. If the user chooses to reprint, the second settlement strategy is adopted. Second settlement strategy: if the text is missing and affects reading or use, the problem page will be reprinted, and no fee will be charged for the reprinted part. The user will be charged the second total fee b, and the second total fee b = the third total fee c; The third settlement strategy: if there is no problem with the printed document, the user is charged the third total fee c normally, and the price of each print is set to f, the third total fee c = the price of each print f × the total number of pages of the whole document e; Preferential policy: Set the printing price per page to f, then the first total cost a = (1-number of problem pages d / total number of pages in the whole document e) × (printing price per page f × total number of pages in the whole document e).

8. The method of the printing system based on voice interaction according to claim 2, characterized in that: The judgment strategy includes a first judgment strategy, a second judgment strategy and a third judgment strategy; First judgment strategy: if there is at least one picture and at least one table in the document, the first printing strategy is adopted; Second judgment strategy: if there is at least one picture or table in the document, the second printing strategy is adopted; The third judgment strategy: if there are no pictures or tables in the document, the third printing strategy is adopted.

9. The method of the printing system based on voice interaction according to claim 2, characterized in that: The printing strategy analyzes and processes the document image and table according to different judgment strategies, and the printing strategy includes a first printing strategy, a second printing strategy and a third printing strategy; First printing strategy: Analyze the images and tables of the document one by one in the order of the document to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill. Second printing strategy: Analyze the pictures or tables of the document one by one to see if there are any problems with the layout and clarity, and implement corresponding solutions to the analyzed problems. After the problems are solved, the user previews and confirms the printing, and then the printing device prints and settles the bill; The third printing strategy: After the user previews and confirms the printing, the printing device will print and settle the bill.

Images