Image processing method, device and computer program product

Abstract

The embodiment of the invention provides an image processing method and device and a computer program product. The image processing method comprises the following steps: responding to a scanning triggering function, entering a first page, and displaying a to-be-scanned object identified by an image acquisition module on the first page; according to the suspected type of the to-be-scanned object, displaying at least one first control on the first page; in response to an operation acting on the at least one first control, determining a definite type of the to-be-scanned object, and displaying a second page corresponding to the definite type; and processing the to-be-scanned object based on the operation acting on the second page corresponding to the definite type. By associating the type of the to-be-scanned object with the second page, the processing of the to-be-scanned object on the second page can be matched with the characteristics of the to-be-scanned object, so that the processing effect and precision of the to-be-scanned object are improved.

Description

Technical Field

[0001] The present disclosure relates to but is not limited to the field of information technology, and in particular to an image processing method, device and computer program product. Background Art

[0002] As the functions of electronic devices become more and more abundant, more and more electronic devices have scanning functions to scan different objects in various usage scenarios and obtain corresponding scanning results. For example, documents, books, etc. can be scanned. However, when scanning different objects using the scanning method in the related art, the accuracy of the scanning results obtained is low. Summary of the invention

[0003] The embodiments of the present disclosure provide an image processing method, an apparatus, and a computer program product to solve the problem of low accuracy of scanning results obtained when scanning different objects.

[0004] In a first aspect, the present disclosure provides an image processing method, the method comprising:

[0005] In response to triggering the scanning function, entering a first page, and displaying the object to be scanned identified by the image acquisition module on the first page;

[0006] Displaying at least one first control on the first page according to the suspected type of the object to be scanned;

[0007] In response to an operation acting on the at least one first control, determining a confirmed type of the object to be scanned, and displaying a second page corresponding to the confirmed type;

[0008] Based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned.

[0009] According to a second aspect of the present disclosure, there is provided an image processing device, including:

[0010] A first display module is configured to enter a first page in response to triggering a scanning function, and to display the object to be scanned identified by the image acquisition module on the first page;

[0011] A second display module is configured to display at least one first control on the first page according to the suspected type of the object to be scanned;

[0012] a determination module, configured to determine the confirmed type of the object to be scanned in response to an operation acting on the at least one first control, and display a second page corresponding to the confirmed type;

[0013] The processing module is configured to perform processing on the object to be scanned based on an operation acting on a second page corresponding to the confirmed type.

[0014] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0015] processor;

[0016] Memory for storing computer programs or instructions;

[0017] The processor executes the computer program or instructions to implement the steps of any one of the methods in the first aspect above.

[0018] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the storage medium stores a computer program or instructions. When the computer program or instructions in the storage medium are executed by a processor, the steps of the method described in any one of the first aspects are implemented.

[0019] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program or instructions, which, when executed by a processor, implement the steps of any one of the methods described in the first aspect.

[0020] According to the technical solution provided by the embodiment of the present disclosure, after the electronic device identifies the suspected type of the object to be scanned, by displaying the first control on the first page, the confirmed type can be conveniently determined based on the user operation. Based on the confirmed type, the second page corresponding to the confirmed type can be entered to perform targeted processing on the object to be scanned on the second page corresponding to the confirmed type. By associating the type of the object to be scanned with the second page, the processing on the object to be scanned on the second page can be matched with the characteristics of the object to be scanned, thereby improving the processing effect and accuracy of the object to be scanned.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] Figure 1 It is a flowchart of an image processing method according to an exemplary embodiment.

[0024] Figure 2 is a schematic diagram of a first page according to an exemplary embodiment Figure 1 .

[0025] Figure 3 is a schematic diagram of a second page according to an exemplary embodiment.

[0026] Figure 4 is a schematic diagram of a first page according to an exemplary embodiment Figure 2 .

[0027] Figure 5 It is a schematic diagram showing the effect of a contract document after processing according to an exemplary embodiment.

[0028] Figure 6 The figure is a schematic diagram of an interface in a file processing process according to an exemplary embodiment.

[0029] Figure 7 The diagram is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0030] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the embodiments of the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the embodiments of the present disclosure as detailed in the appended claims.

[0031] like Figure 1 As shown, the present disclosure provides an image processing method, the method comprising:

[0032] In step 101, in response to triggering the scanning function, entering the first page, and displaying the object to be scanned identified by the image acquisition module on the first page;

[0033] In step 102, at least one first control is displayed on a first page according to the suspected type of the object to be scanned;

[0034] In step 103, in response to the operation of at least one first control, the confirmed type of the object to be scanned is determined, and a second page corresponding to the confirmed type is displayed;

[0035] In step 104, based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned.

[0036] It should be noted that the image processing method proposed in the present disclosure can be applied to electronic devices or servers. Here, electronic devices may include: terminal devices, such as mobile terminals or fixed terminals. Among them, mobile terminals may include: mobile phones, tablet computers, laptops, wearable devices, etc. Fixed terminals may include: fixed scanning devices, such as handheld scanners connected to computers, printers with scanning functions, etc. As a type of computer, a server can provide computing or application services for other clients (such as computers, terminal devices such as smart phones, and even large devices such as train systems) in the network.

[0037] Taking a printer with a scanning function as an example, generally when the printer performs the scanning function, the file is placed on the scanning clamp of the printer so that the file is in a space available for scanning. After the printer completes the scan, the scanned file in image format can be seen on the computer connected to the printer.

[0038] The image processing method in the embodiment of the present disclosure may be configured in an image processing device, and the image processing device may be provided in a server, or may also be provided in an electronic device, which is not limited in the embodiment of the present disclosure.

[0039] It should be noted that the execution subject of the embodiment of the present disclosure may be, for example, a central processing unit (CPU) in a server or electronic device in terms of hardware, or may be, for example, a related background service in a server or electronic device in terms of software, without limitation.

[0040] In the embodiment of the present disclosure, when the scanning function is triggered, the first page can be entered, and the object to be scanned identified by the image acquisition module can be displayed on the first page. Among them, the scanning function indicates the ability to convert paper documents, pictures or other items into digital formats, which can be a function possessed by the electronic device itself, or a function possessed by an application installed on the electronic device. The objects to be scanned may include: objects that can be recognized by the image acquisition module based on the electronic device, and objects that can be recognized and processed by the image processing technology based on the electronic device. Exemplarily, the objects to be scanned may include at least one of the following: books, documents, certificates, express delivery slips, bills, physical objects, emails, test papers, and content displayed on the screen.

[0041] In some embodiments, the first page has at least one of the following functions: an image acquisition function; an image preview function; an image import function, wherein the image acquisition function can be used to acquire an image including an object to be scanned (hereinafter referred to as: an image to be processed), the image preview function can be used to preview the image to be processed, and the image import function can be used to import the image to be processed. Exemplarily, if the first page has an image preview function, the image to be processed may be a preview image, wherein the recognition of the preview image is a pre-recognition, not a final type of recognition result. The first page may be a preview page, which is used to preview and display the image to be processed.

[0042] In some embodiments, the image to be processed may include: an image currently obtained by identifying the object to be scanned based on the image acquisition module (i.e., a preview image), or an image (captured image) currently formally captured by the image acquisition module based on the object to be scanned after the shooting operation is detected. In other embodiments, the image to be processed may also be an image imported from other devices, or an image downloaded from the Internet. The object to be scanned may include at least one of the following: an image, a form, a book, and an invoice.

[0043] In some embodiments, the scanning function can be triggered based on a control set on the electronic device, where the triggering of the scanning function refers to turning on the scanning function, which is different from executing the scanning function. In the embodiment of the present disclosure, after the scanning function is triggered, the first page can be entered, where the first page can also be called a preview page, which is used to display a preview image, for example, the image to be processed identified by the image acquisition module can be previewed. Figure 2 The figure shows a schematic diagram of displaying a preview image on the first page. Figure 2 After the "Universal Scan" control 220 starts scanning, a preview image 210 of the invoice is obtained.

[0044] Exemplarily, the image to be processed can be used to determine the suspected type or the confirmed type of the object to be scanned. For example, the possible type of the object to be scanned can be determined based on the image to be processed. The possible type is the suspected type.

[0045] Exemplarily, for an image including both a table and a graphic, the suspected types of the object to be scanned may include: an image and a table. Further exemplary, for an image including text, a table and invoice information, the suspected types of the object to be scanned may include: a book, a table and an invoice.

[0046] In some embodiments, the image to be processed may be a target image that needs to be processed at the current time, or a non-target image that does not need to be processed at the current time. Among them, the target image is an image that needs to be scanned and processed at the current time, and the non-target image is an image that does not need to be scanned and processed at the current time. Exemplarily, the image to be processed is an image obtained by recognition based on the image acquisition module of the electronic device. Since the electronic device may move during the preview process, the object recognized by the image acquisition module may change accordingly, thereby causing the image recognized by the image acquisition module when executing the scanning function to be different from the image recognized during the preview.

[0047] In some embodiments, after acquiring the image to be processed, the processing module of the electronic device (e.g., mobile terminal) can call image recognition technology to recognize the image, thereby determining the type of the object to be scanned. At this time, since the recognized type has not been confirmed by the user, the recognized type at this time is the aforementioned suspected type.

[0048] Taking the electronic device as a mobile terminal as an example, in some embodiments, the mobile terminal can identify the image to be processed locally and determine the suspected type. In other embodiments, the mobile terminal can send the image to be processed to a server and receive the suspected type identified by the server.

[0049] In some embodiments, optical character recognition (OCR) may be used to recognize text in an image, and the suspected type of the object to be scanned may be determined by keyword matching.

[0050] In some instances, the image to be processed is input into an artificial intelligence model (e.g., a deep learning model) to obtain a suspected type of the artificial intelligence model output. Exemplarily, the deep learning model may include but is not limited to various neural networks, such as convolutional neural networks (CNN) and recurrent neural networks (RNN).

[0051] In some embodiments, distribution information (eg, spacing and / or format) between different parts of the object to be scanned is determined by image recognition technology, and the suspected type of the object to be scanned is determined based on the distribution information.

[0052] In some embodiments, the outline of the object to be scanned is extracted by image recognition technology, and the suspected type of the object to be scanned is determined based on the extracted outline.

[0053] In some embodiments, the suspected type of the object to be scanned includes, but is not limited to, at least one of the following: books, documents, certificates, express delivery slips, bills, physical objects, emails, and test papers.

[0054] In some embodiments, files can be further divided according to file type, which may include but is not limited to at least one of the following: presentation files, document files, spreadsheet files; among which presentation files may include but are not limited to PowerPoint presentations (PPT documents, also called PPT documents).

[0055] In some embodiments, the files may be further divided according to the file content, which may include but is not limited to at least one of the following: contract documents, agreement documents, general notices, and important notices.

[0056] In some embodiments, the express delivery notes may be further differentiated according to the express delivery company or the express delivery note format.

[0057] In some embodiments, the document may include, but is not limited to, an invoice, a receipt, a bill of exchange, a receipt note, and the like.

[0058] In some embodiments, the image acquisition module may be a two-dimensional (2D) camera and / or a three-dimensional (3D) camera, wherein the 3D camera may include but is not limited to various depth cameras.

[0059] In some embodiments, based on the depth information collected by the depth camera, it can be determined whether the object to be scanned is a physical object, and the type of the physical object can be determined based on the outer contour of the physical object, for example, a cup, pen holder, calendar, pen, seal, electronic product, etc.

[0060] After determining the suspected type of the object to be scanned, one or more first controls may be displayed to facilitate the user to input an operation for the first control to determine the confirmed type of the object to be scanned. In some embodiments, the confirmed type is the type of the object to be scanned determined by the user. In other embodiments, the confirmed type is the type of the object to be scanned determined according to the first operation.

[0061] In some embodiments, displaying at least one first control on the first page includes:

[0062] Displaying a first area of ​​the object to be scanned on the first page and displaying at least one first control;

[0063] A fourth control for executing a scanning function is displayed in a second area on the first page; wherein the first area and the second area are located at different positions of the first page respectively.

[0064] Here, the first page includes a first area and a second area. The first area may be an image display area. The second area may be a control area, such as the control area may include: an acquisition control area and / or a scanning control area. Exemplarily, the first area is used to display an image to be processed. Also exemplarily, the first area is also used to display at least one first control. The second area is used to display a fourth control; the fourth control is used to detect an operation to execute a scanning function. Among them, executing the scanning function is distinguished from the aforementioned triggering scanning function. If an operation for executing the scanning function is detected, the image to be scanned (distinguished from the preview image) is formally acquired, and the scanning function is executed on the image.

[0065] In some embodiments, the first control may be displayed in a stacked manner in the first area. Figure 3 As shown, the first control can be displayed in a stacked manner on the image to be processed. Figure 3 The first page shown has two first controls, “Books” and “PPT”.

[0066] Exemplarily, the first control may be displayed in a semi-transparent overlay in the first area. That is, at least one first control is displayed according to the suspected type of the object to be scanned, including: displaying the first control in a superimposed manner on the image to be processed in the first area according to the suspected type of the object to be scanned. In this way, the newly introduced first control does not occupy the display position of the first area, and there is no need to modify the display layout of the first area, which has strong compatibility.

[0067] In other embodiments, the first control may be displayed in a semi-transparent stacked manner in the first area. If the first control is displayed in a semi-transparent stacked manner in the first area, on the one hand, the newly introduced first control does not occupy the display position of the first area, and on the other hand, the first control is displayed in a semi-transparent stacked manner in the first area, which will not completely block the image to be processed displayed in the first area. Exemplarily, at least one first control is displayed semi-transparently on top of the image to be processed. Also exemplarily, the transparency of the semi-transparent first control may be 30% to 70%.

[0068] In some other embodiments, at least one first control may be directly displayed on the first page. Exemplarily, at least one first control may be displayed at any position on the first page.

[0069] In other embodiments, at least one first control is displayed on a pop-up window or a drop-down menu of the first page.

[0070] In some embodiments, the first control includes one of: a single-level control and a multi-level control.

[0071] In some embodiments, the first control is a multi-level control; in response to an operation acting on at least one of the first controls, determining the confirmed type of the object to be scanned includes:

[0072] In response to detecting an operation acting on a target control in at least one multi-level control, displaying a sub-control linked to the target control on the first page; wherein the multi-level control corresponds to a first-level classification of the suspected type; the sub-control corresponds to an n-level classification of the suspected type; and n is greater than or equal to 2;

[0073] Based on the operation performed on the child control, the confident type of the object to be scanned is determined.

[0074] Here, the multi-level control corresponds to a first-level classification of the suspected type; the multi-level control is linked to at least one child control; the child control corresponds to an n-level classification of the suspected type; n is greater than or equal to 2.

[0075] In some embodiments, the first level control of the multi-level control displays the first level classification of the suspected type. The next level or multiple levels of sub-controls of the multi-level control are associated with the second level or multiple levels of classification under the first level classification. For example, "file" is used as the first level control of the multi-level control. "Contract" can be used as the second level sub-control of the multi-level control of the file. After the operation of the first level control is detected, the second level sub-control or the third level sub-control can be displayed step by step to facilitate the user to determine the confirmed type. Figure 4 The figure shows a multi-level control. For example, a "bill" control 401 is first displayed on the first page, and after an operation acting on the "bill" control is detected, sub-controls 402 such as "invoice" and "bill of exchange" are displayed.

[0076] In the embodiment of the present disclosure, by setting the first control as a multi-level control, multi-level classification of suspected types is achieved, and then more suspected types can be selected through the multi-level control, which can improve the refined processing of the image and thus improve the accuracy of the obtained scanning results.

[0077] In some embodiments, the first control is a single-level control; in response to an operation acting on at least one of the first controls, determining the confirmed type of the object to be scanned includes:

[0078] Determining a confirmed type of the object to be scanned based on an operation acting on at least one single-level control;

[0079] Among them, the single-level control corresponds to the m-level classification of the suspected type; m is a positive integer; when the suspected type has multiple levels of classification, the m-level classification is the lowest level classification in the multiple levels of classification.

[0080] In some embodiments, the first control may be a single-level control. Figure 3 The controls represented by the “book” control 301 and / or the “PPT” control 302 are single-level controls.

[0081] Exemplarily, a single-level control may correspond to a secondary classification, a tertiary classification, or a quaternary classification of a suspected type. A single-level control may be used directly to determine the type of the object to be scanned. In some embodiments, when the suspected type has a single-level classification, the single-level control corresponds to the primary classification of the suspected type. In other embodiments, when the suspected type has multiple levels of classification, the single-level control corresponds to the m-level classification of the suspected type, and the m-level classification may be the lowest level classification in the multiple levels of classification of the suspected type. In other embodiments, the m-level classification may also be determined from the multiple levels of classification of the suspected type based on other methods. For example, the m-level classification may be determined from the multiple levels of classification of the suspected type based on the user's usage habit parameters.

[0082] In the disclosed embodiment, by setting the first control as a single-level control, the most detailed suspected classification can be directly presented to the user in the form of a single-level control. The user does not need to perform multiple operations, which can improve the intelligence of image processing and simplify the more redundant steps in the scanning process.

[0083] In some embodiments, the first control may be used to identify the suspected type, for example, the first control may include an identification of the suspected type. For example, the suspected type may include: a graphic mark and / or a text mark of the suspected type. Figure 3 As shown, after the object to be scanned is identified, the first page may display: graphic marks and text marks of books, as well as graphic marks and text marks of PPT. Using image marks and / or text marks related to the suspected type to mark the first control can improve the readability of the interface and facilitate user understanding and operation.

[0084] In other embodiments, the configuration of the first control may also be flexibly configured as required, and is not limited to the above examples. In short, the first control may be used to detect a user operation of a certain type.

[0085] In response to an operation on at least one first control, a confirmed type of the object to be scanned can be determined, and a second page corresponding to the confirmed type can be displayed. Here, the second page is a page for processing the object to be scanned, which is different from the first page. In some embodiments, different suspected types can correspond to different second pages.

[0086] For example, Figure 3 After the preview image is identified, the suspected types are determined to be "book" and "PPT". The confirmed type is determined from the suspected types. For example, the suspected type is determined based on the image to be processed, and then the confirmed type is determined based on the selection operation acting on the suspected type. Therefore, it is equivalent to the image to be processed being used for the suspected type and / or the confirmed type. The confirmed type can be determined in combination with the operation acting on at least one first control.

[0087] In some embodiments, when the operations acting on the first control are different, the determined confirmation types are different, and the second pages corresponding to the different confirmation types are different.

[0088] Exemplarily, the second page corresponding to different confidence types contains different second controls. Also exemplarily, the second pages corresponding to different confidence types can implement different processing functions. Again exemplarily, the second pages corresponding to different confidence types execute different processing functions by default. For example, for a paper document as the confidence type, considering the need to convert paper documents to electronic archives, the second page may perform a shadow removal operation on the document image by default to improve the accuracy of electronic archiving of paper documents. The function executed by default on the second page may be set with a corresponding second control or without a corresponding control. In the case where the second page does not have a second control that triggers the default execution of the processing function, it is equivalent to entering the automatic execution function of the second page.

[0089] In some embodiments, the second page includes at least one second control; the at least one second control is generated based on the confirmed type. The second control is related to the processing of the to-be-scanned object of the confirmed type.

[0090] In some embodiments, the second page may be a dedicated page for information processing for the confirmed type. Exemplarily, the second page may be a dedicated page for image processing and / or text processing for the confirmed type. In some embodiments, one or more second controls are displayed on the second page. The second control can be used to implement any processing for the confirmed type.

[0091] In some embodiments, based on the operation acting on the second page corresponding to the confirmed type, performing processing on the object to be scanned includes:

[0092] Based on the operation acting on at least one second control, performing a process corresponding to the operation acting on the at least one second control on the object to be scanned;

[0093] Each second control has a corresponding processing function, and a processing parameter of the processing function is related to the confirmation type.

[0094] Here, when an operation acting on at least one second control is detected, the processing corresponding to the operation acting on at least one second control can be performed on the object to be scanned, because each second control has a corresponding processing function, and the processing parameters of each processing function are related to the confirmation type. In this way, the processing function corresponding to the confirmation type can be implemented for the object to be scanned based on each second control. The processing function for the object to be processed can be accurately matched to the confirmation type, so that the user can perform corresponding processing on the object to be scanned through the second page, which will further rationalize the processing of the object to be scanned.

[0095] In some embodiments, taking the confirmed type as a test paper as an example, the test paper image can be automatically processed for interference removal on the second page. For example, by image cropping or interference blocking operations, the test paper image is retained to the maximum extent. Since the confirmed type is a test paper, the second page is also provided with a second control, which is used to detect whether the AI ​​model scoring function is started.

[0096] In some embodiments, the confirmed types are books and certificates, respectively. Considering the multi-page property of books, an image acquisition control is provided on the second page corresponding to the book to perform book acquisition. For another example, taking a book as an example, the relative position between the book and the device can be determined based on the first page, and the acquisition angle and / or acquisition direction of the image acquisition module can be determined to complete the acquisition of images of different book pages with the highest possible quality.

[0097] In some embodiments, taking the ID card as an example, the second page supports the functions of extracting the ID card number and address. Taking the ID card as an example, the second page can also support content analysis of the ID card image and / or layout analysis between different contents to achieve functions such as preliminary verification of the ID card. For another example, taking the confirmed type as an invoice as an example, in the scenario where multiple invoices are scanned continuously, the second page supports the functions of continuous invoice scanning, amount extraction, invoice information recording, amount statistics, etc., while these functions are not supported on the second page of books and / or ID cards.

[0098] In some embodiments, based on the operation acting on at least one second control, performing a process corresponding to the operation acting on the at least one second control on the object to be scanned includes:

[0099] In response to a first operation on a second control having an image acquisition function, determining an acquisition parameter based on the confirmed type;

[0100] Capturing an image of the object to be scanned based on the acquisition parameters to obtain a first image;

[0101] In a case where a second operation of a second control acting on a confirmation function is detected, a first scanning result is generated based on the first image.

[0102] Here, when a first operation on a second control having an image acquisition function is detected, an acquisition parameter can be determined based on the confidence type, and then an image acquisition is performed on the object to be scanned based on the acquisition parameter to obtain a first image. Here, the acquisition parameter for the object to be scanned can be associated with the confidence type, and different confidence types correspond to different acquisition parameters.

[0103] Exemplarily, if the confirmed type is a certificate, in order to ensure that the captured image of the certificate can show the original appearance of the certificate as completely and accurately as possible, the first image can be captured by setting specific capture parameters.

[0104] In some embodiments, the acquisition parameters may include but are not limited to at least one of the following parameters: image resolution, focal length of image acquisition, aperture size, acquisition posture of the device when acquiring images, camera used for image acquisition, viewfinder of image acquisition, acquisition mode, viewing angle of image acquisition and other acquisition-related parameters.

[0105] Taking the confirmed type as books as an example, the collection parameter may include the collection posture of the electronic device. By setting the collection posture of the device and adjusting the posture of the electronic device through prompt information, books can be better collected.

[0106] Taking the confirmed type as an ID card as an example, the acquisition parameters may include a framing frame or an acquisition viewing angle, for example, limiting the acquisition of the ID card image to the front viewing angle, or displaying the framing frame on the second page and prompting the user to place the ID card at a specific position of the image acquisition module so that the ID card image is exactly within the framing frame to ensure the acquisition quality of the first image.

[0107] In some embodiments, when the second page performs image acquisition, one or more first images are acquired with acquisition parameters of the confirmed type. Thus, illustratively, after an image is acquired in the viewfinder of the second page and an operation acting on the "image acquisition control" in the second control is detected, the currently acquired image is stored as the first image. For example, the currently acquired image is stored in a storage directory that has a mapping relationship with the confirmed type.

[0108] In other embodiments, the image acquisition control may include a first acquisition control, and when the operation of the first acquisition control is detected for the first time, the acquisition of the first image is started. When the operation acting on the first acquisition control is detected again after the first image acquisition is started, the acquisition of a first image is completed, and the acquired first image is stored in a corresponding storage directory.

[0109] In other embodiments, the image acquisition control may include a first acquisition control and a second acquisition control. If an operation acting on the first acquisition control is detected, the acquisition of a first image is started; if an operation acting on the second acquisition control is detected, the acquisition of a first image is completed.

[0110] Exemplarily, when it is confirmed that the type is a book, the dedicated page for book imaging processing (i.e., the second page) is entered to capture one or more first images of the book. For example, an operation acting on the first capture control is detected, and the capture of the book is started. During the capture process, the operation acting on the first capture control is detected again, and it is determined that the capture of the first image of a book page is completed. This makes it convenient for the user to control the capture process of the first image. Exemplarily, it is convenient for the user to have time to perform operations such as turning pages of the book.

[0111] Exemplarily, when it is confirmed that the type is a book, the dedicated page for book imaging processing (i.e., the second page) is entered to collect one or more first images of the book. For example, an operation acting on the first acquisition control is detected, and the acquisition of the book is started. During the acquisition process, an operation acting on the second acquisition control is detected, and the acquisition of a first image of the book is completed. This makes it convenient for the user to control the acquisition process of the first image. Exemplarily, it is convenient for the user to have time to perform operations such as turning pages of the book.

[0112] In some embodiments, when a second operation acting on a second control with a confirmation function is detected, a first scan result is generated based on the first image. For example, after the first image is generated, it can be detected whether there is a second operation acting on a second control with a confirmation function. If the second operation (e.g., a save operation) is detected, a first target file (i.e., a first scan result) to be exported can be generated based on the first image, and the first target file can be exported as the first scan result. Exemplarily, after the first target file is generated, an exportable format (e.g., Excel, PDF, image) and the like can be displayed, and the user can select an export format, and after determining the export format, the first target file is exported according to the export format.

[0113] In the embodiment of the present disclosure, when the first operation is detected, the acquisition parameters can be determined based on the confidence type, and the image of the object to be scanned can be acquired based on the acquisition parameters to obtain the first image, and when the second operation is detected, the first scanning result can be generated based on the first image. By associating the acquisition parameters with the confidence type and acquiring the image of the object to be scanned based on the acquisition parameters corresponding to the confidence type, a more accurate first image can be obtained, thereby improving the accuracy and display effect of the first scanning result.

[0114] In some embodiments, at least one second control includes an image processing control for the confirmed type; the method further includes: in the event that an operation acting on the image processing control is detected, processing the first image based on processing parameters of the confirmed type.

[0115] In some embodiments, the method also includes: when a third operation acting on a second control having an image processing function is detected, determining processing parameters based on the confirmation type; processing the first image based on the processing parameters to obtain a second image; and when a fourth operation acting on the second control having a confirmation function is detected, generating a second scanning result based on the second image.

[0116] Here, when a third operation on a second control having an image processing function is detected, a processing parameter can be determined based on the confidence type, and then the first image is processed based on the processing parameter to obtain a second image. Here, the processing parameter for the first image can be associated with the confidence type, and different confidence types correspond to different processing parameters.

[0117] Exemplarily, the processing parameters here may include parameters for processing the first image. For example, if the confirmed type is a book, the parameters for image processing of the first image of the book may include: parameters for curvature correction. For example, if the confirmed type is a certificate, the parameters for image processing of the first image of the certificate are based on restoring the information on the certificate as much as possible, and the processing parameters may include parameters mainly for increasing the clarity of the image. For another example, if the confirmed type is a file, the dirt on the file needs to be removed. At this time, the processing parameters of the confirmed type are the operating parameters of the image filter for removing dirt, etc. Of course, the above are just examples. In specific implementations, the processing parameters of the confirmed type are related to the purpose of the confirmed type and / or the scanning purpose of this image. Exemplarily, the scanning purpose of this image can be received through (User Interface, UI), etc.

[0118] In some embodiments, the image processing herein may include but is not limited to at least one of the following:

[0119] Image correction processing; for example, perspective correction, curvature correction and other image distortion corrections; image distortion correction can also include image color distortion correction. For example, when capturing an image of a contract with a signature, the color of the contract seal needs to be restored to the original color as much as possible, and image color distortion correction will also be performed at this time;

[0120] Image cropping and scaling: image cropping and scaling processes make the second image highlight the image content of the object to be scanned, for example, cropping the image of the interfering object, enlarging the image of the object to be scanned, etc.;

[0121] Image recognition processing, in some embodiments, recognizing the first image to obtain image content, for example, recognizing text in the first image to obtain recognized text;

[0122] Correction processing of recognized text. Errors may occur during text recognition. In this case, text correction is performed based on the context to reduce content recognition errors.

[0123] Image filter processing: Image filter processing can remove problems such as overexposure, underexposure, reflection, or dirt;

[0124] Designated type of imaging removal processing; illustratively, the designated type may include but is not limited to the removal of handwriting on a page.

[0125] Archiving processing, exemplarily, stores the first image in a storage directory corresponding to the confirmed type.

[0126] In some embodiments, the image that can be processed on the second page is not limited to the first image, and may also include an image to be processed collected on the first page, etc.

[0127] In some embodiments, when a fourth operation of a second control having a confirmation function is detected, a second scan result is generated based on the second image. For example, after the second image is generated, it can be detected whether there is a fourth operation acting on the second control having a confirmation function. If the fourth operation (e.g., a save operation) is detected, a second target file (level, second scan result) to be exported can be generated based on the second image, and the second target file can be exported as the second scan result. Exemplarily, after the second target file is generated, an exportable format (e.g., Excel, PDF, image) and the like can be displayed, and the user can select the export format, and after determining the export format, the second target file is exported according to the export format.

[0128] In the embodiment of the present disclosure, when the third operation is detected, the processing parameters can be determined based on the confidence type, and the first image can be processed based on the processing parameters to obtain the second image, and when the fourth operation is detected, the second scan result can be generated based on the second image. By associating the processing parameters with the confidence type and processing the first image based on the processing parameters corresponding to the confidence type, a more accurate second image can be obtained, thereby improving the accuracy and display effect of the second scan result.

[0129] In some embodiments, the method further comprises:

[0130] In response to entering a second page corresponding to the confirmed type, determining whether the object to be scanned currently identified by the image acquisition module is of the confirmed type;

[0131] Based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned, including:

[0132] In the case that the object to be scanned currently identified by the image acquisition module is of a confirmed type, processing is performed on the object to be scanned based on the operation acting on the second page corresponding to the confirmed type.

[0133] Here, when the image of the object to be scanned is acquired when the second page is displayed, it can be determined whether the object to be scanned currently identified by the image acquisition module is of the confirmed type. If the object to be scanned currently identified by the image acquisition module is of the confirmed type, the processing for the object to be scanned is performed based on the operation acting on the second page corresponding to the confirmed type. Here, the currently identified object to be scanned is the object identified on the second page (processing page), which is distinguished from the object identified on the first page (preview page).

[0134] For example, the electronic device may move during use. During the movement, an object of an unsure type may enter the capture angle of view or the viewfinder of the image capture module.

[0135] In the disclosed embodiment, before executing the processing for the object to be scanned, the currently identified object to be scanned is confirmed again. When it is determined that the object to be scanned currently identified by the image acquisition module is of a confirmed type, the processing for the object to be scanned is executed based on the operation acting on the second page corresponding to the confirmed type, which can improve the accuracy of the object to be scanned.

[0136] In some embodiments, when the object to be scanned currently identified by the image acquisition module is not of a confirmed type, the method further includes:

[0137] Control the image acquisition module to continue identifying the object to be scanned until an object to be scanned of a confirmed type is identified; or,

[0138] Determine an alternative type from the suspected types of the object to be scanned, display a second page corresponding to the alternative type, and perform processing on the object to be scanned based on an operation acting on the second page corresponding to the alternative type; or,

[0139] Based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned.

[0140] In some embodiments, when the object to be scanned currently identified by the image acquisition module is not of a confirmed type, that is, when the second page is preparing to process the object to be scanned, other objects of non-confirmed types enter the acquisition angle of view or viewfinder of the image acquisition module.

[0141] For example, the electronic device is a mobile phone, and the user holds the mobile phone to collect books. During the collection process, the mobile phone may be aimed at objects other than books due to holding, or the user may terminate the collection due to temporary interference. In this process, the image acquisition module collects the image of the interference object (interference image), and will not process the interference image, but continue to wait. Not processing the interference image here can be understood as: discarding the interference image, not storing the interference image in the storage directory of the confirmed type, or not processing the interference image with the processing parameters of the confirmed type. The interference image here can be the aforementioned image of the image of the object of the confirmed type.

[0142] In this way, during the acquisition process, interferences such as the movement of the electronic device and the movement of the object to be scanned will cause the processing of the object to be scanned to be terminated, thereby reducing image acquisition or unnecessary image processing of irrelevant non-certain type objects, ensuring the accuracy of acquisition and processing of the object to be scanned on the second page of the certain type, and improving the intelligence of the electronic device.

[0143] In some embodiments, in order to assist in image acquisition of the object to be scanned, considering that the image needs to be acquired with specific acquisition parameters, auxiliary lines are displayed on the second page, and the auxiliary lines can be used to improve the scanning effect of the object to be scanned. For example, the auxiliary lines can be arranged horizontally and vertically to facilitate the user to adjust the posture of the electronic device so that the object to be scanned does not have unnecessary perspective and / or deformation in the first image. Figure 2 The thin horizontal and vertical white lines shown overlaid on the invoice image are an example of auxiliary lines.

[0144] In other embodiments, when the object to be scanned currently identified by the image acquisition module is not a confirmed type, an alternative type may be determined from the suspected types of the object to be scanned. For example, the attribute information of the currently identified object to be scanned may be determined, and the alternative type may be determined from the suspected types of the object to be scanned. For another example, the front suspected type may be determined as the alternative type, wherein the front suspected type may be a type among the suspected types whose similarity with the confirmed type is greater than a preset threshold.

[0145] In some embodiments, determining the candidate type from the suspected types of the object to be scanned includes:

[0146] Displaying at least one third control on the second page corresponding to the confirmed type according to the suspected type of the object to be scanned;

[0147] Based on an operation performed on at least one third control, an alternative type is determined.

[0148] Here, when the object to be scanned currently identified by the image acquisition module is not of the confirmed type, at least one third control can be displayed on the second page corresponding to the confirmed type according to the suspected type of the object to be scanned, and the alternative type can be determined based on the operation acting on the at least one third control.

[0149] In this way, the user can determine the alternative type from the suspected type through the third control, and by combining the user's usage parameters, the accuracy of the determined alternative type can be improved. In some embodiments, the operation acting on at least one third control can be a selection operation for the at least one third control. For example, if the user selects any third control, the suspected type corresponding to the third control can be determined as the alternative type.

[0150] In some embodiments, at least one third control may be displayed on the second page of the confirmed type, and when an alternative type is determined based on an operation acting on at least one third control, the page may be jumped from the second page corresponding to the confirmed type to the second page corresponding to the alternative type. In other embodiments, the page may be jumped from the second page corresponding to the confirmed type to the first page first, and at least one third control may be displayed on the first page, and when an alternative type is determined based on an operation acting on at least one third control, the page may be jumped from the first page to the second page corresponding to the alternative type.

[0151] After the candidate type is determined, the second page corresponding to the candidate type can be displayed, and based on the operation on the second page corresponding to the candidate type, the processing of the object to be scanned is performed. In this way, during the movement of the electronic device and the movement of the object to be scanned, the corresponding candidate type can be determined in real time, and the object to be scanned can be collected and processed on the second page of the candidate type. The processing of the object to be scanned does not need to be suspended, which can ensure the continuity of processing the object to be scanned and improve the intelligence of the electronic device.

[0152] In other embodiments, when the object to be scanned currently identified by the image acquisition module is not of the confirmed type, processing is performed on the object to be scanned based on operations acting on the second page corresponding to the confirmed type.

[0153] Exemplarily, when it is detected that an object that is not of a confirmed type is determined to be of a confirmed type, the processing of the object to be scanned can continue. For example, during the preview of the first page, the confirmed type is determined to be a book, and during the processing of the second page, the type of the object to be processed is identified as an invoice, not a book, and the invoice is confirmed to be a type that needs to be entered. At this time, the invoice can also be processed according to the acquisition parameters or processing parameters of the book.

[0154] In this way, when it is detected that an object that is not of a confirmed type is determined to be of a confirmed type, the processing of the object to be scanned can continue to be executed without being terminated, thereby ensuring the continuity of processing the object to be scanned and improving the intelligence of the electronic device.

[0155] In some embodiments, at least one second control includes an image processing control for the confirmed type, and the method further includes: detecting an operation acting on the image processing control, and performing image processing on the image of the object to be scanned of the confirmed type. Since the second control is a control set according to the confirmed type, the second pages of different confirmed types have different second controls, and / or the distribution positions of the second controls are different.

[0156] In some embodiments, the image processing includes at least one of the following: image correction processing; image cropping, scaling, rotation text correction processing; image filter processing; specified type of imaging removal processing; text correction processing; archiving processing.

[0157] In some other embodiments, the second page is a user interface. The second page may include one or more second controls. The second controls may be used to detect user operations to perform processing corresponding to the confirmed type.

[0158] In some embodiments, the second page may be an image acquisition page that supports special image acquisition. Figure 3 As shown, the confirmed type of the object to be scanned is identified as a book. Considering that a book will present two pages when opened, when collecting the written content of the book, two cameras can be used to collect two adjacent pages of the book based on multiple cameras supporting one collection operation. Figure 3 The "Single Page" and "Double Page" controls in the second page can be unique second controls displayed according to the book. The two controls "Single Page" and "Double Page" can correspond to different acquisition modes of the image acquisition module.

[0159] In some embodiments, the second page may be a page for editing or other processing of the image to be processed.

[0160] In some embodiments, the second page may display one or more image editing controls, text editing controls, and / or file editing controls.

[0161] In some embodiments, the second page may also display one or more controls for processing the correction image or the first file. The correction image may be an image generated after performing one or more first operations on the image to be processed. The first file may be a file generated after performing one or more first operations on the image to be processed, including but not limited to a text file, a table file, a web page file, etc.

[0162] On the second page corresponding to the book, one or more second controls related to book scanning will be displayed. Exemplarily, one second control may correspond to one first operation.

[0163] In some embodiments, the processing for the confirmed type on the second page may include but is not limited to at least one of the following: performing image cropping, scaling, and rotation processing that is compatible with the confirmed type on the second page; performing filter processing that is compatible with the confirmed type on the second page.

[0164] In some embodiments, the image correction process may include any processing of the corrected image. Exemplarily, the image correction process may include, but is not limited to, perspective correction processing, deformation correction processing, noise filtering processing, and light intensity correction (for example, low light increases exposure, and for another example, strong light can reduce overexposure) processing. For example, the image correction process may also include, but is not limited to, perspective correction. After the image to be processed is corrected, a corrected image is obtained, and the corrected image no longer has the perspective effect of the object to be scanned. In some embodiments, when acquiring the image to be processed, due to possible interference from debris, the image can be cropped to the image of the debris. For example, Figure 2 If the invoice is the object to be scanned, the keyboard is the interference or debris, and the image of the interference needs to be cropped out.

[0165] In some embodiments, the electronic device will automatically identify the object to be scanned. Generally, the object to be scanned may be the main object in the image to be processed. The main object may usually be located in the central area of ​​the image and / or occupy the largest imaging area and / or be selected based on the selection process. In some embodiments, unnecessary background may be cropped by cropping the image.

[0166] In some embodiments, the second page can also be used to perform one of the following processes: marking process, elimination process and handwriting conversion process. The marking process can be used to mark content. For example, the marking process can be adapted to the confirmation type, or it can be a common process for different confirmation types. For example, taking the invoice as an example, the marking process can be automatic marking or based on user input of the marking amount, taxpayer identification information or invoice code and other information. There are many ways of marking, specifically using various marking patterns or annotations.

[0167] In some embodiments, the elimination process may include but is not limited to at least one of the following: automatically eliminating private information or eliminating designated information based on input processing. In some embodiments, the elimination process may be a process adapted to the confirmed type, or may be a process common to multiple types.

[0168] In some embodiments, if there are handwritten notes on the object to be scanned, the handwritten text can be converted into written text of the electronic device automatically or based on an input operation.

[0169] In some embodiments, for example, since the scanning recognition is a book scan, there is a book spine, which may cause the different words of the book in the captured image to be arranged in a curved manner, which may introduce a reading experience after the book is recorded. Therefore, a deformation correction control can be introduced. The deformation correction control can be used for various bending corrections. The bending correction at this time is a type of the aforementioned first processing.

[0170] In some embodiments, assuming that the object to be scanned is identified as an ID card, and based on the first processing, it is determined that the object to be scanned is ID card A, it can be considered that the user wants to capture an image of ID card A. Usually, the actual size of ID card A is known in advance, and at this time, image capture may cause size mismatch due to distance and other reasons. The image size of the captured image of ID card A can be adjusted to the same as the actual size of ID card A after printing through correction and / or scaling.

[0171] In some embodiments, the certificate has a front and a back side, but the orientations of the two sides are inconsistent during collection. For example, the front and back sides of the certificate are reversed. In this case, the front and back sides of the certificate can be aligned in their top and bottom orientations by rotating one of the two images by 180 degrees.

[0172] In some embodiments, the filter processing is a kind of beautification processing adapted to the type of the image. Exemplarily, the filter processing can be implemented by adding light filtering or adding corresponding light to achieve the filter processing, so that the image to be processed is beautified.

[0173] In some embodiments, the object to be scanned is a certificate. When scanning, the certificate reflects light and a reddish or greenish halo appears. At this time, a filter is added to correct the halo so that the corrected image is restored to the original color of the certificate.

[0174] In some embodiments, if the object to be scanned is a physical object, the number of filters that can be added may be greater than the number of filters when the object to be scanned is a contract. For example, contracts are usually single-color, and generally no other colors are allowed except for the signature. For example, a yellowish, reddish, or greenish filter may not be added to the image of the contract, so that the image to be processed of the contract has a red background, a yellow background, or a green background.

[0175] In some embodiments, processing adapted to the confirmed type is automatically performed on the second page. For example, if it is detected that the image to be processed and / or the second image require correction processing and / or beautification processing such as cropping and / or rotation, the corresponding processing can be automatically performed after jumping to the second page, and the corrected image obtained after the first processing is displayed on the second page. In which way, the second processing can be omitted to improve the efficiency of correction and / or beautification of the image to be processed.

[0176] In some embodiments, a history processing window is displayed on the second page to facilitate the user to cancel one or more history processing based on the history processing window, and / or adjust the execution order of one or more history processing, thereby adjusting the image effect of the generated corrected image.

[0177] Of course, the above is only an example of processing the object to be scanned, and the specific implementation is not limited to the above example.

[0178] In some embodiments, the processing of the object to be scanned includes: image processing and / or text processing; the image processing and / or text processing is related to a specified purpose; the specified purpose is at least related to the usage of the confirmed type and / or the scanning purpose.

[0179] In some embodiments, the specified purpose may include a purpose pre-set by the user, a purpose set by the application, or a purpose predicted by the AI ​​model based on the type of confidence. For example, if the purpose of a book is for people to read, then the correctness of the book after being digitized should be ensured as much as possible, so the processing related to the reading purpose may include text correction. For another example, taking a certificate as an example, the electronic scanning of the certificate is used for archiving the certificate information and / or identity verification, then the specified purpose of archiving the certificate information and / or identity verification needs to ensure the integrity of the certificate. At this time, it may be necessary to retain the original image information as much as possible in addition to removing interference.

[0180] In the disclosed embodiment, after the confirmed type is determined, a dedicated second page is set according to the purpose of the confirmed type of object to perform image processing and / or text processing to achieve intelligent processing related to the object. In some embodiments, the confirmed type of the object to be scanned is a book, and the processing for the book includes: image processing and / or text processing for the purpose of highlighting the content of the book.

[0181] Exemplarily, the processing of the book image includes at least one of the following: performing bending correction processing on the text line imaging of the book image; performing perspective correction processing on the book image; performing text correction processing on the text lines obtained by book image recognition; performing rotation processing on the book image so that the text imaging in the book image is oriented in a specified direction; performing image scaling processing on the book image so that the image size of the book image is a specified size; and removing processing of handwritten text imaging on the book image.

[0182] In some embodiments, the confirmed type of the object to be scanned is a file, and the processing of the file includes: image processing and / or text processing for the purpose of restoring the file content.

[0183] Exemplarily, the processing of the file includes at least one of the following:

[0184] Filter processing for document images to remove dirty images in the images to be processed;

[0185] The brightness of the document image is adjusted to remove the shadow of the object to be scanned in the image to be processed.

[0186] In some embodiments, the confirmed type of the object to be scanned is a certificate, and the processing of the certificate includes: image processing and / or text processing for the purpose of ensuring the accuracy of the content of the certificate and / or reflecting the original appearance of the certificate.

[0187] Exemplarily, the processing of the certificate includes at least one of the following:

[0188] Image resizing for document imaging;

[0189] Image cropping for ID card imaging;

[0190] Recognition processing for document imaging;

[0191] Correction processing of text for document imaging recognition;

[0192] Authentication of ID card images.

[0193] For example, when document imaging is being archived, there are certain requirements for the image size, and the image size is automatically adjusted at this time.

[0194] For example, when capturing document images, it is hoped that interference imaging can be reduced as much as possible. The cropping operation can reduce unnecessary interference imaging.

[0195] Usually, the certificate information is displayed on the certificate, such as the student ID number of the student ID card and the passport information of the passport. Such information may need to be archived. In the embodiment of the present disclosure, the certificate information in text format can be extracted through image recognition technology and automatically archived.

[0196] In some embodiments, some information is easy to identify errors, such as the number "0" and the letter "O", etc., and text correction is allowed at this time. The second page may provide editing controls for users to modify manually. In some cases, since the type is determined, the automatic error correction function can be used to correct the text and / or image according to the characteristics of the item of the confirmed type.

[0197] For example, the information composition on the certificate is analyzed to verify the authenticity of the certificate. In another example, the electronic device verifies the authenticity of the certificate through information interaction with the server.

[0198] In some embodiments, the confirmed type of the object to be scanned is a bill, and the processing of the bill includes: processing the content of the bill.

[0199] In some embodiments, the bill may include: a bill of exchange, an invoice, a receipt, a bank deposit slip, or other paper bills and / or electronic bills related to the amount.

[0200] In some embodiments, the processing of the bill content includes at least one of the following: numerical extraction processing; numerical statistics processing; numerical recording processing.

[0201] In some embodiments, the image to be processed and / or the first image may be one or more images.

[0202] In some embodiments, the image to be processed and / or the first image may be a plurality of images scanned in batches by the image acquisition module. Exemplarily, the plurality of images may be images of the same object to be scanned. In other embodiments, the image to be processed may be images of different objects to be scanned. In some embodiments, if a plurality of objects to be scanned are scanned, the objects to be scanned may be grouped, and the plurality of images in the same group correspond to the same object to be scanned, for example, all correspond to different B certificates.

[0203] In some embodiments, if the multiple images are images of the same object to be scanned, batch processing of the images is performed at this time, and the multiple images are batch processed on the second page, thereby improving scanning efficiency and simplifying user operations.

[0204] In some embodiments, if the image to be processed is a preview image, and if the first operation is detected, the image to be processed is saved as a formally collected image, and the formally collected image is available for the user to view. If the first operation is not detected, the preview image is discarded.

[0205] In some embodiments, the method further includes: displaying a first prompt. Figure 5 As shown, when displaying the corrected and / or beautified image to be processed, a first prompt 501 is displayed at the same time. The first prompt can be used to prompt which operation to perform on the image to be processed. For details, see Figure 5 The “image has been automatically cropped and a “Smart Filter” should be applied” is displayed to facilitate user processing.

[0206] In some embodiments, an "×" may be displayed adjacent to the first prompt. If it is detected that the "×" is acted upon, it may be considered that the user does not want the device to automatically perform one or more first operations. In this case, the original image of the image to be processed is displayed for the user to edit.

[0207] In order to provide high-quality scanning effects, and provide a rich variety of scenario-based scanning functions, and carry out refined operations for vertical scenarios to meet more segmented needs, the scanning and shooting scene entrances and function settings are reintegrated to provide a wealth of special scene functions and shooting settings.

[0208] In the disclosed embodiment, a "universal scan" function is provided. The words "universal scan" can be used as a text mark of the fourth control. When performing the universal scan, the user does not need to manually select, just open and shoot, and the corresponding filters and functions are automatically recommended according to the type of the object to be scanned in the picture.

[0209] In some embodiments, the method further includes: displaying one or more second controls on the second page, the second controls being used to detect that file-level processing will be performed on the corrected image or the image to be processed.

[0210] Exemplarily, the second control may include a text control, and when an operation acting on the text control is detected, the image to be processed is converted into a text image for storage.

[0211] Exemplarily, the second control may be a compression control, and when an operation acting on the compression control is detected, the file may be compressed or multiple images or corrected images may be compressed into the same compression package. Also exemplarily, the scanned file and the corrected file corresponding to the scanned file may be compressed into the same compression package, so that it is convenient for the user to view the original image and the corrected image.

[0212] like Figure 6 As shown, the embodiment of the present disclosure provides an image processing device 600, which includes:

[0213] The first display module 601 is configured to enter a first page in response to triggering a scanning function, and display the object to be scanned identified by the image acquisition module on the first page;

[0214] A second display module 602 is configured to display at least one first control on the first page according to the suspected type of the object to be scanned;

[0215] The determination module 603 is configured to determine the confirmed type of the object to be scanned in response to the operation acting on the at least one first control, and display a second page corresponding to the confirmed type;

[0216] The processing module 604 is configured to perform processing on the object to be scanned based on the operation acting on the second page corresponding to the confirmed type.

[0217] In some embodiments, the second page corresponding to the confirmation type includes at least one second control; the processing module 604 is configured to:

[0218] Based on the operation acting on the at least one second control, performing a process corresponding to the operation acting on the at least one second control on the object to be scanned;

[0219] Each of the second controls has a corresponding processing function, and a processing parameter of the processing function is related to the confirmation type.

[0220] In some embodiments, the processing module 604 is configured to:

[0221] In response to a first operation on a second control having an image acquisition function, determining an acquisition parameter based on the confidence type;

[0222] Capturing an image of the object to be scanned based on the acquisition parameters to obtain a first image;

[0223] In a case where a second operation of a second control acting on a confirmation function is detected, a first scanning result is generated based on the first image.

[0224] In some embodiments, the apparatus 600 further includes:

[0225] a detection module configured to determine a processing parameter based on the confirmed type when a third operation acting on a second control having an image processing function is detected;

[0226] A first generating module is configured to process the first image based on the processing parameters to obtain a second image;

[0227] The second generating module is configured to generate a second scanning result based on the second image when a fourth operation of the second control acting on the confirmation function is detected.

[0228] In some embodiments, the apparatus 600 further includes:

[0229] a determination module, configured to, in response to entering a second page corresponding to the confirmed type, determine whether the object to be scanned currently identified by the image acquisition module is of the confirmed type;

[0230] The processing module 604 is configured to:

[0231] In the case that the object to be scanned currently identified by the image acquisition module is of the confirmed type, processing is performed on the object to be scanned based on an operation acting on the second page corresponding to the confirmed type.

[0232] In some embodiments, when the object to be scanned currently identified by the image acquisition module is not of the confirmed type, the device 600 further includes:

[0233] A control module is configured to control the image acquisition module to continue identifying the object to be scanned until the object to be scanned of the confirmed type is identified; or,

[0234] a first execution module configured to determine an alternative type from the suspected types of the object to be scanned, display a second page corresponding to the alternative type, and perform processing on the object to be scanned based on an operation acting on the second page corresponding to the alternative type; or

[0235] The second execution module is configured to execute processing on the object to be scanned based on an operation acting on a second page corresponding to the confirmed type.

[0236] In some embodiments, the first execution module is configured to:

[0237] According to the suspected type of the object to be scanned, displaying at least one third control on the second page corresponding to the confirmed type;

[0238] The candidate type is determined based on an operation performed on the at least one third control.

[0239] In some embodiments, the first display module is configured as follows:

[0240] Displaying a first area of ​​the object to be scanned and at least one first control on the first page;

[0241] A fourth control for executing the scanning function is displayed in a second area on the first page; wherein the first area and the second area are located at different positions of the first page respectively.

[0242] In some embodiments, the first control is a multi-level control; the determining module 603 is configured to:

[0243] In response to detecting an operation acting on at least one target control in the multi-level control, displaying a sub-control linked to the target control on the first page; wherein the multi-level control corresponds to a first-level classification of the suspected type; the sub-control corresponds to an n-level classification of the suspected type; and n is greater than or equal to 2;

[0244] Based on the operation acting on the sub-control, the confirmed type of the object to be scanned is determined.

[0245] In some embodiments, the first control is a single-level control; the determining module 603 is configured to:

[0246] Determining the confirmed type of the object to be scanned based on an operation acting on at least one of the single-level controls;

[0247] Among them, the single-level control corresponds to the m-level classification of the suspected type; m is a positive integer; in the case that the suspected type has multiple levels of classification, the m-level classification is the lowest level classification in the multiple levels of classification.

[0248] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0249] Based on the same inventive concept, an embodiment of the present disclosure further provides an electronic device,

[0250] The electronic device may be a computer or a terminal in one or more of the above embodiments. Figure 7 FIG. 1 is a schematic diagram showing the structure of an electronic device according to an exemplary embodiment. Figure 7 As shown, the electronic device 700 adopts general computer hardware and includes a processor 701 , a memory 702 , a bus 703 , an input device 704 , and an output device 705 .

[0251] In some possible implementations, the memory 702 may include computer storage media in the form of volatile and / or non-volatile memory, such as read-only memory and / or random access memory. The memory 702 may store an operating system, application programs, other program modules, executable code, program data, user data, etc.

[0252] Input device 704 can be used to input commands and information to the electronic device, such as a keyboard or a pointing device, such as a mouse, trackball, touch pad, microphone, joystick, game pad, satellite TV antenna, scanner or similar device. Input device 704 can be connected to processor 701 via bus 703.

[0253] The output device 705 can be used to output information to the electronic device 700 . In addition to the monitor, the output device 705 can also be other peripheral output devices, such as a speaker and / or a printing device. The output device 705 can also be connected to the processor 701 via the bus 703 .

[0254] The electronic device 700 may be connected to a network, such as a local area network (LAN), via the antenna 706. In a networked environment, executable instructions may be stored in a remote storage device, rather than being limited to local storage.

[0255] When the processor 701 in the electronic device 700 executes the executable code or application stored in the memory 702, the electronic device 700 can implement the image processing method in the above embodiments. The specific execution process refers to the above embodiments and will not be repeated here.

[0256] The memory 702 may store information for implementing Figure 6The executable instructions of the functions of the first display module 601, the second display module 602, the determination module 603 and the processing module 604. Figure 6 The functions / implementation processes of the first display module 601, the second display module 602, the determination module 603 and the processing module 604 can be realized by Figure 7 The processor 701 in the embodiment calls the executable instructions stored in the memory 702 to implement the above-mentioned implementation process and functions.

[0257] Based on the same inventive concept, the embodiment of the present disclosure further provides a storage medium, in which instructions are stored, and when the instructions are executed on a computer, the image processing method in one or more of the above embodiments is executed.

[0258] Based on the same inventive concept, the embodiments of the present disclosure further provide a computer program or a computer program product. When the computer program product is executed on a computer, the computer implements the image processing method in one or more of the above embodiments.

[0259] Those skilled in the art will readily appreciate other embodiments of the disclosed embodiments after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosed embodiments, which follow the general principles of the disclosed embodiments and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the disclosed embodiments are indicated by the following claims.

[0260] It should be understood that the embodiments of the present disclosure are not limited to the precise structures described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the embodiments of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that: The method comprises: In response to triggering the scanning function, entering a first page, and displaying the object to be scanned identified by the image acquisition module on the first page; Displaying at least one first control on the first page according to the suspected type of the object to be scanned; In response to the operation of the at least one first control, determining the confirmed type of the object to be scanned, and displaying a second page corresponding to the confirmed type; Based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned.

2. The method according to claim 1, characterized in that The second page corresponding to the confirmation type includes at least one second control; the processing of the object to be scanned based on the operation acting on the second page corresponding to the confirmation type includes: Based on the operation acting on the at least one second control, performing a process corresponding to the operation acting on the at least one second control on the object to be scanned; Each of the second controls has a corresponding processing function, and a processing parameter of the processing function is related to the confirmation type.

3. The method according to claim 2, characterized in that The performing, based on the operation acting on the at least one second control, processing corresponding to the operation acting on the at least one second control on the object to be scanned comprises: In response to a first operation on a second control having an image acquisition function, determining an acquisition parameter based on the confidence type; Capturing an image of the object to be scanned based on the acquisition parameters to obtain a first image; In a case where a second operation of a second control acting on a confirmation function is detected, a first scanning result is generated based on the first image.

4. The method according to claim 3, characterized in that The method further comprises: In case a third operation acting on a second control having an image processing function is detected, determining a processing parameter based on the confidence type; Processing the first image based on the processing parameters to obtain a second image; In the case where a fourth operation acting on a second control of the confirmation function is detected, a second scanning result is generated based on the second image.

5. The method according to claim 1, characterized in that The method further comprises: In response to entering a second page corresponding to the confirmed type, determining whether the object to be scanned currently identified by the image acquisition module is of the confirmed type; The performing of processing on the object to be scanned based on the operation acting on the second page corresponding to the confirmed type includes: In the case that the object to be scanned currently identified by the image acquisition module is of the confirmed type, processing is performed on the object to be scanned based on an operation acting on the second page corresponding to the confirmed type.

6. The method according to claim 5, characterized in that In the case where the object to be scanned currently identified by the image acquisition module is not of the confirmed type, the method further includes: Controlling the image acquisition module to continue identifying the object to be scanned until the object to be scanned of the confirmed type is identified; or, Determine an alternative type from the suspected types of the object to be scanned, display a second page corresponding to the alternative type, and perform processing on the object to be scanned based on an operation acting on the second page corresponding to the alternative type; or, Based on the operation acting on the second page corresponding to the confirmed type, processing is performed on the object to be scanned.

7. The method according to claim 6, characterized in that The determining of the candidate type from the suspected types of the object to be scanned includes: According to the suspected type of the object to be scanned, displaying at least one third control on the second page corresponding to the confirmed type; The candidate type is determined based on an operation performed on the at least one third control.

8. The method according to any one of claims 1 to 7, characterized in that: The displaying at least one first control on the first page includes: Displaying a first area of ​​the object to be scanned and at least one first control on the first page; A fourth control for executing the scanning function is displayed in a second area on the first page; wherein the first area and the second area are located at different positions of the first page respectively.

9. The method according to any one of claims 1 to 7, characterized in that: The first control is a multi-level control; The determining, in response to the operation acting on the at least one first control, the confirmed type of the object to be scanned comprises: In response to detecting an operation acting on at least one target control in the multi-level control, displaying a sub-control linked to the target control on the first page; wherein the multi-level control corresponds to a first-level classification of the suspected type; the sub-control corresponds to an n-level classification of the suspected type; and n is greater than or equal to 2; Based on the operation acting on the sub-control, the confirmed type of the object to be scanned is determined.

10. The method according to any one of claims 1 to 7, characterized in that: The first control is a single-level control; the determining the confirmed type of the object to be scanned in response to the operation acting on the at least one first control includes: Determining the confirmed type of the object to be scanned based on an operation acting on at least one of the single-level controls; Among them, the single-level control corresponds to the m-level classification of the suspected type; m is a positive integer; in the case that the suspected type has multiple levels of classification, the m-level classification is the lowest level classification in the multiple levels of classification.

11. An image processing device, characterized in that: The device comprises: A first display module is configured to enter a first page in response to triggering a scanning function, and to display the object to be scanned identified by the image acquisition module on the first page; A second display module is configured to display at least one first control on the first page according to the suspected type of the object to be scanned; a determination module, configured to determine the confirmed type of the object to be scanned in response to an operation acting on the at least one first control, and display a second page corresponding to the confirmed type; The processing module is configured to perform processing on the object to be scanned based on an operation acting on a second page corresponding to the confirmed type.

12. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the image processing method according to any one of claims 1 to 10 is implemented.

Images