Mobile device and input method

Abstract

The invention discloses a mobile device and an input method. The mobile device comprises a general camera module, a touch display module, a bar code scanning module, a character recognition engine and a control module. The general camera module is used for generating images. The touch display module is used for simultaneously displaying a character input field and an overlapping window of a virtual keyboard with a parallel system default input method and a preview pane of an image conversion input method. The bar code scanning module is used for scanning at least one first bar code to obtain a first word string expressed by each first bar code. The character recognition engine is used for performing character recognition on the image to obtain at least one second character string. The control module is used for starting one of the bar code scanning module and the character recognition engine and controlling the touch display module to display one of at least one first character string and at least one second character string in the character input field.

Description

Technical Field

[0001] The present invention relates to a multi-input method, and more particularly to a mobile device and an input method. Background Art

[0002] When using the camera lens of existing mobile devices on the market to perform image recognition to convert images into text (such as barcode decoding, QR code decoding, OCR text recognition and license plate recognition, etc.), it is usually necessary to open the camera in a dedicated application installed in the mobile device, capture and recognize the image in the application, and then manually copy and paste the recognized text into the text field to be input. The operation is not intuitive, the steps are numerous, and it is often necessary to switch between applications on the mobile device, which affects the user experience. Summary of the invention

[0003] In some embodiments, a mobile device includes a general camera module, a touch display module, a barcode scanning module, a text recognition engine and a control module. The general camera module is used to generate an image. The touch display module is used to simultaneously display a text input field and an overlapping window having a virtual keyboard of a system default input method and a preview pane of an image conversion input method in parallel. The barcode scanning module is used to scan at least one first barcode to obtain at least one first string expressed by at least one first barcode, wherein the image conversion input method is connected to the barcode scanning module. The text recognition engine is coupled to the general camera module to perform text recognition on the image to obtain at least one second string, wherein the image conversion input method is connected to the text recognition engine. The control module is coupled to the general camera module, the touch display module, the barcode scanning module and the text recognition engine to activate one of the barcode scanning module and the text recognition engine and control the touch display module to display one of the at least one first string and the second string in the text input field.

[0004] In some embodiments, the barcode scanning module is further configured to generate a preview frame having at least one barcode image and the control module is further configured to display the preview frame in real time in the preview pane.

[0005] In some embodiments, the barcode scanning module includes a dedicated camera module and a barcode decoding module. The dedicated camera module is used to shoot at least one barcode to obtain at least one barcode image and a preview screen. The barcode decoding module is coupled to the dedicated camera module and the control module to decode at least one barcode image into at least one first string.

[0006] In some embodiments, the overlay window further has a candidate bar, the candidate bar is above the virtual keyboard and the preview pane, and the control module is further used to display at least one of the first string and the second string as an input option of the text input bar in the candidate bar.

[0007] In some embodiments, the control module is further configured to display the image in the preview pane immediately after starting the text recognition engine.

[0008] In some embodiments, the overlapping window further includes a selection key group, and the control module is further configured to activate the barcode scanning module or the text recognition engine according to a trigger event occurring on the selection key group.

[0009] In some embodiments, the image has at least one string image, each string image is generated by a general camera module by photographing at least one text, and the text recognition engine is further used to recognize and convert each string image into at least one of at least one second string.

[0010] In some embodiments, the image further has at least one barcode image, which is generated by a general camera module by photographing at least one second barcode, and the text recognition engine is further used to recognize and decode the at least one barcode image of the at least one second barcode in the image into at least one of the at least one second string.

[0011] In some embodiments, the preview pane further includes a zoom-in key, and the control module is further configured to zoom in the preview pane and display it on the touch display module according to a trigger event occurring on the zoom-in key.

[0012] In some embodiments, an input method includes enabling a system default input method and an image conversion input method by a text input bar to simultaneously display the text input bar and an overlapping window, wherein the overlapping window has a virtual keyboard of the system default input method and a preview pane of the image conversion input method in parallel; generating at least one string using one of the system default input method and the image conversion input method; and displaying at least one of the strings in the text input bar.

[0013] In some embodiments, the image conversion input method includes a barcode scanning input method, and the step of generating at least one word string using one of the system default input method and the image conversion input method includes: detecting a start signal of the barcode scanning input method; starting a barcode scanning module in response to the start signal; scanning at least one barcode with the started barcode scanning module to obtain at least one barcode image of the at least one barcode; and decoding at least one barcode image into at least one word string with the barcode scanning module.

[0014] In some embodiments, the input method further includes: when the barcode scanning module obtains at least one barcode image, it generates a preview picture having at least one barcode image and displays the preview picture in the preview pane in real time.

[0015] In some embodiments, the overlapping window further has a candidate column, the candidate column is above the virtual keyboard and the preview pane, and the step of generating at least one string using one of the system default input method and the image conversion input method also includes: displaying at least one string as an input option of the text input column in the candidate column.

[0016] In some embodiments, the image conversion input method further includes a text recognition input method, and the step of generating at least one word string using one of the system default input method and the image conversion input method further includes: detecting another start-up signal of the text recognition input method; generating an image using a general camera module according to another start-up signal, wherein the image has at least one word string image, and each word string image is generated by the general camera module by photographing at least one text; displaying the image in a preview pane in real time; and recognizing and converting at least one word string image into at least one word string.

[0017] In some embodiments, the image further has at least one barcode image, and the at least one barcode image is generated by a general camera module by photographing at least one second barcode. The step of generating the at least one string using one of the system default input method and the image conversion input method also includes: identifying and converting the at least one barcode image into at least one of the at least one string.

[0018] In some embodiments, the preview pane further includes a zoom-in key, and the input method further includes: displaying the preview pane in a magnified state according to a trigger event occurring on the zoom-in key.

[0019] In summary, any of the mobile devices and input methods of the embodiments are applicable to mobile devices, so that the basic input function of the mobile device can use other input methods (such as image conversion input method that uses images to obtain strings) in addition to the system default input method, thereby improving the convenience and efficiency of text input. Here, the image conversion input method can use the capture and analysis of optical images to obtain the string input into the text input field, thereby simplifying the text input operation procedure to improve the convenience and efficiency of text input, thereby greatly improving the user experience. In addition, the image conversion input method provides two image analysis methods to improve the scope of application of the image conversion input method.

[0020] For example, when a user wants to input a string into a text input field, the user can use a mobile device to take a picture of a target with a barcode or text, thereby executing a barcode scanning input method or a text recognition input method to obtain the string, and the obtained string will be directly displayed in the text input field. Therefore, when inputting into the text input field, the user does not need to manually copy and paste the decoded or recognized string into the text input field, and does not need to switch between different applications on the mobile device.

[0021] The detailed features and advantages of the present invention are described in detail in the implementation mode below, and the content is sufficient to enable anyone familiar with the relevant skills to understand the technical content of the present invention and implement it accordingly. Moreover, according to the content, claims and drawings disclosed in this specification, anyone familiar with the relevant skills can easily understand the relevant purposes and advantages of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is a block diagram of an embodiment of a mobile device;

[0023] Figure 2 is a flow chart of an embodiment of an input method;

[0024] Figure 3 is a front view of an embodiment of a mobile device;

[0025] Figure 4 For execution Figure 2 A schematic diagram of an embodiment of a display screen after step S03;

[0026] Figure 5 for Figure 2 A flowchart of an embodiment of step S43;

[0027] Figure 6 For execution Figure 5 A schematic diagram of an embodiment of a display screen after step S43;

[0028] Figure 7 For execution Figure 5 A schematic diagram of another embodiment of a display screen after step S43;

[0029] Figure 8 is a block diagram of another embodiment of a mobile device;

[0030] Fig. 9 yes Figure 3 A rear view of an embodiment of the mobile device;

[0031] Fig.10 for Figure 2 A flowchart of an embodiment of step S45;

[0032] Fig.11 For execution Fig.10 A schematic diagram of an embodiment of a display screen after step S45;

[0033] Fig.12 A schematic diagram of an embodiment of a display image after the preview pane is enlarged and displayed.

[0034]

Explanation of symbols

[0035] 1: Mobile device

[0036] 11: Barcode scanning module

[0037] 12: General camera module

[0038] 13: Text recognition engine

[0039] 14: Control module

[0040] 15: Touch display module

[0041] P: Image

[0042] S,S1~S2,S11~S12: string

[0043] S01~S05,S41,S43,S45: Steps

[0044] CIF: Text input field

[0045] D: Display screen

[0046] 20: Shell

[0047] B: Select key group

[0048] B1~B2: Selection key

[0049] PW: Preview Pane

[0050] VK: Virtual Keyboard

[0051] OW: Overlapping windows

[0052] FS: Zoom in key

[0053] CO: Control Option Key

[0054] S431~S434, S451~S455: Steps

[0055] BC1~BC2,BC11~BC12: Barcode image

[0056] PD: Preview screen

[0057] C: Candidate column

[0058] O1: First input option area

[0059] O2: Second input option area

[0060] 111: Dedicated camera module

[0061] 112: Barcode decoding module

[0062] FS2: Reply key DETAILED DESCRIPTION

[0063] Figure 1 is a block diagram of an embodiment of the mobile device 1. Figure 1 The mobile device 1 includes a general camera module 12 , a touch display module 15 , a barcode scanning module 11 , a text recognition engine 13 and a control module 14 .

[0064] The text recognition engine 13 is coupled to the general camera module 12 . The control module 14 is coupled to the general camera module 12 , the touch display module 15 , the barcode scanning module 11 and the text recognition engine 13 .

[0065] Figure 2 A flowchart of an embodiment of an input method. Figure 3 is a front view of an embodiment of the mobile device 1. Figures 1 to 3 The camera module 12 is generally used to shoot to generate an image P. The touch display module 15 is used to display a text input field CIF (step S01). Specifically, the display screen D displayed by the touch display module 15 has a text input field CIF, and the text input field CIF can be used to receive a string S input by a user.

[0066] Figure 4 For execution Figure 2 A schematic diagram of an embodiment of a display screen D after step S03. Figure 4 . Here, the control module 14 enables the system default input method and the image conversion input method in response to a trigger event (hereinafter referred to as an input trigger event) occurring in the text input field CIF (step S02), thereby simultaneously displaying the text input field CIF and the overlapping window OW on the display screen D (step S03). The overlapping window OW has a virtual keyboard VK of the system default input method and a preview pane PW of the image conversion input method in parallel. In other words, the overlapping window OW is used to provide a user interface of the input method for the user to operate and generate an input string S accordingly. Before the system default input method and the image conversion input method are enabled, there is no user interface of any input method (e.g., overlapping window OW) on the display screen D of the touch display module 15; on the contrary, after the system default input method and the image conversion input method are enabled, the user interface (i.e., overlapping window OW) of the enabled input method (i.e., system default input method and image conversion input method) will appear on the display screen of the touch display module 15. The input triggering event may be that the user clicks on a position where the text input field CIF is displayed in the display screen D so as to enable the text input field CIF to start the input function.

[0067] For example, when an input trigger event occurs at the position where the text input bar CIF is presented in the display screen D (e.g., the user clicks the text input bar CIF so that the cursor appears in the text input bar CIF), the system default input method and the image conversion input method are enabled, and after enabling, an overlapping window OW will appear in the lower half of the display screen D.

[0068] Here, the control module 14 controls one of the virtual keyboard VK, the barcode scanning module 11 and the text recognition engine 13 to generate at least one string S according to the currently activated input method (ie, one of the system default input method and the image conversion input method) (step S04).

[0069] Finally, the control module 14 controls the touch display module 15 to display one of the generated character strings S in the text input field CIF (step S05 ).

[0070] In some embodiments, the image conversion input method may include a barcode scanning input method and a text recognition input method.

[0071] In some embodiments, the overlay window OW further includes a selection key set B. In some embodiments, the selection key set B is disposed in the left half of the overlay window OW and is located to the left of the virtual keyboard VK and the preview pane PW.

[0072] Here, the control module 14 is used to start the barcode scanning module 11 or the text recognition engine 13 according to a trigger event (hereinafter referred to as the selection trigger event) occurring in the selection key group B, or to start the virtual keyboard VK according to a trigger event occurring in the virtual keyboard VK. Specifically, there are at least two types of selection trigger events (hereinafter referred to as the first selection trigger event and the second selection trigger event, respectively). The first selection trigger event corresponds to the barcode scanning module 11 (step S43), and the second selection trigger event corresponds to the text recognition engine 13 (step S45). Among them, the first selection trigger event can cause the selection key group B to generate a start signal for the barcode scanning input method, and the second selection trigger event can cause the selection key group B to generate a start signal for the text recognition input method. The trigger event occurring in the virtual keyboard VK can cause the virtual keyboard VK to generate a start signal for the system default input method (step S41).

[0073] In some embodiments, the selection key group B includes two keys (hereinafter referred to as selection key B1 and selection key B2). The selection key B1 corresponds to a first selection trigger event. The selection key B2 corresponds to a second selection trigger event. Specifically, the control module 14 executes the barcode scanning input method according to the trigger event occurring on the selection key B1, and the control module 14 executes the text recognition input method according to the trigger event occurring on the selection key B2.

[0074] In some embodiments, after the system default input method and the image conversion input method are enabled, the virtual keyboard VK is normally activated. In some embodiments, when the overlapping window OW appears, the control module 14 only activates the virtual keyboard VK, and the barcode scanning module 11 and the text recognition engine 13 are not activated. The control module 14 does not activate the barcode scanning module 11 until the first selection trigger event occurs, and does not activate the text recognition engine 13 until the second selection trigger event occurs. In some embodiments, the virtual keyboard VK can be activated simultaneously with the barcode scanning module 11 or the text recognition engine 13.

[0075] Figure 5 for Figure 2 In some embodiments, in step S43, when the first selection trigger event occurs at the selection key B1 (i.e., the selection key group B generates a start signal of the barcode scanning input method), the control module 14 detects the start signal of the barcode scanning input method (step S431), and thus activates the barcode scanning module 11 in response to the first selection trigger event occurring at the selection key B1 (i.e., the control module 14 activates the barcode scanning module 11 in response to the start signal of the barcode scanning input method) (step S432). Then, the control module 14 starts to execute the barcode scanning input method.

[0076] After step S432, the control module 14 uses the barcode scanning module 11 to scan at least one barcode (hereinafter referred to as the first barcode) to obtain at least one first barcode image BC1 of the at least one barcode (step S433). The barcode scanning module 11 then decodes the at least one first barcode image BC1 into at least one string S (step S434). For the convenience of description, the string S generated by the barcode scanning module 11 decoding the first barcode image BC1 is called the first string S1.

[0077] Figure 6 For execution Figure 5 A schematic diagram of an embodiment of a display screen after step S43. Figure 6 . For example, when the first selection trigger event occurs on the selection key B1 (e.g., the user clicks the selection key B1 to generate the start signal of the barcode scanning input method), the control module 14 detects the start signal of the barcode scanning input method, and thus starts the barcode scanning module 11 in response to the first selection trigger event occurring on the selection key B1. The control module 14 then starts to execute the barcode scanning input method. The control module 14 scans the first barcode with the barcode scanning module 11 to obtain the first barcode image BC1. The barcode scanning module 11 then decodes the first barcode image BC1 into the first string S1. The decoded first string S1 is 72527273037. Therefore, the control module 14 will display the first string S1 (i.e., 72527273037) in the text input field CIF.

[0078] When the number of at least one first barcode is multiple. When the control module 14 executes the barcode scanning input method, the number of first barcode images BC1 obtained by scanning at least one first barcode with the barcode scanning module 11 is also multiple, and the number of at least one first string S1 obtained by decoding at least one first barcode image BC1 by the barcode scanning module 11 is also multiple. Therefore, in some embodiments, at this time, the overlapping window OW further has a candidate column C, and the candidate column C is located above the virtual keyboard VK and the preview pane PW. The control module 14 is further used to display multiple first strings S1 as input options of the text input column CIF in the candidate column C and display the corresponding first string S1 in the text input column CIF according to the trigger event occurring in the candidate column C.

[0079] Figure 7 For execution Figure 5 A schematic diagram of another embodiment of the display screen D after step S43. Figure 7 . When the control module 14 uses the barcode scanning module 11 to scan the two first barcodes to obtain two first barcode images BC1 (hereinafter referred to as the first barcode image BC11 and the first barcode image BC12). The barcode scanning module 11 then decodes the first barcode image BC11 and the first barcode image BC12 into two first character strings S1 (hereinafter referred to as the first character string S11 and the first character string S12). The decoded first character string S11 is 72527273037, and the decoded first character string S12 is 72527273038. At this time, the control module 14 displays the first character string S11 (i.e., 72527273037) and the first character string S12 (i.e., 72527273038) as input options of the text input field CIF in the first input option area O1 and the second input option area O2 of the candidate field C. The first character string S11 is displayed in the first input option area O1, and the first character string S12 is displayed in the second input option area O2. If a trigger event occurs in the first input option area O1 (eg, the user clicks the first input option area O1 to select the first string S11 as the string displayed in the text input field CIF), the control module 14 displays the first string S11 (ie, 72527273037) in the text input field CIF.

[0080] See also Figure 6 In some embodiments, the barcode scanning module 11 is further configured to generate a preview image PD having at least one first barcode image BC1 and the control module 14 is further configured to display the preview image PD in the preview pane PW in real time.

[0081] Figure 8 is a block diagram of another embodiment of the mobile device 1. Figure 8In some embodiments, the barcode scanning module 11 includes a dedicated camera module 111 and a barcode decoding module 112. The dedicated camera module 111 is used to shoot at least one first barcode to obtain a preview screen PD having at least one first barcode image BC1. The barcode decoding module 112 is coupled to the dedicated camera module 111 and the control module 14, and is used to decode at least one first barcode image BC1 into at least one first string S1. In some embodiments, the barcode scanning module 11 can also directly shoot the first barcode through the general camera module 12 to generate a preview screen PD having at least one first barcode image BC1.

[0082] Fig. 9 yes Figure 3 A rear view of an embodiment of the mobile device 1 is shown in FIG. Figure 3 and Fig. 9 In some embodiments, the mobile device 1 includes a housing 20. The touch display module 15 is embedded in the front side of the housing 20 (eg, Figure 3 As shown in FIG. 1 , the general camera module 12 and the dedicated camera module 111 are embedded in the back of the housing 20 (as shown in FIG. 1 ). Fig. 9 In some embodiments, the general camera module 12 and the dedicated camera module 111 may also be embedded in the front or side of the housing 20 (not shown).

[0083] In some embodiments, the preview image PD only includes the first barcode image BC1. In some embodiments, the preview image PD includes the surrounding environment image of the first barcode image BC1 in addition to the first barcode image BC1.

[0084] Here, the character string S1 parsed by the barcode scanning module 11 is directly displayed in the text input field CIF. Therefore, the user does not need to manually copy and paste the recognized character string into the text input field CIF and / or switch between applications in the mobile device 1, thereby greatly improving the user experience.

[0085] Fig.10 for Figure 2 See the flowchart of an embodiment of step S45. Fig.10 In some other embodiments, when the second selection trigger event occurs in the selection key group B (i.e., the selection key group B generates a start signal of the text recognition input method), the control module 14 detects the start signal of the text recognition input method (hereinafter referred to as another start signal) (step S451), and thus starts the text recognition engine 13 in response to the other start signal of the selection key group B (step S452), and then the control module 14 starts to execute the text recognition input method.

[0086] The control module 14 responds to another start signal to drive the general camera module 12, so that the general camera module 12 generates an image P by photographing at least one character (step S453). The image P has at least one character string image of at least one character.

[0087] At the same time, the control module 14 controls the touch display module 15 to instantly display the image P in the preview pane PW (step S454). In addition, the text recognition engine 13 recognizes and converts at least one string image into at least one string S (step S455). For the convenience of explanation, the string S generated by the text recognition engine 13 recognizing and converting the string image is called the second string S2.

[0088] In some embodiments, the control module 14 is further configured to display at least one second string S2 as an input option of the text input field CIF in the candidate field C and display the corresponding second string S2 in the text input field CIF according to a trigger event occurring in the candidate field C.

[0089] Fig.11 For execution Fig.10 A schematic diagram of an embodiment of a display screen D after step S45. Fig.11 For example, when the second selection trigger event occurs on the selection key B2 (e.g., the user clicks the selection key B2 to generate a start signal for the text recognition input method), the control module 14 detects the start signal for the text recognition input method, and thus starts the text recognition engine 13 in response to the second selection trigger event occurring on the selection key B2. The control module 14 then starts to execute the text recognition input method. The control module 14 generates an image P using a general camera module 12, wherein the image P has a plurality of string images, and each string image is generated by the general camera module 12 by photographing at least one text. The control module 14 instantly displays the image P in the preview pane PW and the text recognition engine 13 recognizes and converts the plurality of string images into a plurality of second strings S2. The control module 14 displays the plurality of second strings S2 as input options for the text input field CIF in the candidate field C and displays the corresponding second strings S2 in the text input field CIF based on the trigger event occurring in the candidate field C. At Fig.11 In the embodiment of the present invention, the corresponding second string S2 displayed in the text input field CIF is MODEL:P15F v2.

[0090] Here, the second string S2 parsed by the text recognition engine 13 is directly displayed in the text input field CIF. Therefore, when the user wants to input the second string S2 in the text input field CIF, the user does not need to manually copy and paste the recognized string into the text input field CIF and / or switch between applications of the mobile device 1 by selecting key group B, thereby greatly improving the user experience.

[0091] In some embodiments, the text recognition engine 13 can also be used to scan and decode at least one barcode (hereinafter referred to as the second barcode) to obtain the string expressed by the second barcode. Specifically, the general camera module 12 can generate an image P having at least one second barcode image BC2 of at least one second barcode by photographing at least one second barcode.

[0092] The text recognition engine 13 is further used to recognize and decode at least one second barcode image BC2 in the image P as at least one of the at least one second string S2. Figure 5 In addition to the multiple string images, the image P also has a second barcode image BC2 of the second barcode. In addition to recognizing and converting the multiple string images in the image P into multiple strings S2, the text recognition engine 13 is further used to recognize and decode the second barcode image BC2 of the second barcode in the image P into one of the multiple second strings S2.

[0093] In some implementations, if the general camera module 12 captures at least one text and at least one second barcode at the same time, the image P has both a text string image and a barcode image. In other implementations, if the general camera module 12 captures only at least one text, the image P only has a text string image. In still other implementations, if the general camera module 12 captures only at least one second barcode, the image P only has a barcode image.

[0094] In some embodiments, the selection key group B may be a single or multiple physical keys (i.e., selection keys), or a single or multiple virtual keys (i.e., selection keys), or a combination thereof. In some implementations, if the selection key group B is a single key, the first selection trigger event and the second selection trigger event can be distinguished by the different consecutive times or consecutive times of enabling (e.g., pressing, electric shock, etc.) this key, or odd and even times.

[0095] In some implementations, the number of keys included in the selection key group B may be the same as the type of the selection trigger event, and the keys included in the selection key group B correspond one-to-one to different selection trigger events. In one example, the keys of the selection key group B corresponding to the first selection trigger event and the second selection trigger event may all be physical keys. In another example, the key of the selection key group B corresponding to the first selection trigger event may be one of a physical key and a virtual key, and the key of the selection key group B corresponding to the second selection trigger event may be the other of a physical key and a virtual key. In another example, the keys of the selection key group B corresponding to the first selection trigger event and the second selection trigger event may all be virtual keys.

[0096] In some embodiments, the preview pane PW may further include a zoom key FS. The control module 14 is further configured to zoom in the preview pane PW and display it on the display screen D according to a trigger event occurring on the zoom key FS.

[0097] Fig.12 FIG. 1 is a schematic diagram of an embodiment of a display screen D after the preview pane PW is enlarged and displayed. Figure 6 and Fig.12 . For example, when a trigger event occurs on the zoom key FS (e.g., the user clicks the zoom key FS to zoom in the preview pane PW), the control module 14 detects the trigger event, and thus zooms in the preview pane PW on the display screen D in response to the trigger event. In some embodiments, the control module 14 displays the preview pane PW in full screen on the display screen D. In some embodiments, after the preview pane PW is displayed in full screen on the display screen D, the preview pane PW further includes a reply key FS2 and does not include the zoom key FS. The control module 14 is further configured to display the preview pane PW displayed in full screen on the display screen D at the size before zooming in according to the trigger event on the reply key FS2.

[0098] In some embodiments, the overlay window OW may further include a control option key CO. The control option key CO is used to open and close a setting window for setting or adjusting various functions of the image conversion input method and various functions of the overlay window OW.

[0099] In some embodiments, the mobile device 1 may be, but is not limited to, a smart phone, a tablet computer, or a notebook computer.

[0100] In some embodiments, the barcode scanning module 11 may be an independent component, such as but not limited to a barcode scanner (also called a barcode engine). The barcode scanner may be, for example, a laser scanner, a CCD scanner, or a photographic scanner.

[0101] In some embodiments, each of the general camera module and the dedicated camera module can be implemented by a combination of a photosensitive element and a lens. The photosensitive element is used to capture an image (including a barcode image and a string image) and convert the image from an optical signal to an electrical signal. The photosensitive element can be, for example, but not limited to, a charge-coupled device (CCD) or a complementary metal oxide semiconductor sensor (CMOS sensor).

[0102] In some embodiments, the text recognition engine 13 may be, but is not limited to, Tesseract, Azure, Real-Time Recognition SDK, or Ocr Space.

[0103] In some embodiments, each of the barcode decoding module, the text recognition engine 13 and the control module 14 may be implemented by one or more hardware devices that execute software or firmware to implement corresponding computing functions.

[0104] In other embodiments, the barcode decoding module is implemented by a hardware device that executes software or firmware to implement the corresponding computing functions, and the text recognition engine 13 and the control module 14 are implemented by another hardware device that executes software or firmware to implement the corresponding computing functions.

[0105] In some other embodiments, the barcode decoding module, the text recognition engine 13 and the control module 14 may be implemented by a single hardware component that executes software or firmware to implement corresponding computing functions.

[0106] In some embodiments, each hardware element may be, for example but not limited to, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a microcontroller unit.

[0107] In some embodiments, the text input field CIF can be a desktop widget resident on the desktop provided by the operating system or application of the mobile device 1 (for example, but not limited to the search bar on the main screen of the mobile device 1), a search engine field in an application or web page (for example, but not limited to the App Store search engine or the Google search engine, etc.), or a text input page or field in an application or web page (for example, but not limited to the input page of Word or the post creation field of Facebook, etc.).

[0108] In summary, in some embodiments, the mobile device 1 can enable the basic input function of the mobile device 1 to use the image conversion input method in addition to the system default input method, thereby improving the convenience and efficiency of text input. The image conversion input method can directly obtain the string S input into the text input field CIF by capturing and analyzing the preview screen PD or the image P, thereby simplifying the operation procedure of text input to improve the convenience and efficiency of text input, thereby greatly improving the user experience. In addition, the image conversion input method provides two image analysis methods, namely the barcode scanning input method and the text recognition input method, which can further improve the scope of application of the image conversion input method. The user can use the mobile device 1 to shoot a target with a barcode or text, thereby executing the barcode scanning input method or the text recognition input method to obtain the string S, and the obtained string S will be directly displayed in the text input field CIF. Therefore, when inputting into the text input field CIF, the user does not need to manually copy and paste the decoded or recognized string S into the text input field CIF, and does not need to switch between different applications of the mobile device 1.

[0109] Although the technical content of this case has been disclosed as above in the preferred embodiment, it is not used to limit this case. Any slight changes and modifications made by anyone familiar with this technology without departing from the spirit of this case should be included in the scope of this case. Therefore, the scope of protection of this case shall be based on the scope defined in the attached claims.

Claims

1. A mobile device, characterized in that: Include: A general camera module, used to generate an image; A touch display module for simultaneously displaying a text input field and an overlapping window having a virtual keyboard of a system default input method and a preview pane of an image conversion input method in parallel; A barcode scanning module, used for scanning at least one first barcode to obtain at least one first string expressed by the at least one first barcode, wherein the image conversion input method is connected to the barcode scanning module; A text recognition engine, coupled to the general camera module, for performing text recognition on the image to obtain at least a second string, wherein the image conversion input method is connected to the text recognition engine; and A control module is coupled to the general camera module, the touch display module, the barcode scanning module and the text recognition engine, and is used to activate one of the barcode scanning module and the text recognition engine and control the touch display module to display one of the at least one first string and the second string in the text input field.

2. The mobile device according to claim 1, wherein: The barcode scanning module is further used for generating a preview frame having at least one barcode image, and the control module is further used for instantly displaying the preview frame in the preview pane.

3. The mobile device according to claim 2, wherein: The barcode scanning module includes: a dedicated camera module, used for photographing the at least one first barcode to obtain the at least one barcode image and the preview screen; and A barcode decoding module is coupled to the dedicated camera module and the control module, and is used for respectively decoding the at least one barcode image into the at least one first string.

4. The mobile device according to claim 1, wherein: The overlapping window further has a candidate bar, which is located above the virtual keyboard and the preview pane, and the control module is further used to display one of the at least one first string and the second string as an input option of the text input bar in the candidate bar.

5. The mobile device according to claim 1, wherein: The control module is further used to display the image in the preview pane immediately after starting the text recognition engine.

6. The mobile device according to claim 1, wherein: The overlapping window further includes a selection key group, and the control module is further used to correspondingly activate the barcode scanning module or the text recognition engine according to a triggering event occurring on the selection key group.

7. The mobile device according to claim 1, wherein: The image has at least one string image, each of which is generated by the general camera module by photographing at least one text, and the text recognition engine is further used to recognize and convert each of the string images into at least one of the at least one second string.

8. The mobile device according to claim 7, wherein: The image further has at least one barcode image, which is generated by the general camera module by photographing at least one second barcode, and the text recognition engine is further used to recognize and decode the at least one barcode image of the at least one second barcode in the image as at least one of the at least one second string.

9. The mobile device according to claim 1, wherein: The preview pane further includes a zoom-in key, and the control module is further used to zoom in the preview pane and display it on the touch display module according to a triggering event occurring on the zoom-in key.

10. An input method, characterized in that: Include: A text input bar enables a system default input method and an image conversion input method to simultaneously display the text input bar and an overlapping window, wherein the overlapping window has a virtual keyboard of the system default input method and a preview pane of the image conversion input method in parallel; Generate at least one string using one of the system default input method and the image conversion input method; and One of the at least one character string is displayed in the text input field.

11. The input method according to claim 10, characterized in that: The image conversion input method includes a barcode scanning input method, and the step of generating the at least one string using one of the system default input method and the image conversion input method includes: Detecting an activation signal of the barcode scanning input method; In response to the start signal, a barcode scanning module is started; Scanning at least one barcode with the activated barcode scanning module to obtain at least one barcode image of the at least one barcode; and The barcode scanning module is used to decode the at least one barcode image into the at least one character string.

12. The input method according to claim 11, characterized in that: Also includes: When the barcode scanning module obtains the at least one barcode image, it generates a preview picture having the at least one barcode image and displays the preview picture in the preview pane in real time.

13. The input method according to claim 10, characterized in that: The overlapping window further has a candidate column, the candidate column is above the virtual keyboard and the preview pane, and the step of generating the at least one string using one of the system default input method and the image conversion input method further comprises: The at least one character string is displayed in the candidate column as an input option of the text input column.

14. The input method according to claim 12, characterized in that: The image conversion input method further includes a text recognition input method, and the step of generating the at least one character string using one of the system default input method and the image conversion input method further includes: detecting another activation signal of the text recognition input method; Generate an image with a general camera module according to the other activation signal, wherein the image has at least one string image, and each string image is generated by the general camera module by photographing at least one text; Real-time display of the image in the preview pane; and Recognize and convert the at least one word string image into the at least one word string.

15. The input method according to claim 10, characterized in that: The image conversion input method includes a text recognition input method, and the step of generating the at least one character string using one of the system default input method and the image conversion input method includes: detecting another activation signal of the text recognition input method; In response to the other start signal, a general camera module generates an image, wherein the image has at least one string image, and each string image is generated by the general camera module by photographing at least one character; Real-time display of the image in the preview pane; and The at least one word string image is recognized and converted into at least one of the at least one word string.

16. The input method according to claim 15, characterized in that: The image further has at least one barcode image, and the at least one barcode image is generated by the general camera module by photographing at least one second barcode. The step of generating the at least one string using one of the system default input method and the image conversion input method further includes: The at least one barcode image is recognized and converted into at least one of the at least one character string.

17. The input method according to claim 10, characterized in that: The preview pane also includes a zoom-in key, and the input method further includes: The preview pane is magnified and displayed according to a trigger event occurring on the magnification key.

Images