Mobile device and operation method of input method thereof

Abstract

The invention discloses a mobile device and an operation method of an input method thereof, and relates to the mobile device. The mobile device comprises a general camera module, a special camera module, a bar code decoding module, a touch display module and a control module, the bar code decoding module is used for capturing at least one bar code image through the special camera module and converting the at least one bar code image into at least one first word string. The touch display module is used for displaying a display picture, and the display picture is provided with an input field. The control module is used for responding to an input trigger event of the input field to start a virtual keyboard window of a system default input method and a trigger element of the image conversion input method, and responding to a first trigger event of the trigger element to control the touch display module to display an overlapping window of the image conversion input method on the display picture in an overlapping mode.

Description

Technical Field

[0001] The present invention relates to an image conversion input method, and more particularly to a mobile device and an operation method of the input method thereof. Background Art

[0002] In order to meet the special needs of the market, some companies have developed applications with barcode scanning functions and / or optical character recognition (OCR) functions, and applied these applications to various types of mobile devices (such as smart phones, tablet computers or industrial touch computers, etc.). However, these applications are not convenient to use. For example, when a user wants to convert a barcode image or a text image into a string through this application, and input this string into the input field of another application (such as Facebook or Google Chrome, etc.), the user needs to open the window screens of these two applications alternately to complete the above operations. Summary of the invention

[0003] In view of this, the inventor proposes an operating method of a mobile device and an input method thereof, integrating an application with a barcode scanning function and / or an OCR function (hereinafter referred to as an image conversion input method) into the input method of the mobile device, so as to use the barcode scanning function and / or the OCR function to obtain the content represented by the barcode and / or the image and directly input the obtained content into the input field, thereby improving the convenience of using the image conversion input method.

[0004] In some embodiments, a mobile device includes: a general camera module; a dedicated camera module; a barcode decoding module electrically connected to the dedicated camera module, used to capture at least one barcode image through the dedicated camera module, and convert at least one barcode image into at least one first string, wherein each barcode image is generated by the dedicated camera module photographing at least one barcode; a touch display module, used to display a display screen, wherein the display screen has an input field; and a control module electrically connected to the general camera module, the dedicated camera module and the touch display module, used to respond to an input trigger event of the input field to activate a virtual keyboard window of a system default input method and a trigger element of an image conversion input method, and respond to a first trigger event of the trigger element to control the touch display module to overlap and display an overlapping window of the image conversion input method on the display screen.

[0005] In some embodiments, the trigger element is a virtual key, and the virtual key is displayed on the display screen simultaneously with the input field and the virtual keyboard window.

[0006] In some embodiments, the control module is further configured to control the touch display module to hide the overlapping window displayed on the display screen in response to the first triggering event occurring again.

[0007] In some embodiments, the first trigger event is a short press.

[0008] In some embodiments, the control module is further configured to control the touch display module to display a setting window of the image conversion input method in response to a second trigger event of the trigger element.

[0009] In some embodiments, the second trigger event is a long press.

[0010] In some embodiments, the mobile device further includes at least one selection key, wherein a dedicated camera module is used to capture a preview screen having at least one barcode image, and the control module is further used to activate the barcode decoding module in response to a barcode selection trigger event of the at least one selection key, and after activating the barcode decoding module, the preview screen is displayed in an overlapping window in real time and one of the at least one first string is displayed in the input field.

[0011] In some embodiments, there are multiple at least one barcode image, the overlapping window further has a candidate field, the candidate field is above the overlapping window, and the control module is further used to display at least one first string as an input option of the input field in the candidate field after starting the barcode decoding module.

[0012] In some embodiments, the mobile device further includes: a text recognition engine, disposed between the general camera module and the control module, for capturing at least one word string image and another preview screen having at least one word string image via the general camera module, and recognizing and converting each word string image into at least one second word string, wherein each word string image is generated by the general camera module by photographing at least one word.

[0013] In some embodiments, the control module is further configured to activate the text recognition engine in response to a text selection trigger event of at least one selection key, and after activating the text recognition engine, instantly display another preview image in the overlapping window and display one of the second strings in the input field.

[0014] In some embodiments, the overlapping window includes a zoom-in key, and the control module is further configured to control the touch display module to zoom in and display the overlapping window in response to a zoom-in triggering event of the zoom-in key.

[0015] In some embodiments, a method for operating an input method of a mobile device includes: displaying an input field on a display screen; activating a system default input method and an image conversion input method through the input field to simultaneously display the input field, a virtual keyboard window of the system default input method, and a trigger element of the image conversion input method on the display screen, wherein the trigger element is a virtual key; and in response to a first trigger event of the trigger element, controlling a touch display module to overlap and display an overlapping window of the image conversion input method on the display screen, wherein the overlapping window is linked to a general camera module or a dedicated camera module.

[0016] In some embodiments, the operating method further includes: controlling the touch display module to hide the overlapping window displayed on the display screen in response to the first triggering event occurring again.

[0017] In some embodiments, the operating method further includes: controlling the touch display module to display a setting window of the image conversion input method in response to a second trigger event of the trigger element.

[0018] In some embodiments, the image conversion input method includes a barcode scanning input method, and the operation method further includes: starting the barcode scanning input method in response to a barcode selection event; using the barcode scanning input method to scan at least one barcode to obtain at least one first string, wherein the scanning step using the barcode scanning input method includes: photographing at least one barcode via a dedicated camera module to obtain at least one barcode image of the at least one barcode; and using a barcode decoding module to decode at least one barcode image into at least one first string; and displaying one of the at least one first string in the input field.

[0019] In some embodiments, the shooting step of the dedicated camera module further obtains a preview screen having at least one barcode image, and the scanning step using the barcode scanning input method further includes: previewing and displaying the preview screen in an overlapping window.

[0020] In some embodiments, at least one first string is a plurality of first strings, the overlapping window further has a candidate field, the candidate field is above the overlapping window, and the operation method further includes: displaying the plurality of first strings as input options of the input field in the candidate field.

[0021] In some embodiments, the image conversion input method also includes a text recognition input method, the mobile device also includes a text recognition engine, and the operating method also includes: starting the text recognition input method in response to a text selection event; using the text recognition input method to detect at least one text to obtain at least one second string, wherein the detection step using the text recognition input method includes: photographing at least one text through a general camera module to obtain at least one string image of at least one text and another preview screen with at least one string image; previewing another preview screen in an overlapping window; and using the text recognition engine to recognize and convert at least one string image into at least one second string; and displaying one of the at least one second strings in the input field.

[0022] In some embodiments, the overlapping window further includes a zoom-in key, and the operation method further includes: displaying the overlapping window by zooming in response to a zoom-in triggering event of the zoom-in key.

[0023] In summary, according to any embodiment, the mobile device or its input method operation method has both a system default input method and an image conversion input method to provide multiple input functions. In this way, when the user inputs text in any input field, he can select an appropriate input method to perform input operations (such as but not limited to Chinese and English input, barcode scanning input or OCR input, etc.), thereby improving the convenience and efficiency of text input. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a module block diagram of a first embodiment of a mobile device;

[0025] Figure 2 yes Figure 1 A front plan view schematic diagram of an exemplary embodiment of the mobile device;

[0026] Figure 3 yes Figure 1 A rear plan view schematic diagram of an exemplary embodiment of the mobile device;

[0027] Figure 4 is a flowchart of the operation of a mobile device according to some embodiments;

[0028] Figure 5 yes Figure 2 In the input field, Figure 4 A schematic diagram of an exemplary embodiment after processing in step S110;

[0029] Figure 6 yes Figure 2 The trigger element passes through Figure 4 A schematic diagram of an exemplary embodiment after processing in step S120;

[0030] Figure 7 yes Figure 4 The operation flow chart of the first embodiment of the process following step S120;

[0031] Figure 8 yes Figure 4 The operation flow chart of the second embodiment of the process following step S120;

[0032] Fig. 9 yes Figure 6 Overlap window passes Figure 8 A schematic diagram of an exemplary embodiment after processing in step S132a' and step S132b;

[0033] Fig.10 yes Figure 6 Overlap window passes Figure 8 A schematic diagram of an exemplary embodiment after processing in step S132c and step S134;

[0034] Fig.11 yes Figure 8 The operation flow chart of an embodiment of the process following step S132;

[0035] Fig.12 yes Fig. 9 Overlap window passes Fig.11 A schematic diagram of an exemplary embodiment after processing in step S134;

[0036] Fig.13 is a block diagram of a second embodiment of a mobile device;

[0037] Fig.14 yes Figure 4 The operation flow chart of the third embodiment of the process following step S120;

[0038] Fig.15 yes Fig.14 A detailed flow chart of an embodiment of step S142;

[0039] Fig.16 yes Figure 6 Overlap window passes Fig.15 A schematic diagram of an exemplary embodiment after processing in step S142a and step S142b;

[0040] Fig.17 yes Figure 6 Overlap window passes Fig.14 A schematic diagram of an exemplary embodiment after processing in step S143 and step S144;

[0041] Fig.18 yes Figure 4 The operation flow chart of the fourth embodiment of the process following step S120;

[0042] Fig.19 yes Figure 4 An operation flow chart of an embodiment of the process following step S110;

[0043] Fig. 20 yes Figure 6 The trigger element passes through Fig.19 A schematic diagram of an exemplary embodiment after processing in step S170;

[0044] Fig.21 yes Figure 4 The operation flow chart of the fifth embodiment of the process following step S120;

[0045] Fig. 22 yes Figure 6 Overlap window passes Fig.21 Schematic diagram of an exemplary embodiment after processing in step S180.

[0046]

Explanation of symbols

[0047] 10: Mobile Devices

[0048] 100: General camera module

[0049] 110: Dedicated camera module

[0050] 120: Barcode decoding module

[0051] 130: Touch display module

[0052] 140: Control module

[0053] 150:Text recognition engine

[0054] 20: Shell

[0055] 200: Display screen

[0056] 210: Input field

[0057] 211: Cursor

[0058] 220: Virtual keyboard window

[0059] 230: Trigger element

[0060] 240: Overlapping windows

[0061] 241:Select key

[0062] 242:Select key

[0063] 243: Preview screen

[0064] 244: Candidate Column

[0065] 245: Preview screen

[0066] 246: Zoom in key

[0067] 250: Setting window

[0068] 31,32,33: Barcode image

[0069] 41,42: string image

[0070] BT: Virtual Button

[0071] BT1~BT6: Button

[0072] IT1,IT2: Input options

[0073] S100~S180: Steps

[0074] S131~S134: Steps

[0075] S132a, S132a', S132b, S132c: Steps

[0076] S141~S144: Steps

[0077] S142a, S142b, S142c: Steps

[0078] ST1: First string

[0079] ST2: Second string DETAILED DESCRIPTION

[0080] Please refer to Figure 1 , a mobile device 10 with multiple input methods (hereinafter referred to as mobile device 10) can provide multiple input operations such as virtual keyboard, image conversion (such as barcode scanning and / or text recognition). The mobile device 10 includes a general camera module 100, a dedicated camera module 110, a barcode decoding module 120, a touch display module 130 and a control module 140. Among them, the barcode decoding module 120 is electrically connected between the dedicated camera module 110 and the control module 140, and the control module 140 is electrically connected to the general camera module 100, the barcode decoding module 120 and the touch display module 130.

[0081] Here, the barcode decoding module 120 can capture at least one barcode image through the dedicated camera module 110 and convert each captured barcode image into at least one string (hereinafter referred to as a first string).

[0082] Please refer to Figures 1 to 3 In some embodiments, the mobile device 10 includes a housing 20. The touch display module 130 is embedded in the front side of the housing 20 (eg, Figure 2As shown in the figure, the general camera module 100 and the special camera module 110 are embedded in the housing 20, and the barcode decoding module 120 and the control module 140 are disposed inside the housing 20 (not shown).

[0083] In some embodiments, the general camera module 100 can be embedded in the back side of the housing 20 (eg Figure 3 In some embodiments, the general camera module 100 may also be embedded in the front side of the housing 20 (not shown).

[0084] In some embodiments, the dedicated camera module 110 may be embedded in the back side of the housing 20 (eg, Figure 3 In some other embodiments, the dedicated camera module 110 may also be embedded in the side surface of the housing 20 (not shown).

[0085] In some embodiments, the mobile device 10 may be a device with touch function and text input application, such as but not limited to a smart phone, a tablet computer or a touch computer, etc. In some embodiments, the general camera module 100 may be a front camera or a rear camera on the mobile device 10 for taking photos or recording videos.

[0086] Please refer to Figures 1 to 6 When the mobile device 10 starts to operate, the touch display module 130 displays an input field 210 on a display screen 200 (step S100, such as Figure 5 shown).

[0087] In some embodiments, the size of the display screen 200 is not larger than the size of the screen of the touch display module 130. For example, the size of the display screen 200 may be substantially equal to the size of the touch display module 130 (eg, Figure 2 shown).

[0088] In some embodiments, the input field 210 can be a desktop widget resident on the desktop provided by the operating system or application of the mobile device 10 (for example, but not limited to the search bar on the main screen of the mobile device 10), a field of a search engine in an application or a web page (for example, but not limited to the App Store search engine or the Google search engine, etc.), or a text input page or field in an application or a web page (for example, but not limited to the input page of Word or the create post field of Facebook, etc.).

[0089] After step S100, the mobile device 10 triggers the control module 140 to activate a system default input method and an image conversion input method via the input field 210, so as to control the touch display module 130 to simultaneously display the input field 210, a virtual keyboard window 220 of the system default input method, and a trigger element 230 of the image conversion input method on the display screen 200 (step S110, as shown in FIG. 11). Figure 5 ). The trigger element 230 is a virtual key, and both the system default input method and the image conversion input method are connected to the input field 210.

[0090] In some embodiments, the trigger element 230 may be disposed in a floating manner in the display screen 200. In some embodiments, the trigger element 230 may also be disposed in a fixed manner in the display screen 200, for example, fixedly located in the middle position of the display screen 200 near the left side.

[0091] After step S110, the control module 140 responds to a first trigger event of the trigger element 230 to control the touch display module 130 to overlay an overlay window 240 of the image conversion input method on the display screen 200 (eg, Figure 6 As shown in step S120 ), the overlapping window 240 links the general camera module 100 or the dedicated camera module 110 .

[0092] In some embodiments, the overlapping window 240 may be a window extending from the trigger element 230 . The overlapping window 240 may be fixed and overlapped on the upper layer of the virtual keyboard window 220 , or may be floating and overlapped on the upper layer of the virtual keyboard window 220 .

[0093] For example, the input field 210 is a search bar on the main screen of the mobile device 10 (eg Figure 2 When the user clicks the input field 210, the control module 140 controls the touch display module 130 to display a cursor 211 in the input field 210 in response to the user's click event, and a virtual keyboard window 220 of the system default input method is floated out from the bottom of the display screen 200, and at the same time, a virtual key (i.e., a trigger element 230, such as a trigger element 230) for image conversion input method is displayed floatingly or fixedly at any position in the display screen 200. Figure 5 Then, when the user presses the trigger element 230 once (ie, the first trigger event), the touch display module 130 will display an overlapping window 240 located on the upper layer of the virtual keyboard window 220 and overlapping the virtual keyboard window 220 .

[0094] Please refer to Figure 6In some embodiments, the mobile device 10 further includes at least one selection key 241, 242, and the image conversion input method includes a barcode scanning input method. In other words, the mobile device 10 has a barcode scanning function.

[0095] Please refer to Figure 1 , Figure 4 , Figure 6 to Figure 7 In some embodiments, after step S120, the control module 140 activates the barcode scanning input method in response to a barcode selection event of a selection key 241 among at least one selection key 241 and 242 (step S131). In other words, the selection key 241 corresponds to the barcode scanning function. In some embodiments, the selection key 241 corresponding to the barcode scanning function may be a physical key of the mobile device 10, or a virtual key on the overlay window 240. For example, if the selection key 241 is a virtual key, the barcode selection event may be a user clicking the virtual key.

[0096] After step S131 , the mobile device 10 uses a barcode scanning input method to scan at least one barcode to obtain at least one first string (step S132 ).

[0097] In some embodiments of step S132, the dedicated camera module 110 captures at least one barcode to obtain at least one barcode image 31 of the at least one barcode (step S132a). Subsequently, the barcode image 31 is transmitted to the barcode decoding module 120, and the barcode decoding module 120 decodes each barcode image 31 into at least one first string (step S132c).

[0098] Please refer to Figure 1 , Figure 4 , Figure 6 and Figure 8 In some other embodiments of step S132, the dedicated camera module 110 captures at least one barcode to obtain at least one barcode image 31 of the at least one barcode and a preview screen 243 having the at least one barcode image 31 (step S132a'). Next, the control module 140 of the mobile device 10 controls the touch display module 130 to instantly preview and display the preview screen 243 in the overlapping window 240 (step S132b, as shown in FIG. 1 ). Fig. 9 ), so that the user can confirm the barcode that the dedicated camera module 110 is aimed at. Then, the control module 140 transmits at least one barcode image 31 to the barcode decoding module 120, and the barcode decoding module 120 decodes at least one barcode image 31 into at least one first string (step S132c).

[0099] After step S132, the control module 140 receives the first string output by the barcode decoding module 120, and controls the touch display module 130 to display any first string ST1 of the at least one first string in the input field 210 (step S134, such as Fig.10 shown).

[0100] For example, take a barcode as an example, the barcode information carried by the barcode is "ABC123456". Here, the dedicated camera module 110 photographs the barcode to obtain the barcode image 31 of the barcode, and then the barcode decoding module 120 decodes the obtained barcode image 31 to obtain the first string ST1 of "ABC123456".

[0101] In some embodiments, when the dedicated camera module 110 captures multiple barcodes at one time (i.e., there are multiple barcode images at least one), the touch display module 130 displays the first string represented by (i.e., converted from) the barcode image at a specified position in the preview screen 243 (e.g., the barcode image overlapping the center of the preview screen 243) in the input field 210.

[0102] Please refer to Figure 1 , Figure 4 , Fig. 9 , Fig.11 and Fig.12 In some embodiments, at least one first string may be multiple, and the overlapping window 240 further has a candidate field 244. The candidate field 244 is located above the overlapping window 240 (eg, Fig.12 In other words, the dedicated camera module 110 captures multiple barcodes at one time and obtains multiple barcode images 32, 33. At this time, in step S131c, the barcode decoding module 120 decodes the barcode images 32, 33 of the multiple barcodes into multiple first character strings, and the control module 140 controls the touch display module 130 to display the multiple first character strings as input options IT1, IT2 of the input field 210 in the candidate field 244 (step S133, as shown in FIG. 131c). Fig.12 shown).

[0103] For example, take the dedicated camera module 110 taking pictures of two bar codes at one time (e.g. Fig.12), the barcode information carried by the two barcodes is "DEF789012" and "GHI345678" respectively. At this time, the candidate field 244 has two input options IT1 and IT2, one of which is the first string "DEF789012" converted from the barcode image 32, and the other is the first string "GHI345678" converted from the barcode image 33. Specifically, when the mobile device 10 captures the barcode images 32 and 33 of the two barcodes, the barcode decoding module 120 decodes the two barcode images 32 and 33 into the first strings "DEF789012" and "GHI345678" respectively, and the two first strings are displayed in the candidate field 244 as input options IT1 and IT2, so that at least one of the two first strings can be selected to be input into the input field 210.

[0104] Please refer to Fig.13 In some embodiments, the image conversion input method may further include a text recognition input method, and the mobile device 10 further includes a text recognition engine 150. The text recognition engine 150 is electrically connected between the general camera module 100 and the control module 140, and is disposed inside the housing 20 (not shown). In other words, the mobile device 10 has an optical character recognition (OCR) function.

[0105] Please refer to Figure 4 , Fig.13 and Fig.14 In some embodiments, after step S120 or step S134, the control module 140 activates the text recognition input method in response to a text selection event occurring on another selection key 242 of the at least one selection key 241, 242 (step S141). In other words, the selection key 242 corresponds to the optical character recognition function. In some embodiments, the selection key 242 corresponding to the optical character recognition function can be a physical key of the mobile device 10, or a virtual key on the overlay window 240. For example, if the selection key 242 is a virtual key, the barcode selection event can be a user clicking the virtual key.

[0106] In some embodiments, the selection key 241 corresponding to the barcode scanning function and the selection key 242 corresponding to the optical character recognition function may both be physical keys of the mobile device 10, or both be virtual keys on the overlapping window 240, or one may be a physical key of the mobile device 10 and the other may be a virtual key on the overlapping window 240.

[0107] After step S141 , the mobile device 10 can detect at least one character using the text recognition input method to obtain at least one character string (hereinafter referred to as a second character string, step S142 ).

[0108] Please refer to Figure 4 , Figures 13 to 17 In some embodiments of step S142, the general camera module 100 captures at least one character to obtain at least one character string image 41, 42 of the at least one character and another preview screen 245 having at least one character string image 41, 42 (step S142a, such as Fig.16 Then, the control module 140 of the mobile device 10 controls the touch display module 130 to instantly preview and display another preview image 245 in the overlapping window 240 (step S142b, as shown). Fig.16 Then, the mobile device 10 utilizes the text recognition engine 150 to recognize and convert at least one character string image 41, 42 into at least one second character string (step S142c, as shown in FIG. 142c ). Fig.17 shown).

[0109] Finally, the control module 140 controls the touch display module 130 to display any second string ST2 of the at least one second string in the input field 210 (step S144, such as Fig.17 For example, taking the two string images 41 and 42 as examples, in step S142c, the second string ST2 converted by the string image 41 is "Hello", and the second string converted by the string image 42 is "world". And, in step S144, the second string ST2 of "Hello" is displayed in the input field 210.

[0110] In some embodiments, when the at least one second string obtained in step S142c is multiple, after step S142c and before step S144, the control module 140 can control the touch display module 130 to display the multiple second strings as input options of the input field 210 in the candidate field (step S143, not shown). After the user clicks, the touch display module 130 displays the second string ST2 selected by the user in the input field 210 (step S144, not shown). Fig.17 shown).

[0111] Please refer to Figure 1 , Figure 4 , Fig.13 and Fig.18 In some embodiments, after step S120, the control module 140 controls the touch display module 130 to hide the overlapping window 240 displayed on the display screen 200 in response to the first trigger event occurring again (step S160, such as Figure 5 For example, following the previous example, taking pressing once as the first trigger event, when the overlapping window 240 is displayed on the display screen 200 (as shown in FIG. Figure 6 , Fig. 9 , Fig.10, Fig.12 , Fig.16 and Fig.17 As shown), and when the user presses the trigger element 230 again, the control module 140 can hide the overlapping window 240 in the display screen 200, so that the touch display module 130 no longer displays the overlapping window 240 on the display screen 200 (as shown). Figure 5 It should be clear that Fig.18 It is shown that step S160 is executed immediately after step S120, but this order is not a limitation of the present invention. Under reasonable circumstances, step S160 is executed before or after any step after step S120 (for example, any one of steps S131-S134, S141-S144).

[0112] Please refer to Figure 1 , Figure 4 , Fig.13 , Fig.19 and Fig. 20 In some embodiments, after step S110, the control module 140 controls the touch display module 130 to display a setting window 250 of the image conversion input method in response to a second trigger event of the trigger element 230 (step S170, such as Fig. 20 It should be clear that Fig.19 It is shown that step S170 is executed immediately after step S110, but this order is not a limitation of the present invention. Under reasonable circumstances, step S170 is executed before or after any step after step S110 (for example, any one of steps S120, S131-S134, S141-S144, S160).

[0113] In some embodiments, the first trigger event and the second trigger event are different trigger events. In some embodiments, the first trigger event is a short press, and the second trigger event is a long press. For example, a short press is, but not limited to, a single press or a press for 1 second and then release, and a long press is, for example, a press for more than 3 seconds, but is not limited to this.

[0114] In some embodiments, the mobile device 10 can adjust various functions of the image conversion input method and its overlay window 240 through the setting window 250 .

[0115] Please refer to Fig. 20In some embodiments, the setting window 250 has multiple virtual buttons BT. Each virtual button BT has a corresponding setting or function. For example, the function button BT1 is used to adjust the detailed settings of functions such as OCR, QR code scanning and barcode scanning (for example, the automatic / manual function setting of barcode scanning). The window button BT2 is used to set the size and position of the overlapping window 240. The notice button BT3 is used to set the switch of sound notification and / or vibration notification when the recognition or scanning is successful. The prefix / suffix button BT4 is used to set the switch of adding prefix / suffix strings before and after at least one first string. The autoreturn button BT5 is used to set the switch of automatically or manually hiding the overlapping window 240 after scanning or recognition is successful. The other buttons BT6 are used to execute other detailed settings related to the overlapping window 240 (for example, appearance settings such as language or background). In other words, any functions related to the image conversion input method and its overlapping window 240 can be customized by providing setting buttons, options or any combination thereof in the setting window 250 for the user to set.

[0116] Please refer to Figure 1 , Figure 4 , Figure 6 , Fig.13 , Fig.21 and Fig. 22 In some embodiments, the overlapping window 240 may include a zoom-in key 246. After step S120, the control module 140 controls the touch display module 130 to zoom in and display the overlapping window 240 in response to a zoom-in trigger event of the zoom-in key 246 (e.g., the zoom-in key 246 is pressed and selected) (step S180, such as Fig.21 It should be clear that Fig.21 It is shown that step S180 is executed immediately after step S120, but this order is not a limitation of the present invention. Under reasonable circumstances, step S180 is executed before or after any step after step S120 (for example, any one of S131-S134, S141-S144).

[0117] In some embodiments of step S180, the control module 140 may control the touch display module 130 to display the overlapping window 240 in full screen in response to the zoom-in trigger event of the zoom-in key 246. In some embodiments, the display screen 200 has a first size, the overlapping window 240 before zooming in has a second size, and the overlapping window 240 after zooming in has a third size. Here, the second size is smaller than the first size, and the third size is larger than the second size and smaller than or equal to the first size. In some embodiments, the second size and / or the third size of the overlapping window 240 can be set in the setting window 250 of the image conversion input method. For example, the third size of the overlapping window 240 is substantially equal to the first size of the display screen 200 (e.g., Fig. 22 shown).

[0118] In some embodiments, the general camera module 100 and the dedicated camera module 110 may be photosensitive elements for sensing images (including barcode images and string images) and converting the images into electronic signals, such as but not limited to charge-coupled devices (CCD) or complementary metal oxide semiconductor sensors (CMOS sensors).

[0119] In some embodiments, the barcode decoding module 120 and the text recognition engine 150 may be hardware components with computing functions, such as but not limited to a microprocessor, a graphics processing unit (GPU), an embedded controller (Embedded Controller) or a microcontroller unit (MCU).

[0120] In some embodiments, the barcode decoding module 120 converts at least one barcode image into at least one first string according to data in a database built into the mobile device 10, and the text recognition engine 150 converts at least one string image into at least one second string according to data in a database built into the mobile device 10.

[0121] In some embodiments, the mobile device 10 is coupled to a cloud database by wireless communication via a communication module (not shown), wherein the barcode decoding module 120 converts at least one barcode image into at least one first string according to the data in the cloud database, and the text recognition engine 150 converts at least one string image into at least one second string according to the data in the cloud database.

[0122] In some embodiments, the touch display module 130 may be a display device with touch function, such as but not limited to a resistive touch panel, a capacitive touch panel, an infrared touch panel, an optical touch panel or a surface acoustic wave touch panel.

[0123] In some embodiments, the control module 140 can be a hardware element with logic processing functions, such as but not limited to a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC) or a microcontroller unit.

[0124] In some embodiments, the barcode decoding module 120 , the text recognition engine 150 , and the control module 140 may be three hardware components with signal processing functions respectively.

[0125] In other embodiments, the dedicated camera module 110 and the barcode decoding module 120 may be integrated into an independent hardware component, namely a barcode engine (also called a barcode scanning module), while the text recognition engine 150 and the control module 140 are implemented by a single hardware component with signal processing function.

[0126] In some other embodiments, the barcode decoding module 120 , the text recognition engine 150 , and the control module 140 may be implemented by a single hardware component having a signal processing function.

[0127] In summary, according to any embodiment, the mobile device or its input method operation method has both a system default input method and an image conversion input method to provide multiple input functions. In this way, when the user inputs text in any input field, he can select an appropriate input method to perform input operations (such as but not limited to Chinese and English input, barcode scanning input or OCR input, etc.), thereby improving the convenience and efficiency of text input.

[0128] Although the present invention has been disclosed as above by way of embodiments, it is not intended to limit the invention of the present invention. Any person with ordinary knowledge in the relevant technical field may make some modifications and changes without departing from the spirit and scope of the present invention. However, such modifications and changes are still within the scope of the patent application of the present invention.

Claims

1. A mobile device, characterized in that: Include: A general camera module; A dedicated camera module; A barcode decoding module, electrically connected to the dedicated camera module, for capturing at least one barcode image through the dedicated camera module, and converting the at least one barcode image into at least one first string, wherein each barcode image is generated by the dedicated camera module photographing at least one barcode; a touch display module, used for displaying a display screen, wherein the display screen has an input field; and A control module is electrically connected to the general camera module, the dedicated camera module and the touch display module, and is used to respond to an input trigger event of the input field to activate a virtual keyboard window of a system default input method and a trigger element of an image conversion input method, and to respond to a first trigger event of the trigger element to control the touch display module to overlap and display an overlapping window of the image conversion input method on the display screen.

2. The mobile device according to claim 1, wherein: The trigger element is a virtual key, and the virtual key, the input field and the virtual keyboard window are displayed on the display screen simultaneously.

3. The mobile device according to claim 1, wherein: The control module is further used for controlling the touch display module to hide the overlapping window displayed on the display screen in response to the first trigger event occurring again.

4. The mobile device according to claim 3, wherein: The first trigger event is a short press.

5. The mobile device according to claim 1, wherein: The control module is further used for controlling the touch display module to display a setting window of the image conversion input method in response to a second trigger event of the trigger element.

6. The mobile device according to claim 5, characterized in that The second trigger event is a long press.

7. The mobile device according to claim 1, wherein: The invention also comprises at least one selection key, wherein the dedicated camera module is used to capture a preview screen having the at least one barcode image, and the control module is further used to activate the barcode decoding module in response to a barcode selection triggering event of the at least one selection key, and after activating the barcode decoding module, the preview screen is instantly displayed in the overlapping window and one of the at least one first string is displayed in the input field.

8. The mobile device according to claim 7, wherein: The at least one barcode image is multiple, the overlapping window further has a candidate field, the candidate field is above the overlapping window, and the control module is further used to display the at least one first string as an input option of the input field in the candidate field after starting the barcode decoding module.

9. The mobile device according to claim 7, wherein: Also includes: A text recognition engine is arranged between the general camera module and the control module, and is used to capture at least one word string image and another preview screen having the at least one word string image through the general camera module, and recognize and convert each of the word string images into at least one second word string, wherein each of the word string images is generated by the general camera module by photographing at least one word.

10. The mobile device according to claim 9, wherein: The control module is further used to respond to a text selection trigger event of the at least one selection key to start the text recognition engine accordingly, and after starting the text recognition engine, the other preview image is instantly displayed in the overlapping window and one of the second strings is displayed in the input field.

11. The mobile device according to claim 1, wherein: The overlapping window includes a zoom-in key, and the control module is further used for controlling the touch display module to zoom in and display the overlapping window in response to a zoom-in triggering event of the zoom-in key.

12. A method for operating an input method of a mobile device, characterized in that: Include: displaying an input field on a display screen; Activating a system default input method and an image conversion input method via the input field to simultaneously display the input field, a virtual keyboard window of the system default input method, and a trigger element of the image conversion input method on the display screen, wherein the trigger element is a virtual key; as well as In response to a first trigger event of the trigger element, a touch display module is controlled to overlap and display an overlapping window of the image conversion input method on the display screen, wherein the overlapping window is linked to a general camera module or a dedicated camera module.

13. The operating method according to claim 12, characterized in that: Also includes: In response to the first triggering event occurring again, the touch display module is controlled to hide the overlapping window displayed on the display screen.

14. The operating method according to claim 13, characterized in that: The first trigger event is a short press.

15. The operating method according to claim 12, characterized in that: Also includes: In response to a second trigger event of the trigger element, the touch display module is controlled to display a setting window of the image conversion input method.

16. The operating method according to claim 15, characterized in that: The second trigger event is a long press.

17. The operating method according to claim 12, characterized in that: The image conversion input method includes a barcode scanning input method, and the operation method further includes: In response to a barcode selection event, the barcode scanning input method is started; Scanning at least one barcode using the barcode scanning input method to obtain at least one first string, wherein the scanning step using the barcode scanning input method includes: photographing the at least one barcode via the dedicated camera module to obtain at least one barcode image of the at least one barcode; and Decoding the at least one barcode image into the at least one first string using a barcode decoding module; and One of the at least one first character string is displayed in the input field.

18. The operating method according to claim 17, characterized in that: The shooting step of the dedicated camera module also obtains a preview screen having the at least one barcode image, and the scanning step using the barcode scanning input method further includes: The preview displays the preview image in the overlapping window.

19. The operating method according to claim 17, characterized in that: The at least one first string is a plurality of first strings, the overlapping window further has a candidate field, the candidate field is above the overlapping window, and the operation method further comprises: The first strings are displayed in the candidate field as input options of the input field.

20. The operating method according to claim 17, characterized in that: The image conversion input method further includes a text recognition input method, the mobile device further includes a text recognition engine, and the operation method further includes: In response to a text selection event, the text recognition input method is activated; Detecting at least one character using the character recognition input method to obtain at least one second character string, wherein the detecting step using the character recognition input method comprises: photographing the at least one character through the general camera module to obtain at least one character string image of the at least one character and another preview screen having the at least one character string image; Previewing and displaying the other preview picture in the overlapping window; as well as Using the text recognition engine to recognize and convert the at least one character string image into the at least one second character string; as well as One of the at least one second string is displayed in the input field.

21. The operating method according to claim 12, characterized in that: The overlapping window includes a zoom-in button, and the operation method further includes: The overlapping window is displayed by enlarging in response to a zoom-in triggering event of the zoom-in key.

Images