Display method, apparatus, handheld reader, electronic device, and storage medium

Abstract

To provide a display method, a device, a handheld reader, an electronic device, and a storage medium.SOLUTION: A method includes: acquiring a scanned image, collected by a camera, at a current moment when the camera is in an on state; performing character recognition on the scanned image at the current moment to obtain scanned characters at the current moment, and stitching the scanned characters after a scanned text at a previous moment to obtain a scanned text at the current moment; and displaying the scanned image at the current moment until the camera comes into an off state or synchronously displaying the scanned image and the scanned text at the current moment. The method, a device, a handheld reader, an electronic device, and a storage medium provide a user with a technique relating to a view window of the collected characters instead of a hardware structure design based on a transparent observation panel of the handheld reader, contribute to achieving integration of structural design of the handheld reader, and extend a service life of the handheld reader.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to the technical field of computers, and in particular to a display method, apparatus, handheld reader, electronic device, and storage medium. [Background technology]

[0002] In order to enable users to intuitively see the characters being scanned when scanning with a pen-type electronic dictionary, current pen-type electronic dictionaries generally have a transparent observation panel installed on the scanning window, but since the material of the observation panel is different from the material of the pen body of the pen-type electronic dictionary, they cannot be molded as one piece, and the observation panel needs to be fitted into the pen body.

[0003] Due to structural design factors, the observation panel fitted to the pen body is easily damaged, which affects the service life of the pen-type electronic dictionary and the user's experience. Summary of the Invention [Problem to be solved by the invention]

[0004] SUMMARY OF THE PRESENT DISCLOSURE The present invention provides a display method, apparatus, handheld reader, electronic device and storage medium to solve the defect that the observation panel fitted in the pen body in the prior art is easily damaged. [Means for solving the problem]

[0005] The present invention relates to If the camera is on, acquiring a current scan image collected by the camera; performing character recognition on the current scanned image to obtain a current scanned text, and stitching the current scanned text after a previous scanned text to obtain a current scanned text; displaying the current scanned image or synchronously displaying the current scanned image and scanned text until the camera enters an off state.

[0006] According to the display method of the present invention, performing character recognition on the current scanned image includes: The method includes determining a recognition area in the scanned image, performing character recognition on the recognition area, and marking the recognition area in the scanned image.

[0007] According to the display method of the present invention, after performing character recognition on the currently scanned image to obtain the currently scanned character, The method further includes obtaining a character area in the currently scanned image where the currently scanned character is located, and marking the character area in the currently scanned image.

[0008] According to the display method of the present invention, the synchronous display of the current scanned image and the scanned text includes: displaying the currently scanned image in a first area and simultaneously displaying the currently scanned text in a second area; The first area and the second area are two display areas of the same display screen, or the first area and the second area belong to two display screens, respectively.

[0009] According to the display method of the present invention, and displaying the scanned text and / or related content of the scanned text in a third area when the camera is in an off state; The third region includes the first region and the second region, or the third region is the second region.

[0010] According to the display method of the present invention, after displaying the scanned text and / or the content related to the scanned text in the third area, determining target segmented words from the scanned text and / or associated content of the scanned text in response to a trigger command; and displaying related content of the target segmented words in the fourth area; When the third region includes the first region and the second region, the fourth region is a part of the third region, and when the third region is the second region, the fourth region is the first region.

[0011] The present invention further provides a display device, the display device comprising: a capture unit for capturing a current scan image captured by the camera when the camera is in an on state; A recognition unit is used for performing character recognition on the current scanned image to obtain a current scanned character, and stitching the current scanned character after a previous scanned text to obtain a current scanned text; a display unit used for displaying the current scanned image or synchronously displaying the current scanned image and scanned text until the camera enters an off state.

[0012] The present invention further provides a handheld reader, the handheld reader including a camera, a processor and a display screen connected in sequence; The processor is used to perform the following when the camera is in an on state: acquire a current scanned image collected by the camera; perform character recognition on the current scanned image to obtain a current scanned character; stitch the current scanned character after a previous scanned text to obtain a current scanned text; and control the display screen to display the current scanned image or synchronously display the current scanned image and the scanned text until the camera enters an off state.

[0013] The present invention further provides an electronic device, the electronic device including a memory, a processor, and a computer program stored in the memory and operable on the processor, the electronic device realizing any of the display methods described above when the processor executes the program.

[0014] The present invention further provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium storing a computer program, the computer program implementing any one of the above display methods when executed by a processor.

[0015] The present invention further provides a computer program product, the computer program product including a computer program, which, when executed by a processor, realizes any of the display methods described above. Effect of the Invention

[0016] The display method, apparatus, handheld reader, electronic device and storage medium of the present invention display the current scanned image, providing users with a technical solution of a view window of collected characters, instead of the hardware structural design based on the transparent observation panel of the handheld reader, helping to realize the integration of the structural design of the handheld reader and prolonging the service life of the handheld reader. In addition, the synchronous display of the scanned image and the scanned text allows users to synchronously view the collection status and recognition status during the use process, helping users to adjust the sliding direction of the handheld reader in real time, thereby improving the accuracy of scanning to pick up words, and optimizing the user experience. [Brief description of the drawings]

[0017] In order to more clearly describe the technical solutions in the present invention or the prior art, the drawings necessary for describing the embodiments or the prior art will be briefly described below. Of course, the drawings described below are only some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without creative labor. [Figure 1] 2 is a flowchart of a display method according to the present invention. [Diagram 2] FIG. 1 is a schematic diagram of the structure of a handheld reader according to the present invention. [Diagram 3] FIG. 2 is a second schematic diagram of the structure of the handheld reader according to the present invention. [Figure 4] FIG. 1 is a schematic diagram of a display according to the present invention. [Diagram 5] This is the second schematic diagram of the display according to the present invention. [Figure 6] This is the third schematic diagram of the display according to the present invention. [Figure 7] This is the fourth schematic diagram of the display according to the present invention. [Figure 8] This is the fifth schematic diagram of the display according to the present invention. [Figure 9] This is the sixth schematic diagram of a display according to the present invention. [Figure 10] This is the seventh schematic diagram of the display according to the present invention. [Figure 11] 1 is a schematic diagram of the structure of a display device according to the present invention; [Figure 12] 1 is a schematic diagram of the structure of a handheld reader according to the present invention; [Figure 13] 1 is a schematic diagram of the structure of an electronic device according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] In order to make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be described clearly and completely below with reference to the drawings in the present invention. Of course, the described embodiments are not all the embodiments, but only some of the embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments that a person skilled in the art can obtain without creative labor are all within the scope of protection of the present invention.

[0019] In the present invention, the handheld reader is a device, such as a scanning pen or a pen-type electronic dictionary, that can collect images through a camera and obtain the text content in the images through image stitching processing and recognition algorithms. When a user uses the camera at the tip of the handheld reader to collect images, a transparent observation panel is generally installed on the scanning window so that the user can intuitively see the collected text. The material of the observation panel is different from the material of the pen body, so it cannot be molded as one piece, and the observation panel needs to be fitted into the pen body. The fitted observation panel is easily damaged, which directly affects the service life of the handheld reader and the user's experience.

[0020] In response to the above problems, an embodiment of the present invention provides a display method to provide users with a view window of the characters being collected by displaying the scanned image, instead of a hardware structural design based on a viewing panel, thereby extending the service life of the handheld reader and optimizing the user experience.

[0021] 1 is a flowchart of a display method according to the present invention, and as shown in FIG. 1, the execution body of the method is a handheld reader, and specifically, may be a processor installed inside the handheld reader. The method includes steps 110, 120 and 130.

[0022] In step 110, if the camera is on, obtain the current scan image collected by the camera.

[0023] The camera here is a camera that is installed at the end of a handheld reader, and specifically, may be a camera that is installed at the pen tip of the handheld reader.

[0024] In practical application, a user holds a handheld reader and touches the pen tip of the handheld reader to a medium, thereby pressing a mechanical touch scan head switch at the pen tip, or triggering a pressure sensor at the pen tip when the pen tip is pressed, thereby generating an on-trigger signal for starting a camera. Alternatively, a user can use a scan button installed on the handheld reader to realize the emission of an on-trigger signal, thereby controlling the start-up of a camera.

[0025] It can be understood that when the camera is on, the camera performs image acquisition in real time and transmits the acquired scan image to the processor, so that at each time, the processor can obtain the current scan image acquired by the camera.

[0026] In step 120, perform character recognition on the current scanned image to obtain a current scanned text, and stitch the current scanned text after a previous scanned text to obtain a current scanned text.

[0027] Specifically, the processor performs character recognition on the current scanned image to obtain the characters contained in the current scanned image, i.e., the current scanned characters. It can be understood that the characters contained in a single scanned image may be one or more.

[0028] Considering that in the scanning process, a user generally presses the pen tip of a handheld reader against a medium and slides it, the currently scanned character is generally the character following the scanned character at the moving time before the current time. Therefore, after obtaining the currently scanned character, the currently scanned character can be stitched after the previously scanned text, thereby obtaining the currently scanned text. Here, for the same time, the difference between the scanned text and the scanned character is that the scanned character is a character obtained by directly recognizing based on the scanned image, while the scanned text is a text obtained by stitching the previously scanned content and the currently scanned character. For example, if the previously scanned text is "if I am", and the currently scanned character is "a feather", the currently scanned text is "if I am a feather".

[0029] In step 130, the current scanned image is displayed or the current scanned image and scanned text are displayed synchronously until the camera enters an off state.

[0030] Specifically, the current scanned image and the scanned text may be displayed separately, and a specific display manner may be to display the current scanned image in real time on the display screen of the pen body of the handheld reader during the scanning process, and to display the finally obtained scanned text and / or related content of the scanned text on the display screen of the pen body of the handheld reader after the scanning is completed. Here, the related content of the scanned text may be an interpretation of the scanned text, a translation of the scanned text, etc., and the display screen for displaying the scanned image and the display screen for displaying the scanned text and / or related content of the scanned text may be the same display screen of the handheld reader or different display screens of the handheld reader.

[0031] The current scanned image and scanned text may be displayed synchronously. A specific display method may be to divide one display screen on the pen body of the handheld reader into two display areas to display the scanned image and scanned text respectively, or to display the scanned image and scanned text respectively on two display screens on the pen body of the handheld reader.

[0032] Compared with the technical solution of using a transparent observation panel in the common technology to provide the user with a view window of the characters being collected, it can be understood that displaying the current scanned image in the embodiment of the present invention replaces the hardware structural design based on the observation panel, ensuring that the user can intuitively view the characters being collected during the use process, while at the same time contributing to the realization of the integrated structural design of the handheld reader.

[0033] When the camera is on, the current scanned image and scanned text can be displayed in real time at any time. The real-time updated display of the scanned image and scanned text enables the user to synchronously view the collection status and recognition status during the use process, and helps the user adjust the sliding direction of the handheld reader in real time when scanning, thereby improving the accuracy of word extraction by scanning.

[0034] In addition, the camera can be turned off by the user lifting the handheld reader, and the mechanical touch scan head switch at the tip of the handheld reader is released, or the trigger of the pressure sensor at the tip of the pen disappears with the lifting of the pen, thereby generating an off trigger signal to turn off the camera. Or the user can realize the transmission of the off trigger signal by the scan button installed on the handheld reader, and thereby control the turning off of the camera.

[0035] It can be understood that after entering the off state, the camera will not perform image collection, will not transmit scanned images to the processor, will stop updating based on the current scanned image and scanned text, and the processor will not display the scanned image and scanned text in real time through the display screen, and the user can also directly know whether the scanning function is still running from the content displayed on the pen body of the handheld reader.

[0036] The method according to the embodiment of the present invention provides the user with a technical solution of viewing window of collected characters by displaying the current scanned image, instead of the hardware structural design based on the transparent observation panel of the handheld reader, which helps to realize the integration of the structural design of the handheld reader and prolong the service life of the handheld reader. In addition, the synchronous display of the scanned image and the scanned text allows the user to synchronously view the collection situation and the recognition situation during the use process, which helps the user to adjust the sliding direction of the handheld reader in real time, thereby improving the accuracy of scanning to pick up words, and further optimizing the user experience.

[0037] Based on the above embodiment, in step 120, performing character recognition on the current scanned image includes: The method includes determining a recognition area in the scanned image, performing character recognition on the recognition area, and marking the recognition area in the scanned image.

[0038] Specifically, in the process of character recognition on a scanned image, taking into consideration influencing factors such as the mounting position of the camera on the handheld reader and the environmental lighting when the camera collects the image, it is necessary to determine an effective area that can be used for character recognition, i.e., a recognition area, from the scanned image, and then perform character recognition on the recognition area in the scanned image.

[0039] Here, the recognition area in the scanned image may be determined based on configuration parameters set at the time of shipment of the handheld reader, or may be determined based on the brightness of the actual scanned image, and the embodiment of the present invention does not specifically limit this.

[0040] Considering that the recognition area may reflect the actual boundary for character recognition, before displaying the scan image, the recognition area may be marked in the scan image, for example, by framing the recognition area in the scan image in the form of a dashed or solid frame, or by highlighting the recognition area in the scan image, or by drawing the recognition boundary of the recognition area in the scan image, and then the scan image with the marked recognition area may be displayed.

[0041] The method according to the embodiment of the present invention allows a user to intuitively see the position difference between the current sliding position of the handheld reader and the area where recognition is actually performed by displaying the scan image with the recognition area marked, so that the user can more easily adjust the sliding direction when scanning the handheld reader. Also, by displaying the scan image with the recognition area marked, the user can intuitively see the characters currently in the recognition boundary, so that the user can easily determine the timing to stop collecting.

[0042] According to any of the above embodiments, in step 120, after performing character recognition on the current scanned image to obtain a current scanned character, The method further includes obtaining a character area in the currently scanned image where the currently scanned character is located, and marking the character area in the currently scanned image.

[0043] Specifically, after recognizing the scanned characters in the scanned image, a character area of ​​the scanned characters in the scanned image can be obtained, and the character area is used to reflect the position of the scanned characters in the scanned image. Here, when a single scanned character is obtained, the area corresponding to the detection frame of the scanned character directly obtained in the character recognition process can be the character area of ​​the scanned character. When multiple scanned characters are obtained, the detection frames of each scanned character obtained in the character recognition process can be combined to form an area corresponding to the circumscribing frames of all the detection frames, which is the character area.

[0044] Considering that the text area can reflect the real situation of character recognition, before the scan image is displayed, the text area may be marked in the scan image, for example, in the form of a dashed or solid frame, or the lower edge of the text area may be underlined in the scan image of the character to be recognized, and then the scan image with the text area marked can be displayed.

[0045] The method according to an embodiment of the present invention displays a scanned image with marked character areas, allowing a user to intuitively see which characters are currently recognized by the handheld reader; especially when the scanned image contains multiple lines of characters, the marks on the character areas allow the user to more intuitively and clearly know which characters are currently recognized in the scanned image, thereby enabling the user to quickly determine whether the current scan collection is accurate or not, thereby ensuring the accuracy of the scan.

[0046] Based on any of the above embodiments, step 130 includes: displaying the currently scanned image in a first area and simultaneously displaying the currently scanned text in a second area; The first area and the second area are two display areas of the same display screen, or the first area and the second area belong to two display screens, respectively.

[0047] Specifically, the synchronous display of the scanned image and the scanned text may be realized in one of the following two ways.

[0048] In one embodiment, the scanned image and the scanned text are displayed in two display areas of the same display screen. For example, FIG. 2 is a schematic diagram of the structure of the handheld reader according to the present invention, in which the handheld reader 10 shown in FIG. 2 has a complete display screen 20 installed on the pen body, and no observation panel is installed on the pen tip 30. In the scanning process, the display area of ​​the display screen 20 may be subjected to a screen division process, that is, the display area of ​​the display screen 20 is divided into two parts, one part is a first area, and the other part is a second area, where the first area is used to display the current scanned image, and the second area is used to display the current scanned text.

[0049] It can be understood that the first and second areas obtained by the screen division process can synchronously display the scanned image and the scanned text. Preferably, the first area is closer to the pen tip than the second area, so as to meet the user's usage habits and better replace the display role of the observation panel.

[0050] In addition, after the scanning is completed, i.e., when it is no longer necessary to synchronously display the scanned image and the scanned text, a screen merging process is performed on the first and second areas of the display screen 20, i.e., the display area of ​​the display screen 20 is subsequently displayed as the entirety.

[0051] Also, during the scanning process, if only the scanned image and not the scanned text is displayed, the display screen 20 may display the scanned image as the complete display area.

[0052] The second one is to provide two display screens, one display screen displays the scanned image, and the other display screen displays the scanned text. For example, Fig. 3 is a second schematic diagram of the structure of the handheld reader according to the present invention, and the handheld reader 10 shown in Fig. 3 has two display screens, a first display screen 21 and a second display screen 22, provided on the pen body, and no observation panel is provided on the pen tip 30. During the scanning process, the first display screen 21 displays the current scanned image in real time, and the second display screen 22 displays the current scanned text in real time, thereby realizing the synchronous display of the scanned image and the scanned text.

[0053] In accordance with any of the above embodiments, the method comprises: and displaying the scanned text and / or related content of the scanned text in a third area when the camera is in an off state; The third region includes the first region and the second region, or the third region is the second region.

[0054] Specifically, after the camera enters the off state, it will not perform image collection, will not transmit the scanned image to the processor, and will stop updating based on the current scanned image and scanned text. The processor will display the scanned text and / or related content of the scanned text, where the scanned text is the scanned text at the last time when the camera is in the on state, and the related content of the scanned text may be determined based on the function settings of the handheld reader, for example, the related content may be an interpretation of the scanned text, a translation of the scanned text, etc.

[0055] Display for the scanned text and / or the associated content of the scanned text may be realized in a third area, where the third area may be determined according to the configuration setting of the handheld reader itself.

[0056] For example, in the handheld reader 10 shown in Fig. 2, the third region may be the entire display area of ​​the display screen 20, i.e., the third region may be the display area after the first and second regions, which are divided in the scanning process, are merged, i.e., the scanned text and / or the related content of the scanned text may be displayed in full screen on the display screen 20 of the handheld reader 10 shown in Fig. 2.

[0057] Also, for example, in the handheld reader 10 shown in FIG. 3, the third area may be the display area of ​​the second display screen 22, that is, the third area may be the second area for displaying the scanned text in the above embodiment.

[0058] According to any of the above embodiments, after displaying the scanned text and / or the related content of the scanned text in the third area, determining target segmented words from the scanned text and / or associated content of the scanned text in response to a trigger command; and displaying related content of the target segmented words in the fourth area; When the third region includes the first region and the second region, the fourth region is a part of the third region, and when the third region is the second region, the fourth region is the first region.

[0059] Specifically, when the handheld reader displays the scanned text and / or the contents related to the scanned text, the user may issue a trigger command to the handheld reader through a button installed on the handheld reader, or through a touch screen of the handheld reader, or in the form of voice input, where the trigger command is used to trigger a query function, and the trigger command may carry a target segmented word that needs to be queried, where the query function may specifically be a translation query, an interpretation query, etc., and the embodiment of the present invention is not specifically limited thereto.

[0060] After the processor of the handheld reader receives the trigger command, it may determine the target segmented words that need to be queried from the currently displayed scanned text and / or the related content of the scanned text in response to the trigger command, and then may call a local database or a cloud database to obtain the related content of the target segmented words, specifically, the translation, interpretation, etc. of the target segmented words.

[0061] After obtaining the related content of the target segmented word, the related content of the target segmented word may be displayed in a fourth area, where the fourth area may be determined according to the structure setting of the handheld reader itself.

[0062] 2, the fourth region may be a part of the display region of the display screen 20, for example, the fourth region may be a first region after performing screen division on the display screen 20, or the fourth region may be a partial region obtained after performing another type of screen division on the display screen 20. By displaying in regions, the hierarchical nature of the display of the handheld reader can be increased, which is convenient for the user to compare and view, and optimizes the user experience.

[0063] Also, for example, in the handheld reader 10 shown in FIG. 3, the fourth area may be the display area of ​​the first display screen 21, that is, the fourth area may be the first area, in which case the first display screen 21 may display the relevant content of the target divided word, and the second display screen 22 may display the scanned text and / or the relevant content of the scanned text, thereby increasing the hierarchical nature of the display of the handheld reader, which is convenient for users to compare and view, and optimizing the user experience.

[0064] Based on any of the above embodiments, the present invention provides a display method, which is applied to the handheld reader shown in FIG. 2, and includes the following steps:

[0065] Receive an on-trigger signal, and control the camera to enter an on state according to the on-trigger signal, and obtain the current scan image collected by the camera. The on-trigger signal may be generated by pressing a mechanical touch scan head switch at the pen tip of the handheld reader, or by triggering a pressure sensor at the pen tip with the pen tip being pressed, or may be triggered by a scan button installed on the pen body, or by selecting a screen division function on the display screen of the pen body.

[0066] Character recognition is performed on the current scanned image to obtain a current scanned text, and the current scanned text is stitched after the previous scanned text to obtain the current scanned text.

[0067] The display screen is divided into a first area, in which the scanned image is displayed, and a second area, in which the scanned text is displayed, thereby realizing the synchronous display of the scanned image and the scanned text. Fig. 4 is a first schematic diagram of the display according to the present invention. As shown in Fig. 4, the display screen is divided into two areas, namely, a first area 41 and a second area 42. The first area 41 displays the scanned image, and the scanned text corresponding to the scanned image is "I am a bird", and the second area 42 displays the scanned text, which is "If I were a bird". In addition, a blinking cursor is displayed after the scanned text, which is used to indicate that the scanned text is being updated in real time.

[0068] Also, the camera may receive an off trigger signal and control the camera to enter an off state based on the off trigger signal. The off trigger signal may be generated when a mechanical touch scan head switch at the pen tip of the handheld reader is released or when the trigger of a pressure sensor at the pen tip disappears as the pen tip is lifted, or may be triggered by a scan button installed on the pen body, or a split screen cancel function or full screen setting function on the display screen of the pen body.

[0069] After the camera enters the off state, the display screen may display the scanned text and / or the contents related to the scanned text. Figure 5 is a second schematic diagram of the display according to the present invention. As shown in Figure 5, the display screen does not split the screen, but displays the scanned text and the translated text on the full screen.

[0070] Based on any of the above embodiments, the present invention provides a display method, which is applied to the handheld reader shown in FIG. 3, and the method includes the following steps:

[0071] Receive an on-trigger signal, and control the camera to enter an on state according to the on-trigger signal, and obtain the current scan image collected by the camera. The on-trigger signal may be generated by pressing a mechanical touch scan head switch at the pen tip of the handheld reader, or by triggering a pressure-sensitive sensor at the pen tip with the pen tip being pressed, or may be triggered by a scan button installed on the pen body.

[0072] Character recognition is performed on the current scanned image to obtain a current scanned text, and the current scanned text is stitched after the previous scanned text to obtain the current scanned text.

[0073] The display screen is divided into two areas, the first area displays the scanned image, and the second area displays the scanned text, thereby realizing the synchronous display of the scanned image and the scanned text. Figure 6 is a third schematic diagram of the display according to the present invention. As shown in Figure 6, the handheld reader is equipped with two screens, which display the scanned image and the scanned text respectively, and a blinking cursor is displayed after the scanned text, which is used to indicate that the scanned text is being updated in real time.

[0074] In addition, in actual scanning, due to limitations in font size and line spacing, the scanned image often contains multiple lines of text, so the text area in which the currently scanned text is located in the currently scanned image is obtained, and the text area is marked in the scanned image, so that the user can more intuitively and clearly know which text is currently being recognized in the image scanned by the user. Figure 7 is the fourth schematic diagram of the display according to the present invention, as shown in Figure 7, an underline is displayed under the scanned text "I am a bird" in the scanned image to indicate the text area, so that the user can easily know which text is currently being scanned and recognized.

[0075] In addition, considering the mounting position of the camera on the handheld reader and the influencing factors such as the environmental lighting when the camera collects images, it is necessary to determine the effective area available for character recognition, i.e., the recognition area, from the scanned image, and before displaying the scanned image, the recognition area is marked on the scanned image. Figure 8 is a fifth schematic diagram of the display according to the present invention, and as shown in Figure 8, the effective area that can be recognized on the scanned image is marked in the form of a dashed frame, that is, in the scanned image shown in Figure 8, "I am a bird" is within the recognition area, and "bird" is outside the recognition area and has not been recognized, and the corresponding displayed scanned text is "If I am a bird". Marking and displaying the recognition area allows the user to intuitively see the characters currently in the recognition boundary, and thus makes it easier to determine when to stop collecting.

[0076] It may also receive an off trigger signal and control the camera to enter an off state based on the off trigger signal. The off trigger signal may be generated when a mechanical touch scan head switch at the pen tip of the handheld reader is released, or when the trigger of a pressure sensor at the pen tip disappears as the pen tip is lifted, or may be triggered by a scan button installed on the pen body.

[0077] After the camera enters the off state, the display screen may display the scanned text and / or the related content of the scanned text. Figure 9 is a sixth schematic diagram of the display according to the present invention, as shown in Figure 9, the display screen originally for displaying the scanned text continues to display the scanned text and / or the related content of the scanned text, and the display screen originally for displaying the scanned image becomes a rest screen.

[0078] Also, after receiving the trigger command, the processor may determine the target segmented words that need to be queried from the currently displayed scan text and / or the related content of the scan text in response to the trigger command. Then, a local database or a cloud database may be called to obtain the related content of the target segmented words, which may be the translation, interpretation, etc. of the target segmented words. After obtaining the related content of the target segmented words, the related content of the target segmented words may be displayed on the display screen originally used for displaying the scan image. FIG. 10 is a seventh schematic diagram of a display according to the present invention. As shown in FIG. 10, one display screen is used to display the interpretation of the target segmented word "hoarseness", and another display screen is used to display the scan text and its translation text.

[0079] Based on any of the above embodiments, FIG. 11 is a schematic diagram of the structure of a display device according to the present invention. As shown in FIG. 11, the device includes: a collection unit 1110, which is used to obtain a current scan image collected by the camera when the camera is in an on state; A recognition unit 1120 is used for performing character recognition on the current scanned image to obtain a current scanned text, and stitching the current scanned text after a previous scanned text to obtain a current scanned text; and a display unit 1130, which is used to display the current scanned image or synchronously display the current scanned image and scanned text until the camera enters an off state.

[0080] The device according to the embodiment of the present invention displays the current scanned image, providing the user with a technical solution of a view window of the collected characters, instead of the hardware structural design based on the transparent observation panel of the handheld reader, which contributes to the realization of the integration of the structural design of the handheld reader and prolongs the service life of the handheld reader. In addition, the synchronous display of the scanned image and the scanned text allows the user to synchronously view the collection situation and the recognition situation during the use process, which helps the user to adjust the sliding direction of the handheld reader in real time, thereby improving the accuracy of scanning to pick up words, and further optimizing the user experience.

[0081] Based on any of the above embodiments, the recognition unit specifically comprises: The method is used to determine a recognition area in the scanned image, perform character recognition on the recognition area, and mark the recognition area in the scanned image.

[0082] Based on any of the above embodiments, the recognition unit further comprises: The method is used to obtain a character area in the currently scanned image where the currently scanned character is located, and to mark the character area in the currently scanned image.

[0083] Based on any of the above embodiments, the display unit specifically comprises: A first area is used to display the currently scanned image, and a second area is used to display the currently scanned text, The first area and the second area are two display areas of the same display screen, or the first area and the second area belong to two display screens, respectively.

[0084] Based on any of the above embodiments, the display unit further comprises: When the camera is in an off state, a third area is used to display the scanned text and / or the content related to the scanned text; The third region includes the first region and the second region, or the third region is the second region.

[0085] Based on any of the above embodiments, the display unit further comprises: determining target segmented words from the scanned text and / or associated content of the scanned text in response to a trigger command; and displaying related content of the target segmented word in the fourth area; When the third region includes the first region and the second region, the fourth region is a part of the third region, and when the third region is the second region, the fourth region is the first region.

[0086] Based on any of the above embodiments, FIG. 12 is a schematic diagram of the structure of a handheld reader according to the present invention. As shown in FIG. 12, the handheld reader includes a camera 1210, a processor 1220, and a display screen 1230 connected in sequence; When the camera 1210 is in an on state, the processor 1220 is used for: acquiring a current scanned image collected by the camera 1210; performing character recognition on the current scanned image to obtain a current scanned text; stitching the current scanned text after a previous scanned text to obtain a current scanned text; and controlling the display screen 1230 to display the current scanned image or synchronously display the current scanned image and the scanned text until the camera 1210 enters an off state.

[0087] The handheld reader according to the embodiment of the present invention displays the current scanned image, providing the user with a technical solution of a view window of the collected characters, instead of the hardware structural design based on the transparent observation panel, which helps to realize the integration of the structural design of the handheld reader and prolong the service life of the handheld reader. In addition, the synchronous display of the scanned image and the scanned text allows the user to synchronously view the collection situation and the recognition situation during the use process, which helps the user to adjust the sliding direction of the handheld reader in real time when scanning, thereby improving the accuracy of scanning to pick up words, and further optimizing the user experience.

[0088] FIG. 13 is a schematic diagram illustrating an embodiment of an electronic device. As shown in FIG. 13, the electronic device may include a processor 1310, a communications interface 1320, a memory 1330, and a communications bus 1340, where the processor 1310, the communications interface 1320, and the memory 1330 communicate with each other via the communications bus 1340. The processor 1310 can call logic commands in the memory 1330 to execute a display method. The method includes: when the camera is in an on state, acquiring a current scan image collected by the camera, performing character recognition on the current scan image to obtain a current scan text, stitching the current scan text after a previous scan text to obtain a current scan text, and displaying the current scan image or synchronously displaying the current scan image and the scan text until the camera enters an off state.

[0089] Moreover, the logic instructions in the memory 1330 may be realized in the form of a software functional unit, and may be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, its essence or a part contributing to the prior art or a part of the technical solution, may be embodied in the form of a software product, and the computer software product is stored in a storage medium and includes some instructions for causing a computer device (for example, which may be a personal computer, a server, or a network device, etc.) to execute all or some of the steps of the method according to each embodiment of the present invention. However, the storage medium includes various media capable of storing program code, such as a USB disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0090] Meanwhile, the present invention further provides a computer program product, which includes a computer program, which may be stored in a non-transitory computer-readable storage medium, and when the computer program is executed by a processor, the computer can execute the display method according to each of the above methods, which includes: when a camera is in an on state, acquiring a current scan image collected by the camera, performing character recognition on the current scan image to obtain a current scan text, stitching the current scan text after a previous scan text to obtain a current scan text, and displaying the current scan image or synchronously displaying the current scan image and the scan text until the camera enters an off state.

[0091] On the other hand, the present invention further provides a non-transitory computer-readable storage medium storing a computer program, which, when executed by a processor, can perform the display method according to each of the above methods, including: obtaining a current scan image collected by the camera when the camera is in an on state, performing character recognition on the current scan image to obtain a current scan text, stitching the current scan text after a previous scan text to obtain a current scan text, and displaying the current scan image or synchronously displaying the current scan image and the scan text until the camera enters an off state.

[0092] The above-described embodiment of the device is merely exemplary, and the units described herein as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed among multiple network units. The objective of the technical solution of the present embodiment can be achieved by selecting some or all of the modules herein according to actual needs. Those skilled in the art can understand and implement it without any creative effort.

[0093] From the above description of the embodiments, it is clear to those skilled in the art that each embodiment may be realized by combining a necessary common hardware platform and software, or may be realized by hardware. Based on this understanding, the above technical proposals, their essence or a part that contributes to the prior art, may be embodied in the form of a software product. The computer software product may be stored in a computer-readable storage medium such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be, for example, a personal computer, a server, or a network device, etc.) to execute the method described in each embodiment or several parts of the embodiment.

[0094] Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art can still modify the technical solutions described in the above embodiments or replace some of the technical features with equivalents, and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention. [Explanation of symbols]

[0095] 10: Handheld reader 20:Display screen 30: Pen tip 21: 1st display screen 22:Second display screen 41:First area 42:Second area.

Claims

1. When a camera is in an on state, acquiring a current scan image collected by the camera; performing character recognition on the current scanned image to obtain a current scanned text, and stitching the current scanned text after a previous scanned text to obtain a current scanned text; displaying the current scanned image or synchronously displaying the current scanned image and scanned text until the camera enters an off state; The above-mentioned performing character recognition on the current scanned image includes: determining a recognition area in the scanned image, performing character recognition on the recognition area, and marking the recognition area in the scanned image prior to displaying the scanned image; After performing character recognition on the current scanned image to obtain the current scanned character, The display method further includes obtaining a character area in the current scanned image in which the currently scanned character is located, and marking the character area in the scanned image before displaying the scanned image.

2. The synchronous display of the current scanned image and the scanned text may include: displaying the currently scanned image in a first area and simultaneously displaying the currently scanned text in a second area; The display method according to claim 1 , wherein the first area and the second area are two display areas of the same display screen, or the first area and the second area belong to two display screens, respectively.

3. and displaying the scanned text and / or related content of the scanned text in a third area when the camera is in an off state; The display method according to claim 2 , wherein the third region includes the first region and the second region, or the third region is the second region.

4. After displaying the scanned text and / or the related content of the scanned text in the third area, determining target segmented words from the scanned text and / or associated content of the scanned text in response to a trigger command; and displaying related content of the target segmented words in a fourth area. The display method according to claim 3, characterized in that when the third region includes the first region and the second region, the fourth region is a part of the third region, and when the third region is the second region, the fourth region is the first region.

5. a capture unit for capturing a current scan image captured by the camera when the camera is in an on state; A recognition unit is used for performing character recognition on the current scanned image to obtain a current scanned character, and stitching the current scanned character after a previous scanned text to obtain a current scanned text; A display unit is used for displaying the current scanned image or synchronously displaying the current scanned image and scanned text until the camera enters an off state; The above-mentioned performing character recognition on the current scanned image includes: determining a recognition area in the scanned image, performing character recognition on the recognition area, and marking the recognition area in the scanned image prior to displaying the scanned image; After performing character recognition on the current scanned image to obtain a current scanned character, a display device for displaying a character region of the currently scanned character in the currently scanned image, the character region being marked in the currently scanned image before the currently scanned image is displayed;

6. a camera, a processor, and a display screen, connected in sequence; The processor is used to perform the following operations when the camera is in an on state: acquire a current scan image collected by the camera; perform character recognition on the current scan image to obtain a current scan text; stitch the current scan text after a previous scan text to obtain a current scan text; and control the display screen to display the current scan image or synchronously display the current scan image and the scan text until the camera enters an off state; The above-mentioned performing character recognition on the current scanned image includes: determining a recognition area in the scanned image, performing character recognition on the recognition area, and marking the recognition area in the scanned image prior to displaying the scanned image; After performing character recognition on the current scanned image to obtain a current scanned character, A handheld reader comprising: obtaining a character area in the currently scanned image where the currently scanned character is located; and marking the character area in the currently scanned image before displaying the currently scanned image.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, the electronic device realizing the display method according to any one of claims 1 to 4 when the processor executes the computer program.

8. A non-transitory computer-readable storage medium having a computer program stored therein, the non-transitory computer-readable storage medium being characterized in that, when the computer program is executed by a processor, the non-transitory computer-readable storage medium realizes the display method according to any one of claims 1 to 4.

Images