Display method, device, handheld reader, electronic device, and storage medium

The display method enhances the clarity of scanned content by highlighting the area of character recognition results, addressing the challenge of accurately determining the scanned line in pen-type electronic dictionaries.

JP2026501442APending Publication Date: 2026-01-15HEFEI IFLYTEK TOYCLOUD TECH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2025529882
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-04-25
Filing Date
2023-09-13
Publication Date
2026-01-15

AI Technical Summary

Technical Problem

The display effect of pen-type electronic dictionaries is not ideal when scanning small characters, as multiple lines of characters are displayed in a limited sub-screen window, making it difficult for users to determine which line is being scanned accurately.

Method used

A display method that distinguishes between a first area where character recognition results are located and a second area where they are not, displaying the first area in a highlighted form and the second area in a different form to enhance clarity.

Benefits of technology

Improves the accuracy of content capture and user experience by clearly distinguishing the currently scanned content, allowing users to accurately determine the line being captured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026501442000001_ABST
    Figure 2026501442000001_ABST
Patent Text Reader

Abstract

The present disclosure provides a display method, an apparatus, a handheld reader, an electronic device, and a storage medium, the method including: acquiring a scanned image; performing character recognition on the scanned image; determining an area in the scanned image where the result of the character recognition is located as a first area; determining an area in the scanned image other than the first area as a second area; and displaying the first area in a first form, or displaying the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to the field of computer technology, and more particularly to a display method, an apparatus, a handheld reader, an electronic device, and a storage medium. [Background technology]

[0002] The display screen of the current pen-type electronic dictionary is divided into at least two sub-screen windows, one of which displays image content photographed in real time by a camera, and the other sub-screen window displays content scanned and captured by the pen-type electronic dictionary from the start to the present time.

[0003] However, when a sub-screen window on the display screen is used to display the image content captured in real time by the camera and relatively small characters are scanned, multiple lines of characters are displayed in the sub-screen window, and the size of the sub-screen window is limited, so the user cannot accurately determine which line of characters is currently being scanned and captured. As a result, the display effect when the user uses the pen-type electronic dictionary to scan and capture is not very ideal. Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a display method, device, handheld reader, electronic device and storage medium to solve the defect in the prior art that when a user scans using a pen-type electronic dictionary, the display effect of the scanned content is not very ideal. [Means for solving the problem]

[0005] The present disclosure provides a display method, obtaining a scan image; performing character recognition on the scanned image, determining an area in the scanned image where the result of the character recognition is located as a first area, and determining an area in the scanned image other than the first area as a second area; The display method includes displaying the first area in a first form, or displaying the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

[0006] According to the display method of the present disclosure, displaying the first region in a first form as described above includes: obtaining a scaling parameter for the first region; and displaying the first region at the scaling parameter in the first configuration.

[0007] According to the display method of the present disclosure, obtaining the scaling parameter of the first region includes: receiving a scaling operation and determining a first scaling parameter corresponding to the scaling operation; determining a second scaling parameter based on the user setting information; determining a third scaling parameter based on a history scaling operation corresponding to the first history region; determining a scaling parameter for the first region based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0008] According to the display method of the present disclosure, determining the second scaling parameter based on the user setting information includes: determining the second scaling parameter based on a font size in the user setting information and a font size in the first region;

[0009] According to the display method of the present disclosure, determining the third scaling parameter based on the history scaling operation corresponding to the first history region includes: performing area size matching based on size information of the first area and size information of the first history area to obtain a first reference history area that matches the first area; determining the third scaling parameter based on a history scaling operation corresponding to the first reference history region.

[0010] According to the display method of the present disclosure, determining a scaling parameter for the first region based on one of the first scaling parameter, the second scaling parameter, and the third scaling parameter includes: determining a scaling parameter threshold based on size information of a display area corresponding to the scanned image and size information of the first area; determining a scaling parameter for the first region based on the scaling parameter threshold and at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0011] The present disclosure further provides a display device, an acquisition unit used to acquire a scanned image; an area positioning unit used to perform character recognition on the scanned image, determine an area in the scanned image where the result of the character recognition is located as a first area, and determine an area in the scanned image other than the first area as a second area; and a display unit used to display the first area in a first form, or to display the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

[0012] The present disclosure further provides a handheld reader including a camera, a processor, and a display connected in series, the processor is used to acquire a scanned image collected by the camera, perform character recognition on the scanned image, determine an area in the scanned image where a result of the character recognition is located as a first area, and determine an area in the scanned image other than the first area as a second area; The display is used to display the first area in a first form, or to display the first area in the first form and the second area in a second form, the first form and the second form being different display forms.

[0013] In accordance with the handheld reader of the present disclosure, the display includes a first display area and a second display area; the first display area is for displaying the first area in a first form and the second area in a second form; The second display area is for displaying the result of the character recognition.

[0014] The present disclosure further provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable by the processor, which, when the processor executes the program, realizes any one of the display methods described above.

[0015] The present disclosure further provides a non-transitory computer-readable storage medium having a computer program stored thereon, the computer program realizing the display method according to any one of the above when executed by a processor.

[0016] The present disclosure further provides a computer program product including a computer program, which when executed by a processor, realizes any one of the display methods described above. [Effects of the Invention]

[0017] The display method, device, handheld reader, electronic device, and storage medium according to the present disclosure acquire a scanned image, perform character recognition on the scanned image, and determine an area in the scanned image where the character recognition result is located as a first area, and determine an area in the scanned image other than the first area as a second area. By displaying the first area in a first form, or by displaying the first area in the first form and the second area in a second form different from the first form, a clear display of the currently captured content is realized, improving the accuracy of the content that the user subsequently captures and improving the user experience. [Brief explanation of the drawings]

[0018] In order to more clearly describe the embodiments of the present disclosure or the technical solutions in the prior art, the drawings necessary for describing the embodiments or the prior art will be briefly described below. Of course, the drawings in the following description are some embodiments of the present disclosure, and those skilled in the art can further obtain other drawings based on these drawings without creative work. [Figure 1] 1 is a flowchart of a display method according to the present disclosure. [Figure 2] 1 is a flowchart for determining scaling parameters according to the present disclosure. [Figure 3] FIG. 2 is a schematic diagram of a display area of ​​a scanned image according to the present disclosure. [Figure 4] FIG. 10 is a schematic diagram of a magnifying operation performed on a first region according to the present disclosure. [Figure 5] FIG. 10 is a schematic diagram of performing a shrink operation on a first region according to the present disclosure. [Figure 6] 1 is a schematic diagram of the structure of a display device according to the present disclosure; [Figure 7] 1 is a schematic diagram of the structure of a handheld reader according to the present disclosure; [Figure 8] 1 is a schematic diagram of the structure of a display of a handheld reader according to the present disclosure. [Figure 9] 1 is a schematic diagram of the structure of an electronic device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0019] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure will be described clearly and completely below with reference to the drawings in the present disclosure. Of course, the described embodiments are not all embodiments, but only some embodiments of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments that a person skilled in the art can obtain without creative work fall within the scope of protection of the present disclosure.

[0020] In this disclosure, a handheld reader is a device, such as a scanning pen or pen-type electronic dictionary, that can collect images through a camera and then recognize them through image stitching processing and algorithms to obtain the text content in the images. When a user collects images using the camera at the tip of the handheld reader, a sub-screen window is used to display the image content captured by the camera in real time, so that the user can intuitively see the text being collected. When scanning relatively small text, multiple lines of text are displayed in the sub-screen window, and because the size of the sub-screen window is limited, the user cannot accurately determine which line of text is currently being scanned and captured, resulting in inaccurate capture.

[0021] To address the above-mentioned problems, an embodiment of the present disclosure provides a display method for distinguishing currently captured content, improving capture accuracy and user experience. Figure 1 is a flowchart of the display method according to the present disclosure. As shown in Figure 1, the method includes steps 110, 120, and 130.

[0022] In step 110, a scan image is acquired.

[0023] Specifically, a scanned image can be obtained by collecting images using a camera mounted on the end of a handheld reader. In actual application, a user holds a handheld reader and touches the pen tip of the handheld reader to a medium, thereby pressing a mechanical touch scan head switch at the pen tip, or triggering a pressure sensor at the pen tip when the pen tip is pressed, thereby generating an ON trigger signal for activating the camera. Alternatively, a user can use a scan key mounted on the handheld reader to emit an ON trigger signal and control the activation of the camera. When the camera is turned on, the camera collects images in real time and transmits the collected scanned images to a processor, which can then acquire the scanned images collected by the camera.

[0024] In step 120, character recognition is performed on the scanned image, and an area in the scanned image where the character recognition result is located is determined as a first area, and an area in the scanned image other than the first area is determined as a second area.

[0025] Here, the scanned image may contain one line of text or multiple lines of text. Generally, when a handheld reader performs character recognition on a scanned image, it recognizes text within an effective area of ​​the scanned image. The effective area is a predetermined area based on the mounting method of the camera on the handheld reader, and is the area where character recognition can be performed. Thus, the result of performing character recognition on a scanned image may be the text content within the effective area of ​​the scanned image, specifically, one line or multiple lines of text, and the result of character recognition may reflect the text content currently scanned and captured by the handheld reader.

[0026] Specifically, character recognition can be performed on a scanned image using OCR (Optical Character Recognition) technology, and the character content within the valid area of ​​the scanned image can be used as the result of the character recognition, with the area in the scanned image where the result of the character recognition is located being used as the first area. For example, the first area can be the minimum bounding box of the result of the character recognition in the scanned image. Alternatively, the area in the scanned image other than the area where the result of the character recognition is located can be used as the second area.

[0027] It should be noted that the first region may be the entire valid area or a portion thereof. As will be understood, the valid area of ​​a scanned image is not necessarily completely occupied by characters, so the first region in which the character recognition results are located does not include blank areas in the valid area where there are no characters. Alternatively, incomplete characters may exist within the valid area, i.e., some characters may be within the valid area and other characters may be outside the valid area. Therefore, the first region in which the character recognition results are located does not include areas in the valid area where incomplete characters exist.

[0028] That is, in the first and second areas defined based on the results of character recognition, the first area is intended to identify the area in which characters being scanned are located, and the second area is intended to identify the area in which characters that have not been recognized and captured are located.

[0029] In step 130, the first region is displayed in a first form, or the first region is displayed in the first form and the second region is displayed in a second form, and the first form and the second form are different display forms.

[0030] Here, the first form may mark or highlight the display area. For example, marking the display area may mark the display area of ​​the first area in the form of a dashed or solid frame. Also, for example, highlighting the display area may fill the background of the display area with color to improve the display brightness of the display area. Here, the second form may be a display form that does not perform marking or highlighting and is different from the first form. As can be understood, compared to the first form, the first form can more clearly highlight and display the text content in the corresponding display area. For example, if the first form is a highlight display, the second form may be a normal display, i.e., no marking or highlighting is performed, or a blurring process is performed.

[0031] Specifically, the first region may be displayed in a highlighted form and the display window may be color-rendered to emphasize the first region and clearly display the character content therein. Alternatively, the first region may be displayed in a first form, and the second region may be displayed without any processing. As can be understood, the first region may simply be displayed in the first form, allowing the user to determine the content and location of the currently scanned character based on the display window of the first region. Alternatively, the first region may be displayed in the first form, and the second region may be displayed in the second form, allowing the user to obtain not only the content and location of the currently scanned character, but also the content and location of the context of the currently scanned character. Displaying the first region, or the first and second regions, in these two forms can clearly distinguish and display the currently captured content and further guide the user's next capture operation.

[0032] A method according to an embodiment of the present disclosure includes acquiring a scanned image, performing character recognition on the scanned image, determining an area in the scanned image where the character recognition result is located as a first area, and determining an area in the scanned image other than the first area as a second area. By displaying the first area in a first form, or by displaying the first area in the first form and the second area in a second form different from the first form, a clear display of the currently captured content is realized, which improves the accuracy of the content that the user subsequently captures and also improves the user experience.

[0033] According to any one of the above embodiments, displaying the first region in a first form includes: obtaining a scaling parameter for the first region; and displaying the first region at the scaling parameter in the first configuration.

[0034] Here, the scaling parameter may include a scaling value, which may reflect a specific numerical value, for example, a size value or a magnification, reached by specifically enlarging or reducing the first region. Also, the scaling parameter may include a scaling instruction, which may reflect specifically whether to perform a reduction operation or an enlargement operation on the first region.

[0035] Specifically, a scaling value for a preset scaling parameter may be acquired, and the acquired scaling value may be compared with the size of the first region, where the size of the first region may be the width and height of the first region. For example, in terms of the height of the first region, if the scaling value for the scaling parameter is greater than the height of the first region, the scaling instruction for the scaling parameter is an enlargement operation, and if the scaling value for the scaling parameter is less than the height of the first region, the scaling instruction for the scaling parameter is a reduction operation. Alternatively, the scaling parameter may be acquired based on a user's scaling operation. Alternatively, the scaling parameter may be acquired based on a user's history of scaling operations.

[0036] Next, the first region is enlarged or reduced to a corresponding scaling value according to the scaling instruction and scaling value in the scaling parameter, thereby realizing the first region with the scaling parameter to be displayed in a first form.

[0037] The method according to an embodiment of the present disclosure further improves the clarity of the text content in the first region by obtaining scaling parameters for the first region and displaying the first region in a first form with the scaling parameters, which is more advantageous for the user to accurately obtain the text content currently being scanned and captured.

[0038] Generally, in an actual operation, the character recognition result may be the first half of a word, the left half of a character, or the first few characters of a word. The height of the first region corresponds to the height of the character in the character recognition result, thereby allowing the character recognition result to be displayed completely, but the width of the first region is generally not specifically limited. Therefore, the scaling value of the scaling parameter may be relative to the height of the first region. Correspondingly, displaying the first region in a first form using the scaling parameter may mean displaying the first region in a first form with the scaling value of the scaling parameter as the height of the first region.

[0039] Based on any one of the above embodiments, FIG. 2 is a flowchart for determining scaling parameters according to the present disclosure. As shown in FIG. 2, obtaining the scaling parameters of the first region includes at least one of step 211, step 212, and step 213, and step 220.

[0040] In step 211, a scaling operation is received and a first scaling parameter corresponding to the scaling operation is determined. Specifically, the scaling parameters may be determined based on a user's scaling operation.

[0041] The scaling operation here may involve receiving a sliding operation on the display by a user and determining a first scaling parameter corresponding to the sliding operation based on the movement and width of the sliding operation. For example, the movement of the sliding operation may determine whether to perform an enlargement operation or a reduction operation on the first region. For example, when two fingers slide outward on the display, the movement corresponding to the sliding operation is enlargement, and when the two fingers slide inward, the movement corresponding to the scaling operation is reduction. Next, the preset threshold is adjusted based on the size of the first region that is not currently scaled. For example, if the movement of the sliding operation is an enlargement operation, the preset threshold is added to the size of the first region that is not currently scaled. If the movement of the sliding operation is a reduction operation, the preset threshold is subtracted from the size of the first region that is not currently scaled. Finally, the first scaling parameter corresponding to the sliding operation, i.e., the first scaling parameter corresponding to the scaling operation, is obtained.

[0042] The scaling operation here may be a scaling operation that occurs when a user presses a button on the pen body of the handheld reader. It may also be a volume key or a button similar to a volume key. For a scaling operation using the volume key, the volume up key may be an enlargement operation key and the volume down key may be a reduction operation key. A first scaling parameter for the scaling operation is determined by presetting a preset threshold that allows the size of the first region to be adjusted by pressing the volume key once. For example, pressing the volume up key once adds the preset threshold to the size of the currently unscaled first region. Pressing and holding the volume up key sequentially adds the preset threshold to the size of the first region according to the number of times the key is pressed. Pressing the volume down key once subtracts the preset threshold from the size of the currently unscaled first region. Pressing and holding the volume down key sequentially subtracts the preset threshold from the size of the first region according to the number of times the key is pressed, ultimately obtaining the first scaling parameter for the scaling operation.

[0043] In step 212, a second scaling parameter is determined based on the user setting information.

[0044] Specifically, the scaling parameter may be determined based on predetermined user setting information. Here, the user setting information may include setting information for the user to display characters in the first area, such as the font size of the characters in the first area, the color for highlighting the characters, and the size of the first area. It may also include user identification information, such as the user's age. Specifically, in terms of the font size of the characters in the first area in the user setting information, the font size of the characters in the first area may be acquired from the user setting information, and the size of the first area corresponding to each font size may be preset. The size of the first area corresponding to the font size information set by the user may then be used as the second scaling parameter. Alternatively, the second scaling parameter may be determined by presetting different character font sizes corresponding to different age information and the size of the first area corresponding to the font size based on the age information in the user setting information. As can be understood, the appropriate font size varies for users of different age groups. For example, for users aged 3 to 8, the appropriate font size for viewing should be No. 3 (16 pt) or larger, and for users aged 8 and above, the appropriate font size for viewing should be No. 4 (12 pt) or larger.

[0045] In step 213, a third scaling parameter is determined based on the history scaling operation corresponding to the first history region.

[0046] Specifically, the scaling operation may be determined based on the user's historical operations. Here, the first historical area refers to a first area in which the character recognition results are located in the scanned image in a previous scan operation performed by the user. The first historical area may reflect different first areas corresponding to different scanned media before the current scan operation. For example, if the scanned media is a storybook, the font size of the characters in the storybook may be relatively large, and the size of the first area in this case may also be relatively large. If the scanned media is a textbook, the font size of the textbook may be relatively small, and the size of the first area in this case may also be relatively small.

[0047] The historical scaling operation here refers to a scaling operation performed by a user on a first region in a previous scanning operation. Generally, the historical scaling operation can reflect the user's preference for scaling the size of the corresponding first history region when the first history region is obtained. As can be understood, when the first region in the current scanning operation matches the first history region, the user is likely to perform a scaling operation on the first region, and the scaling parameters for the scaling operation are likely to be the same as the scaling parameters of the historical scaling operation. Thus, the third scaling parameter can be determined by the historical scaling operation corresponding to the first history region, referring to the user's historical preferences, thereby further improving the user experience.

[0048] In step 220, a scaling parameter for the first region is determined based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0049] The actual scaling parameter may be determined based on any one of the three scaling parameters. As will be understood, if one of the scaling parameters is obtained, that scaling parameter may be used as the actual scaling parameter. However, if multiple scaling parameters are obtained, the obtained scaling parameters are sorted according to priority, and the scaling parameter with the highest priority is selected as the scaling parameter for the first region. The priority order here may be, for example, the first scaling parameter, the second scaling parameter, and the third scaling parameter, from highest to lowest.

[0050] A method according to an embodiment of the present disclosure receives a scaling operation, determines a first scaling parameter corresponding to the scaling operation, determines a second scaling parameter based on user setting information, determines a third scaling parameter based on a history scaling operation corresponding to the first history region, and determines a scaling parameter for the first region based on one of the first scaling parameter, the second scaling parameter, and the third scaling parameter, thereby achieving a combined automatic and manual scaling operation for the first region, which makes the scaling operation for the first region more flexible, further makes the display effect of the first region clearer, and improves the user experience.

[0051] According to any one of the above embodiments, in step 212, determining the second scaling parameter based on user setting information includes: determining the second scaling parameter based on a font size in the user setting information and a font size in the first region;

[0052] Here, the font size in the user setting information refers to the font size of the characters in the first region preset by the user. The font size of the first region here refers to the font size of the character recognition result obtained by the current scan operation, i.e., the font size of the characters on the scanned medium. Specifically, the font size of the characters in the first region in the user setting information may be obtained and compared with the font size of the first region in the current scan operation. If the comparison results in a mismatch, the size of the first region corresponding to each font size is preset, and the size corresponding to the font size set by the user is used as the scaling value for the second scaling parameter. If the comparison results in a match, the scaling value for the second scaling parameter is set to the size corresponding to the current font size of the first region.

[0053] As can be understood, by determining the scaling parameters of the first region based on user setting information, it is possible to clearly display the characters in the first region without having to manually perform a scaling operation on the first region each time during the scanning process, especially during multiple scanning processes.

[0054] According to any one of the above embodiments, in step 213, determining a third scaling parameter based on a history scaling operation corresponding to the first history region may include: The method includes performing area size matching based on the size information of the first area and the size information of the first history area, and obtaining a first reference history area that matches the first area. Here, the size information of the first region may be size information of the first region in the current scan operation, i.e., the size of the region in the scanned image where the character recognition results are located. The size information of the first history region here may be the size of the region in the scanned image where the character recognition results are located in the scan operation prior to the current scan operation. Typically, when there are multiple first history regions, there is also multiple size information of the first history regions. As can be understood, the size information of the first region and the size information of the first history region here are directly determined by the size of the region in the scanned image where the character recognition results are located, i.e., the size information of the first region without scaling.

[0055] Specifically, size matching is performed among the size information of many first history areas according to the size information of the first area in the current scan operation, and the size information of the first history area that is the same as the size information of the first area in the current scan operation is set as the first reference history area. As can be understood, the scaling operation in the user's current scan operation is likely to be the same as the history scaling operation in the first reference history area.

[0056] The third scaling parameter is determined based on a history scaling operation corresponding to the first reference history region.

[0057] Here, the history scaling operation corresponding to the first reference history area refers to a scaling operation for the user to adjust the size of the first reference history area, and can reflect the user's preference for adjusting the size of the first area.

[0058] As can be understood, by performing area size matching based on the size information of the first area and the size information of the first history area, obtaining a first reference history area that matches the first area, and determining a third scaling parameter based on the history scaling operation corresponding to the first reference history area, it is possible to automatically perform a scaling operation on the first area, thereby improving the user experience.

[0059] According to any one of the above embodiments, determining a scaling parameter of the first region based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter includes: determining a scaling parameter threshold based on size information of a display area corresponding to the scanned image and size information of the first area; determining a scaling parameter for the first region based on the scaling parameter threshold and at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0060] Here, the size information of the display area corresponding to the scanned image refers to the size of the display area for displaying the scanned image, which in the case of a handheld reader may be the entire area of ​​the display or a part of the area of ​​the display. Generally, the size of the display area for displaying the scanned image in a handheld reader is fixed, and at the same time, when performing a scaling operation on the first area, the height of the first area should not exceed the height of the display area corresponding to the scanned image, in order to facilitate a user to clearly obtain the complete text information in the first area.

[0061] Specifically, the height in the size information of the display area corresponding to the scanned image may be set as the maximum threshold among the scaling parameter thresholds of the first area when performing a scaling operation, and a minimum threshold may not be set, or one threshold may be set in advance as the minimum threshold among the scaling parameter thresholds of the first area when performing a scaling operation.

[0062] Then, the scaling parameter of the first region may be determined by limiting at least one of the first, second, and third scaling parameters by a maximum threshold and a minimum threshold of the scaling parameter thresholds. For example, if the value of any scaling parameter is within a scaling parameter threshold range, the scaling parameter of the first region may be the scaling parameter; if the value of any scaling parameter exceeds a maximum or minimum threshold of the scaling parameter thresholds, the scaling parameter of the first region may be the maximum threshold if the scaling parameter exceeds the maximum threshold; if the value of any scaling parameter is below the minimum threshold, the scaling parameter of the first region may be the minimum threshold.

[0063] A method according to an embodiment of the present disclosure determines a scaling parameter threshold based on size information of a display area corresponding to a scanned image and size information of a first area, and determines a scaling parameter of the first area based on the scaling parameter threshold and one of the first scaling parameter, the second scaling parameter, and the third scaling parameter, thereby ensuring a complete display effect of the character recognition results in the first area, avoiding incomplete display of scanned characters due to scaling operations, and thus improving the user experience.

[0064] Based on any one of the above embodiments, the present disclosure further provides a display method, the method comprising: First, a scanned image is obtained, character recognition is performed on the scanned image, and an area in the scanned image where the character recognition result is located is determined as a first area, and an area in the scanned image other than the first area is determined as a second area.

[0065] Next, if the text content in the scanned image contains multiple lines of text, for example, more than two lines of text, the first area is displayed in a highlight window display format, and the second area is displayed in a display format without any processing. Figure 3 is a schematic diagram of the display area of ​​a scanned image according to the present disclosure. As shown in Figure 3, the display area at the left end of the figure is the area corresponding to the scanned image, and the area where "Is there" is located is the first area, which is displayed in a highlight window display format. Furthermore, the areas where "Work in" and "How man" are located are the second area.

[0066] Furthermore, the scaling parameters of the first region may be determined based on at least one of receiving a scaling operation, user setting information, and a history scaling operation corresponding to the first history region. A zoom-in or zoom-out operation can be performed on the first region. FIG. 4 is a schematic diagram illustrating a zoom-in operation on the first region according to the present disclosure. As shown in FIG. 4, in the leftmost display region of the figure, the size information of the first region is zoomed in until it matches the size information of the display region corresponding to the scanned image. This means that the second region does not need to be displayed, allowing the user to more intuitively obtain the content captured by the current scan operation. FIG. 5 is a schematic diagram illustrating a zoom-out operation on the first region according to the present disclosure. As shown in FIG. 5, in the leftmost display region of the figure, the size of the first region can be reduced. Compared with the character recognition results for the first region shown in FIG. 3, the handheld reader in FIG. 5 can display more character recognition results for the first region. As will be understood, when a scaling operation is performed on a first region, the size of the first region is scaled, but the size of the scanned image captured by the camera remains unchanged, i.e., the range captured by the camera does not change.

[0067] Based on any one of the above embodiments, FIG. 6 is a schematic diagram of the structure of a display device according to the present disclosure. As shown in FIG. 6, the device includes: an acquisition unit 610 for acquiring a scanned image; an area positioning unit 620 that performs character recognition on the scanned image, determines an area in the scanned image where the character recognition result is located as a first area, and determines an area in the scanned image other than the first area as a second area; and a display unit 630 that displays the first area in a first form, or that displays the first area in the first form and the second area in a second form, the first form and the second form being different display forms.

[0068] An apparatus according to an embodiment of the present disclosure acquires a scanned image, performs character recognition on the scanned image, and determines an area in the scanned image where the character recognition result is located as a first area, and determines an area in the scanned image other than the first area as a second area. By displaying the first area in a first form, or by displaying the first area in the first form and the second area in a second form different from the first form, a clear display of the currently captured content is realized, which improves the accuracy of the content that the user subsequently captures and also improves the user's usage experience.

[0069] Based on any one of the above embodiments, the display unit specifically includes: obtaining a scaling parameter for the first region; The scaling parameter is used to display the first region in the first form.

[0070] Based on any one of the above embodiments, the display unit specifically includes: receiving a scaling operation and determining a first scaling parameter corresponding to the scaling operation; determining a second scaling parameter based on the user setting information; determining a third scaling parameter based on a history scaling operation corresponding to the first history region; The scaling parameter of the first region is determined based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0071] Based on any one of the above embodiments, the display unit specifically includes: The second scaling parameter is used to determine the second scaling parameter based on the font size in the user setting information and the font size of the first region.

[0072] Based on any one of the above embodiments, the display unit specifically includes: performing area size matching based on the size information of the first area and the size information of the first history area to obtain a first reference history area that matches the first area; The third scaling parameter is used to determine the third scaling parameter based on a history scaling operation corresponding to the first reference history region.

[0073] Based on any one of the above embodiments, the display unit specifically includes: determining a scaling parameter threshold based on size information of a display area corresponding to the scanned image and size information of the first area; A scaling parameter for the first region is determined based on the scaling parameter threshold and at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

[0074] Based on any one of the above embodiments, the present disclosure further provides a handheld reader. FIG. 7 is a schematic diagram of the structure of the handheld reader according to the present disclosure. As shown in FIG. 7, the handheld reader includes a camera 710, a processor 720 and a display 730 connected in series; the processor 720 is used to acquire a scanned image collected by the camera 710, perform character recognition on the scanned image, determine an area in the scanned image where the character recognition result is located as a first area, and determine an area in the scanned image other than the first area as a second area; The display 730 is used to display the first area in a first form, or to display the first area in the first form and the second area in a second form, the first form and the second form being different display forms.

[0075] A handheld reader according to an embodiment of the present disclosure acquires a scanned image, performs character recognition on the scanned image, determines an area in the scanned image where the character recognition result is located as a first area, and determines an area in the scanned image other than the first area as a second area. By displaying the first area in a first form, or by displaying the first area in the first form and the second area in a second form different from the first form, a clear display of the currently captured content is realized, which improves the accuracy of the content that the user subsequently captures and also improves the user's usage experience.

[0076] According to any one of the above embodiments, FIG. 8 is a schematic diagram of the structure of the display of the handheld reader of the present disclosure. As shown in FIG. 8, the display 730 includes a first display area 731 and a second display area 732; the first display area 731 is for displaying the first area in a first form and the second area in a second form; The second display area 732 is for displaying the results of the character recognition.

[0077] Specifically, the scanned image and the character recognition results are displayed in two display areas of the same display. Here, the first display area 731 can be divided into two areas, one of which displays the first area in a first form, i.e., is used to display the area in the scanned image where the character recognition results are located. The other of which displays the second area in a second form, i.e., is used to display the area in the scanned image other than the first area. As can be understood, in order to accommodate the user's usage habits and allow the user to more clearly and intuitively obtain the text content currently being captured, the area in the first display area 731 for displaying the first area may be located in the center of the first display area 731, and the remaining surrounding areas are used to display the second area in a second form. In addition, the second display area 732 displays the character recognition results of the currently scanned image.

[0078] As a result, during the scanning process, the first display area 731 displays the current scanned image in real time, and the second display area 732 displays the current character recognition results in real time, thereby realizing synchronous display of the scanned image and the character recognition results.

[0079] 9 is a schematic diagram illustrating an entity structure of an electronic device. As shown in FIG. 9, the electronic device may include a processor 910, a communications interface 920, a memory 930, and a communications bus 940, where the processor 910, the communications interface 920, and the memory 930 communicate with each other via the communications bus 940. The processor 910 can invoke logic instructions in the memory 930 to execute a display method. The method includes acquiring a scanned image, performing character recognition on the scanned image, determining an area in the scanned image where the character recognition result is located as a first area, determining an area in the scanned image other than the first area as a second area, and displaying the first area in a first form, or displaying the first area in the first form and the second area in a second form, where the first form and the second form are different display forms.

[0080] Furthermore, the logic instructions in the memory 930 may be implemented in the form of a software functional unit, or may be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present disclosure, its essence, or a portion contributing to the prior art, or a portion of the technical solution, may be embodied in the form of a software product, and the computer software product is stored in a storage medium and includes several instructions for causing a computer device (e.g., a personal computer, a server, a network device, etc.) to execute all or some of the steps of the method described in each embodiment of the present disclosure. The storage medium includes various media capable of storing program code, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0081] Meanwhile, the present disclosure further provides a computer program product including a computer program, the computer program being storable on a non-transitory computer-readable storage medium, which, when executed by a processor, enables a computer to perform the display methods according to the above methods, the method including: acquiring a scanned image; performing character recognition on the scanned image; determining an area in the scanned image where the character recognition result is located as a first area; determining an area in the scanned image other than the first area as a second area; and displaying the first area in a first form, or displaying the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

[0082] On the other hand, the present disclosure further provides a non-transitory computer-readable storage medium storing a computer program, which, when executed by a processor, realizes the execution of the display method according to each of the above methods, including: acquiring a scanned image; performing character recognition on the scanned image; determining an area in the scanned image where the result of the character recognition is located as a first area; determining an area in the scanned image other than the first area as a second area; and displaying the first area in a first form, or displaying the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

[0083] The above-described embodiments of the device are merely exemplary. The units described herein as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed across multiple network units. The objectives of the technical solutions of the present embodiments can be achieved by selecting some or all of the modules herein according to actual needs. Those skilled in the art can understand and implement the same without any creative effort.

[0084] From the above description of the embodiments, it will be clear to those skilled in the art that each embodiment may be realized by combining software with a necessary common hardware platform, or by hardware. Based on this understanding, the essence of the above technical proposals, or portions that contribute to the prior art, may be embodied in the form of a software product. The computer software product may be stored in a computer-readable storage medium, such as a ROM / RAM, a magnetic disk, or an optical disk, and includes several instructions for causing a computer device (e.g., a personal computer, a server, or a network device) to execute the methods described in each embodiment or several portions of the embodiments.

[0085] Finally, it should be explained that the above embodiments are only for explaining the technical solutions of the present disclosure and are not intended to limit the same. Although the present disclosure has been described in detail with reference to the above embodiments, those skilled in the art may still modify the technical solutions described in the above embodiments or equivalently replace some of the technical features thereof, and such modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure.

[0086] [Cross reference] This application claims priority to a Chinese patent application filed on April 25, 2023, bearing application number 2023104599622 and entitled "Display method, device, handheld reader, electronic device and storage medium," the entire contents of which are incorporated herein by reference.

Claims

1. obtaining a scan image; performing character recognition on the scanned image, determining an area in the scanned image where the result of the character recognition is located as a first area, and determining an area in the scanned image other than the first area as a second area; A display method comprising: displaying the first area in a first form; or displaying the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

2. The displaying of the first region in a first form includes: obtaining a scaling parameter for the first region; 2. The method of claim 1, further comprising: displaying the first region at the scaling parameter in the first configuration.

3. The step of obtaining the scaling parameters of the first region includes: receiving a scaling operation and determining a first scaling parameter corresponding to the scaling operation; determining a second scaling parameter based on user setting information; determining a third scaling parameter based on a history scaling operation corresponding to the first history region; and determining a scaling parameter for the first region based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

4. The step of determining the second scaling parameter based on the user setting information includes: The display method according to claim 3 , further comprising determining the second scaling parameter based on a font size in the user setting information and a font size in the first region.

5. Determining the third scaling parameter based on the history scaling operation corresponding to the first history region, as described above, includes: performing area size matching based on size information of the first area and size information of the first history area to obtain a first reference history area that matches the first area; and determining the third scaling parameter based on a history scaling operation corresponding to the first reference history region.

6. Determining a scaling parameter for the first region based on one of the first scaling parameter, the second scaling parameter, and the third scaling parameter includes: determining a scaling parameter threshold based on size information of a display area corresponding to the scanned image and size information of the first area; 4. The display method of claim 3, further comprising determining a scaling parameter for the first region based on the scaling parameter threshold and at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

7. an acquisition unit used to acquire a scanned image; an area positioning unit used to perform character recognition on the scanned image, determine an area in the scanned image where the result of the character recognition is located as a first area, and determine an area in the scanned image other than the first area as a second area; a display unit used to display the first area in a first form, or to display the first area in the first form and the second area in a second form, wherein the first form and the second form are different display forms.

8. The display unit a parameter acquisition subunit used for acquiring scaling parameters of the first region; a first display subunit used to display the first region in the first form at the scaling parameter;

9. The parameter acquisition subunit: a first acquisition subunit used to receive a scaling operation and determine a first scaling parameter corresponding to the scaling operation; a second acquisition subunit used to determine a second scaling parameter based on user setting information; a third acquisition subunit used to determine a third scaling parameter based on a history scaling operation corresponding to the first history region; and a comprehensive determination subunit used to determine a scaling parameter of the first region based on at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

10. The second acquisition subunit specifically includes: The display device according to claim 9 , wherein the second scaling parameter is determined based on a font size in the user setting information and a font size in the first region.

11. The third acquisition subunit specifically includes: performing area size matching based on the size information of the first area and the size information of the first history area to obtain a first reference history area that matches the first area; The display device according to claim 9 , which is used to determine the third scaling parameter based on a history scaling operation corresponding to the first reference history region.

12. The comprehensive determination subunit specifically comprises: determining a scaling parameter threshold based on size information of a display area corresponding to the scanned image and size information of the first area; The display device of claim 9 , which is used to determine a scaling parameter of the first region based on the scaling parameter threshold and at least one of the first scaling parameter, the second scaling parameter, and the third scaling parameter.

13. A handheld reader including a camera, a processor, and a display connected in series, the processor is used to acquire a scanned image collected by the camera, perform character recognition on the scanned image, determine an area in the scanned image where a result of the character recognition is located as a first area, and determine an area in the scanned image other than the first area as a second area; A handheld reader, wherein the display is used to display the first area in a first form, or to display the first area in the first form and the second area in a second form, and the first form and the second form are different display forms.

14. the display includes a first display area and a second display area; the first display area is for displaying the first area in a first form and the second area in a second form; 14. The handheld reader of claim 13, wherein the second display area is for displaying the result of the character recognition.

15. 7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, the electronic device realizing the display method according to any one of claims 1 to 6 when the processor executes the program.

16. A non-transitory computer-readable storage medium having a computer program stored thereon, the computer program implementing the display method of any one of claims 1 to 6 when executed by a processor.

Citation Information

Patent Citations

  • Display method and device, dictionary pen, electronic equipment and storage medium

    CN115509413A

  • Portable type electronic device

    JP2018005622A

  • Apparatus, method, and program for setting information related to scanned image data

    JP7077127B2

  • Handheld scanning apparatus and method

    WO1999050782A2