Scanning pen control method, control device, electronic device and readable storage medium

Abstract

The present invention provides a control method, a control device, an electronic device, and a readable storage medium for a scanning pen. The control method for the scanning pen includes: determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen; receiving image information collected by the first camera, the image information collected by the first camera is used for text recognition; or determining that a second trigger signal is received, sending a second start signal to the second camera of the scanning pen, sending a drive signal to the drive mechanism of the second camera, the drive signal is used to control the drive mechanism to drive the second camera to rotate to a target angle; receiving the image information collected by the second camera, and recognizing it. According to the control method for the scanning pen of the present invention, by controlling the working status of multiple cameras in different areas, the scanning pen can be adapted to various usage needs, expanding the application scenarios of the scanning pen.

Description

Technical Field

[0001] The present invention relates to the field of scanning equipment, and in particular to a control method, a control device, an electronic device and a readable storage medium for a scanning pen. Background Art

[0002] When the working end of the scanning pen sweeps over text on media such as books, newspapers, and even packaging, the built-in optical character recognition (OCR) module can identify, store, and edit the text, which is very convenient in scenarios such as court records, student learning, and travel translation.

[0003] However, due to the limited size of the pen tip, current scanning pens can only scan line by line, which is not suitable for scanning large images, such as picture books. In the related art, independent picture book scanners are designed for picture book scanning needs. Summary of the Invention

[0004] Embodiments of the present invention provide a control method, a control device, an electronic device, and a readable storage medium for a scanning pen, so as to solve the defect of a single usage scenario of the scanning pen in the prior art and realize the multi-scenario use of the scanning pen.

[0005] An embodiment of the present invention provides a method for controlling a scanning pen, including: determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen to control the first camera to turn on; receiving image information captured by the first camera, wherein the image information captured by the first camera is used for text recognition; or determining that a second trigger signal is received, sending a second start signal to the second camera of the scanning pen, and sending a drive signal to the drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to work until the second camera is driven to a target angle; receiving the image information captured by the second camera, and recognizing it.

[0006] According to a method for controlling a scanning pen according to an embodiment of the present invention, the image information collected by the second camera is used for feature extraction, and corresponding audio data is determined based on the extracted features.

[0007] According to a scanning pen control method according to one embodiment of the present invention, the second trigger signal is generated when the first sensor of the scanning pen senses that the scanning pen is installed at the target position; or, the second trigger signal is generated when the scanning pen is electrically connected to the target external terminal.

[0008] According to a scanning pen control method according to an embodiment of the present invention, at the target angle, the angle β between the orientation of the second camera and the length direction of the scanning pen satisfies: 55°≤β≤65°, and the second camera is tilted toward the direction of the first camera.

[0009] According to a control method of a scanning pen according to an embodiment of the present invention, when it is determined that a second trigger signal is received, it is determined that the scanning pen is electrically connected to an external terminal, and the identified information is sent to the external terminal so that the external terminal displays content corresponding to the image information.

[0010] According to a control method of a scanning pen according to an embodiment of the present invention, the image information collected by the second camera is used for text recognition, and at the target angle, the angle γ between the direction of the second camera and the length direction of the scanning pen satisfies: 85°≤γ≤95°.

[0011] According to a control method of a scanning pen according to one embodiment of the present invention, the second trigger signal is generated by the control switch of the scanning pen; or, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the sensing signal of the second sensor of the scanning pen; or, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the recognition result of the image information collected by the scanning pen; or, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the sensing signal of the second sensor of the scanning pen and the recognition result of the image information collected by the scanning pen.

[0012] According to an embodiment of the present invention, a method for controlling a scanning pen includes: determining, based on image information captured by the second camera, that the brightness of the image information is lower than a preset value, and sending a fill light turn-on signal to the fill light of the scanning pen to control the fill light to turn on.

[0013] According to the control method of the scanning pen according to one embodiment of the present invention, the first trigger signal is generated by a trigger switch at the working end of the scanning pen.

[0014] According to an embodiment of the present invention, the control method of the scanning pen further includes: when it is determined that the second trigger signal is received, sending a first shutdown signal to the first camera of the scanning pen to control the first camera to be shut down; when it is determined that the first trigger signal is received, sending a second shutdown signal to the second camera of the scanning pen to control the second camera to be shut down.

[0015] An embodiment of the present invention also provides a control device for a scanning pen, comprising: a first processing module, used to determine whether a first trigger signal is received, and send a first start signal to the first camera of the scanning pen to control the first camera to turn on; a first recognition module, used to receive image information captured by the first camera, and the image information captured by the first camera is used for text recognition; or a second processing module, used to determine whether a second trigger signal is received, and send a second start signal to the second camera of the scanning pen, and send a drive signal to the drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to work until the second camera is driven to the target angle; a second recognition module, used to receive the image information captured by the second camera and identify it.

[0016] An embodiment of the present invention further provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-described methods for controlling a scanning pen are implemented.

[0017] An embodiment of the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of any of the above-described methods for controlling a scanning pen are implemented.

[0018] According to the control method of the scanning pen in the embodiment of the present invention, by controlling the working status of multiple cameras in different areas, the scanning pen can be adapted to various usage requirements, thereby expanding the application scenarios of the scanning pen. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 is a side view of a scanning pen provided by an embodiment of the present invention;

[0021] Figure 2 This is a back view of a scanning pen provided by an embodiment of the present invention;

[0022] Figure 3 It is a schematic diagram of the partial structure of a scanning pen provided by an embodiment of the present invention in the second recognition mode.

[0023] Figure 41 is a schematic diagram of a partial structure of a scanning pen in a third recognition mode provided by an embodiment of the present invention;

[0024] Figure 5 is a front view of a base for a scanning pen provided by an embodiment of the present invention;

[0025] Figure 6 is a side view of a base for a scanning pen provided by an embodiment of the present invention;

[0026] Figure 7 is a side view of a scanning pen assembly provided by an embodiment of the present invention;

[0027] Figure 8 is a flow chart of a method for controlling a scanning pen according to an embodiment of the present invention;

[0028] Figure 9 is a schematic structural diagram of a control device of a scanning pen according to an embodiment of the present invention;

[0029] Figure 10 2 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

[0030] Reference numerals:

[0031] Base 100, base body 110, bottom plate 111, support plate 112, scanning pen installation position 113, base connection part 114,

[0032] The first base interface 121, the second base interface 122,

[0033] Scanning pen 200,

[0034] Housing 210, first section 211, connecting section 212, second section 213, scanning pen connecting portion 214, scanning pen interface 215, working end 216, observation window 217, first sensor 218,

[0035] First camera 221, second camera 222, fill light 223,

[0036] Driving mechanism 231, protective cover 232,

[0037] Display screen 240. DETAILED DESCRIPTION

[0038] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0039] The following combination Figure 1-Figure 4 and Figure 7 The scanning pen 200 according to the embodiment of the present invention is described.

[0040] like Figure 1-Figure 4 The scanning pen 200 provided in the embodiment of the present invention includes: a housing 210, a first camera 221, a second camera 222 and a main control chip (not shown in the figure).

[0041] The shell 210 can be in a long strip shape to facilitate holding. The shell 210 defines an installation space for accommodating other components. The shell 210 can be a plastic shell, which can reduce the weight of the entire scanning pen 200. Of course, the shell 210 can also be a metal shell, so that the scanning pen 200 has a stronger texture, or the shell 210 can be a plastic shell with a metal coating on the outside; or some areas of the shell 210, such as the gripping area, can also be covered with a non-slip rubber layer.

[0042] like Figure 1 and Figure 2 As shown, the first camera 221 is mounted on the housing 210, and the first camera 221 faces one end of the housing 210, and the first camera 221 can face the pen tip end of the housing 210. The first camera 221 is used to scan text within a smaller range, such as scanning text line by line. Of course, if combined with an image stitching algorithm, the first camera 221 can also achieve multiple scans of a single line.

[0043] The housing 210 has a working end 216 . In some embodiments, the working end 216 is located at one end of the housing 210 . During actual use, the working end 216 is the end of the scanning pen 200 facing the scanned medium (such as paper).

[0044] The working end 216 defines a scanning area. The working end 216 can roughly indicate an open scanning area, which is consistent with the effective collection area of ​​the first camera 221. That is, the working end 216 is used to indicate the specific location where the user places the scanning pen 200, so that the first camera 221 can roughly capture the area where the target text is located as the user expects.

[0045] Working end 216 may be provided with an observation window 217 , which may be made of a transparent material, including but not limited to glass, tempered glass, or transparent plastic. Observation window 217 may be provided with a marking, which may be located on the upper surface, lower surface, or interior of observation window 217 . The marking may be colored for greater visibility. The marking may be engraved on observation window 217 .

[0046] The mark can be in the shape of "T", "cross", "U", etc. The mark can have a guiding line for indicating the forefront of the scanning area and a guiding line for indicating the central axis of the scanning area.

[0047] As Figure 1 and Figure 2 As shown, the second camera 222 is installed on the housing 210, and the second camera 222 faces the peripheral wall of the housing 210.

[0048] It should be noted that the housing 210 can be generally in a columnar structure. The areas at both ends in the length direction of the housing 210 are the peripheral walls. The second camera 222 can be open on the peripheral wall of the housing 210. In this way, when the second camera 222 needs to be used, the peripheral wall of the housing 210 needs to face the medium to be scanned.

[0049] Since the second camera 222 is installed on the peripheral wall of the housing 210, the second camera 222 can have a larger viewing angle. For example, when holding and using the scanning pen 200, the second camera 222 can capture images of a larger area and identify them at one time; or when the scanning pen 200 is installed on a fixed bracket, the second camera 222 can face a specific position to capture images of a specific area. For example, the scanning pen 200 can scan an entire picture book page.

[0050] When the housing 210 is generally cylindrical, the peripheral wall of the housing 210 includes an arc-shaped closed annular surface. When the housing 210 is generally rectangular parallelepiped, the peripheral wall of the housing 210 includes 4 wall surfaces. Among them, the wall surface on which the display screen 240 is installed usually faces the user during use. This wall surface serves as the front. The other three peripheral walls are the back facing away from the front and the two side surfaces located between the front and the back. The second camera 222 can face the front, back or side of the housing.

[0051] In Figure 1 , Figure 2 and Figure 7 In the embodiments shown, the second camera 222 faces the back of the housing 210. The back of the housing 210 refers to the side facing the hand when the scanning pen 200 is held and used and the first camera 221 is turned on. Or, the scanning pen 200 has a display screen 240, and the text recognized by the scanning pen 200 can be displayed on the display screen 240. The second camera 222 and the display screen 240 can be respectively installed on both sides in the thickness direction of the housing 210. When the second camera 222 faces the back of the housing 210, the medium to be scanned is placed in front of the user, and the display screen 240 just faces the user, which is convenient for the user to view.

[0052] The main control chip is electrically connected to the first camera 221 and the second camera 222. An identification module can be installed on the main control chip. When the scanning device is turned on, the first camera 221 or the second camera 222 transmits the collected image information to the identification module. The identification module can be an optical character recognition module. The recognition module detects the dark and light patterns in the received image information and confirms its shape, and then uses the character recognition method to recognize the text into editable text. The recognized text can be displayed on the display screen 240.

[0053] According to the scanning pen 200 of the embodiment of the present invention, by setting multiple cameras in different areas, the use scenarios of the scanning pen 200 can be expanded. The scanning pen 200 can realize both line-by-line scanning and full-page scanning.

[0054] In some embodiments, as Figure 1 As shown, the housing 210 may include a first section 211 , a connecting section 212 and a second section 213 .

[0055] The first section 211, the connecting section 212, and the second section 213 are sequentially connected along the length of the housing 210 and can be formed into a single piece. The second section 213 is thicker than the first section 211, and the thickness of the connecting section 212 gradually increases from the end connected to the first section 211 to the end connected to the second section 213. A display screen 240 is provided on the front of the second section 213.

[0056] It can be understood that the first section 211 is thinner, which is convenient for gripping, and the second section 213 has a larger space, which is convenient for installing more components inside.

[0057] The first camera 221 is installed on the first section 211 . A trigger switch for controlling the first camera 221 is provided at one end of the first section 211 facing away from the second section 213 . The trigger switch can be installed on the working end 216 .

[0058] When the trigger switch of the scanning pen 200 is triggered, for example, by pressing the working end 216 of the scanning pen 200 against the scanned medium, the trigger switch is triggered, and the main control chip activates the first camera 221 and begins to collect image data. When the working end 216 of the scanning pen 200 is lifted, the main control chip deactivates the first camera 221 and begins processing the collected image data.

[0059] The second camera 222 is installed on the connecting section 212 , so that the reduced space of the connecting section 212 can be fully utilized.

[0060] like Figure 2As shown, the scanning pen 200 further includes a protective cover 232 connected to the housing 210 and positioned over the second camera 222. The protective cover 232 is made of a transparent material to prevent damage to the second camera 222. The protective cover 232 can be made of glass, tempered glass, transparent plastic, or other materials, and the outer surface of the protective cover 232 can be treated to prevent wear.

[0061] In some embodiments, as Figure 1-Figure 4 As shown, the scanning pen 200 of the embodiment of the present invention may also include: a driving mechanism 231, the driving mechanism 231 is installed on the shell 210, and the driving mechanism 231 is electrically connected to the main control chip, the driving mechanism 231 is power-coupled with the second camera 222, and the driving mechanism 231 is used to drive the second camera 222 to adjust the shooting direction.

[0062] In other words, the second camera 222 is an active camera, and the second camera 222 can be adjusted to a corresponding angle according to different usage scenarios. In this way, the scanning pen 200 can easily adjust the second camera 22 to a more suitable viewing angle in various scenarios.

[0063] It should be noted that for the scanning pen 200 provided with a protective cover 232, the protective cover 232 must ensure that the second camera 222 rotates within the designed rotation range, does not interfere with the rotation of the second camera 222, and the shooting angle of the second camera 222 is not blocked by the opaque part of the shell 210.

[0064] The driving mechanism 231 may include a servo, which is electrically connected to the main control chip. The servo is configured to operate according to a pulse width modulation signal output by the main control chip.

[0065] In some embodiments, the scanning pen 200 has a first recognition mode, a second recognition mode, and a third recognition mode.

[0066] In the first recognition mode, the main control chip controls the first camera 221 to turn on.

[0067] It should be noted that when the working end 216 of the scanning pen 200 is pressed against the scanned medium, the trigger switch of the scanning pen 200 is triggered, the main control chip activates the first camera 221, begins collecting image data, and the scanning pen 200 enters the first recognition mode. When the working end 216 of the scanning pen 200 is lifted, the main control chip deactivates the first camera 221 and begins processing the collected image data.

[0068] like Figure 3 and Figure 7 As shown, in the second recognition mode, the main control chip controls the driving mechanism 231 to work to drive the second camera 222 to rotate to the first target angle, and the main control chip controls the second camera 222 to turn on.

[0069] In the second recognition mode, as Figure 7 As shown, the scanning pen 200 is mounted on a fixed bracket, and the second camera 222 can be oriented toward a specific location to capture images of a specific area. For example, the scanning pen 200 can be mounted on the base 100, so that the scanning pen 200 can scan an entire page of a picture book. In the second recognition mode, feature extraction is performed on the image information captured by the second camera 222. Based on the extracted features, a matching query is performed in a pre-set database. When the picture book audio data corresponding to the image information is retrieved, the scanning pen 200 can read the audio data aloud.

[0070] At the first target angle, the angle β between the direction of the second camera 222 and the length direction of the scanning pen 200 satisfies: 55°≤β≤65°, and the second camera 222 is tilted toward the first camera 221. In a specific embodiment, β=60°.

[0071] In actual implementation, when the scanning pen 200 enters the second recognition mode, the main control chip sets the duty cycle of the pulse width modulation signal to rotate the servo to tilt the second camera 222 toward the pen tip.

[0072] like Figure 4 As shown, in the third recognition mode, the main control chip controls the driving mechanism 231 to work to drive the second camera 222 to rotate to the second target angle, and the main control chip controls the second camera 222 to turn on.

[0073] When the scanning pen 200 is held and used, the second camera 222 can capture images of a larger area.

[0074] like Figure 4 As shown, at the second target angle, the angle between the direction of the second camera 222 and the length direction of the scanning pen 200 is γ, which satisfies: 85°≤γ≤95°. In a specific embodiment, γ=90°.

[0075] In this way, when the scanning pen 200 is held, for example, by holding the first section 211 of the housing 210 , the shooting direction of the second camera 222 is substantially perpendicular to the holding direction, which facilitates shooting.

[0076] In actual implementation, when the scanning pen 200 enters the third recognition mode, the main control chip sets the duty cycle of the pulse width modulation signal to rotate the servo so that the second camera 222 is substantially perpendicular to the back of the scanning pen 200.

[0077] In some embodiments, as Figure 1 and Figure 2As shown, the scanning pen 200 may further include a fill light 223, which is mounted on the peripheral wall of the housing 210 and arranged adjacent to the second camera 222. For example, when the second camera 222 faces the back of the housing, the fill light 223 may be mounted on the back of the housing 210.

[0078] The fill light 223 is electrically connected to the main control chip. In the third and second recognition modes, the main control chip is configured to control the fill light 223 based on the brightness of the image information collected by the second camera 222. The algorithm performs real-time calculations on the data collected by the second camera 222 and automatically turns on the fill light 223 if the image data is found to be insufficiently bright.

[0079] In summary, the scanning pen 200 according to the embodiment of the present invention can expand the usage scenarios of the scanning pen 200 by setting up dual cameras. The scanning pen 200 can realize both line-by-line scanning and full-page scanning.

[0080] Reference below Figure 5-Figure 7 The base 100 for a scanning pen provided in an embodiment of the present invention is described. The base 100 is used to support the scanning pen 200 of any of the above embodiments.

[0081] like Figure 5-Figure 7 As shown, the base 100 for the scanning pen according to the embodiment of the present invention includes: a base body 110, the base body 110 is provided with a scanning pen installation position 113, and the scanning pen installation position 113 is provided with a base connection part 114 for detachably connecting with the scanning pen 200.

[0082] It should be noted that when the scanning pen 200 needs to be converted into a fixed scanning device, the scanning pen 200 can be installed on the base 100, and the base connection portion 114 is provided, so that the scanning pen 200 can be easily installed and removed. After installation, the scanning pen 200 is supported on the scanning pen installation position 113.

[0083] The base 100 for the scanning pen according to the embodiment of the present invention can expand the usage scenarios of the scanning pen 200, so that the scanning pen 200 can also be used for picture book scanning, and the scanning pen 200 can be easily disassembled and installed.

[0084] In some embodiments, as Figure 5-Figure 7 As shown, the scanning pen mounting position 113 includes an inclined flat surface. This flat surface can be aligned with the back of the scanning pen 200, which is the side opposite the display screen 240 of the scanning pen 200. Of course, the scanning pen mounting position 113 can also be provided with a protrusion. After the scanning pen 200 is installed in the scanning pen mounting position 113, the lower end (the tip end) of the scanning pen 200 can rest against the protrusion to prevent the scanning pen 200 from falling.

[0085] like Figure 5-Figure 7 As shown, the base body 110 may include a bottom plate 111 and a support plate 112. The support plate 112 is connected to the bottom plate 111, and a scanning pen mounting position 113 is formed on the support plate 112. The bottom plate 111 is placed horizontally on a tabletop. The support plate 112 and the bottom plate 111 are connected at an acute angle. The surface of the support plate 112 facing away from the bottom plate 111 forms the scanning pen mounting position 113. This ensures that the base 100 is highly stable both when the scanning pen 200 is placed and when it is placed.

[0086] like Figure 6 and Figure 7 As shown, the angle α between the plane where the scanning pen mounting position 113 is located and the horizontal plane satisfies the following conditions: 70° ≤ α ≤ 80°. This ensures that, due to the component of gravity exerted by the inclined surface, the force applied to the scanning pen 200 by the base 100 along this plane after the scanning pen 200 is supported on the scanning pen mounting position 113 is less than the force of gravity on the scanning pen 200, preventing the scanning pen 200 from falling. Furthermore, the scanning pen 200's inclination angle relative to the vertical plane is not large, resulting in a wide scanning angle, which can expand the viewing area of ​​the second camera 222 during picture book recognition. In one specific embodiment, α = 75°.

[0087] The base connection portion 114 may include a magnetic attraction device, which may be a magnetic suction cup. The base connection portion 114 may include a permanent magnet or an electromagnet. Correspondingly, the scanning pen connection portion 214 also includes a magnetic attraction device. The two magnetic attraction devices have opposite polarities facing outward. When the scanning pen 200 is brought close to the base 100, the scanning pen 200 can be attracted to the base 100. This makes installation and removal of the scanning pen 200 from the base 100 extremely convenient.

[0088] In some embodiments, the base body 110 is further provided with a first base interface 121 for electrically connecting to an external device and a second base interface 122 for electrically connecting to the scanning pen 200 , and the second base interface 122 is electrically connected to the first base interface 121 .

[0089] When the scanning pen 200 is installed on the base 100, the scanning pen interface 215 is electrically connected to the second base interface 122. The base 100 can charge the scanning pen 200, so that the scanning pen 200 has a long battery life in the working scenario of picture book scanning. In some embodiments, when charging the scanning pen 200 through the base 100, it is necessary to connect the first base interface 121 to an external power source. In other embodiments, a battery is provided in the base 100. When the first base interface 121 is connected to an external power source, the battery in the base 100 can be charged. When charging the scanning pen 200 through the base 100, the first base interface 121 can be disconnected from an external power source and the scanning pen 200 can be charged by the battery.

[0090] The electrical connection between the second base interface 122 and the first base interface 121 can also realize data transmission between the scanning pen 200 and the base 100. For example, the first base interface 121 can be connected to a computer terminal. When the scanning pen 200 is installed on the base 100, the scanning pen interface 215 is electrically connected to the second base interface 122. The data of the scanning pen 200 can be transmitted to the computer through the second base interface 122 and the first base interface 121.

[0091] Alternatively, when the scanning pen 200 is installed on the base 100 , the scanning pen interface 215 is electrically connected to the second base interface 122 , thereby achieving charging and data connection at the same time.

[0092] The first base interface 121 may be a USB interface, the second base interface 122 may include a plurality of metal contacts, and the structure of the scanning pen interface 215 corresponds to the structure of the second base interface 122 .

[0093] In some embodiments, as Figure 5-Figure 7 As shown, the second base interface 122 is installed on the base connecting portion 114. In this way, when the second base interface 122 is docked with the scanning pen interface 215, the connection between the base connecting portion 114 and the scanning pen connecting portion 214 can be achieved.

[0094] In a specific embodiment, Figure 7 As shown, the base connection portion 114 may include a magnetic adsorption device having a plurality of metal contacts on its surface, which correspond to the metal contacts on the surface of the scanning pen connection portion 214 of the scanning pen 200. When the scanning pen 200 is adsorbed on the bracket of the base 100, the contacts on both sides come into contact and connect.

[0095] Reference below Figure 1-Figure 7 The scanning pen assembly provided by an embodiment of the present invention is described. The scanning pen assembly may include the scanning pen 200 of the above embodiment and a base 100 for the scanning pen.

[0096] like Figure 7 As shown, the scanning pen assembly of the embodiment of the present invention includes: a scanning pen 200 and a base 100.

[0097] The scanning pen 200 includes a shell 210, a first camera 221 installed at the end of the shell 210, and a second camera 222 installed on the peripheral wall of the shell 210. The shell 210 is provided with a scanning pen connecting portion 214, and the scanning pen connecting portion 214 is detachably connected to the base connecting portion 114 so that the scanning pen 200 is suitable for installation in the scanning pen installation position 113, and when the scanning pen 200 is installed in the scanning pen installation position 113, the second camera 222 is exposed relative to the base 100.

[0098] When the scanning pen 200 is removed from the base 100, the scanning pen 200 can realize line-by-line scanning by turning on the trigger switch and turning on the first camera 221. When the scanning pen 200 is installed on the base 100, the scanning pen 200 can realize line-by-line scanning by turning on the trigger switch and turning on the first camera 221.

[0099] The scanning pen 200 has a first recognition mode and a second recognition mode.

[0100] In the first recognition mode, the main control chip controls the first camera 221 to turn on.

[0101] It should be noted that when the working end 216 of the scanning pen 200 is pressed against the scanned medium, the trigger switch of the scanning pen 200 is triggered, the main control chip activates the first camera 221, begins collecting image data, and the scanning pen 200 enters the first recognition mode. When the working end 216 of the scanning pen 200 is lifted, the main control chip deactivates the first camera 221 and begins processing the collected image data.

[0102] In the second recognition mode, as Figure 7 As shown, the scanning pen 200 is mounted on a fixed bracket, and the second camera 222 can be oriented toward a specific location to capture images of a specific area. For example, the scanning pen 200 can be mounted on the base 100, so that the scanning pen 200 can scan an entire page of a picture book. In the second recognition mode, feature extraction is performed on the image information captured by the second camera 222. Based on the extracted features, a matching query is performed in a pre-set database. When the picture book audio data corresponding to the image information is retrieved, the scanning pen 200 can read the audio data aloud.

[0103] The scanning pen 200 may include a first sensor 218 . When the first sensor 218 senses that the scanning pen 200 is installed on the base 100 , it sends a second trigger signal to enable the scanning pen 200 to enter a second recognition mode.

[0104] The first sensor 218 can be a Hall sensor, and the first sensor 218 can be installed near the scanning pen connection part 214. The scanning pen connection part 214 and the base connection part 114 are magnetic adsorption parts. When the Hall sensor senses that the scanning pen connection part 214 and the base connection part 114 are adsorbed, a second trigger signal is generated.

[0105] In some embodiments, as Figure 5-Figure 7 As shown, the second base interface 122 is installed on the base connecting portion 114. In this way, when the second base interface 122 is docked with the scanning pen interface 215, the connection between the base connecting portion 114 and the scanning pen connecting portion 214 can be achieved.

[0106] In a specific embodiment, Figure 7As shown, the base connection portion 114 may include a magnetic adsorption device having a plurality of metal contacts on its surface, which correspond to the metal contacts on the surface of the scanning pen connection portion 214 of the scanning pen 200. When the scanning pen 200 is adsorbed on the bracket of the base 100, the contacts on both sides come into contact and connect.

[0107] The scanning pen mounting position 113 includes an inclined plane. The plane of the scanning pen mounting position 113 forms an angle α with the horizontal plane. The angle β between the orientation of the second camera 222 and the length of the scanning pen 200 satisfies the following conditions: 70° ≤ α ≤ 80°, 55° ≤ β ≤ 65°. In one specific embodiment, α = 75°, β = 60°. When the scanning pen 200 is attached to the base 100, the second camera 222 forms a downward angle of approximately 45° with the horizontal direction, thereby expanding the viewing area of ​​the second camera 222 during picture book recognition.

[0108] According to the scanning pen assembly of the embodiment of the present invention, by disposing multiple cameras in different areas of the scanning pen 200 and configuring the base 100, the use scenarios of the scanning pen 200 can be expanded.

[0109] Reference below Figure 8 The control method of the scanning pen 200 according to an embodiment of the present invention is described. The execution subject of the control method may be a control device of the scanning pen 200 , and the control device may be a main control chip of the scanning pen 200 .

[0110] The scanning pen 200 can be the scanning pen 200 of any of the above-mentioned embodiments, and the scanning pen 200 includes a first camera 221 and a second camera 222. The first camera 221 is arranged at one end close to the tip of the scanning pen 200, and the second camera 222 is installed in the middle area of ​​the shell of the scanning pen 200, such as the back area.

[0111] like Figure 8 As shown, the control method of the scanning pen 200 according to the embodiment of the present invention includes: step 801-step 802.

[0112] Step 801: Determine that a first trigger signal is received, and send a first start signal to the first camera 221 of the scanning pen 200 to control the first camera 221 to start.

[0113] It is understandable that when the first trigger signal is received, the scanning pen 200 enters the first recognition mode, at which time the scanning pen 200 collects image information through the first camera 221.

[0114] In actual execution, the first trigger signal is generated by the trigger switch at the working end of the scanning pen 200. In other words, when the user holds the scanning pen 200 and presses the working end of the scanning pen 200 against the scanned medium, the trigger switch is triggered and sends a first trigger signal to the control device of the scanning pen 200. After receiving the first trigger signal, the control device sends a first start signal to the first camera 221. After receiving the first start signal, the first camera 221 starts to start, thereby entering the scanning and recognition process.

[0115] It should be noted that, when it is determined that the first trigger signal is received, a second closing signal for controlling the second camera 222 to be closed is sent to the second camera 222 of the scanning pen 200 .

[0116] In other words, if the second camera 222 is previously turned on, the second camera 222 needs to be turned off when entering the first recognition mode.

[0117] Step 802: Receive image information captured by the first camera 221. The image information captured by the first camera is used for text recognition.

[0118] At this time, the image information captured by the first camera 221 is used to perform the scanning function of the scanning pen. This image information can be used for line-by-line scanning and recognition of text, that is, to translate the image information into text information. In the first recognition mode, the first camera 221 captures image information and sends it to the control device for recognition. For example, the control device integrates a recognition module, which can be an optical character recognition module. The recognition module detects dark and light patterns in the received image information and determines their shapes. It then uses character recognition methods to recognize the text into editable text, thereby identifying the text in the image information.

[0119] Or, as Figure 8 As shown, the control method of the scanning pen 200 according to the embodiment of the present invention includes: step 811 to step 812.

[0120] Step 811, determine whether the second trigger signal is received, send a second start signal to the second camera 222 of the scanning pen 200, and send a drive signal to the drive mechanism of the second camera 222, wherein the second start signal is used to control the second camera 222 to turn on, and the drive signal is used to control the drive mechanism to work until the second camera 222 is driven to rotate to the target angle.

[0121] It is understandable that, upon receiving the second trigger signal, the scanning pen 200 enters another recognition mode, in which the scanning pen 200 collects image information through the second camera 222 .

[0122] The second camera 222 is installed at the output end of the driving mechanism. When the driving mechanism is working, it can drive the second camera 222 to rotate to adjust the direction of the second camera 222.

[0123] It should be noted that, when it is determined that the second trigger signal is received, a first closing signal for controlling the first camera 221 to be closed is sent to the first camera 221 of the scanning pen 200 .

[0124] In other words, if the first camera 221 is previously in an on state, the first camera 221 needs to be turned off when entering a non-first recognition mode.

[0125] Step 812: Receive and identify image information captured by the second camera 222.

[0126] The second camera 222 has a wider shooting angle than the first camera 221 and can perform text recognition or pattern recognition over a wide range.

[0127] According to the control method of the scanning pen 200 in an embodiment of the present invention, by controlling the working states of multiple cameras in different areas, the scanning pen 200 can be adapted to various usage requirements, thereby expanding the application scenarios of the scanning pen 200.

[0128] In some embodiments, the image information captured by the second camera 222 is used to perform feature extraction, and corresponding audio data is determined based on the extracted features.

[0129] It can be understood that the image information collected by the second camera 222 is used for picture book recognition. When performing picture book recognition, the image information is subjected to feature extraction, and a matching query is performed in a pre-set database based on the extracted features. The picture book audio data corresponding to the image information is retrieved, and the scanning pen 200 can read the audio data aloud.

[0130] like Figure 3 and Figure 7 As shown, in the second recognition mode, the control device controls the driving mechanism 231 to work so as to drive the second camera 222 to rotate to the first target angle, and the control device controls the second camera 222 to turn on.

[0131] In the second recognition mode, as Figure 7 As shown, the scanning pen 200 is installed on the base, and the second camera 222 can be directed to a specific position to capture images of a specific area. For example, the scanning pen 200 can be installed on the base 100, so that the scanning pen 200 can scan a whole page of a picture book.

[0132] In some embodiments, as Figure 3 and Figure 7As shown, at the target angle, the angle β between the direction of the second camera and the length direction of the scanning pen satisfies: 55°≤β≤65°, and the second camera is tilted toward the direction of the first camera. In a specific embodiment, β=60°.

[0133] In actual implementation, when the scanning pen 200 enters the second recognition mode, the control device sets the duty cycle of the pulse width modulation signal to rotate the servo to tilt the second camera 222 toward the pen tip.

[0134] In some embodiments, the second trigger signal is generated when the first sensor 218 of the scanning pen 200 senses that the scanning pen 200 is installed at a target location.

[0135] It should be noted that if Figure 6 and Figure 7 As shown, the target position can be the scanning pen installation position 113 on the base 100. When the scanning pen 200 is installed at the scanning pen installation position 113 on the base 100, the first sensor 218 of the scanning pen 200 detects this installation method, and the first sensor 218 generates a second trigger signal and sends it to the control device.

[0136] In this embodiment, the second trigger signal is generated by the first sensor 218 of the scanning pen 200 when it senses that the scanning pen 200 is installed at the target position. Correspondingly, upon receiving the second trigger signal, the scanning pen 200 enters the second recognition mode. In this mode, the scanning pen 200 captures image information via the second camera 222, with the target angle being the first target angle. The second recognition mode is used for picture book recognition.

[0137] The scanning pen 200 may include a first sensor 218 . When the first sensor 218 senses that the scanning pen 200 is installed on the base 100 , it sends a second trigger signal to enable the scanning pen 200 to enter a second recognition mode.

[0138] The first sensor 218 can be a Hall sensor, and the first sensor 218 can be installed near the scanning pen connection part 214. The scanning pen connection part 214 and the base connection part 114 are magnetic adsorption parts. When the Hall sensor senses that the scanning pen connection part 214 and the base connection part 114 are adsorbed, a second trigger signal is generated.

[0139] In other embodiments, the second trigger signal is generated when the scanning pen 200 is electrically connected to a target external terminal. For example, the target external terminal may be the base 100, the scanning pen 200 is provided with a scanning pen interface 215, and the base body 110 of the base 100 is provided with a second base interface 122 for electrically connecting to the scanning pen 200. When the scanning pen 200 is installed on the base 100, the scanning pen interface 215 is electrically connected to the second base interface 122, thereby generating the second trigger signal.

[0140] In this way, when the scanning pen 200 is placed at the target position, it automatically enters the second recognition mode, with a high degree of automation and a good user experience.

[0141] In some embodiments, when it is determined that the second trigger signal is received, it is determined that the scanning pen 200 is electrically connected to the external terminal, and the identified information is sent to the external terminal so that the external terminal displays content corresponding to the image information.

[0142] Specifically, if Figure 5 As shown, the base body 110 of the base 100 is further provided with a first base interface 121 for electrically connecting to an external device and a second base interface 122 for electrically connecting to the scanning pen 200 , and the second base interface 122 is electrically connected to the first base interface 121 .

[0143] When the scanning pen 200 is installed on the base 100, the scanning pen interface 215 is electrically connected to the second base interface 122. The base 100 can charge the scanning pen 200, so that the scanning pen 200 has a long battery life in the working scenario of picture book scanning. In some embodiments, when charging the scanning pen 200 through the base 100, it is necessary to connect the first base interface 121 to an external power source. In other embodiments, a battery is provided in the base 100. When the first base interface 121 is connected to an external power source, the battery in the base 100 can be charged. When charging the scanning pen 200 through the base 100, the first base interface 121 can be disconnected from an external power source and the scanning pen 200 can be charged by the battery.

[0144] In the second recognition mode, the electrical connection between the second base interface 122 and the first base interface 121 can also realize data transmission between the scanning pen 200 and the base 100. For example, the first base interface 121 can be connected to a computer terminal (or mobile terminal). When the scanning pen 200 is installed on the base 100, the scanning pen interface 215 is electrically connected to the second base interface 122. The data of the scanning pen 200 can be transmitted to the computer terminal (or mobile terminal) through the second base interface 122 and the first base interface 121. The supporting application on the computer terminal (or mobile terminal) will display the content of the picture book or the supporting animation resources while the scanning pen reads the picture book.

[0145] In some embodiments, the control method includes: based on the image information captured by the second camera 222 , determining that the brightness of the image information is lower than a preset value, and sending a fill light 223 turn-on signal to the fill light 223 of the scanning pen 200 to control the fill light 223 to turn on.

[0146] In other words, in the second recognition mode, when the control device processes the image data collected by the second camera in real time, if the algorithm finds that the picture is dark, it will turn on the fill light 223 on the bottom of the scanning pen 200 to illuminate the photographed object or picture book.

[0147] In some embodiments, the image information collected by the second camera 222 is used for text recognition, and the text recognition is larger in range than that of the first camera 221. The recognized text can also be translated into foreign languages, etc. The second camera 222 collects image information, and the image information will be sent to the control device for recognition. For example, the control device integrates a recognition module, and the recognition module can be an optical character recognition module. The recognition module detects the dark and light patterns in the received image information and confirms its shape, and then uses the character recognition method to recognize the text into editable text. The text in the image information is recognized, and the text can be combined with the translation function to realize foreign language translation.

[0148] In some embodiments, the second trigger signal is generated by a control switch of the scanning pen 200. When the second trigger signal received by the control device is generated by the control switch of the scanning pen 200, the scanning pen 200 enters the third recognition mode.

[0149] In actual implementation, the scanning pen 200 has a display screen 240, which can be a touch screen. Correspondingly, the control switch is integrated into the touch screen. When the user chooses to enter the third recognition mode on the touch screen, the scanning pen 200 enters the third recognition mode. At this time, the second camera 222 is turned on, the first camera 221 is turned off, and rotated to the target angle, which can be the second target angle.

[0150] Of course, the control switch may also be a physical switch, such as an independently set button or knob switch.

[0151] In other embodiments, the second trigger signal is generated when the trigger request of the scanning pen 200 is confirmed, and the trigger request is generated based on the sensing signal of the second sensor of the scanning pen 200.

[0152] It is understandable that the scanning pen 200 has a second sensor that can detect the posture of the scanning pen, such as the tilt angle or the shaking state. The second sensor may include a gyroscope and a gravity sensor. The signal tested by the second sensor can determine that the scanning pen 200 is in a handheld state and has a certain shaking. In this way, after the signal of the second sensor is sent to the main control chip of the scanning pen 200, a trigger request is generated. The trigger request can be in various forms, such as displaying "Do you want to enter the photo recognition mode?" on the display screen 240. If the user selects "yes", it is equivalent to confirming the trigger request, and the main control chip can generate a second trigger signal. Alternatively, the trigger request can be a voice prompt "Do you want to enter the photo recognition mode?". The scanning pen 200 collects the audio signal of the user's reply through the microphone and performs voice recognition. If the recognition is yes, it is equivalent to confirming the trigger request, and the main control chip can generate a second trigger signal.

[0153] In some other embodiments, the second trigger signal is generated when the trigger request of the scanning pen 200 is confirmed, and the trigger request is generated based on the recognition result of the image information collected by the scanning pen.

[0154] In this case, the image information may be captured by the first camera 221. If, upon recognizing the image information captured by the first camera 221, image processing determines that the image includes multiple lines of text, or includes irregular lines of text, a trigger request is generated. In this case, the image information may be captured by the second camera 222. If, upon recognizing the image information captured by the second camera 222, image processing determines that the image includes multiple lines of text, or includes irregular lines of text, a trigger request is generated.

[0155] The trigger request can take various forms. For example, the display screen 240 may display the message "Do you want to enter the photo recognition mode?". If the user selects "Yes," the trigger request is confirmed, and the main control chip can generate a second trigger signal. Alternatively, the trigger request can be a voice prompt "Do you want to enter the photo recognition mode?". The scanner 200 collects the user's audio signal through a microphone and performs voice recognition. If the voice recognition result is "Yes," the trigger request is confirmed, and the main control chip can generate a second trigger signal.

[0156] In some further embodiments, the second trigger signal is generated when the trigger request of the scanning pen 200 is confirmed. The trigger request is generated based on the sensing signal of the second sensor of the scanning pen and the recognition result of the image information collected by the scanning pen. It is understandable that the scanning pen 200 has a second sensor, which can detect the posture of the scanning pen, such as the tilt angle or the shaking state. The second sensor can be a gyroscope. The signal tested by the second sensor can determine that the scanning pen 200 is in a handheld state and has a certain degree of shaking. In this way, after the signal of the second sensor is sent to the main control chip of the scanning pen 200, and when the image information collected by the first camera 221 is identified, through image processing, it is determined that the image includes multiple lines of text, or includes irregular lines of text. After comprehensively weighing these two factors, a trigger request is generated.

[0157] The trigger request can take various forms. For example, the display screen 240 may display the message "Do you want to enter the photo recognition mode?". If the user selects "Yes," the trigger request is confirmed, and the main control chip can generate a second trigger signal. Alternatively, the trigger request can be a voice prompt "Do you want to enter the photo recognition mode?". The scanner 200 collects the user's audio signal through a microphone and performs voice recognition. If the voice recognition result is "Yes," the trigger request is confirmed, and the main control chip can generate a second trigger signal.

[0158] At the target angle (second target angle), the angle between the direction of the second camera and the length direction of the scanning pen is γ, which satisfies: 85°≤γ≤95°.

[0159] In other words, if Figure 4 As shown, in the third recognition mode, the control device controls the driving mechanism 231 to work so as to drive the second camera 222 to rotate to the second target angle, and the control device controls the second camera 222 to turn on.

[0160] When the scanning pen 200 is held and used, the second camera 222 can capture images of a larger area.

[0161] like Figure 4 As shown, at the second target angle, the angle between the direction of the second camera 222 and the length direction of the scanning pen 200 is γ, which satisfies: 85°≤γ≤95°. In a specific embodiment, γ=90°.

[0162] In this way, when the scanning pen 200 is held, for example, by holding the first section 211 of the housing 210 , the shooting direction of the second camera 222 is substantially perpendicular to the holding direction, which facilitates shooting.

[0163] In actual implementation, when the scanning pen 200 enters the third recognition mode, the control device sets the duty cycle of the pulse width modulation signal to rotate the servo so that the second camera 222 is substantially perpendicular to the back of the scanning pen 200 .

[0164] In some embodiments, the control method may include: based on the image information captured by the second camera 222 , determining that the brightness of the image information is lower than a preset value, and sending a fill light 223 turn-on signal to the fill light 223 of the scanning pen 200 to control the fill light 223 to turn on.

[0165] In other words, in the second recognition mode, when the control device processes the image data collected by the second camera in real time, if the algorithm finds that the picture is dark, it will turn on the fill light 223 on the bottom of the scanning pen 200 to illuminate the photographed object or picture book.

[0166] In some embodiments, the scanning pen 200 has a first recognition mode and a second recognition mode. Correspondingly, the control method of the scanning pen 200 includes: entering the first recognition mode when the received trigger signal is the first trigger signal; entering the second recognition mode when the received trigger signal is the second trigger signal.

[0167] In other embodiments, the scanning pen 200 has a first recognition mode and a third recognition mode. Correspondingly, the control method of the scanning pen 200 includes: entering the first recognition mode when the received trigger signal is the first trigger signal; entering the third recognition mode when the received trigger signal is the second trigger signal.

[0168] In some other embodiments, the scanning pen 200 has a first recognition mode, a second recognition mode and a third recognition mode. Correspondingly, the control method of the scanning pen 200 includes: when the received trigger signal is a first trigger signal, entering the first recognition mode; when the received trigger signal is a second trigger signal, and the second trigger signal is generated by the first sensor 218 of the scanning pen 200 when it senses that the scanning pen 200 is installed at the target position, entering the second recognition mode; when the received trigger signal is a second trigger signal, and the second trigger signal is generated by the control switch of the scanning pen 200, entering the third recognition mode.

[0169] The control device of the scanning pen 200 provided in an embodiment of the present invention is described below. The control device of the scanning pen 200 described below and the control method of the scanning pen 200 described above can be referred to each other.

[0170] like Figure 9 As shown, the control device 900 of the scanning pen 200 according to the embodiment of the present invention includes: a first processing module 901 and a first recognition module 902 , or includes a second processing module 911 and a second recognition module 912 .

[0171] The first processing module 901 is used to determine whether a first trigger signal is received and send a first start signal to the first camera 221 of the scanning pen 200 to control the first camera 221 to turn on; the first recognition module 902 is used to receive image information collected by the first camera 221, and the image information collected by the first camera 221 is used for text recognition.

[0172] The second processing module 911 is used to determine whether a second trigger signal has been received, send a second start signal to the second camera 222 of the scanning pen 200, and send a drive signal to the drive mechanism of the second camera 222, wherein the second start signal is used to control the second camera 222 to turn on, and the drive signal is used to control the drive mechanism to work until the second camera 222 is driven to rotate to the target angle; the second recognition module 912 is used to receive and recognize image information captured by the second camera 222.

[0173] The second processing module 911 and the first processing module 901 may also be integrated into one processing module, and the second recognition module 912 and the first recognition module 902 may also be integrated into one recognition module.

[0174] The control device of the scanning pen 200 according to the embodiment of the present invention can control the working status of multiple cameras in different areas, so that the scanning pen 200 can adapt to various usage requirements and expand the application scenarios of the scanning pen 200.

[0175] Figure 10 An example of a physical structure diagram of an electronic device is shown below. Figure 10 As shown, the electronic device may include: a processor 10, a communication interface 20, a memory 30, and a communication bus 40, wherein the processor 10, the communication interface 20, and the memory 30 communicate with each other via the communication bus 40. The processor 10 may call the logic instructions in the memory 30 to execute a control method for the scanning pen, the method comprising: determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen to control the first camera to turn on; receiving image information captured by the first camera, the image information captured by the first camera being used for text recognition; or determining that a second trigger signal is received, sending a second start signal to the second camera of the scanning pen, and sending a drive signal to the drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to work until the second camera is driven to rotate to a target angle; receiving image information captured by the second camera, and recognizing it.

[0176] In addition, the logic instructions in the above-mentioned memory 30 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0177] On the other hand, an embodiment of the present invention also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the control method of the scanning pen provided by the above-mentioned method embodiments, the method including: determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen to control the first camera to turn on; receiving image information captured by the first camera, and the image information captured by the first camera is used for text recognition; or determining that a second trigger signal is received, sending a second start signal to the second camera of the scanning pen, and sending a drive signal to the drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to work until the second camera is driven to the target angle; receiving the image information captured by the second camera and identifying it.

[0178] On the other hand, an embodiment of the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute the control method of the scanning pen provided by the above embodiments, the method including: determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen to control the first camera to turn on; receiving image information captured by the first camera, and the image information captured by the first camera is used for text recognition; or determining that a second trigger signal is received, sending a second start signal to the second camera of the scanning pen, and sending a drive signal to the drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to work until the second camera is driven to the target angle; receiving the image information captured by the second camera and identifying it.

[0179] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0180] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0181] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for controlling a scanning pen, characterized in that: include: Determining that a first trigger signal is received, sending a first start signal to the first camera of the scanning pen to control the first camera to start; receiving image information captured by the first camera, where the image information captured by the first camera is used for text recognition and translating the image information into text information; determining that a second trigger signal has been received, sending a second start signal to the second camera of the scanning pen, and sending a drive signal to a drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to operate so as to drive the second camera to rotate to a target angle; When the scanning pen is mounted on a fixed bracket, the driving mechanism drives the second camera to rotate to a first target angle, so that the scanning pen operates in a second recognition mode. Image information collected by the second camera is used for feature extraction, and corresponding audio data is determined based on the extracted features. When the scanning pen is held and used, the driving mechanism drives the second camera to rotate to a second target angle, so that the scanning pen works in a third recognition mode to perform a wide range of text recognition or pattern recognition; receiving and identifying image information captured by the second camera; The scanning pen includes a housing, a first camera, and a second camera. The first camera and the second camera are respectively arranged on the peripheral wall of the housing. The first camera faces one end of the pen tip of the housing, and the second camera and a display screen are arranged on both sides along the thickness direction of the housing. The display screen is used to display text recognized by the scanning pen, and the display screen is configured to face the user side. The scanning pen scans text line by line based on the first camera, and scans a whole page of a picture book based on the second camera.

2. The control method of the scanning pen according to claim 1, characterized in that: When the driving mechanism drives the second camera to rotate to the first target angle, the second trigger signal is generated when the first sensor of the scanning pen senses that the scanning pen is installed at the target position; Alternatively, the second trigger signal is generated when the scanning pen is electrically connected to a target external terminal.

3. The control method of the scanning pen according to claim 1, characterized in that: At the first target angle, the angle β between the direction of the second camera and the length direction of the scanning pen satisfies: 55°≤β≤65°, and the second camera is tilted toward the direction of the first camera.

4. The control method of the scanning pen according to claim 1, characterized in that: When it is determined that the second trigger signal is received, if the scanning pen operates in the second recognition mode and it is determined that the scanning pen is electrically connected to the external terminal, the recognized information is sent to the external terminal so that the external terminal displays content corresponding to the image information.

5. The control method of the scanning pen according to claim 1, characterized in that: The image information collected by the second camera is used for text recognition, and at the second target angle, the angle γ between the direction of the second camera and the length direction of the scanning pen satisfies: 85°≤γ≤95°.

6. The control method of the scanning pen according to claim 5, characterized in that: When the driving mechanism drives the second camera to rotate to the second target angle, the second trigger signal is generated by the control switch of the scanning pen; Alternatively, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the sensing signal of the second sensor of the scanning pen; Alternatively, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the recognition result of the image information collected by the scanning pen; Alternatively, the second trigger signal is generated when the trigger request of the scanning pen is confirmed, and the trigger request is generated based on the sensing signal of the second sensor of the scanning pen and the recognition result of the image information collected by the scanning pen.

7. The control method of the scanning pen according to any one of claims 1 to 6, characterized in that: include: Based on the image information collected by the second camera, it is determined that the brightness of the image information is lower than a preset value, and a fill light turn-on signal for controlling the fill light to turn on is sent to the fill light of the scanning pen.

8. The control method of the scanning pen according to any one of claims 1 to 6, characterized in that: The first trigger signal is generated by a trigger switch at the working end of the scanning pen.

9. The control method of the scanning pen according to any one of claims 1 to 6, characterized in that: Also includes: When it is determined that the second trigger signal is received, sending a first shut-down signal to the first camera of the scanning pen to control shutting down the first camera; When it is determined that the first trigger signal is received, a second shut-down signal for controlling the second camera to be shut down is sent to the second camera of the scanning pen.

10. A control device for a scanning pen, characterized in that: include: a first processing module, configured to determine receipt of a first trigger signal and send a first start signal to the first camera of the scanning pen to control turning on the first camera; a first recognition module, configured to receive image information captured by the first camera, wherein the image information captured by the first camera is used for text recognition and to translate the image information into text information; a second processing module, configured to determine receipt of a second trigger signal, send a second start signal to the second camera of the scanning pen, and send a drive signal to a drive mechanism of the second camera, wherein the second start signal is used to control the second camera to turn on, and the drive signal is used to control the drive mechanism to operate so as to drive the second camera to rotate to a target angle; when the scanning pen is mounted on a fixed bracket, the drive mechanism drives the second camera to rotate to a first target angle, so that the scanning pen operates in a second recognition mode, and image information collected by the second camera is used for feature extraction, and corresponding audio data is determined based on the extracted features; When the scanning pen is held and used, the driving mechanism drives the second camera to rotate to a second target angle, so that the scanning pen works in a third recognition mode; A second recognition module is used to receive and recognize image information collected by the second camera; The scanning pen includes a housing, a first camera, and a second camera. The first camera and the second camera are respectively arranged on the peripheral wall of the housing. The first camera faces one end of the pen tip of the housing, and the second camera and a display screen are arranged on both sides along the thickness direction of the housing. The display screen is used to display text recognized by the scanning pen, and the display screen is configured to face the user side. The scanning pen scans text line by line based on the first camera, and scans a whole page of a picture book based on the second camera.

Images