A reading system based on visual detection

By adopting visual detection technology and electric push rod system in the reading system, the problem of using reading machines and frequent movement of book positions under network conditions is solved, and efficient and accurate text information collection and reading are achieved.

CN114051080BActive Publication Date: 2025-02-25SHANGHAI YINGMAO INFORMATION TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111323703.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-10
Publication Date
2025-02-25
Estimated Expiration
2041-11-10

AI Technical Summary

Technical Problem

Existing reading machines cannot be used normally when there is no network or the network is unstable, and due to different books sizes, it is necessary to frequently move the book location to use the reading function, resulting in content reading errors.

Method used

A reading system based on visual detection is designed, using components such as longitudinal electric push rods, first motors, transverse electric push rods and second motors. Through wireless communication base stations and central control units, the position of the camera device and the adjustment of the scanning angle are achieved to ensure accurate collection of image information at different book positions.

Benefits of technology

It realizes the normal use of the reading system under no network conditions, and by accurately adjusting the position of the camera device and scanning angle, the reading efficiency is improved, the frequency of the movement of the book position is reduced, and the accuracy of text information is ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114051080B_ABST
    Figure CN114051080B_ABST
Patent Text Reader

Abstract

The present invention relates to a reading system based on visual detection, and relates to the technical field of point reading equipment, including a base, the upper surface of which is connected to a longitudinal electric push rod, the top end of the longitudinal electric push rod is connected to a first motor, the first motor is used to control the image acquisition end to rotate in the horizontal direction, the output end of the first motor is connected to a first motor reducer, one side of the first motor reducer is connected to a transverse electric push rod, the transverse electric push rod is used to control the extension and retraction of the image acquisition end in the horizontal direction, the end of the transverse electric push rod away from the first motor is connected to a second motor, the second motor is used to control the image acquisition end to rotate in the vertical direction, the output end of the second motor is connected to a second motor reducer, and the other end of the second motor reducer is connected to the image acquisition end. The system of the present invention effectively improves the reading efficiency of the reader.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of point-reading equipment, and in particular to a reading system based on visual detection. Background Art

[0002] At present, there is a new type of reading pen and reading machine. The common feature of these devices is that they have a camera. As long as you put the book in front of the camera and flip through the book, the machine can read the contents of the book. When you point your finger or other objects to a certain position in the book, the machine will read the audio at the specified position.

[0003] There are two problems with reading machines at present. The first problem is that when there is no network, the flipping and finger reading functions cannot be used. When the network is unstable, it will cause lag in use. The reason is that to achieve this reading and finger reading method, the reading machine interacts with the remote server through the network after connecting to the network to transmit relevant data, such as audio data and fingertip recognition data. When there is no network or the network signal is poor, this data interaction will be blocked, which will affect the use of the device. The second problem is that when using the reading machine, due to the different sizes of books, the book needs to be moved to the specified position under the reading machine to use the reading function. Therefore, the book position needs to be moved frequently during use, which is easy to cause content recognition errors. Summary of the invention

[0004] To this end, the present invention provides a reading system based on visual detection to overcome the problem of low reading efficiency caused by the inability to accurately adjust the image acquisition position according to the position of the book in the prior art.

[0005] To achieve the above object, the present invention provides a reading system based on visual detection, comprising:

[0006] A base, an upper surface of which is connected to a longitudinal electric push rod, the longitudinal electric push rod is used to control the longitudinal movement of the image acquisition end, the top end of the longitudinal electric push rod is connected to a first motor, the first motor is used to control the image acquisition end to rotate in a horizontal direction, the output end of the first motor is connected to a first motor reducer, a side of the first motor reducer is connected to a transverse electric push rod, the transverse electric push rod is used to control the extension and retraction of the image acquisition end in a horizontal direction, an end of the transverse electric push rod away from the first motor is connected to a second motor, the second motor is used to control the image acquisition end to rotate in a vertical direction, the output end of the second motor is connected to a second motor reducer, the other end of the second motor reducer is connected to the image acquisition end, the image acquisition end is used to collect image information of a book, a camera device is also provided on the lower surface of the image acquisition end, and a positioning unit, a wireless communication unit and a data transmission unit are provided inside the image acquisition end;

[0007] A data processing system, comprising a wireless communication base station, a data storage unit, a data analysis unit and a central control unit, wherein each of the components is wirelessly connected to the data processing system via the wireless communication unit;

[0008] When the camera device scans the book in the rectangular scanning area, the central control unit controls the camera device to rotate according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book, until the upper edge of the rectangular scanning area is parallel to the upper edge of the book;

[0009] When the first motor has completed its rotation, when the camera device is scanning the book in the rectangular scanning area, the central control unit determines the position of the camera device according to the size of the interval between each point;

[0010] When the central control unit determines that the position of the camera device is high, the central control unit controls the longitudinal electric push rod to descend, and the central control unit selects the corresponding descending height of the longitudinal electric push rod by comparing the scanned book area ratio F with each preset book area ratio; after the central control unit selects the descending height of the longitudinal electric push rod, when the central control unit adjusts the selected descending height, the central control unit compares the minimum point spacing Dmin of the book with each preset minimum point spacing to select the corresponding descending height adjustment coefficient to adjust the descending height; when the central control unit completes the height adjustment of the longitudinal electric push rod, the central control unit controls the transverse electric push rod to extend and retract from the side with the larger transverse margin to the side with the smaller transverse margin; when the central control unit controls the transverse electric push rod to extend and retract, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device;

[0011] When the central control unit determines that the position of the camera device is low, the central control unit controls the longitudinal electric push rod to rise, and the central control unit selects the corresponding longitudinal electric push rod rising height by comparing the scanned book area proportion F with each preset book area proportion; after the central control unit selects the rising height of the longitudinal electric push rod, when the central control unit adjusts the selected rising height, the central control unit compares the maximum point spacing Dmax of the book with each preset maximum point spacing to select the corresponding rising height adjustment coefficient to adjust the rising height.

[0012] Furthermore, when the camera device scans the book in the rectangular scanning area, the central control unit controls the rotation of the camera device according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book until the upper edge of the rectangular scanning area is parallel to the upper edge of the book; wherein, when the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book is θ, the central control unit controls the first motor to rotate the camera device clockwise at an angle θ, 0°<θ<90°.

[0013] Further, when the first motor completes its rotation, when the camera device scans the book in the rectangular scanning area, a preset standard point spacing D is set in the central control unit, and the central control unit obtains the upper left point spacing D1, the lower left point spacing D2, the upper right point spacing D3 and the lower right point spacing D4 by scanning the book. When any end point of the book in the rectangular scanning area is on the edge line of the rectangular scanning area, the point spacing corresponding to the end point is set to 0, and the central control unit determines the position of the camera device according to the size of each point spacing;

[0014] When 0<D1≤D, 0<D2≤D, 0<D3≤D, 0<D4≤D, or 0<D1≤D, 0<D2≤D, D<D3, D<D4, or D<D1, D<D2, 0<D3≤D, 0<D4≤D, or 0<D1≤D, D<D2, 0<D3≤D, D<D4, or D<D1, 0<D2≤D, D<D3, 0<D4≤D, the central control unit determines that the position of the camera device meets the requirements;

[0015] When 0<D1≤D, D<D2, D<D3, D<D4, or 0<D2≤D, D<D1, D<D3, D<D4, or 0<D3≤D, D<D1, D<D2, D<D4, or 0<D4≤D, D<D1, D<D2, D<D3, or D<D1, D<D2, D<D3, D<D4, the central control unit determines that the position of the camera device is high;

[0016] When D1=0, D2=0, or D3=0, D4=0, or D1=0, D3=0, or D2=0, D4=0, the central control unit determines that the position of the camera device is low.

[0017] Further, when the central control unit determines that the position of the camera device is high, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding descending height of the longitudinal electric push rod according to the comparison result;

[0018] When F<F1, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E3;

[0019] When F1≤F<F2, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E2;

[0020] When F2≤F<F3, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E1;

[0021] Among them, F1 is the first preset book area ratio, F2 is the second preset book area ratio, F3 is the third preset book area ratio, F1<F2<F3; E1 is the first preset descent height, E2 is the second preset descent height, E3 is the third preset descent height, E1<E2<E3.

[0022] Further, after the central control unit selects the descending height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset descending height Ei, i=1,2,3 is set, the central control unit compares the minimum point spacing Dmin of the book with each preset minimum point spacing, and selects the corresponding descending height adjustment coefficient according to the comparison result to adjust Ei, and the minimum point spacing Dmin is the minimum value among D1, D2, D3 and D4;

[0023] When the central control unit selects the jth preset descent height adjustment coefficient mj to adjust Ei, j=1, 2, 3 is set, the adjusted descent height is Ei', and Ei'=Ei×mj is set;

[0024] When Dmin<△D1, the central control unit selects m1 to adjust Ei;

[0025] When △D1≤Dmin<△D2, the central control unit selects m2 to adjust Ei;

[0026] When △D2≤Dmin<△D3, the central control unit selects m3 to adjust Ei;

[0027] Among them, △D1 is the first preset minimum point spacing, △D2 is the second preset minimum point spacing, △D3 is the third preset minimum point spacing, △D1<△D2<△D3; m1 is the first preset descent height adjustment coefficient, m2 is the second preset descent height adjustment coefficient, m3 is the third preset descent height adjustment coefficient, 0<m1<m2<m3<1.

[0028] Furthermore, after the central control unit completes the height adjustment of the longitudinal electric push rod, the central control unit controls the transverse electric push rod to extend and retract from the side with a larger transverse margin to the side with a smaller transverse margin. A telescopic distance G is provided in the central control unit, and G=│P1-P2│÷2 is set, where P1 is the transverse margin close to the first motor, and P2 is the transverse margin away from the first motor.

[0029] Further, when the central control unit controls the lateral electric push rod to complete the telescopic adjustment, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device. When the central control unit controls the second motor to rotate, the central control unit compares the maximum longitudinal margin Qmax in the rectangular scanning area with each preset maximum longitudinal margin, and selects the corresponding second motor rotation angle according to the comparison result;

[0030] When Q1≤Qmax<Q2, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t1;

[0031] When Q2≤Qmax<Q3, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t2;

[0032] When Q3≤Qmax, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t3;

[0033] Wherein, Q1 is the first preset maximum longitudinal margin, Q2 is the second preset maximum longitudinal margin, Q3 is the third preset maximum longitudinal margin, Q1<Q2<Q3; t1 is the first preset second motor rotation angle, t2 is the second preset second motor rotation angle, t3 is the third preset second motor rotation angle, t1<t2<t3;

[0034] After the central control unit controls the second motor to rotate, the central control unit scans the book in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

[0035] Further, when the central control unit determines that the position of the camera device is low, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding longitudinal electric push rod rising height according to the comparison result;

[0036] When F<F1, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H3;

[0037] When F1≤F<F2, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H2;

[0038] When F2≤F<F3, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H1;

[0039] Among them, H1 is the first preset rising height, H2 is the second preset rising height, H3 is the third preset rising height, and H1<H2<H3.

[0040] Further, after the central control unit selects the rising height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset rising height Hi, i=1, 2, 3 is set, the central control unit compares the maximum point spacing Dmax of the book with each preset maximum point spacing, and selects the corresponding rising height adjustment coefficient according to the comparison result to adjust Hi, and the maximum point spacing Dmax is the maximum value among D1, D2, D3 and D4;

[0041] When the central control unit selects the jth preset lifting height adjustment coefficient nj to adjust Hi, set j=1,2,3, the adjusted lifting height is Hi', and set Hi'=Hi×nj;

[0042] When Dmax<Da1, the central control unit selects n1 to adjust Hi;

[0043] When Da1≤Dmax<Da2, the central control unit selects n2 to adjust Hi;

[0044] When Da2≤Dmax<Da3, the central control unit selects n3 to adjust Hi;

[0045] Among them, Da1 is the first preset maximum point spacing, Da2 is the second preset maximum point spacing, Da3 is the third preset maximum point spacing, Da1<Da2<Da3; n1 is the first preset rise height adjustment coefficient, n2 is the second preset rise height adjustment coefficient, n3 is the third preset rise height adjustment coefficient, 1<n1<n2<n3<2.

[0046] Furthermore, after the central control unit controls the longitudinal electric push rod to rise, the central control unit scans the books in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

[0047] Compared with the prior art, the beneficial effect of the present invention lies in that the reading system of the present invention can control the longitudinal height of the camera device by setting a longitudinal electric push rod, and the acquisition range changes accordingly with different longitudinal heights. The height of the camera device can be flexibly adjusted according to the position of the book, so that the scanned text information is more accurate, thereby improving the reading efficiency of the reading system. At the same time, the present invention enables the camera device to rotate in the horizontal direction by setting a first motor. When the book is located in different directions, the camera device can be rotated to the corresponding direction, thereby making the acquired text information more real and reliable, and the camera device can be extended and retracted in the horizontal direction by setting a transverse electric push rod. Regardless of whether the book is directly below the camera device, the central control unit can control the camera device to move to the corresponding position according to the actual position of the book, thereby further ensuring the accuracy of the scanned text information and further improving the reading efficiency of the reading system.

[0048] In particular, the central control unit controls the rotation of the camera device according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book, thereby ensuring that the rectangular scanning area and the book are in a parallel state after rotation, so that the text information on the book is easy to identify, further improving the reading efficiency of the reading system.

[0049] In particular, when the camera device scans a book in a rectangular scanning area, the central control unit determines the position of the camera device according to the size of the point spacing. By determining the position of the camera device, the position of the camera device can be accurately adjusted, thereby making the obtained text information more authentic and reliable, further improving the reading efficiency of the reading system.

[0050] In particular, when the central control unit determines that the position of the camera device is high, the central control unit selects the corresponding descending height of the longitudinal electric push rod by comparing the scanned book area ratio F with each preset book area ratio. When the book area ratio F is smaller, the descending height is greater. By adjusting the height of the camera device, the reliability of obtaining text information is further improved, and the reading efficiency of the reading system is further improved.

[0051] In particular, the central control unit compares the minimum dot spacing Dmin of the book with each preset minimum dot spacing and selects the corresponding descent height adjustment coefficient to adjust Ei, thereby further ensuring the accuracy of the selected descent height, further improving the reliability of obtaining text information, and further improving the reading efficiency of the reading system.

[0052] In particular, the central control unit controls the lateral electric push rod to extend and retract from the side with a larger lateral margin to the side with a smaller lateral margin, so that the book is located in the middle of the rectangular scanning area, thereby further ensuring the reliability of obtaining text information and further improving the reading efficiency of the reading system.

[0053] In particular, after the electric push rod is extended and retracted, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device. By adjusting the scanning angle of the camera device, the reliability of obtaining text information is further guaranteed, and the reading efficiency of the reading system is further improved.

[0054] In particular, when the central control unit determines that the position of the camera device is low, the central control unit selects the corresponding longitudinal electric push rod rising height by comparing the scanned book area ratio F with each preset book area ratio, and expands the range of the rectangular scanning area by raising the height of the camera device, thereby ensuring that the book is covered in the rectangular scanning area, further ensuring the reliability of obtaining text information, and further improving the reading efficiency of the reading system.

[0055] In particular, the central control unit compares the maximum dot spacing Dmax of the book with each preset maximum dot spacing and selects the corresponding rising height adjustment coefficient to adjust Hi. When the maximum dot spacing is larger, the rising height is larger. By accurately adjusting the rising height, the reliability of the text information obtained by scanning can be effectively guaranteed, and the reading efficiency of the reading system can be further improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 is a schematic diagram of a reading system based on visual detection in this embodiment;

[0057] Figure 2 A schematic diagram of the lower surface of the image acquisition end of the reading system based on visual detection in this embodiment. DETAILED DESCRIPTION

[0058] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0059] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0060] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0061] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0062] See also Figure 1 As shown, it is a reading system based on Bluetooth connection and visual detection described in this embodiment, including:

[0063] The base 001 is used to support various components. An audio player 008 is arranged on one side of its outer surface. The audio player 008 is used to play the text on the book. A power supply is arranged inside the base 001. The upper surface of the base 001 is connected to the longitudinal electric push rod 002. The longitudinal electric push rod 002 is used to control the longitudinal movement of the image acquisition end 005. The top of the longitudinal electric push rod 002 is connected to the first motor 003. The first motor 003 is used to control the image acquisition end 005 to rotate in the horizontal direction. The output end of the first motor 003 is connected to the first motor reducer 010. One side of the first motor reducer 010 is connected to the transverse electric push rod 004. The image acquisition end 005 is connected to the second motor 009, the output end of the second motor 009 is connected to the second motor reducer 011, the other end of the second motor reducer 011 is connected to the image acquisition end 005, the image acquisition end 005 is used to acquire image information of the book, the image acquisition end 005 is rectangular, and a positioning unit, a wireless communication unit and a data transmission unit are arranged inside the image acquisition end 005.

[0064] See also Figure 2As shown, it is a schematic diagram of the lower surface of the image acquisition end described in this embodiment. The lower surface of the image acquisition end 005 is provided with a lighting lamp 006, and the lighting lamp 006 is used to illuminate the text information on the book. The lower surface of the image acquisition end 005 is also provided with a camera device 007, and the camera device 007 is used to collect the book position and text information in real time.

[0065] The reading system based on Bluetooth connection and visual detection described in this embodiment also includes a data processing system, which includes a wireless communication base station, a data storage unit, a data analysis unit and a central control unit. Each of the components is wirelessly connected to the data processing system via the wireless communication unit. The wireless connection includes but is not limited to Bluetooth connection and WiFi connection. The data processing system controls the operation of each component by downloading to a smart device, which includes but is not limited to a smartphone and a tablet computer.

[0066] It is understandable that the spacing setting of the lighting lamps and the number of the lighting lamps in this embodiment are not limited, and the position setting of the camera device on the lower surface of the image acquisition end is not limited, as long as it can meet the image acquisition requirements.

[0067] Specifically, the reading system described in this embodiment can effectively control the working process of each component by downloading the data processing system to the smart device, and the interconnection method between the wireless communication unit and the data processing system can be Bluetooth or WiFi. The mobile phone replaces the server to transmit interactive data to realize the reading and pointing reading functions. In particular, the Bluetooth interconnection does not depend on the existence of a WiFi network, and can still be used normally without a network, thereby effectively avoiding the situation where the reading system is stuck when the network is unstable. In addition, the reading system can effectively avoid the continuous movement of the book by automatically adjusting the position of the camera device, thereby improving reading efficiency.

[0068] Specifically, a rectangular scanning area is provided in the central control unit, and a rectangular area to be scanned below the camera device is defined as the rectangular scanning area, and the size of the rectangular scanning area increases with the increase of the height of the camera device from the desktop; the distance between the upper left end point of the book in the rectangular scanning area and the upper left end point of the rectangular scanning area is defined as the upper left point spacing, the distance between the lower left end point of the book in the rectangular scanning area and the lower left end point of the rectangular scanning area is defined as the lower left point spacing, the distance between the upper right end point of the book in the rectangular scanning area and the upper right end point of the rectangular scanning area is defined as the upper right point spacing, and the distance between the lower right end point of the book in the rectangular scanning area and the lower right end point of the rectangular scanning area is defined as the lower right point spacing; the four side lines of the rectangular scanning area are defined as follows: The invention relates to an upper edge line, a lower edge line, a left edge line and a right edge line; defining the ratio of the area of ​​the book in the rectangular scanning area to the area of ​​the rectangular scanning area as the book area ratio; defining the distance between the upper edge line of the rectangular scanning area and the upper edge line of the book as the upper margin, defining the distance between the lower edge line of the rectangular scanning area and the lower edge line of the book as the lower margin, defining the distance between the left edge line of the rectangular scanning area and the left edge line of the book as the left margin, defining the distance between the right edge line of the rectangular scanning area and the right edge line of the book as the right margin, defining the margin in the direction perpendicular to the horizontal electric push rod as the horizontal margin, and defining the margin in the direction parallel to the horizontal electric push rod as the longitudinal margin; defining the angle formed by the lower surface of the image acquisition end and the horizontal plane as the scanning angle.

[0069] Specifically, when the camera device scans the book for the first time, the central control unit controls the longitudinal electric push rod to raise the camera device to a preset height A1, and at the same time, the central control unit controls the transverse electric push rod to extend the distance between the camera device and the first motor to a preset length B1;

[0070] When the camera device scans the book in the rectangular scanning area, the central control unit controls the camera device to rotate according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book until the upper edge of the rectangular scanning area is parallel to the upper edge of the book; wherein, when the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book is θ, the central control unit controls the first motor to rotate the camera device clockwise at an angle θ, 0°<θ<90°.

[0071] Specifically, the central control unit described in this embodiment controls the rotation of the camera device according to the angle formed by the upper edge line of the rectangular scanning area and the upper edge line of the book, thereby ensuring that the rectangular scanning area and the book are in a parallel state after rotation, so that the text information on the book is easy to identify, further improving the reading efficiency of the reading system.

[0072] It can be understood that when setting the rotation angle of the motor in this embodiment, the angle formed by the lower edge line of the rectangular scanning area and the lower edge line of the book, or the angle formed by the left edge line of the rectangular scanning area and the left edge line of the book, or the angle formed by the right edge line of the rectangular scanning area and the right edge line of the book can also be considered. The rotation direction of the motor can also be set to counterclockwise, and the methods of this embodiment can all be adopted.

[0073] Specifically, when the first motor rotates, when the camera device scans the book in the rectangular scanning area, a preset standard point spacing D is set in the central control unit, and the central control unit obtains the upper left point spacing D1, the lower left point spacing D2, the upper right point spacing D3 and the lower right point spacing D4 by scanning the book. When any end point of the book in the rectangular scanning area is on the edge line of the rectangular scanning area, the point spacing corresponding to the end point is set to 0, and the central control unit determines the position of the camera device according to the size of each point spacing;

[0074] When 0<D1≤D, 0<D2≤D, 0<D3≤D, 0<D4≤D, or 0<D1≤D, 0<D2≤D, D<D3, D<D4, or D<D1, D<D2, 0<D3≤D, 0<D4≤D, or 0<D1≤D, D<D2, 0<D3≤D, D<D4, or D<D1, 0<D2≤D, D<D3, 0<D4≤D, the central control unit determines that the position of the camera device meets the requirements;

[0075] When 0<D1≤D, D<D2, D<D3, D<D4, or 0<D2≤D, D<D1, D<D3, D<D4, or 0<D3≤D, D<D1, D<D2, D<D4, or 0<D4≤D, D<D1, D<D2, D<D3, or D<D1, D<D2, D<D3, D<D4, the central control unit determines that the position of the camera device is high;

[0076] When D1=0, D2=0, or D3=0, D4=0, or D1=0, D3=0, or D2=0, D4=0, the central control unit determines that the position of the camera device is low.

[0077] Specifically, when the central control unit determines that the position of the camera device is high, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding descending height of the longitudinal electric push rod according to the comparison result;

[0078] When F<F1, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E3;

[0079] When F1≤F<F2, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E2;

[0080] When F2≤F<F3, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E1;

[0081] Among them, F1 is the first preset book area ratio, F2 is the second preset book area ratio, F3 is the third preset book area ratio, F1<F2<F3; E1 is the first preset descent height, E2 is the second preset descent height, E3 is the third preset descent height, E1<E2<E3.

[0082] Specifically, in this embodiment, when the central control unit determines that the position of the camera device is high, the central control unit selects the corresponding descending height of the longitudinal electric push rod by comparing the scanned book area ratio F with each preset book area ratio. When the book area ratio F is smaller, the descending height is greater. By adjusting the height of the camera device, the reliability of obtaining text information is further improved, and the reading efficiency of the reading system is further improved.

[0083] Specifically, after the central control unit selects the descending height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset descending height Ei, i=1, 2, 3 is set, the central control unit compares the minimum point spacing Dmin of the book with each preset minimum point spacing, and selects the corresponding descending height adjustment coefficient according to the comparison result to adjust Ei, and the minimum point spacing Dmin is the minimum value among D1, D2, D3 and D4;

[0084] When the central control unit selects the jth preset descent height adjustment coefficient mj to adjust Ei, j=1, 2, 3 is set, the adjusted descent height is Ei', and Ei'=Ei×mj is set;

[0085] When Dmin<△D1, the central control unit selects m1 to adjust Ei;

[0086] When △D1≤Dmin<△D2, the central control unit selects m2 to adjust Ei;

[0087] When △D2≤Dmin<△D3, the central control unit selects m3 to adjust Ei;

[0088] Among them, △D1 is the first preset minimum point spacing, △D2 is the second preset minimum point spacing, △D3 is the third preset minimum point spacing, △D1<△D2<△D3; m1 is the first preset descent height adjustment coefficient, m2 is the second preset descent height adjustment coefficient, m3 is the third preset descent height adjustment coefficient, 0<m1<m2<m3<1.

[0089] Specifically, after the central control unit completes the height adjustment of the longitudinal electric push rod, the central control unit controls the transverse electric push rod to extend and retract from the side with a larger transverse margin to the side with a smaller transverse margin. The central control unit is provided with a telescopic distance G, and G=│P1-P2│÷2 is set, where P1 is the transverse margin close to the first motor, and P2 is the transverse margin away from the first motor.

[0090] Specifically, when the central control unit controls the extension and contraction adjustment of the lateral electric push rod, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device. When the central control unit controls the second motor to rotate, the central control unit compares the maximum longitudinal margin Qmax in the rectangular scanning area with each preset maximum longitudinal margin, and selects the corresponding second motor rotation angle according to the comparison result;

[0091] When Q1≤Qmax<Q2, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t1;

[0092] When Q2≤Qmax<Q3, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t2;

[0093] When Q3≤Qmax, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t3;

[0094] Wherein, Q1 is the first preset maximum longitudinal margin, Q2 is the second preset maximum longitudinal margin, Q3 is the third preset maximum longitudinal margin, Q1<Q2<Q3; t1 is the first preset second motor rotation angle, t2 is the second preset second motor rotation angle, t3 is the third preset second motor rotation angle, t1<t2<t3;

[0095] After the central control unit controls the second motor to rotate, the central control unit scans the book in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

[0096] Specifically, the central control unit described in this embodiment controls the horizontal electric push rod to extend and retract from the side with a larger horizontal margin to the side with a smaller horizontal margin. Through extension and retraction, the book is located in the middle of the rectangular scanning area, thereby further ensuring the reliability of obtaining text information and further improving the reading efficiency of the reading system.

[0097] Specifically, when the central control unit determines that the position of the camera device is low, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding longitudinal electric push rod rising height according to the comparison result;

[0098] When F<F1, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H3;

[0099] When F1≤F<F2, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H2;

[0100] When F2≤F<F3, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H1;

[0101] Among them, H1 is the first preset rising height, H2 is the second preset rising height, H3 is the third preset rising height, and H1<H2<H3.

[0102] Specifically, after the central control unit selects the rising height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset rising height Hi, i=1, 2, 3 is set, the central control unit compares the maximum point spacing Dmax of the book with each preset maximum point spacing, and selects the corresponding rising height adjustment coefficient according to the comparison result to adjust Hi, and the maximum point spacing Dmax is the maximum value among D1, D2, D3 and D4;

[0103] When the central control unit selects the jth preset lifting height adjustment coefficient nj to adjust Hi, set j=1,2,3, the adjusted lifting height is Hi', and set Hi'=Hi×nj;

[0104] When Dmax<Da1, the central control unit selects n1 to adjust Hi;

[0105] When Da1≤Dmax<Da2, the central control unit selects n2 to adjust Hi;

[0106] When Da2≤Dmax<Da3, the central control unit selects n3 to adjust Hi;

[0107] Among them, Da1 is the first preset maximum point spacing, Da2 is the second preset maximum point spacing, Da3 is the third preset maximum point spacing, Da1<Da2<Da3; n1 is the first preset rise height adjustment coefficient, n2 is the second preset rise height adjustment coefficient, n3 is the third preset rise height adjustment coefficient, 1<n1<n2<n3<2.

[0108] Specifically, after the central control unit controls the longitudinal electric push rod to rise, the central control unit scans the books in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

[0109] Specifically, when the position of the camera device meets the requirements, the central control module scans and obtains the text information on the book, responds to the reading instruction according to the image information obtained in real time, and controls the audio player to read.

[0110] Specifically, the central control unit described in this embodiment compares the maximum dot spacing Dmax of the book with each preset maximum dot spacing and selects the corresponding rising height adjustment coefficient to adjust Hi. When the maximum dot spacing is larger, the rising height is larger. By accurately adjusting the rising height, the reliability of the text information obtained by scanning can be effectively guaranteed, and the reading efficiency of the reading system can be further improved.

[0111] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A reading system based on visual detection, characterized in that: include: A base, an upper surface of which is connected to a longitudinal electric push rod, the longitudinal electric push rod is used to control the longitudinal movement of the image acquisition end, the top end of the longitudinal electric push rod is connected to a first motor, the first motor is used to control the image acquisition end to rotate in a horizontal direction, the output end of the first motor is connected to a first motor reducer, a side of the first motor reducer is connected to a transverse electric push rod, the transverse electric push rod is used to control the extension and retraction of the image acquisition end in a horizontal direction, an end of the transverse electric push rod away from the first motor is connected to a second motor, the second motor is used to control the image acquisition end to rotate in a vertical direction, the output end of the second motor is connected to a second motor reducer, the other end of the second motor reducer is connected to the image acquisition end, the image acquisition end is used to collect image information of a book, a camera device is also provided on the lower surface of the image acquisition end, and a positioning unit, a wireless communication unit and a data transmission unit are provided inside the image acquisition end; A data processing system, which includes a wireless communication base station, a data storage unit, a data analysis unit and a central control unit, each component being wirelessly connected to the data processing system via the wireless communication unit; When the camera device scans the book in the rectangular scanning area, the central control unit controls the camera device to rotate according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book, until the upper edge of the rectangular scanning area is parallel to the upper edge of the book; When the first motor has completed its rotation, when the camera device is scanning the book in the rectangular scanning area, the central control unit determines the position of the camera device according to the size of the interval between each point; When the central control unit determines that the position of the camera device is high, the central control unit controls the longitudinal electric push rod to descend, and the central control unit selects the corresponding descending height of the longitudinal electric push rod by comparing the scanned book area ratio F with each preset book area ratio; after the central control unit selects the descending height of the longitudinal electric push rod, when the central control unit adjusts the selected descending height, the central control unit compares the minimum point spacing Dmin of the book with each preset minimum point spacing to select the corresponding descending height adjustment coefficient to adjust the descending height; when the central control unit completes the height adjustment of the longitudinal electric push rod, the central control unit controls the transverse electric push rod to extend and retract from the side with the larger transverse margin to the side with the smaller transverse margin; when the central control unit controls the transverse electric push rod to extend and retract, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device; When the central control unit determines that the position of the camera device is low, the central control unit controls the longitudinal electric push rod to rise, and the central control unit selects the corresponding longitudinal electric push rod rising height by comparing the scanned book area ratio F with each preset book area ratio; after the central control unit selects the rising height of the longitudinal electric push rod, when the central control unit adjusts the selected rising height, the central control unit compares the maximum point spacing Dmax of the book with each preset maximum point spacing to select the corresponding rising height adjustment coefficient to adjust the rising height; When the first motor rotates, when the camera device scans the book in the rectangular scanning area, a preset standard point spacing D is set in the central control unit, and the central control unit obtains the upper left point spacing D1, the lower left point spacing D2, the upper right point spacing D3 and the lower right point spacing D4 by scanning the book. When any end point of the book in the rectangular scanning area is on the edge line of the rectangular scanning area, the point spacing corresponding to the end point is set to 0, and the central control unit determines the position of the camera device according to the size of each point spacing; When 0<D1≤D, 0<D2≤D, 0<D3≤D, 0<D4≤D, or 0<D1≤D, 0<D2≤D, D<D3, D<D4, or D<D1, D<D2, 0<D3≤D, 0<D4≤D, or 0<D1≤D, D<D2, 0<D3≤D, D<D4, or D<D1, 0<D2≤D, D<D3, 0<D4≤D, the central control unit determines that the position of the camera device meets the requirements; When 0<D1≤D, D<D2, D<D3, D<D4, or 0<D2≤D, D<D1, D<D3, D<D4, or 0<D3≤D, D<D1, D<D2, D<D4, or 0<D4≤D, D<D1, D<D2, D<D3, or D<D1, D<D2, D<D3, D<D4, the central control unit determines that the position of the camera device is high; When D1=0, D2=0, or D3=0, D4=0, or D1=0, D3=0, or D2=0, D4=0, the central control unit determines that the position of the camera device is low; After the central control unit selects the descending height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset descending height Ei, i=1, 2, 3 is set, the central control unit compares the minimum point spacing Dmin of the book with each preset minimum point spacing, and selects the corresponding descending height adjustment coefficient according to the comparison result to adjust Ei, and the minimum point spacing Dmin is the minimum value among D1, D2, D3 and D4; When the central control unit selects the jth preset descent height adjustment coefficient mj to adjust Ei, j=1, 2, 3 is set, the adjusted descent height is Ei', and Ei'=Ei×mj is set; When Dmin<△D1, the central control unit selects m1 to adjust Ei; When △D1≤Dmin<△D2, the central control unit selects m2 to adjust Ei; When △D2≤Dmin<△D3, the central control unit selects m3 to adjust Ei; Wherein, △D1 is the first preset minimum point spacing, △D2 is the second preset minimum point spacing, △D3 is the third preset minimum point spacing, △D1<△D2<△D3; m1 is the first preset descent height adjustment coefficient, m2 is the second preset descent height adjustment coefficient, m3 is the third preset descent height adjustment coefficient, 0<m1<m2<m3<1; After the central control unit selects the rising height of the longitudinal electric push rod, when the central control unit adjusts the selected i-th preset rising height Hi, i=1, 2, 3 is set, the central control unit compares the maximum point spacing Dmax of the book with each preset maximum point spacing, and selects the corresponding rising height adjustment coefficient according to the comparison result to adjust Hi, and the maximum point spacing Dmax is the maximum value among D1, D2, D3 and D4; When the central control unit selects the jth preset lifting height adjustment coefficient nj to adjust Hi, set j=1,2,3, the adjusted lifting height is Hi', and set Hi'=Hi×nj; When Dmax<Da1, the central control unit selects n1 to adjust Hi; When Da1≤Dmax<Da2, the central control unit selects n2 to adjust Hi; When Da2≤Dmax<Da3, the central control unit selects n3 to adjust Hi; Among them, Da1 is the first preset maximum point spacing, Da2 is the second preset maximum point spacing, Da3 is the third preset maximum point spacing, Da1<Da2<Da3; n1 is the first preset rise height adjustment coefficient, n2 is the second preset rise height adjustment coefficient, n3 is the third preset rise height adjustment coefficient, 1<n1<n2<n3<2.

2. The visual detection-based reading system according to claim 1, characterized in that: When the camera device scans the book in the rectangular scanning area, the central control unit controls the camera device to rotate according to the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book until the upper edge of the rectangular scanning area is parallel to the upper edge of the book; wherein, when the angle formed by the upper edge of the rectangular scanning area and the upper edge of the book is θ, the central control unit controls the first motor to rotate the camera device clockwise at an angle θ, 0°<θ<90°.

3. The visual detection based reading system according to claim 2, characterized in that: When the central control unit determines that the position of the camera device is high, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding descending height of the longitudinal electric push rod according to the comparison result; When F<F1, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E3; When F1≤F<F2, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E2; When F2≤F<F3, the central control unit controls the longitudinal electric push rod to descend, and the descending height is E1; Among them, F1 is the first preset book area ratio, F2 is the second preset book area ratio, F3 is the third preset book area ratio, F1<F2<F3; E1 is the first preset descent height, E2 is the second preset descent height, E3 is the third preset descent height, E1<E2<E3.

4. The visual detection based reading system according to claim 3, characterized in that: When the central control unit completes the height adjustment of the longitudinal electric push rod, the central control unit controls the transverse electric push rod to extend and retract from the side with a larger transverse margin to the side with a smaller transverse margin. The central control unit is provided with a telescopic distance G, and G=│P1-P2│÷2 is set, wherein P1 is the transverse margin close to the first motor, and P2 is the transverse margin away from the first motor.

5. The visual detection based reading system according to claim 4, characterized in that: When the central control unit controls the lateral electric push rod to complete the telescopic adjustment, the central control unit controls the second motor to rotate to adjust the scanning angle of the camera device. When the central control unit controls the second motor to rotate, the central control unit compares the maximum longitudinal margin Qmax in the rectangular scanning area with each preset maximum longitudinal margin, and selects the corresponding second motor rotation angle according to the comparison result; When Q1≤Qmax<Q2, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t1; When Q2≤Qmax<Q3, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t2; When Q3≤Qmax, the central control unit controls the second motor to rotate from the side with the largest longitudinal margin to the side with the smallest longitudinal margin at a rotation angle t3; Wherein, Q1 is the first preset maximum longitudinal margin, Q2 is the second preset maximum longitudinal margin, Q3 is the third preset maximum longitudinal margin, Q1<Q2<Q3; t1 is the first preset second motor rotation angle, t2 is the second preset second motor rotation angle, t3 is the third preset second motor rotation angle, t1<t2<t3; After the central control unit controls the second motor to rotate, the central control unit scans the book in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

6. The visual detection based reading system according to claim 5, characterized in that: When the central control unit determines that the position of the camera device is low, the central control unit compares the scanned book area ratio F with each preset book area ratio, and selects the corresponding longitudinal electric push rod rising height according to the comparison result; When F<F1, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H3; When F1≤F<F2, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H2; When F2≤F<F3, the central control unit controls the longitudinal electric push rod to rise, and the rising height is H1; Among them, H1 is the first preset rising height, H2 is the second preset rising height, H3 is the third preset rising height, and H1<H2<H3.

7. The visual detection based reading system according to claim 6, characterized in that: After the central control unit controls the longitudinal electric push rod to rise, the central control unit scans the books in the rectangular scanning area again, and repeats the determination and adjustment process until the position of the camera device meets the requirements.

Citation Information

Patent Citations

  • Image recognition system and recognition method thereof

    CN110977970A