Intelligent projection reading system and use method thereof

Abstract

The invention belongs to the technical field of intelligent reading auxiliary devices, and particularly discloses an intelligent projection reading system which comprises a supporting table, automatic page turning equipment, a projection surface and integrated projection equipment. The automatic page turning equipment comprises a book placing area used for supporting a book and a driving assembly used for achieving page turning of the book. The projection surface is arranged in front of the integrated projection equipment; the integrated projection equipment is arranged at the top of the supporting table, and the integrated projection equipment comprises a page content recognition module, a word processing module and an optical projection module. According to the intelligent projection reading system and the use method thereof, by arranging the automatic page turning equipment, the inconvenience of manual page turning is solved, and the intelligent projection reading system is suitable for old people and people with inconvenience in hands and feet; besides, through the projection display technology, the user can read the projection content by raising the head so as to reduce cervical vertebra fatigue, and based on the projection display technology, the page content can be visually displayed so as to improve the reading experience.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent reading assistance devices, and particularly relates to an intelligent projection reading system and a using method thereof. Background Art

[0002] In the Internet era, people are surrounded by fragmented information (such as hot searches, short videos), with their attention scattered and prone to falling into a state of "knowing a lot but understanding little". Books, on the other hand, can provide a complete logical framework and in-depth analysis, helping the brain establish complex cognitive paths, enhancing logical and critical thinking. Moreover, books are not controlled by algorithmic recommendations, enabling active exploration of diverse viewpoints and avoiding cognitive ossification.

[0003] The current mainstream book reading methods have the following three significant defects, restricting the universality and convenience of the user experience:

[0004] First, the traditional paper book reading method requires maintaining a fixed posture of lowering the head and holding the book for a long time; it is easy to cause cervical spondylosis and stiff shoulder and neck muscles, which is particularly unfriendly to the elderly and people with limb disabilities. Moreover, the manual page-turning action requires relatively high limb coordination ability, and patients with limb dysfunction are often forced to interrupt reading due to difficulty in turning pages, affecting the immersion.

[0005] Second, using an e-reader, existing devices are difficult to be compatible with the content of paper books, and the digital resources of some professional books (such as ancient books, art picture albums) are scarce, unable to meet the needs of in-depth reading. Moreover, e-reading and paper reading belong to independent scenarios, and users need to frequently switch between the two media, resulting in fragmented knowledge management.

[0006] Third, using a mechanical automatic page-turning device, this device has page positioning deviation and a high page corner damage rate; this device needs to fix the book on a mechanical bracket, resulting in limited reading distance and rigid interaction. Summary of the Invention

[0007] The purpose of the present invention is to provide an intelligent projection reading system and a using method thereof to solve the problems that the mainstream data reading methods in the prior art restrict the universality and convenience of the user experience, etc.

[0008] The purpose of the present invention can be achieved through the following technical solutions:

[0009] In the first aspect, the present invention provides an intelligent projection reading system, including:

[0010] A support platform;

[0011] An automatic book-turning device, the automatic book-turning device comprising a book placement area for supporting a book and a driving component for realizing book page-turning;

[0012] A projection surface, which is arranged in front of the integrated projection device;

[0013] An integrated projection device, which is arranged on the top of the support platform. The integrated projection device includes a page content recognition module, a text processing module, and an optical projection module. The page content recognition module is used to automatically recognize the content of a book page and transmit the book page content to the text processing module for correction processing. The optical projection module is used to receive the processed book page content from the text processing module, and the optical projection module is also used to project the processed book page content onto the projection surface and display it.

[0014] Further, the integrated projection device further includes a device body, and both the page content recognition module and the optical projection module are arranged on the device body;

[0015] The page content recognition module includes an aspherical mirror, a lens group, and an image receiver;

[0016] The aspherical mirror has a working concave surface facing the book, and the working concave surface also faces the lens group;

[0017] After the book page content is reflected by the working concave surface of the aspherical mirror, it is transmitted to the image receiver through the lens group;

[0018] The output end of the image receiver is docked with the input end of the text processing module.

[0019] Further, the lens group includes a plurality of transmissive lenses arranged side by side, and the plurality of transmissive lenses are arranged on the same optical axis.

[0020] Further, the image receiver is a CCD or a CMOS.

[0021] Further, the driving assembly includes a book pressing device, a page turning device, and a page sucking device, and there are two book pressing devices;

[0022] The two book pressing devices are arranged opposite to each other in the transverse direction of the book placement area, and are respectively positioned at the left end and the right end of the book placement area;

[0023] The page turning device is arranged at the rear end of the book placement area, and the page sucking device is arranged on the side of the page turning device;

[0024] The integrated projection device is arranged at the front end of the book placement area.

[0025] Further, the book pressing device includes a mounting seat, a book pressing driving mechanism, and a driving arm. There are two book pressing driving mechanisms, which are respectively arranged at the front end and the rear end of the mounting seat. The driving arm is arranged at the output end of the book pressing driving mechanism, and the book pressing driving mechanism is used to drive the driving arm to rotate.

[0026] Further, the page turning device includes a bottom carrier, a first lifting driving mechanism, a first telescopic mechanism, a turning mechanism, and a page turning member;

[0027] The first lifting driving mechanism is arranged on the top of the bottom carrier;

[0028] The mounting end of the turning mechanism is arranged at the output end of the first lifting driving mechanism. The output end of the turning mechanism is connected to the mounting end of the first telescopic mechanism, and the output end of the first telescopic mechanism is connected to the page turning member;

[0029] The first lifting driving mechanism is used to drive the turning mechanism to lift, the turning mechanism is used to drive the first telescopic mechanism to rotate, and the first telescopic mechanism is used to drive the page turning member to move.

[0030] Further, the page sucking device includes a bottom carrier seat, a second lifting driving mechanism, a second telescopic mechanism, a connecting arm, and a suction cup;

[0031] The second lifting driving mechanism is arranged on the top of the bottom carrier seat. The mounting end of the second telescopic mechanism is arranged at the output end of the second lifting driving mechanism. The output end of the second telescopic mechanism is connected to the upper end of the connecting arm, and the lower end of the connecting arm is connected to the suction cup;

[0032] The second lifting driving mechanism is used to drive the second telescopic mechanism to lift, and the second telescopic mechanism is used to drive the connecting arm to move;

[0033] The suction cup is used to adsorb the book pages.

[0034] Further, a book sucking driving mechanism is further arranged in the bottom carrier seat. The connecting end of the book sucking driving mechanism is connected to the mounting end of the second lifting driving mechanism, and the book sucking driving mechanism is used to drive the second lifting driving mechanism to rotate.

[0035] In a second aspect, the present invention provides a usage method of an intelligent projection reading system, including the following steps:

[0036] S1. Place the book unfolded to the target page in the book placement area, and respectively press both sides of the unfolded page of the book through the book pressing devices symmetrically arranged at the left end and the right end of the book placement area;

[0037] S2. Obtain the book page content of the target page of the book through the page content recognition module, and transmit the book page content to the text processing module for correction processing. The optical projection module is used to receive the processed book page content from the text processing module. The optical projection module is also used to project the processed book page content onto the projection surface and display it;

[0038] S3. Select the book pressing device to perform the page turning operation according to the reading progress;

[0039] S4. Automatically turn the pages of the book;

[0040] The process of step S4 is as follows:

[0041] S41. Control the driving arm of the book pressing device selected in step S3 to perform a lifting movement;

[0042] S42. Adsorb the page to be turned by the suction cup of the page sucking device and lift it to a preset height;

[0043] S43. Drive the page turning device to complete the page turning action;

[0044] S44. Control the driving arm to perform a downward pressing action to reset and press the book, and complete the page turning operation.

[0045] Compared with the prior art, the beneficial effects of the present invention are:

[0046] 1. The present invention provides an intelligent projection reading system and its usage method. By setting up an automatic page turning device, it solves the inconvenience of manual page turning and is suitable for the elderly and people with inconvenient hands and feet. In addition, through the projection display technology, users can reduce cervical fatigue by looking up to read the projected content, and based on the projection display technology, the page content can be intuitively displayed, thus enhancing the reading experience.

[0047] 2. In the present invention, the integrated projection device includes a page content recognition module and an optical projection module. The page content recognition module is used to collect the book page content in real time, transmit the book page content to the text processing module for processing and then transmit it to the optical projection module. The optical projection module is used to project the book page content onto the projection surface and display it. During this process, the digital processing of paper books is realized, which simplifies the user operation. In addition, through the projection technology, users can adjust the content size and display mode according to their needs to meet the reading needs of different users. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The drawings described herein are used to provide a further understanding of the present invention, form a part of this application, and the schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention. In the drawings:

[0049] Figure 1 It is a schematic structural diagram provided by Embodiment 1 of the present invention;

[0050] Figure 2 It is a schematic structural diagram of the device main body provided by Embodiment 1 of the present invention;

[0051] Figure 3 It is a schematic structural diagram of the page content recognition module provided by Embodiment 3 of the present invention;

[0052] Figure 4 It is a schematic structural diagram provided by Embodiment 4 of the present invention;

[0053] Figure 5 It is a schematic structural diagram of the page content recognition module provided by Embodiment 4 of the present invention;

[0054] Figure 6 It is a schematic structural diagram of the driving component provided by Embodiment 6 of the present invention;

[0055] Figure 7 It is a schematic structural diagram of the book pressing device provided by Embodiment 6 of the present invention;

[0056] Figure 8 It is a schematic structural diagram of the book turning device provided by Embodiment 6 of the present invention;

[0057] Figure 9 It is a schematic structural diagram of the page sucking device provided by Embodiment 6 of the present invention.

[0058] Among them, the reference numerals are: 1, support platform; 3, automatic book turning device; 2, integrated projection device; 4, projection surface; 5, book placement area; 6, book pressing device; 7, book turning device; 8, page sucking device; 9, chair; 21, device main body; 22, aspherical mirror; 23, lens group; 24, image receiver; 25, transmissive lens; 26, connecting bracket; 27, notch; 28, inclined notch; 61, mounting seat; 62, book pressing driving mechanism; 63, driving arm; 71, bottom carrier; 72, lifting driving mechanism I; 73, book turning member; 74, telescopic mechanism I; 81, bottom bearing seat; 82, lifting driving mechanism II; 83, telescopic mechanism II; 84, connecting arm; 85, suction cup. Detailed implementation manners

[0059] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0060] In the description of the present invention, it should be understood that the terms "opening", "upper", "lower", "thickness", "top", "middle", "length", "inner", "periphery", etc. indicating the orientation or positional relationship are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the components or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be construed as a limitation of the present invention.

[0061] The current mainstream book reading methods have the following three significant defects, which restrict the universality and convenience of the user experience:

[0062] First, the traditional paper book reading method is adopted. Traditional reading requires maintaining a fixed posture of lowering the head and holding the book by hand for a long time, and the following problems are likely to occur: (1) The inconvenience of manually turning pages, that is, the traditional paper book reading method requires the reader to manually turn pages, which may be relatively difficult for the elderly and people with inconvenient hands and feet, and long-term manual page turning is likely to cause hand fatigue and affect the reading experience; (2) Reading with the head down for a long time harms the cervical spine: The traditional reading method requires the reader to look down at the book for a long time, which is likely to cause cervical spine fatigue and discomfort; (3) The interactivity and intelligence of the reading experience are insufficient, that is, the traditional reading method lacks interactivity, and the reader cannot interact with the book content in real time; (4) The flexibility and diversity of content display are insufficient: The traditional book display method is fixed and cannot flexibly adjust the content size and display method according to the user's needs. For users with poor eyesight or those who need large font display, the existing reading methods cannot meet their needs;

[0063] Second, e-readers are adopted. Existing devices are difficult to be compatible with the content of paper books, and the digital resources of some professional books (such as ancient books and art picture albums) are scarce, unable to meet the needs of in-depth reading. Moreover, e-reading and paper reading belong to independent scenarios, and users need to frequently switch between the two media, resulting in fragmented knowledge management;

[0064] In addition, the digital processing of paper books is difficult: Existing e-books and readers cannot directly process paper books, and users need to manually input or scan the book content; the digital process of paper books is cumbersome and lacks intelligent processing functions;

[0065] And although existing e-books and readers provide certain interactive functions, there are still deficiencies in intelligent analysis and explanation;

[0066] Third, a mechanical automatic page-turning device is adopted. This device has page positioning deviation and a high page corner breakage rate; this device needs to fix the book on a mechanical bracket, resulting in a limited reading distance and a rigid interaction.

[0067] Therefore, it is of great practical significance to develop an intelligent reading system that can automatically turn pages, recognize text and project content.

[0068] Example 1

[0069] As Figure 1 shown, this embodiment provides an intelligent projection reading system, including a support platform 1, an automatic book-turning device 3, a projection surface 4, and an integrated projection device 2, specifically as follows:

[0070] Support platform 1;

[0071] Automatic book-turning device 3, which includes a book placement area 5 for supporting books and a driving component for realizing book page turning;

[0072] Projection surface 4, which is arranged in front of the integrated projection device 2;

[0073] Integrated projection device 2, which is arranged on the top of the support platform 1. The integrated projection device 2 includes a page content recognition module, a text processing module, and an optical projection module. The page content recognition module is used to automatically recognize the content of the book page and transmit the content of the book page to the text processing module for correction processing. The optical projection module is used to receive the processed content of the book page from the text processing module, and the optical projection module is also used to project the processed content of the book page onto the projection surface 4 and display it;

[0074] In this embodiment, the automatic book-turning device 3 is adopted to turn the book placed in the book placement area 5, and the page content recognition module on the integrated projection device 2 is used to collect and transmit the content of the opened book page. After transmitting the content of the book page to the optical projection module, the optical projection module projects the content of the book page onto the projection surface 4 for display;

[0075] Specifically, the page content recognition module uses a high-resolution camera and OCR (Optical Character Recognition) technology to automatically recognize the text content on the book;

[0076] Among them, the optical projection module can adopt types of projection such as long focus, short focus, and ultra-short focus, and at the same time project the picture onto the projection surface 4. In addition, the light source of the optical projection module adopts eye-protecting laser to reduce the harm of blue light to the human eye;

[0077] The projection surface 4 is a two-dimensional structural plane. Specifically, the projection surface 4 can be a wall, an anti-light curtain, a high-gain curtain, a conventional curtain, etc.;

[0078] In this embodiment, the word processing module has the following functions: First, it uses filtering techniques (such as Gaussian filtering, median filtering, etc.) to reduce noise; second, it detects the edges of the book pages through algorithms; third, it can convert the images of the book page content into black and white to highlight the contrast between the book pages and the background; fourth, it can use algorithms to detect the corner points of the book pages, analyze the movement of the book pages, extract the contours of the book pages, and track the changes in their shapes, judge the movement direction of the book pages, identify the page turning actions, confirm the page turning behaviors, detect the changes in the shapes of the book pages, identify the page turning, identify the page content, etc.; fifth, it identifies the changes in the page content through feature matching;

[0079] An intelligent projection reading system provided in this embodiment has the following advantages: First, it can provide a convenient reading experience, that is, it liberates the user's hands through the automatic page turning device 3, which is especially suitable for the elderly and people with inconvenient hands and feet, improving the convenience of reading; second, it provides a healthy reading method, that is, it uses an integrated projection device 2. Based on the projection display technology, the user can read the projected content by looking up, reducing cervical fatigue and protecting the user's health; third, it has efficient digital processing, that is, the page content recognition module can quickly digitalize the paper books, simplifying the user's operation and improving the efficiency; fourth, it provides an intelligent reading experience, that is, it can provide in-depth content analysis and explanation by combining artificial intelligence analysis and explanation functions, enhancing the interactivity and intelligence of reading; fifth, the optical projection module on the integrated projection device 2 allows the user to adjust the content size and display mode according to needs, meeting the reading needs of different users, especially users with poor eyesight or those who need large font displays.

[0080] Embodiment 2

[0081] As Figure 1 shown, an intelligent projection reading system provided in this embodiment is different from that in Embodiment 1. In this embodiment, the integrated projection device 2 further includes an artificial intelligence analysis unit, which can perform in-depth content analysis and explanation on the book page content, enhancing the interactivity and intelligence of reading.

[0082] Since the page content recognition module is used to collect the book page content in real time and transmit the book page content to the word processing module for correction, format adjustment and other processing to ensure the accuracy and readability of the processed book page content, and the optical projection module is used to receive the processed book page content from the word processing module, and the optical projection module is also used to project the processed book page content onto the projection surface 4 and display it;

[0083] That is, in this embodiment, the page content recognition module can adopt a high-resolution camera and OCR (Optical Character Recognition) technology to automatically recognize the text content on the book, while the text processing module can correct and format the text recognized by the camera to ensure the accuracy and readability of the text content. The optical projection module is used to project the processed text content onto the projection surface 4. Users can read the projection content by looking up, reducing cervical fatigue. The artificial intelligence analysis unit can perform real-time analysis and explanation on the projection content on the projection surface 4, providing an intelligent reading experience and enhancing interactivity;

[0084] In this embodiment, the artificial intelligence analysis unit realizes the collaborative processing of text semantic understanding and visual feature recognition based on a deep learning model; the artificial intelligence analysis unit can achieve real-time content analysis through a dual-channel processing engine (i.e., a text processing channel and a visual processing channel): in the text processing channel, syntactic analysis, entity recognition, and knowledge graph association can be performed; in the visual processing channel, page element segmentation can be realized, supporting functions such as formula recognition, chart parsing, and handwritten character identification; the artificial intelligence analysis unit can be connected to the knowledge base, provide in-depth content analysis based on the book page content, and can perform real-time explanations in multiple languages;

[0085] Specifically, in the intelligent projection reading system provided in this embodiment, the system can be implemented based on the following algorithms:

[0086] I. Page content recognition algorithm based on multi-modal feature fusion of the page content recognition module

[0087] 1. High-precision OCR enhancement model

[0088] Model architecture: Adopt a dual-stream structure of a multi-scale feature pyramid network (FPN) and Transformer;

[0089] Input layer: Perform adaptive illumination compensation (CLAHE algorithm) and perspective correction (based on Harris corner detection + Homography transformation) on the image captured by the camera;

[0090] Feature extraction:

[0091] Visual stream: Use a ResNet-50 backbone network to extract multi-scale feature maps;

[0092] Text stream: Use a ViT-Base model to extract global semantic features;

[0093] Feature fusion: Realize dual-stream feature interaction through a cross-attention mechanism, formula expression:

[0094]

[0095] Among them, Q comes from text stream features, and K / V come from visual stream features;

[0096] Decoder: The CTC loss function optimized based on Beam Search, supporting a mixed character set (including printed characters, handwritten characters, and special symbols);

[0097] The advantage of this algorithm is that it can solve the problem of character segmentation in complex layouts through the complementarity of dual-stream features.

[0098] II. The text processing module is based on a text processing algorithm driven by a dynamic knowledge graph

[0099] 1. Context-aware semantic correction model

[0100] Adopt the BERT-CRF joint architecture:

[0101] BERT layer: Fine-tune the Chinese RoBERTa-wwm-ext model;

[0102] CRF layer: Define the transition matrix constraint conditions:

[0103]

[0104] Knowledge enhancement mechanism: Associate the named entities in the text with the CN-DBpedia knowledge base through entity linking to establish dynamic context constraints;

[0105] 2. Layout reconstruction algorithm

[0106] Paragraph division model based on conditional random field (CRF):

[0107] Feature function definition:

[0108]

[0109] Support automatic conversion of LaTeX formula typesetting specifications;

[0110] The advantages of this algorithm are: first, it has real-time and context-aware capabilities; second, it has knowledge-enhanced reasoning capabilities; third, it has an adaptive evolution mechanism; fourth, it has interpretability and decision traceability; fifth, it has domain migration and cold start optimization;

[0111] III. The text processing module is also based on a dual-channel cognitive engine algorithm architecture

[0112] 1. Text processing channel

[0113] Syntactic analysis module: Adopt a dependency syntactic parser based on the Eisner algorithm, with the time complexity optimized to O(n^3)

[0114] Real-time knowledge graph construction:

[0115] Entity recognition: BiLSTM-CRF model, and the BIOES scheme is adopted for the annotation set;

[0116] Relation extraction: a joint extraction framework based on the pre-trained model ERNIE;

[0117] 2. Visual processing channel

[0118] Formula recognition subsystem:

[0119] Recurrent neural network (RNN) encoded by the Gram matrix:

[0120] G(x) i，j = φ(x i ) T φ(x j )

[0121] where is the embedded representation of the symbol;

[0122] Chart parsing module:

[0123] Component detection based on MaskR-CNN (mAP@0.5 = 0.92) ;

[0124] Axis parsing algorithm: the Hough transform is used to detect the axis, and the SVM classifier is used to identify the scale type;

[0125] 3. Cross-modal alignment mechanism

[0126] Design a bilinear attention pooling layer:

[0127] S ij = f a (v i ) T f b (t j )

[0128] where v i is the visual feature vector, and t j is the text feature vector;

[0129] Dynamic weight allocation: automatically adjust the contribution of the text / visual channel through a gating network;

[0130] IV. The artificial intelligence analysis unit adopts a real-time multilingual explanation system

[0131] 1. Hybrid machine translation architecture

[0132] Basic layer: Transformer Big model (6 encoder / 6 decoder layers)

[0133] Optimization strategy:

[0134] Quantization-Aware Training (QAT): Compress model weights to 8 bits;

[0135] Caching mechanism: Establish an LRU cache dictionary for high-frequency terms;

[0136] Text-to-Speech Synthesis: Adopt the FastSpeech2+HiFi-GAN architecture, with a generation latency of <200 ms;

[0137] 2. Adaptive Projection Optimization Algorithm

[0138] Brightness Adjustment Model Based on Reinforcement Learning:

[0139] State space: Ambient light intensity (obtained through a light sensor)

[0140] Action space: Projection brightness / contrast parameters

[0141] Reward function:

[0142] R = α·Comfort - β·Energy - γ·ChangePenalty;

[0143] Among them, Comfort: Based on the matching degree between the light and the projection brightness;

[0144] Energy consumption (Energy): A linear combination of projection brightness and contrast;

[0145] Change Penalty (ChangePenalty): Penalty when the action amplitude is too large;

[0146] Among them, the readability score is obtained through a pre-trained CNN evaluation model.

[0147] Based on the above content, the training scheme for the embodiments of the system is as follows:

[0148] Step 1. Data preparation:

[0149] Construct a multi-modal training dataset:

[0150] Text corpus: CLUE Chinese benchmark dataset (40 GB);

[0151] Visual data: ICDAR competition dataset (including 100,000 complex-layout images);

[0152] Cross-modal data: Extract image-text pairs from Wikipedia (5 million);

[0153] Step 2. Training details:

[0154] Two-stage training strategy:

[0155] The first stage: Pre-train on unimodal data respectively;

[0156] The second stage: Joint fine-tuning using cross-modal alignment loss;

[0157] Optimizer: LAMB optimizer, learning rate 3e-5, batch size 256;

[0158] After implementing the training plan of the system's embodiments, verify the technical effects of the system. The obtained conclusions on the verification of technical effects are as follows:

[0159] 1. Quantitative evaluation:

[0160] OCR accuracy: Achieve 96.2% character-level accuracy on the test set containing complex formulas;

[0161] Inference speed: Control the end-to-end processing delay within 120 ms (1080p input);

[0162] 2. User study:

[0163] Cervical fatigue index: Reduce by 62% compared to the traditional reading method (based on the NASA-TLX scale);

[0164] Content comprehension: The knowledge association function increases the long-term memory retention rate by 37%.

[0165] Embodiment 3

[0166] As Figures 1 to 3 shown, this embodiment provides an intelligent projection reading system. Different from Embodiment 1, in this embodiment, the integrated projection device 2 further includes a device main body 21, and the page content recognition module, the text processing module, and the optical projection module are all arranged on the device main body 21; the device main body 21 is located at the front end of the book placement area 5;

[0167] Among them, one end of the device main body 21 close to the book placement area 5 is provided with a notch 27, the top of the notch 27 is provided with an inclined opening 28, the page content recognition module is arranged on the inclined opening 28, and the projection light outlet of the optical projection module is arranged on the top of the device main body 21; the inclined opening 28 faces the book placement area 5;

[0168] The projection light outlet can adopt an inclined design to ensure that the projected picture can be projected onto the projection surface 4;

[0169] The page content recognition module includes an aspherical mirror 22, a lens group 23, and an image receiver 24;

[0170] The aspherical mirror 22 has a working concave surface facing the book, and the working concave surface also faces the lens group 23;

[0171] After the content of the book page is reflected by the working concave surface of the aspherical mirror 22, it is transmitted to the image receiver 24 through the lens group 23;

[0172] The output end of the image receiver 24 is docked with the input end of the optical projection module;

[0173] Specifically, the lens group 23 includes a plurality of transmissive lenses 25 arranged side by side, and the plurality of transmissive lenses 25 are arranged coaxially;

[0174] The image receiver 24 can be a CCD or a CMOS;

[0175] In this embodiment, the page content recognition module combines an aspherical mirror and a transmissive lens group, and adopts the method of receiving images obliquely. At the same time, the image receiver 24 can adopt image receivers such as CCD or CMOS, and uses high resolution and high frame rate to capture the details of the book-flipping process;

[0176] As Figure 3 shown, in this embodiment, since the inclined port 28 faces the book placement area 5, the method of receiving images obliquely can be adopted. Specifically, during the image acquisition process, the light transmission path is as Figure 3 shown by the arrow in, and is transmitted through the aspherical mirror 22 and then through the plurality of transmissive lenses 25 to the image receiver 24.

[0177] Embodiment 4

[0178] As Figures 4 to 5 shown, this embodiment provides an intelligent projection reading system. Different from Embodiment 1 and Embodiment 3, in this embodiment, the device main body 21 is located directly above the book placement area 5, and a connecting bracket 26 is further provided on the device main body 21. The connecting bracket 26 can be fixed to the support table 1 by bolt connection and / or welding connection;

[0179] And the page content recognition module is located at the lower end of the device main body 21, and the projection light outlet of the optical projection module is arranged at the top of the device main body 21; the projection light outlet can adopt an inclined design to ensure that the projected picture can be projected on the projection surface 4;

[0180] As Figure 5 shown, in this embodiment, with this setting, the method of receiving images vertically is adopted; specifically, during the image acquisition process, the light transmission path is as Figure 5 shown by the arrow in, and is transmitted through the aspherical mirror 22 and then through the plurality of transmissive lenses 25 to the image receiver 24.

[0181] Embodiment 5

[0182] As Figure 1As shown in the figure, this embodiment provides an intelligent projection reading system, which is different from that of Embodiment 1. In this embodiment, a chair 9 is further provided behind the support table 1 for the reader to lean on, facilitating the reader to directly read the projection content on the projection surface 4.

[0183] Embodiment 6

[0184] As Figures 6 to 9 shown in the figure, this embodiment provides an intelligent projection reading system, which is different from that of Embodiment 1. In this embodiment, the driving component includes a book pressing device 6, a page turning device 7 and a page sucking device 8, and there are two book pressing devices 6;

[0185] The two book pressing devices 6 are arranged oppositely along the transverse direction of the book placement area 5 and are respectively positioned at the left end and the right end of the book placement area 5;

[0186] The page turning device 7 is arranged at the rear end of the book placement area 5, and the page sucking device 8 is arranged on the side of the page turning device 7;

[0187] The integrated projection device 2 is arranged at the front end of the book placement area 5;

[0188] In this embodiment, the specific principle is as follows:

[0189] Function of the book pressing device 6: Place the book on the table. After turning to the page to be read, use the left and right book pressing devices 6 to press both sides of the book respectively to prevent the book from turning;

[0190] Function of the page sucking device 8: The page sucking device 8 is used to adsorb the pages and can drive the pages to move up and down;

[0191] Function of the page turning device 7: The page turning device 7 is used to turn the pages lifted by the page sucking device 8;

[0192] Among them, the page content recognition module on the intelligent projection reading system can recognize the page number symbol in the lower right corner of the book. This module also integrates a voice recognition module. When the user says the page number of the book they want to read, the page turning device 7 starts to perform the page turning action. The page content recognition module recognizes the page number. When it reaches the correct page number, the page turning device 7 stops the page turning action according to the instruction and presses the book tightly;

[0193] Specifically, the page turning process is as follows:

[0194] Step (1), Select the book pressing device 6 to be subjected to the page turning operation according to the reading progress;

[0195] In Step (1), assuming that the page number of the page on the left side of the opened book is smaller than that of the page on the right side of the opened book, the process of selecting the book pressing device 6 to be subjected to the page turning operation according to the reading progress is specifically as follows:

[0196] Case 1: If the reading progress is after the target page, the book pressing device 6 on the right side of the book needs to perform the page-turning operation in step (2), and the book pressing device 6 on the left side of the book keeps the book pressing operation unchanged;

[0197] Case 2: If the reading progress is before the target page, the book pressing device 6 on the left side of the book needs to perform the page-turning operation in step (2), and the book pressing device 6 on the right side of the book keeps the book pressing operation unchanged;

[0198] Step (2): The book automatically turns the page;

[0199] The process of step (2) is as follows:

[0200] Step (21): Control the selected book pressing device 6 in step (1) to perform a lifting motion away from the book;

[0201] Step (22): The page sucking device 8 moves downward to adsorb the page to be turned, and lifts it to a preset height;

[0202] Step (23): Drive the book turning device 7 close to the page to be turned, the page to be turned is separated from the page sucking device 8, and the book turning device 7 turns the page to be turned to complete the page turning action;

[0203] Step (24): The book pressing device 6 performs a downward pressing action to reset the pressing of the book and complete the page turning operation;

[0204] In addition, in this embodiment, the book pressing device 6 includes a mounting base 61, a book pressing driving mechanism 62 and a driving arm 63. There are two book pressing driving mechanisms 62, which are respectively arranged at the front end and the rear end of the mounting base 61. The driving arm 63 is arranged at the output end of the book pressing driving mechanism 62, and the book pressing driving mechanism 62 is used to drive the driving arm 63 to rotate;

[0205] The installation ends of the two book pressing driving mechanisms 62 are both installed on the mounting base 61. The book pressing driving mechanism 62 can adopt a driving motor, and the output end of the driving motor is connected to the driving arm 63 to realize the rotation of the driving arm 63;

[0206] The book turning device 7 includes a bottom carrier 71, a first lifting driving mechanism 72, a first telescopic mechanism 74, a turning mechanism (not shown in the figure) and a book turning member 73;

[0207] The first lifting driving mechanism 72 is arranged on the top of the bottom carrier 71;

[0208] The installation end of the turning mechanism is arranged at the output end of the first lifting driving mechanism 72, the output end of the turning mechanism is connected to the installation end of the first telescopic mechanism 74, and the output end of the first telescopic mechanism 74 is connected to the book turning member 73;

[0209] The lifting drive mechanism 72 is used to drive the lifting of the flipping mechanism, the flipping mechanism is used to drive the rotation of the first telescopic mechanism 74, and the first telescopic mechanism 74 is used to drive the movement of the page-turning member 73;

[0210] The bottom carrier 71 is used to support the first lifting drive mechanism 72, the first telescopic mechanism 74, the flipping mechanism, the page-turning member 73, etc. on its top. The first lifting drive mechanism 72 can adopt a lead screw mechanism, a cylinder or an electric push rod to realize the lifting of the flipping mechanism. The flipping mechanism can adopt a driving motor to realize the rotation of the first telescopic mechanism 74 installed at its output end. The first telescopic mechanism 74 can be selected as a cylinder or an electric push rod to realize the extension or retraction of the page-turning member 73;

[0211] During the actual page-turning process, after the page-turning member 73 is driven by the first telescopic mechanism 74 to extend and reaches the page to be turned, the rotation of the first telescopic mechanism 74 is realized through the flipping mechanism, and then the rotation of the page-turning member 73 is realized, so as to complete the page-turning action;

[0212] The page suction device 8 includes a bottom carrier 81, a second lifting drive mechanism 82, a second telescopic mechanism 83, a connecting arm 84 and a suction cup 85, and the suction cup 85 is used to adsorb the book page;

[0213] The second lifting drive mechanism 82 is arranged on the top of the bottom carrier 81. The installation end of the second telescopic mechanism 83 is arranged at the output end of the second lifting drive mechanism 82. The output end of the second telescopic mechanism 83 is connected to the upper end of the connecting arm 84, and the lower end of the connecting arm 84 is connected to the suction cup 85;

[0214] The second lifting drive mechanism 82 is used to drive the second telescopic mechanism 83 to lift, and the second telescopic mechanism 83 is used to drive the connecting arm 84 to move;

[0215] The working principle of the page suction device 8 is as follows:

[0216] The bottom carrier 81 is used to carry the second lifting drive mechanism 82;

[0217] The second lifting drive mechanism 82 can adopt a lead screw mechanism, a cylinder or an electric push rod. It is used to drive the second telescopic mechanism 83 to lift. The second telescopic mechanism 83 can adopt a cylinder or an electric push rod to drive the connecting arm 84 to move to the page to be turned, and the suction cup 85 is used to adsorb the book page;

[0218] After the suction cup 85 adsorbs the book page, the second telescopic mechanism 83 can be lifted by the second lifting drive mechanism 82, and then the connecting arm 84 can be lifted, so as to lift the height of the page adsorbed by the suction cup 85.

[0219] Embodiment 7

[0220] This embodiment provides an intelligent projection reading system. The difference from Embodiment 1 and Embodiment 6 is that in this embodiment, the driving arm 63 is a driving cylinder or an electric push rod, and a pressing head is provided at the output end of the driving arm 63 for pressing the book.

[0221] By adopting the adjustment form of a driving cylinder or an electric push rod, the extending length of the pressing head can be automatically adjusted to support applying pressure to various areas of the book. And based on the book pressing driving mechanism 62, this pressure can be adjusted, thereby avoiding deformation or indentation of the book. In addition, it can also meet the pressing requirements of different book specifications.

[0222] Embodiment 8

[0223] This embodiment provides an intelligent projection reading system. The difference from Embodiment 1 and Embodiment 6 is that in this embodiment, a book sucking driving mechanism is further provided inside the bottom bearing seat 81. The connecting end of the book sucking driving mechanism is connected to the installation end of the lifting driving mechanism II 82, and the book sucking driving mechanism is used to drive the lifting driving mechanism II 82 to rotate.

[0224] Embodiment 9

[0225] This embodiment provides a method for using an intelligent projection reading system, including the following steps:

[0226] S1. Place the book unfolded to the target page in the book placement area 5, and press both sides of the unfolded page of the book through the book pressing devices 6 symmetrically arranged at the left end and the right end of the book placement area 5.

[0227] S2. Obtain the book page content of the target page of the book through the page content recognition module, and transmit the book page content to the optical projection module. The optical projection module projects the book page content onto the projection surface 4 and displays it.

[0228] S3. Select the book pressing device 6 to be operated for page turning according to the reading progress.

[0229] S4. The book automatically turns the page.

[0230] The process of step S4 is as follows:

[0231] S41. Control the driving arm 63 of the book pressing device 6 selected in step S3 to perform a lifting movement.

[0232] S42. Adsorb the page to be turned through the suction cup 85 of the page sucking device 8, lift it to a preset height, then drive the page turning member 73 on the page turning device 7 close to the page to be turned, the suction cup 85 disengages from the page to be turned, and the page to be turned falls onto the page turning member 73.

[0233] In step S42, if the reading progress is after the target page, the page-turning member 73 on the page-turning device 7 is located at the right end of the page to be turned; if the reading progress is before the target page, the page-turning member 73 on the page-turning device 7 is located at the left end of the page to be turned.

[0234] S43. Drive the page-turning device 7 to complete the page-turning action.

[0235] S44. Control the driving arm 63 to perform a pressing-down action to reset and hold the book, thus completing the page-turning operation.

[0236] The present invention provides an intelligent projection reading system and its usage method, which uses an automatic page-turning device 3 to achieve automatic page-turning and fixation of a book; through an integrated projection device, an integrated design that combines page information collection, text processing, and projection display is realized; in this intelligent projection reading system, each module operates in coordination to enhance the actual reading experience.

[0237] In the description of this specification, the descriptions referring to terms such as "one embodiment", "example", "specific example", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0238] The above shows and describes the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and the descriptions in the specification only illustrate the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention will have various changes and improvements, and these changes and improvements all fall within the scope of the present invention claimed.

Claims

1. An intelligent projection reading system, characterized in that, Comprising: Support platform (1); An automatic book-turning device (3), which includes a book placement area (5) for supporting a book and a driving component for realizing book page turning; A projection surface (4), which is arranged in front of the integrated projection device (2); An integrated projection device (2), which is arranged on the top of the support platform (1). The integrated projection device (2) includes a page content recognition module, a text processing module, and an optical projection module. The page content recognition module is used to automatically recognize the content of the book page and transmit the book page content to the text processing module for correction processing. The optical projection module is used to receive the processed book page content from the text processing module, and the optical projection module is also used to project the processed book page content onto the projection surface (4) and display it.

2. The intelligent projection reading system according to claim 1, wherein, The integrated projection device (2) further includes a device main body (21), and both the page content recognition module and the optical projection module are arranged on the device main body (21); The page content recognition module includes an aspherical mirror (22), a lens group (23), and an image receiver (24); The aspherical mirror (22) has a working concave surface facing the book, and the working concave surface is also facing the lens group (23); After the book page content is reflected by the working concave surface of the aspherical mirror (22), it is transmitted to the image receiver (24) through the lens group (23); The output end of the image receiver (24) is docked with the input end of the text processing module.

3. An intelligent projection reading system according to claim 2, wherein, The lens group (23) includes a plurality of transmissive lenses (25) arranged side by side, and the plurality of transmissive lenses (25) are arranged on the same optical axis.

4. An intelligent projection reading system according to claim 2, characterized in that, The image receiver (24) is a CCD or a CMOS.

5. An intelligent projection reading system according to claim 1, characterized in that, The driving component includes a book pressing device (6), a book turning device (7), and a page sucking device (8). There are two book pressing devices (6); The two book pressing devices (6) are arranged opposite to each other in the transverse direction of the book placement area (5), and are respectively positioned at the left end and the right end of the book placement area (5); The book turning device (7) is arranged at the rear end of the book placement area (5), and the page sucking device (8) is arranged on the side of the book turning device (7); The integrated projection device (2) is arranged at the front end of the book placement area (5).

6. The intelligent projection reading system according to claim 5, wherein The book pressing device (6) includes a mounting seat (61), a book pressing driving mechanism (62), and a driving arm (63). There are two book pressing driving mechanisms (62), and the two book pressing driving mechanisms (62) are respectively arranged at the front end and the rear end of the mounting seat (61). The driving arm (63) is arranged at the output end of the book pressing driving mechanism (62), and the book pressing driving mechanism (62) is used to drive the driving arm (63) to rotate.

7. An intelligent projection reading system according to claim 5, characterized in that, The book turning device (7) includes a bottom carrier (71), a first lifting driving mechanism (72), a first telescopic mechanism (74), a turning mechanism, and a book turning member (73); The first lifting driving mechanism (72) is arranged on the top of the bottom carrier (71); The installation end of the flipping mechanism is arranged at the output end of the first lifting drive mechanism (72), the output end of the flipping mechanism is connected to the installation end of the first telescopic mechanism (74), and the output end of the first telescopic mechanism (74) is connected to the page-turning member (73). The first lifting drive mechanism (72) is used to drive the flipping mechanism to lift, the flipping mechanism is used to drive the first telescopic mechanism (74) to rotate, and the first telescopic mechanism (74) is used to drive the page-turning member (73) to move.

8. An intelligent projection reading system according to claim 5, characterized in that, The page suction device (8) includes a bottom bearing seat (81), a second lifting drive mechanism (82), a second telescopic mechanism (83), a connecting arm (84) and a suction cup (85). The second lifting drive mechanism (82) is arranged on the top of the bottom bearing seat (81), the installation end of the second telescopic mechanism (83) is arranged at the output end of the second lifting drive mechanism (82), the output end of the second telescopic mechanism (83) is connected to the upper end of the connecting arm (84), and the lower end of the connecting arm (84) is connected to the suction cup (85). The second lifting drive mechanism (82) is used to drive the second telescopic mechanism (83) to lift, and the second telescopic mechanism (83) is used to drive the connecting arm (84) to move. The suction cup (85) is used to adsorb the book pages.

9. An intelligent projection reading system according to claim 8, wherein, A book suction drive mechanism is further arranged in the bottom bearing seat (81), the connecting end of the book suction drive mechanism is connected to the installation end of the second lifting drive mechanism (82), and the book suction drive mechanism is used to drive the second lifting drive mechanism (82) to rotate.

10. A method for using the intelligent projection reading system according to any one of claims 1-9, characterized in that, It includes the following steps: S1. Place the book unfolded to the target page in the book placement area (5), and press both sides of the unfolded page of the book through the book pressing devices (6) symmetrically arranged at the left end and the right end of the book placement area (5). S2. Obtain the book page content of the target page of the book through the page content recognition module, and transmit the book page content to the text processing module for correction processing. The optical projection module is used to receive the processed book page content from the text processing module, and the optical projection module is also used to project the processed book page content onto the projection surface (4) and display it. S3. Select the book pressing device (6) to be subjected to the page-turning operation according to the reading progress. S4. The book automatically turns pages. The process of step S4 is as follows: S41. Control the driving arm (63) of the book pressing device (6) selected in step S3 to perform a lifting motion. S42. Adsorb the page to be turned by the suction cup (85) of the page suction device (8) and lift it to a preset height. S43. Drive the page-turning device 7 to complete the page-turning action. S44. Control the driving arm (63) to perform a downward pressing action to reset and press the book, and complete the page-turning operation.

Images