Learning method, system, computer device and storage medium for visually impaired people

Abstract

The application relates to the field of human-computer interaction, and discloses a visual impairment group learning method, a visual impairment group learning system, computer equipment and a storage medium, the method comprising the following steps: guiding a user to reach a predetermined position in front of an interaction area through voice broadcasting, and guiding the user to perform a specified action; wherein when the user is not totally blind, an interaction projection is provided in the interaction area; the specified action performed by the user is acquired, the operation instruction of the user is determined according to the specified action, and the corresponding interaction behavior is responded according to the operation instruction of the user. Therefore, the visual impairment group can perform interactive learning or answer examination questions through simple actions under the voice prompt or screen prompt, the learning convenience is improved, and the amount of physical activity is increased.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction, and more particularly to a learning method, system, computer device, and storage medium for visually impaired individuals. Background Technology

[0002] In the internet age, facing an overwhelming influx of information, blind people urgently need tools to understand and recognize digital information such as text and graphics. However, current computer interaction devices for the blind suffer from problems such as multi-level menus, unclear information display, and complex and expensive materials, and it is difficult to provide blind people with the same real-time feedback as sighted people. Even with tactile methods, such as using tactile graphical interfaces, only a single line of Braille can be displayed, and graphic images cannot be presented. To display multiple lines of Braille or tactile graphic images, a much larger tactile dot matrix is ​​needed, and the materials and space required are beyond the reach of most households. Summary of the Invention

[0003] Firstly, this application provides a learning method for visually impaired individuals, including:

[0004] The system guides the user to a predetermined location in front of the interactive area via voice prompts and instructs the user to perform a prescribed action; when the user is not completely blind, an interactive projection is provided in the interactive area.

[0005] The system acquires the specified action performed by the user, determines the user's operation instruction based on the executed specified action, and responds to the corresponding interactive behavior based on the user's operation instruction.

[0006] Furthermore, markers are provided at the predetermined location, and guiding the user to the predetermined location in front of the interactive area via voice announcement includes:

[0007] The system uses voice announcements to inform users of the type and location of the predetermined location, guiding them to the predetermined location in front of the interactive area.

[0008] Furthermore, the prescribed actions include a touch-and-tap interaction mode and a body posture sensing and recognition interaction mode, and the predetermined positions include a near point that is closer to the interaction area and a far point that is farther from the interaction area.

[0009] The process of guiding the user to perform the prescribed action includes:

[0010] When the user is at the near point, the user is guided to perform the touch-and-tap interaction mode action through voice broadcast. If the user arrives at the near point for the first time, the user is guided to perform the positioning action in the touch-and-tap interaction mode to locate the user's center position.

[0011] When the user is at the far point, the user is guided to perform actions in the body posture sensing and recognition interaction mode through voice broadcast.

[0012] Furthermore, the interactive projection includes an interactive interface and an information bar;

[0013] The information bar is located above the interactive interface and is used to display user information;

[0014] The interactive interface includes four interactive option areas, which are located at the upper left, upper right, lower left, and lower right positions of the user's center.

[0015] Furthermore, determining the user's operation instruction based on the executed predetermined action includes:

[0016] After obtaining the prescribed action performed by the user, the prescribed action is analyzed by tapping area or body sensor location recognition to obtain the corresponding operation instruction.

[0017] Furthermore, the interactive options in the interactive projection are displayed using bright color blocks, and the interactive options and the characters in the information bar are displayed in bold and enlarged fonts.

[0018] Furthermore, responding to corresponding interactive behaviors based on the user's operation instructions includes:

[0019] Based on the currently projected image content or voice prompts, determine the target of the operation instruction, and perform a corresponding program response based on the operation instruction and the target.

[0020] Secondly, this application provides a learning system for visually impaired people, including: a camera device, a projection device, a broadcasting device, and a computing terminal;

[0021] The projection device is used to project the interactive projection sent by the computing terminal onto the interactive area of ​​the projection screen;

[0022] The broadcasting device is used to guide the user to a predetermined position in front of the interactive area through voice broadcasting, and to guide the user to perform a prescribed action;

[0023] The camera device is used to acquire the prescribed actions performed by the user and upload the prescribed actions to the computer terminal;

[0024] The computing terminal is used to receive the prescribed actions uploaded by the camera device, determine the user's operation instructions based on the prescribed actions, and respond to the corresponding interactive behavior based on the operation instructions.

[0025] Thirdly, this application also provides a computer device, including a processor and a memory, wherein the memory stores a computer program, and the computer program executes the learning method for visually impaired people when it is run on the processor.

[0026] Fourthly, this application also provides a computer-readable storage medium storing a computer program that executes the learning method for visually impaired people when run on a processor.

[0027] This invention discloses a learning method for visually impaired individuals. The method includes: providing different system interaction prompts based on the user's vision, i.e., providing voice prompts and screen projection prompts for non-total blind users, and providing voice prompts for totally blind users; the system provides different interaction modes; the system guides the user to a predetermined location via voice announcements; the system prompts the user for different options or operation commands required for system interaction; the user selects an option or operation command and executes the corresponding interactive action. This allows visually impaired individuals to engage in interactive learning or answer questions through simple actions with voice or screen prompts, improving learning convenience and increasing physical activity. Attached Figure Description

[0028] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the embodiments will be briefly described below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope of protection of the present invention. In the various drawings, similar components are numbered similarly.

[0029] Figure 1 This invention illustrates a flowchart of a learning method for visually impaired individuals according to an embodiment of this application.

[0030] Figure 2 This illustration shows an interactive projection diagram according to an embodiment of the present application;

[0031] Figure 3 This illustration shows an interactive scenario diagram according to an embodiment of this application;

[0032] Figure 4 This illustration shows another interactive scenario according to an embodiment of the present application;

[0033] Figure 5 A schematic diagram of a learning system for visually impaired people according to an embodiment of this application is shown. Detailed Implementation

[0034] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0035] The components of the embodiments of the invention described and illustrated herein can typically be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0036] In the following, the terms “comprising,” “having,” and their cognates, which may be used in various embodiments of the invention, are intended only to indicate a particular feature, number, step, operation, element, component, or combination thereof, and should not be construed as excluding, firstly, the presence of one or more other features, numbers, steps, operations, elements, components, or combinations thereof, or adding the possibility of one or more features, numbers, steps, operations, elements, components, or combinations thereof.

[0037] Furthermore, the terms "first," "second," and "third" are used only to distinguish descriptions and should not be interpreted as indicating or implying relative importance.

[0038] Unless otherwise specified, all terms used herein (including technical and scientific terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of the invention pertain. Terms (such as those defined in commonly used dictionaries) shall be interpreted as having the same meaning as in their contextual meaning in the relevant technical field and shall not be interpreted as having an idealized or overly formal meaning, unless clearly defined in the various embodiments of the invention.

[0039] The technical solution of this application is applied to the interactive operation of visually impaired people when learning or answering questions. It provides different interactive prompts based on the user's vision: voice prompts and screen projection prompts for non-total blind users, and voice prompts for totally blind users. An operation interface is provided, guiding the user to a predetermined position in front of the interactive area via voice broadcast, and guiding the user to perform prescribed actions. The user's actions are captured and their behavior patterns are determined. When the user interacts, based on the user's body posture and movements captured by the camera or the behavior pattern, a corresponding operation command is determined. The computing terminal executes the corresponding interactive behavior according to the operation command and the program execution steps. This allows totally blind people or visually impaired people who can see blurry images to learn and interact using the above method.

[0040] The technical solution of this application will now be described with reference to specific embodiments.

[0041] Example 1

[0042] like Figure 1 As shown, the learning method for visually impaired individuals in this embodiment includes:

[0043] Step S100: Guide the user to the predetermined position in front of the interactive area through voice broadcast, and guide the user to perform the prescribed action.

[0044] The system uses voice prompts to provide guidance to the user. It can also project the interactive interface onto the screen area based on the user's vision. If the user is not completely blind, the interactive interface is projected onto the screen. In this embodiment, the learning method for visually impaired individuals uses a projection device to display the interactive interface of the learning system. This is because visually impaired individuals include not only the completely blind but also those with low vision, who can see blurry images. Therefore, in this embodiment, it is necessary to first confirm the user's vision. If the user is completely blind, projection is unnecessary; if not, projection can be performed, and the colors of the projected image can provide some guidance to non-completely blind users.

[0045] In this embodiment, the prescribed actions have two modes: one is the touch-and-tap interaction mode, and the other is the body posture sensing and recognition interaction mode. The use of these two modes is related to the predetermined position.

[0046] In one optional solution, the interactive environment can have both projection and non-projection areas. Users are guided to the corresponding interactive area based on their vision. No projection is performed in areas without projection. However, the interactive area for tapping the wall still needs to be configured so that the system can obtain the tapping position when the user uses the touch-to-tap interaction mode. In this embodiment, the user's interaction logic is similar regardless of whether projection is used; therefore, for ease of explanation, this embodiment will focus on the scenario with projection.

[0047] The interactive projection contains only simple and clear information. Specifically, it may only include an interactive interface and an information bar. The interactive interface occupies the largest area and can have up to four interactive objects. These four interactive objects are located in the upper left, upper right, lower left, and lower right positions of the center of the interactive interface and are displayed as large image blocks, so that visually impaired people can make simple distinctions by relying on colors.

[0048] The aforementioned interactive projection refers to the interactive interface displayed by the interactive system on the computer device. When projection is needed, the interactive interface will be projected; when projection is not needed, the interactive interface will not be projected.

[0049] The aforementioned learning system is a learning software developed for visually impaired people. It can provide users with learning functions such as doing exercises, reviewing, and attending classes. The specific learning functions are not the focus of this embodiment and are only described introductoryly here.

[0050] like Figure 2 The image shows a schematic diagram of the interactive projection structure. The upper part of the interactive projection is the information bar 100, and the lower part of the information bar 100 is the interactive interface 200. In this image, there are 4 interactive objects in the interactive interface 200. Users can achieve corresponding functions by interacting with the interactive objects.

[0051] The text in these interactive interfaces and information bars is bolded and enlarged so that visually impaired people can vaguely distinguish it. Different colors are used to represent different interactive objects, so that visually impaired people can also vaguely distinguish different interactive objects by color, which facilitates subsequent interactive operations.

[0052] The interactive area mentioned above needs to be a wall or a flat projection screen, as long as it can stably display the interactive projection.

[0053] The designated locations are near and far. When the user is near, the interaction mode will be a tapping / touching interaction mode with the system. When the user is far, the interaction mode will be a body posture sensing and recognition interaction mode with the system.

[0054] like Figure 3 The image shown is a schematic diagram illustrating a user interaction scenario in this embodiment. (Summary) Figure 3 The scenario is indoors. A 300-pixel projector projects its screen onto an interactive area, which can then... Figure 3 The image shows a wall. The camera device 400 is used to film the indoor scene, especially to capture user movements. There are markers on the ground corresponding to preset positions.

[0055] In this embodiment, the user is guided to a predetermined position near the interactive area by voice prompts. This predetermined position is used to determine the center position where the user's outstretched arm touches the wall, so as to ensure the effectiveness of the system interaction for users of different heights.

[0056] This embodiment uses two predetermined positions for illustration. The predetermined positions include a near point 600, which is closer to the interactive area, and a far point 500, which is farther from the interactive area. The distance between the near point 600 and the interactive area should allow the user to reach out and touch the wall, while the far point 500 should be further away. For example, if the near point 600 is 0.5 to 1 meter away from the interactive area, then the far point 500 can be between 1 and 1.5 meters away from the wall.

[0057] In this embodiment, the type and location of the predetermined location, as well as the markers set at the predetermined location, can be announced via voice broadcast to guide the user to the predetermined location. For example, it can be announced that the near point 600 is a tactile paving marked with the letter A, and the far point 500 is a tactile paving marked with the letter B, so that the user can identify which location they have arrived at.

[0058] For totally blind users, they are usually accompanied by a sighted person. The accompanying person can then guide them on how to reach the designated points. In this embodiment, the voice prompts only describe the location and shape of the designated points to help the user understand their position.

[0059] The camera device 400 is positioned to capture a full view of the room for filming purposes. It can be used to recognize the user's body movements and, to some extent, determine the user's location.

[0060] The aforementioned predetermined location can also be located by setting up special objects so that users know they have arrived at the location when they walk to the preset location. For example, special-shaped tactile paving can be used for guidance, or small steps can be set up as objects that blind people can feel while walking, but which cannot hinder normal walking. This embodiment does not make any special limitations here.

[0061] In this embodiment, by recognizing the user's actions, the interaction between the user and the interactive projection is determined. As can be seen from the above description of the interactive projection, the content in this embodiment is simple, there are no multi-level menus, and the number of interactive objects for the user is limited. Figure 2 Taking the screen as an example, users only need to reach out and interact with the corresponding options. However, since different users may have different heights, it is necessary to determine the user's center position (corresponding to the user's chest height and position on the wall) in order to ensure that users can correctly touch these options, so as to better carry out subsequent interaction tasks.

[0062] The prescribed actions include positioning actions and interactive actions: the positioning actions are special interactive actions used to determine the user's center when the user first uses the system, while the interactive actions refer to the actions used by the user when using the system's question-answering interactive function.

[0063] For example, when a user arrives at the designated location, they are first asked to tap the wall to the corresponding interactive area located in front of their chest. The positioning device uses this tap to determine the center of the user's body for users of different heights. Figure 4As shown, the four interactive objects in the interactive area will generate four regions, A, B, C, and D, centered on the user's tapping point. These four regions are located in the user's upper left, upper right, lower left, and lower right directions. The user needs to perform a corresponding interactive action to determine the user's interaction with these regions, ensuring a consistent correspondence during subsequent interactions. This positioning action allows for adjustments to the projected image's position, ensuring that regions A, B, C, and D are in the user's upper left, upper right, lower left, and lower right directions. Because the users are visually impaired or completely blind, this positioning method ensures a fixed relative position between the generated projected image and the user. This allows users to interact with the correct interactive objects even when they cannot see, avoiding positional errors caused by misjudging the user's location during interaction.

[0064] It's understandable that for totally blind users, although there is no projection, there is always voice information to prompt the user, and by determining the user's center position, the position when the user selects the four options A, B, C, and D can be determined. Therefore, it is mainly used to determine the position of the option. As long as the option represented by the user's action can be determined, it is not necessary to generate the corresponding image.

[0065] The aforementioned interactive methods include a touch-and-tap interaction mode and a body posture sensing and recognition interaction mode.

[0066] Among them, the touch-and-tap interaction mode allows users to tap any point on the wall according to their own choices or operational intentions. The system then learns the user's choices or operational intentions based on the area corresponding to the tapping point and performs the corresponding system selection or operation.

[0067] Among them, the limb posture sensing and recognition interaction mode allows users to choose to extend their upper limbs in different directions based on their own selection or operational intentions, including four options: left hand diagonally upward, left hand diagonally downward, right hand diagonally upward, and left hand diagonally downward, corresponding to […]. Figure 4 The interaction is divided into four areas: A, B, C, and D. For example, moving your left hand diagonally upwards interacts with area A. Theoretically, there are only these four interaction actions. The learning system will identify the user's body movements captured by the camera and determine the corresponding options or operation intentions. It will then perform the appropriate system selection or operation.

[0068] Users need to select their preferred interaction action in advance within the system. Depending on the action, they will stand at different predetermined positions and perform different actions. Specifically, when the user is at the near point (600), the interaction method is tapping the designated area; for example, tapping the wall diagonally upwards with the left hand interacts with area A, and tapping the wall diagonally upwards with the right hand interacts with area B. When the user is at the far point (500), the interaction method is based on the user's body posture recognition, with four gestures—left hand diagonally upwards, left hand diagonally downwards, right hand diagonally upwards, and left hand diagonally downwards—representing interactions with areas A, B, C, and D, respectively.

[0069] In one alternative approach, if multiple user-preset standing positions exist, when a user first enters the room and uses the interactive system, there can be a default operation method, such as tapping the wall interaction area. The system can then guide the user to a corresponding default preset position, for example, the near point 600. Then, the system will prompt the user to select an interaction control method. At this point, the user can choose whether to perform the interaction operation at a far point or a near point. If the user wants to use the motion-sensing interaction method at a far point, the system will move back to the corresponding far point according to the voice prompt, and then perform the above-mentioned operation of executing the prescribed body posture sensing interaction action.

[0070] In addition, when a user arrives at the preset location, facial information will be captured by the camera, and the user will be automatically logged in to obtain the user's historical learning information. For visually impaired people, it is very troublesome to ask them to enter passwords and other operations. Therefore, in this embodiment, facial recognition can be used for automatic login to make the login process as seamless as possible. At the same time, when the login fails, the default login will be as a guest to reduce operations that affect the user experience.

[0071] During login, guidance can also be provided via voice prompts, such as "Please turn left" or "Please look up," to facilitate capturing the user's face and then confirming successful login. This allows the learning system to access the user's data after login, enabling it to provide tailored learning plans and actions based on the user's progress, thus offering better learning services.

[0072] Step S200: Obtain the user's execution action, determine the user's operation instruction based on the execution action, and respond to the corresponding interactive behavior based on the operation instruction.

[0073] After completing the first two steps, the user will have the basic conditions for interaction. The user only needs to perform the corresponding interactive actions according to the voice prompts to interact.

[0074] For example, when answering questions, the voice will announce the questions and options, and the user can choose the appropriate answer based on their judgment. Figure 4As shown, the four areas A, B, C, and D represent the four options A, B, C, and D of the question, respectively. When a user wants to select A, the user only needs to perform the action of patting the wall diagonally upwards with the left hand to indicate that they have selected A.

[0075] The system recognizes the user's operation or selection intention, determines the object of the operation instruction on the projected image based on the currently projected image content and the user's selected operation instruction, and executes the operation instruction on the object to respond to the operation. For example, in a motion-sensing interaction method, when a user stands at a distance and performs an interactive action, the camera captures the corresponding limb posture image. The coordinates of various key points of the human limb are then obtained from the image; these key points can be positions such as the shoulder, elbow, and wrist. Based on these coordinates, the position and angle of the arm can be determined. Furthermore, based on the constraint of four angle intervals, it can be determined that the user's arm is currently positioned... Figure 4 Which of the four regions A, B, C, and D is selected? This determines the user's choice.

[0076] Furthermore, in the tapping interaction mode, the user's tapping action area is determined using LiDAR positioning. This directly identifies the option or operation intention corresponding to the user's action within the interaction area, allowing the system to execute the corresponding action. For example, in the tapping operation, if a user stands nearby, listens to the question, and decides to choose answer A, they extend their left hand and tap the upper left interaction area in front of them. Once this tapping action is captured by LiDAR, the location of the user's action within the interaction area can be determined, uniquely corresponding to one of the four options within the area. Based on this defined action, the operation instruction can be determined, indicating that the user has selected answer A.

[0077] Once the system receives the request, it selects option A and then executes subsequent procedures. For example, after the selection is complete, the system records the answer and moves on to the next question, or it informs the user via voice whether the selection is correct, thus completing the response and achieving a complete interactive operation.

[0078] In addition to answering questions, the system provides voice guidance on all operation interfaces. For example, at the beginning of the system, the system will prompt the user to select several options for the current program node through voice prompts, such as A is to answer questions, B is the collection of wrong questions, C is the study plan, and D is the next page.

[0079] In one alternative technical solution, the learning system can initially acquire user actions via radar without using a camera. The user can then switch the recognition method to the system, which can then determine the appropriate action based on the user's actions.

[0080] This embodiment of the learning method for visually impaired individuals guides user behavior through voice prompts, enabling users to interact with the system through simple actions. Simultaneously, for non-total blind users, the system's projected interface offers concise options; the limited choices and simple interactions minimize the burden on visually impaired users. Furthermore, the projection method also caters to those with some visual impairment, allowing them to understand the current interface information through projected color blocks and enlarged fonts. This makes the system adaptable to visually impaired individuals in different situations. The visually appealing interface also allows teachers or administrators with normal vision to better understand the learning outcomes of visually impaired users.

[0081] Example 2

[0082] like Figure 5 As shown, this application also provides a learning system for visually impaired people, including: a projection device 300, a camera device 400, a broadcasting device 700, and a computing terminal 800;

[0083] The projection device 300 is used to project the interactive projection sent by the computing terminal onto the interactive area of ​​the projection screen;

[0084] The broadcasting device 700 is used to guide the user to a predetermined position in front of the interactive area through voice broadcasting, and to guide the user to perform a prescribed action;

[0085] The camera device 400 is used to acquire the prescribed actions performed by the user and upload the prescribed actions to the computer terminal 800;

[0086] The computing terminal 800 is used to receive the prescribed actions uploaded by the camera device 400, determine the user's operation instructions based on the prescribed actions, and respond to the corresponding interactive behavior based on the operation instructions.

[0087] The aforementioned projection device 300 can be a projector, and the camera device 400 can be a camera or other instrument capable of capturing user movements. This camera device is generally positioned 1.5 meters above the ground, as long as it can capture images of people. The broadcasting device 700 can be a computer-controlled speaker, placed in any corner of the room. The computer terminal 800 is the terminal device that actually carries the learning system and controls the projection device 300, camera device 400, and broadcasting device 700 to interact with the user. It can be a server or a computer; the specific device is selected based on the actual situation.

[0088] The functional flow of this learning system for visually impaired people is similar to that of the aforementioned learning methods for visually impaired people, and will not be described in detail here.

[0089] This application also provides a computer device, including a processor and a memory, wherein the memory stores a computer program that, when executed on the processor, performs the aforementioned learning method for visually impaired individuals.

[0090] This application also provides a computer-readable storage medium storing a computer program that, when run on a processor, executes the aforementioned learning method for visually impaired individuals.

[0091] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative; for example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that, as an alternative implementation, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0092] In addition, the functional modules or units in the various embodiments of the present invention can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0093] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a smartphone, personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0094] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for learning by visually impaired people, characterized in that, include: The system guides users to a predetermined location in front of the interactive area via voice prompts and instructs them to perform the prescribed actions. When the user is not completely blind, an interactive projection is provided in the interactive area; The system acquires the specified action performed by the user, determines the user's operation instruction based on the executed specified action, and responds to the corresponding interactive behavior based on the user's operation instruction. The prescribed actions include a touch-and-tap interaction mode and a body posture sensing and recognition interaction mode. The predetermined positions include a near point that is closer to the interaction area and a far point that is farther from the interaction area. The process of guiding the user to perform the prescribed action includes: When the user is at the near point, the user is guided to perform the touch-and-tap interaction mode action through voice broadcast. If the user arrives at the near point for the first time, the user is guided to perform the positioning action in the touch-and-tap interaction mode to locate the user's center position. The position of the interactive projection is adjusted according to the center position. When the user is at the far point, the user is guided to perform actions in the body posture sensing and recognition interaction mode through voice broadcast.

2. The method of claim 1, wherein, The predetermined location is marked with a marker, and the step of guiding the user to the predetermined location in front of the interactive area via voice announcement includes: The system uses voice announcements to inform users of the type and location of the predetermined location, guiding them to the predetermined location in front of the interactive area.

3. The method of claim 2, wherein, The interactive projection includes an interactive interface and an information bar; The information bar is located above the interactive interface and is used to display user information; The interactive interface includes four interactive option areas, which are located at the upper left, upper right, lower left, and lower right positions of the user's center.

4. The learning method for visually impaired people according to claim 2, characterized in that, Determining the user's operation instruction based on the executed predetermined action includes: After obtaining the prescribed action performed by the user, the prescribed action is analyzed by tapping area or body sensor location recognition to obtain the corresponding operation instruction.

5. The learning method for visually impaired individuals according to claim 3, characterized in that, The interactive options in the interactive projection are displayed using bright color blocks, and the interactive options and the characters in the information bar are displayed in bold and enlarged fonts.

6. The learning method for visually impaired individuals according to claim 1, characterized in that, The step of responding to corresponding interactive behaviors based on the user's operation instructions includes: Based on the currently projected image content or voice prompts, determine the target of the operation instruction, and perform a corresponding program response based on the operation instruction and the target.

7. A learning system for visually impaired people, characterized in that, include: Cameras, projection equipment, broadcasting equipment, and computing terminals; The projection device is used to project the interactive projection sent by the computing terminal onto the interactive area of ​​the projection screen; The broadcasting device is used to guide the user to a predetermined position in front of the interactive area through voice broadcasting, and to guide the user to perform a prescribed action; The camera device is used to acquire the prescribed actions performed by the user and upload the prescribed actions to the computing terminal; The computing terminal is used to receive the prescribed actions uploaded by the camera device, determine the user's operation instructions based on the prescribed actions, and respond to the corresponding interactive behavior based on the operation instructions; The prescribed actions include a touch-and-tap interaction mode and a body posture sensing and recognition interaction mode. The predetermined positions include a near point that is closer to the interaction area and a far point that is farther from the interaction area. The process of guiding the user to perform the prescribed action includes: When the user is at the near point, the user is guided to perform the touch-and-tap interaction mode action through voice broadcast. If the user arrives at the near point for the first time, the user is guided to perform the positioning action in the touch-and-tap interaction mode to locate the user's center position. The position of the interactive projection is adjusted according to the center position. When the user is at the far point, the user is guided to perform actions in the body posture sensing and recognition interaction mode through voice broadcast.

8. A computer device, characterized in that, It includes a processor and a memory, the memory storing a computer program that, when run on the processor, executes the learning method for visually impaired people as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, It stores a computer program that, when run on a processor, executes the learning method for visually impaired people as described in any one of claims 1 to 6.

Images