Job tutoring method, device, system and equipment based on projection interaction

Abstract

The invention relates to the technical field of intelligent equipment, and provides a job tutoring method, device, system and equipment based on projection interaction, and the method comprises the steps: obtaining an image in a selected region; the image contains job content; homework content on the image is identified, and complete homework question content is determined; analyzing the homework question content, and determining question solving process data; determining problem solving demonstration data based on the problem solving process data; the problem solving demonstration data comprises picture data and voice data; according to the method, the complete homework content is determined by identifying the homework content on the selected image, then the homework content is analyzed, the problem solving process data is determined, and after the problem solving demonstration data capable of being displayed in an audio-video mode is determined based on the problem solving process data, the problem solving demonstration data can be displayed in an audio-video mode. Projection processing is carried out on problem solving demonstration data, and the projection explanation tutoring effect is closer to a real tutoring mode.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent devices, and in particular to a homework tutoring method, device, system and equipment based on projection interaction. Background Art

[0002] Existing homework grading apps all use mobile phones and tablets as hardware media, shoot through the camera, and display the homework photos and the corrected content on the screen.

[0003] This way of grading homework will also focus students' attention on electronic devices, making them more interested in electronic devices and not paying attention to the grading content, thus failing to achieve good tutoring results. Summary of the invention

[0004] In view of the problems existing in the prior art, the present invention provides a homework tutoring method, device, system and equipment based on projection interaction.

[0005] The present invention provides a homework tutoring method based on projection interaction, comprising: Acquire an image in the selected area; the image contains the work content; Recognize the homework content on the image to determine the complete homework content; Analyze the content of the homework question and determine the problem-solving process data; Determine problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The problem-solving demonstration data is projected.

[0006] According to a homework tutoring method based on projection interaction provided by the present invention, the step of determining the problem-solving demonstration data based on the problem-solving process data comprises: Based on the problem-solving process data, the adopted content is determined from the homework content, and first screen data with a marking function is configured for the adopted content, and new content is determined, and converted into second screen data with a tutoring function based on the new content; Based on the problem-solving process data, converting into voice data for playing the problem-solving process; Based on the first screen data, the second screen data and the voice data, problem-solving demonstration data having a time sequence is determined.

[0007] According to a homework tutoring method based on projection interaction provided by the present invention, before projecting the problem-solving demonstration data, the method further includes: Determine a first projection area of ​​the first screen data based on position information of the adopted content in the selected area; Determining a second projection area of ​​the second picture data based on a picture area occupied by the second picture data and a free area divided from the selected area; Correspondingly, the problem-solving demonstration data is projected in the first projection area and the second projection area.

[0008] According to a homework tutoring method based on projection interaction provided by the present invention, the projection processing of the problem-solving demonstration data includes: Determining a voice segment to be played in the voice data; When it is determined that the voice segment has corresponding adopted content and first picture data, while playing the voice segment, projecting the first picture data in the first projection area; When it is determined that the voice segment has corresponding second picture data, the second picture data is projected into the second projection area while the voice segment is played.

[0009] According to a projection interaction-based homework tutoring method provided by the present invention, before analyzing the homework content and determining the problem-solving process data, the method further includes: When it is determined that the homework question content contains the answer content, and when it is determined that the answer content is different from the standard answer content, the homework question content is further analyzed to determine the problem-solving process data; When it is determined that the homework question content contains the answer content, and when it is determined that the answer content is the same as the standard answer content, a prompt information is generated and the prompt information is projected onto the selection area content; the prompt information represents whether to confirm the selection trigger interface of the problem-solving process data.

[0010] According to a homework tutoring method based on projection interaction provided by the present invention, the method also includes: when it is determined that the answer content is different from or the same as the standard answer content, generating third screen data for judging whether the answer is right or wrong, and projecting the third screen data into the answer area in the homework content.

[0011] According to a homework tutoring method based on projection interaction provided by the present invention, the step of acquiring an image in a selected area includes: Sensing an image capture trigger operation on the projection auxiliary control interface, analyzing the test paper screen collected from the photographic area, generating a selection box, and projecting the selection box into the photographic area to obtain an image in the selection area where the selection box is located; Accordingly, the method further comprises: The selection operation of the selection box in the photographic area is sensed, and the problem-solving process data of the homework content on the image in the selection area where the selection box is located is obtained; and the problem-solving process data is projected in the projection area on the projection auxiliary operation interface.

[0012] The present invention also provides a homework tutoring device based on projection interaction, comprising: An acquisition module is used to acquire an image in a selected area; the image contains the operation content; A recognition module, used to recognize the homework content on the image and determine the complete homework content; An analysis module, used to analyze the content of the homework question and determine the problem-solving process data; A generating module, used for determining problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The projection module is used to project the problem-solving demonstration data.

[0013] The present invention also provides a homework tutoring system based on projection interaction, comprising: A camera device is used to obtain an image in a selected area, wherein the image contains homework content, and recognize the homework content on the image to determine the complete homework content; A processor, configured to analyze the content of the homework question, determine the problem-solving process data, and determine the problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The projection component is used to project the problem-solving demonstration data.

[0014] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any one of the above-mentioned homework tutoring methods based on projection interaction is implemented.

[0015] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the computer program implements any of the above-mentioned homework tutoring methods based on projection interaction.

[0016] The present invention also provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned homework tutoring methods based on projection interaction.

[0017] The present invention provides a homework tutoring method, device, system and equipment based on projection interaction, which identifies the homework content on the selected image to determine the complete homework content, then analyzes the homework content to determine the problem-solving process data, and after determining the problem-solving demonstration data that can be displayed in audio and video based on the problem-solving process data, the problem-solving demonstration data is projected to achieve a projection explanation tutoring effect that is closer to the real tutoring method. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 It is a flowchart of the homework tutoring method based on projection interaction provided by the present invention.

[0020] Figure 2 The invention provides a homework guidance display based on projection interaction. Figure 1 .

[0021] Figure 3 The invention provides a homework guidance display based on projection interaction. Figure 2 .

[0022] Figure 4 The invention provides a homework guidance display based on projection interaction. Figure 3 .

[0023] Figure 5 It is a structural schematic diagram of the homework tutoring device based on projection interaction provided by the present invention.

[0024] Figure 6 It is a structural schematic diagram of the homework tutoring system based on projection interaction provided by the present invention.

[0025] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Combine the following Figure 1-Figure 7 The invention describes the homework tutoring method, device, system, equipment and medium based on projection interaction.

[0028] Figure 1 A flowchart of a homework tutoring method based on projection interaction provided by the present invention is shown in FIG. Figure 1 , the method comprises the following steps: Step 11, obtaining an image in the selected area; the image contains the work content; Step 12: Identify the homework content on the image and determine the complete homework content; Step 13: Analyze the content of the homework and determine the data of the problem-solving process; Step 14: determining problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; Step 15: Project the problem-solving demonstration data.

[0029] Regarding the above steps 11 to 15, it should be noted that the homework tutoring method based on projection interaction is applicable to a projection product for tutoring students' homework. The projection product can take pictures and project, the picture is for obtaining the image information of the homework, and the projection is for projecting the content of tutoring students' homework. The projection product also has a processor capable of analyzing data to analyze the projection data of tutoring students' homework.

[0030] In the present invention, an image in a selected area is obtained. The image contains the operation content. Since the camera viewing angle range is large, obtaining an image is actually to identify one or more selected areas in the camera screen, and then intercept the image content in the selected area to perform content analysis to obtain the operation content.

[0031] For example, if a test paper is placed on the camera area of ​​a projection product, and a student uses an electronic product (such as a trigger smart pen) to draw a box area on the test paper, the projection product can capture the image in the box area. The area will contain the test questions, which will be the content of the homework.

[0032] For example, placing the test paper in the camera area of ​​the projection product will trigger the projection product to shoot the entire test paper. The projector will automatically analyze the image to find the area where the test questions are located and project a box on the test paper, which will exactly frame the test questions on the test paper.

[0033] From this, we can see that the selection of homework content on the test paper can be done by automatic photography and recognition, or the product can recognize it after the user selects it.

[0034] In the present invention, when a student uses an electronic product (such as a trigger smart pen) to outline an area on the test paper on the table, due to improper operation, the selected area may not contain a complete homework question, or may contain a complete homework question and half of the homework question. Therefore, the homework content on the image in the selected area must be identified to determine whether there is a complete homework question content. Only the complete homework question content can be processed to achieve the purpose of auxiliary learning.

[0035] If the homework content on the image does not contain the complete homework content, a prompt message will be projected to remind the student to reselect the image. For the recognition of homework content, it can be matched with the homework test paper stored in the database. If the match is successful, it means that the complete homework content exists. If the match is not successful, it means that the content is missing.

[0036] Furthermore, when the homework content on the image is identified and it is determined that the complete homework content cannot be obtained, the expansion direction of the extended selection area is determined based on the missing part of the homework content, and then the selection area is expanded according to the expansion strategy (for example, expanding the preset width based on the expansion direction). After the expansion, the image is captured again based on the expanded selection area, and then the homework content on the image is identified again until the complete homework content is identified.

[0037] In the present invention, because a test question needs to obtain the answer to strive for, it has a corresponding problem-solving process, which can provide students with problem-solving ideas. Therefore, after identifying a complete homework question content, the homework question content is analyzed to determine the problem-solving process data. In the case where the database stores the corresponding homework test paper file, the problem-solving process data of each homework question on the homework test paper can also be stored in the database. At this time, only the complete homework question needs to be matched, and the corresponding problem-solving process data can be screened in the database. In the case where the database does not store the corresponding homework test paper file, the homework question content can be analyzed for problem-solving based on the basic knowledge required for problem-solving to generate problem-solving process data. This analysis process belongs to the intelligent problem-solving process.

[0038] In the present invention, the problem-solving process needs to be projected onto the test paper to play a role in tutoring students. A problem-solving process that inspires problem-solving ideas should be combined with the content of the homework questions to show the problem-solving process step by step. Projection on the test paper, due to the fixed display of the content of the homework questions on the test paper, the information projected on the test paper is displayed in the form of a picture, such as the projected problem-solving formula as a picture, projected on the test paper, such as the analysis of the keywords in the content of the homework questions, can be marked under the keywords with a horizontal line picture. In addition, from the perspective of tutoring, if the problem-solving process is restored by sound, it can make students understand the problem-solving process more intuitively, so the problem-solving demonstration data includes picture data and voice data. But if the problem-solving process is not restored by sound, it is also possible to directly project the problem-solving process in the form of a picture on the test paper, which requires students' understanding of the problem-solving process.

[0039] In the present invention, after determining the problem-solving demonstration data based on the problem-solving process data, the picture data and voice data are projected onto the test paper in sequence according to the problem-solving process. When students cannot fully understand the problem-solving process, they can repeatedly project the problem-solving demonstration data. At this time, students need to hold an electronic device (such as a smart trigger pen) to operate so that the product can recognize the trigger signal for repeated projection, or they can repeat the projection by voice control. When students need to understand and digest the ideas of a certain part of the problem-solving process, they need to hold an electronic device to operate so that the product can recognize the trigger signal for pausing the projection, or they can pause the projection by voice control.

[0040] The projection-interaction-based homework tutoring method provided by the present invention identifies the homework content on the selected image to determine the complete homework content, then analyzes the homework content to determine the problem-solving process data, and after determining the problem-solving demonstration data that can be displayed by audio and video based on the problem-solving process data, the problem-solving demonstration data is projected to achieve a projection explanation tutoring effect that is closer to the real tutoring method.

[0041] In a further method of the above method, the processing process of determining the problem-solving demonstration data based on the problem-solving process data is mainly explained, as follows: Based on the problem-solving process data, the adopted content is determined from the homework content, and the first screen data with a marking function is configured for the adopted content. The new content is determined and converted into the second screen data with a tutoring function based on the new content.

[0042] Based on the problem-solving process data, it is converted into voice data for playing the problem-solving process.

[0043] Based on the first screen data, the second screen data and the voice data, problem-solving demonstration data having a time sequence is determined.

[0044] In this regard, it should be noted that in the present invention, Figure 2 As shown, in the real human problem-solving process, based on the sequential nature of the problem-solving ideas, people will use pens to draw on the test paper to distinguish the important knowledge points in the homework questions. To this end, based on the problem-solving process data, the adopted content is determined from the homework question content, and the adopted content is used as the important key content analyzed in the homework question. If there is "AB=CD" in the homework question, at this time, "AB=CD" is identified as the adopted content. From the perspective of explanation and guidance, during the projection process, a "horizontal line" can be projected at the position below "AB=CD". Here, the projected "horizontal line" is a picture form, and its function is to mark a key content. Therefore, the present invention configures picture data with a marking function for the adopted content. If the homework question is a multiple-choice question, after the problem-solving process, the correctness and errors of several options must be marked. Here, several options can also be adopted content, and the marked correct and wrong numbers are the picture data of the option content, as the first picture data.

[0045] In the present invention, the entire problem-solving process may contain content that does not exist on the test paper, which is considered as new content. For example, a calculation formula, such as a conclusion is derived from several adopted contents, such as arrows and braces between the conclusion and the adopted contents. These new contents have a coaching role and can encompass the problem-solving ideas. In this regard, the new contents are converted into screen data with a coaching role as the second screen data.

[0046] In the present invention, in order to express the problem-solving process with sound, the problem-solving process data is converted into voice data for playing the problem-solving process.

[0047] Finally, based on the first screen data, the second screen data and the voice data, the problem-solving demonstration data with a time sequence is determined. It should be noted that the problem-solving process is a step-by-step process, so the time points for displaying different display contents are also different.

[0048] Furthermore, the voice data and the picture data correspond to each other and are displayed synchronously. The voice data expresses a problem-solving process, so the voice data contains multiple voice segments. However, each voice segment may not necessarily have corresponding picture data, because some problem-solving ideas only need voice expression. In this case, there is no need to project the picture, and only the voice content needs to be played.

[0049] After determining the voice segment to be played in the voice data, it is necessary to determine whether the voice segment to be played matches the picture data. When it is determined that the voice segment has corresponding adopted content and first picture data, the first picture data is projected into the corresponding projection area while playing the voice segment.

[0050] When it is determined that the voice segment has corresponding second picture data, the second picture data is projected in the corresponding projection area while the voice segment is played.

[0051] In the present invention, the test questions on the test paper are closely arranged, and sometimes the problem-solving process is cumbersome. Therefore, it is necessary to reasonably plan the projection area so that the information projected onto the test paper is as orderly as possible and can achieve a good tutoring effect.

[0052] To this end, for the adopted content, the first projection area of ​​the first screen data can be determined based on the position information of the adopted content in the selection area. In other words, the projection area is configured in the surrounding area of ​​the position area of ​​the adopted content. For example, if a "horizontal line" is set below the adopted content, then the position below the adopted content is the projection area of ​​the horizontal line.

[0053] For the newly added content, the second projection area of ​​the second screen data is determined based on the screen area occupied by the second screen data and the free area divided from the selected area. In other words, there is a blank area in the selected area, and the blank area here can be used as a free area. If the second screen data is large, then the projection area should be reasonably divided on the free area based on the screen area of ​​the second screen data.

[0054] Accordingly, the problem-solving demonstration data is projected in the first projection area and the second projection area.

[0055] By reasonably dividing the projection area, the display of the problem-solving process can be made more reasonable, which is conducive to students' understanding of problem-solving ideas and achieves a good tutoring effect.

[0056] Below Figure 2 The adopted content (AB=CD, test question attached figure), the first screen data (red horizontal line, red frame line), and the second screen data (arrow, problem-solving formula) are displayed.

[0057] In a further method of the above method, sometimes a student gives a correct answer to a question on the test paper, which can indicate that the student is already familiar with the solution ideas of such questions, and there is no need to show the solution process at this time. Therefore, when it is determined that the homework question content contains the answer content, when it is determined that the answer content is different from the standard answer content, the homework question content is analyzed again to determine the solution process data. Accordingly, when it is determined that the answer content is different from the standard answer content, the third screen data for judging that the answer is wrong is generated.

[0058] Sometimes, although there is a correct answer, it may be a guess or an answer determined by elimination. At this time, it is also necessary to understand the problem-solving process. For this reason, when it is determined that the homework question contains the answer content, when it is determined that the answer content is the same as the standard answer content, a prompt information is generated and the prompt information is projected on the selection area content; the prompt information represents whether to determine the selection trigger interface of the problem-solving process data. At this time, based on the selection trigger interface, the trigger operation of projecting the problem-solving process is selected, and then the homework question content is analyzed to determine the problem-solving process data. Accordingly, when it is determined that the answer content is the same as the standard answer content, a third screen data for judging that the answer is wrong is generated.

[0059] In a further method of the above method, it is determined that the selected area is an image of a whole page of the test paper, then multiple homework questions are determined, and when the multiple homework questions contain answer content, it is necessary to execute the processing of "generating prompt information when it is determined that the answer content is the same as the standard answer content" one by one in sequence.

[0060] In a further method of the above method, the processing of intercepting the image in the selected area is mainly explained as follows: See also Figure 3 , sensing the image capture trigger operation on the projection auxiliary control interface (such as Figure 3 ), analyze the test paper image collected from the photographic area, generate a selection box, project the selection box into the photographic area, and obtain the image in the selected area where the selection box is located.

[0061] Accordingly, see Figure 4 , sensing the selection operation of the selection box in the photographic area (such as clicking in the selection box area by a trigger pen), obtaining the problem-solving process data of the homework content on the image in the selection area where the selection box is located; and projecting the problem-solving process data in the projection area on the projection auxiliary operation interface.

[0062] In addition, on the projection auxiliary control interface, the projected content can be controlled and displayed through other virtual trigger "objects" displayed on the operation interface.

[0063] The following is a description of the homework tutoring device based on projection interaction provided by the present invention. The homework tutoring device based on projection interaction described below and the homework tutoring method based on projection interaction described above can be referred to each other.

[0064] Figure 5 A schematic diagram of the structure of a homework tutoring device based on projection interaction provided by the present invention is shown in FIG. Figure 5 The device comprises an acquisition module 51, an identification module 52, an analysis module 53, a generation module 54 and a projection module 55, wherein: The acquisition module is used to capture the image in the selected area; the image contains the work content; A recognition module is used to recognize the homework content on the image and determine the complete homework content; The analysis module is used to analyze the content of the homework and determine the data of the problem-solving process; A generating module, used for determining problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The projection module is used to project the problem-solving demonstration data.

[0065] Since the principle of the device described in the embodiment of the present invention is the same as that of the method described in the above embodiment, a more detailed explanation will not be repeated here.

[0066] It should be noted that, in the embodiments of the present invention, relevant functional modules may be implemented by a hardware processor.

[0067] The present invention provides a homework tutoring device based on projection interaction, which identifies the homework content on a selected image to determine the complete homework content, then analyzes the homework content to determine problem-solving process data, and after determining problem-solving demonstration data that can be displayed by audio and video based on the problem-solving process data, the problem-solving demonstration data is projected to achieve a projection explanation tutoring effect that is closer to the real tutoring method.

[0068] FIG. 1 shows a schematic diagram of the structure of a homework tutoring system based on projection interaction provided by the present invention. Figure 6 , the device comprises a photographing device 61, a processor 62 and a projection component 63, wherein: A camera device is used to capture an image in a selected area, the image contains homework content, and recognize the homework content on the image to determine the complete homework content; A processor is used to analyze the content of the homework question, determine the problem-solving process data, and determine the problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The projection component is used to project the problem-solving demonstration data. In order to coordinate the processing of the picture data and the voice data, the projection component includes a projector and a player.

[0069] Since the principle of the device described in the embodiment of the present invention is the same as that of the method described in the above embodiment, a more detailed explanation will not be repeated here.

[0070] It should be noted that, in the embodiments of the present invention, relevant functional modules may be implemented by a hardware processor.

[0071] The present invention provides a homework tutoring system based on projection interaction, which identifies the homework content on a selected image to determine the complete homework content, then analyzes the homework content to determine problem-solving process data, and after determining problem-solving demonstration data that can be displayed in audio and video based on the problem-solving process data, the problem-solving demonstration data is projected to achieve a projection explanation tutoring effect that is closer to the real tutoring method.

[0072] Figure 7 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 7 As shown, the electronic device may include: a processor 71, a communication interface 72, a memory 73 and a communication bus 74, wherein the processor 71, the communication interface 72 and the memory 73 communicate with each other through the communication bus 74. The processor 71 may call the logic instructions in the memory 73 to execute a homework tutoring method based on projection interaction, the method comprising: intercepting an image in a selected area; the image contains homework content; identifying the homework content on the image to determine the complete homework content; analyzing the homework content to determine the problem-solving process data; determining the problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; and projecting the problem-solving demonstration data.

[0073] In addition, the logic instructions in the above-mentioned memory 73 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0074] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the homework tutoring method based on projection interaction provided by the above-mentioned methods, which includes: capturing an image in a selected area; the image contains homework content; identifying the homework content on the image to determine the complete homework content; analyzing the homework content to determine problem-solving process data; determining problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; and projecting the problem-solving demonstration data.

[0075] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the projection-interactive homework tutoring method provided by the above-mentioned methods, the method comprising: capturing an image in a selected area; the image contains homework content; identifying the homework content on the image to determine the complete homework content; analyzing the homework content to determine problem-solving process data; determining problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; and projecting the problem-solving demonstration data.

[0076] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0077] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0078] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A homework tutoring method based on projection interaction, characterized in that: include: Acquire an image in the selected area; the image contains the work content; Recognize the homework content on the image to determine the complete homework content; Analyze the content of the homework question and determine the problem-solving process data; Determine problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The problem-solving demonstration data is projected.

2. The homework tutoring method based on projection interaction according to claim 1, characterized in that: The determining of the problem-solving demonstration data based on the problem-solving process data comprises: Based on the problem-solving process data, the adopted content is determined from the homework content, and first screen data with a marking function is configured for the adopted content, and new content is determined, and converted into second screen data with a tutoring function based on the new content; Based on the problem-solving process data, converting into voice data for playing the problem-solving process; Based on the first screen data, the second screen data and the voice data, problem-solving demonstration data having a time sequence is determined.

3. The homework tutoring method based on projection interaction according to claim 2, characterized in that: Before projecting the problem-solving demonstration data, the method further includes: Determine a first projection area of ​​the first screen data based on position information of the adopted content in the selected area; Determining a second projection area of ​​the second picture data based on a picture area occupied by the second picture data and a free area divided from the selected area; Correspondingly, the problem-solving demonstration data is projected in the first projection area and the second projection area.

4. The homework tutoring method based on projection interaction according to claim 3 is characterized in that: The projecting the problem-solving demonstration data comprises: Determining a voice segment to be played in the voice data; When it is determined that the voice segment has corresponding adopted content and first picture data, while playing the voice segment, projecting the first picture data in the first projection area; When it is determined that the voice segment has corresponding second picture data, the second picture data is projected into the second projection area while the voice segment is played.

5. The homework tutoring method based on projection interaction according to claim 1, characterized in that: Before analyzing the content of the homework question and determining the problem-solving process data, the method further includes: When it is determined that the homework question content contains the answer content, and when it is determined that the answer content is different from the standard answer content, the homework question content is further analyzed to determine the problem-solving process data; When it is determined that the homework question content contains the answer content, and when it is determined that the answer content is the same as the standard answer content, a prompt information is generated and the prompt information is projected onto the selection area content; the prompt information represents whether to confirm the selection trigger interface of the problem-solving process data.

6. The homework tutoring method based on projection interaction according to claim 5, characterized in that: The method further includes: when it is determined that the answer content is different from or the same as the standard answer content, generating third screen data for judging whether the answer is correct or not, and projecting the third screen data into the answer area in the homework content.

7. The homework tutoring method based on projection interaction according to claim 1, characterized in that: The step of obtaining an image in the selected area comprises: Sensing an image capture trigger operation on the projection auxiliary control interface, analyzing the test paper screen collected from the photographic area, generating a selection box, and projecting the selection box into the photographic area to obtain an image in the selection area where the selection box is located; Accordingly, the method further comprises: The selection operation of the selection box in the photographic area is sensed, and the problem-solving process data of the homework content on the image in the selection area where the selection box is located is obtained; and the problem-solving process data is projected in the projection area on the projection auxiliary operation interface.

8. A homework tutoring device based on projection interaction, characterized in that: include: An acquisition module is used to acquire an image in a selected area; the image contains the operation content; A recognition module, used to recognize the homework content on the image and determine the complete homework content; An analysis module, used to analyze the content of the homework question and determine the problem-solving process data; A generating module, used for determining problem-solving demonstration data based on the problem-solving process data; The problem-solving demonstration data includes picture data and voice data; The projection module is used to project the problem-solving demonstration data.

9. A homework tutoring system based on projection interaction, characterized in that: include: A camera device is used to obtain an image in a selected area, wherein the image contains homework content, and recognize the homework content on the image to determine the complete homework content; A processor, configured to analyze the content of the homework question, determine the problem-solving process data, and determine the problem-solving demonstration data based on the problem-solving process data; the problem-solving demonstration data includes picture data and voice data; The projection component is used to project the problem-solving demonstration data.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the homework tutoring method based on projection interaction as described in any one of claims 1 to 6 is implemented.

Images