Calligraphy practicing guidance method and device, AR glasses and storage medium

Abstract

The invention relates to the technical field of electronic information, and provides a calligraphy practicing guidance method and device, AR (Augmented Reality) glasses and a storage medium, and the method comprises the steps: displaying a calligraphy practicing guidance image or video based on a near-to-eye display device, and displaying a virtual copybook, so that a user can practice calligraphy on the virtual copybook according to the calligraphy practicing guidance image or video; obtaining calligraphy practicing related information of the user; and according to the calligraphy practicing related information, generating feedback information corresponding to the calligraphy practicing of the user. According to the embodiment of the invention, the calligraphy practicing effectiveness is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic information technology, and in particular to a calligraphy instruction method, device, AR glasses and storage medium. Background Art

[0002] In traditional calligraphy learning, people usually attend calligraphy training classes, put paper copybooks aside, observe and analyze the strokes and structure of the characters on the paper copybooks, and then imitate and practice calligraphy on paper. Paper copybooks are not easy to carry, and are often limited by time and space, making it difficult to get professional guidance anytime and anywhere. There are electronic calligraphy practice devices on the market. Compared with paper copybooks, electronic calligraphy practice devices provide convenience to a certain extent, but their functions are relatively single, making it difficult to stimulate interest and enthusiasm in calligraphy practice, and cannot achieve ideal calligraphy practice results.

[0003] Therefore, how to improve the effectiveness of calligraphy practice becomes an urgent problem to be solved. Summary of the invention

[0004] The present application provides a calligraphy practice guidance method, device, AR glasses and storage medium, aiming to improve the effectiveness of calligraphy practice.

[0005] To achieve the above-mentioned purpose, the present application provides a method for guiding calligraphy practice based on a near-eye display device, and the method for guiding calligraphy practice based on a near-eye display device comprises:

[0006] Displaying a calligraphy practice guidance image or video based on the near-eye display device, and displaying a virtual copybook, so that the user can practice calligraphy on the virtual copybook with reference to the calligraphy practice guidance image or video;

[0007] Obtaining the user's calligraphy practice related information;

[0008] Based on the calligraphy practice related information, feedback information corresponding to the calligraphy practice of the user is generated.

[0009] In addition, to achieve the above-mentioned purpose, the present application also provides a calligraphy instruction device, the calligraphy instruction device comprising a memory and a processor;

[0010] The memory is used to store computer programs;

[0011] The processor is used to execute the computer program and implement the steps of the above-mentioned method for guiding calligraphy practice based on a near-eye display device when executing the computer program.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides an AR glasses, and the AR glasses include the calligraphy guidance device as described above.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned method of guiding calligraphy practice based on a near-eye display device.

[0014] The present application discloses a method and device for guiding calligraphy practice, AR glasses and storage medium, which display calligraphy practice guiding images or videos and virtual copybooks through a near-eye display device. Users practice calligraphy on the virtual copybook with reference to the calligraphy practice guiding images or videos, and obtain the user's calligraphy practice related information. Based on the calligraphy practice related information, feedback information corresponding to the user's calligraphy practice is generated, thereby helping the user to strengthen and improve, and improving the effectiveness of calligraphy practice. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 is a schematic flow chart of the steps of a calligraphy practice guidance method based on a near-eye display device provided in an embodiment of the present application;

[0017] Figure 2 is a schematic diagram of a calligraphy practice guidance image provided in an embodiment of the present application;

[0018] Figure 3 It is a schematic diagram of a virtual copy provided in an embodiment of the present application;

[0019] Figure 4 It is a schematic diagram of a virtual copying method provided in an embodiment of the present application;

[0020] Figure 5 is a schematic flow chart of steps for displaying a calligraphy practice guidance image or video provided by an embodiment of the present application;

[0021] Figure 6 It is a schematic diagram of a user's calligraphy practice content provided in an embodiment of the present application;

[0022] Figure 7 It is a schematic flow chart of the steps of generating feedback information corresponding to the user's calligraphy practice according to the calligraphy practice related information provided by an embodiment of the present application;

[0023] Figure 8 Another schematic flow chart of steps for generating feedback information corresponding to the user's calligraphy practice according to the calligraphy practice related information provided by an embodiment of the present application;

[0024] Fig. 9 It is a schematic block diagram of a calligraphy instruction device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0027] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0028] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] The embodiments of the present application provide a calligraphy practice guidance method, device, AR glasses and storage medium for improving the effectiveness of calligraphy practice.

[0030] See also Figure 1 , Figure 1 This is a flow chart of a method for guiding calligraphy practice based on a near-eye display device provided in one embodiment of the present application. The method can be applied to a calligraphy practice guidance device or to a near-eye display device, and the application scenario of the method is not limited in the present application. Among them, the near-eye display device includes but is not limited to AR glasses, VR (Virtual Reality) glasses and other devices.

[0031] like Figure 1 As shown, the calligraphy training guidance method based on the near-eye display device specifically includes steps S101 to S103.

[0032] S101. Displaying a calligraphy practice guidance image or video based on a near-eye display device, and displaying a virtual copybook, so that the user can practice calligraphy on the virtual copybook with reference to the calligraphy practice guidance image or video.

[0033] Exemplarily, a calligraphy practice related application program is installed on the near-eye display device. When the user needs to practice calligraphy, the user wears the near-eye display device and performs corresponding operations to start the calligraphy practice related application program on the near-eye display device, and the near-eye display device displays corresponding calligraphy practice guidance images or videos, as well as a virtual calligraphy copybook.

[0034] For example, taking the near-eye display device as an AR glasses, the wearer of the AR glasses inputs a voice such as "practice calligraphy". When receiving the voice, the system controls to start the calligraphy practice related application program, and displays corresponding calligraphy practice guidance images or videos, as well as a virtual calligraphy copybook.

[0035] For another example, operation buttons are provided on the AR glasses. For example, a touch key is provided at the temple position of the AR glasses. When the user touches the touch key, the system controls to start the calligraphy practice related application program, and displays corresponding calligraphy practice guidance images or videos, as well as a virtual calligraphy copybook.

[0036] Among them, the calligraphy practice guidance images or videos include but are not limited to single gesture action images of holding a pen to write, gesture action videos, continuous multiple images after the gesture action is decomposed, etc.

[0037] For example, still taking the near-eye display device as an AR glasses, as Figure 2 shown, a single gesture action image of holding a writing brush to write is displayed on the virtual screen projected by the AR glasses.

[0038] The virtual calligraphy copybook includes but is not limited to virtual tracing and virtual copying. Among them, the virtual tracing is a blank copybook without fonts, while the virtual copying is not a blank copybook and includes the fonts to be copied. The user can refer to the calligraphy practice guidance images or videos and write and practice calligraphy on the corresponding virtual tracing or virtual copying.

[0039] For example, still taking the near-eye display device as an AR glasses, as Figure 3 shown, a virtual copy of the character "中" is displayed on the virtual screen projected by the AR glasses. The user can refer to the calligraphy practice guidance images or videos and trace the character "中" on the virtual copy.

[0040] For another example, still taking the near-eye display device as an AR glasses, as Figure 4 shown, a virtual tracing is displayed on the virtual screen projected by the AR glasses. The user can refer to the calligraphy practice guidance images or videos and copy the corresponding fonts on the virtual tracing.

[0041] In some embodiments, in addition to displaying calligraphy practice guidance images or videos, and virtual calligraphy copybooks, virtual calligraphy tools are also displayed. Among them, the virtual calligraphy tools include but are not limited to writing brushes, pencils, ballpoint pens, fountain pens, etc. The user uses the virtual calligraphy tools to write and practice calligraphy on the virtual calligraphy copybook.

[0042] Exemplarily, a gesture recognition device is provided on the near-eye display device, and the gesture recognition device includes a camera, a sensor, etc. The gesture recognition device is used to recognize the user's gesture posture, position, etc. When the user moves his hand, the virtual calligraphy practice tool is controlled to follow the movement of the user's hand, so as to realize the user's real writing experience.

[0043] In some embodiments, the calligraphy practice guidance image or video includes a calligraphy practice guidance image or video that is common to multiple people. For the sake of distinction and description, it is referred to as the first calligraphy practice guidance image or video below. Exemplarily, the display of the calligraphy practice guidance image or video includes:

[0044] The first calligraphy practice guidance image or video is displayed, wherein the first calligraphy practice guidance image or video includes any one of a single gesture action image, a gesture action video, and a plurality of continuous images after gesture action decomposition.

[0045] In one embodiment, the first calligraphy practice guidance image or video is an image of a hand gesture copied by a virtual hand, such as an image corresponding to the action of holding a pen, the action of lifting a pen, the action of writing a stroke (such as a horizontal line or a vertical line), etc. Figure 2 As shown, the single gesture action image is a gesture action image of a virtual hand holding a brush, and a single gesture action image of a virtual hand holding a brush and writing is displayed on a virtual screen. The user can practice following the single gesture action image, and after completing the action corresponding to the single gesture action image, jump to display other single gesture action images.

[0046] In another embodiment, the first calligraphy practice guidance image or video is a gesture action video or a plurality of consecutive images after gesture action decomposition, such as a video corresponding to a continuous stroke action or a plurality of consecutive images after action decomposition. The user can follow the gesture action video or the plurality of consecutive images after gesture action decomposition to perform real-time copying actions, such as practicing continuous stroke actions following the gesture action video.

[0047] In some embodiments, the calligraphy practice guidance image or video includes a calligraphy practice guidance image or video for individual use only, which is referred to as the second calligraphy practice guidance image or video below for the convenience of distinguishing descriptions. Figure 5 As shown, step S101 includes sub-steps S1011 to S1013.

[0048] S1011, obtaining hand feature information of the user;

[0049] S1012, generating the second calligraphy practice guidance image or video corresponding to the user according to the hand feature information;

[0050] S1013: Display the second calligraphy practice guidance image or video.

[0051] The user's hand feature information includes, but is not limited to, the user's hand shape, finger length, palm size, wrist rotation / deflection direction, wrist rotation / deflection angle, palm rotation / deflection direction, palm rotation / deflection angle, etc. It is understandable that the hand feature information such as wrist rotation / deflection direction, wrist rotation / deflection angle, palm rotation / deflection direction, and palm rotation / deflection angle can reflect the flexibility of the user's hand. For different users, the obtained user's hand feature information is different.

[0052] Exemplarily, the near-eye display device includes a camera device, wherein the camera device may be a camera provided by the near-eye display device. Of course, it is understandable that the camera device may also be other types of devices such as a camera mounted on the near-eye display device, and this is not specifically limited in the present application.

[0053] The camera device is turned on to scan the user's hand, and an image of the user's hand is collected. Then, based on the image of the user's hand, feature extraction and other related processing are performed on the hand image to obtain the user's hand feature information.

[0054] It should be noted that in addition to the above-mentioned method of obtaining the user's hand feature information by collecting the user's hand image, the user's hand feature information can also be obtained by other methods, such as through the corresponding user model (including multiple parameter features, such as user hand shape, finger length, palm size, wrist rotation / deflection direction, wrist rotation / deflection angle, palm rotation / deflection direction, palm rotation / deflection angle, etc.) to obtain the user's hand feature information, which is not specifically limited in the embodiments of the present application.

[0055] Afterwards, a virtual hand is formed for the user according to the user's hand feature information, and a second calligraphy practice guidance image or video corresponding to the user is generated based on the virtual hand and standard holding gestures, pen-put gestures, the font the user wants to practice, etc.

[0056] For example, still taking the near-eye display device as AR glasses as an example, various types of pens sold on the market can be selected according to the user model, and a suitable pen with suitable pen type, size, etc. can be matched for the user. Specifically, data matching, calculation, etc. can be performed through big data or AI models to obtain a suitable suitable pen for the user.

[0057] AR glasses can form targeted writing practice movements and habits that conform to the user's hand feature information based on the user model and the selected adapter pen through big data or AI models, that is, generate a second writing practice guidance image or video corresponding to the user.

[0058] In the second calligraphy practice guidance image or video, while displaying the user's corresponding virtual hand, an image or video of a virtual adaptive pen corresponding to the size of the virtual hand is displayed.

[0059] The advantage of this design is that after the user practices through the AR glasses, he can purchase the adapter pen provided in the AR glasses to perform real writing or copying in the real world.

[0060] In addition, AR glasses can also scan the shape, size, model, etc. of the user's existing physical pen, combine it with the user model, and use big data or AI models to form targeted writing movements and habits that are in line with the user's hand feature information, that is, generate a second writing guidance image or video corresponding to the user.

[0061] It can be understood that the second calligraphy guidance image or video can be a single gesture image corresponding to the user's virtual hand, or the second calligraphy guidance image or video can be a gesture video corresponding to the user's virtual hand, or the second calligraphy guidance image or video can be a series of multiple images after the gestures corresponding to the user's virtual hand are decomposed.

[0062] Afterwards, a second calligraphy practice guidance image or video is displayed on the virtual screen, and the user can follow the second calligraphy practice guidance image or video to perform corresponding exercises. In the aforementioned embodiment, the first calligraphy practice guidance image or video is universal, that is, different users follow the same first calligraphy practice guidance image or video to practice. Unlike the first calligraphy practice guidance image or video, the second calligraphy practice guidance image or video is for individual use, that is, different users follow different second calligraphy practice guidance images or videos to practice. Users practice following the second calligraphy practice guidance image or video generated for themselves, such as practicing following the image or video of the virtual hand corresponding to the user and the virtual adapter pen corresponding to the size of the virtual hand, which can meet the needs of different users, provide personalized calligraphy practice guidance, and stimulate the interest and enthusiasm of users in practice, and reduce the probability of users giving up practice.

[0063] S102: Obtaining the calligraphy practice related information of the user.

[0064] Exemplarily, the information related to calligraphy practice includes, but is not limited to, images or videos corresponding to the gestures of the user practicing calligraphy, the content of the user practicing calligraphy, etc.

[0065] In some embodiments, obtaining the user's calligraphy practice related information includes:

[0066] The calligraphy practice related information of the user during the calligraphy practice is collected by a camera device on the near-eye display device, and the calligraphy practice related information includes calligraphy practice images or videos.

[0067] For example, still taking the near-eye display device as AR glasses, the camera on the AR glasses is used to collect images or videos of the user practicing calligraphy, where the calligraphy practice images or videos include but are not limited to a single gesture action image of the user practicing calligraphy, a gesture action video of the user practicing calligraphy, and multiple consecutive images after the user's gesture action of practicing calligraphy is decomposed.

[0068] For example, when a user practices calligraphy following a calligraphy practice instruction image or video, the user's calligraphy practice content is generated according to the user's hand movement or the movement of a virtual calligraphy practice tool. For example, when a user practices strokes using a virtual brush, corresponding user calligraphy practice content is generated according to the movement trajectory of the brush, for example, Figure 6 The user's stroke practice content is shown.

[0069] S103: Generate feedback information corresponding to the user's calligraphy practice according to the calligraphy practice related information.

[0070] After obtaining the images or videos corresponding to the user's handwriting practice gestures, the user's handwriting practice content and other handwriting practice related information, feedback information corresponding to the user's handwriting practice is generated based on the handwriting practice related information, wherein the feedback information includes but is not limited to gesture correction information, handwriting practice evaluation results, etc. The gesture correction information includes but is not limited to the user's pen holding gesture correction information, writing gesture correction information, etc. The handwriting practice evaluation results include but are not limited to evaluation scores, evaluation grades, comments, etc. corresponding to the user's handwriting practice content.

[0071] For example, feedback information can be output in corresponding ways such as pictures, texts, and voices. The feedback information further provides calligraphy practice guidance to the user. Based on the feedback information, the user can timely understand whether the gestures and movements of his calligraphy practice are standard, the quality of the content written by the copying practice, etc., thereby helping the user understand his actual situation and providing targeted guidance.

[0072] In some embodiments, Figure 7 As shown, step S103 includes sub-step S1031.

[0073] S1031. Compare the calligraphy practice image or video with the second calligraphy practice guidance image or video to generate the feedback information.

[0074] Still taking the near-eye display device as AR glasses as an example, the camera on the AR glasses collects the user's calligraphy practice images or videos, such as a single gesture image of the user practicing calligraphy, or a gesture video of the user practicing calligraphy, or multiple consecutive images after the user's calligraphy practice gestures are decomposed, and the user's calligraphy practice images or videos are compared with the second calligraphy practice guidance image or video, and corresponding gesture correction information is generated according to the comparison.

[0075] In some embodiments, the step of comparing the calligraphy practice image or video with the second calligraphy practice guidance image or video to generate the feedback information includes:

[0076] Comparing the first gesture action corresponding to the calligraphy practice image or video with the second gesture action corresponding to the second calligraphy practice guidance image or video, and determining whether the first gesture action matches the second gesture action;

[0077] If the first gesture action does not match the second gesture action, the feedback information is generated, and the feedback information includes gesture action correction information.

[0078] After the image or video of the user practicing calligraphy is captured by the camera device on the near-eye display device, it is detected whether the hand shape and gesture of the user in the image or video of the user practicing calligraphy match the hand shape and gesture of the corresponding virtual hand in the second calligraphy instruction image or video. Since the corresponding virtual hand in the second calligraphy instruction image or video is generated based on the user's hand shape, if the user's gesture is standard, then the gesture of the user in the image or video of the user practicing calligraphy and the gesture of the corresponding virtual hand in the second calligraphy instruction image or video can be overlapped, that is, the gesture of the user in the image or video of the user practicing calligraphy matches the gesture of the corresponding virtual hand in the second calligraphy instruction image or video. At this time, there is no need to correct the user's gesture. Exemplarily, prompt information of the action standard or corresponding praise information can be output to further enhance the user's enthusiasm. On the contrary, if the gestures of the user in the calligraphy practice image or video corresponding to the user practicing calligraphy deviate from and do not overlap with the gestures of the corresponding virtual hand in the second calligraphy practice guidance image or video, that is, the gestures of the user in the calligraphy practice image or video corresponding to the user practicing calligraphy do not match the gestures of the corresponding virtual hand in the second calligraphy practice guidance image or video, indicating that the user's gestures are not standard. At this time, corresponding gesture correction information is generated based on the gestures of the user in the calligraphy practice image or video corresponding to the user practicing calligraphy.

[0079] For example, the pen-holding gesture action of the user in the calligraphy practice image or video corresponding to the user practicing calligraphy is compared with the pen-holding gesture action of the virtual hand in the second calligraphy practice guidance image or video. If the pen-holding gesture action of the user in the calligraphy practice image or video corresponding to the user practicing calligraphy does not match the pen-holding gesture action of the virtual hand in the second calligraphy practice guidance image or video, corresponding pen-holding gesture action correction information is generated to provide a reminder to help the user adjust the correction of the pen-holding gesture action.

[0080] In some embodiments, Figure 8 As shown, step S103 includes sub-step S1032.

[0081] S1032. Evaluate the calligraphy practice content of the user and generate the calligraphy practice evaluation result, wherein the calligraphy practice evaluation result includes at least one of an evaluation score, an evaluation grade, and a comment.

[0082] Exemplarily, the evaluation of the user's calligraphy practice content includes but is not limited to the evaluation of the strokes, structure, writing speed and other aspects of the font. For example, the user follows the calligraphy practice guidance image or video to practice a Chinese character, and the user can follow the strokes, font structure, writing speed and other aspects of the Chinese character to be evaluated. The Chinese character written by the user is compared with the standard font of the Chinese character in the copybook, and the problematic parts are identified, such as inaccurate strokes, too wide or too narrow spacing between radicals, etc., thereby generating the calligraphy practice evaluation results corresponding to the user's calligraphy practice. Among them, the calligraphy practice evaluation results can be presented in different forms such as evaluation scores, evaluation levels, comments, etc., and are not specifically limited in this application. Exemplarily, one or more corresponding solutions can be provided according to the identified problems. For example, if the font structure is not standardized, the writing instructions of the corresponding font structure and the copybook can be provided for the user to practice, thereby helping the user to continuously strengthen and improve. In this way, timely and targeted feedback, as well as continuous practice, continuous strengthening and improvement are provided to improve the enthusiasm and effect of the user's calligraphy practice.

[0083] In the above embodiment, a calligraphy practice guidance image or video and a virtual copybook are displayed through a near-eye display device. The user practices calligraphy on the virtual copybook with reference to the calligraphy practice guidance image or video, and obtains the user's calligraphy practice-related information. Based on the calligraphy practice-related information, feedback information corresponding to the user's calligraphy practice is generated, thereby helping the user to strengthen and improve, thereby improving the effectiveness of calligraphy practice.

[0084] See also Fig. 9 , Fig. 9 It is a schematic block diagram of a calligraphy guidance device provided in an embodiment of the present application. The calligraphy guidance device can be configured in a near-eye display device to execute the aforementioned calligraphy guidance method based on the near-eye display device.

[0085] like Fig. 9 As shown, the calligraphy instruction device 200 may include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0086] Specifically, the processor 210 may be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP).

[0087] Specifically, the memory 220 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB disk, or a mobile hard disk, etc. The memory 220 stores various computer programs for the processor 210 to execute.

[0088] The processor 210 is used to run a computer program stored in the memory, and implements the following steps when executing the computer program:

[0089] Displaying a calligraphy practice guidance image or video based on the near-eye display device, and displaying a virtual copybook, so that the user can practice calligraphy on the virtual copybook with reference to the calligraphy practice guidance image or video;

[0090] Obtaining the user's calligraphy practice related information;

[0091] Based on the calligraphy practice related information, feedback information corresponding to the calligraphy practice of the user is generated.

[0092] In some embodiments, the calligraphy practice guidance image or video includes a first calligraphy practice guidance image or video common to multiple people, and the processor 210, when implementing the display of the calligraphy practice guidance image or video, is used to implement:

[0093] The first calligraphy practice guidance image or video is displayed, wherein the first calligraphy practice guidance image or video includes any one of a single gesture action image, a gesture action video, and a plurality of continuous images after gesture action decomposition.

[0094] In some embodiments, the calligraphy practice guidance image or video includes a second calligraphy practice guidance image or video for individual use only. When the processor 210 implements the display of the calligraphy practice guidance image or video, it is used to implement:

[0095] Acquiring hand feature information of the user;

[0096] Generating the second calligraphy practice guidance image or video corresponding to the user according to the hand feature information;

[0097] The second calligraphy practice guidance image or video is displayed.

[0098] In some embodiments, when the processor 210 implements the acquisition of the user's calligraphy practice related information, it is used to implement:

[0099] The calligraphy practice related information of the user during the calligraphy practice is collected by a camera device on the near-eye display device, and the calligraphy practice related information includes calligraphy practice images or videos.

[0100] In some embodiments, when the processor 210 generates feedback information corresponding to the user's calligraphy practice according to the calligraphy practice related information, it is configured to implement:

[0101] The calligraphy practice image or video is compared with the second calligraphy practice guidance image or video to generate the feedback information.

[0102] In some embodiments, when the processor 210 compares the calligraphy practice image or video with the second calligraphy practice guidance image or video to generate the feedback information, it is configured to implement:

[0103] Comparing the first gesture action corresponding to the calligraphy practice image or video with the second gesture action corresponding to the second calligraphy practice guidance image or video, and determining whether the first gesture action matches the second gesture action;

[0104] If the first gesture action does not match the second gesture action, the feedback information is generated, and the feedback information includes gesture action correction information.

[0105] In some embodiments, the calligraphy practice related information includes the calligraphy practice content of the user, and the feedback information includes the calligraphy practice evaluation result. When the processor 210 generates the feedback information corresponding to the calligraphy practice of the user according to the calligraphy practice related information, it is used to implement:

[0106] The user's calligraphy practice content is evaluated to generate the calligraphy practice evaluation result, wherein the calligraphy practice evaluation result includes at least one of an evaluation score, an evaluation grade, and a comment.

[0107] The calligraphy guidance device 200 can execute the calligraphy guidance method based on the near-eye display device provided in the embodiment of the present application. Therefore, it can achieve the beneficial effects that can be achieved by the calligraphy guidance method based on the near-eye display device provided in the embodiment of the present application. Please see the previous embodiment for details and will not be repeated here.

[0108] An embodiment of the present application also provides an AR glasses, the AR glasses include a calligraphy instruction device, and the calligraphy instruction device can be Fig. 9 Therefore, AR glasses can achieve the beneficial effects that can be achieved by the calligraphy guidance method based on the near-eye display device provided in the embodiment of the present application, as detailed in the previous embodiment, which will not be repeated here.

[0109] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for guiding calligraphy practice based on a near-eye display device are implemented.

[0110] The computer-readable storage medium may be an internal storage unit of the calligraphy instruction device or near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the calligraphy instruction device or near-eye display device. The computer-readable storage medium may also be an external storage device of the calligraphy instruction device or near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital card (Secure Digital Card, SD Card), a flash card (Flash Card), etc., equipped on the calligraphy instruction device or near-eye display device.

[0111] Since the computer program stored in the storage medium can execute any one of the calligraphy training guidance methods based on the near-eye display device provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the calligraphy training guidance methods based on the near-eye display device provided in the embodiments of the present application can be achieved. Please see the previous embodiments for details and will not be repeated here.

[0112] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0113] The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or substitutions within the technical scope disclosed in the present application, and these modifications or substitutions should be included in the protection scope of the present application.

Claims

1. A calligraphy instruction method based on a near-eye display device, characterized in that: The calligraphy practice guidance method based on the near-eye display device comprises: Displaying a calligraphy practice guidance image or video based on the near-eye display device, and displaying a virtual copybook, so that the user can practice calligraphy on the virtual copybook with reference to the calligraphy practice guidance image or video; Obtaining the user's calligraphy practice related information; Based on the calligraphy practice related information, feedback information corresponding to the calligraphy practice of the user is generated.

2. The calligraphy instruction method based on the near-eye display device according to claim 1, characterized in that: The calligraphy practice guidance image or video includes a first calligraphy practice guidance image or video that is common to multiple people, and the display of the calligraphy practice guidance image or video includes: The first calligraphy practice guidance image or video is displayed, wherein the first calligraphy practice guidance image or video includes any one of a single gesture action image, a gesture action video, and a plurality of continuous images after gesture action decomposition.

3. The calligraphy instruction method based on the near-eye display device according to claim 1, characterized in that: The calligraphy practice guidance image or video includes a second calligraphy practice guidance image or video for individual use, and the display of the calligraphy practice guidance image or video includes: Acquiring hand feature information of the user; Generating the second calligraphy practice guidance image or video corresponding to the user according to the hand feature information; The second calligraphy practice guidance image or video is displayed.

4. The calligraphy instruction method based on the near-eye display device according to claim 3, characterized in that: The obtaining of the user's calligraphy practice related information includes: The calligraphy practice related information of the user during the calligraphy practice is collected by a camera device on the near-eye display device, and the calligraphy practice related information includes calligraphy practice images or videos.

5. The calligraphy instruction method based on the near-eye display device according to claim 4, characterized in that: Generating feedback information corresponding to the user's calligraphy practice according to the calligraphy practice related information includes: The calligraphy practice image or video is compared with the second calligraphy practice guidance image or video to generate the feedback information.

6. The calligraphy instruction method based on the near-eye display device according to claim 5, characterized in that: The step of comparing the calligraphy practice image or video with the second calligraphy practice guidance image or video to generate the feedback information includes: Comparing the first gesture action corresponding to the calligraphy practice image or video with the second gesture action corresponding to the second calligraphy practice guidance image or video, and determining whether the first gesture action matches the second gesture action; If the first gesture action does not match the second gesture action, the feedback information is generated, and the feedback information includes gesture action correction information.

7. The calligraphy instruction method based on a near-eye display device according to claim 1, characterized in that: The calligraphy practice related information includes the calligraphy practice content of the user, the feedback information includes the calligraphy practice evaluation result, and the generating of the feedback information corresponding to the calligraphy practice of the user according to the calligraphy practice related information includes: The user's calligraphy practice content is evaluated to generate the calligraphy practice evaluation result, which includes at least one of an evaluation score, an evaluation grade, and a comment.

8. A calligraphy instruction device, characterized in that: The calligraphy instruction device comprises a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the steps of the calligraphy guidance method based on a near-eye display device as described in any one of claims 1 to 7 when executing the computer program.

9. An AR glasses, characterized in that: The AR glasses include the calligraphy training guidance device as described in claim 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the calligraphy training guidance method based on a near-eye display device as described in any one of claims 1 to 7 are implemented.

Images