A calligraphy practice method, device, system and electronic device based on virtual reality

Abstract

The present invention discloses a calligraphy practice method, device, system and electronic device based on virtual reality. The method includes: obtaining a target virtual scene and a target virtual calligraphy practice copy selected by a user; obtaining a current user image collected in real time by a panoramic camera, wherein the current user image includes a touch calligraphy pen held by the user and a writing board; processing the current user image based on the target virtual scene and the target virtual calligraphy practice copy to generate a current virtual scene image; sending the current virtual scene image to a virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene image, and calligraphy practice is carried out through the touch calligraphy pen and the writing board in the current virtual image. The technical solution of the embodiment of the present invention, through the application of virtual reality technology in the calligraphy practice process, establishes different virtual calligraphy practice scenes for users, enhances the interest and experience of users in calligraphy practice, and at the same time mobilizes the enthusiasm of users for writing training, thereby improving the calligraphy practice efficiency.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a calligraphy practice method, device, system and electronic device based on virtual reality. Background Art

[0002] The application of virtual reality technology in education and teaching provides users with rich learning resources while enhancing the learning experience of users, and has extremely huge application prospects in the field of education and teaching. The traditional calligraphy practice method is to practice on a paper copybook. This calligraphy practice method is boring and cannot provide a good calligraphy practice atmosphere for users, so the calligraphy practice efficiency is relatively low. Summary of the Invention

[0003] The present invention provides a calligraphy practice method, device, system and electronic device based on virtual reality. By applying virtual reality technology in the calligraphy practice process, different virtual calligraphy practice scenes are established for users, while enhancing the fun and experience of users' calligraphy practice, mobilizing the enthusiasm of users for writing training, and thus improving the calligraphy practice efficiency.

[0004] In a first aspect, an embodiment of the present invention provides a calligraphy practice method based on virtual reality, which is applied to a client. The client is connected and communicates with a virtual reality glasses, a panoramic camera, a touch calligraphy pen and a writing board. The method includes:

[0005] Obtain a target virtual scene and a target virtual calligraphy copybook selected by the user;

[0006] Obtain the current user image collected in real time by the panoramic camera, where the current user image includes the touch calligraphy pen and the writing board held by the user;

[0007] Process the current user image based on the target virtual scene and the target virtual calligraphy copybook to generate a current virtual scene image;

[0008] Send the current virtual scene image to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene image, and perform writing practice through the touch calligraphy pen and the writing board in the current virtual image.

[0009] In a second aspect, an embodiment of the present invention further provides a calligraphy practice device based on virtual reality, which is integrated in a client. The device includes:

[0010] A scene selection module, configured to obtain a target virtual scene and a target virtual calligraphy copybook selected by the user;

[0011] An image acquisition module, configured to obtain the current user image collected in real time by the panoramic camera, where the current user image includes the touch calligraphy pen and the writing board held by the user;

[0012] A virtual scene generation module, configured to process the current user picture based on the target virtual scene and the target virtual calligraphy copybook, and generate a current virtual scene picture;

[0013] A scene presentation module, configured to send the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and perform calligraphy practice on the current virtual picture through a touch calligraphy pen and a writing board.

[0014] In a third aspect, an embodiment of the present invention further provides a calligraphy practice system based on virtual reality. The system includes: a client, virtual reality glasses, a panoramic camera, a touch calligraphy pen, and a writing board;

[0015] Wherein,

[0016] The client is configured to implement the calligraphy practice method based on virtual reality provided in the first aspect.

[0017] In a fourth aspect, the present invention further provides an electronic device, which includes:

[0018] At least one processor; and

[0019] A memory communicatively connected to the at least one processor; wherein,

[0020] The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor, so that the at least one processor can execute the calligraphy practice method based on virtual reality according to any embodiment of the present invention.

[0021] The technical solution of the embodiment of the present invention solves the problems that the traditional calligraphy practice method is boring, cannot provide a good calligraphy practice atmosphere for users, and has low calligraphy practice efficiency by obtaining the target virtual scene and the target virtual calligraphy copybook selected by the user; obtaining the current user picture collected in real time by the panoramic camera, where the current user picture includes the touch calligraphy pen and the writing board held by the user; processing the current user picture based on the target virtual scene and the target virtual calligraphy copybook to generate a current virtual scene picture; sending the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and performing calligraphy practice on the current virtual picture through the touch calligraphy pen and the writing board, enhancing the fun and experience of users' calligraphy practice, while mobilizing the enthusiasm of users' writing training, and thus improving the efficiency of calligraphy practice.

[0022] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. Brief Description of the Drawings

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0024] Figure 1 is a flowchart of a calligraphy practice method based on virtual reality according to Embodiment 1 of the present invention;

[0025] Figure 2 is a flowchart of a calligraphy practice method based on virtual reality according to Embodiment 2 of the present invention;

[0026] Figure 3 is a flowchart of a calligraphy practice method based on virtual reality according to Embodiment 3 of the present invention;

[0027] Figure 4 is a schematic structural diagram of a calligraphy practice device based on virtual reality according to Embodiment 4 of the present invention;

[0028] Figure 5 is a schematic structural diagram of a calligraphy practice system based on virtual reality according to Embodiment 5 of the present invention

[0029] Figure 6 is a schematic structural diagram of an electronic device for implementing the calligraphy practice method based on virtual reality in the embodiments of the present invention. Detailed Description of the Embodiments

[0030] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0031] It should be noted that the terms "first", "second", etc. in the description, claims and the above drawings of the present invention are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present invention described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily limit to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0032] Embodiment 1

[0033] Figure 1 The figure is a flowchart of a virtual reality-based calligraphy practice method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation where a user conducts writing training in a virtual scenario. This method can be executed by a virtual reality-based calligraphy practice device, which can be implemented in the form of hardware and / or software, and can be integrated into a client. The client is connected and communicates with a virtual reality glasses, a panoramic camera, a touch calligraphy pen and a writing board. Among them, the client and the virtual reality interaction end can be integrated on terminal devices such as a computer and a mobile phone to achieve data transmission between the two parties. The virtual reality interaction end can be connected to the virtual reality glasses, the panoramic camera, the touch calligraphy pen and the writing board through methods such as Bluetooth and data lines, and then indirectly communicate between the client and the virtual reality glasses, the panoramic camera, the touch calligraphy pen and the writing board through the virtual reality interaction end.

[0034] As Figure 1 shown, the method includes:

[0035] S110. Obtain a target virtual scenario and a target virtual calligraphy copybook selected by the user.

[0036] Among them, the target virtual scenario refers to the virtual calligraphy practice situation selected by the user. The target virtual scenario can be, but is not limited to, a library scenario, a park scenario, a playground scenario, etc. The target virtual calligraphy copybook refers to the virtual copybook selected by the user. Further, the copybook can include many fonts such as regular script, official script, and small seal script. It should be noted that when the user first logs in to the virtual reality teaching client, there will be default virtual scenarios and virtual calligraphy copybooks on the virtual reality teaching page, and the user can customize the virtual scenarios and virtual calligraphy copybooks according to actual needs.

[0037] Specifically, the virtual scene and the virtual calligraphy copybook are teaching resources pre-stored in the virtual reality teaching server, and are presented in the form of pictures on the client interface when the user accesses the server for the user to select. The user logs in to the client and enters the virtual reality teaching page, which can include multiple recommended virtual scenes and multiple virtual calligraphy copybooks, or can also include user-defined virtual scenes and virtual calligraphy copybooks. The user selects the target virtual scene and the target virtual calligraphy copybook according to personal needs among the scene and copybook options on the page.

[0038] Exemplarily, the user logs in to the client on the tablet, and selects the park scene as the target virtual scene in the virtual scene module of the virtual reality teaching page; selects regular script as the target virtual calligraphy copybook in the virtual calligraphy copybook module.

[0039] S120. Obtain the current user picture collected in real time by the panoramic camera, where the current user picture includes the touch calligraphy pen held by the user and the writing board.

[0040] Among them, the panoramic camera is a device set at a suitable position in the user's real scene and can collect the overall picture of the user during the calligraphy practice process. The current user picture refers to the overall picture of the user collected at the current moment. The touch calligraphy pen is a device used for writing training and can sense the current user's pen-holding action. The writing board is a device used for writing and displaying the writing result.

[0041] Specifically, the panoramic camera collects the picture of the user during calligraphy practice in real time, and uploads the collected current user picture to the virtual reality interaction end in real time, and the virtual reality interaction end sends the current user picture to the client. Exemplarily, the current user picture includes the touch calligraphy pen held by the user and the writing board.

[0042] S130. Process the current user picture based on the target virtual scene and the target virtual calligraphy copybook to generate the current virtual scene picture.

[0043] Among them, the current virtual scene picture refers to the picture of the user practicing calligraphy in the selected target virtual scene. Further, the writing board shows the target virtual calligraphy copybook selected by the user.

[0044] Specifically, the client performs cropping and splicing processing on the target virtual scene and the target virtual calligraphy copybook selected by the user and the current user picture, and then generates the current virtual scene picture on the client.

[0045] Optionally, S130 may include: obtaining the writing board area in the current user picture and the background area except for the touch calligraphy pen and the writing board; rendering the picture of the target virtual scene to the background area, and rendering the target virtual calligraphy copybook to the writing board area to generate the current virtual scene picture.

[0046] Specifically, based on the client performing matte painting processing on the current user screen, removing the area corresponding to the writing tablet in the current user screen and the background area except for the touch calligraphy pen and the writing tablet, rendering the pre-selected target virtual characters onto the area of the writing tablet, and rendering the target virtual scene onto the background area, to obtain the current virtual scene screen.

[0047] S140. Send the current virtual scene screen to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene screen, and perform calligraphy practice through the touch calligraphy pen and the writing tablet in the current virtual screen.

[0048] Among them, the virtual reality glasses are a kind of head-mounted display device that closes a person's vision and hearing of the outside world, guiding the user to have a feeling of being in a virtual environment.

[0049] Specifically, send the current virtual scene screen generated by the client to the virtual reality glasses worn by the user, enabling the user to immerse in the target virtual scene and perform calligraphy practice through the touch calligraphy pen and the writing tablet.

[0050] The technical solution of the embodiment of the present invention, by obtaining the target virtual scene and the target virtual calligraphy copy selected by the user; obtaining the current user screen collected in real time by the panoramic camera, where the current user screen includes the touch calligraphy pen and the writing tablet held by the user; based on the target virtual scene and the target virtual calligraphy copy, processing the current user screen to generate the current virtual scene screen; sending the current virtual scene screen to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene screen, and performing calligraphy practice through the touch calligraphy pen and the writing tablet in the current virtual screen, builds multiple virtual scenes for the user to practice calligraphy, provides a good atmosphere for the user to practice calligraphy, solves the problem of the boring process of traditional calligraphy practice methods, mobilizes the user's enthusiasm for calligraphy practice, and thus improves the calligraphy practice efficiency.

[0051] Based on the above technical solution, the method may further include: determining the current user sitting posture according to the current user screen; if it is detected that the current user sitting posture is not a standard sitting posture, then sending the standard sitting posture screen to the virtual reality glasses, so that the virtual reality glasses superimpose the standard sitting posture screen on the current virtual scene screen for display.

[0052] Among them, the current user sitting posture refers to the posture at the current moment when the user is practicing calligraphy. The standard sitting posture screen may be a screen of a virtual person maintaining a standard sitting posture.

[0053] Specifically, a panoramic camera is used to record the user's sitting posture during calligraphy practice throughout the process, and relevant data or photos are uploaded to the virtual reality interaction terminal. Specifically, by calculating data such as the distance between the user's head and the writing board, and the vertical angle between the neck and the shoulders, and comparing these data with the corresponding data of the standard sitting posture, it is determined whether the current user's sitting posture is the standard sitting posture. If the deviation between the above data and the corresponding data of the standard sitting posture is greater than the preset range, it can be determined that the current user's sitting posture is not the standard sitting posture. Then, the virtual character image maintaining the standard sitting posture is sent to the virtual reality glasses, so that the user can see the standard sitting posture image through the virtual reality glasses and then adjust the sitting posture.

[0054] Based on the above technical solution, the method may further include: obtaining the current pen-holding force point information sent by the touch calligraphy pen; based on the current pen-holding force point information, detecting whether the user's pen-holding posture is the standard pen-holding posture; if it is detected that the user's pen-holding posture is not the standard pen-holding posture, the standard pen-holding posture image is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the standard pen-holding posture image on the current virtual scene image for display.

[0055] Among them, the force point information refers to the position information of the contact point received by the touch calligraphy pen and the corresponding pressure information when the user's finger touches the touch calligraphy pen during calligraphy practice. The standard pen-holding posture image is an image used to show the user the standard pen-holding posture, which can be, but is not limited to, an image of a virtual hand holding a virtual touch calligraphy pen in the correct pen-holding posture. Further, the standard pen-holding posture image can be customized.

[0056] Specifically, during the user's writing practice, the touch calligraphy pen records the position information and the force information of the user's finger touching the surface of the touch calligraphy pen, and detects whether the user's pen-holding posture is the standard pen-holding posture according to the position information and the force information. If it is detected that the contact position of the user's finger and the touch calligraphy pen is not at the preset position, or the pressure value detected at the preset position deviates too much from the preset pressure value, it can be determined that the user's pen-holding posture is not the standard pen-holding posture. Then, the customized standard pen-holding posture image is sent to the virtual reality glasses through the virtual reality interaction terminal, so that the user can see the standard pen-holding posture image in the current virtual scene and correct the pen-holding posture.

[0057] Embodiment 2

[0058] Figure 2 The flowchart of a virtual reality-based calligraphy practice method provided in Embodiment 2 of the present invention. On the basis of the foregoing embodiments, the writing board and the pen movement training method used in the virtual reality-based calligraphy practice method can be described. The specific implementation manner can refer to the detailed description of the embodiments of the present invention. Among them, the same or corresponding technical terms as those in the above embodiments will not be described again here.

[0059] like Figure 2 As shown, the method includes:

[0060] S210: Obtain the target virtual scene and target virtual calligraphy practice sticker selected by the user.

[0061] S220, obtaining the current user screen captured in real time by the panoramic camera, wherein the current user screen includes the touch calligraphy pen and writing board held by the user.

[0062] Among them, the writing board is a dot cloud trajectory writing board, and there are rice-shaped writing grids distributed on the dot cloud trajectory writing board. Each writing grid is evenly arranged with dot clouds on each stroke.

[0063] Specifically, there are rice-shaped writing grids distributed on the dot cloud trajectory writing board, and the rice grids include the background of the target virtual copybook. When the user is practicing calligraphy, the dot cloud trajectory writing board can monitor the position of each stroke and the trajectory of the pen tip on the dot cloud trajectory writing board.

[0064] S230: Based on the target virtual scene and the target virtual calligraphy practice sticker, the current user screen is processed to generate a current virtual scene screen.

[0065] S240: Send the current virtual scene image to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene image, and practice writing in the current virtual image using the touch calligraphy pen and the dot cloud track writing board.

[0066] S250, obtaining the current pen focus point information corresponding to the current stroke sent by the dot cloud trajectory writing board.

[0067] The current stroke refers to the stroke written by the user on the dot cloud track writing board at the current moment. The pen focus point information refers to the position information of each point in each stroke falling on the dot cloud track writing board and the force information of each point in each stroke.

[0068] Specifically, the position information of each point in the current stroke is collected through the dot cloud track writing board, and the force information corresponding to each point in the current stroke is collected through the pressure sensor configured in the dot cloud track writing board.

[0069] S260, detecting whether the current pen focus point information meets the standard pen focus point information of the current stroke.

[0070] Among them, the standard writing force application point information refers to the stroke position information preset according to each stroke and the pressure information received by each point in the stroke. The standard writing force application point picture is a picture used to show the ideal position of each point of the stroke and the position of the points where the writing force needs to be increased. It can be, but is not limited to, filling the position of the current stroke with red at the corresponding position on the dot matrix cloud trajectory writing board and marking the positions where the writing force needs to be increased with special marks.

[0071] Specifically, compare the position information corresponding to the current stroke collected by the dot matrix cloud trajectory writing board with the position of the corresponding stroke in the background of the dot matrix cloud trajectory writing board, and compare the pressure information of each point in the current stroke collected by the pressure sensor in the dot matrix cloud trajectory writing board with the preset pressure information of each point. According to the comparison result, judge whether the current writing force application point information meets the standard writing force application point information of the current stroke.

[0072] S270. If not, send the standard writing force application point picture corresponding to the current stroke to the virtual reality glasses, so that the virtual reality glasses superimpose the standard writing force application point picture on the current virtual scene picture for display.

[0073] Specifically, if the position of the current stroke seriously deviates from the position of the corresponding stroke in the background of the dot matrix cloud trajectory writing board or no greater pressure information than other points is detected at the position of the point where the writing force needs to be increased in the current stroke, it means that the current writing force application point information does not meet the standard writing force application point information of the current stroke. Then, send the standard writing force application point picture corresponding to the current stroke to the virtual reality glasses through the virtual reality interaction terminal, and present the standard writing force application point picture on the dot matrix cloud trajectory writing board to remind the user to correct. If the current writing force application point information meets the standard writing force application point information of the current stroke, information on accurate writing can be fed back to the user through voice feedback or other means on the client side, or no reminder can be defaulted.

[0074] The technical solution of the embodiment of the present invention obtains the current writing force application point information corresponding to the current stroke sent by the dot matrix cloud trajectory writing board; detects whether the current writing force application point information meets the standard writing force application point information of the current stroke; if not, sends the standard writing force application point picture corresponding to the current stroke to the virtual reality glasses, so that the virtual reality glasses superimpose the standard writing force application point picture on the current virtual scene picture for display, real-time collects the user's writing force application point information, and feeds back the information through the client, judges whether the user's writing is standard, and gives timely feedback and prompt in the virtual scene when the user's writing is not standard, enhances the user's interest and experience in practicing calligraphy, and at the same time mobilizes the user's enthusiasm for practicing calligraphy, and further improves the efficiency of practicing calligraphy.

[0075] Embodiment III

[0076] Figure 3 This is a flowchart of a calligraphy practice method based on virtual reality provided in the third embodiment of the present invention. On the basis of the foregoing embodiments, the calligraphy practice mode in the calligraphy practice method based on virtual reality can be described. For specific implementation manners, reference can be made to the detailed description of the embodiments of the present invention. Technical terms that are the same or corresponding to those in the above embodiments will not be elaborated herein again.

[0077] As Figure 3 shown, the method includes:

[0078] S310. Obtain a target virtual scene and a target virtual calligraphy copybook selected by the user.

[0079] S320. Obtain the current user picture collected in real time by a panoramic camera. Among them, the current user picture includes a touch calligraphy pen held by the user and a dot matrix cloud trajectory writing board.

[0080] S330. Process the current user picture based on the target virtual scene and the target virtual calligraphy copybook to generate a current virtual scene picture.

[0081] S340. Send the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and perform calligraphy practice through the touch calligraphy pen and the dot matrix cloud trajectory writing board in the current virtual picture.

[0082] S350. Obtain the calligraphy practice mode selected by the user. If the calligraphy practice mode is the writing teaching mode, execute S360; if the calligraphy teaching mode is the writing practice mode, execute S370.

[0083] Among them, the calligraphy practice mode refers to the mode that the user can select when practicing calligraphy, which can be but is not limited to the writing teaching mode and the calligraphy teaching mode.

[0084] S360. Send the target teaching video selected by the user to the virtual reality glasses, so that the virtual reality glasses superimpose the target teaching video on the current virtual scene picture for display.

[0085] Among them, the target teaching video is a teaching video further selected by the user in the writing teaching mode. For example, the teaching video can be but is not limited to a famous teacher teaching video stored in the server.

[0086] Specifically, when the calligraphy practice mode selected by the user is the writing teaching mode, the user can select a corresponding teaching video as the target teaching video on the virtual reality teaching page, send the target teaching video to the virtual reality glasses through the client, and present the target teaching video in the current virtual scene picture through the virtual reality glasses. Exemplarily, the user can adjust the position and window size of the target teaching video in the current virtual scene.

[0087] S370. Based on the scanning camera on the touch-based calligraphy pen, collect the glyph images written by the user, score the glyph images, and send the scoring result to the virtual reality glasses, so that the virtual reality glasses superimpose the scoring result on the current virtual scene image for display.

[0088] Among them, the scanning camera is a camera device installed on the touch-based calligraphy pen, which can record and save the current calligraphy achievements of the user. The glyph image is the glyph image collected by the scanning camera when the user practices calligraphy. The scoring result is the score obtained by calculating the image similarity by comparing the standard glyph with the glyph image collected by the scanning camera through the client.

[0089] Specifically, when the calligraphy practice mode selected by the user is the writing practice mode, record the glyph image corresponding to the current character written by the user through the scanning camera, save it and send it to the client. The client calculates the similarity between the standard glyph corresponding to the current character and the collected glyph image to obtain the score of the current glyph image, and sends the number or image corresponding to the score to the virtual reality glasses, so that the user can see the score corresponding to the current character through the virtual reality glasses.

[0090] The technical solution of the embodiment of the present invention obtains the calligraphy practice mode selected by the user; if the calligraphy practice mode is the writing teaching mode, send the target teaching video selected by the user to the virtual reality glasses, so that the virtual reality glasses superimpose the target teaching video on the current virtual scene image for display; if the calligraphy teaching mode is the writing practice mode, based on the scanning camera on the touch-based calligraphy pen, collect the glyph images written by the user, score the glyph images, and send the scoring result to the virtual reality glasses, so that the virtual reality glasses superimpose the scoring result on the current virtual scene image for display, providing the user with a writing teaching mode and a writing practice mode, so that the user can carry out targeted learning and training in different modes, enhance the fun and experience of the user's calligraphy practice, and at the same time mobilize the enthusiasm of the user's calligraphy practice, and further improve the calligraphy practice efficiency.

[0091] Embodiment 4

[0092] Figure 4 FIG. 17 is a schematic structural diagram of a calligraphy practice device based on virtual reality provided in Embodiment 4 of the present invention. The device is integrated into the client. The client and the virtual reality interaction end can be integrated on terminal devices such as a computer and a mobile phone to realize data transmission between the two parties. At the same time, the virtual reality interaction end can be connected to the virtual reality glasses, the panoramic camera, the touch-based calligraphy pen, and the writing board through Bluetooth, data lines, etc., and then realize communication between the client and the virtual reality glasses, the panoramic camera, the touch-based calligraphy pen, and the writing board through the virtual reality interaction end.

[0093] AsFigure 4 As shown, the device includes: a scene selection module 410, a picture acquisition module 420, a virtual scene generation module 430 and a scene presentation module 440, wherein:

[0094] The scene selection module 410 is used to obtain the target virtual scene and target virtual calligraphy sticker selected by the user; the picture acquisition module 420 is used to obtain the current user picture acquired in real time by the panoramic camera, wherein the current user picture includes the touch calligraphy pen and writing board held by the user; the virtual scene generation module 430 is used to process the current user picture based on the target virtual scene and the target virtual calligraphy sticker to generate the current virtual scene picture; the scene presentation module 440 is used to send the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and practice writing in the current virtual picture with the touch calligraphy pen and writing board.

[0095] Based on the above-mentioned embodiments of the invention, the virtual scene generation module 430 specifically includes:

[0096] A background area acquisition unit, used to acquire the writing board area and the background area other than the touch calligraphy pen and the writing board in the current user screen;

[0097] The virtual scene generation unit is used to render the target virtual scene image to the background area, and render the target virtual calligraphy sticker to the writing board area, so as to generate the current virtual scene image.

[0098] On the basis of the above-mentioned embodiments of the invention, the calligraphy practice device based on virtual reality further includes:

[0099] The sitting posture training module is used to determine the current user's sitting posture based on the current user screen; if it is detected that the current user's sitting posture is not the standard sitting posture, the standard sitting posture screen is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the standard sitting posture screen on the current virtual scene screen for display.

[0100] On the basis of the above-mentioned embodiments of the invention, the calligraphy practice device based on virtual reality further includes:

[0101] The pen holding training module is used to obtain the current pen holding force point information sent by the touch calligraphy pen; based on the current pen holding force point information, detect whether the user's pen holding posture is the standard pen holding posture; if not, send the standard pen holding posture image to the virtual reality glasses, so that the virtual reality glasses will superimpose the standard pen holding posture image on the current virtual scene image for display.

[0102] On the basis of the above-mentioned embodiments of the invention, the writing board is a dot cloud trajectory writing board, and the dot cloud trajectory writing board is distributed with rice-shaped writing grids, and each writing grid is evenly arranged with dot clouds on each stroke.

[0103] Based on the above embodiments of the invention, the virtual reality-based calligraphy practice device further includes:

[0104] A pen movement training module, configured to obtain the current pen movement force application point information corresponding to the current stroke sent by the dot matrix cloud trajectory writing board; detect whether the current pen movement force application point information meets the standard pen movement force application point information of the current stroke; if not, send the standard pen movement force application point picture corresponding to the current stroke to the virtual reality glasses, so that the virtual reality glasses superimpose the standard pen movement force application point picture on the current virtual scene picture for display.

[0105] Based on the above embodiments of the invention, the virtual reality-based calligraphy practice device further includes:

[0106] A calligraphy practice mode selection module, configured to obtain the calligraphy practice mode selected by the user; a writing teaching module, configured to, if the calligraphy practice mode is the writing teaching mode, send the target teaching video selected by the user to the virtual reality glasses, so that the virtual reality glasses superimpose the target teaching video on the current virtual scene picture for display; a writing practice module, configured to, if the calligraphy teaching mode is the writing practice mode, collect the glyph image written by the user based on the scanning camera on the touch calligraphy pen, score the glyph image, and send the scoring result to the virtual reality glasses, so that the virtual reality glasses superimpose the scoring result on the current virtual scene picture for display.

[0107] The technical solution of the embodiment of the present invention solves the problems that the traditional calligraphy practice method is boring, cannot provide a good calligraphy practice atmosphere for users, and users cannot get timely feedback and guidance during the calligraphy practice process, resulting in low calligraphy practice efficiency, by obtaining the target virtual scene and the target virtual calligraphy copy selected by the user; obtaining the current user picture collected in real time by the panoramic camera, where the current user picture includes the touch calligraphy pen held by the user and the writing board; processing the current user picture based on the target virtual scene and the target virtual calligraphy copy to generate the current virtual scene picture; and sending the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture and perform calligraphy practice through the touch calligraphy pen and the writing board in the current virtual picture.

[0108] The virtual reality-based calligraphy practice device provided by the embodiment of the present invention can execute the virtual reality-based calligraphy practice device method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0109] Embodiment Five

[0110] Figure 5Schematic diagram of a virtual reality-based calligraphy practice system provided in Embodiment 5 of the present invention. This embodiment is applicable to application scenarios where a virtual environment is built based on virtual reality technology for writing training.

[0111] As Figure 5 shown, the system specifically includes: a client 510, a virtual reality glasses 520, a panoramic camera 530, a touch calligraphy pen 540, and a writing board 550.

[0112] Among them, the client 510 and the virtual reality interaction end can be integrated on terminal devices such as computers and mobile phones to realize data transmission between the two parties. At the same time, the virtual reality interaction end can be connected to the virtual reality glasses 520, the panoramic camera 530, the touch calligraphy pen 540, and the writing board 550 through Bluetooth, data lines, etc., so as to realize communication between the client 510 and the virtual reality glasses 520, the panoramic camera 530, the touch calligraphy pen 540, and the writing board 550. The client 510 is used to implement the virtual reality-based calligraphy practice method provided in the above embodiments.

[0113] In the virtual reality-based calligraphy practice system of the embodiments of the present invention, the client obtains the target virtual scene and the target virtual calligraphy copy selected by the user; the panoramic camera real-time collects the current user picture, where the current user picture includes the touch calligraphy pen held by the user and the writing board; based on the target virtual scene and the target virtual calligraphy copy, the current user picture is processed to generate the current virtual scene picture; the current virtual scene picture is sent to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and writing practice is carried out through the touch calligraphy pen and the writing board in the current virtual picture, solving the problems that the traditional calligraphy practice method is boring, cannot provide a good calligraphy practice atmosphere for users, and users cannot get timely feedback and guidance during the calligraphy practice process, resulting in low calligraphy practice efficiency.

[0114] Embodiment 6

[0115] Figure 6 The structure diagram of an electronic device 10 that can be used to implement the embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0116] As Figure 6As shown, the electronic device 10 includes at least one processor 11 and a memory communicatively connected to the at least one processor 11, such as read-only memory (ROM) 12, random access memory (RAM) 13, etc. The memory stores a computer program executable by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, ROM 12, and RAM 13 are connected to each other via a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0117] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disc, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0118] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the virtual reality-based calligraphy practice method.

[0119] In some embodiments, the virtual reality-based calligraphy practice method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the virtual reality-based calligraphy practice method described above can be executed. Alternatively, in other embodiments, the processor 11 can be configured to execute the virtual reality-based calligraphy practice method by any other appropriate means (e.g., by means of firmware).

[0120] The various embodiments of the systems and techniques described above in this specification can be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems-on-chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which may be a special-purpose or general-purpose programmable processor that receives data and instructions from, and transmits data and instructions to, a storage system, at least one input device, and at least one output device.

[0121] A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

[0122] In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium may be a machine-readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0123] To provide interaction with users, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with users; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0124] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected with each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), blockchain network, and the Internet.

[0125] The computing system can include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0126] It should be understood that various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps recited in the present invention can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved, and no limitation is made herein.

[0127] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims

1. A calligraphy practice method based on virtual reality, characterized in that, The method is applied to a client, wherein the client is connected and communicated with virtual reality glasses, a panoramic camera, a touch-controlled calligraphy pen and a writing board, wherein the panoramic camera is a device for collecting the overall picture of the user during the calligraphy practice process, and the method comprises: Acquire a target virtual scene and a target virtual calligraphy practice sticker selected by a user; the target virtual scene is a virtual calligraphy practice scenario selected by the user; Acquire the current user screen captured by the panoramic camera in real time, wherein the current user screen includes the touch calligraphy pen and writing board held by the user; the current user screen is the overall user screen captured at the current moment; Acquire the writing board area and the background area excluding the touch calligraphy practice pen and the writing board in the current user screen; render the screen of the target virtual scene to the background area, and render the target virtual calligraphy practice sticker to the writing board area to generate the current virtual scene screen; the current virtual scene screen is the screen of the user practicing calligraphy in the selected target virtual scene; the writing board in the current virtual scene screen is the target virtual calligraphy practice sticker selected by the user; The current virtual scene picture is sent to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and writing practice is performed in the current virtual scene picture through the touch calligraphy pen and writing board.

2. The method according to claim 1, characterized in that The method further comprises: Determine the current user's sitting posture according to the current user screen; If it is detected that the current user sitting posture is not the standard sitting posture, the standard sitting posture picture is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the standard sitting posture picture on the current virtual scene picture for display.

3. The method according to claim 1, wherein The method further comprises: Get the current pen holding point information sent by the touch calligraphy pen; Based on the current pen holding point information, detect whether the user's pen holding posture is a standard pen holding posture; If not, the standard pen-holding posture image is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the standard pen-holding posture image on the current virtual scene image for display.

4. The method according to claim 1, characterized in that The writing board is a dot cloud track writing board, and the dot cloud track writing board is distributed with rice-shaped writing grids, and each writing grid is evenly arranged on each stroke with a dot cloud.

5. The method according to claim 4, wherein The method further comprises: Obtaining the current pen focus point information corresponding to the current stroke sent by the dot cloud trajectory writing board; Check whether the current pen focus point information meets the standard pen focus point information of the current stroke; If not, the standard pen focus point picture corresponding to the current stroke is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the standard pen focus point picture on the current virtual scene picture for display.

6. The method according to any one of claims 1-5, characterized in that, The method further comprises: Get the calligraphy practice mode selected by the user; If the calligraphy practice mode is a writing teaching mode, the target teaching video selected by the user is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the target teaching video on the current virtual scene screen for display; If the calligraphy practice mode is the writing practice mode, based on the scanning camera on the touch calligraphy pen, the glyph images written by the user are collected, and the glyph images are scored, and the scoring result is sent to the virtual reality glasses, so that the virtual reality glasses superimpose the scoring result on the current virtual scene picture for display.

7. A calligraphy practice device based on virtual reality, characterized in that, Integrated in the client, the client is connected and communicates with a virtual reality glasses, a panoramic camera, a touch calligraphy pen, and a writing board. The panoramic camera is a device for collecting the overall picture of the user during the user's calligraphy practice. The device includes: A scene selection module, configured to obtain a target virtual scene and a target virtual calligraphy copy selected by the user; the target virtual scene is a virtual calligraphy practice scenario selected by the user; A picture acquisition module, configured to obtain the current user picture collected in real time by the panoramic camera, wherein the current user picture includes the touch calligraphy pen held by the user and the writing board; the current user picture is the overall picture of the user collected at the current moment; A virtual scene generation module, configured to process the current user picture based on the target virtual scene and the target virtual calligraphy copy to generate a current virtual scene picture; the current virtual scene picture is a picture of the user practicing calligraphy in the selected target virtual scene; the writing board in the current virtual scene picture is the target virtual calligraphy copy selected by the user; A scene presentation module, configured to send the current virtual scene picture to the virtual reality glasses worn by the user, so that the virtual reality glasses display the current virtual scene picture, and perform writing practice through the touch calligraphy pen and the writing board in the current virtual picture; Among them, the virtual scene generation module includes: A background area acquisition unit, configured to acquire the writing board area and the background area other than the touch calligraphy pen and the writing board in the current user picture; A virtual scene generation unit, configured to render the picture of the target virtual scene to the background area, and render the target virtual calligraphy copy to the writing board area to generate a current virtual scene picture.

8. A virtual reality-based calligraphy practice system, characterized in that, The system includes: a client, a virtual reality glasses, a panoramic camera, a touch calligraphy pen, and a writing board; wherein, The client is used to implement the virtual reality-based calligraphy practice method described in any one of claims 1-6.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor, so that the at least one processor can execute the virtual reality-based calligraphy practice method described in any one of claims 1-6.

Images