Virtual interactive physics teaching method and system and readable storage medium

Abstract

The invention provides a virtual interactive physics teaching method and system and a readable storage medium. The method comprises the steps of obtaining a point location data set of handwriting transmitted by a display screen; acquiring first point location data of a blackboard position, and mapping the first point location data to a display screen for displaying the virtual resources to obtain second point location data mapped to the display screen for displaying the virtual resources; determining a position range for processing a virtual resource based on the second point location data; and processing the virtual resources in the determined position range based on the point location data set. According to the method, software and hardware tools of the intelligent blackboard can be used for modifying and annotating in the prefabricated physical simulation resource courseware (virtual resources such as Matter.js courseware), and teachers are helped to flexibly use virtual physical experiment resources to carry out teaching.

Description

Technical Field

[0001] The present invention belongs to the field of digital teaching technology, and in particular relates to a virtual interactive physics teaching method, system and readable storage medium. Background Art

[0002] With the development of modern educational technology, digital teaching has become a trend in modern education. As an important digital teaching resource, virtual simulation resources can break through the limitations of time and space, provide a safe, economical and efficient experimental teaching environment, and are widely used in physics teaching.

[0003] Physical virtual simulation teaching in offline scenarios requires the support of hardware and software equipment. As a digital teaching auxiliary tool, the smart blackboard can meet the needs of virtual simulation teaching resource application. Unlike traditional blackboards, smart blackboards not only display electronic teaching content such as virtual simulation resources in real time, but also allow teachers and students to write and annotate on the electronic blackboard and display screen. Combining the characteristics of traditional teaching and digital teaching, teachers and students can better adapt to smart blackboard equipment. In addition, the smart blackboard can also remotely transmit the content written and displayed by teachers through network connection, so that students and teachers can collaborate and communicate in real time in different locations, realize resource sharing and remote teaching, and provide strong support for educational informatization. Similar technologies include smart education physical environment system (patent announcement number CN208985412U), holographic classroom (CN210402781U), and an interactive system, method and terminal for infrared writing as recording and broadcasting screen (patent publication number CN117596351A).

[0004] However, the existing smart blackboard can realize the electronicization of handwriting, the display and remote sharing of digital teaching resources, but the two are generally used as independent functions. When physical virtual simulation resources are applied, the existing technology cannot meet the needs of teachers to edit resources. For example, the CN208985412U patent uses a holographic blackboard including a 3D display screen and an electronic whiteboard, but the 3D display screen is only used for 2D / 3D virtual simulation resource display, and the electronic whiteboard is only used as an auxiliary device for writing and drawing. The playback and demonstration of virtual simulation resources are not integrated with the electronic whiteboard function, and users cannot annotate and modify virtual resources in real time. Summary of the invention

[0005] The present invention provides a virtual interactive physics teaching method, system and readable storage medium, which can at least solve the problem that the electronic whiteboard is only used as an auxiliary device for writing and drawing, the playback and demonstration of virtual simulation resources are not integrated with the electronic whiteboard function, and the user cannot annotate and modify the virtual resources in real time.

[0006] The technical solution provided by the present invention is as follows: On the one hand, a virtual interactive physics teaching method is provided, the method comprising: Obtaining a point data set of handwriting transmitted by the display screen; Acquire first point data of the blackboard position, map the first point data to a display screen displaying virtual resources, and obtain second point data mapped on the display screen displaying virtual resources; Determine a location range for processing the virtual resource based on the second point data; The virtual resources are processed within a determined location range based on the point data set.

[0007] In an optional implementation, obtaining a point data set of handwriting transmitted by a display screen includes: Acquire handwriting direction data, handwriting size data and handwriting content data of the handwriting transmitted by the display screen; The handwriting direction data, handwriting size data and handwriting content data are used as the point data set.

[0008] In an optional implementation, obtaining a point data set of handwriting transmitted by a display screen further includes: Get the attribute data of the handwriting transmitted by the display screen.

[0009] In an optional implementation, after obtaining the point data set of the handwriting transmitted by the display screen, the method further includes: Determining the processing type of the handwriting according to the handwriting direction data, the handwriting size data and the handwriting content data; The processing type of the handwriting includes a first processing type and a second processing type. The first processing type is to modify or edit the original virtual resource, and the second processing type is to generate a new virtual resource.

[0010] In an optional implementation, processing the virtual resources in a determined location range based on the point data set includes: The point data in the point data set are mapped onto a display screen for displaying virtual resources, and the virtual resources are processed on the display screen for displaying virtual resources in a one-to-one ratio.

[0011] In an optional implementation, processing the virtual resources in a determined location range based on the point data set further includes: Use the toolbar in the display showing the virtual resource to work with the virtual resource, and The virtual resources are processed based on the blackboard.

[0012] In an optional implementation, the method further includes: recording the processed virtual resources, and replaying and remotely sharing the recorded virtual resources.

[0013] On the other hand, a virtual interactive physics teaching system is provided, the virtual interactive physics teaching system comprising: A first acquisition unit, used to acquire a point data set of handwriting transmitted by the display screen; A second acquisition unit is used to acquire first point position data of the blackboard position, map the first point position data to a display screen displaying virtual resources, and obtain second point position data mapped on the display screen displaying virtual resources; A position determination unit, configured to determine a position range for processing virtual resources based on the second point data; A processing unit is used to process the virtual resources in a determined position range based on the point data set.

[0014] In an optional implementation, it further includes a display unit, which is used for writing on a blackboard and displaying virtual resources.

[0015] In yet another aspect, a scale storage medium is provided, on which a program is stored, and the program is used to execute any of the virtual interactive physics teaching methods described above.

[0016] The method provided by the embodiment of the present invention has at least the following beneficial effects: The virtual interactive physics teaching method and system provided by the embodiment of the present invention are based on the existing smart blackboard (the blackboard in the present invention), combined with the teaching characteristics of traditional blackboard writing, and can use the software and hardware tools of the smart blackboard to modify and annotate pre-made physical simulation resource courseware (virtual resources, such as Matter.js courseware), helping teachers to flexibly use virtual physics experiment resources to carry out teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components throughout the exemplary embodiments of the present disclosure.

[0018] Figure 1 A schematic flow chart of a virtual interactive physics teaching method is shown.

[0019] Figure 2 A structural block diagram of a virtual interactive physics teaching system is shown.

[0020] Figure 3 A schematic diagram of the working principle of a virtual interactive physics teaching system is shown. DETAILED DESCRIPTION

[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0022] As used herein, the term "including" and its variations mean open inclusion, i.e., "including but not limited to". Unless otherwise stated, the term "or" means "and / or". The term "based on" means "based at least in part on". The terms "an example embodiment" and "an embodiment" mean "at least one example embodiment". The term "another embodiment" means "at least one additional embodiment". The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0023] The method and system provided by the embodiments of the present invention can solve the problem of combining virtual physics experiment teaching with smart blackboard applications. At present, virtual physics experiment teaching uses electronic blackboards or whiteboards as separate writing tools, which are not deeply integrated with virtual experiment resources. Teachers cannot use electronic blackboards or whiteboards as input tools according to classroom teaching needs to edit, annotate or modify virtual resources. The method and system provided by the embodiments of the present invention can support teachers to edit, annotate or modify virtual resources in real time through electronic blackboards, thereby improving the flexibility of virtual experiment teaching resource applications.

[0024] The application scenarios of the method and system provided by the embodiments of the present invention may include the following scenarios: when teaching high school physics offline and online, teachers can display the prepared virtual interactive physics experiment resources through the display screen of the smart blackboard (the blackboard of the present invention); the smart blackboard can be used for chalk writing, and the display screen will capture the writing signal to edit and modify the virtual interactive experiment resources; the content modified by the teacher in real time is synchronously displayed on the display screen and transmitted to the student end of remote teaching, and online and offline teaching are carried out synchronously. The method and system of the present invention will be further explained and illustrated through optional embodiments below.

[0025] See also Figure 1 On the one hand, the present invention provides a virtual interactive physics teaching method, the method comprising: step S101, step S102, step S103 and step S104.

[0026] Step S101, obtaining a point data set of handwriting transmitted by a display screen.

[0027] Step S102: Acquire first point data of the blackboard position, map the first point data to a display screen for displaying virtual resources, and obtain second point data mapped on the display screen for displaying virtual resources.

[0028] Step S103: determining a location range for processing the virtual resource based on the second point data.

[0029] Step S104: Process the virtual resources in the determined location range based on the point data set.

[0030] In an optional implementation, step S101 acquires a point data set of handwriting transmitted by the display screen, including: acquiring handwriting direction data, handwriting size data, and handwriting content data of the handwriting transmitted by the display screen; The handwriting direction data, handwriting size data and handwriting content data are used as point data sets.

[0031] It is understandable that when a user writes on a blackboard (which may include an electronic blackboard or an electronic whiteboard, etc.), the user may write text, draw graphics, insert graphics, insert text, or insert punctuation marks, etc. The embodiment of the present invention captures the handwriting to form a point data set.

[0032] The method provided by the embodiment of the present invention also includes a virtual interactive physical experiment resource display step. Exemplarily, the user (teacher) clicks on the display screen of the smart blackboard (the blackboard of the present invention) to open the pre-made virtual interactive physical experiment resources (the virtual resources of the present invention), and the display screen displays the virtual interactive physical experiment resources, such as simulated object collision, movement, buoyancy effect, etc. The teacher can touch the display screen or use a stylus to operate the experimental resource interaction and demonstrate the virtual experimental resources.

[0033] In an optional implementation, obtaining a point data set of handwriting transmitted by a display screen further includes: obtaining attribute data of handwriting transmitted by the display screen.

[0034] It is understandable that when editing virtual resources, users can add new virtual resources, for example, they can draw graphics on pre-made virtual resources. When drawing graphics, they can add the attributes of the graphics, such as object material, mass, density and other attribute data. Exemplarily, virtual resources can also be other virtual resources such as chemistry and biology. That is, the method provided in the embodiment of the present invention can also be processed for the above virtual resources. Including but not limited to the modification, editing and annotation of virtual resources such as physics, chemistry and biology.

[0035] Specific usage scenarios, for example, teachers want to draw and add an object in the virtual resource due to teaching needs. They can use chalk and blackboard ruler to draw an object on the blackboard and set the object properties through software tools. The system provided by the embodiment of the present invention captures the handwriting signal of the blackboard, draws and adds the same object in the virtual resource, and realizes the editing of the virtual resource. The display screen will display the edited resource in real time, and can simulate scenes such as physical collision and movement.

[0036] In an optional implementation, after obtaining the point data set of the handwriting transmitted by the display screen, it also includes: judging the processing type of the handwriting according to the handwriting direction data, the handwriting size data and the handwriting content data; The processing types of handwriting include a first processing type and a second processing type. The first processing type is to modify or edit the original virtual resource, and the second processing type is to generate a new virtual resource.

[0037] Step S102: Acquire first point data of the blackboard position, map the first point data to a display screen for displaying virtual resources, and obtain second point data mapped on the display screen for displaying virtual resources.

[0038] The first point data may be the position data of a blackboard (electronic blackboard or whiteboard or smart blackboard), which may include the size of the blackboard, such as length data. The second point data may be the position data mapped on the display screen displaying the virtual resource, that is, the position of the blackboard is mapped one-to-one with the position of the display screen displaying the virtual resource, so as to ensure the accuracy of modifying or editing the virtual resource through the blackboard.

[0039] Step S103: Determine the position range for processing the virtual resource based on the second point data, that is, process the virtual resource within the range formed by the second point data.

[0040] Step S104: Process the virtual resources in the determined location range based on the point data set.

[0041] In an optional implementation, an embodiment of the present invention may compare the acquired handwriting direction data, handwriting size data and handwriting content data with the original direction, original size and original content of the virtual resource, and determine whether the processing type of the written handwriting is the first processing type or the second processing type based on the comparison result.

[0042] Furthermore, the acquired handwriting direction data is compared with the original direction of the virtual resource. When the two handwriting directions have the same correlation factor or the same overlapping segment, the processing type corresponding to the handwriting direction is used as the first processing type, that is, the handwriting is a modification or editing of the virtual resource. If the two handwriting directions do not have the same correlation factor and the same overlapping segment, the processing type corresponding to the handwriting direction is used as the second processing type, and the handwriting is to establish or generate a new virtual resource.

[0043] Alternatively, the acquired handwriting content data is compared with the original handwriting content of the virtual resource. When the two handwriting contents have the same association factors or the same overlapping segments, the processing type corresponding to the handwriting content is used as the first processing type, that is, the handwriting is a modification or editing of the virtual resource. If the two handwriting contents do not have the same association factors and do not have the same overlapping segments, the processing type corresponding to the handwriting content is used as the second processing type, and the handwriting is to establish or generate a new virtual resource.

[0044] The processing of virtual resources in the embodiment of the present invention includes modifying or editing the original virtual resources. For example, the properties of the objects in the original virtual resources, such as mass, density, etc., are modified. New virtual resources are generated, such as adding a new column, and the properties of the column, such as size, density, or mass, etc., are changed.

[0045] In an optional embodiment, virtual resources are processed in a determined location range based on a point data set, including: mapping point data in the point data set to a display screen that displays virtual resources, and processing the virtual resources on the display screen that displays virtual resources at a one-to-one ratio.

[0046] In an optional implementation, processing the virtual resources in a determined location range based on the point data set also includes: processing the virtual resources using a toolbar in a display screen displaying the virtual resources, and processing the virtual resources based on a blackboard.

[0047] The method provided in the embodiment of the present invention includes two ways to process virtual resources. One is to process the virtual resources through a toolbar in a display screen that displays the virtual resources, and the other is to process the virtual resources based on a blackboard.

[0048] For example, teachers can use the software tools in the toolbar of the display screen, including basic tools such as pencils, shapes, arrows, straight lines, erasers, rulers, set squares, etc., as well as property options such as object materials, mass, density, etc. Teachers can touch and click or use a stylus pen to operate on the display screen to use software tools to edit virtual interactive physics experiment resources.

[0049] The specific implementation steps are as follows: the user (teacher, etc.) edits the virtual interactive resource, and the system provided by the embodiment of the present invention will record each specific operation of the user, and modify or add the corresponding code in the virtual resource. The edited resource can realize the simulation of physical collision, movement and other scenes, and display it in real time on the display screen. For example, the teacher can click the attribute option in the toolbar, set the material and mass of the object, and click to add the object. The system provided by the embodiment of the present invention will add an object (corresponding to the newly added block) to the initial code of the virtual interactive resource, write the material and mass attribute fields according to the attributes selected by the user, and after the code is edited, the newly added block will be displayed on the display screen and the scene of simulated object collision will be displayed.

[0050] In an optional implementation, the method further includes: remotely sharing the processed virtual resources.

[0051] The display screen will display the edited experimental resources in real time and share the screen remotely. The display screen will display the virtual interactive physical experiment resources edited by the teacher using hardware or software in real time, and remotely share the display screen image with students learning online, realizing the combination of offline and online teaching.

[0052] The present invention is based on a smart blackboard device and combines the characteristics of traditional blackboard teaching. Users (teachers) can flexibly edit virtual resources according to teaching needs and remotely share demonstration images, thereby meeting both online and offline smart teaching needs.

[0053] On the other hand, a virtual interactive physics teaching system is also provided, the virtual interactive physics teaching system comprising: a first acquisition unit, used to acquire a point data set of handwriting transmitted by a display screen.

[0054] The second acquisition unit is used to acquire first point position data of the blackboard position, map the first point position data to the display screen displaying the virtual resources, and obtain second point position data mapped on the display screen displaying the virtual resources.

[0055] The position determination unit is used to determine a position range for processing the virtual resource based on the second point data.

[0056] The processing unit is used to process the virtual resources in a determined location range based on the point data set.

[0057] For example, see Figure 2 The virtual interactive physics teaching system provided by the embodiment of the present invention may include two parts, one of which is Figure 2The smart blackboard (blackboard of the present invention) is partially virtual interactive physical experiment resources (virtual resources of the present invention). The hardware tools of the smart blackboard include a blackboard, and the software tools include a display screen. The virtual interactive physical experiment resources include pre-made resources (virtual resources of the present invention) and edited resources obtained by processing (editing or modifying) the pre-made resources.

[0058] In an optional embodiment, a display unit is further included, and the display unit is used for blackboard writing and displaying virtual resources. The embodiment of the present invention combines a blackboard (smart blackboard, electronic blackboard or whiteboard) with a display screen for displaying virtual resources, and can realize online editing and modification of virtual resources.

[0059] See also Figure 3 , Figure 3 The principle of the virtual interactive physics teaching system provided by the embodiment of the present invention uses an intuitive principle diagram. As an example, when teaching offline, the user (teacher) in the embodiment of the present invention can write on the blackboard and use the blackboard handwriting to edit resources. Furthermore, the teacher can edit and modify objects through the toolbar in the software tool of the blackboard, such as Figure 3 The rotation direction of the circular object placed on the rectangle in the figure, etc. During online teaching, the modified virtual resources can be transmitted to the computer at the other end through remote transmission (wireless or other transmission methods) for remote teaching.

[0060] On the other hand, a readable storage medium is also provided, on which a program is stored, and the program is used to execute any of the above-mentioned virtual interactive physics teaching methods.

[0061] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A virtual interactive physics teaching method, characterized in that: The method comprises: Obtaining a point data set of handwriting transmitted by the display screen; Acquire first point data of the blackboard position, map the first point data to a display screen displaying virtual resources, and obtain second point data mapped on the display screen displaying virtual resources; Determine a location range for processing the virtual resource based on the second point data; The virtual resources are processed within a determined location range based on the point data set.

2. The virtual interactive physics teaching method according to claim 1, characterized in that: Obtain the point data set of the handwriting transmitted by the display screen, including: Acquire handwriting direction data, handwriting size data and handwriting content data of the handwriting transmitted by the display screen; The handwriting direction data, handwriting size data and handwriting content data are used as the point data set.

3. The virtual interactive physics teaching method according to claim 1, characterized in that: Obtaining the point data set of the handwriting transmitted by the display screen, including: Get the attribute data of the handwriting transmitted by the display screen.

4. The virtual interactive physics teaching method according to claim 2, characterized in that: After obtaining the point data set of the handwriting transmitted by the display screen, it also includes: Determining the processing type of the handwriting according to the handwriting direction data, the handwriting size data and the handwriting content data; The processing type of the handwriting includes a first processing type and a second processing type. The first processing type is to modify or edit the original virtual resource, and the second processing type is to generate a new virtual resource.

5. The virtual interactive physics teaching method according to claim 1, characterized in that: Processing the virtual resources in a determined location range based on the point data set includes: The point data in the point data set are mapped onto a display screen for displaying virtual resources, and the virtual resources are processed on the display screen for displaying virtual resources in a one-to-one ratio.

6. The virtual interactive physics teaching method according to claim 5, characterized in that: Processing the virtual resources in the determined location range based on the point data set also includes: Use the toolbar in the display showing the virtual resource to work with the virtual resource, and The virtual resources are processed based on the blackboard.

7. The virtual interactive physics teaching method according to claim 1, characterized in that: Also includes: The processed virtual resources are recorded, and replayed and remotely shared based on the recorded virtual resources.

8. A virtual interactive physics teaching system, characterized in that: The virtual interactive physics teaching system comprises: A first acquisition unit, used to acquire a point data set of handwriting transmitted by the display screen; A second acquisition unit is used to acquire first point position data of the blackboard position, map the first point position data to a display screen displaying virtual resources, and obtain second point position data mapped on the display screen displaying virtual resources; A position determination unit, configured to determine a position range for processing virtual resources based on the second point data; A processing unit is used to process the virtual resources in a determined position range based on the point data set.

9. The virtual interactive physics teaching system according to claim 8, characterized in that: It also includes a display unit, which is used for blackboard writing and displaying virtual resources.

10. A readable storage medium, characterized in that: The readable storage medium stores a program, and the program is used to execute the virtual interactive physics teaching method according to any one of claims 1-7.

Images