Method and system for enhancing reality based on mobile phone side and electronic whiteboard

Abstract

The invention provides a method and a system for enhancing a reality based on a mobile phone side and an electronic whiteboard. The method comprises the following steps: a 3D model database is respectively preset at the mobile phone side and the electronic whiteboard side; the mobile phone side obtains a to-be-displayed 3D picture; the mobile phone side obtains a 3D model matched with the picture and an identity of the 3D model from the 3D model databases; the mobile phone side obtains a camera real-time image data; the real-time image data and the identity of the 3D model are sent to the electronic whiteboard side; the electronic whiteboard side obtains the corresponding 3D model from the 3D model databases according to the identity of the 3D model; and the electronic whiteboard side overlaps the obtained 3D model to a camera image to display. By interaction between the mobile phone side and the electronic whiteboard side, the reality enhancement effect at the electronic whiteboard side is realized; and meanwhile, the mobile phone side only needs to send the identity of the 3D model to the electronic whiteboard side, so the data transmission quantity is greatly reduced.

Description

technical field

[0001] The invention relates to augmented reality technology, in particular to an augmented reality method and system based on a mobile phone terminal and an electronic whiteboard. Background technique

[0002] At present, AR technology has been applied to the children's market such as toys, but it is rarely applied to the field of education, and it is mainly used in mobile phones, and does not support the use of hardware systems such as electronic whiteboards.

[0003] For example, the Chinese patent with the publication number CN 105608934A discloses an AR children's early childhood education fairy tale stage play system, including a stage model and physical equipment; the physical equipment includes a camera, an identification module, a synthesis module, a processing module, a display device and Memory; the camera is used to capture the image of the stage model, and the recognition module is used to bind the stage model image with the tag information of th...

Examples

Embodiment 1

[0085] Please refer to image 3 , Embodiment 1 of the present invention is:

[0086] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, comprising:

[0087] Preset 3D model databases on the mobile terminal and electronic whiteboard respectively;

[0088] The mobile terminal obtains the picture to be displayed in 3D; for example, if the picture A needs to be displayed in 3D, scan the picture A through the mobile terminal;

[0089] The mobile terminal obtains the 3D model matched with the picture from the 3D model database, and the identification of the 3D model; specifically, it includes: identifying the characteristic information of the picture; combining the characteristic information with the 3D model database of the mobile terminal Compare the 3D models to obtain the 3D model matching the specified picture; and obtain the identification of the 3D model; the identification can be the ID number of the 3D model;

[0090] The mobile te...

Embodiment 2

[0094] Please refer to Figure 4 , the second embodiment of the present invention is:

[0095] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, which differs from the first embodiment above in that:

[0096] The electronic whiteboard end superimposes the obtained 3D model on the real-time image of the camera for display, and then further includes:

[0097] The mobile terminal obtains an operation instruction for the 3D model; for example, sliding the screen of the mobile terminal to control the rotation of the 3D model;

[0098] Send the operation instruction to the electronic whiteboard; for example, send the control instruction to the 3D model to the electronic whiteboard;

[0099] The electronic whiteboard terminal controls the acquired 3D model to perform corresponding operations according to the control instruction; realizes synchronous control of rotation of the 3D model on the electronic whiteboard.

Embodiment 3

[0100] Please refer to Figure 5 , Embodiment three of the present invention is:

[0101] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, which differs from the above-mentioned embodiments in that:

[0102] The electronic whiteboard end superimposes the obtained 3D model on the real-time image of the camera for display, and then further includes:

[0103] The electronic whiteboard terminal obtains an operation instruction for the 3D model;

[0104] The electronic whiteboard terminal controls the acquired 3D model to perform corresponding operations according to the operation instruction; for example, sliding the screen of the electronic whiteboard terminal controls the rotation of the 3D model displayed on the electronic whiteboard terminal.

[0105] In a preferred embodiment, the manners of controlling the operation of the 3D model displayed on the electronic whiteboard in the above-mentioned second and third embodiments can exist ...

technical field

[0001] The invention relates to augmented reality technology, in particular to an augmented reality method and system based on a mobile phone terminal and an electronic whiteboard. Background technique

[0002] At present, AR technology has been applied to the children's market such as toys, but it is rarely applied to the field of education, and it is mainly used in mobile phones, and does not support the use of hardware systems such as electronic whiteboards.

[0003] For example, the Chinese patent with the publication number CN 105608934A discloses an AR children's early childhood education fairy tale stage play system, including a stage model and physical equipment; the physical equipment includes a camera, an identification module, a synthesis module, a processing module, a display device and Memory; the camera is used to capture the image of the stage model, and the recognition module is used to bind the stage model image with the tag information of th...

Examples

Embodiment 1

[0085] Please refer to image 3 , Embodiment 1 of the present invention is:

[0086] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, comprising:

[0087] Preset 3D model databases on the mobile terminal and electronic whiteboard respectively;

[0088] The mobile terminal obtains the picture to be displayed in 3D; for example, if the picture A needs to be displayed in 3D, scan the picture A through the mobile terminal;

[0089] The mobile terminal obtains the 3D model matched with the picture from the 3D model database, and the identification of the 3D model; specifically, it includes: identifying the characteristic information of the picture; combining the characteristic information with the 3D model database of the mobile terminal Compare the 3D models to obtain the 3D model matching the specified picture; and obtain the identification of the 3D model; the identification can be the ID number of the 3D model;

[0090] The mobile te...

Embodiment 2

[0094] Please refer to Figure 4 , the second embodiment of the present invention is:

[0095] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, which differs from the first embodiment above in that:

[0096] The electronic whiteboard end superimposes the obtained 3D model on the real-time image of the camera for display, and then further includes:

[0097] The mobile terminal obtains an operation instruction for the 3D model; for example, sliding the screen of the mobile terminal to control the rotation of the 3D model;

[0098] Send the operation instruction to the electronic whiteboard; for example, send the control instruction to the 3D model to the electronic whiteboard;

[0099] The electronic whiteboard terminal controls the acquired 3D model to perform corresponding operations according to the control instruction; realizes synchronous control of rotation of the 3D model on the electronic whiteboard.

Embodiment 3

[0100] Please refer to Figure 5 , Embodiment three of the present invention is:

[0101] An augmented reality method based on a mobile phone terminal and an electronic whiteboard, which differs from the above-mentioned embodiments in that:

[0102] The electronic whiteboard end superimposes the obtained 3D model on the real-time image of the camera for display, and then further includes:

[0103] The electronic whiteboard terminal obtains an operation instruction for the 3D model;

[0104] The electronic whiteboard terminal controls the acquired 3D model to perform corresponding operations according to the operation instruction; for example, sliding the screen of the electronic whiteboard terminal controls the rotation of the 3D model displayed on the electronic whiteboard terminal.

[0105] In a preferred embodiment, the manners of controlling the operation of the 3D model displayed on the electronic whiteboard in the above-mentioned second and third embodiments can exist ...

Images