Virtual 3D imaging system with inductive physical object and method thereof

Abstract

A virtual 3D imaging system with inductive physical object and method thereof is disclosed. By using a sensor of a handheld box-type stereoscopic display device to detect an identification component of a physical object, so as to obtain an object identification code for comparison with an image identification code. When a match is found, a stereoscopic image corresponding to the matched image identification code is loaded, and based on the loaded stereoscopic image, a virtual stereoscopic image is generated and displayed within the handheld box-type stereoscopic display device. The mechanism is help to improve the interactivity and diversity of virtual stereoscopic imaging.

Claims

1. A virtual stereoscopic imaging system with sensing capabilities for physical objects, allowing the sensing of a physical object, the physical object having a sensing identification element, the system comprising: a handheld box-type stereoscopic display device, the handheld box-type stereoscopic display device comprising: a sensor for sensing the identification element of the physical object to obtain an object identification code; and a storage unit for storing a stereoscopic image corresponding to the physical object, wherein... The stereoscopic image corresponds to an image identification code; a loading unit, connected to the storage unit and the sensor, is used to compare the obtained object identification code with the image identification code, and when the comparison matches, load the stereoscopic image corresponding to the matching image identification code; and an imaging unit, connected to the loading unit, is used to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously display the generated virtual stereoscopic image in the handheld box-type stereoscopic display device.

2. As in claim 1, a virtual stereoscopic imaging system with sensing physical objects, wherein the object identification code includes multiple object categories, including body, clothing, accessories, weapons and armor; when the sensor senses more than one physical object and obtains multiple object identification codes, the loading unit first loads the corresponding stereoscopic image, and then the imaging unit executes a paper doll (Avatar) system to integrate the loaded stereoscopic images into the virtual stereoscopic image for display in the handheld box-type stereoscopic display device; the paper doll system is selected from at least one of a model splicing, a multi-view reconstruction, a 3D rendering compositing and a 3D hierarchical compositing to integrate the loaded stereoscopic images.

3. A virtual stereoscopic imaging system with sensing physical objects as described in claim 2, wherein the stereoscopic image corresponds to a prompt word, and when the loading unit loads the stereoscopic image, the corresponding prompt word is loaded simultaneously, so that the paper doll system generates the virtual stereoscopic image based on the loaded prompt word through a text-to-video generative AI model, wherein the generative AI model is pre-trained with the stereoscopic image and its corresponding prompt word.

4. A virtual stereoscopic imaging system for sensing physical objects as claimed in claim 1, wherein the sensor includes a wireless sensor and an optical sensor, the identification element includes a smart tag and a two-dimensional barcode, the wireless sensor is used to sense the smart tag embedded in the physical object to obtain the object identification code, and the optical sensor is used to scan the two-dimensional barcode disposed on the surface of the physical object to obtain the object identification code.

5. A virtual stereoscopic imaging system with a sensing entity, the system comprising: a sensing object having a sensing identification element; a handheld box-type stereoscopic display device, the handheld box-type stereoscopic display device comprising: a sensor for sensing the identification element of the sensing object to obtain an object identification code; and a smart device comprising: a network unit for connecting to a network and transmitting data via a wireless transmission element; and a storage unit connected to the network unit for storing a stereoscopic image corresponding to the sensing object, wherein... The stereoscopic image corresponds to an image identification code and is updated via the network unit; a loading unit, connected to the storage unit and the sensor, is used to compare the obtained object identification code with the image identification code, and when the comparison matches, load the stereoscopic image corresponding to the matching image identification code; and an imaging unit, connected to the loading unit, is used to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously display the generated virtual stereoscopic image in the handheld box-type stereoscopic display device.

6. A virtual stereoscopic imaging method with sensing capabilities for physical objects, executed by a handheld box-type stereoscopic display device, wherein the handheld box-type stereoscopic display device allows sensing of a physical object, the physical object having a sensing identification element, the steps of which include: A stereoscopic image corresponding to the physical object is pre-stored in the handheld box-type stereoscopic display device, wherein the stereoscopic image corresponds to an image identification code; the handheld box-type stereoscopic display device senses the identification element of the physical object through a sensor to obtain an object identification code; the handheld box-type stereoscopic display device compares the obtained object identification code with the image identification code, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identification code; and the handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and displays the generated virtual stereoscopic image in the handheld box-type stereoscopic display device.

7. The virtual stereoscopic imaging method for sensing physical objects as described in claim 6, wherein the object identification code includes multiple object categories, including body, clothing, accessories, weapons and armor; when the sensor senses more than one physical object and obtains multiple object identification codes, the handheld box-type stereoscopic display device first loads the corresponding stereoscopic image, and then executes a paper doll (Avatar) system to integrate the loaded stereoscopic images into the virtual stereoscopic image for display in the handheld box-type stereoscopic display device; the paper doll system is selected from at least one of a model splicing, a multi-view reconstruction, a 3D rendering compositing and a 3D hierarchical compositing to integrate the loaded stereoscopic images.

8. The virtual stereoscopic imaging method with sensing physical objects as described in claim 7, wherein the stereoscopic image corresponds to a prompt word, and when the handheld box-type stereoscopic display device loads the stereoscopic image, the corresponding prompt word is loaded simultaneously, so that the paper doll system generates the virtual stereoscopic image based on the loaded prompt word through a text-to-video generative AI model, wherein the generative AI model is pre-trained with the stereoscopic image and its corresponding prompt word.

9. The virtual stereoscopic imaging method for sensing physical objects as claimed in claim 6, wherein the sensor includes a wireless sensor and an optical sensor, the identification element includes a smart tag and a two-dimensional barcode, the wireless sensor is used to sense the smart tag embedded in the physical object to obtain the object identification code, and the optical sensor is used to scan the two-dimensional barcode disposed on the surface of the physical object to obtain the object identification code.

10. A virtual stereoscopic imaging method with a sensing object, applied in an environment having a sensing object and a handheld box-type stereoscopic display device, the steps of which include: The handheld box-type stereoscopic display device connects to a network via a wireless transmission element to download and store a stereoscopic image corresponding to the sensed object, wherein the stereoscopic image corresponds to an image identification code; the handheld box-type stereoscopic display device senses an identification element of the sensed object through a sensor to obtain an object identification code; the handheld box-type stereoscopic display device compares the obtained object identification code with the image identification code, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identification code; and the handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

Images