Virtual stereoscopic imaging system with inductive physical object and method thereof

Abstract

A virtual stereoscopic imaging system and method with sensing entity objects is disclosed. The system uses a sensor of a handheld box-type stereoscopic display device to sense the identification element of the entity object to obtain an object identifier, which is then compared with an image identifier. When the comparison matches, a stereoscopic image corresponding to the matching image identifier is loaded, and a virtual stereoscopic image is generated based on the loaded stereoscopic image and displayed in the handheld box-type stereoscopic display device. This system aims to improve the diversity and interactivity of virtual stereoscopic imaging.

Description

Technical Field

[0001] This invention relates to a virtual stereoscopic imaging system and method, and more particularly to a virtual stereoscopic imaging system and method for sensing physical objects. Background Technology

[0002] In recent years, with the popularization and vigorous development of virtual stereoscopic imaging technology, various virtual stereoscopic imaging technologies have sprung up like mushrooms after rain, such as stereoscopic display, holographic imaging, light field display, autostereoscopic display, augmented reality (AR), virtual reality (VR), and so on.

[0003] Generally speaking, the basic principle of virtual stereoscopic imaging technology is to create stereoscopic visual effects by utilizing parallax and binocular vision, or to reconstruct three-dimensional images of objects using optical principles (such as holographic imaging and light field display). However, regardless of the presentation method, viewers are usually passive recipients, meaning they cannot change or interact with the presented results. For example, viewers cannot dynamically adjust or control the presented results, thus exhibiting the problems of insufficient diversity and interactivity in virtual stereoscopic imaging.

[0004] In light of this, some manufacturers have proposed combining gaming technology with control devices such as touchscreens, keyboards, mice, and joysticks, allowing viewers to control and interact with the presented results. However, because this method requires additional control devices, and these devices have varying learning curves, its applicability is quite limited. Therefore, this method is still insufficient to solve the problems of diversity and lack of interactivity in virtual stereoscopic imaging.

[0005] In conclusion, it is clear that existing technologies have long suffered from insufficient diversity and interactivity in virtual stereoscopic imaging. Therefore, it is necessary to propose improved technical methods to address this issue. Summary of the Invention

[0006] This invention discloses a virtual stereoscopic imaging system and method with the ability to sense physical objects.

[0007] First, this invention discloses a virtual stereoscopic imaging system with sensing capabilities for physical objects. The system allows sensing of physical objects, each having a sensing identification element. The system includes a handheld box-type stereoscopic display device. The handheld box-type stereoscopic display device includes a sensor, a storage unit, a loading unit, and an imaging unit. The sensor senses the identification element of the physical object to obtain an object identifier. The storage unit stores a stereoscopic image corresponding to the physical object, wherein the stereoscopic image corresponds to an image identifier. The loading unit, connected to the storage unit and the sensor, compares the obtained object identifier with the image identifier, and loads the stereoscopic image corresponding to the matching image identifier when the comparison matches. The imaging unit, connected to the loading unit, generates a virtual stereoscopic image based on the loaded stereoscopic image and displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

[0008] Next, this invention discloses a virtual stereoscopic imaging system with a sensing entity object. This system includes: a sensing object and a handheld box-type stereoscopic display device. The sensing object has a sensing identification element; the handheld box-type stereoscopic display device includes: a sensor and an intelligent device. The sensor is used to sense the identification element of the sensing object to obtain an object identifier. The intelligent device includes: a network unit, a storage unit, a loading unit, and an imaging unit. The network unit is used to connect to a network and transmit data via a wireless transmission element; the storage unit is connected to the network unit and is used to store stereoscopic images corresponding to the sensing object, the stereoscopic images corresponding to image identifiers, and to be updated via the network unit; the loading unit is connected to the storage unit and the sensor, and is used to compare the obtained object identifier with the image identifier, and when the comparison matches, load the stereoscopic image corresponding to the matching image identifier; and the imaging unit is connected to the loading unit and is used to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously display the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

[0009] In addition, this invention also discloses a virtual stereoscopic imaging method with sensing entity objects, executed by a handheld box-type stereoscopic display device. The handheld box-type stereoscopic display device allows sensing entity objects, and the entity objects have sensing identification elements. The steps include: pre-storing a stereoscopic image corresponding to the entity object in the handheld box-type stereoscopic display device, wherein the stereoscopic image corresponds to an image identifier; the handheld box-type stereoscopic display device sensing the identification element of the entity object through a sensor to obtain an object identifier; the handheld box-type stereoscopic display device comparing the obtained object identifier with the image identifier, and when the comparison matches, loading a stereoscopic image corresponding to the matching image identifier; and the handheld box-type stereoscopic display device generating a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displaying the generated virtual stereoscopic image in the handheld box-type stereoscopic display device.

[0010] Next, this invention also discloses a virtual stereoscopic imaging method with a sensing entity object, applied in an environment with a sensing object and a handheld box-type stereoscopic display device. The steps include: the handheld box-type stereoscopic display device connecting to a network via a wireless transmission element to download and store a stereoscopic image corresponding to the sensing object, wherein the stereoscopic image corresponds to an image identifier; the handheld box-type stereoscopic display device sensing an identification element of the sensing object through a sensor to obtain an object identifier; the handheld box-type stereoscopic display device comparing the obtained object identifier with the image identifier, and when the comparison matches, loading a stereoscopic image corresponding to the matching image identifier; and the handheld box-type stereoscopic display device generating a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displaying the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

[0011] The system and method disclosed in this invention are as described above. The difference between this invention and the prior art is that this invention uses a sensor in a handheld box-type stereoscopic display device to sense the identification element of the entity object to obtain an object identifier, so as to compare it with an image identifier. When the comparison matches, a stereoscopic image corresponding to the matching image identifier is loaded, and then a virtual stereoscopic image is generated based on the loaded stereoscopic image to be displayed in the handheld box-type stereoscopic display device.

[0012] Through the above-mentioned technical means, the present invention can achieve the technical effect of improving the diversity and interactivity of virtual stereoscopic imaging. Attached Figure Description

[0013] Figure 1 This is a system block diagram of the virtual stereoscopic imaging system with sensing physical objects according to the present invention.

[0014] Figure 2This is another system block diagram of the virtual stereoscopic imaging system with sensing physical objects according to the present invention.

[0015] Figure 3 This is a flowchart of the virtual stereoscopic imaging method for sensing physical objects according to the present invention.

[0016] Figure 4 This is another flowchart of the virtual stereoscopic imaging method with sensing entity objects according to the present invention.

[0017] Figure 5 A schematic diagram illustrating the application of this invention to sense physical objects and display virtual stereoscopic images.

[0018] Figure 6 This is an exploded perspective view of the handheld box-type stereoscopic display device of the present invention.

[0019] Figure 7 This is a schematic diagram of the hardware architecture of the intelligent device of the present invention.

[0020] The annotations in the attached figures are explained as follows:

[0021] 10: Handheld box-type 3D display device

[0022] 11: Outer shell

[0023] 12: Device board

[0024] 13: Embedded glass groove

[0025] 14: Monitor

[0026] 15: Front Cover

[0027] 100: Entity Object

[0028] 110: Handheld box-type 3D display device

[0029] 111: Sensor

[0030] 112: Storage unit

[0031] 113: Loading Unit

[0032] 114: Imaging Unit

[0033] 120: Sensible Objects

[0034] 121: Handheld box-type stereoscopic display device

[0035] 122: Sensor

[0036] 123: Intelligent devices

[0037] 124: Network Unit

[0038] 125: Storage unit

[0039] 126: Loading Unit

[0040] 127: Imaging Unit

[0041] 131: Connecting slot

[0042] 151: Transparent Touch Panel

[0043] 153: Keypad

[0044] 300: Cartoon dolls

[0045] 310: Handheld box-type stereoscopic display device

[0046] 311: Sensor

[0047] 320: Virtual Stereo Imaging

[0048] 700: Intelligent Device

[0049] 711: Hardware Processor

[0050] 712: Memory

[0051] 713: Network Interface Device

[0052] 714: Network

[0053] 715: Display device

[0054] 716: Graphical User Interface

[0055] 717: Input device

[0056] 718: Data storage device

[0057] 719: Wireless Radio Frequency Transceiver

[0058] 720: Bus

[0059] Step 211: Pre-store stereoscopic images corresponding to the physical object in the handheld box-type stereoscopic display device, wherein the stereoscopic images correspond to image identifiers.

[0060] Step 212: The handheld box-type stereoscopic display device obtains the object identifier by sensing the recognition element of the physical object through a sensor.

[0061] Step 213: The handheld box-type stereoscopic display device compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier.

[0062] Step 214: The handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

[0063] Step 221: The handheld box-type stereoscopic display device connects to the network via a wireless transmission element to download and store stereoscopic images corresponding to the sensed object, wherein the stereoscopic images correspond to image identifiers.

[0064] Step 222: The handheld box-type stereoscopic display device obtains an object identifier by sensing the identification element of the sensing object through a sensor.

[0065] Step 223: The handheld box-type stereoscopic display device compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier.

[0066] Step 224: The handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device. Detailed Implementation

[0067] The following will describe in detail the implementation of the present invention with reference to the accompanying drawings and embodiments, thereby enabling a full understanding of how the present invention uses technical means to solve technical problems and achieve technical effects, and allowing for its implementation.

[0068] Please refer to the following first. Figure 1 , Figure 1This is a system block diagram of a virtual stereoscopic imaging system for sensing physical objects according to the present invention. The system allows sensing of a physical object 100, which has a sensed identification element. The system includes a handheld box-type stereoscopic display device 110. The handheld box-type stereoscopic display device 110 includes a sensor 111, a storage unit 112, a loading unit 113, and an imaging unit 114. The sensor 111 is used to sense the identification element of the physical object 100 to obtain an object identifier. In practical implementation, the sensor 111 may include a wireless sensor and an optical sensor. The identification element includes a smart tag, such as a radio frequency identification tag (RFID tag) or a two-dimensional barcode. The wireless sensor is used to sense the smart tag embedded in the physical object 100 to obtain the object identifier; the optical sensor (e.g., an infrared scanner) is used to scan the two-dimensional barcode set on the surface of the physical object 100 to obtain the object identifier. In addition, the object identifier can include multiple object categories, such as the body, clothing, accessories, weapons, and armor. In practice, different characters can be used to represent different object categories, for example, "A" for the body, "B" for clothing, "C" for accessories, and so on. At the same time, different numbers are added after the characters to represent different entity objects 100 in the same object category. For example, object identifiers "A001" and "A002" respectively represent different entity objects in the same object category (i.e., the body). When the sensor 111 senses more than one entity object 100 and obtains multiple object identifiers, the corresponding stereoscopic image will first be loaded by the loading unit 113, and then the imaging unit 114 will execute the paper doll (Avatar) system to integrate the loaded stereoscopic images into a virtual stereoscopic image for display in the handheld box-type stereoscopic display device 110. The paper doll system is at least one of the following: self-model splicing, multi-view reconstruction, 3D rendering synthesis, and 3D hierarchical synthesis, used to integrate the loaded stereoscopic images to make them a virtual stereoscopic image. In addition, the stereoscopic image can correspond to the prompt words. When the handheld box-type stereoscopic display device 110 loads the stereoscopic image, the corresponding prompt words are loaded simultaneously, so that the paper doll system can generate virtual stereoscopic images based on the loaded prompt words through a text-to-video generative AI model. It should be noted that this generative AI model will be pre-trained with the stereoscopic image and its corresponding prompt words so that it can generate corresponding images based on text.

[0069] Storage unit 112 is used to store stereoscopic images corresponding to the physical object 100, wherein the stereoscopic image corresponds to an image identifier. In practice, storage unit 112 can be implemented using a disk, optical disk, non-volatile memory, relational database, or NoSQL database. Taking the physical object 100 as a physical cartoon doll as an example, the corresponding stereoscopic image is a stereoscopic image of this cartoon doll.

[0070] The loading unit 113 is connected to the storage unit 112 and the sensor 111. It compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier. For example, assuming the object identifier is "A001", the loading unit 113 will load the stereoscopic image with the same image identifier "A001". When multiple object identifiers are obtained simultaneously, the loading unit 113 will also load the corresponding multiple stereoscopic images. For example, if the object identifiers obtained simultaneously are "A001" and "A002", then the stereoscopic image with image identifier "A001" and the stereoscopic image with image identifier "A002" will be loaded simultaneously.

[0071] Imaging unit 114 is connected to loading unit 113 to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device 110. In practice, the handheld box-type stereoscopic display device 110 can be a holographic projection device, the structure of which and the method of generating virtual stereoscopic images will be described in detail later with reference to the accompanying drawings.

[0072] Next, as Figure 2 The meaning is shown. Figure 2 This is another system block diagram of the virtual stereoscopic imaging system with sensing entity objects according to the present invention. This system includes: a sensing object 120 and a handheld box-type stereoscopic display device 121. The sensing object 120 has a sensing identification element; the handheld box-type stereoscopic display device 121 includes: a sensor 122 and an intelligent device 123. The sensor 122 is used to sense the identification element of the sensing object 120 to obtain an object identifier; the intelligent device 123 includes: a network unit 124, a storage unit 125, a loading unit 126, and an imaging unit 127. The network unit 124 is used to connect to a network and transmit data via a wireless transmission element. In practical implementation, the network unit 124 can use technologies such as Wi-Fi, Zigbee, LoRa (Long Range), or similar technologies for wireless transmission.

[0073] Storage unit 125 is connected to network unit 124 for storing stereoscopic images corresponding to the sensed object 120, wherein the stereoscopic images correspond to image identifiers and are updated via network unit 124. In practice, storage unit 125 can be implemented using a disk, optical disk, non-volatile memory, relational database, or NoSQL database.

[0074] The loading unit 126 is connected to the storage unit 125 and the sensor 122, and is used to compare the obtained object identifier with the image identifier. When the comparison matches, the stereoscopic image corresponding to the matching image identifier is loaded. In actual implementation, the loading unit 126 is the same as the aforementioned loading unit 113, so it will not be described again here.

[0075] Imaging unit 127 is connected to loading unit 126 to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displays the generated virtual stereoscopic image within handheld box-type stereoscopic display device 121. In practice, handheld box-type stereoscopic display device 121 can also be a holographic projection device, the structure of which and the method of generating virtual stereoscopic images will be described in detail later with reference to the accompanying drawings.

[0076] Simply put, compared to Figure 1 The system block diagram, Figure 2 The system block diagram includes an additional network unit 124, and all units are housed within the intelligent device 123, while the sensor 122 is independent of the intelligent device 123. However, the sensor 122 is connected to the loading unit 126 so that the sensor 122 can transmit the acquired object identifier to the loading unit 126. The connection methods and functions between the other units (i.e., the storage unit 125, the loading unit 126, and the imaging unit 127) are the same as those in the previous system block diagram. Figure 1 The system block diagram is the same.

[0077] It should be particularly noted that, in practical implementation, each unit described in this invention can be implemented in various ways, including firmware, hardware, or any combination thereof. For example, in some embodiments, each module can be implemented using firmware and hardware, or one of them. Furthermore, this invention can also be implemented partially or entirely based on hardware. For instance, one or more modules in the system can be implemented using integrated circuit chips, system-on-chip (SoC), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), etc. This invention can be a system, method, and / or computer program. A computer program can include a computer-readable storage medium loaded with computer-readable program instructions for causing a processor to implement various aspects of the invention. The computer-readable storage medium can be a tangible device capable of holding and storing instructions used by an instruction execution device. The computer-readable storage medium can be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: hard disks, random access memory, read-only memory, flash memory, optical disks, floppy disks, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical signals through fiber optic cables), or electrical signals transmitted through wires. Furthermore, the computer-readable program instructions described herein can be downloaded from the computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to external computer devices or external storage devices. Networks may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, hubs, and / or gateways. A network card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards these instructions to the computer-readable storage media stored in the respective computing / processing device.The computer program instructions that execute the operations of this invention can be assembly language instructions, instruction set architecture instructions, machine instructions, machine-dependent instructions, microinstructions, firmware instructions, or source code or object code written in any combination of one or more programming languages. The programming languages ​​include object-oriented programming languages ​​such as Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby, and PHP, as well as conventional procedural programming languages ​​such as C or similar languages. The computer program instructions can be executed entirely on the computer, partially on the computer, partially on a client computer and partially on a remote computer, or entirely on a remote computer or server.

[0078] Please refer to Figure 3 ”, Figure 3 The present invention provides a flowchart of a virtual stereoscopic imaging method for sensing physical objects. The method is executed by a handheld box-type stereoscopic display device 110, which allows sensing of a physical object 100. The physical object 100 has a sensing identification element. The steps include: pre-storing a stereoscopic image corresponding to the physical object 100 within the handheld box-type stereoscopic display device 110, wherein the stereoscopic image corresponds to an image identifier (step 211); the handheld box-type stereoscopic display device 110 sensing the identification element of the physical object 100 through a sensor 111 to obtain an object identifier (step 212); the handheld box-type stereoscopic display device 110 comparing the obtained object identifier with the image identifier, and when the comparison matches, loading a stereoscopic image corresponding to the matching image identifier (step 213); and the handheld box-type stereoscopic display device 110 generating a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously displaying the generated virtual stereoscopic image within the handheld box-type stereoscopic display device 110 (step 214). Through the above steps, the sensor 111 of the handheld box-type stereoscopic display device 110 can sense the identification element of the entity object 100 to obtain the object identifier, so as to compare it with the image identifier. When the comparison matches, the stereoscopic image corresponding to the matching image identifier is loaded, and then a virtual stereoscopic image is generated based on the loaded stereoscopic image to be displayed in the handheld box-type stereoscopic display device 110.

[0079] Additionally, please see Figure 4 , Figure 4This is another flowchart of the virtual stereoscopic imaging method with sensing entity objects according to the present invention, applied in an environment with a sensing object 120 and a handheld box-type stereoscopic display device 121. The steps include: the handheld box-type stereoscopic display device 121 connects to a network via a wireless transmission element to download and store a stereoscopic image corresponding to the sensing object 120, wherein the stereoscopic image corresponds to an image identifier (step 221); the handheld box-type stereoscopic display device 121 senses the identification element of the sensing object 120 through a sensor 122 to obtain an object identifier (step 222); the handheld box-type stereoscopic display device 121 compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier (step 223); and the handheld box-type stereoscopic display device 121 generates a virtual stereoscopic image based on the loaded stereoscopic image, and displays the generated virtual stereoscopic image in the handheld box-type stereoscopic display device 121 (step 224). Steps 223 and 224 are the same as steps 213 and 214 mentioned above, that is, the aforementioned Figure 3 and Figure 4 The difference in the methods and procedures lies in the first two steps. Figure 4 The method involves downloading, storing, and updating stereoscopic images corresponding to the sensed object 120 using wireless transmission elements such as Wi-Fi, Zigbee, LoRa (Long Range) or similar elements.

[0080] The following combinations Figures 5 to 7 The following description is provided by way of examples; please refer to the previous section first. Figure 5 , Figure 5This is a schematic diagram illustrating the application of the present invention to sense physical objects and display virtual stereoscopic images. Assume the physical object is a cartoon doll 300 with identification elements, such as an RFID tag embedded inside the cartoon doll 300, a two-dimensional barcode affixed to the base of the cartoon doll 300, etc., and that the handheld box-type stereoscopic display device 310 pre-stores a stereoscopic image corresponding to the cartoon doll 300. When the user brings the cartoon doll 300 close to the sensor 311 of the handheld box-type stereoscopic display device 310, the handheld box-type stereoscopic display device 310 obtains the corresponding object identifier and compares it with the image identifier corresponding to the stereoscopic image. When the comparison matches, the stereoscopic image corresponding to the matching image identifier is loaded. Finally, the handheld box-type stereoscopic display device 310 generates a virtual stereoscopic image 320 based on the loaded stereoscopic image and displays the generated virtual stereoscopic image 320 within the handheld box-type stereoscopic display device 310. This completes the process of sensing physical objects to display virtual stereoscopic images. In practice, users can bring different cartoon figures close to the sensor 311 of the handheld box-type stereoscopic display device, so that the handheld box-type stereoscopic display device 310 can dynamically present virtual stereoscopic images corresponding to the images of the cartoon figures according to the different object identifiers sensed, thereby interacting with the user.

[0081] In practical implementation, sensor 311 can simultaneously sense multiple object identifiers, enabling the handheld box-type stereoscopic display device 310 to load corresponding stereoscopic images. These stereoscopic images are then integrated through the paper doll system to generate a virtual stereoscopic image. The paper doll system integrates stereoscopic images through model stitching, multi-view reconstruction, 3D rendering and composition, 3D hierarchical composition, or similar techniques. For example, model stitching can fuse 3D models or image data from different angles or sources into a complete virtual stereoscopic image. This process typically involves: collecting data on entities from different perspectives; using feature matching algorithms, such as Scale-invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), and Oriented FAST and Rotated BRIEF (ORB), to spatially align this data from different perspectives; and fusing the aligned data and eliminating overlapping areas to generate a seamless virtual stereoscopic image. Point cloud fusion, texture mapping, or mesh patching techniques are often employed throughout the process.

[0082] like Figure 6 The meaning is shown. Figure 6 This is an exploded perspective view of the handheld box-type stereoscopic display device of the present invention. In actual implementation, the handheld box-type stereoscopic display device 10 may include: a housing 11, a device circuit board 12, an embedded glass slot 13, a display 14, and a front cover 15. The housing 11 is illustrated as a cuboid. In addition, the housing 11 may also have different geometric shapes, such as cylinders, prisms, frustums, etc., and the housing 11 may be made of metal, polymer, or special materials. Examples of metal materials include steel, aluminum alloy, titanium alloy, etc.; examples of polymer materials include ABS, PC, PC / ABS, etc.; and examples of special materials include carbon fiber, high-density fiberglass, etc. These are merely illustrative examples and are not intended to limit the scope of the invention.

[0083] Next, the device board 12 is fixed to the bottom of the outer casing 11 by means of screw fixing, snap fixing, or similar fixing methods. The device board 12 may include a sensor 111, a storage unit 112, a loading unit 113, and an imaging unit 114. Alternatively, the device board 12 may also be an intelligent device 123 including a network unit 124, a storage unit 125, a loading unit 126, and an imaging unit 127. The device board 12 can be electrically connected to the battery embedded in the outer casing 11 to obtain power supply. The device board 12 loads and executes the operating system, enabling the handheld box-type stereoscopic display device 10 to operate the operating system.

[0084] Next, the embedded glass groove 13 can be directly embedded and fixed to the outer shell 11. The embedded glass groove 13 can also be used in conjunction with the front cover 15 for embedding and fixing to the outer shell 11. This is merely an example and does not limit the scope of application of the invention. The embedded glass groove 13 is made of glass in a single piece, with rounded edges and corners on both the inner and outer sides. A light-shielding film is applied to the outer surface of the embedded glass groove 13, making it opaque. This is also merely an example and does not limit the scope of application of the invention. A connecting groove 131 is provided at the bottom of the embedded glass groove 13. The connecting groove 131 provides a flexible cable for electrically connecting the display 14 embedded in the embedded glass groove 13 to the device circuit board 12. The device circuit board 12, in conjunction with the display 14, provides the ability to display the generated virtual stereoscopic image within the handheld box-type stereoscopic display device 10.

[0085] It should be noted that the aforementioned embedded glass groove 13 can prevent excess external light from entering the stereoscopic image display space mentioned later, thus avoiding affecting the contrast of the virtual stereoscopic image presented in the stereoscopic image display space and improving the image sharpness of the virtual stereoscopic image. Furthermore, it makes the light in the stereoscopic image display space controllable, effectively reducing ambient light interference, thereby improving the image stability and image clarity of the virtual stereoscopic image presented in the stereoscopic image display space.

[0086] In one embodiment, the inner surface of the embedded glass groove 13 can be further formed into a partially reflective area and a partially transmissive area, so that the inner surface of the embedded glass groove 13 forms a "semi-transparent mirror" effect, which can enhance the floating effect of the virtual stereoscopic image presented in the stereoscopic image display space. The inner surface of the embedded glass groove 13 can also be further coated with an augmented reality coating, polarization beam splitting coating, etc. using optical coating technology (this is only for illustrative purposes and does not limit the application scope of the present invention), thereby reducing unnecessary light reflection in the stereoscopic image display space, ensuring the image stability and image clarity of the virtual stereoscopic image presented in the stereoscopic image display space, and improving the stereoscopic effect of the virtual stereoscopic image presented in the stereoscopic image display space.

[0087] In another embodiment, the embedded glass groove 13 can also be made into a waveguide structure to make the light in the stereoscopic image display space uniformly distributed and reduce parallax distortion, so that a consistent virtual stereoscopic image can still be viewed from different angles. The handheld box-type stereoscopic display device 10 can also be further combined with a multi-area optical system, a dynamic parallax adjustment system and / or a dynamic viewing angle adjustment system so that multiple people can view the virtual stereoscopic image at the same time, and make the virtual stereoscopic image adapt to different viewing positions. Eye-tracking technology is used to adjust the image angle output by the display 14 in real time so that the virtual stereoscopic image viewed from different viewing positions is accurate. Again, this is only for illustrative purposes and is not intended to limit the scope of application of the present invention.

[0088] The display 14 may be composed of a display panel and a parallax barrier layer, a lenticular lens array layer, or a light field display layer. The display panel of the display 14 is generally an LCD panel or an OLED panel, etc., and the display panel provides the ability to display images from multiple viewing angles simultaneously. The display 14 may superimpose a grating (mask) of the parallax barrier layer in front of the display panel so that the left and right eyes see different images. The display 14 may also superimpose a lenticular lens array layer in front of the display panel to achieve left and right eye parallax by blocking some pixels. The display 14 may also superimpose a light field display layer in front of the display panel to generate more natural multi-view images using multi-layer display panels or holographic technology. The foregoing examples are for illustrative purposes only and do not limit the scope of application of the present invention.

[0089] Next, the front cover 15, incorporating the transparent touch panel 151, covers the outer shell 11, and the front cover 15 and the outer shell 11 are fixed together by screwing or snapping to form a tight seal. Simultaneously, the transparent touch panel 151 also covers the embedded glass groove 13, forming a sealed three-dimensional image display space. The transparent touch panel 151 is electrically connected to the device circuit board 12 via a flexible ribbon cable to achieve touch selection and sliding operations. That is, the device circuit board 12 cooperates with the transparent touch panel 151 to achieve touch selection and sliding operations. The aforementioned transparent touch panel 151 is made using capacitive touch technology, optical touch technology, infrared touch technology, and ultrasonic touch technology. Among these technologies, projected capacitive touch technology (P-Cap) is the best implementation technology. This is only for illustrative purposes and is not intended to limit the scope of application of the present invention. In practice, the virtual stereoscopic image displayed on the display 14 in the stereoscopic image display space can be viewed from different angles. However, when viewing the virtual stereoscopic image from a frontal view, a left-tilted view, or a right-tilted view, the touch-sensitive elements of the virtual stereoscopic image, such as application icons, are projected onto the transparent touch panel 151 at inconsistent positions from different angles. This will result in the correct touch operation being possible for these elements from a frontal view, but not from a left-tilted view or a right-tilted view. Therefore, a front-facing camera can be further used in conjunction with head tracking technology to calculate the viewing angle of the virtual stereoscopic image in real time. The mapping relationship of the touch point can be dynamically adjusted according to the change of viewing angle. The head tracking technology refers to compensating for the touch offset caused by the change of viewing angle, ensuring that the touch position can still accurately correspond to the touchable element of the virtual stereoscopic image under different viewing angles. First, the viewer's eye position is determined by the front-facing camera, infrared sensor or optical tracking system, and then parallax correction technology is used to calculate the parallax change according to the viewer's viewing angle, thereby dynamically correcting the touch position mapping to the position of the touchable element of the virtual stereoscopic image.

[0090] In practical implementation, sensors (111, 122) are installed at the top inside the outer casing 11 to sense identification elements of the sensing object 120 or physical object 100 outside the outer casing 11, such as smart tags or two-dimensional barcodes of cartoon dolls 300. When the sensors (111, 122) are wireless sensors, they can sense smart tags embedded in the physical object 100 to obtain object identifiers. When the sensors are optical sensors, they can scan two-dimensional barcodes set on the surface of the physical object 100 to obtain object identifiers. In fact, the sensors (111, 122) and the device circuit board 12 can be electrically connected via flexible ribbon cables.

[0091] It should be further noted that the handheld box-type stereoscopic display device 10 may also include a speaker device disposed on the outer casing 11 or the front cover 15. This speaker device can be electrically connected to the device circuit board 12 via a flexible ribbon cable for playing background music and sound effects. In addition, the handheld box-type stereoscopic display device 10 may also include a button 153 disposed on the front cover 15. Similarly, this button 153 can be electrically connected to the device circuit board 12 via a flexible ribbon cable for selecting the virtual stereoscopic image displayed on the display 14 in conjunction with the touch operation of the transparent touch panel 151.

[0092] like Figure 7 The meaning is shown. Figure 7 This is a schematic diagram of the hardware architecture of the intelligent device of the present invention. Within the intelligent device 700, there are multiple computer-executable instructions (hereinafter referred to as instructions) for driving the machine to perform any or more methods discussed in this invention. In other embodiments, the machine may be connected (e.g., network connected) to other machines in a Local Area Network (LAN), intranet, extranet, or the Internet. The machine may operate as a server or client in a client-server network environment, or as a peer machine in a peer-to-peer network environment. The machine may also function as a network device, server, router, switch or bridge, event generator, distributed node, centralized system, or any machine capable of executing a set of instructions (whether sequential or otherwise) specifying the actions the machine needs to take. Furthermore, although only one machine is illustrated, the term "machine" should also be considered as including a collection of any machines (e.g., a tablet computer) that can individually or jointly execute a set (or more) of instructions to perform any or more methods discussed in this invention.

[0093] The intelligent device 700, such as a tablet computer, intelligent display, etc., includes a hardware processor 711, a memory 712 (e.g., read-only memory, flash memory, dynamic random access memory, non-volatile resistive random access memory, embedded flash memory or ferroelectric random access memory (FeRAM), a network interface device 713, a display device 715, an input device 717, and a data storage device 718 (which may include fixed or removable computer-readable storage media), and these components communicate via a bus 720. It should be noted that... Figure 2 The sensor 122 can also be electrically connected to the intelligent device 700 via the bus 720.

[0094] The hardware processor 711 may be a microprocessor, a central processing unit (CPU), or a similar device. More specifically, the hardware processor 711 may be a Complex Instruction Set Computing (CISC) microprocessor, a Reduced Instruction Set Computing (RISC) microprocessor, a Very Long Instruction Word (VLIW) microprocessor, or a general-purpose instruction set processor implementing other instruction sets, or a general-purpose instruction set processor implementing multiple instruction sets. Furthermore, the hardware processor 711 executes various software elements stored in memory 712 to perform various functions for the intelligent device 700. In one embodiment, these software elements include an operating system, compiler elements, and a communication module (or instruction set). The operating system includes various programs, instruction sets, software elements, and / or drivers for controlling and managing general system tasks and facilitating communication between various hardware and software elements. A compiler is a computer program (or assembly of programs) that translates source code written in a programming language into another computer language (e.g., object language, object code). The communication module can communicate with other devices via a network interface device 713. The network interface device 713 is connected to a network 714 (such as a local area network (LAN) or a wide area network (WAN)) to communicate with other devices.

[0095] The memory 712 may store program code and / or data for use by the hardware processor 711. The memory 712 may be implemented using random access memory (e.g., SRAM, DRAM, DDRAM), ROM, magnetic and / or optical storage devices, flash memory, or any combination thereof. The memory 712 may also include a transmission medium for carrying information-bearing signals (which may be modulated signals with or without carrier waveforms) representing instructions or data.

[0096] The display device 715, such as a liquid crystal display (LCD), LED, or cathode ray tube (CRT), is connected to the computer system via a display port and a graphics chipset, and provides a graphical user interface (GUI) 716 for user operation. In practice, the display device 715 can also be a touchscreen or a similar device that combines input and display functions. Additionally, the input device 717 (e.g., keyboard, mouse, touchpad, etc.) can provide user input commands and generate trigger signals.

[0097] Data storage device 718 may include a machine-readable storage medium (or more specifically, a computer-readable storage medium) storing one or more instruction sets embodying any or more methods or functions described in this invention. The disclosed data storage mechanism may be fully or at least partially implemented in memory 712. The data storage device 718 (also referred to as a storage unit) and memory 712 disclosed in intelligent device 700 may be configured to implement a data storage mechanism for performing the operations and steps discussed in this invention.

[0098] It should be noted that the intelligent device 700 may also include a wireless radio frequency transceiver 719 to provide frequency conversion, converting the received radio frequency signal into a baseband signal and the baseband transmission signal into a radio frequency signal. In practical implementation, the wireless radio frequency transceiver can be understood to include other signal processing functions, such as: modulation / demodulation, encoding / decoding, interleaving / deinterleaving, spreading / despreading, inverse fast Fourier transform (IFFT) / fast Fourier transform (FFT), cyclic prefix addition / removal, and other signal processing functions. Figure 2 When the sensor 122 is a wireless sensor, the sensed data can be transmitted through the wireless radio frequency transceiver 719 without needing to be directly electrically connected to the bus 720.

[0099] In one example, the intelligent device 700 is a tablet computer that can connect (e.g., via a network connection) to other machines on a local area network (LAN), wide area network (WAN), or any network. The intelligent device 700 can be a distributed system comprising many interconnected tablet computers. This tablet computer can act as a server or client in a client-server network environment, or operate as a peer-to-peer machine in a peer-to-peer (or distributed) network environment.

[0100] In summary, the difference between this invention and the prior art lies in the fact that the sensor of the handheld box-type stereoscopic display device senses the object recognition element to obtain the object identifier, so as to compare it with the image identifier. When the comparison matches, the stereoscopic image corresponding to the matching image identifier is loaded, and then a virtual stereoscopic image is generated based on the loaded stereoscopic image and displayed in the handheld box-type stereoscopic display device. This technical means can solve the problems existing in the prior art, thereby achieving the technical effect of improving the diversity and interactivity of virtual stereoscopic imaging.

[0101] Although the present invention has been disclosed above with reference to the foregoing embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications and alterations without departing from the spirit and scope of the present invention. Therefore, the scope of patent protection of the present invention shall be determined by the scope defined in the appended claims.

Claims

1. A virtual stereoscopic imaging system capable of sensing physical objects, characterized in that, The system allows sensing of physical objects, wherein the physical objects have sensing identification elements, and the system comprises: A handheld box-type stereoscopic display device, the handheld box-type stereoscopic display device comprising: A sensor is used to sense the identification element of the entity object to obtain an object identifier; A storage unit for storing a stereoscopic image corresponding to the entity object, wherein the stereoscopic image corresponds to an image identifier; A loading unit, connected to the storage unit and the sensor, is used to compare the obtained object identifier with the image identifier, and when the comparison matches, load the stereoscopic image corresponding to the matching image identifier; and An imaging unit, connected to the loading unit, is used to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously display the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

2. The virtual stereoscopic imaging system with sensing entity objects as described in claim 1, characterized in that, The object identifier includes multiple object categories, including the body, clothing, accessories, weapons, and armor. When the sensor senses more than one entity object and obtains multiple object identifiers, the loading unit first loads the corresponding stereoscopic image, and then the imaging unit executes the paper doll system to integrate the loaded stereoscopic images into the virtual stereoscopic image for display in the handheld box-type stereoscopic display device. The paper doll system is selected from at least one of model splicing, multi-view reconstruction, 3D rendering compositing, and 3D hierarchical compositing to integrate the loaded stereoscopic images.

3. The virtual stereoscopic imaging system with sensing entity objects as described in claim 2, characterized in that, The stereoscopic image corresponds to the prompt words. When the loading unit loads the stereoscopic image, it simultaneously loads the corresponding prompt words, so that the paper doll system generates the virtual stereoscopic image based on the loaded prompt words through a generative AI model that converts text into images. The generative AI model is pre-trained with the stereoscopic image and its corresponding prompt words.

4. The virtual stereoscopic imaging system with sensing entity objects as described in claim 1, characterized in that, The sensor includes a wireless sensor and an optical sensor. The identification element includes a smart tag and a two-dimensional barcode. The wireless sensor is used to sense the smart tag embedded in the physical object to obtain the object identifier. The optical sensor is used to scan the two-dimensional barcode set on the surface of the physical object to obtain the object identifier.

5. A virtual stereoscopic imaging system capable of sensing physical objects, characterized in that, The system includes: A senseable object, the senseable object having a sensed identification element; and A handheld box-type stereoscopic display device, the handheld box-type stereoscopic display device comprising: A sensor for sensing the identification element of the senseable object to obtain an object identifier; and Intelligent device, the intelligent device comprising: A network unit, used to connect to a network and transmit data via wireless transmission elements; A storage unit, connected to the network unit, is used to store a stereoscopic image corresponding to the sensed object, wherein the stereoscopic image corresponds to an image identifier, and is updated through the network unit; A loading unit, connected to the storage unit and the sensor, is used to compare the obtained object identifier with the image identifier, and when the comparison matches, load the stereoscopic image corresponding to the matching image identifier; and An imaging unit, connected to the loading unit, is used to generate a virtual stereoscopic image based on the loaded stereoscopic image, and simultaneously display the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

6. A virtual stereoscopic imaging method with a sensing entity object, characterized in that, Performed via a handheld box-type stereoscopic display device, the handheld box-type stereoscopic display device being able to sense physical objects, the physical objects having sensed recognition elements, the steps including: A stereoscopic image corresponding to the physical object is pre-stored in the handheld box-type stereoscopic display device, wherein the stereoscopic image corresponds to an image identifier; The handheld box-type stereoscopic display device obtains an object identifier by sensing the identification element of the physical object through a sensor. The handheld box-type stereoscopic display device compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier; and The handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

7. The virtual stereoscopic imaging method with a sensing entity object as described in claim 6, characterized in that, The object identifier includes multiple object categories, including the body, clothing, accessories, weapons, and armor. When the sensor senses more than one entity object and obtains multiple object identifiers, the handheld box-type stereoscopic display device first loads the corresponding stereoscopic image, and then executes the paper doll system to integrate the loaded stereoscopic images into the virtual stereoscopic image for display in the handheld box-type stereoscopic display device. The paper doll system is at least one of the following: model splicing, multi-view reconstruction, 3D rendering compositing, and 3D hierarchical compositing, used to integrate the loaded stereoscopic images.

8. The virtual stereoscopic imaging method with a sensing entity object as described in claim 7, characterized in that, The stereoscopic image corresponds to the prompt words. When the handheld box-type stereoscopic display device loads the stereoscopic image, the corresponding prompt words are loaded simultaneously, so that the paper doll system generates the virtual stereoscopic image based on the loaded prompt words through a generative AI model that converts text into images. The generative AI model is pre-trained with the stereoscopic image and its corresponding prompt words.

9. The virtual stereoscopic imaging method with a sensing entity object as described in claim 6, characterized in that, The sensor includes a wireless sensor and an optical sensor. The identification element includes a smart tag and a two-dimensional barcode. The wireless sensor is used to sense the smart tag embedded in the physical object to obtain the object identifier. The optical sensor is used to scan the two-dimensional barcode set on the surface of the physical object to obtain the object identifier.

10. A virtual stereoscopic imaging method with sensing entity objects, characterized in that, When applied in environments with sensing objects and handheld box-type stereoscopic display devices, the steps include: The handheld box-type stereoscopic display device connects to the network via a wireless transmission element to download and store stereoscopic images corresponding to the sensed object, wherein the stereoscopic images correspond to image identifiers; The handheld box-type stereoscopic display device obtains an object identifier by sensing the identification element of the sensing object through a sensor. The handheld box-type stereoscopic display device compares the obtained object identifier with the image identifier, and when the comparison matches, loads the stereoscopic image corresponding to the matching image identifier; and The handheld box-type stereoscopic display device generates a virtual stereoscopic image based on the loaded stereoscopic image, and displays the generated virtual stereoscopic image within the handheld box-type stereoscopic display device.

Images