Video conference system and three-dimensional modeling method using same

Abstract

The invention provides a video conference system and a three-dimensional modeling method using the same. The three-dimensional modeling method of the video conference comprises the following steps. A mobile image capture device shoots a plurality of photos of an object and records modeling information corresponding to each photo. The mobile image capturing device transmits the photo and the modeling information to a first electronic device. The first electronic device encodes each piece of modeling information into each photo in a hidden watermark mode. The first electronic device transmits the photo with the hidden watermark to a second electronic device. The second electronic device receives the photo with the hidden watermark. The second electronic device decodes the hidden watermarks of the photos to obtain modeling information. The second electronic device establishes a stereoscopic model according to the photo and the modeling information. The second electronic device displays the stereoscopic model.

Description

Technical Field

[0001] This invention relates to a conference system and a conference construction method, and more particularly to a video conferencing system and a stereo modeling method using the same. Background Technology

[0002] With advancements in video technology, people can now conduct long-distance video communication and discussions using video conferencing software. During a video conference, the speaker simply turns on their camera to transmit their image to the participants.

[0003] During video conferences, presenters can showcase an object, an interior environment, or a beautiful view through the camera. To ensure attendees can see the object completely, the presenter can rotate or walk around it to take pictures. However, even if the presenter tries to capture every detail, attendees may still want to examine a particular angle more closely, but cannot repeatedly ask the presenter to show the object from that angle. Therefore, researchers are working on a technology that allows attendees to actively adjust the angle without requiring the presenter to re-show the object. Summary of the Invention

[0004] This invention relates to a video conferencing system and a stereoscopic modeling method using the same. During a video conference, the presenter's first electronic device transmits photos of an object from various angles to the participants' second electronic devices via a network. Furthermore, modeling information is added to the photos, allowing the second electronic device to quickly create a stereoscopic model. Using the stereoscopic model, participants can rotate the object using a mouse or keyboard to fully view its various facets.

[0005] According to one aspect of the present invention, a stereoscopic modeling method for video conferencing is proposed. The stereoscopic modeling method for video conferencing includes the following steps: A mobile image capture device takes several photos of an object and records modeling information corresponding to each photo. The mobile image capture device transmits the multiple photos and the multiple modeling information to a first electronic device. The first electronic device encodes each modeling information into each photo using a hidden watermark. The first electronic device transmits the multiple photos with the multiple hidden watermarks to a second electronic device. The second electronic device receives the multiple photos with the multiple hidden watermarks. The second electronic device decodes each hidden watermark in each photo to extract each modeling information. The second electronic device builds a stereoscopic model based on the multiple photos and the multiple modeling information. The second electronic device displays the stereoscopic model.

[0006] According to another aspect of the present invention, a video conferencing system is provided. The video conferencing system includes a mobile image capture device, a first electronic device, and a second electronic device. The mobile image capture device is used to capture several photographs of an object and record modeling information corresponding to each photograph. The first electronic device includes a first transmission unit and a watermark encoding unit. The first transmission unit is used to receive the multiple photographs and the multiple modeling information from the mobile image capture device. The watermark encoding unit is used to encode each modeling information into each photograph in the form of a hidden watermark. The first transmission unit is further used to transmit the multiple photographs with the multiple hidden watermarks. The second electronic device includes a second transmission unit, a watermark decoding unit, a modeling unit, a control unit, and a display unit. The second transmission unit is used to receive the multiple photographs with the multiple hidden watermarks. The watermark decoding unit is used to decode each hidden watermark of each photograph to output each modeling information. The modeling unit is used to build a three-dimensional model based on the multiple photographs and the multiple modeling information. The control unit is used to provide a viewing angle. The display unit is used to show the 3D model according to the viewing angle. Attached Figure Description

[0007] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings, wherein:

[0008] Figure 1 An example illustrates a stereoscopic modeling method for video conferencing according to an embodiment of the present invention.

[0009] Figure 2 A block diagram of a video conferencing system according to an embodiment of the present invention is shown.

[0010] Figures 3A-3B A flowchart illustrating a stereoscopic modeling method for video conferencing according to an embodiment of the present invention is shown.

[0011] Figure 4 The example illustrates steps S240 and S250.

[0012] Figure label:

[0013] 100: First Electronic Device

[0014] 110: First Transmission Unit

[0015] 120: Watermark Encoding Unit

[0016] 200: Second electronic device

[0017] 210: Second Transmission Unit

[0018] 220: Watermark Decoding Unit

[0019] 230: Modeling Unit

[0020] 240: Control Unit

[0021] 250: Display Unit

[0022] 700: Mobile Image Capture Equipment

[0023] 900: Network

[0024] MD: 3D model

[0025] MS: Modeling Information

[0026] OB: Object

[0027] PT: Photos

[0028] VA: Viewing Angle

[0029] WD: Independent Window

[0030] WM: Hide Watermark

[0031] S110, S120, S130, S210, S211, S220, S221, S230, S240, S250, S700, S710: Steps Detailed Implementation

[0032] The technical terms used in this specification are based on common terminology in the field. Where this specification provides further explanation or definition of certain terms, the interpretation of those terms shall be based on the explanation or definition provided in this specification. Each embodiment of the present invention has one or more technical features. Where feasible, those skilled in the art may selectively implement some or all of the technical features in any embodiment, or selectively combine some or all of the technical features in these embodiments.

[0033] Please refer to Figure 1 The example illustrates a stereoscopic modeling method for video conferencing according to an embodiment of the present invention. During the video conference, a first electronic device 100 of the speaker and a second electronic device 200 of the participants can conduct remote video communication and discussion via a network 900. The first electronic device 100 of the speaker transmits photos PT showing various directions of an object OB to the second electronic device 200 of the participants via the network 900. In a separate window WD, the participants can rotate the object OB themselves using a mouse or keyboard to fully view the appearance of each facet of the object OB.

[0034] Regardless of the speaker's rotation angle of object OB, participants can adjust the rotation of object OB themselves to select the part / position of object OB that interests them. Therefore, participants can experience the feeling of holding object OB in their hands and examining it carefully, creating an immersive experience.

[0035] Please refer to Figure 1 and Figure 2 , Figure 2 A block diagram of a video conferencing system 1000 according to an embodiment of the present invention is shown. The video conferencing system 1000 includes a mobile image capture device 700, a first electronic device 100, and a second electronic device 200. The mobile image capture device 700 is used to perform an image capture process.

[0036] The first electronic device 100 includes a first transmission unit 110 and a watermark encoding unit 120. The second electronic device 200 includes a second transmission unit 210, a watermark decoding unit 220, a modeling unit 230, a control unit 240, and a display unit 250. The first transmission unit 110 and the second transmission unit 210 are used to perform data transmission procedures, such as a wireless transmission module or a wired transmission module.

[0037] The watermark encoding unit 120 is used for the encoding process. The watermark decoding unit 220 is used for the decoding process. The modeling unit 230 is used for the modeling process.

[0038] The watermark encoding unit 120, the watermark decoding unit 220, and / or the modeling unit 230 are, for example, a circuit, a circuit board, a storage device for storing program code, or a chip. The chip is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microcontroller (MCU), microprocessor, digital signal processor (DSP), programmable controller, application-specific integrated circuit (ASIC), graphics processing unit (GPU), image signal processor (ISP), image processing unit (IPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field-programmable gate array (FPGA), or other similar components or combinations thereof.

[0039] The control unit 240 is used for user operation, such as a mouse, a touch screen, a touchpad, or a stylus. The display unit 250 is used to display various information, such as an LCD screen or an OLED screen.

[0040] In this embodiment, modeling information MS is added to the photograph PT, enabling the second electronic device 200 to quickly create a stereoscopic model MD. A flowchart is provided below to explain the operation of each component in detail.

[0041] Please refer to Figure 2 and Figures 3A-3B , Figures 3A-3B A flowchart illustrating a stereoscopic modeling method for video conferencing according to an embodiment of the present invention is shown. The stereoscopic modeling method for video conferencing includes steps S700, S710, S110–S130, S210, S211, S220, S221, and S230–S250. In step S700, as... Figure 1 and Figure 2 As shown, the mobile image capture device 700 takes several photos (PT) of an object (OB) and records the modeling information (MS) corresponding to each photo (PT). The modeling information (MS) includes, for example, a shooting direction, a spatial position, an image size, and shooting parameters.

[0042] Next, in step S710, as follows Figure 1 and Figure 2 As shown, the mobile image capture device 700 transmits photo PT and modeling information MS.

[0043] Then, in step S110, as follows Figure 1 and Figure 2 As shown, the first transmission unit 110 of the first electronic device 100 receives the photo PT and modeling information MS from the mobile image capture device 700.

[0044] Next, in step S120, as Figure 1 and Figure 2 As shown, the watermark encoding unit 120 encodes the modeling information MS into each photo PT as a hidden watermark WM. The hidden watermark WM is encoded across the entire range of each photo PT. The hidden watermark is scattered across several pixels, making its presence imperceptible to the human eye.

[0045] Then, in step S130, as Figure 1 and Figure 2 As shown, the first transmission unit 110 transmits a photo PT with a hidden watermark WM.

[0046] Next, in step S210, as follows Figure 1 and Figure 2As shown, the second transmission unit 210 of the second electronic device 200 receives a photo PT with a hidden watermark WM.

[0047] In step S211, as Figure 1 and Figure 2 As shown, the second transmission unit 210 determines whether the photo PT with hidden watermark WM has been completely received. If the photo PT with hidden watermark WM has been completely received, then proceed to step S220; if the photo PT with hidden watermark WM has not been completely received, then return to step S210 and continue to receive the photo PT with hidden watermark WM.

[0048] Next, in step S220, as Figure 1 and Figure 2 As shown, the watermark decoding unit 220 decodes the hidden watermark WM of the photograph PT to output the modeling information MS. The modeling information MS includes, for example, the shooting direction, spatial position, image size, and shooting parameters.

[0049] Then, in step S221, as follows Figure 1 and Figure 2 As shown, the watermark decoding unit 220 determines whether all hidden watermarks WM have been decoded. If all hidden watermarks WM have been decoded, proceed to step S230; if there are still hidden watermarks WM that have not been decoded, return to step S220 and continue decoding the hidden watermarks WM of the photo PT.

[0050] In step S230, as Figure 1 and Figure 2 As shown, the modeling unit 230 establishes a stereo model MD based on the photographs PT and modeling information MS. In this step, the second electronic device 200 establishes the stereo model MD only after receiving all the multiple photographs PT and decoding all the modeling information MS.

[0051] Please refer to Figure 4 The example illustrates steps S240 and S250. In step S240, the display unit 250 receives a viewing angle VA.

[0052] In step S250, such as Figures 2-4 As shown, the display unit 250 of the second electronic device 200 displays a stereoscopic model (MD). The user can use the control unit 240 to control the angle of the photographic object (PT) OB within the display unit 250. For example, the angle of the object OB within the display unit 250 can be controlled using a mouse or keyboard.

[0053] According to the above embodiment, the presenter's first electronic device 100 transmits photos PT showing various views of an object OB to the participant's second electronic device 200 via network 900. Furthermore, modeling information MS is added to the photos PT, enabling the second electronic device 200 to quickly create a stereoscopic model MD. Using the stereoscopic model MD, the participant can rotate the object OB using a mouse or keyboard to fully view the appearance of each facet of the object OB.

[0054] Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications and improvements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be defined by the claims.

Claims

1. A method for stereo modeling video conferencing, comprising: A mobile image capture device takes multiple photos of an object and records modeling information corresponding to each photo. The mobile image capture device transmits the multiple photos and the multiple modeling information to a first electronic device; The first electronic device encodes each of the modeling information into each of the photos using a hidden watermark; The first electronic device transmits the multiple photos with the multiple hidden watermarks to a second electronic device; The second electronic device receives the multiple photos with the multiple hidden watermarks; The second electronic device decodes the hidden watermark of each of the photos to obtain the modeling information; The second electronic device establishes a three-dimensional model based on the multiple photographs and the multiple modeling information; and The second electronic device displays the three-dimensional model.

2. The stereoscopic modeling method for video conferencing as described in claim 1, characterized in that, Each of these modeling information includes a shooting direction, a spatial location, an image size, and shooting parameters.

3. The stereoscopic modeling method for video conferencing as described in claim 1, characterized in that, Each hidden watermark is encoded across the entire area of ​​each photo.

4. The stereoscopic modeling method for video conferencing as described in claim 1, characterized in that, The second electronic device builds the 3D model only after receiving all the photos with the multiple hidden watermarks.

5. The stereoscopic modeling method for video conferencing as described in claim 1, characterized in that, The second electronic device only displays the three-dimensional model after it has fully created the three-dimensional model.

6. The stereoscopic modeling method for video conferencing as described in claim 1, characterized in that, The three-dimensional model is stored in the second electronic device.

7. A video conferencing system, comprising: A mobile image capture device for taking multiple photos of an object and recording modeling information corresponding to each photo; A first electronic device, comprising: A first transmission unit is used to receive the plurality of photos and the plurality of modeling information from the mobile image capture device; A watermark encoding unit is used to encode each of the modeling information into each of the photos in the manner of a hidden watermark; the first transmission unit is further used to transmit the multiple photos with the multiple hidden watermarks; and A second electronic device, comprising: A second transmission unit is used to receive the multiple photos having the multiple hidden watermarks; A watermark decoding unit is used to decode the hidden watermark of each photo to obtain the modeling information. A modeling unit is used to create a three-dimensional model based on the multiple photos and the multiple modeling information. A control unit for providing a viewing angle; and A display unit is used to display the 3D model according to the viewing angle.

8. The video conferencing system as described in claim 7, characterized in that, Each of these modeling information includes a shooting direction, a spatial location, an image size, and shooting parameters.

9. The video conferencing system as described in claim 7, characterized in that, Each hidden watermark is encoded across the entire area of ​​each photo.

10. The video conferencing system as described in claim 7, characterized in that, After the second transmission unit of the second electronic device receives all the multiple photos and all the multiple modeling information, the modeling unit of the second electronic device then builds the three-dimensional model.

11. The video conferencing system as described in claim 7, characterized in that, Only after the modeling unit of the second electronic device has fully created the 3D model can the display unit of the second electronic device display the 3D model.

12. The video conferencing system as described in claim 7, characterized in that, The three-dimensional model is stored in the second electronic device.

Images