Video conference system and three-dimensional modeling method using the same

Abstract

A video conferencing system and a stereo modeling method thereon are disclosed. The stereo modeling method for video conferencing includes the following steps: A mobile image capturing device takes several photos of an object and records modeling information corresponding to each photo. The mobile image capturing device transmits the photos and modeling information to a first electronic device. The first electronic device encodes each modeling information into each photo using a hidden watermark. The first electronic device transmits the photos with hidden watermarks to a second electronic device. The second electronic device receives the photos with hidden watermarks. The second electronic device decodes each hidden watermark in each photo to extract the modeling information. The second electronic device builds a stereo model based on the photos and modeling information. The second electronic device displays the stereo model.

Description

Technical Field

[0001] This disclosure relates to a conference system and a conference construction method, and more particularly to a video conferencing system and a stereo modeling method for using the same. Prior Technology

[0002] With the advancement of video technology, people can conduct long-distance video communication and discussions through video conferencing software. During a video conference, as long as the speaker turns on their camera, their image can be transmitted to the participants.

[0003] During video conferences, presenters can showcase an object, an interior environment, or a beautiful view through the camera. To ensure attendees can see the object completely, the presenter can rotate or walk around it to film. However, even if the presenter tries to capture every detail, attendees may still want to examine a particular angle more closely, but cannot repeatedly ask the presenter to show the object from that angle. Therefore, researchers are working on a technology that allows attendees to actively adjust their viewing angle without requiring the presenter to re-show the object. Summary of the Invention

[0004] This disclosure relates to a video conferencing system and a stereoscopic modeling method using the same. During a video conference, the presenter's first electronic device transmits photos of an object from various angles to the participants' second electronic devices via a network. Furthermore, modeling information is added to the photos, allowing the second electronic device to quickly create a stereoscopic model. Using the stereoscopic model, participants can rotate the object themselves using a mouse or keyboard to fully view its various facets.

[0005] According to one aspect of this disclosure, a stereoscopic modeling method for video conferencing is proposed. The stereoscopic modeling method for video conferencing includes the following steps: A mobile image capturing device takes several photos of an object and records modeling information corresponding to each photo. The mobile image capturing device transmits these photos and the modeling information to a first electronic device. The first electronic device encodes each modeling information into each photo using a hidden watermark. The first electronic device transmits these photos with the hidden watermarks to a second electronic device. The second electronic device receives these photos with the hidden watermarks. The second electronic device decodes each hidden watermark in each photo to extract the modeling information. The second electronic device constructs a stereoscopic model based on these photos and the modeling information. The second electronic device displays the stereoscopic model.

[0006] According to another aspect of this disclosure, a video conferencing system is proposed. The video conferencing system includes a mobile image capturing device, a first electronic device, and a second electronic device. The mobile image capturing device is used to capture several photographs of an object and record modeling information corresponding to each photograph. The first electronic device includes a first transmission unit and a watermark encoding unit. The first transmission unit is used to receive the photographs and modeling information from the mobile image capturing device. The watermark encoding unit is used to encode each modeling information into each photograph using a hidden watermark. The first transmission unit is further used to transmit the photographs with these hidden watermarks. The second electronic device includes a second transmission unit, a watermark decoding unit, a modeling unit, a control unit, and a display unit. The second transmission unit is used to receive the photographs with these hidden watermarks. The watermark decoding unit is used to decode each hidden watermark in each photograph to obtain modeling information. The modeling unit is used to build a three-dimensional model based on the photographs and the modeling information. The control unit is used to provide a viewing angle. The display unit is used to show the 3D model according to the viewing angle.

[0007] To provide a better understanding of the above and other aspects of this disclosure, specific embodiments are described below in conjunction with the accompanying drawings: Simple Explanation of the Diagram

[0008] Figure 1 illustrates a stereoscopic modeling method for video conferencing according to an embodiment of this disclosure. Figure 2 illustrates a block diagram of a video conferencing system according to an embodiment of the present disclosure. Figures 3A-3B illustrate flowcharts of a stereoscopic modeling method for video conferencing according to an embodiment of this disclosure. Figure 4 illustrates steps S240 and S250. Implementation

[0009] The technical terms used in this specification are based on common terminology in the field. Where this specification provides explanations or definitions for certain terms, the interpretation of those terms shall be based on the explanations or definitions provided in this specification. Each of the embodiments disclosed herein has one or more technical features. Where feasible, those skilled in the art may selectively implement some or all of the technical features in any embodiment, or selectively combine some or all of the technical features in these embodiments.

[0010] Please refer to Figure 1, which illustrates a stereoscopic modeling method for video conferencing according to an embodiment of this disclosure. During the video conference, a first electronic device 100 of the speaker and a second electronic device 200 of the participants can conduct long-distance video communication and discussion via a network 900. The first electronic device 100 of the speaker transmits photos PT of an object OB from various directions to the second electronic device 200 of the participants via the network 900. In a separate window WD, the participants can rotate the object OB themselves using a mouse or keyboard to fully view the appearance of each facet of the object OB.

[0011] Regardless of the speaker's rotation angle of object OB, participants can adjust the rotation of object OB themselves to select the part / position of object OB that interests them. Therefore, participants can experience the feeling of holding object OB in their hands and examining it carefully, creating an immersive experience.

[0012] Please refer to Figures 1 and 2. Figure 2 illustrates a block diagram of a video conferencing system 1000 according to an embodiment of this disclosure. The video conferencing system 1000 includes a mobile image capturing device 700, a first electronic device 100, and a second electronic device 200. The mobile image capturing device 700 is used to perform image capturing procedures.

[0013] The first electronic device 100 includes a first transmission unit 110 and a watermark encoding unit 120. The second electronic device 200 includes a second transmission unit 210, a watermark decoding unit 220, a modeling unit 230, a control unit 240, and a display unit 250. The first transmission unit 110 and the second transmission unit 210 are used to perform data transmission procedures, such as a wireless transmission module or a wired transmission module.

[0014] The watermark encoding unit 120 is used for the encoding process. The watermark decoding unit 220 is used for the decoding process. The modeling unit 230 is used for the modeling process.

[0015] The watermark encoding unit 120, the watermark decoding unit 220, and / or the modeling unit 230 are, for example, a circuit, a circuit board, a storage device for stored program code, or a chip. The chip is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microcontroller (MCU), microprocessor, digital signal processor (DSP), programmable controller, application-specific integrated circuit (ASIC), graphics processing unit (GPU), image signal processor (ISP), image processing unit (IPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field-programmable gate array (FPGA), or other similar components or combinations thereof.

[0016] The control unit 240 is used for user operation, such as a mouse, a touch screen, a touchpad, or a stylus. The display unit 250 is used to display various information, such as an LCD screen or an OLED screen.

[0017] In this embodiment, modeling information MS is added to the photograph PT, enabling the second electronic device 200 to quickly create a 3D model MD. A flowchart is provided below to explain the operation of each component in detail.

[0018] Please refer to Figures 2 and 3A-3B. Figures 3A-3B illustrate a flowchart of a stereoscopic modeling method for video conferencing according to an embodiment of this disclosure. The stereoscopic modeling method for video conferencing includes steps S700, S710, S110-S130, S210, S211, S220, S221, and S230-S250. In step S700, as shown in Figures 1 and 2, a mobile image capturing device 700 takes several photos PT of an object OB and records the modeling information MS corresponding to each photo PT. The modeling information MS includes, for example, a shooting direction, a spatial position, an image size, and shooting parameters.

[0019] Next, in step S710, as shown in Figures 1 and 2, the mobile image capturing device 700 transmits the photo PT and modeling information MS.

[0020] Then, in step S110, as shown in Figures 1 and 2, the first transmission unit 110 of the first electronic device 100 receives the photo PT and modeling information MS from the mobile image capturing device 700.

[0021] Next, in step S120, as shown in Figures 1 and 2, the watermark encoding unit 120 encodes the modeling information MS into each photo PT using a hidden watermark WM. The hidden watermark WM is encoded across the entire area of ​​each photo PT. The hidden watermark is scattered across several pixels, and its presence is imperceptible to the human eye.

[0022] Then, in step S130, as shown in Figures 1 and 2, the first transmission unit 110 transmits the photo PT with the hidden watermark WM.

[0023] Next, in step S210, as shown in Figures 1 and 2, the second transmission unit 210 of the second electronic device 200 receives the photo PT with a hidden watermark WM.

[0024] In step S211, as shown in Figures 1 and 2, the second transmission unit 210 determines whether the photo PT with the hidden watermark WM has been completely received. If the photo PT with the hidden watermark WM has been completely received, then proceed to step S220; if the photo PT with the hidden watermark WM has not been completely received, then return to step S210 and continue to receive the photo PT with the hidden watermark WM.

[0025] Next, in step S220, as shown in Figures 1 and 2, the watermark decoding unit 220 decodes the hidden watermark WM of the photo PT to obtain the modeling information MS. The modeling information MS includes, for example, the shooting direction, spatial position, image size, and shooting parameters.

[0026] Then, in step S221, as shown in Figures 1 and 2, the watermark decoding unit 220 determines whether all hidden watermarks WM have been decoded. If all hidden watermarks WM have been decoded, proceed to step S230; if there are still hidden watermarks WM that have not been decoded, return to step S220 and continue decoding the hidden watermarks WM of the photo PT.

[0027] In step S230, as shown in Figures 1 and 2, the modeling unit 230 establishes the stereo model MD based on the photographs PT and modeling information MS. In this step, the second electronic device 200 establishes the stereo model MD only after receiving all of these photographs PT and decoding all of the modeling information MS.

[0028] Please refer to Figure 4, which illustrates steps S240 and S250. In step S240, the display unit 250 receives a viewing angle VA.

[0029] In step S250, as shown in Figures 2-4, the display unit 250 of the second electronic device 200 displays a stereoscopic model MD. The user can use the control unit 240 to control the angle of the photographic object OB within the display unit 250. For example, the angle of the object OB within the display unit 250 can be controlled using a mouse or keyboard.

[0030] According to the above embodiment, the presenter's first electronic device 100 transmits photos PT showing various views of an object OB to the participant's second electronic device 200 via network 900. Furthermore, modeling information MS is added to the photos PT, enabling the second electronic device 200 to quickly create a 3D model MD. Using the 3D model MD, the participant can rotate the object OB using a mouse or keyboard to fully view the appearance of each facet of the object OB.

[0031] In summary, although this disclosure has been presented above with examples, it is not intended to limit the scope of this disclosure. Those skilled in the art to which this disclosure pertains can make various modifications and refinements without departing from the spirit and scope of this disclosure. Therefore, the scope of protection of this disclosure shall be determined by the appended claims.

[0032] 100: First Electronic Device 110: First Transmission Unit 120: Watermark Encoding Unit 200: Second electronic device 210: Second Transmission Unit 220: Watermark Decoding Unit 230: Modeling Unit 240: Control Unit 250: Display Unit 700: Mobile Image Capture Device 900: Network MD: 3D model MS: Modeling Information OB: Object PT: Photos VA: Viewing Angle WD: Independent window WM: Hide watermark S110, S120, S130, S210, S211, S220, S221, S230, S240, S250, S700, S710: Steps

Claims

1. A method for stereoscopic modeling in video conferencing, comprising: A mobile image capturing device takes multiple photographs of an object and records modeling information corresponding to each photograph; the mobile image capturing device transmits the photographs and modeling information to a first electronic device; the first electronic device encodes each modeling information into each photograph using a hidden watermark; the first electronic device transmits the photographs with the hidden watermarks to a second electronic device; the second electronic device receives the photographs with the hidden watermarks; the second electronic device decodes each hidden watermark in each photograph to extract the modeling information; the second electronic device builds a 3D model based on the photographs and modeling information; and the second electronic device displays the 3D model, wherein during the video conference, the rotation angle of the 3D model on the second electronic device is different from the rotation angle of the object on the first electronic device.

2. The stereoscopic modeling method for video conferencing as described in claim 1, wherein each of the modeling information includes a shooting direction, a spatial position, an image size, and shooting parameters.

3. The stereoscopic modeling method for video conferencing as described in claim 1, wherein each of the hidden watermarks is encoded over the entire area of ​​each of the photographs.

4. The stereoscopic modeling method for video conferencing as described in claim 1, wherein the second electronic device builds the stereoscopic model only after receiving all of the photos with the hidden watermarks.

5. The stereoscopic modeling method for video conferencing as described in claim 1, wherein the stereoscopic model is displayed only after the second electronic device has fully built the stereoscopic model.

6. A stereoscopic modeling method for video conferencing as described in claim 1, wherein the stereoscopic model is stored in the second electronic device.

7. A video conferencing system, comprising: A mobile image capturing device is used to take multiple photographs of an object and record modeling information corresponding to each photograph. A first electronic device includes: a first transmission unit for receiving photographs and modeling information from a mobile image capturing device; a watermark encoding unit for encoding each of the modeling information into each of the photographs using a hidden watermark, the first transmission unit further being used to transmit the photographs with the hidden watermarks; and a second electronic device including: a second transmission unit for receiving the photographs with the hidden watermarks; a watermark decoding unit for decoding each of the hidden watermarks in each photograph to extract the modeling information; a modeling unit for building a stereoscopic model based on the photographs and the modeling information; a control unit for providing a viewing angle; and a display unit for displaying the stereoscopic model according to the viewing angle, wherein during a video conference, the rotation angle of the stereoscopic model on the second electronic device is different from the rotation angle of the object on the first electronic device.

8. The video conferencing system as described in claim 7, wherein each of the modeling information includes a shooting direction, a spatial location, an image size, and shooting parameters.

9. The video conferencing system as described in claim 7, wherein each of the hidden watermarks is encoded over the entire area of ​​each of the photographs.

10. The video conferencing system as described in claim 7, wherein the modeling unit of the second electronic device builds the stereo model only after the second transmission unit of the second electronic device receives all of the photos and all of the modeling information.

11. The video conferencing system as described in claim 7, wherein the display unit of the second electronic device displays the stereoscopic model only after the modeling unit of the second electronic device has fully established the stereoscopic model.

12. The video conferencing system as described in claim 7, wherein the stereoscopic model is stored in the second electronic device.

Images