Conference system

Abstract

To improve a kinetic function based on sensation and sensitiveness.SOLUTION: A conference system 10 comprises a first conference device 12 and a second conference device 13. The first conference device 12 and the second conference device 13 include a display device, a half mirror and an imaging section. The half mirror reflects an image of the display device, and the imaging section images a subject from a back of a reflection face of the half mirror. A first subject image of the imaging section of the first conference device 12 is displayed on the display device of the second conference device 13. A second subject image of the imaging section of the second conference device 13 is displayed on the display device of the first conference device 12. The imaging section of the first conference device 12 images a region excluding a region in which the second subject image is reflected and made incident to the imaging section. The imaging section of the second conference device 13 images a region excluding a region in which the first subject image is reflected and made incident to the imaging section.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a conference system.

Background Art

[0002] A video conference system via communication is known. In the video conference system, moving images of other participants are displayed on a display, and the conference proceeds while the participants look at each other's expressions. In order to improve the sense of presence, it has been proposed to reflect an image of another participant on a mirror covering the surroundings of the user so that the user can visually recognize the other participant, and to image the user through the mirror (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is a possibility that the visibility of other attendees by the user may decrease.

[0005] In view of this point, an object of the present disclosure is to improve the visibility of attendees.

Means for Solving the Problems

[0006] To solve the above-described various problems, a conference system according to a first aspect includes a first conference device and a second conference device having a display device, a half mirror that reflects an image of the display device, and an imaging unit that images a subject from the back of the reflecting surface of the half mirror through the reflecting surface, a first subject image of the imaging unit of the first conference device is displayed on the display device of the second conference device, The second subject image captured by the imaging unit of the second conference device is displayed on the display device of the first conference device. The imaging unit of the first conference device captures an area excluding the area of the half mirror of the first conference device where the second subject image is reflected and incident on the imaging unit. The imaging unit of the second conference device captures an area excluding the area of the half mirror of the second conference device where the first subject image is reflected and incident on the imaging unit.

Advantages of the Invention

[0007] According to the present disclosure, the visibility of the attendees is improved.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the components shown in the following drawings, the same components are denoted by the same reference numerals.

[0010] As shown in FIG. 1, a meeting system 10 according to an embodiment of the present disclosure includes a plurality of meeting devices 11. The plurality of meeting devices 11 includes at least a first meeting device 12 and a second meeting device 13. The plurality of meeting devices 11 may communicate via a network 14.

[0011] In the following description, the operations between the first meeting device 12 and the second meeting device 13 will be described. However, for the meeting devices 11 other than the first meeting device 12 and the second meeting device 13, the first meeting device 12 may perform the same operations as those for the second meeting device 13, and the second meeting device 13 may perform the same operations as those for the first meeting device 12. In the following description, unless otherwise specified, features common to each of the meeting devices 11 will be described.

[0012] As shown in FIG. 2, the conference device 11 includes a display device 15, a half mirror 16, and an imaging unit 17. The conference device 11 may further include an illumination device 18, a plurality of speakers 19, a microphone 20, an input unit 21, a communication unit 22, and a control unit 23. A first direction may be defined for the conference device 11. The first direction may be defined as the direction facing vertically upward when the conference device 11 is installed.

[0013] The display device 15 may be positioned to face the opposite direction of the first direction. The display surface of the display device 15 may be perpendicular to the first direction. The display device 15 displays a subject image captured by the imaging unit 17 of another conference device 11. Specifically, for example, the display device 15 of the first conference device 12 displays a second subject image captured by the imaging unit 17 of the second conference device 13. Also, the display device 15 of the second conference device 13 displays a first subject image captured by the imaging unit 17 of the first conference device 12.

[0014] The image light to be displayed on the display device 15 is reflected by the half mirror 16 as described later. In the display surface of the display device 15, a first area for displaying an image corresponding to the image light reflected by the half mirror 16 toward a specific space area described later is determined by the shape of the half mirror 16, the angle of the half mirror 16 with respect to the space area, the angle of the display surface with respect to the half mirror 16, etc. As shown in FIG. 3, within the entire display surface ds, the first area r1 is a partially annular area in a configuration where the half mirror 16 is frustum-shaped as described later.

[0015] The display device 15 may separately display the subject image oi captured by another conference device 11 in a part of the first area r1. For example, in a situation where a video conference is being held with six conference devices 11, the display device 15 of each conference device 11 may display the subject image oi generated by imaging by another conference device 11 so as to be arranged along the circumferential direction of the first area r1.

[0016] On the display surface ds of the display device 15, the area other than the first area r1 may function as illumination. Specifically, the display device 15 may emit illumination light in the area other than the first area r1.

[0017] The half mirror 16 reflects the image displayed on the display device 15. As shown in FIG. 4, the half mirror 16 may be located in the direction opposite to the first direction from the display device 15. The half mirror 16 may be inclined with respect to the first direction. As shown in FIG. 5, the half mirror 16 may cover at least a part of the periphery of a specific space area sa defined in the conference device 11 when viewed from the first direction.

[0018] As shown in FIG. 4, the specific space area sa may be an area defined within the imaging range of the imaging unit 17 via the half mirror 16. The space area sa may have an arbitrary shape, for example, it may be a prismatic shape or a cylindrical shape with a straight line parallel to the first direction as its axis. The space area sa may be an area where the participants of the video conference are assumed to be located in the conference device 11. When viewed from the first direction, for example, chairs for the participants to sit on may be provided in the space area sa. A front direction may be defined with respect to the space area sa when viewed from the first direction. The front direction with respect to the space area sa may be, for example, the direction in which the imaging unit 17 described later is located.

[0019] The half mirror 16 may face the space area sa at a plurality of points when viewed from the first direction. Facing the space area sa may mean that the normal line nl at a point on the intersection line il of the plane perpendicular to the first direction and the surface of the half mirror 16 passes through the space area sa. For example, the half mirror 16 may be a part of the side surface of a truncated cone, in other words, a part of a mortar shape. Also, for example, as shown in FIG. 6, the half mirror 16 may be a part of the side surface of a truncated pyramid.

[0020] The half mirror 16 may reflect the image light of the image displayed in the first region r1 of the display device 15 toward the spatial region sa. With such a configuration, the participants in the video conference located in the specific spatial region sa can visually recognize the image in the half mirror 16. The half mirror 16 may reflect the light beam of the subject image oi toward the spatial region sa in the corresponding region corresponding to the region where the subject image oi of the display device 15 is displayed. In other words, the subject image oi can be visually recognized in the corresponding region from the spatial region sa, and the subject image oi cannot be visually recognized in the corresponding region from outside the spatial region sa.

[0021] The imaging unit 17 images the subject through the reflecting surface from the back of the reflecting surface of the half mirror 16 with respect to the display device 15. The main subject to be imaged in the conference device 11 is assumed to be the participants in the video conference. Moreover, the installation and orientation may be determined so as to include the spatial region sa where the main subject of the imaging unit 17 is assumed to be located within the imaging range.

[0022] The direction in which the imaging unit 17 and the spatial region sa are arranged may intersect in the first direction. The position of the imaging unit 17 for defining the direction may be, for example, the principal point of the optical system or the intersection of the imaging surface and the optical axis. As will be described later, in a configuration where the imaging unit 17 includes a plurality of cameras, the optical system and the imaging surface of any one of the cameras may be used for defining the direction. The position of the spatial region sa for defining the direction may be the center of the spatial region sa. The direction in which the imaging unit 17 and the spatial region sa are arranged may be parallel to the optical axis, for example.

[0023] The imaging unit 17 may be able to image the subject located in the spatial region sa from a plurality of directions as viewed from the first direction.

[0024] For example, as shown in FIG. 7, the imaging unit 17 may include a plurality of cameras 24. The plurality of cameras 24 may be arranged around the spatial region sa as viewed from the first direction. Further, the plurality of cameras 24 may be arranged such that the spatial region sa is included within the imaging range. Further, the optical axes of the plurality of cameras 24 may pass through the spatial region sa.

[0025] Further, for example, as shown in FIG. 8, the imaging unit 17 may be capable of imaging a subject located in the spatial region sa from a plurality of directions using a single camera 24. The single camera 24 may be arranged such that the optical axis passes through the spatial region sa. The light receiving surface of the camera 24 may be virtually divided into a plurality of regions. The plurality of regions may include, for example, a front region fr, an inclined surface region or, and a side surface region sr. Subject light fluxes of the front of the spatial region sa may be incident on the front region fr. Subject light fluxes of the obliquely front of the spatial region sa may be incident on the inclined surface region or via the first reflection optical system 25. Subject light fluxes of the side of the spatial region sa may be incident on the side surface region sr via the second reflection optical system 26.

[0026] The imaging unit 17 images a region excluding the region of the half mirror 16 where the subject image oi imaged by another conference device 11 is reflected and incident on the imaging unit 17. Specifically, the imaging unit 17 of the first conference device 12 images a region excluding the region of the half mirror 16 of the first conference device 12 where the second subject image oi is reflected and incident on the imaging unit 17. Further, the imaging unit 17 of the second conference device 13 images a region excluding the region of the half mirror 16 of the second conference device 13 where the first subject image oi is reflected and incident on the imaging unit 17. In other words, as shown in FIG. 10, the imaging unit 17 images the subject in the spatial region sa from outside the reflection range ra from the corresponding region cr of the light flux of each subject image oi in the half mirror 16. Each subject image oi means each subject image oi imaged outside its own conference device 11 among all the conference devices 11 participating in the video conference.

[0027] As shown in FIG. 4, the lighting device 18 may be located between the display device 15 and the half mirror 16 in the first direction. The lighting device 18 may emit illumination light for illuminating the spatial region sa.

[0028] As shown in FIG. 9, each of the plurality of speakers 19 may output sound in different directions from the space region sa toward the half mirror 16 when viewed from the first direction. The speaker 19 may have high directivity. As shown in FIG. 3, each speaker 19 may output sound so as to be reflected by the half mirror 16 to the first direction side in the space region sa in a plane parallel to both the first direction and the sound output direction.

[0029] The microphone 20 may detect the sound in the conference device 11.

[0030] The input unit 21 may detect an operation input by the user. The input unit 21 may include, for example, a pointing device, a keyboard, etc.

[0031] The communication unit 22 may include a communication module that communicates with other conference devices 11 via the network 14. The communication unit 22 may transmit and receive various information and commands. The communication unit 22 may, for example, receive the subject image oi as information from another conference device 11. Also, the communication unit 22 may transmit the subject image oi captured by the imaging unit 17 of its own conference device 11 to another conference device 11 as information. The communication unit 22 may transmit the subject image oi while associating the identification information of the conference device 11.

[0032] The control unit 23 is configured to include at least one processor, at least one dedicated circuit, or a combination thereof. The processor is a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for specific processing. The dedicated circuit may be, for example, an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc. The control unit 23 controls the operation of the conference device 11.

[0033] Based on the operation input to the input unit 21, the control unit 23 may set up a communication conference. In setting up the communication conference, the conference devices 11 participating in the communication conference and the conference date and time are determined. The setting information of the communication conference is stored in any one of the conference devices 11 participating in the communication conference or an external server connected via the network 14.

[0034] Based on the operation to the input unit 21, the control unit 23 may participate in a set communication conference. Specifically, the control unit 23 may participate in the communication conference by transmitting the information of entering the conference to the conference device 11 that stores the setting information of the communication conference. The control unit 23 may receive the identification information of other conference devices 11 participating in the communication conference by participating in the communication conference. In the following description, other conference devices 11 mean other conference devices 11 participating in the communication conference in which the own conference device 11 participates. The control unit 23 can transmit information to a specific one of the other conference devices 11 by acquiring the identification information of the other conference devices 11.

[0035] Based on the operation input to the input unit 21, the control unit 23 may select any one of a plurality of seats installed in the virtual space in the communication conference as the seat to sit on. The control unit 23 may transmit the selected seat as information to other conference devices 11. When the control unit 23 receives the information of the selected seat from other conference devices 11, it may notify the user that the seat cannot be selected. The notification may be made, for example, by display on the display device 15.

[0036] Based on the operation input to the input unit 21, the control unit 23 may select a conference form in the virtual space. The conference form may include, for example, a first form in which seats 28 are arranged in the circumferential direction of the round table 27 as shown in FIG. 11, a second form in which seats 28 are arranged to face each other along the longitudinal direction of the rectangular table 29 as shown in FIG. 12, and the like. In each conference form, the front direction for each seat 28 may be determined. The front direction may be the direction from the seat 28 toward the tables 27, 29.

[0037] In a communication conference, the control unit 23 may determine the virtual relative positional relationship of each of the plenary conference devices 11. Therefore, in the communication conference of the first conference device 12 and the second conference device 13, the relative positional relationship between the first conference device 12 and the second conference device 13 may be determined. The control unit 23 may determine the virtual relative positional relationship by recognizing the position of the plenary conference device 11 with respect to the seat 28 in the virtual space.

[0038] In a communication conference, the control unit 23 may generate an image to be displayed on the display device 15. The generated image may include the subject image oi of each of the other conference devices 11 so as to reflect the subject image oi of each of the other conference devices 11 in the corresponding direction corresponding to each of the other conference devices 11 from the space area sa of its own conference device 11. The corresponding direction is the direction from the conference device 11 to each of the other conference devices 11 in the virtual relative positional relationship. Therefore, the second subject image oi may be displayed on the display device 15 of the first conference device 12 so as to reflect the second subject image oi in the corresponding direction corresponding to the second conference device 13 from the space area sa of the first conference device 12. The corresponding direction corresponding to the second conference device 13 is the direction from the first conference device 12 to the second conference device 13 in the virtual relative positional relationship. Also, the first subject image oi may be displayed on the display device 15 of the second conference device 13 so as to reflect the first subject image oi in the corresponding direction corresponding to the first conference device 12 from the space area sa of the second conference device 13. The corresponding direction corresponding to the first conference device 12 is the direction from the second conference device 13 to the first conference device 12 in the virtual relative positional relationship.

[0039] A more specific method for generating the image as described above will be explained below. For generating the image, the control unit 23 may determine the position of the corresponding region cr corresponding to the subject image oi captured by another conference device 11 from the virtual relative position relationship within the half mirror 16 in its own conference device 11. The control unit 23 may define the corresponding region cr as a vicinity region including the point where the direction in which each of the other conference devices 11 is located in the conference form in the virtual space intersects with the half mirror 16 in the same direction as its own conference device 11, with the front direction in its own conference device 11 being aligned with the front direction in the conference form in the virtual space. For example, the control unit 23 may define the region of the half mirror 16 extended from the spatial region sa in the first conference device 12 as the corresponding region cr corresponding to the second subject image oi in the first conference device 12 in the same direction as the direction in which the second conference device 13 is located in the conference form in the virtual space with respect to the first conference device 12.

[0040] The control unit 23 may determine the drawing position of the subject image oi on the display device 15 so that the light beam of the subject image oi can be reflected by the spatial region sa through the corresponding region cr corresponding to each subject image oi. The control unit 23 may generate the image to be displayed on the display device 15 by drawing the subject image oi at the determined drawing position. The control unit 23 may change the size of the subject image oi according to the distance from the seat 28 of its own conference device 11 selected to the seat 28 of the other conference device 11 in the virtual relative position relationship. Specifically, the control unit 23 may draw the subject image oi to be larger as the distance is closer and smaller as the distance is farther.

[0041] The control unit 23 may draw an image of the furniture virtually in the meeting form on the display image together with the subject image oi. The control unit 23 may draw an image of the furniture according to the position selected by another conference device 11. For example, the control unit 23 may superimpose the subject image oi of the conference device 11 that has selected another seat 28 located without sandwiching the desks 27 and 29 with respect to the seat 28 selected by its own conference device 11 on the image of the furniture. Further, for example, the control unit 23 may superimpose the image of the furniture on the subject image oi of the conference device 11 that has selected another seat 28 located with the desks 27 and 29 sandwiched with respect to the seat 28 selected by its own conference device 11.

[0042] The control unit 23 may select, from among a plurality of directions in which a subject located in the space area sa can be imaged in its own conference device 11, the four directions closest to the direction from the space area sa to the corresponding area cr corresponding to the subject image oi in each other conference device 11. The closest direction is the direction with the smallest included angle when viewed from the first direction between the direction from the space area sa to the corresponding area cr. The control unit 23 may recognize the subject image oi captured from the selected direction as the subject image oi to be transmitted to each other conference device 11 corresponding to each corresponding area cr. The control unit 23 may transmit the recognized subject image oi to each other conference device 11.

[0043] Therefore, for example, in the first conference device 12, an image captured from the direction closest to the direction from the first conference device 12 to the second conference device 13 in the virtual relative positional relationship may be used as the first subject image oi to be displayed in the second conference device 13. Further, in the second conference device 13, an image captured from the direction closest to the direction from the second conference device 13 to the first conference device 12 in the virtual relative positional relationship may be used as the second subject image oi to be displayed in the first conference device 12.

[0044] The control unit 23 may synthesize a subject image oi of a subject located in the spatial region sa from the corresponding region cr based on the original image generated by the imaging unit 17 through imaging. The control unit 23 may synthesize the subject image oi for each corresponding region cr. The control unit 23 may recognize the synthesized subject image oi corresponding to each corresponding region cr as a subject image to be transmitted to each other conference device 11 corresponding to the respective corresponding regions cr. The control unit 23 may transmit the recognized subject image oi to each of the other conference devices 11.

[0045] Therefore, for example, in the first conference device 12, a first subject image oi displayed in the second conference device 13 may be synthesized based on the original image generated by the imaging unit 17 through imaging. Also, for example, in the second conference device 13, a second subject image oi displayed in the first conference device 12 may be synthesized based on the original image generated by the imaging unit 17 through imaging.

[0046] The control unit 23 may transmit the sound detected by the microphone 20 as information to the other conference devices 11.

[0047] The control unit 23 may cause the sound transmitted from the other conference device 11 to be output from the speaker 19 that outputs the sound toward the closest position to the corresponding region cr corresponding to the subject image oi transmitted from the conference device 11. Therefore, for example, the sound detected by the second conference device 13 may be output from the speaker 19 that outputs the sound toward the closest position to the region of the half mirror 16 that reflects the second subject image oi toward the spatial region sa.

[0048] Next, the conference process executed by the control unit 23 in the present embodiment will be described using the flowchart of FIG. 13. The conference process starts, for example, when the input unit 21 detects an operation input to participate in a communication conference. The conference process ends, for example, when the input unit 21 detects an operation input to leave the communication conference.

[0049] In step S100, the control unit 23 determines whether it has acquired identification information from another conference device 11. If it has not acquired it, the process repeats step S100. If it has acquired it, the process proceeds to step S101.

[0050] In step S101, the control unit 23 selects a seat 28 to be seated in the virtual space of the communication conference to participate in. The selection of the seat 28 may be based on the detection result of the operation input to the input unit 21. Further, the control unit 23 transmits the selected seat 28 as information to the other conference devices 11. After the selection, the process proceeds to step S102.

[0051] In step S102, the control unit 23 determines the relative positional relationship of the plurality of conference devices 11 participating in the communication conference based on the seat 28 selected in step S101 and the seats 28 respectively selected by the other conference devices 11. After the determination, the process proceeds to step S103.

[0052] In step S103, the control unit 23 determines a corresponding area cr corresponding to the subject image oi acquired from each of the other conference devices 11 within the half mirror 16. After the determination, the process proceeds to step S104.

[0053] In step S104, the control unit 23 generates a display image in which the subject image oi is drawn at a position based on the corresponding area cr determined for each of the other conference devices 11 determined in step S103. After the generation, the process proceeds to step S105.

[0054] In step S105, the control unit 23 causes the display device 15 to display the display image generated in step S104. After the display, the process proceeds to step S106.

[0055] In step S106, based on the corresponding area cr determined in step S103, the control unit 23 acquires the subject image oi as seen from the corresponding area cr of each of the other conference devices 11. As described above, the subject image oi may be an image selected from among images captured from a plurality of directions, or may be synthesized from the original images generated by the imaging unit 17. Further, the control unit 23 transmits the acquired subject image oi to each of the other conference devices 11. After the transmission, the process proceeds to step S107.

[0056] In step S107, the control unit 23 selects the speaker 19 that outputs the audio received from the other conference device 11, based on the conference device 11 that transmitted the audio and the corresponding area cr determined in step S103 for that conference device 11. After the selection, the process proceeds to step S108.

[0057] In step S108, the control unit 23 outputs the audio from the speaker 19 selected in step S107. After the output, the process proceeds to step S109.

[0058] In step S109, the control unit 23 transmits, as information, the audio detected by the microphone 20 to the other conference devices 11. After the transmission, the process returns to step S104.

[0059] The conference system 10 of the present embodiment configured as described above includes a first conference device 12 and a second conference device 13 having a display device 15, a half mirror 16 that reflects the image of the display device 15, and an imaging unit 17 that images a subject through the reflection surface from the back of the reflection surface of the half mirror 16. In the conference system 10, the first subject image oi of the imaging unit 17 of the first conference device 12 is displayed on the display device 15 of the second conference device 13, and the second subject image oi of the imaging unit 17 of the second conference device 13 is displayed on the display device 15 of the first conference device 12. The imaging unit 17 of the first conference device 12 images a region excluding the region of the half mirror 16 of the first conference device 12 where the second subject image oi is reflected and incident on the imaging unit 17, and the imaging unit 17 of the second conference device 13 images a region excluding the region of the half mirror 16 of the second conference device 13 where the first subject image oi is reflected and incident on the imaging unit 17. In the video conferencing system described in Patent Document 1, while imaging a user in an imaging display device constituting the video conferencing system, the image of the user imaged by another imaging display device is visually recognized by reflecting it with optical means. In such a configuration described in Patent Document 1, the imaging means of the imaging display device images not only the original imaging target user but also the optical image of the user imaged by another imaging display device. Therefore, in another imaging display means of an arbitrary imaging display means, a user who does not exist in the arbitrary imaging display means is displayed. As a result, the users participating in the conference are displayed repeatedly on the imaging display means. For this reason, the video conferencing system described in Patent Document 1 had room for improvement in the visibility of the attendees. In response to such an event, the conference system 10 having the above-described configuration does not image the subject image oi of another conference device 11 because the imaging unit 17 is out of the direction in which the subject image oi of another conference device 11 is reflected, and images the attendees of its own conference device 11. Therefore, the conference system 10 prevents overlapping display of the attendees, thereby improving visibility.

[0060] In the conference system 10, a specific spatial region sa is defined within the imaging range of the imaging unit 17 via the half mirror 16 in the conference device 11. The half mirror 16 covers the spatial region sa as viewed from a first direction intersecting the direction in which the imaging unit 17 and the spatial region sa are arranged, and the half mirror 16 faces the spatial region sa at a plurality of points as viewed from the first direction. With such a configuration, the conference system 10 can improve the sense of presence compared to a configuration that allows an image to be visually recognized only in front of the user.

[0061] In the conference system 10, there are further provided a plurality of speakers 19 that output sound in different directions from the spatial region sa toward the half mirror 16 as viewed from the first direction. The sound detected by the second conference device 13 is output from the speaker 19 that outputs sound toward the closest region of the region of the half mirror 16 that reflects the second subject image oi toward the spatial region sa in the first conference device 12. With such a configuration, the conference system 10 can cause the attendee who is the user of the conference device 11 to recognize the sound of the other attendees of the conference from a direction close to the viewing direction of the other attendees. Therefore, the conference system 10 can improve the sense of presence.

[0062] In the conference system 10, the region other than the first region r1 of the image reflected in the spatial region sa via the half mirror 16 on the display surface ds of the display device 15 functions as illumination. With such a configuration, the conference system 10 can effectively utilize the area other than the drawing area of the image to be visually recognized by the attendees.

[0063] The conference system 10 further includes an illumination device 18 located between the display device 15 and the half mirror 16 in the first direction. With such a configuration, the conference system 10 can clearly capture the subject.

[0064] In the conference system 10, in a conference between the first conference device 12 and the second conference device 13, a virtual relative positional relationship between the first conference device 12 and the second conference device 13 is defined. The second subject image oi is displayed on the display device 15 of the first conference device 12 so as to be reflected from the space area sa of the first conference device 12 in the direction from the first conference device 12 to the second conference device 13 in the virtual relative positional relationship. The first subject image oi is displayed on the display device 15 of the second conference device 13 so as to be reflected from the space area sa of the second conference device 13 in the direction from the second conference device 13 to the first conference device 12 in the virtual relative positional relationship. With such a configuration, as shown in FIG. 14, the conference system 10 allows the subject image oi to be visually recognized through the half mirror 16 as if the subject images oi were gathered in the same space, as compared with a configuration in which the subject images oi are merely visually recognized as being arranged in a linear or matrix form. Therefore, the conference system 10 can improve the sense of presence.

[0065] In the conference system 10, on the display device 15 of the first conference device 12, the first subject image oi of the space area sa of the second conference device 13 as seen in the direction from the first conference device 12 to the second conference device 13 in the virtual relative positional relationship is displayed. On the display device 15 of the second conference device 13, the second subject image oi of the space area sa of the first conference device 12 as seen in the direction from the second conference device 13 to the first conference device 12 in the virtual relative positional relationship is displayed. With such a configuration, as shown in FIG. 14, in the conference system 10, in any conference device 11, the subject image oi of the attendee in the teleconference using another conference device 11 can be visually recognized in the half mirror 16 in a posture of actually attending a specific conference form in the same space. Therefore, the conference system 10 can improve the sense of presence.

[0066] In one embodiment, (1) the conference system is A conference system comprising a first conference device and a second conference device, the first conference device including a display device, a half mirror for reflecting an image of the display device, and an imaging unit for imaging a subject through the reflecting surface from the back of the reflecting surface of the half mirror, wherein: The first subject image captured by the imaging unit of the first conference device is displayed on the display device of the second conference device; The second subject image captured by the imaging unit of the second conference device is displayed on the display device of the first conference device; The imaging unit of the first conference device captures an area excluding the area of the half mirror of the first conference device where the second subject image is reflected and incident on the imaging unit; The imaging unit of the second conference device captures an area excluding the area of the half mirror of the second conference device where the first subject image is reflected and incident on the imaging unit.

[0067] (2) In the conference system of (1) above, A specific spatial area is defined within the imaging range of the imaging unit via the half mirror in the conference device, The half mirror covers at least a part of the periphery of the spatial area when viewed from a first direction intersecting the direction in which the imaging unit and the spatial area are arranged, When viewed from the first direction, the half mirror faces the spatial area at a plurality of points.

[0068] (3) The conference system of (2) above further comprises, A plurality of speakers for outputting sound in different directions from the spatial area towards the half mirror when viewed from the first direction, The sound detected by the second conference device is output from the speaker that outputs sound towards the closest area of the half mirror that reflects the second subject image towards the spatial area in the first conference device.

[0069] (4) In the conference system of (2) or (3) above, The half mirror is in the shape of a mortar.

[0070] (5) In any of the conference systems of (2) to (4) above, In the display surface of the display device, an area other than the first area of the image reflected in the space area through the half mirror functions as illumination.

[0071] (6) Any of the conference systems of (2) to (5) above further includes an illumination device located between the display device and the half mirror in the first direction.

[0072] (7) In any of the conference systems of (2) to (6) above, In the conference between the first conference device and the second conference device, a virtual relative positional relationship between the first conference device and the second conference device is defined. The second subject image is displayed on the display device of the first conference device so as to be reflected from the space area of the first conference device in the corresponding direction corresponding to the second conference device. The first subject image is displayed on the display device of the second conference device so as to be reflected from the space area of the second conference device in the corresponding direction corresponding to the first conference device. The corresponding direction corresponding to the second conference device is the direction from the first conference device to the second conference device in the virtual relative positional relationship. The corresponding direction corresponding to the first conference device is the direction from the second conference device to the first conference device in the virtual relative positional relationship.

[0073] (8) In the conference system of (7) above, On the display device of the first conference device, a first subject image of viewing the space area of the second conference device in the direction from the first conference device to the second conference device in the virtual relative positional relationship is displayed. On the display device of the second conference device, a second subject image is displayed, which is an image of the space area of the first conference device viewed in the direction from the second conference device to the first conference device in the virtual relative positional relationship.

[0074] (9) In the conference system of (8) above, The imaging unit can image a subject located in the space area from a plurality of directions, In the first conference device, among the plurality of directions, an image captured from the direction closest to the direction from the first conference device to the second conference device in the virtual relative positional relationship is used as the first subject image, In the second conference device, among the plurality of directions, an image captured from the direction closest to the direction from the position of the second conference device to the first conference device in the virtual relative positional relationship is used as the first subject image.

[0075] (10) In the conference system of (8) above, In the first conference device, the first subject image is synthesized based on the original image generated by the imaging unit through imaging, In the second conference device, the second subject image is synthesized based on the original image generated by the imaging unit through imaging.

[0076] As described above, the embodiments of the conference system 10 have been described. As embodiments of the present disclosure, in addition to the method or program for implementing the device, embodiments as a storage medium (for example, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a hard disk, or a memory card, etc.) on which the program is recorded are also possible.

[0077] Furthermore, the implementation form of the program is not limited to application programs such as object code compiled by a compiler and program code executed by an interpreter, and may be in the form of program modules incorporated into an operating system. Further, the program may or may not be configured such that all processing is performed only by the CPU on the control board. The program may be configured such that part or all of it is performed by another processing unit implemented on an expansion board or expansion unit added to the board as needed.

[0078] The drawings for explaining the embodiments according to the present disclosure are schematic. The dimensional ratios and the like on the drawings do not necessarily match the actual ones.

[0079] Although the embodiments according to the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can make various modifications or alterations based on the present disclosure. Therefore, it should be noted that these modifications or alterations are included in the scope of the present disclosure. For example, the functions and the like included in each component can be rearranged so as not to be logically contradictory, and a plurality of components can be combined into one or divided.

[0080] All of the constituent elements described in the present disclosure, and / or all of the disclosed methods, or all of the steps of the processes, can be combined in any combination except combinations in which these features are mutually exclusive. Also, each of the features described in the present disclosure can be replaced with an alternative feature that serves the same purpose, an equivalent purpose, or a similar purpose, unless explicitly negated. Therefore, unless explicitly negated, each of the disclosed features is merely an example of a comprehensive series of identical or equivalent features.

[0081] Furthermore, the embodiments according to the present disclosure are not limited to any specific configuration of the above-described embodiments. The embodiments according to the present disclosure can be extended to all novel features described in the present disclosure, or combinations thereof, or all novel methods described, or processing steps, or combinations thereof.

[0082] In the present disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configurations. The configurations distinguished by the descriptions such as "first" and "second" in the present disclosure can have their numbers exchanged in the configuration. For example, the first conference device can have the identifiers "first" and "second" exchanged with the second conference device. The exchange of identifiers is performed simultaneously. Even after the exchange of identifiers, the configurations are still distinguishable. The identifiers can be deleted. The configurations with the identifiers deleted are distinguished by symbols. Based only on the descriptions of identifiers such as "first" and "second" in the present disclosure, the order of the configurations should not be interpreted, nor should it be used as the basis for the existence of an identifier with a smaller number.

Description of Symbols

[0083] 10 Conference system 11 Conference device 12 First conference device 13 Second conference device 14 Network 15 Display device 16 Half mirror 17 Imaging unit 18 Lighting device 19 Speaker 20 Microphone 21 Input unit 22 Communication unit 23 Control unit 24 Camera 25 First reflective optical system 26 Second reflective optical system 27 Round table 28 Seat 29 Rectangular desk cr Corresponding area ds Display surface fr Front area the intersection line the normal line the object image the inclined surface area the first area the space area the side area

Claims

1. A conference system including a first conference device and a second conference device, the first conference device comprising a display device, a half mirror for reflecting an image of the display device, and an imaging unit for imaging a subject through the reflection surface from the back of the reflection surface of the half mirror, wherein: a first subject image captured by the imaging unit of the first conference device is displayed on the display device of the second conference device; a second subject image captured by the imaging unit of the second conference device is displayed on the display device of the first conference device; the imaging unit of the first conference device images a region excluding the region of the half mirror of the first conference device where the second subject image is reflected and incident on the imaging unit; the imaging unit of the second conference device images a region excluding the region of the half mirror of the second conference device where the first subject image is reflected and incident on the imaging unit. Conference system.

2. In the conference system according to Claim 1, a specific spatial region is defined within the imaging range of the imaging unit via the half mirror in the conference device; the half mirror covers at least a part of the periphery of the spatial region when viewed from a first direction intersecting the direction in which the imaging unit and the spatial region are arranged; when viewed from the first direction, the half mirror faces the spatial region at a plurality of points. Conference system.

3. In the conference system according to Claim 2, further comprising a plurality of speakers for outputting sound in different directions from the spatial region toward the half mirror when viewed from the first direction; the sound detected by the second conference device is output from the speaker that outputs sound toward the closest region of the region of the half mirror that reflects the second subject image toward the spatial region in the first conference device. Conference system.

4. In the conference system according to Claim 2 or 3, the half mirror is in a mortar shape. Conference system.

5. In the conference system according to Claim 2 or 3, in the display surface of the display device, a region other than the first region of the image reflected to the spatial region via the half mirror functions as illumination. Conference system.

6. In the conference system according to Claim 2 or 3, further comprising an illumination device located between the display device and the half mirror in the first direction. Conference system.

7. In the conference system according to Claim 2 or 3, In a meeting between the first conference device and the second conference device, a virtual relative positional relationship between the first conference device and the second conference device is defined. The second subject image is displayed on the display device of the first conference device so as to be reflected in a corresponding direction corresponding to the second conference device from the space region of the first conference device. The first subject image is displayed on the display device of the second conference device so as to be reflected in a corresponding direction corresponding to the first conference device from the space region of the second conference device. The corresponding direction corresponding to the second conference device is the direction from the first conference device to the second conference device in the virtual relative positional relationship. The corresponding direction corresponding to the first conference device is the direction from the second conference device to the first conference device in the virtual relative positional relationship. Conference system.

8. In the conference system according to claim 7, On the display device of the first conference device, a first subject image of the space region of the second conference device viewed in the direction from the first conference device to the second conference device in the virtual relative positional relationship is displayed. On the display device of the second conference device, a second subject image of the space region of the first conference device viewed in the direction from the second conference device to the first conference device in the virtual relative positional relationship is displayed. Conference system.

9. In the conference system according to claim 8, The imaging unit can image a subject located in the space region from a plurality of directions. In the first conference device, an image captured from the direction closest to the direction from the first conference device to the second conference device in the virtual relative positional relationship among the plurality of directions is used as the first subject image. In the second conference device, an image captured from the direction closest to the direction from the position of the second conference device to the first conference device in the virtual relative positional relationship among the plurality of directions is used as the first subject image. Conference system.

10. In the conference system according to claim 8, In the first conference device, the first subject image is synthesized based on the original image generated by the imaging unit through imaging. In the second conference device, the second subject image is synthesized based on the original image generated by the imaging unit through imaging. Conference system.

Images