Image communication equipment
The image communication device with multiple cameras and display units addresses the limitations of conventional tools by enabling flexible, operator-controlled communication with enhanced interaction capabilities.
Patent Information
- Application Number
- JP2021117291
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-15
- Publication Date
- 2025-10-24
- Estimated Expiration
- 2041-07-15
AI Technical Summary
Conventional online communication tools face limitations such as restricted field of view, difficulty in managing multiple cameras, and complex operation, making flexible communication challenging, especially in large gatherings or events.
An image communication device with multiple cameras and display units, controlled by a single operator, allowing independent image and sound management, enabling flexible communication.
Facilitates highly flexible communication by a single operator, enhancing ease of operation and management, and supporting richer, more realistic interactions.
Smart Images

Figure 0007759609000001 
Figure 0007759609000002 
Figure 0007759609000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an image communication apparatus. [Background technology]
[0002] An interactive virtual telepresence system has been proposed that allows an Internet user to view a remote object in three dimensions from any direction (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication 2004-514205 Summary of the Invention [Problem to be solved by the invention]
[0004] Events that bring together large numbers of people, such as trips and exhibitions, are essential to human daily life. However, some people are unable to attend these events due to reasons such as the distance of the venue or the fact that they are currently recovering from an illness. Particularly in the current pandemic situation, the number of participants and movement of people at events are strictly restricted in order to prevent the spread of infection. In response to this, the use of online communication tools (e.g., Zoom (registered trademark), Skype (registered trademark)) has recently become widespread, making it possible to share video and audio from remote locations without having to travel to the site. Hereinafter, this virtual experience of a situation in which a person in a remote location (hereinafter referred to as the "client") is accompanied by a person on-site (hereinafter referred to as the "reporter") is referred to as an "online tour."
[0005] However, conventional online communication tools have limitations, such as the fact that the communication they can achieve is limited to those using cameras with a limited field of view, or that if an unexpected third party appears at an event, it is difficult to fully communicate with that third party. This makes it difficult to achieve free communication. Furthermore, when using online communication tools equipped with many cameras, the equipment becomes large-scale, making operation and management complex, which creates the problem of being unable to operate and control it by the operator alone.
[0006] The present invention has been made in view of the above circumstances, and its object is to provide an online communication tool that allows highly flexible communication to be realized by the operator alone. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems, an image communication device according to one embodiment of the present invention includes a first camera that captures an image on the side of an operator, a second camera that captures an image on the side opposite the operator, a first display unit facing the side of the operator, a second display unit facing the side opposite the operator, a communication unit, and a control unit. The first display unit and the second display unit each independently display an image captured by the first camera or the second camera. The communication unit transmits the image captured by the first camera or the second camera to a remote communication device and displays the transmitted image on the display unit of the remote communication device. The control unit independently controls the display of the image on the first display unit, the second display unit, and the display unit of the remote communication device. The control content of the control unit can be operated only by the operator.
[0008] According to this aspect, it is possible to provide an image communication device as an online communication tool that can realize highly flexible communication through operations by the operator alone.
[0009] In one embodiment, the image communication device may further include a third camera that captures images of the operator's surroundings. The first display unit and the second display unit may each independently display images captured by the first camera, the second camera, or the third camera. The communication unit may transmit images captured by the first camera, the second camera, or the third camera to a remote communication device.
[0010] In one embodiment, the remote communication device may include a camera. The communication unit of the image communication device may receive images captured by the camera of the remote communication device and display the received images on the first display unit and the second display unit. The first display unit, the second display unit, and the display unit of the remote communication device may each independently display images captured by the first camera, the second camera, or the camera of the remote communication device.
[0011] In one embodiment, the image communication device may further include a storage unit that stores prepared image content. The first display unit and the second display unit may each independently display an image captured by the first camera, an image captured by the second camera, or image content stored in the storage unit. The communication unit may transmit the image captured by the first camera, an image captured by the second camera, or image content stored in the storage unit to a remote communication device.
[0012] In one embodiment, the image communication device may further include microphones paired with the first camera, the second camera, and the third camera, respectively, and speakers for playing back sounds collected by the microphones. Each of these microphones may collect sounds around the first camera, the second camera, and the third camera, respectively. In this case, the control unit may independently control the playback of the sounds collected by each of these microphones.
[0013] In one embodiment, the image communication apparatus may further include an operation panel for an operator to operate the control contents of the control unit.
[0014] In one embodiment, the image communication device may further include a fourth camera that captures images in a direction different from the directions captured by the first and second cameras, and a third display unit facing the direction captured by the fourth camera. The first display unit, the second display unit, and the third display unit may each independently display images captured by the first camera, the second camera, or the fourth camera. The communication unit may transmit images captured by the first camera, the second camera, or the fourth camera to a remote communication device.
[0015] In one embodiment, the image communication device may further include a 3D imaging unit that creates a 3D image from the images captured by the first camera and the second camera.
[0016] In an embodiment, the image communication device may further include an AR image generation unit that generates an AR image to be displayed on the first display unit and the second display unit.
[0017] In one embodiment, the image communication device may further include an omnidirectional microphone that collects sounds from the entire surroundings of the operator.
[0018] In addition, any combination of the above components, or mutual substitution of the components or expressions of the present invention between methods, devices, programs, temporary or non-temporary storage media on which programs are recorded, systems, etc., are also valid aspects of the present invention. [Effects of the Invention]
[0019] According to the present invention, it is possible to provide an online communication tool that allows highly flexible communication to be realized by the operator alone. [Brief explanation of the drawings]
[0020] [Figure 1] 1 is a functional block diagram of an image communication apparatus according to a first embodiment. [Figure 2] FIG. 2 is a diagram showing a state in which the image communication apparatus of FIG. 1 is used for an online tour. [Figure 3] FIG. 10 is a functional block diagram of an image communication apparatus according to a second embodiment. [Figure 4] 4 is a diagram showing a state in which a reporter holds the main body of the image communication apparatus of FIG. 3 in his left hand and a third camera in his right hand. [Figure 5] (a) shows an image displayed on the first display unit of the image communication device 2 in Figure 3. (b) shows an image displayed on the second display unit of the image communication device in Figure 3. (c) shows an image displayed on the display unit of the client's communication terminal. [Figure 6] FIG. 10 is a functional block diagram of an image communication apparatus according to a third embodiment. [Figure 7] FIG. 10 is a functional block diagram of an image communication apparatus according to a fourth embodiment. [Figure 8] FIG. 13 is a functional block diagram of an image communication apparatus according to a fifth embodiment. [Figure 9] FIG. 13 is a functional block diagram of an image communication apparatus according to a sixth embodiment. [Figure 10] FIG. 13 is a functional block diagram of an image communication apparatus according to a seventh embodiment. [Figure 11] FIG. 13 is a functional block diagram of an image communication apparatus according to an eighth embodiment. [Figure 12] FIG. 13 is a functional block diagram of an image communication apparatus according to a ninth embodiment. [Figure 13] FIG. 22 is a functional block diagram of an image communication apparatus according to a tenth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0021] The present invention will be described below based on preferred embodiments with reference to the drawings. In the embodiments and modifications, identical or equivalent components and parts are designated by the same reference numerals, and redundant description will be omitted where appropriate. The dimensions of the components in the drawings are enlarged or reduced as appropriate for ease of understanding. Some elements that are not important for explaining the embodiments are omitted from the drawings. Terms including ordinal numbers such as "first" and "second" are used to describe various components, but these terms are used only to distinguish one component from another and do not limit the components.
[0022] Before describing specific embodiments, an overview will first be provided. This embodiment relates to an image communication device (hereinafter referred to as "the image communication device"). An example in which the image communication device is used for an online travel tour will be described below. In this case, a reporter (e.g., a tour guide) carries the image communication device and operates it while moving around the site. Clients in remote locations participate in the online tour using communication terminals (communication devices such as smartphones and tablet terminals) equipped with a display unit.
[0023] This image communication device is equipped with a camera (hereinafter referred to as the "first camera") that captures the side of the reporter (hereinafter referred to as the "operator") who is the operator of this image communication device, and a camera (hereinafter referred to as the "second camera") that captures the side opposite the operator. The first camera corresponds to the front camera or in-camera of a smartphone. The second camera corresponds to the rear camera or out-camera of a smartphone. This image communication device also has a display unit (hereinafter referred to as the "first display unit") that faces the side of the operator, and a display unit (hereinafter referred to as the "second display unit") that faces the side opposite the operator. Note that the first display unit corresponds to the display of a smartphone, but the second display unit is a configuration not provided in conventional smartphones.
[0024] The first display unit and the second display unit independently display images captured by the first camera or the second camera. That is, the images displayed on the first display unit and the second display unit may be the same or different. The display methods (image layout, image size ratio, image magnification / reduction ratio, resolution, color balance, etc.) of the images displayed on the first display unit and the second display unit may also be the same or different. For example, the first display unit and the second display unit may both display images captured by the first camera. Alternatively, the first display unit may display images captured by the second camera, and the second display unit may display images captured by the first camera. Furthermore, the first display unit may display both images captured by the first camera and the second camera at a size ratio of 3:7, and the second display unit may display both images captured by the first camera and the second camera at a size ratio of 1:1.
[0025] The image communication device includes a communication unit that transmits an image captured by the first camera or the second camera to a client communication terminal and displays the transmitted image on a display unit of the client communication terminal. The image displayed on the display unit of the client communication terminal may be the same as or different from the image displayed on the first display unit or the second display unit.
[0026] This image communication device includes a control unit. This control unit independently controls the display of images on the first display unit, the second display unit, and the display unit of the client communication terminal. That is, it is possible to independently select which images to display on the first display unit, the second display unit, and the display unit of the client communication terminal, and to independently change the display method (image layout, magnification / reduction ratio, resolution, color balance, etc.). Furthermore, these display controls can be independently operated by an operator.
[0027] The reporter (operator) moves around the site while carrying this image communication device. The first camera captures the reporter explaining the site and sharing his or her impressions. The second camera captures what the reporter sees. At this time, for example, a salesperson at a store visited or a person encountered by chance at the site (hereinafter referred to as a "third party") may want to participate in the online tour communication. Such third parties are not necessarily predetermined individuals, may not necessarily have communication terminals, and it is unknown when they will join or leave the communication. Even in such cases, the image communication device can capture such third parties using the second camera. At this time, the first display unit displays images captured by the first camera and the second camera toward the reporter. Meanwhile, the second display unit displays images captured by the first camera and the second camera toward the third party. The display unit of the client terminal displays images captured by the first camera and the second camera toward the client. This allows the reporter, client, and third party to freely communicate with each other. In this case, the reporter can independently control what images and how they are displayed on the first display unit, the second display unit, and the display unit of the client terminal, which dramatically improves the degree of freedom of communication in online tours compared to conventional systems.
[0028] Furthermore, this image communication device can be configured using a simple equipment configuration and operation interface, making operation and management easy, and the display screen and other controls can be controlled by the operator alone.
[0029] As described above, the image communication apparatus according to this embodiment can provide an online communication tool that allows highly flexible communication to be realized by the operator alone.
[0030] The above describes the use of online tours for travel as an example. However, the present image communication device is not limited to this, and can be applied to various online tours such as exhibitions, school performances, sporting events, weddings, entrance and graduation ceremonies, company and school guides, etc. Also, in the above example, the reporter and client communicated directly end-to-end. However, the present invention is not limited to this, and the image communication device according to this embodiment can also be used to provide services via broadcasting stations or online service providers, such as providing information from TV program performers (reporters) to viewers (clients).
[0031] [First embodiment] 1 is a functional block diagram of an image communication device 1 according to a first embodiment. Image communication device 1 includes a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, and a control unit 40. Image communication device 1 is connected to a remote client communication terminal 100 via a network such as the Internet. Client communication terminal 100 includes a display unit 120.
[0032] The first camera 11 captures the reporter's (operator's) side (mainly the reporter himself). The second camera 12 captures the opposite side of the reporter (mainly what the reporter sees). The first display 21 faces the reporter's side and is mainly observed by the reporter. The second display 22 faces the opposite side of the reporter and is mainly observed by a person facing the reporter.
[0033] First display unit 21 and second display unit 22 each independently display an image captured by first camera 11 or second camera 12. For example, the images displayed on first display unit 21 and second display unit 22 may be the same or different. The display methods (image layout, image size ratio, image enlargement / reduction ratio, resolution, color balance, etc.) of the images displayed on first display unit 21 and second display unit 22 may also be the same or different.
[0034] The communication unit 30 transmits the image captured by the first camera 11 or the second camera 12 to the client communication terminal 100, and causes the transmitted image to be displayed on the display unit 120 of the client communication terminal 100. The image displayed on the display unit 120 of the client communication terminal 100 may be the same as or different from the image displayed on the first display unit 21 or the second display unit 22. The display method of the image displayed on the display unit 120 of the client communication terminal 100 may also be the same as or different from the image displayed on the first display unit 21 or the second display unit 22.
[0035] The control unit 40 independently controls the display of images on the first display unit 21, the second display unit 22, and the display unit 120 of the client's communication terminal 100. That is, it is possible to independently select which images to display on the first display unit 21, the second display unit 22, and the display unit 120 of the client's communication terminal 100, and to independently change the display method for each of them. The reporter (operator) can independently operate these display controls.
[0036] FIG. 2 shows the situation when image communication device 1 is being used for an online tour. Here, a reporter holds image communication device 1 in his left hand and faces a third party in front. First camera 11 captures an image of the reporter, and second camera 12 captures an image of the third party. The reporter observes the image displayed on first display unit 21, and the third party observes the image displayed on second display unit 22. The images captured by first camera 11 and second camera 12 are transmitted via a network to a remote client communication terminal 100. Display unit 120 of client communication terminal 100 displays an image of the reporter captured by first camera 11 and an image of the third party captured by second camera 12. In this way, by using image communication device 1, communication through images can be exchanged between the reporter, the client, and the third party.
[0037] According to this embodiment, highly flexible communication can be realized through operations by the reporter alone.
[0038] [Second embodiment] 3 is a functional block diagram of image communication device 2 according to the first embodiment. Image communication device 2 includes first camera 11, second camera 12, third camera 13, first display unit 21, second display unit 22, communication unit 30, and control unit 40. That is, image communication device 2 differs from image communication device 1 in that it further includes third camera 13. The rest of the configuration of image communication device 2 is the same as the configuration of image communication device 1. The following description of image communication device 2 will focus on the parts that are different from image communication device 1, and redundant explanations of common parts will be omitted (the same applies below).
[0039] The third camera 13 is a camera for capturing images of the reporter's surroundings, and may be, for example, a handheld camera that the reporter can carry with him / her. The reporter can capture any image using the third camera. For example, the third camera may capture scenery at a travel destination or an object of common interest to the reporter and a third party (such as products displayed in a store).
[0040] First display unit 21 and second display unit 22 each independently display an image captured by first camera 11, second camera 12, or third camera 13. Communication unit 30 transmits the image captured by first camera 11, second camera 12, or third camera 13 to client communication terminal 100.
[0041] 4 shows a reporter holding the main body of image communication device 2 in his left hand and third camera 13 in his right hand. As shown in the figure, image communication device 2 is a simple and portable device, so that the reporter can carry and operate it by himself.
[0042] 5A shows an image (a) displayed on the first display unit 21 of the image communication device 2, an image (b) displayed on the second display unit 22 of the image communication device 2, and an image (c) displayed on the display unit 120 of the client's communication terminal 100. As shown in FIG. 5A, an image of a third party captured by the second camera 12 is displayed full-screen on the first display unit 21. As shown in FIG. 5B, the image of the third party captured by the second camera 12 and an image of the scenery captured by the third camera are displayed on the second display unit 22 in a P-in-Picture (P-in-Picture) format with a size ratio of approximately 1:3. As shown in FIG. 5C, the image of the reporter captured by the first camera 11, an image of the third party captured by the second camera 12, and an image of the scenery captured by the third camera are displayed on the display unit 120 of the client's communication terminal 100 in a P-by-Picture (P-by-Picture) format with a size ratio of approximately 2:1:1.
[0043] The reporter can independently control what images and how they are displayed on the first display unit 21, the second display unit 22, and the display unit 120 of the client's communication terminal 100.
[0044] According to this embodiment, the reporter can use images taken by a third camera that can photograph any object, thereby realizing richer communication.
[0045] [Third embodiment] FIG. 6 is a functional block diagram of an image communication device 3 according to a third embodiment. In this embodiment, a client communication terminal 100 is equipped with a camera 130. The camera 130 captures images of the client itself and images of the client's surroundings. The image communication device 3 is equipped with a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, and a control unit 40. The communication unit 30 receives images captured by the camera 130 of the client communication terminal 100 via the network and displays the received images on the first display unit 21 and the second display unit 22. The first display unit 21, the second display unit 22, and the display unit 120 of the client communication terminal 100 each independently display images captured by the first camera 11, the second camera 12, or the camera 130 of the client communication terminal 100.
[0046] According to this embodiment, an image on the client side taken by camera 130 of client communication terminal 100 can be used, so that communication with a higher degree of freedom can be realized.
[0047] [Fourth embodiment] 7 is a functional block diagram of an image communication device 4 according to a fourth embodiment. The image communication device 4 includes a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, and a storage unit 50. That is, the image communication device 2 differs from the image communication device 1 of FIG. 1 in that it further includes a storage unit 50. The other configuration of the image communication device 4 is the same as that of the image communication device 1.
[0048] The storage unit 50 stores image content prepared in advance. Such image content may be any image content, such as information about the surrounding area related to the online tour or information about the participant profiles. The first display unit 21 and the second display unit 22 independently display images captured by the first camera 11, images captured by the second camera 12, or image content stored in the storage unit 50. The communication unit 30 transmits the images captured by the first camera 11, images captured by the second camera 12, or image content stored in the storage unit 50 to the client's communication terminal 100.
[0049] According to this embodiment, it is possible to use image content that has been prepared in advance, thereby enabling communication with a higher degree of freedom.
[0050] [Fifth embodiment] FIG. 8 is a functional block diagram of an image communication device 5 according to a fifth embodiment. The image communication device 5 includes a first camera 11, a second camera 12, a third camera 13, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, a storage unit 50, a first microphone 11M paired with the first camera 11, a second microphone 12M paired with the second camera 12, a third microphone 13M paired with the third camera 13, and a speaker 11S. That is, the image communication device 5 differs from the image communication device 2 of FIG. 3 in that it includes a first microphone 11M, a second microphone 12M, a third microphone 13M, and a speaker 11S. The other configuration of the image communication device 5 is the same as that of the image communication device 2.
[0051] First microphone 11M, second microphone 12M, and third microphone 13M are configured as directional microphones, and collect sounds around first camera 11, second camera 12, and third camera 13, respectively. Speaker 11S plays back the sounds collected by first microphone 11M, second microphone 12M, and third microphone 13M, respectively.
[0052] According to this embodiment, each microphone can selectively collect and play back the sound from the shooting direction of the corresponding camera, thereby realizing communication with a sense of realism.
[0053] In this embodiment, control unit 40 may independently control the playback of sounds collected by first microphone 11M, second microphone 12M, and third microphone 13M. For example, in a scene where a reporter is giving an explanation, the sound collected by first microphone 11M may be played back at the loudest, and in a scene where scenery captured by third camera 13 is mainly displayed, the sound collected by third microphone 13M may be played back at the loudest.
[0054] According to this embodiment, the sounds collected by each microphone can be optimally controlled and played back, thereby realizing communication with a more realistic feel.
[0055] [Sixth embodiment] 9 is a functional block diagram of an image communication device 6 according to a sixth embodiment. The image communication device 6 includes a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, and an operation panel 60. That is, the image communication device 2 differs from the image communication device 1 in FIG. 1 in that it further includes the operation panel 60. The other configuration of the image communication device 6 is the same as that of the image communication device 1.
[0056] The reporter (operator) operates the operation panel 60 to operate the control contents of the control unit 40. For example, the operation panel 60 provides a user interface for individually selecting which images to display on the first display unit 21, the second display unit 22, and the display unit 120 of the client's communication terminal 100, and for determining the display method (image layout, magnification / reduction ratio, resolution, color balance, etc.) for display.
[0057] According to this embodiment, the operator can operate the control contents of the control unit in a more convenient and user-friendly manner.
[0058] [Seventh embodiment] 10 is a functional block diagram of an image communication device 7 according to a seventh embodiment. The image communication device 7 includes a first camera 11, a second camera 12, a fourth camera 14, a first display unit 21, a second display unit 22, a third display unit 23, a communication unit 30, and a control unit 40. That is, the image communication device 2 differs from the image communication device 1 of FIG. 1 in that it further includes a fourth camera 14 and a third display unit 23. The other configuration of the image communication device 7 is the same as that of the image communication device 1.
[0059] The fourth camera 14 captures an image in a direction different from either the reporter (operator) side or the opposite side of the reporter. In other words, the fourth camera 14 captures an image in a direction different from either the first camera or the second camera. For example, the fourth camera 14 may capture an image in any direction different from either the reporter side or the opposite side of the reporter, such as a sideways, upward, or downward direction of the reporter. The third display unit 23 faces the direction captured by the fourth camera 14. The first display unit 21, the second display unit 22, and the third display unit 23 each independently display an image captured by the first camera 11, the second camera 12, or the fourth camera 14. The communication unit 30 transmits the image captured by the first camera 11, the second camera 12, or the fourth camera 14 to the client's communication terminal 100.
[0060] The first camera 11 captures the reporter's side (mainly the reporter himself / herself). The second camera 12 captures the opposite side of the reporter (mainly what the reporter sees). The fourth camera 14 captures a direction different from either the reporter's side or the opposite side of the reporter, for example, the reporter's side (mainly people to the side of the reporter). The first display unit 21 faces the reporter's side and is mainly observed by the reporter. The second display unit 22 faces the opposite side of the reporter and is mainly observed by people facing the reporter. The third display unit 23 faces the direction of the fourth camera 14 and is mainly observed by people in the direction of the fourth camera 14. Therefore, the presence of the fourth camera 14 and the third display unit 23 allows third parties facing the reporter, as well as third parties in a different direction from the third party, to participate in the communication.
[0061] According to this embodiment, more people can participate in the communication, and therefore the degree of freedom in communication can be further improved.
[0062] [Eighth embodiment] 11 is a functional block diagram of an image communication device 8 according to an eighth embodiment. The image communication device 8 includes a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, and a 3D imaging unit 70. That is, the image communication device 2 differs from the image communication device 1 of FIG. 1 in that it further includes the 3D imaging unit 70. The other configuration of the image communication device 6 is the same as the configuration of the image communication device 1.
[0063] The 3D imaging unit 70 converts the images captured by the first camera 11 and the second camera 12 into 3D images. The images converted into 3D images by the 3D imaging unit 70 are displayed on the first display unit 21 and the second display unit 22.
[0064] According to this embodiment, 3D images can be used, making it possible to realize communication with a higher visual effect.
[0065] [Ninth embodiment] 12 is a functional block diagram of an image communication device 9 according to a ninth embodiment. The image communication device 9 includes a first camera 11, a second camera 12, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, and an AR image generation unit 80. That is, the image communication device 2 differs from the image communication device 1 of FIG. 1 in that the image communication device 2 further includes an AR image generation unit 80. The other configuration of the image communication device 6 is the same as the configuration of the image communication device 1.
[0066] The AR image generation unit 80 generates an AR (Augmented Reality) image to be displayed on the first display unit 21 and the second display unit 22. The AR image may be any AR image, including additional information related to the online tour, information that makes the online tour appear more effective, etc. The first display unit 21 and the second display unit 22 display the AR image generated by the AR image generation unit 80 in addition to the images captured by the first camera 11 and the second camera 12.
[0067] According to this embodiment, the generated AR image can be displayed, thereby achieving communication with a higher visual effect.
[0068] [Tenth embodiment] 13 is a functional block diagram of an image communication device 10 according to a tenth embodiment. The image communication device 10 includes a first camera 11, a second camera 12, a third camera 13, a first display unit 21, a second display unit 22, a communication unit 30, a control unit 40, a storage unit 50, a first microphone 11M paired with the first camera 11, a second microphone 12M paired with the second camera 12, a third microphone 13M paired with the third camera 13, a speaker 11S, and an omnidirectional microphone 90. That is, the image communication device 10 differs from the image communication device 5 of FIG. 8 in that the image communication device 10 further includes an omnidirectional microphone 90. The other configuration of the image communication device 10 is the same as that of the image communication device 5.
[0069] The omnidirectional microphone 90 collects sounds from the entire area surrounding the reporter. This allows the first microphone 11M, the second microphone 12M, and the third microphone 13M to selectively collect sounds from the shooting directions of their corresponding cameras, as well as sounds from the entire area surrounding the reporter, such as background sounds. The speaker 11S plays back the sounds collected by the first microphone 11M, the second microphone 12M, and the third microphone 13M, as well as the sounds collected by the omnidirectional microphone 90.
[0070] According to this embodiment, in addition to the sounds from the shooting direction of each camera, sounds from the entire surrounding area can also be collected and played back, thereby realizing communication with a more auditory sense of realism.
[0071] The present invention has been described above based on the embodiments. The embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of the components and treatment processes, and that such modifications are also within the scope of the present invention. [Explanation of symbols]
[0072] 1...Image communication device. 2...Image communication equipment. 3...Image communication equipment. 4...Image communication equipment. 5...Image communication equipment. 6...Image communication equipment. 7...Image communication equipment. 8...Image communication device. 9...Image communication device. 10...Image communication device. 11...First camera. 12...Second camera. 13...Third camera. 14...Fourth camera. 11M...first microphone. 12M...second microphone. 13M...third microphone. 11S...Speaker. 21...First display unit. 22...Second display unit. 23...Third display unit. 30...Communications Department. 40...Control unit. 50...Memory section. 60...Operation panel. 70...3D imaging section. 80...AR image generation unit. 90...Omnidirectional microphone. 100...Client communication terminal. 120...Display unit of client's communication terminal. 130...Camera on client's communication device.
Claims
1. a first camera for photographing the operator's side; a second camera that captures an image on the opposite side of the operator; a first display unit facing the operator; a second display unit facing away from the operator; The Communications Department and a control unit, the first display unit displays an image captured by the first camera and / or an image captured by the second camera; the second display unit displays an image captured by the first camera and / or an image captured by the second camera; the communication unit transmits an image captured by the first camera or the second camera to a remote communication device, and causes a display unit of the remote communication device to display the transmitted image; the control unit independently controls the display of images on the first display unit, the second display unit, and the display unit of the remote communication device; The image communication device is characterized in that the control content of the control unit can be operated by the operator alone.
2. Further provided is a third camera that captures an image of the surroundings of the operator, the first display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by the third camera; the second display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by the third camera; 2. The image communication device according to claim 1, wherein the communication unit transmits an image captured by the first camera, the second camera, or the third camera to the remote communication device.
3. the remote communication device comprises a camera; the communication unit receives an image captured by a camera of the remote communication device, and causes the first display unit and the second display unit to display the received image; the first display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by a camera of the remote communication device; the second display unit displays an image taken by the first camera, an image taken by the second camera, and / or an image taken by a camera of the remote communication device; The image communication device described in claim 2, characterized in that the display unit of the remote communication device displays images taken by the first camera, and / or images taken by the second camera, and / or images taken by a camera of the remote communication device.
4. further comprising a storage unit for storing image content prepared in advance; the first display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or image content stored in the storage unit; the second display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or image content stored in the storage unit; An image communication device as described in any one of claims 1 to 3, characterized in that the communication unit transmits images taken by the first camera, images taken by the second camera, or image content stored in the memory unit to the remote communication device.
5. a microphone paired with the first camera, the second camera, and the third camera, respectively; a speaker that reproduces the sounds collected by each of the microphones; 3. The image communication device according to claim 2, wherein each of the microphones collects sounds around the first camera, the second camera, and the third camera, respectively.
6. 6. The image communication device according to claim 5, wherein the control unit independently controls the reproduction of the sounds collected by each of the microphones.
7. 7. The image communication apparatus according to claim 1, further comprising an operation panel for the operator to operate the control contents of the control section.
8. a fourth camera that captures an image in a direction different from the directions captured by the first camera and the second camera; a third display unit facing the direction in which the fourth camera takes an image, the first display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by the fourth camera; the second display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by the fourth camera; the third display unit displays an image taken by the first camera, and / or an image taken by the second camera, and / or an image taken by the fourth camera; 2. The image communication device according to claim 1, wherein the communication unit transmits an image captured by the first camera, the second camera, or the fourth camera to the remote communication device.
9. The image communication device according to claim 1 , further comprising a 3D imaging unit that generates a 3D image from the images captured by the first camera and the second camera.
10. The image communication device according to claim 1 , further comprising an AR image generating unit that generates an AR image to be displayed on the first display unit and the second display unit.
11. 6. The image communication device according to claim 5, further comprising an omnidirectional microphone that collects sounds from all around the operator.
Citation Information
Patent Citations
Mobile terminal device
JP2003298884A
Internet virtual telepresence system
JP2004514205A
Camera-attached mobile communication terminal
JP2009089331A
Imaging apparatus and imaging system
JP2013126018A
Electronic apparatus and program
JP2013190463A