Transmission management device

Abstract

To provide a transmission management device that allows users of each transmission terminal to know which transmission terminals are participating in a meeting, regardless of the number of transmission terminals participating in the meeting. [Solution] A transmission management device 50 that manages the transmission status of multiple transmission terminals 10 includes a terminal management DB 5003 which manages terminal information including the identifier and identification name of the transmission terminal 10, a transmitting and receiving unit 51 which receives a terminal information request signal that represents a request for information to identify the transmission terminal 10 and the transmission terminals that are in a transmission state, and a terminal status acquisition unit 55 which, when it receives a terminal information request signal, acquires information to identify the transmission terminal 10 and the transmission terminals that are in a transmission state from the terminal management table, and transmits the information acquired by the terminal status acquisition unit 55 to the transmission terminal 10 that sent the terminal information request signal via the transmitting and receiving unit 51.

Description

Technical Field

[0001] The present invention relates to a transmission management apparatus, and for example, to a transmission management apparatus that manages the transmission state of a transmission terminal used in a teleconference system that holds teleconferences via a network. Background Art

[0002] A teleconference system collects images and sound by photographing attendees and collecting sounds such as statements from the attendees in a conference room where teleconference attendees are present, converts the collected images and sound into digital data by a transmission terminal, transmits the digital data to the counterpart transmission terminal, displays images on a display such as a video screen in the counterpart conference room, and outputs sound from a speaker, thereby realizing a state close to that of an actual conference.

[0003] In such a teleconference system, a teleconference can be realized between multiple sites by connecting all transmission terminals participating in the conference to a relay device, and the relay device controlling the distribution of image data and sound data to each transmission terminal.

[0004] Generally, in a teleconference held between multiple sites, in order to know which other transmission terminals are participating in the conference during the conference, the display screen of the transmission terminal is divided into as many areas as the number of participating transmission terminals, and an image transmitted from each transmission terminal is displayed in each area of the divided display screen (see, for example, Patent Document 1). Summary of the Invention Problem to be Solved by the Invention

[0005] However, in such conventional techniques, when the number of transmission terminals participating in the conference increases, the number of divisions of the display screen increases, and the display area for displaying an image transmitted from each transmission terminal becomes narrow, which poses a problem that users of each transmission terminal cannot grasp which transmission terminals are participating in the conference.

[0006] This invention was made to solve the aforementioned problems of the past, and aims to provide a transmission management device that allows users of each transmission terminal to know which transmission terminals are participating in a meeting, regardless of the number of transmission terminals participating in the meeting. [Means for solving the problem]

[0007] To solve the above problems, the present invention provides a transmission system including a transmission terminal and a management device for managing name information associated with the transmission terminal, wherein the transmission terminal has a first function for displaying image data transmitted from other transmission terminals participating in communication based on image data to which it has joined by accepting an operation, and a second function for displaying a list of name information associated with other transmission terminals participating in the communication, the management device has a transmission unit for transmitting name information associated with other transmission terminals participating in the same communication as the transmission terminal that accepted the operation to the transmission terminal that accepted the operation, the transmission terminal that accepted the operation further has a receiving unit for receiving the name information transmitted by the transmission unit, and a display control unit for displaying a first screen which displays image data transmitted from the other transmission terminals by the first function, and which does not include a specific display area for displaying a list of name information by the second function, and the display control unit further has a second screen which displays image data transmitted from the other transmission terminals by the first function, and which does not include the specific display area The system is configured to display the second screen, the first screen being displayed when a first mode among a plurality of display modes is selected, the second screen being displayed when a second mode different from the first mode among the plurality of display modes is selected, the display control unit, when it receives an operation to switch the display mode while the first screen is being displayed, switches from the first screen to display the second screen, and when it receives the same operation while the second screen is being displayed, switches from the first screen to display the second screen, and the first screen and the second screen are configured to display image data transmitted from another transmission terminal among other transmission terminals participating in the communication, which is the source of sound data representing voice. [Effects of the Invention]

[0008] The present invention provides a transmission management device that allows users of each transmission terminal to know which transmission terminals are participating in a meeting, regardless of the number of transmission terminals participating in the meeting. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of a transmission system according to an embodiment of the present invention. [Figure 2] This is a conceptual diagram showing the state of transmission and reception of image data, sound data, and various management information in a transmission system according to an embodiment of the present invention. [Figure 3] This is a conceptual diagram illustrating the image quality of image data according to an embodiment of the present invention. [Figure 4] This is an external view of a transmission terminal according to an embodiment of the present invention. [Figure 5] This is a hardware configuration diagram of a transmission terminal according to an embodiment of the present invention. [Figure 6] This is a hardware configuration diagram of a transmission management device, relay device, or program provisioning device according to an embodiment of the present invention. [Figure 7] This is a functional block diagram of a transmission terminal and transmission management system according to an embodiment of the present invention. [Figure 8] This is a conceptual diagram of a terminal authentication management table managed by a transmission management device according to an embodiment of the present invention. [Figure 9] This is a conceptual diagram of a terminal management table managed by a transmission management device according to an embodiment of the present invention. [Figure 10] This is a conceptual diagram of a terminal management table managed by a transmission management device according to an embodiment of the present invention. [Figure 11] This is a sequence diagram showing the preparation phase operation of a transmission system according to an embodiment of the present invention. [Figure 12] This is a sequence diagram showing the conference participation operation of a transmission system according to an embodiment of the present invention. [Figure 13] This is a sequence diagram showing the data transmission operation of a transmission system according to an embodiment of the present invention. [Figure 14]This is a conceptual diagram showing the display screen of the full image display mode displayed by a transmission terminal according to an embodiment of the present invention. [Figure 15] This is a conceptual diagram showing the display screen of the information display mode displayed by a transmission terminal according to an embodiment of the present invention. [Figure 16] This is a sequence diagram showing the terminal information display operation of a transmission system according to an embodiment of the present invention. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to the drawings.

[0011] <<Overall Configuration of the Embodiment>> Figure 1 is a schematic diagram of a transmission system 1 according to an embodiment of the present invention. Figure 2 is a conceptual diagram showing the transmission and reception status of image data, sound data, and various management information in the transmission system. Figure 3 is a conceptual diagram explaining the image quality of the image data.

[0012] Furthermore, the transmission system includes a data provision system that transmits content data unidirectionally from one transmission terminal to multiple transmission terminals via a transmission management device, and a communication system that transmits information, emotions, etc., between multiple transmission terminals via a transmission management device. The communication system is a system for transmitting information, emotions, etc., between multiple communication terminals (corresponding to "transmission terminals") via a communication management device (corresponding to "transmission management device"), and examples include video conferencing systems and video telephone systems.

[0013] In the present embodiment, a transmission system, a transmission management apparatus, and a transmission terminal are described on the assumption of a video conference system as an example of a communication system, a video conference management apparatus as an example of a communication management apparatus, and a video conference terminal as an example of a communication terminal. That is, the transmission terminal and the transmission management apparatus of the present invention are applicable not only to a video conference system but also to a communication system or a data transmission system.

[0014] As shown in FIG. 1, the transmission system 1 includes a plurality of transmission terminals 10aa, 10ab, ..., displays 120aa, 120ab, ... for the respective transmission terminals 10aa, 10ab, ..., a relay device 30, a transmission management apparatus 50, and a program providing device 90. The transmission terminals 10aa, 10ab, ... are configured to perform transmission as content data by transmitting and receiving, for example, image data and sound data.

[0015] In the following description, any transmission terminal among the plurality of transmission terminals 10aa, 10ab, ... is referred to as a "transmission terminal 10", and any display among the plurality of displays 120aa, 120ab, ... is referred to as a "display 120". Further, the transmission terminal 10 of a request source that requests the start of a video conference is referred to as a "request source terminal", and the transmission terminal 10 of a request destination is referred to as a "destination terminal".

[0016] As shown in FIG. 2, in the transmission system 1, a management information session sei for transmitting and receiving various types of management information via the transmission management apparatus 50 is established between the request source terminal and the destination terminal.

[0017] Further, between the transmission terminals 10 for which the management information session sei has been established, four sessions for transmitting and receiving four types of data, namely high-resolution image data, medium-resolution image data, low-resolution image data, and sound data, are established via the relay device 30. In the present embodiment, these four sessions are collectively referred to as an "image and sound data session sed".

[0018] Here, the image data used in this embodiment is encoded in a scalable manner. For example, the image data used in this embodiment includes low-resolution image data that serves as the base image, consisting of 320 pixels horizontally and 180 pixels vertically, as shown in Figure 3(a); medium-resolution image data consisting of 640 pixels horizontally and 360 pixels vertically, as shown in Figure 3(b); and high-resolution image data consisting of 1280 pixels horizontally and 720 pixels vertically, as shown in Figure 3(c).

[0019] In this case, if the bandwidth through which the image data is transmitted is narrow, only the low-resolution image data that serves as the base image will be transmitted, and the receiving transmission terminal 10 can display only the low-quality image based on the transmitted low-resolution image data.

[0020] Furthermore, if the bandwidth through which the image data is transmitted is relatively wide, low-resolution image data and medium-resolution image data that serve as the base image are transmitted, and the receiving transmission terminal 10 can display a medium-quality image based on the transmitted low-resolution and medium-resolution image data.

[0021] Furthermore, if the bandwidth through which the image data is transmitted is very wide, low-resolution image data, medium-resolution image data, and high-resolution image data are transmitted as base image quality, and the receiving transmission terminal 10 can display a high-quality image based on the transmitted low-resolution image data, medium-resolution image data, and high-resolution image data.

[0022] In Figure 1, the relay device 30 relays content data between multiple transmission terminals 10. The transmission management device 50 centrally manages login authentication from the transmission terminals 10, management of the transmission status of the transmission terminals 10, management of the destination list, and the transmission status of the relay device 30. The image data may be a video, a still image, or both.

[0023] Multiple routers 70a, 70b, 70c, 70d, 70ab, and 70cd select the optimal route for image data and sound data. In the following description, any of the routers 70a, 70b, 70c, 70d, 70ab, and 70cd will be referred to as "router 70".

[0024] The program supply device 90 is equipped with an HD (Hard Disk) 204, which will be described later. The program supply device 90 stores a transmission terminal control program for implementing various functions in the transmission terminal 10 and can transmit the transmission terminal control program to the transmission terminal 10.

[0025] Furthermore, the HD204 of the program supply device 90 also stores programs for the relay device 30 to implement various functions, and can transmit these relay device programs to the relay device 30.

[0026] Furthermore, the HD204 of the program supply device 90 also stores transmission management programs for implementing various functions in the transmission management device 50, and can transmit these transmission management programs to the transmission management device 50.

[0027] Transmission terminals 10aa, 10ab, 10ac, ... and router 70a are connected via LAN2a for transmission. Transmission terminals 10ba, 10bb, 10bc, ... and router 70b are connected via LAN2b for transmission.

[0028] Furthermore, LAN2a and LAN2b are connected via a dedicated line 2ab that includes router 70ab, and are located within a designated region A. For example, region A is Japan, LAN2a is located within the Tokyo office, and LAN2b is located within the Osaka office.

[0029] On the other hand, transmission terminals 10ca, 10cb, 10cc, ... and router 70c are connected via LAN2c for transmission. Transmission terminals 10da, 10db, 10dc, ... and router 70d are connected via LAN2d for transmission.

[0030] Furthermore, LAN2c and LAN2d are connected via a dedicated line 2cd that includes router 70cd, and are located within a designated region B. For example, region B is the United States, LAN2c is located within the New York office, and LAN2d is located within the Washington D.C. office. Regions A and B are connected to each other via the Internet 2i from routers 70ab and 70cd, respectively, enabling transmission between them.

[0031] Furthermore, the relay device 30, the transmission management device 50, and the program provision device 90 are transmitted to each transmission terminal 10 via the Internet 2i. Here, the relay device 30, the transmission management device 50, and the program provision device 90 may be installed in region A or region B, or in other regions.

[0032] In this embodiment, the transmission network 2 is configured by LAN2a, LAN2b, dedicated line 2ab, Internet 2i, dedicated line 2cd, LAN2c, and LAN2d. The transmission network 2 may include locations where wireless transmission such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) is performed, in addition to wired transmission.

[0033] Furthermore, in Figure 1, the four sets of numbers shown under each transmission terminal 10, relay device 30, transmission management device 50, each router 70, and program provider device 90 represent simplified IP addresses in a typical IPv4 configuration. For example, the IP address of transmission terminal 10aa is "1.2.1.3". While IPv6 could also be used instead of IPv4, IPv4 will be used for simplicity in this explanation.

[0034] Each transmission terminal 10 may be used not only for video conferencing between multiple business locations or between different rooms within the same business location, but also for video conferencing within the same room, or between outdoor and indoor locations, or between outdoor and outdoor locations. When each transmission terminal 10 is used outdoors, wireless transmission such as via a mobile phone transmission network will be performed.

[0035] <<Hardware configuration of the embodiment>> As shown in Figure 4, the transmission terminal 10 comprises a housing 1021, an arm 1074, and a camera housing 1075. Of these, multiple intake holes 1021e are formed on substantially the entire front wall 1021a of the housing 1021, and multiple exhaust holes (not shown) are formed on substantially the entire rear wall 1021b of the housing 1021. As a result, the transmission terminal 10 can take in outside air from the front of the transmission terminal 10 through the intake holes 1021e and exhaust it to the rear of the transmission terminal 10 through the exhaust holes, when a cooling fan built into the housing 1021 is driven. A sound-collecting hole 1021f is formed in the center of the front wall 1021a, and sounds such as voices, noises, and background noise can be collected by a built-in microphone 114, which will be described later.

[0036] On the left side of the housing 1021 in a front view, an operation panel 1022 is formed. The operation panel 1022 is equipped with operation buttons 108 and a power switch 109, and also has multiple sound output holes 1022f for passing sound output from the built-in speaker 115, which will be described later. On the right side of the housing 1021 in a front view, a housing section 1021p is formed as a recess for accommodating the arm 1074 and the camera housing 1075.

[0037] The arm 1074 is attached to the housing 1021 via a torque hinge 1073. For example, the arm 1074 is mounted so as to be rotatable in the up, down, left, and right directions, with a pan angle θ1 of ±180 degrees and a tilt angle θ2 of 90 degrees, when the front is considered 0 degrees, and a click sensation is generated when it is tilted by approximately 45 degrees.

[0038] The camera housing 1075 is equipped with a built-in camera 112, which will be described later, and can capture images of the user, the room, etc. Furthermore, a torque hinge 1075a is formed on the camera housing 1075.

[0039] The camera housing 1075 is attached to the arm 1074 via a torque hinge 1075a. For example, the camera housing 1075 is attached to the arm 1074 so as to be rotatable within a tilt angle θ3 range of approximately 100 degrees forward of the transmission terminal 10 and approximately 90 degrees backward of the transmission terminal 10, with the state in a straight line with the arm 1074 being defined as 0 degrees.

[0040] As shown in Figure 5, the transmission terminal 10 includes a CPU (Central Processing Unit) 101 that controls the overall operation of the transmission terminal 10, a ROM (Read Only Memory) 102 that stores programs used to drive the CPU 101, such as an IPL (Initial Program Loader), a RAM (Random Access Memory) 103 used as the work area of ​​the CPU 101, a flash memory 104 that stores various data such as the transmission terminal control program, image data, and sound data, an SSD (Solid State Drive) 105 that controls the reading or writing of various data to the flash memory 104 according to the control of the CPU 101, a media drive 107 that controls the reading or writing (storage) of data to a recording medium 106 such as the flash memory, an operation button 108 that is operated when selecting a destination for the transmission terminal 10, a power switch 109 for switching the power of the transmission terminal 10 ON / OFF, and a network I / F (Interface) 111 for transmitting data using the transmission network 2.

[0041] Furthermore, the transmission terminal 10 includes a built-in camera 112 that captures an image of a subject and obtains image data according to the control of the CPU 101, an image sensor I / F 113 that controls the drive of the camera 112, a built-in microphone 114 that acts as a built-in sound collector for inputting sound, a built-in speaker 115 that outputs sound, an audio input / output I / F 116 that processes the input and output of sound signals between the microphone 114 and the speaker 115 according to the control of the CPU 101, a display I / F 117 that transmits image data to an external display 120 according to the control of the CPU 101, an external device connection I / F 118 for connecting various external devices, and bus lines 110 such as an address bus and a data bus for electrically connecting each of the above components.

[0042] Display 120 is a display device composed of liquid crystal or organic EL that displays images of the subject, operation icons, etc. Display 120 is connected to display I / F 117 by cable 120c. Cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, or a cable for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals.

[0043] The camera 112 includes a lens and a solid-state image sensor that converts light into electric charge to create an electronic image of the subject. As the solid-state image sensor, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used.

[0044] The external device connection interface (F118) allows external devices such as external cameras, external microphones, and external speakers to be connected via USB (Universal Serial Bus) cables, etc.

[0045] When an external camera is connected to the external device connection interface 118, the CPU 101 prioritizes driving the external camera over the built-in camera 112. Similarly, when an external microphone or external speaker is connected to the external device connection interface 118, the CPU 101 prioritizes driving the external microphone or external speaker over the built-in microphone 114 and built-in speaker 115, respectively.

[0046] The recording medium 106 is configured to be detachably attached to the transmission terminal 10. Furthermore, the transmission terminal 10 may use an EEPROM (Electrically Erasable and Programmable ROM) or the like instead of flash memory 104, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101.

[0047] Furthermore, the transmission terminal control program may be distributed as an installable or executable file, recorded on a computer-readable recording medium such as the recording medium 106. Alternatively, the transmission terminal control program may be stored in the ROM 102 instead of the flash memory 104.

[0048] As shown in Figure 6, the transmission management device 50 includes a CPU 201 that controls the overall operation of the transmission management device 50, a ROM 202 that stores programs used to drive the CPU 201 such as an IPL, a RAM 203 used as the work area of ​​the CPU 201, an HD 204 that stores various data such as transmission management programs, an HDD (Hard Disk Drive) 205 that controls the reading or writing of various data to the HD 204 according to the control of the CPU 201, a media drive 207 that controls the reading or writing (storage) of data to a recording medium 206 such as flash memory, a display 208 that displays various information such as cursors, menus, windows, characters, or images, a network I / F 209 for data transmission using the transmission network 2, a keyboard 211 with multiple keys for inputting characters, numbers, and various instructions, a mouse 212 for selecting and executing various instructions, selecting processing targets, moving the cursor, etc., and a CD-ROM (Compact Disc Read Only) as an example of a removable recording medium. The system includes a CD-ROM drive 214 that controls the reading or writing of various data to the Memory 213, and bus lines 210 such as an address bus and a data bus for electrically connecting the above components.

[0049] The transmission management program may be distributed as an installable or executable file, recorded on a computer-readable recording medium such as recording media 206 or CD-ROM 213. Alternatively, the transmission management program may be stored in ROM 202 instead of HD 204.

[0050] Furthermore, since the relay device 30 has the same hardware configuration as the transmission management device 50, its description will be omitted. However, the HD204 contains a program for controlling the relay device 30.

[0051] In this case as well, the relay device program may be distributed as an installable or executable file, recorded on a computer-readable recording medium such as recording media 206 or CD-ROM 213. Alternatively, the relay device program may be stored in ROM 202 instead of HD 204.

[0052] Furthermore, since the program supply device 90 has the same hardware configuration as the transmission management device 50, its description will be omitted. However, HD204 contains a program for the program supply device used to control the program supply device 90.

[0053] In this case as well, the program for the program provider may be distributed as an installable or executable file, recorded on a computer-readable recording medium such as the recording medium 206 or CD-ROM 213. Alternatively, the program for the program provider may be stored in ROM 202 instead of HD 204.

[0054] Furthermore, as mentioned above, CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), Blu-ray disc, etc., may be used as the computer-readable recording medium.

[0055] <<Embodiment Functional Configuration>> As shown in Figure 7, the transmission terminal 10, relay device 30, and transmission management device 50 are connected so that data can be transmitted via the transmission network 2. Note that the program provider device 90 shown in Figure 1 is not directly related to the transmission of video conferencing data and is therefore not shown in Figure 7.

[0056] <Functional Configuration of Transmission Terminals> The transmission terminal 10 includes a transmitting / receiving unit 11, an operation input receiving unit 12, a login request unit 13, an imaging unit 14, an audio input unit 15a, an audio output unit 15b, a display control unit 17, and a storage / reading processing unit 19. Each of these units is a function realized by a CPU 101 that executes a transmission terminal control program loaded from the flash memory 104 onto the RAM 103. The transmission terminal 10 also has a storage unit 1000 composed of the RAM 103 and the flash memory 104.

[0057] (Functional configuration of each transmission terminal) The transmitting / receiving unit 11 is composed of a CPU 101 and a network interface 111, and is configured to transmit and receive various data and information with other transmission terminals 10 or devices 30, 50, and 90 via the transmission network 2. The transmitting / receiving unit 11 constitutes the transmitting and receiving units of the transmission terminal according to the present invention.

[0058] The transmitting / receiving unit 11 is configured to begin receiving status information from the transmission management device 50 indicating the status of each transmission terminal 10 as a candidate destination for the video conference, even before the video conference is initiated with the desired destination terminal.

[0059] The status information not only indicates whether each transmission terminal 10 is online or offline, but also shows detailed operational status such as whether it is online and capable of transmission, or whether it is online and currently transmitting.

[0060] Furthermore, the status information represents not only the operating status of each transmission terminal 10, but also various other states such as whether the cable 120c is disconnected from the transmission terminal 10, whether sound is output but no image is output, or whether sound is muted. However, in the following explanation, in order to make the present invention easier to understand, we will explain the case in which the status information represents the operating status of each transmission terminal 10.

[0061] The operation input reception unit 12 consists of a CPU 101, operation buttons 108, and a power switch 109, and is configured to receive various inputs from the user. For example, when the user turns on the power switch 109, the operation input reception unit 12 receives the power ON signal and turns on the power of the transmission terminal 10.

[0062] The login request unit 13 is configured by the CPU 101 and, upon receiving a power-on notification, transmits login request information indicating a login request and the current IP address of the terminal to the transmission management device 50 via the transmission network 2 from the transmission / reception unit 11.

[0063] Furthermore, when the user switches the power switch 109 from the ON state to the OFF state, the transmitting / receiving unit 11 sends status information to the transmission management device 50 indicating that the power has been turned OFF, and then the operation input reception unit 12 completely turns off the power to the transmission terminal 10. This allows the transmission management device 50 to know that the transmission terminal 10 has changed from power ON to power OFF.

[0064] The imaging unit 14 consists of a CPU 101, a camera 112, and an image sensor interface 113, and is configured to capture images of a subject and output the image data obtained from the capture to the transmission / reception unit 11. Here, the camera 112 constitutes the imaging device in the present invention, and the image sensor interface 113 constitutes the image data input unit in the present invention.

[0065] The sound input unit 15a is composed of a CPU 101 and an sound input / output interface 116, and constitutes the sound data input unit in the present invention. The sound input unit 15a receives an audio signal representing the sound collected by the microphone 114, and converts the input audio signal into sound data.

[0066] The sound output unit 15b consists of a CPU 101 and an sound input / output interface 116. It converts sound data into sound signals and outputs the converted sound signals to the speaker 115, thereby outputting sound to the speaker 115.

[0067] The display control unit 17 is composed of a CPU 101 and a display I / F 117. It combines image data of different resolutions received by the transmitting / receiving unit 11 and transmits the combined image data to the display 120, thereby displaying the image represented by the image data on the display 120.

[0068] Furthermore, the display control unit 17 transmits the destination list information received by the transmitting / receiving unit 11 from the transmission management device 50 to the display 120, thereby displaying the destination list on the display 120.

[0069] The memory and read processing unit 19 is composed of a CPU 101 and an SSD 105, and is configured to store various data in the memory unit 1000 and to read various data stored in the memory unit 1000.

[0070] The storage unit 1000 stores an identifier (hereinafter referred to as "terminal ID") and password for identifying the transmission terminal 10. Furthermore, the storage unit 1000 is also used as a reception buffer for image data and sound data received when conducting a video conference with the destination terminal.

[0071] In this embodiment, the terminal ID represents information such as language, characters, symbols, or various markings used to uniquely identify the transmission terminal 10. Alternatively, the terminal ID may be a combination of at least two of the following: language, characters, symbols, and various markings.

[0072] <Functional Configuration of Transmission Management Device> The transmission management device 50 includes a transmitting / receiving unit 51, a terminal authentication unit 52, a state management unit 53, a terminal extraction unit 54, a terminal state acquisition unit 55, and a storage / reading processing unit 59. Each of these units is a function realized by a CPU 201 that executes a transmission management program deployed from the HD 204 onto the RAM 203. The transmission management device 50 also includes a storage unit 5000, which is composed of the HD 204.

[0073] (Terminal authentication management table) The memory unit 5000 has a terminal authentication management DB 5002 which has a terminal authentication management table as shown in Figure 8. In the terminal authentication management table, each password is associated with and managed for each terminal ID of all transmission terminals 10 managed by the transmission management device 50. For example, the terminal authentication management table shown in Figure 8 shows that the terminal ID of transmission terminal 10aa is "01aa" and the password is "aaaa".

[0074] (Terminal management table) Furthermore, the storage unit 5000 has a terminal management DB 5003 having a terminal management table as shown in Figure 9. The terminal management DB 5003 constitutes the terminal management table storage unit in the present invention.

[0075] In the terminal management table, for each terminal ID of each transmission terminal 10, the identification name of each transmission terminal 10 (hereinafter referred to as "terminal name"), the operating status of each transmission terminal 10, the date and time when the login request information for logging into the transmission system 1 was received by the transmission management device 50, and the IP address of the transmission terminal 10 are associated and managed.

[0076] For example, the terminal management table shown in Figure 9 indicates that for transmission terminal 10aa with terminal ID "01aa", the terminal name is "Japan Tokyo Office AA Terminal", the operational status is "Online (Transmission Possible)", the date and time the login request information was received by the transmission management device 50 was "November 10, 2009 at 13:40", and the IP address of transmission terminal 10aa is "1.2.1.3".

[0077] Here, the terminal ID in the terminal management table is uniquely assigned when the transmission terminal 10 is registered with the transmission system 1, and the terminal name is registered or changed by the administrator of the transmission management device 50. The terminal name may also be registered or changed in response to a request made from the transmission terminal 10 to the transmission management device 50.

[0078] Furthermore, an operating status of "online (transmission possible)" means that the transmission terminal 10 is logged into the transmission system 1 but is not participating in a video conference, "online (transmitting)" means that the transmission terminal 10 is logged into the transmission system 1 but is participating in a video conference, and an operating status of "offline" means that the transmission terminal 10 is not logged into the transmission system 1.

[0079] (Recipient list management table) Furthermore, the storage unit 5000 has a destination list management DB 5004 which has a destination list management table as shown in Figure 10. The terminal management DB 5003 constitutes the destination list management table storage unit in this invention.

[0080] In the destination list management table, all destination terminal IDs registered as candidate destination terminals are associated and managed with the terminal ID of the requesting terminal that initiates the video conference.

[0081] For example, in the destination list management table shown in Figure 10, the candidate destination terminals for a video conference to be initiated from transmission terminal 10aa, whose terminal ID is "01aa", are shown to be transmission terminal 10ab, whose terminal ID is "01ab", transmission terminal 10ba, whose terminal ID is "01ba", and transmission terminal 10db, whose terminal ID is "01db". Candidate destination terminals are added or deleted in response to requests made from transmission terminal 10 to the transmission management device 50.

[0082] (Functional configuration of the transmission management device) The transmitting / receiving unit 51 consists of a CPU 201 and a network interface 209, and is configured to transmit and receive various data and information with other transmission terminals 10 or devices 30 and 90 via the transmission network 2.

[0083] The terminal authentication unit 52 is configured by the CPU 102 and performs terminal authentication by using the terminal ID and password contained in the login request information received via the transmission / reception unit 51 as search keys to search the terminal authentication management DB 5002 in the storage unit 5000 and determining whether the same terminal ID and password are managed in the terminal authentication management DB 5002.

[0084] The status management unit 53 is comprised of the CPU 102 and manages the operational status of the requesting terminal that made the login request. It stores and manages the operational status, the date and time the login request information was received by the transmission management device 50, and the IP address associated with the terminal ID of the requesting terminal in the terminal management DB 5003 (see Figure 9).

[0085] Furthermore, the status management unit 53 changes the operating status of the transmission terminal 10 in the terminal management DB 5003 (see Figure 9) from online to offline based on the status information sent from the transmission terminal 10 indicating that the power has been turned off, when the user turns the power switch 109 of the transmission terminal 10 from ON to OFF.

[0086] The terminal extraction unit 54 is configured by the CPU 102 and searches the destination list management DB 5004 (see Figure 10) using the terminal ID of the requesting terminal that made the login request as the search key, and extracts terminal IDs of candidate destination terminals for the requesting terminal.

[0087] Furthermore, the terminal extraction unit 54 searches the destination list management DB 5004 (see Figure 10) using the terminal ID of the requesting terminal that made the login request as the search key, and extracts the terminal IDs of other requesting terminals that have registered the requesting terminal's terminal ID as a candidate destination terminal.

[0088] The terminal status acquisition unit 55 is configured by the CPU 102 and searches the terminal management DB 5003 (see Figure 9) using the terminal ID of the candidate destination terminal extracted by the terminal extraction unit 54 as the search key, and reads the operating status for each detected terminal ID.

[0089] This allows the terminal status acquisition unit 55 to acquire the operational status of candidate destination terminals for the requesting terminal that made the login request. The terminal status acquisition unit 55 also searches the terminal management DB 5003 using the terminal ID extracted by the terminal extraction unit 54 as a search key, and acquires the operational status of the requesting terminal that made the login request.

[0090] The memory and read processing unit 59 is composed of a CPU 102 and an HDD 205, and is configured to store various data in the memory unit 5000 and to read various data stored in the memory unit 5000.

[0091] <<Processing or operation of the embodiment>> Next, the operation of the transmission system 1 according to this embodiment will be described. Figure 11 is a sequence diagram showing the preparation phase operation until the transmission terminal 10 is ready to participate in a video conference. Note that Figure 11 shows an example where the transmission terminal 10aa is ready. During the preparation phase operation, various information is sent and received in the management information session sei (see Figure 2).

[0092] First, when a user of the transmission terminal 10aa turns on the power switch 109 of the transmission terminal 10aa, the operation input reception unit 12 receives the power ON signal and turns on the power (step S21). Then, triggered by the acceptance of the power ON signal, the login request unit 13 transmits login request information representing a login request from the transmission reception unit 11 of the transmission terminal 10aa to the transmission management device 50 via the transmission network 2 (step S22).

[0093] The login request information includes a terminal ID and password to identify the transmission terminal 10aa that initiated the login request. These terminal IDs and passwords are read from the storage unit 1000 by the storage / reading processing unit 19.

[0094] Furthermore, when the transmission management device 50 receives login request information sent from the transmission terminal 10aa, the transmission management device 50 can determine the IP address of the transmitting transmission terminal 10ab.

[0095] Next, the terminal authentication unit 52 of the transmission management device 50 uses the terminal ID and password contained in the login request information received via the transmission / reception unit 51 as search keys to search the terminal authentication management DB 5002 (see Figure 8) in the storage unit 5000, and performs terminal authentication by determining whether the same terminal ID and password as the search key are managed in the terminal authentication management DB 5002 (step S23).

[0096] If the terminal authentication unit 52 determines that a terminal ID and password identical to the search key are not managed, that is, if it determines that the login request is not from a transmission terminal 10 with legitimate access rights, the transmission / reception unit 51 transmits the authentication result information, which represents the authentication result obtained by the terminal authentication unit 52, to the transmission terminal 10aa that made the login request via the transmission network 2, and the preparatory operation ends.

[0097] On the other hand, if the terminal authentication unit 52 determines that the same terminal ID and password as the search key are being managed, that is, if it determines that the login request is from a transmission terminal 10 with legitimate usage rights, the status management unit 53 stores the terminal ID of the transmission terminal 10aa, its operating status, the date and time the login request information was received, and the IP address of the transmission terminal 10aa in association with each other in the terminal management DB 5003 (see Figure 9) (step S24).

[0098] As a result, as shown in Figure 9, the terminal management table will manage the terminal by associating the terminal ID "01aa", operating status "Online (transmission possible)", reception date and time "2009.11.10.13:40", and the IP address of transmission terminal 10aa "1.2.1.3".

[0099] Next, the transmitting / receiving unit 51 of the transmission management device 50 transmits authentication result information, which represents the authentication result obtained by the terminal authentication unit 52, to the transmission terminal 10aa that requested login via the transmission network 2 (step S25).

[0100] Next, the terminal extraction unit 54 of the transmission management device 50 searches the destination list management DB 5004 (see Figure 10) using the terminal ID "01aa" of the transmission terminal 10aa that made the login request as the search key, and extracts terminal IDs of candidate destination terminals for the transmission terminal 10aa (step S26).

[0101] Here, the terminal IDs "01ab", "01ba", and "01db" of the destination terminals, transmission terminals 10ab, 10ba, and 10db, respectively, will be extracted for the terminal ID "01aa" of transmission terminal 10aa.

[0102] Next, the terminal status acquisition unit 55 of the transmission management device 50 searches the terminal management DB 5003 (see Figure 9) using the terminal IDs "01ab", "01ba", and "01db" of the candidate destination terminals extracted by the terminal extraction unit 54 as search keys, and acquires the operating status of each transmission terminal 10ab, 10ba, and 10db by reading the operating status "offline", "online (transmission possible)", and "online (transmission in progress)" for each terminal ID extracted by the terminal extraction unit 54 (step S27).

[0103] Next, the transmitting / receiving unit 51 of the transmission management device 50 transmits destination status information to the transmission terminal 10aa via the transmission network 2, which includes the terminal IDs "01ab", "01ba", and "01db" used as search keys in step S27, and the operating status of the corresponding transmission terminals 10ab, 10ba, and 10db, respectively: "offline", "online (transmission possible)", and "online (transmission in progress)" (step S28).

[0104] This allows transmission terminal 10aa to understand the current operating status of each of the candidate destination terminals, transmission terminals 10ab, 10ba, and 10db, which are "offline," "online (transmission possible)," and "online (transmission in progress)."

[0105] Furthermore, the terminal extraction unit 54 of the transmission management device 50 searches the destination list management DB 5004 (see Figure 10) using the terminal ID "01aa" of the transmission terminal 10aa that made the login request as a search key, and extracts the terminal IDs of other transmission terminals that have registered the terminal ID "01aa" of transmission terminal 10aa as a candidate destination terminal (step S29). For example, in the destination list management table shown in Figure 10, the extracted terminal IDs are "01ab", "01ba", and "01db".

[0106] Next, the status management unit 53 of the transmission management device 50 searches the terminal management DB 5003 (see Figure 9) using the terminal ID "01aa" of the transmission terminal 10aa that requested login as the search key, and obtains the operating status "online (transmission possible)" of the transmission terminal 10aa that requested login (step S30).

[0107] Next, the transmitting / receiving unit 51 of the transmission management device 50 transmits destination status information, which includes the terminal ID "01aa" and operating status "Online (Transmission Possible)" of transmission terminal 10aa, to the transmission terminals 10ba and 10db that are identified as "Online" in the terminal management DB 5003 (see Figure 9) among the transmission terminals 10ab, 10ba, and 10db identified by the terminal IDs "01ab", "01ba", and "01db" extracted in step S29 (steps S31-1, 2).

[0108] When transmitting destination status information to transmission terminals 10ba and 10db, the transmitting / receiving unit 51 refers to the IP address of the transmission terminal managed in the terminal management table shown in Figure 9, based on the respective terminal IDs "01ba" and "01db".

[0109] This allows transmission terminals 10db and 10ba, which can transmit to transmission terminal 10aa that made the login request, to be informed of the terminal ID "01aa" and operating status "online (transmission possible)" of the transmission terminal 10aa that made the login request.

[0110] Furthermore, when step S28 of the preparation phase is completed, the display control unit 17 of the transmission terminal 10aa can use the destination list information displayed on the display 120 to highlight on the display 120 the information of transmission terminals 10db that are participating in the video conference, i.e., transmission terminals 10db whose operating status is "online (transmitting)" or "online (transmittable)", thereby allowing the user to recognize the transmission terminals 10 that are participating in the video conference or transmission terminals 10 that are capable of participating.

[0111] Figure 12 is a sequence diagram showing the conference participation process from when the transmission terminal 10 enters a participating state in a video conference. Note that Figure 12 shows an example where the transmission terminal 10aa enters a participating state. During the conference participation process, various types of information are sent and received in the management information session sei (see Figure 2).

[0112] First, when the user presses the operation button 108 to select to participate in the video conference, the operation input reception unit 12 receives a request from the transmission terminal 10db to participate in the video conference (step S41).

[0113] In response to this request, the transmitting / receiving unit 11 of the transmission terminal 10aa transmits participation request information to the transmission management device 50, which includes the terminal ID "01aa" of the transmission terminal 10aa and the terminal ID "01db" of the transmission terminal 10db, and indicates that the user intends to participate in the video conference (step S42).

[0114] As a result, the transmitting / receiving unit 51 of the transmission management device 50 can receive the participation request information and confirm the IP address "1.2.1.3" of the transmission terminal 10aa, which is the source of the transmission.

[0115] Next, the status management unit 53 of the transmission management device 50 searches using the terminal ID "01aa" of the transmission terminal 10aa included in the participation request information as the search key, and sets the operational status of the transmission terminal 10aa that made the participation request to "online (transmitting)" (step S43).

[0116] Next, the transmitting / receiving unit 51 of the transmission management device 50 transmits start request information, including the terminal ID "01aa" of the transmission terminal 10aa, to the transmission terminal 10db via the transmission network 2 (step S44). This allows the transmission terminal 10db to determine which transmission terminal 10 has requested to join the video conference.

[0117] For the sake of clarity in understanding the invention, the explanation will be omitted, but in the terminal management DB 5003 shown in Figure 9, the operating status of the transmission terminal 10cb is also "online (transmitting)". Therefore, the transmitting and receiving unit 51 of the transmission management device 50 transmits start request information including the terminal ID "01aa" of the transmission terminal 10aa to the transmission terminal 10cb via the transmission network 2.

[0118] Next, the transmission terminal 10db transmits reception completion information from the transmitting / receiving unit 11 to the transmission management device 50 via the transmission network 2, indicating that the reception of the start request information has been completed (step S45).

[0119] Next, the transmitting / receiving unit 51 of the management system 50 transmits relay start request information to the relay device 30 via the communication network 2, indicating a request to start relaying (step S46). The relay start request information includes the IP addresses "1.2.1.3" and "1.3.2.4" of the transmission terminals 10aa and 10db, respectively.

[0120] As a result, the relay device 30 establishes a session between transmission terminals 10aa and 10db for transmitting three image data sets—low resolution, medium resolution, and high resolution—as well as audio data (step S47). In this way, transmission terminal 10aa becomes able to participate in a video conference with transmission terminal 10db.

[0121] On the other hand, the transmitting / receiving unit 51 of the management system 50 casts terminal status change information, which includes the terminal ID "01aa" and the operating status "online (transmitting)" of the transmission terminal 10aa, to each transmission terminal 10 registered in the terminal management DB 5003 (see Figure 9) (step S48). As a result, each transmission terminal that receives the terminal status change information can store and display the operating status of the transmission terminal 10aa with terminal ID "01aa" as needed.

[0122] Figure 13 is a sequence diagram showing the data transmission operation between transmission terminals 10. In the data transmission operation shown in Figure 13, image data and sound data are sent and received using the image / sound data session sed (see Figure 2).

[0123] As explained using Figure 12, once a session is established between transmission terminals 10aa and 10db, transmission terminal 10aa transmits the image data obtained by imaging unit 14 and the sound data converted from the sound signal input to sound input unit 15a to relay device 30 via transmission / reception unit 51 (step S60).

[0124] The relay device 30, having received image data and sound data from transmission terminal 10aa, transmits the received image data and sound data to each transmission terminal 10aa, 10db participating in the video conference (steps S61-1, 61-2).

[0125] Each transmission terminal 10aa, 10db that receives image data and sound data from the relay device 30 displays the image represented by the received image data on the display 120 using the display control unit 17, and outputs the sound represented by the received sound data to the speaker 150 using the sound output unit 15b (steps S62-1, S62-2).

[0126] Next, the transmission terminal 10db transmits the image data obtained by the imaging unit 14 and the sound data converted from the sound signal input to the sound input unit 15a to the relay device 30 via the transmitting / receiving unit 51 (step S63).

[0127] The relay device 30, having received image data and sound data from transmission terminal 10db, transmits the received image data and sound data to each transmission terminal 10aa, 10db participating in the video conference (steps S64-1, S64-2).

[0128] Each transmission terminal 10aa, 10db that receives image data and sound data from the relay device 30 displays the image represented by the received image data on the display 120 using the display control unit 17, and outputs the sound represented by the received sound data to the speaker 150 using the sound output unit 15b (steps S65-1, S65-2).

[0129] In this way, transmission terminals 10aa and 10db can conduct video conferencing via the relay device 30. Note that in Figure 13, for the sake of easier understanding of the present invention, the transmission terminals 10 participating in the video conferencing are shown as two transmission terminals 10aa and 10db. However, even if there are three or more transmission terminals 10 participating in the video conferencing, the image data and sound data will be transmitted in the same manner as the data transmission operation shown in Figure 13.

[0130] Here, the image display of the transmission terminal 10 will be described. In this embodiment, the display control unit 17 has two display modes: a full image display mode and an information display mode. Switching between these display modes is performed, for example, in response to the operation of the operation button 108.

[0131] As shown in Figure 14, in full image display mode, the display control unit 17 of the transmission terminal 10 displays all images transmitted from each transmission terminal 10 participating in the video conference on the display 120.

[0132] The display screen shown in Figure 14 is allocated a relatively large first image area 500 and a number of relatively small second image areas 510. For example, each second image area 510 displays an image represented by image data transmitted from each transmission terminal 10 participating in the video conference, while the first image area 500 displays an image represented by image data from the main transmission terminal among the transmission terminals 10 participating in the video conference.

[0133] For example, the display control unit 17 identifies the transmission terminal that sent the audio data representing speech among the transmission terminals 10 participating in the video conference as the primary terminal. Here, audio data representing speech refers to audio data in which an audio segment has been detected for each received audio data, and it has been determined that a voiced segment exists. Note that the detection of an audio segment can be achieved using known techniques (see, for example, Non-Patent Document 1).

[0134] On the other hand, as shown in Figure 15, in information display mode, the display control unit 17 of the transmission terminal 10 displays terminal information on the display 120, which includes at least the terminal name and terminal ID of each transmission terminal 10 participating in the video conference.

[0135] The display screen shown in Figure 15 is allocated an image display area 520 for displaying images and a terminal information display area 530 for displaying terminal information. For example, the terminal information display area 530 displays a list of terminal information for transmission terminals 10 participating in the video conference.

[0136] Note that terminals whose names are not displayed in the terminal information shown in the list represent transmission terminals 10 that are not registered as candidate destination terminals for the terminal in the destination list management DB5004 (see Figure 10).

[0137] For example, in the display screen shown in Figure 15, the transmission terminal 10db is registered in the destination list management DB 5004 as a candidate destination terminal for transmission terminal 10aa, so its terminal name is displayed. However, the transmission terminal 10cb is not registered in the destination list management DB 5004 as a candidate destination terminal for transmission terminal 10aa, so its terminal name is not displayed.

[0138] The image display area 520 displays an image representing the image data of the main transmission terminal among the transmission terminals 10 participating in the video conference. For example, the display control unit 17 identifies the transmission terminal that is the source of the audio data representing voice among the received audio data among the transmission terminals 10 participating in the video conference as the main transmission terminal. Alternatively, the display control unit 17 may identify the selected transmission terminal as the main transmission terminal when the operation input reception unit 12 receives confirmation that one transmission terminal has been selected from the transmission terminals 10 participating in the video conference in response to an operation of the operation button 108 by the user.

[0139] Figure 16 is a sequence diagram showing the terminal information display operation, which displays terminal information in the terminal information display area 530 when the transmission terminal 10 is switched to information display mode. In the terminal information display operation shown in Figure 16, various types of information are transmitted and received in the management information session sei.

[0140] First, the transmission terminal 10 sends a terminal information request signal to the transmission management device 50, which represents a request for terminal information from a transmission terminal participating in the video conference (step S70). Upon receiving the terminal information request signal, the terminal status acquisition unit 55 of the transmission management device 50 searches the terminal management DB 5003 (see Figure 9) in the storage unit 5000 using the IP address of the source of the terminal information request signal as a search key, and obtains the terminal ID of the transmission terminal that sent the terminal information request signal (step S71).

[0141] Next, the terminal status acquisition unit 55 searches the terminal management DB 5003 to find terminal IDs and terminal names whose operating status is "online (transmitting)" (step S72). In this embodiment, the terminal IDs detected by the terminal status acquisition unit 55 are "01aa", "01cb", and "01db". Note that the operating status of the transmission terminal with terminal ID "01aa" is set to "online (transmitting)" in step S43.

[0142] Next, the terminal status acquisition unit 55 uses the terminal ID detected in step S71 (in this embodiment, "01aa") as a search key to search the destination list management DB 5004 (see Figure 10) in the storage unit 5000 and obtains the terminal ID of a candidate destination terminal that is the source of the terminal information request signal (step S73).

[0143] For example, if the terminal ID of the transmission terminal that sent the terminal information request signal is "01aa", the terminal IDs acquired by the terminal status acquisition unit 55 will be "01ab", "01ba", and "01db".

[0144] Next, the terminal status acquisition unit 55 determines whether each terminal ID acquired in step S72 is included in the terminal ID of the sender of the terminal information request signal or the terminal ID acquired in step S73. If it determines that it is included, it sends the terminal ID and terminal name to the sender of the terminal information request signal via the transmit / receive unit 51. If it determines that it is not included, it sends only the terminal ID to the sender of the terminal information request signal via the transmit / receive unit 51 (step S74).

[0145] For example, if the terminal ID of the transmission terminal that sent the terminal information request signal is "01aa", then the transmission terminal aa, which is the source of the terminal information request signal, will receive the terminal IDs "01aa" and "01db" of transmission terminal aa and transmission terminal db, as well as the terminal names "Japan Tokyo Office AA Terminal" and "USA Washington Office DB Terminal", and the terminal ID "01cb" of transmission terminal cb.

[0146] Upon receiving this response, the display control unit 17 of the transmission terminal 10 displays the response content in the terminal information display area 530, as shown in the display screen in Figure 14 (step S75).

[0147] <<Main Effects of This Embodiment>> As described above, the transmission system 1 according to this embodiment allows the transmission management device 50 to respond with information about the transmission terminals 10 participating in the video conference. Therefore, regardless of the number of transmission terminals 10 participating in the video conference, each user of the transmission terminal 10 can be made aware of which transmission terminals 10 are participating in the video conference.

[0148] As a result, transmission system 1 can inform users of the video conference participants without requiring them to ask in conversation, thus shortening conference times. Furthermore, transmission system 1 does not display the terminal name for transmission terminals that are not registered as destinations, so it can inform participants if an unknown person is joining the video conference, allowing them to proceed with the conference while paying attention to what they are saying.

[0149] Furthermore, even when terminal information is being displayed on the display 120, the transmission system 1 also displays image data of the main transmission terminals, allowing users to understand the current status of the location leading the meeting.

[0150] [Supplement to the Embodiment] In the above embodiment, the relay device 30, the transmission management device 50, and the program provision device 90 may be constructed by a single computer, or they may be constructed by multiple computers, each part (function or means) divided and assigned as desired.

[0151] Furthermore, if the program provider 90 is built on a single computer, the program transmitted by the program provider 90 may be transmitted in multiple modules or without being divided.

[0152] Furthermore, if the program provider 90 is constructed using multiple computers, the multiple modules may be separated and transmitted from each computer.

[0153] Furthermore, recording media such as CD-ROMs on which the transmission terminal control program, relay device program, or transmission management program of each of the above embodiments are stored, as well as HD204 on which these programs are stored, and program supply devices 90 equipped with HD204, are all used as program products when the above transmission terminal control program, relay device program, and transmission management program are provided to users, etc., domestically or internationally.

[0154] Furthermore, while the image quality of the image data relayed by the relay device 30 was managed by focusing on the image resolution of the image data, this is not the only example of quality management. Other examples of quality management may include focusing on the depth of image quality, the sampling frequency of the sound data, and the bit length of the sound data. Additionally, the sound data may be transmitted and received separately in three resolutions (high resolution, medium resolution, and low resolution).

[0155] Furthermore, while Figure 9 shows that the IP address of the transmission terminal 10 is managed, this is not the only option. Any information that identifies the transmission terminal 10 on the transmission network 2 is acceptable; for example, the FQDN (Fully Qualified Domain Name) of the transmission terminal 10 could be managed. In this case, the IP address corresponding to the FQDN would be obtained by a well-known DNS (Domain Name System) server.

[0156] Furthermore, although the above embodiment described a video conferencing system as an example of the transmission system 1, it is not limited to this, and may also be a telephone system such as an IP (Internet Protocol) phone or an internet phone.

[0157] Furthermore, the transmission system 1 may be a car navigation system. In this case, for example, one of the transmission terminals 10 corresponds to a car navigation device installed in a vehicle, and the other of the transmission terminals 10 corresponds to a management terminal or management server of a management center that manages the car navigation system, or a car navigation device installed in another vehicle. Alternatively, the transmission system 1 may consist of a mobile phone as the transmission terminal 10.

[0158] Furthermore, while the above embodiment described image data and sound data as examples of content data, it is not limited to these, and may also include tactile (touch) data. In this case, the sensation of contact by the user at one transmission terminal is transmitted to the other transmission terminal.

[0159] Furthermore, the content data may also be olfactory (smell) data. In this case, the smell from one transmission terminal is transmitted to the other transmission terminal. Also, the content data may consist of at least one of the following: image data, sound data, tactile data, and olfactory data.

[0160] Furthermore, although the above embodiment describes a case where a video conference is conducted using the transmission system 1, it is not limited to this, and it may also be used for meetings, general conversations between family members or friends, or for the presentation of information in one direction. [Explanation of Symbols]

[0161] 1. Transmission System 10 Transmission terminals 11. Transmitting and Receiving Unit (Transmitter, Receiver) 12 Operation Input Reception Unit 15a Audio input section (audio data input section) 15b Audio input section 17 Display Control Unit 19 Memory and Retrieval Processing Unit 30 Relay device 50 Transmission Management Device 51 Transmitting and Receiving Unit (Transmitter, Receiver) 52. Authentication section of the terminal 53 Status Management Department 54 Terminal extraction unit 55 Terminal status acquisition unit 59 Memory and Retrieval Processing Unit 70 Routers 90 Program provisioning device 112 Camera (imaging device) 113 Image Sensor I / F (Image Data Input Section) 114 Microphone (sound collection device) 120 displays (display devices) 1000 storage section 5000 storage section 5002 Terminal Authentication Management DB 5003 Terminal Management DB (Terminal Management Table Storage Unit) 5004 Destination List Management DB (Destination List Management Table Storage Unit) [Prior art documents] [Patent Documents]

[0162] [Patent Document 1] Patent No. 3308563 [Non-patent literature]

[0163] [Non-Patent Document 1] Niimi, "Speech Recognition," Kyoritsu Shuppan, pp. 68-72.

Claims

1. In a transmission system including a transmission terminal and a management device that manages name information associated with the transmission terminal, The aforementioned transmission terminal has a first function of displaying image data transmitted from other transmission terminals participating in communication based on image data that it has joined by accepting an operation, and a second function of displaying a list of name information associated with the other transmission terminals participating in the communication. The management device has a transmission unit that transmits name information associated with other transmission terminals participating in the same communication as the transmission terminal that received the operation to the transmission terminal that received the operation. The transmission terminal that received the above operation further: A receiving unit that receives the name information transmitted by the transmitting unit, The system includes a display control unit that displays a first screen which displays image data transmitted from the other transmission terminal by the first function, and which does not include a specific display area for displaying the name information in a list by the second function, The display control unit further displays a second screen that displays image data transmitted from the other transmission terminal by the first function, the second screen including the specific display area. The first screen is displayed when a first mode among multiple display modes is selected, and the second screen is displayed when a second mode, different from the first mode among multiple display modes, is selected. When the display control unit is displaying the first screen, if it receives an operation to switch the display mode, it switches from the first screen to the second screen and displays it; when the second screen is displaying, if it receives the same operation, it switches from the second screen to the first screen and displays it; The first screen and the second screen display image data transmitted from other transmission terminals participating in the communication, which are the source of sound data representing voice. A transmission system characterized by the following.

2. The aforementioned control device is After receiving the aforementioned operation, in response to a request sent from the transmission terminal that received the operation, The system further includes an information acquisition unit that acquires name information associated with other transmission terminals participating in the same communication as the transmission terminal that sent the request, The transmission system according to claim 1, characterized in that the transmitting unit transmits the information acquired by the information acquisition unit.

3. The aforementioned control device is A terminal information storage unit that stores terminal information including at least an identifier for a transmission terminal and name information associated with the transmission terminal, It further includes a destination list management unit that manages the destination list associated with the transmission terminal, The transmission system according to claim 2, characterized in that when the information acquisition unit receives a terminal information request representing a request for information to identify other transmission terminals participating in the same communication as the transmission terminal that accepted the operation, it acquires the identifier and name information included in the terminal information for transmission terminals among the other transmission terminals that are registered in the destination list associated with the transmission terminal that sent the terminal information request, and acquires the identifier included in the terminal information for transmission terminals that are not registered in the destination list.

4. The transmission system according to any one of claims 1 to 3, characterized in that the name information associated with the other transmission terminal is information that is registered or modified in response to a request from the other transmission terminal.

5. The transmission system according to any one of claims 1 to 4, characterized in that it transmits or receives content data between the transmission terminal that received the operation and other transmission terminals participating in the same communication.

6. The transmission system according to claim 5, characterized in that the content data includes at least image data and sound data.

7. The transmission system according to claim 5 or 6, characterized in that other transmission terminals participating in the same communication as the transmission terminal that received the operation transmit or receive the content data via a relay device.

8. The transmission system according to any one of claims 1 to 7, characterized in that the transmission terminal is a communication terminal, a car navigation device, or a mobile phone.

9. The transmission system according to any one of claims 1 to 8, characterized in that the name information indicates the identification name of the other transmission terminal.

10. The management device further includes a status management unit that manages the participation status of the transmission terminal in the meeting, The transmission system according to any one of claims 1 to 9, characterized in that the transmitting unit transmits name information associated with another transmission terminal indicating that the participant status is participating in a meeting to the transmission terminal that received the operation.

11. In a transmission terminal connected to at least one computer via a network, It has a first function that displays image data transmitted from other transmission terminals participating in communication based on image data acquired by accepting an operation, and a second function that displays a list of name information associated with the other transmission terminals participating in the communication. A receiving unit that receives name information associated with other transmission terminals participating in the same communication as the transmission terminal, transmitted by at least one of the aforementioned computers, The system includes a display control unit that displays a first screen which displays image data transmitted from the other transmission terminal by the first function, and which does not include a specific display area for displaying the name information in a list by the second function, The display control unit further displays a second screen that displays image data transmitted from the other transmission terminal by the first function, the second screen including the specific display area. The first screen is displayed when a first mode among multiple display modes is selected, and the second screen is displayed when a second mode, different from the first mode among multiple display modes, is selected. When the display control unit is displaying the first screen, if it receives an operation to switch the display mode, it switches from the first screen to the second screen and displays it; when the second screen is displaying, if it receives the same operation, it switches from the second screen to the first screen and displays it; The first screen and the second screen display image data transmitted from other transmission terminals participating in the communication, which are the source of sound data representing voice. A transmission terminal characterized by the following.

12. A transmission terminal control method executed by a transmission terminal having a first function that displays image data transmitted from other transmission terminals participating in communication based on image data, which is connected to at least one computer via a network and accepts operations, and a second function that displays a list of name information associated with the other transmission terminals participating in the communication, A receiving step of receiving name information associated with other transmission terminals participating in the same communication as the transmission terminal, transmitted by at least one of the aforementioned computers, The display control step includes a first screen that displays image data transmitted from the other transmission terminal by the first function, the first screen which does not include a specific display area for displaying the name information in a list by the second function, The display control step further causes the display of a second screen which displays image data transmitted from the other transmission terminal by the first function, the second screen which includes the specific display area, The first screen is displayed when a first mode among multiple display modes is selected, and the second screen is displayed when a second mode, different from the first mode among multiple display modes, is selected. The display control step, when the first screen is displayed, receives an operation to switch the display mode, switches from the first screen to the second screen and displays it; when the second screen is displayed, receives the same operation, switches from the second screen to the first screen and displays it; The first screen and the second screen display image data transmitted from other transmission terminals participating in the communication, which are the source of sound data representing voice. A transmission terminal control method characterized by the following.

13. A transmission terminal that connects to at least one computer via a network, The first function is to display image data transmitted from other transmission terminals participating in communication based on image data acquired by accepting an operation. A second function that displays a list of name information associated with other transmission terminals participating in the aforementioned communication. A receiving unit that receives name information associated with other transmission terminals participating in the same communication as the transmission terminal, transmitted by at least one of the aforementioned computers. A display control unit is configured to display a first screen that displays image data transmitted from the other transmission terminal by the first function, and which does not include a specific display area for displaying the name information in a list by the second function. The display control unit further displays a second screen that displays image data transmitted from the other transmission terminal by the first function, the second screen including the specific display area. The first screen is displayed when a first mode among multiple display modes is selected, and the second screen is displayed when a second mode, different from the first mode among multiple display modes, is selected. When the display control unit is displaying the first screen, if it receives an operation to switch the display mode, it switches from the first screen to the second screen and displays it; when the second screen is displaying, if it receives the same operation, it switches from the second screen to the first screen and displays it; The first and second screens are configured to display image data transmitted from other transmission terminals participating in the communication, specifically those that are the source of sound data representing voice. A transmission terminal control program characterized by the following.

14. The transmission terminal control program according to claim 13, characterized in that the name information associated with the other transmission terminal is information that is registered or modified in response to a request from the other transmission terminal.

15. A transmission terminal control program according to any one of claims 13 to 14, characterized in that it transmits or receives content data between the transmission terminal that received the operation and other transmission terminals participating in the same communication.

16. The transmission terminal control program according to claim 15, characterized in that the content data includes at least image data and sound data.

17. The transmission terminal control program according to claim 15 or 16, characterized in that other transmission terminals participating in the same communication as the transmission terminal that received the operation transmit or receive the content data via a relay device.

18. The transmission terminal control program according to any one of claims 13 to 17, characterized in that the transmission terminal is a communication terminal, a car navigation device, or a mobile phone.

19. The transmission terminal control program according to any one of claims 13 to 18, characterized in that the name information indicates the identification name of the other transmission terminal.

Images