Transmission system, transmission terminal and program

Abstract

To reduce discomfort on the quality of communication.SOLUTION: A transmission system is for a plurality of transmission terminals to perform communication via a network, and has: a transmission and reception unit that holds information on communication used for the communication; a video encoding unit that holds information on the quality of video data, voice data, or content data used for the communication; and an analysis unit that, when data transmission corresponding to the communication is cut off, analyzes the necessity of an improvement plan based on the information held by the transmission and reception unit or the information held by the video encoding unit.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a transmission system, a transmission terminal, and a program. [Background technology]

[0002] There are known conference systems that conduct remote conferences between remote locations via a communication network such as the Internet. However, the network environment is not always stable and may become unstable, which can cause communication to be interrupted or disconnected (interrupted) due to network factors. When communication is disconnected, there is no guarantee that the instability of the network environment will be resolved immediately, so if communication is resumed in the same manner as before the disconnection, there is a possibility that the communication will be disconnected again due to network factors. For this reason, it is desirable for users to set appropriate communication quality, communication method, etc. before resuming communication.

[0003] Therefore, there is known a technique for setting an appropriate network bandwidth and facilitating reconnection when communication is interrupted (for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional technology, for example, in a situation where a communication method in which network bandwidth is prone to fluctuations, such as a wireless environment, is used, or in an environment where a communication method in which congestion is likely to occur when the network bandwidth narrows, such as a TCP (Transmission Control Protocol) environment, is used, and congestion is likely to affect the network bandwidth, it is difficult to predict or estimate the network bandwidth, and even if the network bandwidth is thought to be set appropriately, a situation may occur in which the bandwidth falls below the set value. Furthermore, in the above-mentioned conventional technology, since the reconnection occurs without the user being aware of the change in network bandwidth setting, if the network bandwidth is lowered, the quality of communication may be reduced unintentionally by the user.

[0005] Therefore, in the above-mentioned conventional technology, when communication is interrupted, even if an appropriate network bandwidth is set and reconnection is attempted, there is a possibility that a disconnection may occur again in an environment where the communication method or communication method makes it difficult to predict or estimate the network bandwidth, and there is also the problem that this may result in an unintended deterioration in communication quality by the user, which may lead to discomfort with the communication itself.

[0006] The present invention has been made in view of the above, and has an object to provide a transmission system, a transmission terminal, and a program that reduce discomfort related to the quality of communication. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the object, the present invention provides a transmission system for a plurality of transmission terminals to communicate via a network, the system including: a transmitting / receiving unit that holds information related to communication used in the communication; a video encoding unit that holds information related to the quality of video data, audio data, or content data used in the communication; If the data transmission corresponding to said communication is interrupted and it is determined that a remedial measure is necessary, an analysis unit that generates an improvement plan based on information held by the transmission / reception unit or information held by the video encoding unit; an output unit that outputs the generated improvement plan for display when a reconnection operation due to a data transmission interruption is received from a user;The present invention is characterized by having the following. [Effects of the Invention]

[0008] The present invention has the effect of reducing discomfort regarding the quality of communication. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a transmission system according to the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a transmission terminal according to the first embodiment. [Figure 3] FIG. 3 is a hardware configuration diagram of the transmission management system according to the first embodiment. [Figure 4] FIG. 4 is a conceptual diagram showing an overview of communication in the transmission system according to the first embodiment. [Figure 5] FIG. 5 is a block diagram illustrating an example of a functional configuration of the transmission terminal according to the first embodiment. [Figure 6] FIG. 6 is a functional configuration diagram of the conference analysis unit 25 according to the first embodiment. [Figure 7] FIG. 7 is a sequence diagram showing the process from when data transfer is interrupted to when a remedy for the interruption is created. [Figure 8] FIG. 8 is a diagram illustrating an example of communication information according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the conference quality information according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing the flow of the analysis process according to the first embodiment. [Figure 11] FIG. 11 is a flowchart showing the flow of the improvement plan creation process according to the first embodiment. [Figure 12] FIG. 12 is a sequence diagram showing the process from when an improvement plan is created to when the improvement plan is implemented. [Figure 13]FIG. 13 is a diagram illustrating an example of an improvement plan list according to the first embodiment. [Figure 14] FIG. 14 is a flowchart schematically showing the flow of the improvement plan creation process according to the second embodiment. [Figure 15] FIG. 15 is a sequence diagram showing the process from creating an improvement plan to implementing the improvement plan and issuing a notification regarding the improvement. [Figure 16] FIG. 16 is a diagram showing an example of a display of the contents of the implemented improvement measures. [Figure 17] FIG. 17 is a sequence diagram showing a process of returning to the settings before the improvement after the improvement plan is implemented. [Figure 18] FIG. 18 is a diagram showing an example of a notification as to whether or not to return to the settings before the improvement. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0011] (First embodiment) <System configuration> 1 is a diagram showing an example of the configuration of a transmission system according to a first embodiment. The transmission system includes a data providing system that transmits content data unidirectionally from one transmission terminal to another transmission terminal via a transmission management system, and a communication system that transmits information, emotions, etc. between multiple transmission terminals via the transmission management system. This communication system is a system for transmitting information, emotions, etc. between multiple communication terminals (corresponding to "transmission terminals") via the communication management system (corresponding to "transmission management system"). Examples of this communication system include a video conference system, a video phone system, an audio conference system, an audio phone system, and a screen sharing system.

[0012] In this embodiment, a transmission system, a transmission management system, and a transmission terminal will be described assuming a video conference system as an example of a communication system, a video conference management system as an example of a communication management system, and a video conference terminal as an example of a communication terminal. That is, the transmission terminal and the transmission management system of the present invention are not only applied to a video conference system, but also to a communication system or a transmission system.

[0013] The transmission system 1 shown in FIG. 1 is constructed by a plurality of transmission terminals (10aa, 10ab, ..., 10dc), displays (120aa, 120ab, ..., 120dc) for each transmission terminal (10aa, 10ab, ..., 10dc), a plurality of relay devices (30a, 30b, 30c, 30d), a transmission management system 50, a program provision system 90, a maintenance system 100, etc.

[0014] In this embodiment, any one of the transmission terminals (10aa, 10ab, ..., 10dc) will be referred to as "transmission terminal 10." Any one of the displays (120aa, 120ab, ..., 120dc) will be referred to as "display 120." Any one of the relay devices (30a, 30b, 30c, 30d) will be referred to as "relay device 30."

[0015] Furthermore, the configuration in which the transmission terminal 10 shown in FIG. 1 has the display 120 is merely an example.

[0016] The relay device 30 relays video data, audio data, etc. between multiple transmission terminals 10. The transmission management system 50 centrally manages login authentication from the transmission terminal 10, management of the communication status of other transmission terminals 10, management of the destination list, etc., and management of the communication status of the relay device 30, etc.

[0017] The multiple routers (70a, 70b, 70c, 70d, 70ab, 70cd) select the optimal route for content data. In this embodiment, the term "router 70" is used to refer to any of the routers (70a, 70b, 70c, 70d, 70ab, 70cd).

[0018] The program providing system 90 includes a hard disk (HD) (described later) that stores programs for the transmission terminal 10 to enable the transmission terminal 10 to realize various functions or various means, and can transmit the programs for the transmission terminal 10 to the transmission terminal 10. The HD of the program providing system 90 also stores programs for the relay device 30 to enable the relay device 30 to realize various functions or various means, and can transmit the programs for the relay device to the relay device 30. The HD of the program providing system 90 also stores programs for transmission management to enable the transmission management system 50 to realize various functions or various means, and can transmit the programs for transmission management to the transmission management system 50.

[0019] The maintenance system 100 is a computer for maintaining, managing, or servicing at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program provision system 90. For example, if the maintenance system 100 is installed domestically and the transmission terminal 10, the relay device 30, the transmission management system 50, or the program provision system 90 is installed overseas, the maintenance system 100 remotely performs maintenance such as maintaining, managing, or servicing at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program provision system 90 via a communication network 2. In addition, the maintenance system 100 performs maintenance such as managing the model number, serial number, customer, maintenance inspection, or failure history of at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program provision system 90 without using the communication network 2.

[0020] Meanwhile, the transmission terminals (10aa, 10ab, 10ac, . . .), the relay device 30a, and the router 70a are communicatively connected via a LAN 2a. The transmission terminals (10ba, 10bb, 10bc, . . .), the relay device 30b, and the router 70b are communicatively connected via a LAN 2b. Furthermore, the LAN 2a and the LAN 2b are communicatively connected via a dedicated line 2ab including the router 70ab, and are constructed within a predetermined region A. For example, the region A is Japan, and the LAN 2a is constructed within an office in Tokyo, and the LAN 2b is constructed within an office in Osaka.

[0021] Meanwhile, the transmission terminals (10ca, 10cb, 10cc,...), the relay device 30c, and the router 70c are communicatively connected via LAN 2c. The transmission terminals 10d (a, 10db, 10dc,...), the relay device 30d, and the router 70d are communicatively connected via LAN 2d. Furthermore, LAN 2c and LAN 2d are communicatively connected via a dedicated line 2cd including a router 70cd, and are constructed within a predetermined region B. For example, region B is the United States, and LAN 2c is constructed within an office in New York, and LAN 2d is constructed within an office in Washington, D.C. Region A and region B are communicatively connected via the Internet 2i from routers (70ab, 70cd), respectively.

[0022] The transmission management system 50 and the program providing system 90 are communicably connected to the transmission terminal 10 and the relay device 30 via the Internet 2i. The transmission management system 50 and the program providing system 90 may be installed in area A or area B, or may be installed in an area other than these.

[0023] In this embodiment, the communication network 2 of this embodiment is constructed by LAN2a, LAN2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, LAN2c, and LAN2d. This communication network 2 may include locations where communication is performed not only by wired communication but also by wireless communication such as wireless LAN or short-range wireless communication.

[0024] 1, four sets of numbers shown under each transmission terminal 10, each relay device 30, transmission management system 50, each router 70, and program providing system 90 simply indicate a general IPv4 IP (Internet Protocol) address. For example, the IP address of the transmission terminal 10aa is "1.2.1.3." Although IPv6 may be used instead of IPv4, for the sake of simplicity, IPv4 will be used in the following description.

[0025] Each transmission terminal 10 may be used not only for communication between multiple offices or between different rooms in the same office, but also for calls within the same room, or for communication between indoors and outdoors or between outdoors and outdoors. When each transmission terminal 10 is used outdoors, communication is performed via a mobile communication network or the like.

[0026] <Hardware configuration of transmission terminal> 2 is a diagram illustrating an example of a hardware configuration of a transmission terminal 10 according to the first embodiment. The transmission terminal 10 is an example of a terminal device according to the present invention. As illustrated in FIG. 2, the transmission terminal 10 has a typical computer configuration, including, for example, a central processing unit (CPU) 101, a read-only memory (ROM) 102, a random access memory (RAM) 103, a flash memory 104, a solid-state drive (SSD) 105, a media drive 107, operation buttons 108, a power switch 109, a network I / F 111, a camera 112, an image sensor I / F 113, a microphone 114, a speaker 115, an audio input / output I / F 116, a display I / F 117, an external device connection I / F 118, and bus lines 110, such as an address bus and a data bus, for electrically connecting the above components as illustrated in FIG. 2.

[0027] 2 is merely an example. For example, the transmitting terminal 10 does not necessarily have to have the microphone 114, the speaker 115, the camera 112, etc. built-in; the microphone, the speaker, the camera, etc. may be external. The transmitting terminal 10 may also have a built-in display 120.

[0028] The CPU 101 is a computing device that realizes each function of the transmission terminal 10 by reading programs and data from the ROM 102 and executing processes. The ROM 102 is a non-volatile memory that stores programs and the like of the transmission terminal 10, and is configured, for example, by a flash ROM. The RAM 103 is a volatile memory used as a work area for the CPU 101. The flash memory 104 is a non-volatile memory that stores various data such as video data and audio data. The SSD 105 controls the reading and writing of various data from and to the flash memory 104 under the control of the CPU 101.

[0029] The media drive 107 controls reading and writing (storing) of data from and to a recording medium 106 such as a memory card. The operation button 108 is an input unit for performing various operations on the transmission terminal 10, and may be an input means other than a button, such as a touch panel. The power switch 109 is a switch for turning on / off the power of the transmission terminal 10. The network I / F 111 is an interface such as a wired / wireless LAN that transmits and receives data using a network.

[0030] Camera 112 is a device that captures an image of a subject under the control of CPU 101, and includes a lens and a solid-state image sensor that converts light into an electric charge to digitize an image (video) of the subject. The solid-state image sensor may be a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD). Image sensor I / F 113 is an interface that captures an image signal output from camera 112 for capturing images as predetermined image data. Microphone 114 receives audio and converts it into an audio signal. Speaker 115 converts the input audio signal into audio. Audio input / output I / F captures an audio signal input from microphone 114 as predetermined audio data under the control of CPU 101. It also converts the output audio data into an audio signal that can be played back by speaker 115.

[0031] The display I / F 117 is an interface that outputs various images, such as an image of the communication destination, a menu screen, a setting screen, etc., to the display 120. The display 120 is a display unit configured with a liquid crystal or organic EL display that displays an image of a subject, operation icons, etc. The display 120 is connected to the display I / F 117 by a cable 120c. This cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, or a cable for HDMI (registered trademark) (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals.

[0032] The external device connection I / F 118 is an interface for transmitting and receiving various data to and from external devices, and includes, for example, a USB (Universal Serial Bus). External devices such as an external camera, an external microphone, and an external speaker can be electrically connected to the external device connection I / F 118 via a USB cable or the like. When an external camera is connected, the external camera is driven in priority over the built-in camera 112 under the control of the CPU 101. Similarly, when an external microphone or an external speaker is connected, the external microphone or the external speaker is driven in priority over the built-in microphone 114 or the built-in speaker 115, respectively, under the control of the CPU 101.

[0033] The recording medium 106 is configured to be detachable from the transmission terminal 10. The flash memory 104 is not limited to a flash memory, and may be an EEPROM (Electrically Erasable and Programmable ROM) or the like, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101.

[0034] The program for the transmission terminal may be recorded in an installable or executable file format on a computer-readable recording medium such as the recording medium 106 and distributed.

[0035] <Hardware configuration of the transmission management system> 3 is a hardware configuration diagram of the transmission management system according to the first embodiment. The transmission management system 50 has the configuration of a general computer (server), and includes, for example, a CPU 201, a ROM 202, a RAM 203, an HD 204, an HDD (Hard Disk Drive) 205, a media drive 207, a display 208, a network I / F 209, a keyboard 211, a mouse 212, an optical drive 214, a bus line 210, and the like.

[0036] The CPU 201 is a computing device that reads programs and data from the ROM 202, HD 204, etc., and executes processing to realize each function of the transmission management system 50. The ROM 202 is a non-volatile memory that stores programs and the like for the external input device 40, and is configured, for example, by a flash ROM. The RAM 203 is a volatile memory used as a work area for the CPU 201.

[0037] The HD 204 stores various software, data, image data, audio data, etc. required for various processes executed by the CPU 201. The HDD 205 controls the reading and writing of various data from and to the HD 204 under the control of the CPU 201. The media drive 207 controls the reading and writing of data from and to the media 206, which is a recording medium such as a memory card. The display 208 displays various information such as a cursor, menus, windows, characters, images, and videos. The display 208 may be provided outside the external input device.

[0038] The network I / F 209 is an interface for transmitting and receiving data via a network, and includes, for example, a wired LA and / or a wireless LAN. The keyboard 211 is used for key input of characters, etc. The mouse 212 is a means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc., and may be, for example, another pointing device such as a touch panel or a touch pad. The optical drive 214 controls reading and writing of data from and to an optical disc 213, such as a CD (Compact Disc), DVD, or Blu-ray.

[0039] The external device I / F 215 is an interface for inputting and outputting various data to and from an external device, and includes, for example, a USB interface, etc. The bus line 210 transmits an address bus, a data bus, various control signals, and the like.

[0040] The ROM 202 and / or HD 204 stores a program for the transmission management system 50 for controlling the external input device 40. This program for the external input device may be recorded in the form of an installable or executable file on a computer-readable recording medium such as the medium 206 or the optical disk 213 and distributed.

[0041] <Hardware configuration of other devices> 3, the relay device 30 has a similar hardware configuration to the transmission management system 50, and therefore a description thereof will be omitted. However, a relay device program for controlling the relay device 30 is recorded on the HD 204 and / or ROM 202. In this case, too, the relay device program may be recorded in the form of an installable or executable file on a computer-readable recording medium such as the medium 206 or optical disk 213 and distributed.

[0042] 3, the program provision system 9 and the maintenance system 100 have the same hardware configuration as the transmission management system 50, and therefore description thereof will be omitted. However, the HD 204 and / or ROM 202 have recorded thereon a program provision program for controlling the program provision system 90 or a maintenance program for controlling the maintenance system 100. In this case as well, the program provision program, maintenance program, etc. may be recorded as an installable or executable file on a computer-readable recording medium such as the medium 206 or optical disc 213 and distributed.

[0043] <Communication Overview> FIG. 4 is a conceptual diagram illustrating an overview of communication in the transmission system 1 according to the first embodiment. In the transmission system 1 according to the first embodiment, content data is transmitted and received between a plurality of transmission terminals 10 via a relay device 30. At this time, as shown in FIG. 4, a management information session Sei for transmitting and receiving various types of management information is established between the plurality of transmission terminals 10 via a transmission management system 50. Furthermore, a data session Sed for transmitting and receiving content data is established between the plurality of transmission terminals 10 via the relay device 30. Here, in particular, the video data transmitted and received in the data session Sed is scalably encoded data, and for example, encoded data of high-quality video, encoded data of medium-quality video, and encoded data of low-quality video are transmitted and received through separate channels.

[0044] The H.264 / SVC (H.264 / AVC Annex G) encoding format is known as a standard encoding format for scalably encoding video data. In the H.264 / SVC encoding format, video data is converted into hierarchical data and encoded as a set of multiple pieces of video data with different qualities, and encoded data corresponding to the video data of each quality can be transmitted and received over multiple channels. In this embodiment, the encoded data obtained by encoding video data using this H.264 / SVC encoding format is transmitted and received between multiple transmission terminals 10.

[0045] [Embodiment] <Functional configuration> Next, a functional configuration of the transmission terminal 10 according to the first embodiment will be described. Fig. 5 is a block diagram showing an example of the functional configuration of the transmission terminal 10 according to the first embodiment. As shown in Fig. 5, the transmission terminal 10 includes a transmission / reception unit 12, an operation input reception unit 13, a login request unit 14, an imaging unit 15, an audio input unit 16, an audio output unit 17, a storage / readout processing unit 18, a volatile storage unit 19, a non-volatile storage unit 20, a display control unit 21, a video decoding unit 22, a video encoding unit 23, a bandwidth control unit 24, and a conference analysis unit 25.

[0046] The transmitting / receiving unit 12 transmits and receives various data (or information) to and from other transmission terminals 10, relay devices 30, transmission management systems 50, etc. via the communication network 2. The transmitting / receiving unit 12 is realized, for example, by a program running on the CPU 101 shown in FIG. 2 and the network I / F 111 shown in FIG. 2, etc. As an example, the transmitting / receiving unit 12 enables the exchange of session information and conference video data (images, audio, conference materials, etc.). In addition, the transmitting / receiving unit 12 holds information (communication information) related to the communication used for communication.

[0047] The operation input receiving unit 13 is realized by commands from the CPU 101 shown in Fig. 2 and the operation buttons 108 and power switch 109 shown in Fig. 2, and receives various inputs from the user. For example, when the user turns on the power switch 109 shown in Fig. 2, the operation input receiving unit 13 receives the power-on command and turns on the power.

[0048] 2, and upon receiving the power-on command, the login request unit 14 automatically transmits login request information indicating a login request and the current IP address of the requesting terminal from the transmitting / receiving unit 12 to the transmission management system 50 via the communication network 2. When the user turns the power switch 109 from the on state to the off state, the transmitting / receiving unit 12 transmits status information indicating that the power is to be turned off to the transmission management system 50, and then the operation input receiving unit 13 turns the power off completely. This allows the transmission management system 50 to know that the transmission terminal 10 has changed from a power-on state to a power-off state.

[0049] The imaging unit 15 is realized by instructions from the CPU 101 shown in FIG. 2 and the camera 112 and imaging element I / F 113 shown in FIG. 2, and converts an image of a subject captured by the camera 112 etc. into predetermined image data by the imaging element I / F and outputs the image.

[0050] The audio input unit 16 is realized by an instruction from the CPU 101 shown in Fig. 2 and the audio input / output I / F 116 shown in Fig. 2, and converts audio signals etc. of the user etc. acquired by the microphone 114 into predetermined audio data by the audio input / output I / F 116. The audio output unit 17 is realized by an instruction from the CPU 101 shown in Fig. 2 and the audio input / output I / F 116 shown in Fig. 2, converts audio data to be output into an audio signal by the audio input / output I / F 116, and outputs the converted audio signal as audio from the speaker 115.

[0051] The storage / readout processing unit 18 is realized by an instruction from the CPU 101 shown in FIG. 2 and the SSD 105 shown in FIG. 2, etc. Alternatively, the storage / readout processing unit 18 is realized by an instruction from the CPU 101. The storage / readout processing unit 18 performs processing to store and read various data in the volatile memory unit 19 and the nonvolatile memory unit 20. The volatile memory unit 19 is realized by, for example, the RAM 102 shown in FIG. 2. For example, the volatile memory unit 19 can retain information only when the power is on. The nonvolatile memory unit 20 is realized by, for example, the flash memory 104 shown in FIG. 2. For example, the nonvolatile memory unit 20 can retain information even when the power is off.

[0052] The display control unit 21 is realized by an instruction from the CPU 101 shown in Fig. 2 and the display I / F 117 shown in Fig. 2. The display control unit 21 can also transmit information of the destination list received from the transmission management system 50 to the display 120 and display the destination list on the display 120. The display control unit 21 can also output an image using an image output device connected to the transmission terminal 10. For example, when a reconnection operation is received due to a data transmission being disconnected, the display control unit 21 displays an improvement plan generated by the conference analysis unit 25. For example, the display control unit 21 displays the improvement plan in accordance with the control of the conference analysis unit 25.

[0053] The video decoding unit 22 decodes encoded data transmitted from another transmission terminal 10 via the relay device 30, and outputs the video data, audio data, and content data before encoding. The video decoding unit 22 is realized, for example, by the CPU 101 shown in FIG. 2 executing an encoding / decoding program (video / audio codec) included in the program for the transmission terminal described above. For example, the video decoding unit 22 can decode the received video data, audio data, and content data.

[0054] The video encoding unit 23 generates encoded data by encoding the video data output from the imaging unit 15 and the audio data output from the audio output unit 17. In particular, the video encoding unit 23 scalably encodes the video data in accordance with the H.264 / SVC encoding format when encoding video data. The video encoding unit 23 is realized, for example, by the CPU 101 shown in FIG. 2 executing an encoding / decoding program (video / audio codec) included in the program for the transmission terminal described above. For example, the video encoding unit 23 can encode the video data, audio data, and content data to be transmitted. The video encoding unit 23 also stores information regarding the quality of the video data, audio data, and content data used in communication.

[0055] The bandwidth control unit 24 controls the network for transmitting and receiving video data, audio data, and content data. The bandwidth control unit 24 is realized, for example, by the CPU 101 shown in FIG. 2 executing the above-mentioned program for the transmission terminal.

[0056] When data transmission (session) corresponding to communication such as a remote conference (e.g., a video conference or an audio conference) is disconnected, the conference analysis unit 25 analyzes the need for an improvement plan based on information held by the transmission / reception unit 12 or information held by the video encoding unit 23.

[0057] Furthermore, if the analysis determines that an improvement plan is necessary, the conference analysis unit 25 generates an improvement plan based on whether or not the information held by the transmission / reception unit 12 or the information held by the video encoding unit 23 satisfies predetermined condition information. Furthermore, if a reconnection operation due to a data transmission interruption is received from the user, the conference analysis unit 25 controls the display control unit 21 so that the generated improvement plan is presented (displayed) to the user. Furthermore, if the presented improvement plan is selected by the user, the conference analysis unit 25 controls so that the selected improvement plan is implemented. For example, the conference analysis unit 25 controls the transmission / reception unit 12 and the video encoding unit 23.

[0058] 6 is a functional configuration diagram of the conference analysis unit 25 according to the first embodiment. The conference analysis unit 25 includes a communication information acquisition unit 25a, a conference quality information acquisition unit 25b, an analysis unit 25c, a reception unit 25d, and an output unit 25e.

[0059] The communication information acquisition unit 25a acquires, from the transmission / reception unit 12, information relating to the communication used for communication (conference).

[0060] The conference quality information acquisition unit 25b acquires, from the video encoding unit 23, information relating to the quality of the video data, audio data, or content data used in the communication (conference).

[0061] When communication (conference) is interrupted due to a disconnection (interruption) of data transmission corresponding to the communication, the analysis unit 25c analyzes the necessity of an improvement plan for the interrupted communication based on the information acquired by the conference quality information acquisition unit 25b. Furthermore, when the analysis determines that an improvement plan is necessary, the analysis unit 25c generates an improvement plan based on the information acquired by the conference quality information acquisition unit 25b.

[0062] The reception unit 25d receives notifications and inputs addressed to the conference analysis unit 25. For example, when the user selects a presented improvement plan, the reception unit 25d receives input of the selected improvement plan (selection result).

[0063] The output unit 25e controls the display control unit 21 so that the improvement plan generated by the analysis unit 25c is displayed. For example, the output unit 25e outputs the improvement plan generated by the analysis unit 25c to the display control unit 21 so that the improvement plan is displayed. In addition, the output unit 25e controls the transmission / reception unit 12 and the video encoding unit 23 so that the improvement plan selected by the user is implemented.

[0064] Next, referring to Fig. 7, a process from when data transfer corresponding to communication is disconnected to when a remedial plan for the disconnection is created in the transmission system 1 according to the first embodiment will be described. Fig. 7 is a sequence diagram showing the process from when data transfer is disconnected to when a remedial plan for the disconnection is created. Note that in Fig. 7, the communication is assumed to be a conference (for example, communication via a video conference). Therefore, in the example of Fig. 7, the disconnection of data transfer means the disconnection of the conference, and the disconnected conference can be rephrased as a disconnected conference.

[0065] 7 illustrates data transfer between the transmission terminal aa and the transmission terminal db. That is, in the example of FIG. 7, a conference (hereinafter referred to as "conference MT1") is being held between the transmission terminal aa and the transmission terminal db. Also, a user U1 shown in FIG. 7 is the owner of the transmission terminal aa.

[0066] In this state, the transmitting / receiving unit 12 of the transmitting terminal aa determines whether the data transmission has been disconnected (step S701). For example, if the transmitting / receiving unit 12 detects that the data transmission has been disconnected, it determines that the data transmission has been disconnected and notifies the conference analysis unit 25 that the data transmission has been disconnected.

[0067] In this case, the reception unit 25d of the conference analysis unit 25 receives a disconnection notification from the transmission / reception unit 12 (step S702).

[0068] Furthermore, when the reception unit 25d receives the disconnection notification, the communication information acquisition unit 25a acquires information (communication information) related to the communication used in the conference MT1 from the transmission / reception unit 12 (step S703).

[0069] Here, communication information according to the first embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of communication information according to the first embodiment. As shown in Fig. 8, the communication information held by the transmitting / receiving unit 12 includes information indicating each item such as "communication means," "communication method," "proxy," "communication capability," and "disconnection reason."

[0070] "Communication means" is information indicating the means used for communication to transmit data, and examples of communication means include "wired communication" and "wireless communication." In the example of Figure 8, the communication means is "wireless." This example indicates that in conference MT1, data transmission is performed using the communication means "wireless communication." "Communication method" is information indicating the protocol used for communication to transmit data, and examples of communication methods include "UDP" and "TCP." In the example of Figure 8, the communication method is "TCP." This example indicates that in conference MT1, data transmission is performed using the communication method "UDP."

[0071] "Proxy" is information indicating whether or not a proxy is used. In the example of Fig. 8, "no proxy" is shown. This example shows that data transmission is performed in conference MT1 with "no proxy."

[0072] "Communication availability" is information indicating whether communication for data transmission is possible, and examples of such information include "link up" and "link down." In the example of FIG. 8, communication availability is indicated as "available." This example shows that communication for data transmission is "available" in conference MT1.

[0073] The "disconnection reason" is information indicating the reason why data transmission was disconnected, and examples of such reasons include "disconnection due to poor communication with the transmission management system 50 or the relay device 30" and "disconnection due to user operation." In the example of FIG. 8, the disconnection reason is "connection lost with the relay device." This example indicates that the reason why data transmission was disconnected in conference MT1 is "connection lost with the relay device."

[0074] Returning to the description of Fig. 7, when the reception unit 25d receives the disconnection notification, the conference quality information acquisition unit 25b acquires information (conference quality information) related to the quality of the video data, audio data, or content data used in the conference MT1 from the video encoding unit 23 (step S704).

[0075] Here, the conference quality information according to the first embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of the conference quality information according to the first embodiment. In the example of Fig. 9, the conference quality information includes information indicating the quality of "video" data used in the conference, information indicating the quality of "audio" data used in the conference, and information indicating the quality of "content data" used in the conference.

[0076] Furthermore, information indicating quality includes, for example, items such as "resolution," "frame rate," "sampling frequency," and "used bandwidth." "Resolution" indicates the resolution of the data transmitted in the conference. "Frame rate" indicates the frame rate of the data transmitted in the conference. "Sampling frequency" indicates the sampling frequency of the data transmitted in the conference. "Used bandwidth" indicates the bandwidth used for data transmission.

[0077] In the example of FIG. 9, "1920 x 1080" is associated with the combination of "video" and "resolution." This example shows an example where the resolution of the "video data" transmitted in conference MT1 is "1920 x 1080." In addition, in the example of FIG. 9, "30 fps" is associated with the combination of "video" and "frame rate." This example shows an example where the frame rate of the "video data" transmitted in conference MT1 is "30 fps." In addition, in the example of FIG. 9, "4000 Kbps" is associated with the combination of "video" and "used bandwidth." This example shows an example where the bandwidth used for data transmission in conference MT1 is "4000 Kbps."

[0078] In the example of FIG. 9, "32 KHz" is associated with the combination of "audio" and "sampling frequency." This example shows an example where the sampling frequency of "audio data" transmitted in conference MT1 is "32 KHz." In the example of FIG. 9, "72 Kbps" is associated with the combination of "audio" and "used bandwidth." This example shows an example where the bandwidth used for data transmission in conference MT1 is "72 Kbps."

[0079] In the example of FIG. 9, "1920 x 1080" is associated with the combination of "content data" and "resolution." This example shows an example where the resolution of the "content data" transmitted in conference MT1 is "1920 x 1080." In the example of FIG. 9, "10 fps" is associated with the combination of "content data" and "frame rate." This example shows an example where the frame rate of the "content data" transmitted in conference MT1 is "10 fps." In the example of FIG. 9, "2000 Kbps" is associated with the combination of "content data" and "used bandwidth." This example shows an example where the bandwidth used for data transmission in conference MT1 is "2000 Kbps."

[0080] Returning to the description of FIG. 7, the analysis unit 25c performs an analysis on the disconnected conference MT1 (step S705) based on the communication information (communication information held by the transmitter / receiver 12) acquired by the communication information acquisition unit 25a in step S703 or the conference quality information (conference quality information held by the video encoding unit 23) acquired by the conference quality information acquisition unit 25b in step S704. For example, the analysis unit 25c analyzes the need for improvement measures for the conference MT1 based on the communication information or the conference quality information. More specifically, the analysis unit 25c analyzes the need for improvement measures to restore the disconnection of data communication corresponding to the conference MT1 based on the communication information or the conference quality information.

[0081] Here, the process of analyzing the necessity of improvement measures will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the analysis process according to the first embodiment. Fig. 10 also describes the analysis process in step S705 in more detail.

[0082] First, the analysis unit 25c determines whether the reason for disconnection of the conference MT1 is "disconnection due to user operation" based on the "disconnection reason" included in the acquired communication information (step S1001). Then, if the analysis unit 25c determines that the reason for disconnection of the conference MT1 is "disconnection due to user operation" (step S1001; Yes), it analyzes the need for an improvement plan based on the disconnection reason "disconnection due to user operation" (step S1003).

[0083] Here, "disconnection due to user operation" means an intentional disconnection due to a user (user U1 in the example of FIG. 7) operation, and such a disconnection is not a disconnection due to some problem in the communication environment, for example. Therefore, when the analysis unit 25c determines that the reason for the disconnection of the conference MT1 is "disconnection due to user operation," it obtains an analysis result that "there is no need to create an improvement plan."

[0084] On the other hand, if the analysis unit 25c determines that the reason for disconnecting the conference MT1 is not "disconnection due to user operation" (step S1001; No), it determines whether the reason for disconnecting the conference MT1 is "disconnection due to the other party disconnecting" based on the "disconnection reason" included in the acquired communication information (step S1002).

[0085] Then, if the analysis unit 25c determines that the reason for the disconnection of the conference MT1 is "disconnection due to the conference partner disconnecting" (step S1002; Yes), it analyzes the need for an improvement plan based on the disconnection reason "disconnection due to the conference partner disconnecting" (step S1003).

[0086] Here, "disconnection due to the other party disconnecting" means an intentional disconnection by the other party user (user b of transmission terminal db in the example of FIG. 7), and such a disconnection is not due to, for example, some problem in the communication environment. Therefore, even when the analysis unit 25c determines that the reason for the disconnection of the conference MT1 is "disconnection due to the other party disconnecting," it obtains an analysis result that "there is no need to prepare an improvement plan."

[0087] On the other hand, if the analysis unit 25c determines that the reason for the disconnection of the conference MT1 is not "disconnection due to the other party disconnecting" (step S1002; No), it analyzes the need for an improvement plan based on the disconnection reason "disconnection not due to a user operation by a user participating in the conference" (step S1003). For example, a "disconnection not due to a user operation by a user participating in the conference" is likely to be a disconnection caused by some kind of problem in the communication environment. Furthermore, since such a disconnection is not intentional and the actual reason for the disconnection is unclear, it can be said that it is a disconnection for which measures must be taken to reconnect. For this reason, if the analysis unit 25c determines that the reason for the disconnection of the conference MT1 is not "disconnection due to the other party disconnecting," it obtains an analysis result that "an improvement plan needs to be prepared."

[0088] Returning to the explanation of Fig. 7, the analysis unit 25c creates an improvement plan for the conference MT1 based on the analysis result of the analysis process in step S705 (step S706). Specifically, when the analysis process in step S705 results in the analysis result that "an improvement plan needs to be created," the analysis unit 25c performs an improvement plan creation process to create an improvement plan for the conference MT1.

[0089] Here, the improvement plan creation process will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the improvement plan creation process according to the first embodiment. Fig. 11 also describes the improvement plan creation process of step S706 in more detail.

[0090] First, the analysis unit 25c determines whether or not communication for data transmission is possible based on the information indicated by "communication possible / not possible" included in the communication information (step S1101).

[0091] When the analysis unit 25c determines that communication for data transmission is possible (step S1101; Yes), the analysis unit 25c determines whether the communication means used for communication for data transmission is wired or not based on the information indicated by the "communication means" included in the communication information (step S1103). When making such a determination, the analysis unit 25c has an internal determination criterion of "wired > wireless."

[0092] On the other hand, if the analysis unit 25c determines that communication for data transmission is not possible (step S1101; No), it adds an improvement plan (referred to as "improvement plan A1") for confirming whether communication is possible to the list of improvement plans (referred to as "improvement plan list LT") (step S1102), and proceeds to processing of step S1103.

[0093] Furthermore, when the analysis unit 25c determines that the communication method used for the communication for data transmission is wired (step S1103; Yes), it determines whether the communication method used for the communication for data transmission is UDP or not based on the information indicated by the "communication method" included in the communication information (step S1105). When making such a determination, the analysis unit 25c has an internal determination criterion of "UDP>TCP".

[0094] On the other hand, if the analysis unit 25c determines that the communication means used for data transmission is not wired (step S1103; No), it adds an improvement proposal for changing the communication means (referred to as "improvement proposal A2") to the improvement proposal list LT (step S1104), and proceeds to processing in step S1105.

[0095] Furthermore, when the analysis unit 25c determines that the communication method used for data transmission is UDP (step S1105; Yes), it determines whether the information related to the bandwidth used (for example, the total bandwidth used) is within a predetermined threshold (for example, "2000 Kbps") based on the "bandwidth used" included in the conference quality information (step S1107). When making such a determination, the analysis unit 25c internally stores the threshold "2000 Kbps."

[0096] On the other hand, if the analysis unit 25c determines that the communication method used for data transmission is not UDP (step S1105; No), it adds an improvement proposal for changing the communication method (referred to as "improvement proposal A3") to the improvement proposal list LT (step S1106), and proceeds to processing of step S1107.

[0097] Furthermore, if the analysis unit 25c determines that the information regarding the bandwidth used (for example, the total bandwidth used) is within a predetermined threshold (for example, "2000 Kbps") (step S1107; Yes), it creates a final improvement plan based on the improvement plans added so far (step S1109).

[0098] On the other hand, if the analysis unit 25c determines that the information regarding the bandwidth used (e.g., the total bandwidth used) is not within a predetermined threshold (e.g., "2000 Kbps") (step S1107; No), it adds an improvement proposal for changing the conference quality (referred to as "improvement proposal A4") to the improvement proposal list LT (step S1108), and proceeds to processing in step S1109.

[0099] The analysis unit 25c can extract an improvement plan from the candidate improvement plans according to the determination results in each step, and add the extracted improvement plan to the improvement plan list LT.

[0100] Here, an example of step S1109 will be described. The analysis unit 25c assigns a priority to each improvement plan added so far and controls the improvement plan list LT so that the improvement plans are displayed according to the assigned priority. For example, the analysis unit 25c assigns a priority to each improvement plan added so far according to the order in which they were added to the improvement plan list LT. For example, the analysis unit 25c assigns a higher priority to an improvement plan added earlier to the improvement plan list LT. Then, the analysis unit 25c generates an improvement plan list LT in which the improvement plans are listed from top to bottom in order of priority. Alternatively, the analysis unit 25c may generate an improvement plan list in which only a predetermined number of improvement plans with the highest priorities are displayed. Furthermore, for example, when generating an improvement plan list LT in which the improvement plans are listed from top to bottom in order of priority, the analysis unit 25c may generate an improvement plan list LT in which the improvement plans are listed so that the priority is visible. Note that the priority here indicates the level of priority at which the improvement plans should be executed.

[0101] The improvement proposals displayed in the improvement proposal list LT are controlled so that they can be selected by the user. For example, the improvement proposals displayed in the improvement proposal list LT are controlled so that the improvement proposals that the user wishes to implement can be selected using check boxes.

[0102] Next, a process from when an improvement plan is created to when the improvement plan is implemented in the transmission system 1 according to the first embodiment will be described with reference to Fig. 12. Fig. 12 is a sequence diagram showing a process from when an improvement plan is created to when the improvement plan is implemented. Note that the process shown in Fig. 12 is a process performed by the transmission terminal aa following step S706 in Fig. 7.

[0103] For example, the operation input accepting unit 13 of the transmission terminal aa determines whether or not a reconnection operation input has been accepted from the user U1 (step S1201). For example, when the operation input accepting unit 13 accepts a reconnection operation input from the user U1, the operation input accepting unit 13 notifies the conference analysis unit 25 that a reconnection operation has been performed.

[0104] In this case, the reception unit 25d of the conference analysis unit 25 receives a reconnection notification from the operation input reception unit 13, and in response to receiving the reconnection notification, the output unit 25e controls the display control unit 21 to display the improvement plan (improvement plan list LT) generated by the analysis unit 25c in step S706 (step S1202). For example, the output unit 25e outputs the improvement plan generated by the analysis unit 25c to the display control unit 21 so as to display the improvement plan.

[0105] Then, the display control unit 21 causes the improvement plan (improvement plan list LT) output by the output unit 25e to be displayed on the display 120 (step S1203). That is, the display control unit 21 presents the improvement plan (improvement plan list LT) output by the output unit 25e to the user U1 via the display 120.

[0106] Here, the improvement plan list LT according to the first embodiment will be described with reference to Fig. 13. Fig. 13 is a diagram showing an example of the improvement plan list LT according to the first embodiment. For example, the improvement plan list LT is displayed in any of the modes shown in Fig. 13(a) to Fig. 13(c).

[0107] FIG. 13(a) shows how the added improvement plans are displayed in a list from top to bottom according to their priority. As described above, the analysis unit 25c may generate the improvement plan list LT such that the earlier an improvement plan is added to the improvement plan list LT, the higher the priority is assigned to the improvement plan, and the improvement plans are displayed from top to bottom in descending order of the assigned priority. Therefore, FIG. 13(a) corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c may assign a priority of "1" to the improvement plan A1, a priority of "2" to the improvement plan A2, a priority of "3" to the improvement plan A3, and a priority of "4" to the improvement plan A4. In this case, the analysis unit 25c generates and displays the improvement plan list LT in which the improvement plans A1 to A4 are displayed from top to bottom, as shown in FIG. 13(a).

[0108] FIG. 13(b) also shows how only a predetermined number of the added improvement plans with the highest priority are displayed. As a simple example, FIG. 13(b) displays only the added improvement plans with the highest priority. As described above, the analysis unit 25c may generate an improvement plan list that displays only a predetermined number of the added improvement plans with the highest priority. Therefore, FIG. 13(b) corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c assigns a priority of "1" to improvement plan A1, a priority of "2" to improvement plan A2, a priority of "3" to improvement plan A3, and a priority of "4" to improvement plan A4. In this case, the analysis unit 25c generates and displays an improvement plan list LT that displays only improvement plan A1, as shown in FIG. 13(b).

[0109] 13(c) shows how each improvement plan is displayed in a list so that the priority order can be visually confirmed. As described above, the analysis unit 25c may generate an improvement plan list LT in which each improvement plan is displayed in a list so that the priority order can be visually confirmed. Therefore, FIG. 13(c) corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c may assign a priority order of "1" to improvement plan A1, a priority order of "2" to improvement plan A2, a priority order of "3" to improvement plan A3, and a priority order of "4" to improvement plan A4.

[0110] In this case, the analysis unit 25c displays the text "Highly recommended" and the text "To network..." indicating the content of the improvement plan A1 in a unified text color R, thereby making it visually apparent that the improvement plan A1 has the highest priority. Also, the analysis unit 25c displays the text "Medium recommended" and the text "To wired connection..." indicating the content of the improvement plan A2 in a unified text color Y, thereby making it visually apparent that the improvement plan A2 has a medium priority.

[0111] Furthermore, the analysis unit 25c visually indicates that the priority of improvement plan A3 is medium by displaying the text "Medium recommendation" and the text "From TCP method..." indicating the content of improvement plan A3 in a unified text color Y. Furthermore, the analysis unit 25c visually indicates that the priority of improvement plan A4 is medium by displaying the text "Low recommendation" and the text "For communication..." indicating the content of improvement plan A4 in a unified text color G.

[0112] Returning to the explanation of Fig. 12, the operation input receiving unit 13 determines whether or not a selection operation input for selecting one of the improvement proposals has been received from the user U1 in a state in which the improvement proposals are displayed as shown in Fig. 13 (step S1204). For example, when the operation input receiving unit 13 receives a selection operation input from the user U1, the operation input receiving unit 13 notifies the conference analysis unit 25 of the selection result corresponding to the selection operation (information indicating the improvement proposal selected from the improvement proposals).

[0113] In this case, the reception unit 25d of the conference analysis unit 25 receives the selection result (information indicating the improvement plan selected from the improvement plans) from the operation input reception unit 13, and the output unit 25e controls the transmission / reception unit 12 and the video encoding unit 23 so that the selected improvement plan is implemented (step S1205). For example, the output unit 25e outputs information indicating the improvement plan to the transmission / reception unit 12 and the video encoding unit 23 so that the selected improvement plan is implemented.

[0114] In response to such control, for example, the transmitting / receiving unit 12 changes the communication settings, and the video encoding unit 23 changes the conference quality (step S1206).

[0115] For example, suppose that with the improvement plan list LT displayed in the format of FIG. 13(a), user U1 selects improvement plan A2 from among improvement plans A1 to A4. Specifically, suppose that user U1 selects improvement plan A2 of "switching to wired connection" by checking the checkbox associated with "switching to wired connection." In this case, the transmitter / receiver 12 implements improvement plan A2 of "switching to wired connection" in response to control from the output unit 25e. That is, the transmitter / receiver 12 changes the communication settings.

[0116] Also, for example, suppose that with the improvement plan list LT displayed in the format of FIG. 13(a), user U1 selects improvement plan A4 from among improvement plans A1 to A4. Specifically, suppose that user U1 selects improvement plan A4, "reduce the amount of data used for communication," by checking the checkbox associated with "reduce the amount of data used for communication." In this case, video encoding unit 23 implements improvement plan A4, "reduce the amount of data used for communication," in response to control from output unit 25e. In other words, video encoding unit 23 changes the conference quality.

[0117] <Summary> According to the transmission system 1 (transmission terminal 10) of the first embodiment, when data transmission corresponding to communication is interrupted, the necessity of an improvement plan is analyzed based on information held by the transmitting / receiving unit 12 or information held by the video encoding unit 23. Then, when it is determined that an improvement plan is necessary, the transmission system 1 generates (creates) an improvement plan based on whether or not the information held by the transmitting / receiving unit 12 or the information held by the video encoding unit 23 satisfies predetermined condition information.

[0118] Furthermore, when a reconnection operation due to a data transmission interruption is received from the user, the transmission system 1 controls so that the generated improvement plan is presented to the user. Furthermore, when the user selects one of the presented improvement plans, the transmission system 1 controls so that the selected improvement plan is implemented.

[0119] For this reason, the transmission system 1 according to the first embodiment can prevent recurrence of disconnections even in an environment where the communication means or communication method makes it difficult to predict or estimate the network bandwidth, and also allows the user to select a method for improving the connection when reconnecting. As a result, the transmission system 1 can reduce discomfort related to the quality of communication.

[0120] (Second embodiment) Next, a second embodiment will be described.

[0121] In the first embodiment, the flow was "Create an improvement plan" → "Present the improvement plan to the user" → "User selects an improvement plan" → "Implement the improvement plan." In the second embodiment, the flow is "Create an improvement plan" → "Automatically implement the improvement plan" → "Present action items to the user" → (at the end of the meeting) "Present whether to return to the settings before the improvement plan was implemented" → (If returning) "Return to the settings before the improvement." In the following explanation of the second embodiment, explanation of the same parts as in the first embodiment will be omitted, and only the parts that are different from the first embodiment will be explained.

[0122] Here, Fig. 14 is a flowchart showing an outline of the flow of the improvement plan creation process according to the second embodiment. Fig. 14 explains in more detail the improvement plan creation process in step S706 shown in Fig. 7 of the first embodiment. In summary, the analysis unit 25c of the conference analysis unit 25 creates an improvement plan to be implemented based on communication information and conference quality information.

[0123] The analysis unit 25c of the conference analysis unit 25 starts creating an improvement plan (step S1401).

[0124] First, the analysis unit 25c of the conference analysis unit 25 checks whether communication is possible based on the communication information (step S1402). If communication is "not possible" (No in step S1402), the analysis unit 25c of the conference analysis unit 25 adds an improvement to the communication possibility (step S1403) since it is necessary to first make the communication possible, and then proceeds to step S1404. Note that actual improvements will be considered in combination with the confirmation results of the communication means, which will be described later.

[0125] On the other hand, if communication is "possible" (Yes in step S1402), the analysis unit 25c of the conference analysis unit 25 implements improvements based on the check items from step S1404 onwards.

[0126] Next, the analysis unit 25c of the conference analysis unit 25 checks whether or not other communication means are to be used based on the communication information (step S1404). For example, if the communication information indicates that the current communication means is "wired," the analysis unit 25c of the conference analysis unit 25 checks whether or not wireless communication is available as another communication means. The analysis unit 25c of the conference analysis unit 25 determines whether or not other communication means are to be used based on the presence or absence of settings for SSID and security information for wireless connection, whether or not an IP address can be obtained, etc.

[0127] If another communication means is "available" (Yes in step S1404), the analysis unit 25c of the conference analysis unit 25 adds a change in the communication means to the improvement plan (step S1405), and the process proceeds to step S1406.

[0128] On the other hand, if the analysis unit 25c of the conference analysis unit 25 determines that other communication means are "unavailable" (No in step S1404), the process proceeds to step S1406.

[0129] If the communication capability check results in "not possible" (No in step S1402) and if the communication means check results in "other means not available" (No in step S1404), the analysis unit 25c of the conference analysis unit 25 cannot "automatically implement an improvement plan" as referred to in the flow of this embodiment, regardless of the results of subsequent checks. Therefore, the improvement plan will not be implemented automatically, but will be presented to the user.

[0130] Example 1: When the confirmation of wired communication availability is “not possible” (No in step S1402) and the confirmation of communication means is “other means are not available” (No in step S1404), the analysis unit 25c of the conference analysis unit 25 makes the following presentation. -Indicate that you would like to check the connection of the wired LAN cable on your device. -Suggest that "we would like you to change the settings on your device so that it can connect wirelessly."

[0131] Example 2: If the confirmation of wireless communication capability is “not possible” (No in step S1402) and the confirmation of communication means is “other means are not available” (No in step S1404), the analysis unit 25c of the conference analysis unit 25 will make the following presentation. -Suggest that you try connecting a wired LAN cable to the device. -Suggest that you try changing the wireless access point.

[0132] Next, the analysis unit 25c of the conference analysis unit 25 checks the communication method of the communication information to check whether another communication method is being used (step S1406). For example, if communication is currently being performed using UDP, the analysis unit 25c of the conference analysis unit 25 determines whether a port desired to be used for TCP is open, and conversely, if communication is currently being performed using TCP, whether a port desired to be used for UDP is open.

[0133] If another communication method is "available" (Yes in step S1406), the analysis unit 25c of the conference analysis unit 25 adds a change in the communication method to the improvement plan (step S1407), and the process proceeds to step S1408.

[0134] On the other hand, if the analysis unit 25c of the conference analysis unit 25 determines that other communication methods are "unavailable" (No in step S1406), the process proceeds to step S1408.

[0135] Next, the analysis unit 25c of the conference analysis unit 25 checks the conference quality based on the conference quality information and checks whether the conference quality can be lowered (step S1408). For example, if the available bandwidth is low compared to the bandwidth setting for the conference video, the conference is more likely to be disconnected, so the analysis unit 25c of the conference analysis unit 25 determines whether the conference quality can be lowered to below the available bandwidth.

[0136] Basically, the analysis unit 25c of the conference analysis unit 25 checks the conference quality in the following manner. 1. When the bandwidth used is greater than the bandwidth used Basically, the quality of the meeting may be reduced. However, as shown below, if the current conference quality has deteriorated sufficiently, the conference quality cannot be reduced. When the resolution is low enough to reduce the visibility of the image, such as 320 x 180. - When the frame rate is so low that it can no longer be recognized as an image, such as 5fps. 2. When the bandwidth used is less than or equal to the bandwidth used Basically, the quality of the meeting cannot be reduced.

[0137] If "conference quality can be reduced" (Yes in step S1408), the analysis unit 25c of the conference analysis unit 25 adds a change in conference quality to the improvement plan (step S1409), and the process proceeds to step S1410.

[0138] On the other hand, if the analysis unit 25c of the conference analysis unit 25 determines that "the conference quality cannot be reduced" (No in step S1408), the process proceeds to step S1410.

[0139] Finally, the analysis unit 25c of the conference analysis unit 25 creates a final improvement plan (step S1410).

[0140] The analysis unit 25c of the conference analysis unit 25 follows predetermined guidelines and policies when finally creating an improvement plan in the processing flow shown in Fig. 14. For example, if improvement plans for "communication means," "communication method," and "conference quality" are added, the analysis unit 25c of the conference analysis unit 25 creates the improvement plan as shown below. 1. Implement all possible improvements to increase the chances of successful reconnection. - Create improvement plans to improve "communication means," "communication method," and "meeting quality." 2. To minimize the number of changes, implement the highest priority according to the pre-determined priority (for example, "Improvement of communication methods" > "Improvement of communication methods" > "Improvement of meeting quality"). - Create an improvement plan that only implements improvements to "communication means," which has the highest priority.

[0141] Once the analysis unit 25c of the conference analysis unit 25 creates an improvement plan as described above, the improvement is implemented in accordance with the improvement plan.

[0142] Next, a description will be given of the processing from implementing the improvement plan to notifying the improvement after the improvement plan is created as described above in the transmission system 1. Here, Fig. 15 is a sequence diagram showing the processing from implementing the improvement plan to notifying the improvement after the improvement plan is created.

[0143] As shown in FIG. 15, after the improvement measures shown in FIG. 7 are created (step S706), the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa creates an improvement plan (step S707).

[0144] Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa stores the communication information and conference quality information before improvement in the volatile storage unit 19 (step S708).

[0145] Next, the analysis unit 25c of the conference analysis unit 25 of the transmitting terminal 10aa implements an improvement measure based on the created improvement plan (step S709). More specifically, the conference analysis unit 25 of the transmitting terminal 10aa changes the communication settings of the transceiver 12 of the transmitting terminal 10aa based on the created improvement plan. Furthermore, the conference analysis unit 25 of the transmitting terminal 10aa changes the conference quality of the video encoding unit 23 of the transmitting terminal 10aa based on the created improvement plan.

[0146] After that, the transmitting / receiving unit 12 of the transmission terminal 10aa starts the conference (step S710).

[0147] Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa presents the content of the implemented improvement measures (step S711). More specifically, the conference analysis unit 25 of the transmission terminal 10aa causes the display control unit 21 of the transmission terminal 10aa to notify (display) the content of the implemented improvement measures to the user.

[0148] Here, Fig. 16 is a diagram showing an example of displaying the contents of implemented improvement measures. As shown in Fig. 16, the display control unit 21 creates an improvement plan list LT showing the contents implemented as improvement plans, and displays it on the display 120 superimposed on the conference video after the conference has started. Note that the display control unit 21 may constantly display the improvement plan list LT showing the contents implemented as improvement plans during the conference, or may erase the improvement plan list LT after a few seconds have passed.

[0149] Next, a process will be described for the case in which, after the implementation of the above-described improvement plan, the user is notified at the end of the conference whether to return to the settings before the improvement plan, and the settings before the improvement plan are returned to the settings before the improvement plan. Here, Fig. 17 is a sequence diagram showing the process for returning to the settings before the improvement plan after the implementation of the improvement plan.

[0150] As shown in FIG. 17, when the transmitting / receiving unit 12 of the transmission terminal 10aa receives the signal for ending the conference described in FIG. 15 from the transmission management system 50, the transmitting / receiving unit 12 ends the conference (step S712).

[0151] Next, the analysis unit 25c of the conference analysis unit 25 of the transmitting terminal 10aa presents a notification as to whether or not to return to the settings before the improvement (step S713). More specifically, the conference analysis unit 25 of the transmitting terminal 10aa causes the display control unit 21 of the transmitting terminal 10aa to notify (display) the notification as to whether or not to return to the settings before the improvement on the display 120. In response to the displayed notification, the user inputs whether or not to return to the settings before the improvement proposal.

[0152] Here, Fig. 18 is a diagram showing an example of a notification as to whether or not to restore the settings before the improvement. In the notification example shown in Fig. 18, the display control unit 21 displays an improvement plan list LT showing the changed improvement plans on the display 120, and allows the user to select whether or not to restore the settings before reconnection (before the improvement) by selecting buttons B1 and B2.

[0153] The reception unit 25d of the conference analysis unit 25 of the transmission terminal 10aa receives the selection input via the operation input reception unit 13 (step S714).

[0154] When restoring the settings to those before the improvement, the analysis unit 25c of the conference analysis unit 25 of the transmitting terminal 10aa changes the settings based on the communication information and conference quality information before the improvement stored in the volatile storage unit 19 (step S715). More specifically, the conference analysis unit 25 of the transmitting terminal 10aa changes the communication settings of the transceiver 12 of the transmitting terminal 10aa based on the settings before the improvement. In addition, the conference analysis unit 25 of the transmitting terminal 10aa changes the conference quality of the video encoding unit 23 of the transmitting terminal 10aa based on the settings before the improvement.

[0155] As described above, according to this embodiment, the transmission system 1 according to the second embodiment can prevent re-disconnection even in an environment where the communication means or communication method is difficult to predict or estimate the network bandwidth, and also allows the user to select a method for improving the connection when reconnecting. As a result, the transmission system 1 can reduce discomfort related to the quality of communication.

[0156] Although the above describes various embodiments of the present invention, these embodiments are presented as examples and are not intended to limit the scope of the invention. The novel embodiments described above can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The above embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0157] 1 Transmission System 10 Transmission terminal 12 Transmitter / Receiver 13 Operation input reception section 14 Login request section 15 Imaging unit 16 Audio input section 17 Audio output section 18 Storage and readout processing section 19 Volatile memory unit 20 Non-volatile memory unit 21 Display control unit 22 Video Compositing Department 23 Video Encoding Unit 24 Bandwidth control section 25 Conference Analysis Department 25a Communication information acquisition section 25b Conference quality information acquisition unit 25c Analysis Department 25d Reception 25e Output section 30 Relay Device 50 Transmission Management System [Prior art documents] [Patent documents]

[0158] [Patent Document 1] Patent No. 6515436

Claims

1. A transmission system for a plurality of transmission terminals to communicate via a network, a transmitting / receiving unit that stores information related to the communication used for the communication; a video encoding unit that stores information about the quality of video data, audio data, or content data used in the communication; an analysis unit that generates an improvement plan based on information held by the transmitting / receiving unit or information held by the video encoding unit when data transmission corresponding to the communication is cut off and it is determined that an improvement plan is necessary; an output unit that outputs the generated improvement plan for display when a reconnection operation due to a data transmission interruption is received from a user; A transmission system comprising:

2. the analysis unit generates the improvement plan when data transmission corresponding to the communication is disconnected without an operation by a user participating in the conference.

2. The transmission system according to claim 1.

3. the analysis unit generates the improvement plan based on whether the information held by the transmission / reception unit or the information held by the video encoding unit satisfies predetermined condition information.

2. The transmission system according to claim 1.

4. the analysis unit analyzes the necessity of an improvement plan based on information held by the transmission / reception unit or information held by the video encoding unit.

4. A transmission system according to claim 1.

5. When the presented improvement plan is selected by the user, the analysis unit performs control so that the selected improvement plan is implemented. The transmission system according to claim 1 .

6. A transmission terminal in a transmission system for a plurality of transmission terminals to communicate via a network, a transmitting / receiving unit that stores information related to the communication used for the communication; a video encoding unit that stores information about the quality of video data, audio data, or content data used in the communication; an analysis unit that generates an improvement plan based on information held by the transmitting / receiving unit or information held by the video encoding unit when data transmission corresponding to the communication is cut off and it is determined that an improvement plan is necessary; an output unit that outputs the generated improvement plan for display when a reconnection operation due to a data transmission interruption is received from a user; A transmission terminal comprising:

7. A transmission system in which a plurality of transmission terminals communicate with each other via a network, a transmitting / receiving unit that stores information related to the communication used for the communication; a video encoding unit that stores information about the quality of video data, audio data, or content data used in the communication; an analysis unit that generates an improvement plan based on information held by the transmitting / receiving unit or information held by the video encoding unit when data transmission corresponding to the communication is cut off and it is determined that an improvement plan is necessary; an output unit that outputs the generated improvement plan for display when a reconnection operation due to a data transmission interruption is received from a user; A program to function as a

Images