Display device, display method, and display program

Abstract

To provide a display device capable of presenting a combination of a plurality of devices settable by the display device to a user, a display method, and a display program.SOLUTION: A user terminal 1 includes: an acquisition processing unit 112 for acquiring determination information including at least any of communication environment information on a communication environment of each of a plurality of peripheral devices, performance information on performance of each of the plurality of peripheral devices, and a usage environment information on a usage environment of each of the plurality of peripheral devices; a determination processing unit 113 for determining combinations of the peripheral devices for validating a function on the basis of the determination information; and a display processing unit 114 for displaying the combinations of the peripheral devices determined by the determination processing unit 113 in an operation display unit 13.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for setting devices (peripheral devices) such as cameras, microphones, and speakers used in a display device.

Background Art

[0002] Conventionally, in a setting screen for setting devices (peripheral devices) such as cameras, microphones, and speakers used in a web conference, a system is known that displays devices connected to an information processing device (user terminal) so that they can be selected in a predetermined display order (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When a plurality of devices having the same function are connected to a display device (user terminal), a plurality of configurable combinations are conceivable. For example, when a camera, a microphone, and a speaker are built in the display device and a camera, a microphone, and a speaker are connected as external devices, a plurality of combinations of the camera, the microphone, and the speaker that can be set are conceivable. In such a case, it is difficult for the user to determine which combination should be set.

[0005] An object of the present disclosure is to provide a display device, a display method, and a display program capable of presenting a user with a plurality of combinations of devices that can be set in a display device.

Means for Solving the Problems

[0006] A display device according to one aspect of the present disclosure is a display device that can use a plurality of devices having at least one function among a camera, a microphone, and a speaker. The display device includes an acquisition processing unit, a determination processing unit, and a display processing unit. The acquisition processing unit acquires determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices. The determination processing unit determines a combination of the devices that enables the function based on the determination information. The display processing unit causes the display device to display the combination of the devices determined by the determination processing unit.

[0007] A display method according to one aspect of the present disclosure is a method executed in a display device that can use a plurality of devices having at least one function among a camera, a microphone, and a speaker. The display method includes acquiring determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices, determining a combination of the devices that enables the function based on the determination information, and causing the display device to display the combination of the devices, which is executed by one or more processors.

[0008] A display program according to another aspect of the present disclosure is a program executed in a display device that can use a plurality of devices having at least one function among a camera, a microphone, and a speaker. The display program includes acquiring determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices, determining a combination of the devices that enables the function based on the determination information, and causing the display device to display the combination of the devices, which is a program for causing one or more processors to execute.

Advantages of the Invention

[0009] According to the present disclosure, it is possible to provide a display device, a display method, and a display program that can present a user with a plurality of combinations of devices that can be set in the display device.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are merely examples of embodying the present disclosure and do not have the character of limiting the technical scope of the present disclosure.

[0012] The display system according to the present disclosure can be applied, for example, to a case where a plurality of users each hold an online meeting (such as a Web meeting) using a user terminal and devices (devices) such as a camera, a microphone, and a speaker. The camera, the microphone, and the speaker are peripheral devices connected to or built into the user terminal. Each user can start a predetermined application (such as a meeting application) on their own user terminal, set the camera, the microphone, and the speaker, and conduct conversations by transmitting and receiving video and audio. The device of the present disclosure may be a device built into the user terminal or a device connected to the user terminal by wire or wirelessly.

[0013] [Display System 10] FIG. 1 is a diagram showing the configuration of a display system 10 according to an embodiment of the present disclosure. The display system 10 includes a user terminal 1, a data server 2, and external devices 3 (external devices 3A and 3B in FIG. 1). The display system 10 includes one or more user terminals 1. Also, the peripheral device may be connected to the user terminal 1 by wire or wirelessly, or may be built into the user terminal 1. In the example shown in FIG. 1, the user terminal 1 has a built-in microphone 15, a speaker 16, and a camera 17. Also, an external device 3A (a camera microphone speaker device) composed of a microphone 31a, a speaker 32a, and a camera 33a and an external device 3B (a microphone speaker device) composed of a microphone 31b and a speaker 32b are connected to the user terminal 1 by wire or wirelessly. The number of external devices connected to the user terminal 1 is not limited to two, and may be one or three or more.

[0014] The data server 2 is a storage device that stores various types of information. The user terminal 1 and the data server 2 can communicate via a communication network N1 such as the Internet, LAN, WAN, or public telephone line. For example, the data server 2 is composed of a cloud server.

[0015] The cameras (camera 17, camera 33a) are digital cameras that capture images of subjects and output them as digital image data. The image data captured by the cameras is transmitted to the control unit 11 of the user terminal 1. For example, the cameras capture a predetermined area including the user who uses the user terminal 1.

[0016] The microphones (microphone 15, microphones 31a, 31b) collect the spoken voices of the users of the user terminal 1 and transmit the voice data to the control unit 11 of the user terminal 1. The speakers (speaker 16, speakers 32a, 32b) output (play) the voice data transmitted from other user terminals 1.

[0017] The display system 10 may include a conference server that executes a conference application for online meetings. The conference server manages conference information. Each user terminal 1 activates the conference application and transmits and receives video and audio via the conference server. As a result, multiple users can hold an online meeting.

[0018] Here, when holding an online meeting, each user performs an operation to set the peripheral devices they use. For example, the user launches a conferencing application on the user terminal 1 and performs an operation to set the microphone, speaker, and camera on the settings screen. FIG. 2 shows an example of a conventional settings screen D10. The settings screen D10 shown in FIG. 2 includes a microphone setting column Km for setting the microphone, a speaker setting column Ks for setting the speaker, and a camera setting column Kc for setting the camera. The user presses (clicks) on the microphone setting column Km on the settings screen D10 and selects the microphone to be used from one or more microphones displayed in the microphone list. Also, the user presses (clicks) on the speaker setting column Ks on the settings screen D10 and selects the speaker to be used from one or more speakers displayed in the speaker list. Further, the user presses (clicks) on the camera setting column Kc on the settings screen D10 and selects the camera to be used from one or more cameras displayed in the camera list.

[0019] Here, when a plurality of devices (peripheral devices) with the same function are connected to the user terminal 1, a plurality of configurable combinations are conceivable. For example, when the user terminal 1 has a built-in camera, microphone, and speaker, and cameras, microphones, and speakers are connected as external devices, a plurality of combinations of cameras, microphones, and speakers that can be set are conceivable. In such a case, it is difficult for the user to determine which combination should be set. In contrast, the user terminal 1 according to the present embodiment has a configuration capable of presenting the user with a plurality of combinations of peripheral devices that can be set on the user terminal 1 as described below.

[0020] [User Terminal 1] As shown in FIG. 1, the user terminal 1 is an information processing device including a control unit 11, a storage unit 12, an operation display unit 13, a communication unit 14, a microphone 15, a speaker 16, a camera 17, and the like. The user terminal 1 is, for example, a personal computer, a smartphone, or the like. The user terminal 1 is an example of the display device of the present disclosure.

[0021] The communication unit 14 is a communication unit for executing data communication according to a predetermined communication protocol between the user terminal 1 and peripheral devices such as external devices 3A and 3B by wire or wirelessly. Further, the communication unit 14 connects the user terminal 1 to a communication network N1 (for example, the Internet) by wire or wirelessly, and is a communication interface for executing data communication according to a predetermined communication protocol between the user terminal 1 and an external device such as a data server 2 via the communication network N1.

[0022] The operation display unit 13 is a user interface including a display unit such as a liquid crystal display or an organic EL display for displaying various kinds of information, and an operation unit such as a mouse, a keyboard, or a touch panel for receiving operations.

[0023] The storage unit 12 is a non-volatile storage unit such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory for storing various kinds of information. Specifically, information regarding peripheral devices such as a microphone, a camera, and a speaker is stored in the storage unit 12.

[0024] Further, a control program such as a device setting program for causing the control unit 11 to execute device setting processing (see FIG. 10) described later is stored in the storage unit 12. For example, the device setting program may be non-temporarily recorded on a computer-readable recording medium such as a CD or a DVD, and read by a reading device (not shown) such as a CD drive or a DVD drive provided in the user terminal 1 and stored in the storage unit 12.

[0025] The control unit 11 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which control programs such as BIOS and OS for causing the CPU to execute various arithmetic processes are stored in advance. The RAM is a volatile or non-volatile storage unit that stores various information and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 11 controls the user terminal 1 by causing the CPU to execute various control programs stored in advance in the ROM or the storage unit 12.

[0026] Specifically, as shown in FIG. 1, the control unit 11 includes various processing units such as a reception processing unit 111, an acquisition processing unit 112, a determination processing unit 113, a display processing unit 114, and a setting processing unit 115. Note that the control unit 11 functions as the various processing units by causing the CPU to execute various processes according to the control program. Also, some or all of the processing units may be configured by electronic circuits. Note that the control program may be a program for causing a plurality of processors to function as the processing units.

[0027] The reception processing unit 111 receives various operations of the user. For example, the reception processing unit 111 receives a setting operation of peripheral devices used for an online meeting from the user.

[0028] The acquisition processing unit 112 acquires identification information (model number, device number, product number, etc.) of peripheral devices connected to the user terminal 1. For example, when microphones 15, 31a, 31b, speakers 16, 32a, 32b, and cameras 17, 33a are connected (built-in, wired connection, wireless connection, etc.) to the user terminal 1, the acquisition processing unit 112 acquires the identification information of each microphone, the identification information of each speaker, and the identification information of each camera, respectively.

[0029] In addition, the acquisition processing unit 112 searches for and acquires device information corresponding to the peripheral device via the network based on the identification information of the peripheral device. Specifically, the acquisition processing unit 112 transmits a search request including the device information of the peripheral device to the data server 2 via the Internet (communication network N1). Here, the acquisition processing unit 112 transmits a search request including the identification information of each of the microphones 15, 31a, 31b, speakers 16, 32a, 32b, and cameras 17, 33a to the data server 2.

[0030] The data server 2 searches for the device information corresponding to the search request from the device information stored in the storage unit (database DB). FIG. 3 shows an example of the database DB. As shown in FIG. 3, the database DB stores information on various peripheral devices. The device information includes an image of the device (such as a photo, still image, or video), performance information of the device (such as camera image quality, microphone sound quality, speaker sound quality, etc.). Note that the data server 2 may search for a microphone image that matches or is similar to the identification information of each microphone, a speaker image that matches or is similar to the identification information of each speaker, and a camera image that matches or is similar to the identification information of each camera. The data server 2 transmits the search result (device information) to the user terminal 1. When the acquisition processing unit 112 acquires the device information from the data server 2, it stores it in the storage unit 12.

[0031] In this way, the acquisition processing unit 112 acquires performance information regarding the performance of each of the plurality of peripheral devices. For example, the acquisition processing unit 112 acquires information regarding the resolution of each camera, the sensitivity, frequency band, and directivity of each microphone, and the output level and frequency band of each speaker.

[0032] In addition, the acquisition processing unit 112 acquires communication environment information regarding the communication environment of peripheral devices. Specifically, the acquisition processing unit 112 acquires information regarding the communication band and communication speed of each microphone, each speaker, and each camera. The acquisition processing unit 112 performs data communication with each peripheral device to acquire the current communication environment information. In addition, the acquisition processing unit 112 acquires the current communication environment information of the network (communication network N1) to which the user terminal 1 is connected.

[0033] In addition, the acquisition processing unit 112 acquires usage environment information regarding the usage environment of peripheral devices. Specifically, the acquisition processing unit 112 acquires information regarding the size of the conference room of the conference using the peripheral devices, the number and attributes of the participants participating in the conference, and the type of the conference. The acquisition processing unit 112 acquires the usage environment information by referring to, for example, conference reservation information registered in a conference server (not shown).

[0034] In the present embodiment, the acquisition processing unit 112 acquires determination information including at least any one of performance information regarding the performance of each of a plurality of peripheral devices, communication environment information regarding the communication environment of each of the plurality of peripheral devices, and usage environment information regarding the usage environment of each of the plurality of peripheral devices.

[0035] The determination processing unit 113 determines a combination of peripheral devices that enable functions based on the determination information acquired by the acquisition processing unit 112. For example, in the user terminal 1, when the microphone 15 built in the user terminal 1, the microphone 31a of the external device 3A connected to the user terminal 1, and the microphone 31b of the external device 3B connected to the user terminal 1 can be used, the determination processing unit 113 determines one of the microphones based on the determination information. Also, for example, in the user terminal 1, when the speaker 16 built in the user terminal 1, the speaker 32a of the external device 3A connected to the user terminal 1, and the speaker 32b of the external device 3B connected to the user terminal 1 can be used, the determination processing unit 113 determines one of the speakers based on the determination information. Also, for example, in the user terminal 1, when the camera 17 built in the user terminal 1 and the camera 33a of the external device 3A connected to the user terminal 1 can be used, the determination processing unit 113 determines one of the cameras based on the determination information.

[0036] In addition, the determination processing unit 113 determines combinations in which microphones, speakers, and cameras can be used together. Also, for example, when there are two peripheral devices (camera devices) having the same function (for example, a camera), and the functions of each peripheral device are enabled and the same function overlaps, the determination processing unit 113 excludes the combination of the two devices.

[0037] The determination processing unit 113 determines combinations of microphones, speakers, and cameras based on performance information regarding, for example, the resolution of each camera, the sensitivity of each microphone, the frequency band, and the directivity, and the output level and frequency band of each speaker. For example, the determination processing unit 113 determines combinations of microphones, speakers, and cameras that can achieve high image quality and high sound quality, combinations of microphones, speakers, and cameras that can achieve high image quality and low sound quality, combinations of microphones, speakers, and cameras that can achieve medium image quality and medium sound quality, combinations of microphones, speakers, and cameras that can achieve low image quality and medium sound quality, combinations of microphones, speakers, and cameras that can achieve low image quality and low sound quality, and the like.

[0038] As another embodiment, the determination processing unit 113 determines a combination of a microphone, a speaker, and a camera based on, for example, communication environment information regarding the communication bandwidth and communication speed of each microphone, each speaker, and each camera. For example, the determination processing unit 113 determines a combination of a microphone, a speaker, and a camera corresponding to the communication bandwidth of the current communication network N1.

[0039] Also, as another embodiment, the determination processing unit 113 determines a combination of a microphone, a speaker, and a camera based on usage environment information regarding the size of the conference room where a meeting using peripheral devices is held, the number and attributes of participants participating in the meeting, and the type of the meeting. For example, the determination processing unit 113 determines a combination of a microphone, a speaker, and a camera corresponding to the size of the conference room.

[0040] The determination processing unit 113 may determine a combination of a microphone, a speaker, and a camera based on at least any one of the performance information, the communication environment information, and the usage environment information.

[0041] Also, the determination processing unit 113 determines the priority order of combinations of each peripheral device based on the determination information. For example, the determination processing unit 113 determines the order of combinations of a microphone, a speaker, and a camera in descending order of the performance (image quality and sound quality) of the peripheral device. Also, the determination processing unit 113 determines the order of combinations of a microphone, a speaker, and a camera in descending order of the communication speed or in descending order of the communication bandwidth of the peripheral device. The determination processing unit 113 may calculate an evaluation value for each combination for each of the performance information, the communication environment information, and the usage environment information, and determine the order of each combination based on the sum of the evaluation values of each information.

[0042] As described above, in this embodiment, when the user terminal 1 can use a first device and a second device having a first function among a camera, a microphone, or a speaker, and a third device and a fourth device having a second function different from the first function among a camera, a microphone, or a speaker, the determination processing unit 113 determines, based on the determination information, a combination of a device that enables the first function among the first device and the second device and a device that enables the second function among the third device and the fourth device. For example, when the user terminal 1 can use a user terminal 1 having a camera and an external device 3A, and an external device 3A having a microphone and an external device 3B, the determination processing unit 113 determines, based on the determination information, a combination of a device that enables the camera among the user terminal 1 and the external device 3A and a device that enables the microphone among the external device 3A and the external device 3B.

[0043] The display processing unit 114 causes the operation display unit 13 to display a setting screen for setting peripheral devices. Specifically, the display processing unit 114 causes the operation display unit 13 to display a setting screen D1 shown in FIG. 4, and on the setting screen D1, a microphone setting column Km, a speaker setting column Ks, and a camera setting column Kc are displayed. The user can select peripheral devices (such as a microphone, a speaker, a camera, etc.) to be used on the setting screen D1.

[0044] In addition, the display processing unit 114 causes the operation display unit 13 to display the combination of peripheral devices determined by the determination processing unit 113. Specifically, the display processing unit 114 causes the "Recommended" button K1 to be displayed on the setting screen D1 (see FIG. 4). When the user presses the "Recommended" button K1, the display processing unit 114 displays a combination selection screen D2 (see FIG. 5) regarding the combination of peripheral devices determined by the determination processing unit 113. On the combination selection screen D2, a plurality of combinations of the microphone, speaker, and camera determined by the determination processing unit 113 are displayed according to the priority order. FIG. 5 shows an example in which a plurality of combinations are displayed in descending order of image quality and sound quality. Note that the display processing unit 114 displays information on the combination of the microphone, speaker, and camera by means of an image (device image). Thereby, the user can intuitively grasp the peripheral devices. The user can select any combination on the combination selection screen D2. FIG. 5 shows a state in which the "Medium image quality / Medium sound quality" combination is selected.

[0045] When the user selects any combination on the combination selection screen D2 and presses the OK button, the display processing unit 114 causes the information on the peripheral devices included in the selected combination to be displayed on the setting screen D1 (see FIG. 6). For example, when the user selects the "Medium image quality / Medium sound quality" combination, the display processing unit 114, as shown in FIG. 6, causes the identification information of the microphone 31b of the external device 3B included in the "Medium image quality / Medium sound quality" combination to be displayed in the microphone setting field Km, and at the same time, causes the microphone image Pm corresponding to the identification information of the microphone 31b to be displayed in association with the identification information. In addition, the display processing unit 114 causes the identification information of the speaker 32b of the external device 3B included in the "Medium image quality / Medium sound quality" combination to be displayed in the speaker setting field Ks, and at the same time, causes the speaker image Ps corresponding to the identification information of the speaker 32b to be displayed in association with the identification information. In addition, the display processing unit 114 causes the identification information of the camera 17 of the user terminal 1 included in the "Medium image quality / Medium sound quality" combination to be displayed in the camera setting field Kc, and at the same time, causes the camera image Pc corresponding to the identification information of the camera 17 to be displayed in association with the identification information.

[0046] Note that, as shown in FIG. 6, the display processing unit 114 may display each device image arranged according to the identification information, or as shown in FIG. 7, may display each device image in place of the identification information, or as shown in FIG. 8, may display each device image superimposed on the identification information. Also, as shown in FIG. 9, on the setting screen D1, the user may be able to change the displayed devices. For example, the user may press the speaker setting column Ks on the setting screen D1 to change the speaker. In this case, the control unit 11 may display selectable one or more changeable speakers (see FIG. 9).

[0047] The setting processing unit 115 effectively sets the functions of the peripheral devices selected by the user. Specifically, the setting processing unit 115 effectively sets the functions of the peripheral devices of the combination selected by the user among the combinations of peripheral devices displayed on the combination selection screen D2 (see FIG. 5). For example, in a state where information on the microphone, speaker, and camera corresponding to the combination selected by the user is displayed on the setting screen D1 shown in FIG. 6, when the user presses the OK button, the setting processing unit 115 enables the displayed microphone, speaker, and camera.

[0048] As a result, the user can hold a meeting using the peripherals effectively set. In the example shown in FIG. 6, when the meeting starts, the meeting audio is transmitted and received by the microphone and speaker of the external device 3B, and the captured image is transmitted by the camera 17 built in the user terminal 1.

[0049] As another embodiment, after the meeting is started (for example, during the meeting), the control unit 11 may be able to change the peripheral devices based on at least any one of the performance information, the communication environment information, and the usage environment information. For example, when the communication speed decreases during the meeting, the control unit 11 may display a combination of a microphone, a speaker, and a camera corresponding to the low communication speed and accept an operation for the user to select a desired combination. When the user selects a combination, the control unit 11 invalidates the currently enabled microphone, speaker, and camera, and enables the microphone, speaker, and camera of the selected combination. Thereby, the user does not need to switch each peripheral device by himself / herself, and can grasp and switch the optimal combination of peripheral devices.

[0050] [Device Setting Process] Hereinafter, with reference to FIG. 10, an example of the procedure of the device setting process executed by the control unit 11 of the user terminal 1 will be described.

[0051] Note that the present disclosure can be regarded as a disclosure of a device setting method (the display method of the present disclosure) that executes one or more steps included in the device setting process. Also, one or more steps included in the device setting process described here may be appropriately omitted. Also, the execution order of each step in the device setting process may be different within a range that produces the same operational effects. Further, here, the case where the control unit 11 executes each step in the device setting process is taken as an example for description, but in other embodiments, one or more processors may execute each step in the device setting process in a distributed manner.

[0052] First, in step S1, the control unit 11 determines whether it has acquired the identification information (model number, device number, product number, etc.) of the peripheral devices. For example, when the control unit 11 recognizes the microphone, speaker, and camera connected to the user terminal 1, it acquires the identification information of each peripheral device. Also, for example, when the user selects the identification information of the peripheral device on the setting screen D1 (see FIG. 4), the control unit 11 may acquire the identification information of the selected peripheral device. When the control unit 11 acquires the identification information of the peripheral device (S1: Yes), it transfers the process to step S2. The control unit 11 waits until it acquires the identification information of the peripheral device (S1: No).

[0053] In step S2, the control unit 11 determines whether it has received a request for a "recommended" setting regarding the settings for activating each peripheral device from the user. For example, when the user presses the "recommended" button K1 on the setting screen D1 shown in FIG. 4, the control unit 11 receives the request for the "recommended" setting (S2: Yes) and transfers the process to step S3. For example, when the user does not press the "recommended" button K1 on the setting screen D1 shown in FIG. 4, the control unit 11 does not receive the request for the "recommended" setting (S2: No), and it transfers the process to step S21.

[0054] In step S3, the control unit 11 acquires determination information for determining a combination of peripheral devices. Specifically, the control unit 11 acquires determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of peripheral devices, performance information regarding the performance of each of the plurality of peripheral devices, and usage environment information regarding the usage environment of each of the plurality of peripheral devices. For example, the control unit 11 acquires the performance information regarding the resolution of each camera, the sensitivity of each microphone, the frequency band, and the directivity, and the output level and frequency band of each speaker from the data server 2. Also, the control unit 11 acquires the communication environment information regarding the communication band and communication speed of each microphone, each speaker, and each camera based on the data communication status between the user terminal 1 and the external device. Further, the control unit 11 acquires the usage environment information regarding the size of the conference room where the meeting using the peripheral devices is held, the number and attributes of the participants attending the meeting, and the type of the meeting from the conference server.

[0055] Next, in step S4, the control unit 11 determines a combination of peripheral devices for which the functions are to be enabled based on the determination information.

[0056] For example, the control unit 11 determines a combination of microphones, speakers, and cameras based on the performance information regarding the resolution of each camera, the sensitivity of each microphone, the frequency band, and the directivity, and the output level and frequency band of each speaker.

[0057] Also, for example, the control unit 11 determines a combination of microphones, speakers, and cameras based on the communication environment information regarding the communication band and communication speed of each microphone, each speaker, and each camera.

[0058] Also, for example, the control unit 11 determines a combination of microphones, speakers, and cameras based on the usage environment information regarding the size of the conference room where the meeting using the peripheral devices is held, the number and attributes of the participants attending the meeting, and the type of the meeting.

[0059] Based on at least any one of the performance information, the communication environment information, and the usage environment information, the control unit 11 may determine a combination of a microphone, a speaker, and a camera.

[0060] Next, in step S5, the control unit 11 determines the priority order of the combinations based on the determination information. For example, the control unit 11 determines the order of the combinations of the microphone, the speaker, and the camera in descending order of the performance (image quality and sound quality) of the device. Also, the control unit 11 determines the order of the combinations of the microphone, the speaker, and the camera in descending order of the communication speed or in descending order of the communication bandwidth of the device.

[0061] Next, in step S6, the control unit 11 causes the combination of the peripheral devices determined in step S4 to be displayed according to the priority order determined in step S5. For example, on the combination selection screen D2 shown in FIG. 5, the control unit 11 causes the information of the combinations of the microphone, the speaker, and the camera to be displayed by the images of the respective devices in descending order of the image quality and the sound quality.

[0062] Next, in step S7, the control unit 11 determines whether or not a selection operation of a specific combination has been received from the user among the plurality of combinations. When the user selects one combination (selects a checkbox) on the combination selection screen D2, the control unit 11 proceeds to step S8. The control unit 11 waits until a selection operation of a combination is received from the user (S7: No).

[0063] In step S8, the control unit 11 effectively sets the respective functions of the microphone, the speaker, and the camera corresponding to the combination selected by the user. Specifically, when the user selects one combination on the combination selection screen D2, the control unit 11 causes the information of the microphone, the speaker, and the camera corresponding to the combination selected by the user to be displayed together with the images of the respective devices on the setting screen D1 (see FIG. 6). When the user presses the OK button on the setting screen D1, the control unit 11 effectively sets the respective functions of the microphone, the speaker, and the camera.

[0064] In step S2, when the control unit 11 does not receive a request for a "recommended" setting from the user, in step S21, it determines whether an operation for individually setting each peripheral device has been received. For example, on the setting screen D1 shown in FIG. 4, the user can individually select each of the microphone, speaker, and camera. When the user individually selects each of the microphone, speaker, and camera (S21: Yes), the control unit 11 enables the functions of the microphone, speaker, and camera according to the user's individual setting operation (S8).

[0065] As described above, when the setting process of the peripheral devices used by the user in the meeting is completed, the control unit 11 starts an online meeting using the set peripheral devices. Each user terminal 1 executes the above-described device setting process in parallel before starting the online meeting.

[0066] As described above, the user terminal 1 according to the present embodiment can use a plurality of devices having at least one function of a camera, a microphone, and a speaker. Further, the user terminal 1 acquires determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices, determines a combination of the devices for enabling the function based on the determination information, and causes the user terminal 1 to display the determined combination of the devices.

[0067] For example, the user terminal 1 determines a priority order of the combinations based on the determination information, and displays the combinations based on the priority order. Then, the user terminal 1 enables the functions of the devices of the combination selected by the user among the displayed combinations of the devices.

[0068] According to the above configuration, when a plurality of peripheral devices (such as microphones, speakers, cameras, etc.) with the same function are connected to the user terminal 1, it is possible to present the user with a plurality of combinations of peripheral devices that can be set on the user terminal 1. In addition, since the optimal combination of a plurality of peripheral devices is presented to the user, the user does not need to select peripheral devices for each function, and can set a plurality of peripheral devices by selecting the optimal combination. Therefore, the user's labor can be saved and the convenience is improved.

[0069] This disclosure may be configured by the user terminal 1 alone, or may be configured by the control unit 11 (control device) of the user terminal 1 alone.

[0070] [Supplementary Note of the Disclosure] Hereinafter, the outline of the disclosure extracted from the above-described embodiments will be appended. Note that each configuration and each processing function described in the following supplementary notes can be arbitrarily combined by selection.

[0071] [Supplementary Note 1] A display device capable of using a plurality of devices having at least one function of a camera, a microphone, and a speaker, an acquisition processing unit that acquires determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices; a determination processing unit that determines a combination of the devices that enables the function based on the determination information; a display processing unit that causes the display device to display the combination of the devices determined by the determination processing unit; A display device comprising:

[0072] [Supplementary Note 2] The determination processing unit determines a priority order of the combination based on the determination information, The display processing unit causes the display device to display the combination based on the priority order. The display device according to Supplementary Note 1.

[0073] <Appendix 3> Further comprising a setting processing unit that effectively sets the functions of the devices in the combination of devices selected by the user from among the combinations of devices displayed on the display device. The display device according to Appendix 1 or 2.

[0074] <Appendix 4> The display processing unit causes the display device to display the combination by means of a device image corresponding to the device. The display device according to any one of Appendices 1 to 3.

[0075] <Appendix 5> The acquisition processing unit acquires an image corresponding to the device via a network based on the identification information of the device. The display processing unit causes the device image corresponding to the device to be displayed in association with the identification information based on the image acquired by the acquisition processing unit. The display device according to Appendix 4.

[0076] <Appendix 6> When the display device can use a first device and a second device having a first function among a camera, a microphone, or a speaker, and a third device and a fourth device having a second function different from the first function among a camera, a microphone, or a speaker, The determination processing unit determines a combination of a device that enables the first function among the first device and the second device and a device that enables the second function among the third device and the fourth device based on the determination information. The display device according to any one of Appendices 1 to 5.

[0077] <Appendix 7> The communication environment information includes information regarding communication bandwidth and communication speed. The performance information includes information regarding the resolution of the camera, the sensitivity of the microphone, the frequency band, and the directivity, and the output level and the frequency band of the speaker. The usage environment information includes information on the size of the conference room for the meeting using the device, the number and attributes of the participants attending the meeting, and the type of the meeting. The display device according to any one of Appendices 1 to 6.

Explanation of Signs

[0078] 1: User terminal 2: Data server 3: External device 3A: External device 3B: External device 10: Display system 11: Control unit 12: Storage unit 13: Operation display unit 14: Communication unit 15: Microphone 16: Speaker 17: Camera 31a: Microphone 31b: Microphone 32a: Speaker 32b: Speaker 33a: Camera 111: Reception processing unit 112: Acquisition processing unit 113: Decision processing unit 114: Display processing unit 115: Setting processing unit D1: Setting screen D2: Combination selection screen

Claims

1. A display device capable of using a plurality of devices having at least one function among a camera, a microphone, and a speaker, an acquisition processing unit that acquires determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices; a determination processing unit that determines a combination of the devices that enables the function based on the determination information; a display processing unit that causes the display device to display the combination of the devices determined by the determination processing unit; A display device comprising:

2. The determination processing unit determines a priority order of the combinations based on the determination information, The display processing unit causes the display device to display the combination based on the priority order, The display device according to claim 1.

3. The display device according to claim 1, further comprising a setting processing unit that validly sets the functions of the devices in the combination selected by the user among the combinations of the devices displayed on the display device. The display device according to claim 1.

4. The display processing unit causes the display device to display the combination by means of device images corresponding to the devices, The display device according to claim 1.

5. The acquisition processing unit acquires an image corresponding to the device via a network based on the identification information of the device, The display processing unit displays the device image corresponding to the device in association with the identification information based on the image acquired by the acquisition processing unit. The display device according to claim 4.

6. When the display device can use a first device and a second device having a first function among a camera, a microphone, or a speaker, and a third device and a fourth device having a second function different from the first function among a camera, a microphone, or a speaker, The determination processing unit determines a combination of a device that enables the first function among the first device and the second device and a device that enables the second function among the third device and the fourth device based on the determination information. The display device according to claim 1.

7. The communication environment information includes information regarding communication bandwidth and communication speed, The performance information includes information regarding the resolution of the camera, the sensitivity, frequency band, and directivity of the microphone, and the output level and frequency band of the speaker. The usage environment information includes information regarding the size of the meeting room for the meeting where the device is used, the number and attributes of the participants attending the meeting, and the type of the meeting. The display device according to any one of claims 1 to 6.

8. A display method executed in a display device capable of using a plurality of devices each having at least one function of a camera, a microphone, and a speaker, comprising: obtaining determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices; determining a combination of the devices that enables the function based on the determination information; causing the display device to display the combination of the devices; A display method executed by one or more processors.

9. A display program executed in a display device capable of using a plurality of devices each having at least one function of a camera, a microphone, and a speaker, comprising: obtaining determination information including at least any one of communication environment information regarding the communication environment of each of the plurality of devices, performance information regarding the performance of each of the plurality of devices, and usage environment information regarding the usage environment of each of the plurality of devices; determining a combination of the devices that enables the function based on the determination information; causing the display device to display the combination of the devices; A display program for causing one or more processors to execute.

Images