Information processing device, display device, communication method, program, and communication system

Abstract

To provide an information processing device to which other information processing devices can connect.SOLUTION: An information processing device can wirelessly communicate with other information processing devices in the role of either a group owner or a client. The information processing device includes a setting change unit that changes a setting related to the role in response to user operation, a determination unit that determines the role on the basis of the setting related to the role changed by the setting change unit, and a wireless control unit that wirelessly communicates with other information processing devices in the role determined by the determination unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, a display device, a communication method, a program, and a communication system. [Background technology]

[0002] There are known wireless communication technologies such as Miracast (registered trademark) that wirelessly transmit the screen of a smartphone, tablet, or the like to a display. In such wireless communication technologies, another information processing device that transmits video (called a source device) and an information processing device that receives the video (called a sink device) form a network and communicate with each other. Either the source device or the sink device plays the role of the group owner of the network, and the source device or sink device that does not become the group owner plays the role of a client.

[0003] Although the group owner is normally determined when the network is formed, there is known a technique for changing the group owner when another device connects to the network after the network is formed (see, for example, Patent Document 1). According to Patent Document 1, even if the network has already been formed, it is possible to increase the degree of freedom of the connection form when connecting a device later. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, there is a problem that an information processing device may not be able to connect to another information processing device. For example, another information processing device such as a PC (Personal Computer) used in a company may be set so as not to be able to connect to access points other than a specific access point (such as an access point in the company to which the user belongs, which is an access point registered in the PC). On the other hand, a group owner has a function similar to that of an access point. Therefore, when an information processing device becomes a group owner, when another information processing device tries to connect to the information processing device, the information processing device is not registered as an access point, so that the other information processing device may be restricted from connecting to the information processing device.

[0005] In view of the above-mentioned problems, the present invention provides an information processing device to which other information processing devices can be connected. [Means for solving the problem]

[0006] In view of the above problems, the present invention provides an information processing device that can communicate wirelessly with other information processing devices in the role of either a group owner or a client, and includes a setting change unit that changes settings related to the role when communicating wirelessly with the other information processing devices in response to user operation, a determination unit that determines the role based on the settings related to the role changed by the setting change unit, and a wireless control unit that communicates wirelessly with the other information processing devices in the role determined by the determination unit. Effect of the Invention

[0007] The present invention can provide an information processing device to which other information processing devices can be connected. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating a method of connecting a sink device and a source device. [Diagram 2] FIG. 1 is a system configuration diagram of an example of a communication system. [Diagram 3]1 is a block diagram showing a hardware configuration of a display device according to an embodiment; [Figure 4] FIG. 2 is a block diagram showing a hardware configuration of a terminal device according to an embodiment. [Diagram 5] FIG. 2 is a functional block diagram of an example illustrating functions of a terminal device and a display device, the functions being divided into blocks. [Figure 6] 13 is a diagram showing an example of a list of APs registered in a registered AP storage unit; FIG. [Figure 7] FIG. 4 is a diagram showing an example of a connection list stored in a connection list storage unit; [Figure 8] FIG. 1 is a system configuration diagram of an example in which a plurality of terminal devices are connected to a display device. [Figure 9] FIG. 1 is a diagram showing an example of a screen configuration displayed on a display device connected to a plurality of terminal devices. [Figure 10] 1 is a diagram illustrating an AP to which a terminal device is restricted from connecting; [Figure 11] FIG. 13 is a diagram showing an example of a network list screen displayed by the terminal device. [Figure 12] 11 is a sequence diagram illustrating an example of a process flow for connecting a terminal device and a display device. FIG. [Figure 13] FIG. 11 is a flowchart illustrating an example of a process in which a determination unit determines a network owner in a negotiation. [Figure 14] FIG. 13 is a diagram showing an example of a multiple-device simultaneous connection setting screen displayed on the display device. [Figure 15] 11 is a diagram for explaining the correspondence between multiple device simultaneous connection settings and intent values. FIG. [Figure 16] 11 is a flowchart illustrating an example of a process in which a setting change unit switches an intent value. FIG. [Figure 17] FIG. 11 is a flowchart illustrating an example of a process for connecting a terminal device and a display device. [Figure 18] FIG. 13 is a diagram showing an example of a pop-up screen displayed by the display device when a connection has failed. [Figure 19]This is a flowchart diagram for explaining an example of the process in which the setting change unit changes the multi-device simultaneous connection setting when the display device fails to connect to the terminal device. [Figure 20] This is a diagram showing an example of a pop-up screen that the display device displays when the multi-device simultaneous connection setting is changed. [Figure 21] This is a flowchart diagram for explaining an example of the process in which the connection list management unit registers "not permitted" in the multi-device simultaneous connection setting of the connection list when the display device fails to connect to the terminal device.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, as an example of the embodiments for carrying out the present invention, a communication system and a communication method performed by the communication system will be described with reference to the drawings.

[0010] <Supplementary Explanation Regarding Miracast> As described above, in Miracast (registered trademark, hereinafter omitted), a source device (video transmission source) and a sink device (video transmission destination) form a network to perform wireless communication such as video and audio. It is determined which device will play the role of the group owner through negotiation at the start of connection (when forming the network). Also, there are sink devices that can have multiple source devices connected simultaneously and can display multiple videos simultaneously. Such a sink device needs to play the role of the group owner in order to connect to multiple source devices simultaneously.

[0011] A device that has been determined to be the group owner (group owner device) provides functionality similar to that of an access point (hereafter referred to as AP) (functions that fulfill the role of an AP). Client devices can connect to the AP. However, the group owner does not act as an intermediary for connection to the Internet. Miracast uses Wi-Fi Direct (registered trademark) as its communication method, and devices that support Wi-Fi Direct have built-in access point functionality. An access point in Wi-Fi Direct refers to a device or function that accepts connection requests from communication partner devices. A device that fulfills the role of an AP is called a group owner.

[0012] On the other hand, some companies prohibit in-house devices (PCs and smartphones) from connecting to any AP other than those registered in the company system due to their corporate security policies. Since the Miracast group owner has a role similar to that of an AP, source devices that are prohibited from connecting to any AP other than the registered AP cannot connect to a sink device that plays the role of group owner. Here, a sink device that can be connected simultaneously from multiple source devices always plays the role of a group owner (a function similar to that of an AP), so a source device to which the above security policy is applied cannot connect to a sink device.

[0013] APs registered in corporate systems generally have an SSID (Service Set Identifier) ​​registered to identify the AP. With Miracast, the SSID is automatically determined when a source device and sink device form a network, but to prevent SSID duplication, a random character string is inserted into the SSID. This makes it difficult for an administrator to register the SSID of a sink device that communicates via Miracast in a corporate system. It is difficult from a security standpoint for sink devices to automatically register themselves in a corporate system.

[0014] For the reasons described above, a source device that is prohibited from connecting to any AP other than its registered AP cannot connect via Miracast to a sink device that can connect to multiple source devices simultaneously (a sink device that plays the role of group owner).

[0015] <Outline of connection process in this embodiment> Therefore, the sink device of the present embodiment controls the connection method as follows depending on the setting as to whether or not connection to a plurality of source devices is permitted.

[0016] 1 is a diagram for explaining a method of connecting sink device 51 and source device 52. Hereinafter, sink device 51 will be referred to as "display device 20," and source device 52 will be referred to as "terminal device 40." It is assumed that no security policy is applied to display device 20.

[0017] As shown in FIG. 1(a), when the setting allows connection with multiple terminal devices 40, the display device 20 becomes the group owner and allows multiple terminal devices 40 to connect simultaneously. Although details will be described later, the Intent Value (hereinafter referred to as the Intent Value) used to determine the group owner in Miracast is changed depending on whether or not the setting allows connection with multiple terminal devices 40. This increases the possibility that the display device 20 will become the group owner. However, in this case, terminal devices 40 that can only connect to registered APs cannot connect to the display device 20.

[0018] As shown in FIG. 1(b), when the setting does not permit connection to multiple terminal devices 40, the display device 20 becomes a client and connects to the terminal device 40 that prohibits connection to any device other than a registered AP. The terminal device 40 becomes the group owner. Similarly, the intent value is changed depending on the setting of whether or not to permit connection to multiple terminal devices 40. In this case, the display device 20 cannot connect to multiple terminal devices 40 at the same time, but can connect to a terminal device 40 that prohibits connection to any device other than a registered AP.

[0019] In this manner, in this embodiment, the terminal device 40 that is set to prohibit connection with APs other than the registered AP can connect to the display device 20. Although there is no risk of information leakage when the terminal device 40 connects to the display device 20, the problem that the terminal device 40 cannot connect to the display device 20 because the connection is prohibited in the terminal device 40 can be eliminated.

[0020] <Terminology> The role refers to whether the display device 20 is a group owner or a client when wirelessly communicating with the terminal device 40. Even if the role is not called a group owner or a client, if it is an equivalent role, it corresponds to the role of this embodiment.

[0021] The role-related settings refer to the multiple device simultaneous connection settings (settings for whether multiple terminal devices 40 can connect simultaneously) set in the display device 20, and can be set by the user or automatically.

[0022] The information processing device is a device that is mainly used as a sink device, and may or may not have a display. In this embodiment, the information processing device is described using the term display device 20. The other information processing device is a device that is mainly used as a source device. In this embodiment, the other information processing device is described using the term terminal device 40.

[0023] <Usage scenarios> An example of a usage scenario of the communication system 100 is a scenario in which an employee uses a terminal device 40 at a company conference or the like to display video on a shared display device 20. In this case, even if the employee's terminal device 40 can only connect to a registered AP, the display device 20 can display video from the terminal device 40 by making the display device 20 a client and the terminal device 40 a group owner. Such usage scenarios are not limited to within a company, but are similar outside the company, and even if there are restrictions on an employee outside the company connecting the terminal device 40 to the display device 20, the employee can display video from the terminal device 40 on the display device 20 by making the display device 20 a client.

[0024] Furthermore, although unrelated to the setting of the group owner or client, for example, a usage scenario may be one in a cram school where a teacher uses a terminal device 40 and students use a display device 20. The teacher can proceed with a lecture while sharing screen data of the terminal device 40 with the display devices 20 of multiple students. Students can input answers to assignments or questions into the display device 20 and share them with the teacher. Also, handwritten data input by one student into the display device 20 can be shared between the terminal device 40 and the display devices 20 of the other students.

[0025] In addition, various usage scenarios are conceivable in which a presenter uses the terminal device 40 to share screen data with participants, such as in a meeting, a product briefing session, or a presentation.

[0026] The display device 20 may be a thin, portable display device having a built-in battery (or may not have a battery). Therefore, the display device 20 can be carried together with the terminal device 40 and can be used as an extended display for the terminal device 40 by being connected to the terminal device 40 when in use.

[0027] For example, the display device 20 can be used by a sales representative as an extended display for presentations at a sales destination. Also, for example, the display device 20 can be used as a double display for office work together with a terminal device 40 such as a PC. Also, for example, the display device 20 can be connected to a smartphone used by an individual outside the office and used as an extended display for watching videos or working from home.

[0028] <System configuration example> With reference to FIG. 2, an example of the system configuration of the communication system 100 will be described. FIG. 2 shows a system configuration diagram of the communication system 100. The terminal device 40 and the display device 20 can communicate wirelessly. The wireless communication method is, for example, Wi-Fi Direct, Bluetooth (registered trademark), etc., but the communication method is not particularly limited. The communication method may be communication via a normal access point (Wi-Fi router) instead of one-to-one communication (P2P). Alternatively, the terminal device 40 and the display device 20 may communicate via the same server device. In this case, the terminal device 40 and the display device 20 are associated with each other by the server device, and the server device transmits video and audio from the terminal device 40 to the display device 20 and transmits a touch signal from the display device 20 to the terminal device 40.

[0029] Also, Miracast, Google Cast, Airplay (all of which are registered trademarks; hereinafter, the description of registered trademarks will be omitted) and the like are known as communication standards that enable wireless communication between the terminal device 40 and the display device 20. The terminal device 40 and the display device 20 can communicate with each other using these communication standards or improved communication methods. For example, Miracast is a display transmission technology that uses one-to-one wireless communication, established by the Wi-Fi Alliance. Miracast uses streaming technology to wirelessly send images, audio, and video from a host to another device that is paired with it. Miracast is a technology that wirelessly displays a display connected with a dedicated cable, and is sometimes called wireless HDMI because it wirelessly performs the functions realized by, for example, HDMI (High Definition Multimedia Interface; registered trademark; hereinafter, omitted).

[0030] Furthermore, the connection between the terminal device 40 and the display device 20 may be made via a wired video output interface such as HDMI, DisplayPort (registered trademark), or Thunderbolt (registered trademark). Regardless of the connection form, the terminal device 40 can transmit at least one of video and audio to the display device 20, and the display device 20 can transmit touch signals and the like to the terminal device 40. Therefore, communication between the terminal device 40 and the display device 20 is bidirectional. However, transmission from the display device 20 to the terminal device 40 may have a narrow bandwidth or may not be essential.

[0031] The terminal device 40 is, for example, a PC 40a (desktop PC, notebook PC, etc.), a smartphone 40b, a tablet terminal, etc. used by a user. The terminal device 40 may be capable of executing applications compatible with wireless communication and applications for playing videos. The terminal device 40 is mainly portable by the user, but may also be a stationary type. The terminal device 40 may have a general-purpose configuration, and does not require special hardware or the installation of an application dedicated to this embodiment. However, if a dedicated application is installed on the display device 20 of this embodiment, user convenience is further improved.

[0032] Moreover, a device that transmits the content (source) to be output, such as terminal device 40, is called source device 52. Source device 52 does not refer to a specific device, but refers to the source of the content. Similarly, a device that receives the content to be output, such as display device 20, is called sink device 51. Sink device 51 does not refer to a specific device, but refers to the destination of the content. Therefore, terminal device 40 can be sink device 51, and display device 20 can be source device 52.

[0033] The display device 20 is, for example, a display 20a such as a liquid crystal or organic EL display, a PC 20b (display integrated type), a television receiver 20c, a set-top box 20d, a projector 20e, or a wireless communication device 20f. The display device 20 may be a portable display device, a portable display device, an electronic whiteboard device, a smartphone, a tablet, a television, a monitor, a signage device, a medical image display device, or the like. The display device 20 may have at least a wireless communication function, but may further have a display means. The display 20a, the PC 20b, the television receiver 20c, and the projector 20e have a display means, while the set-top box 20d and the wireless communication device 20f do not have a display means.

[0034] The display device 20 (excluding the wireless communication device 20f) may have a built-in wireless communication function or may have an external wireless communication function. Since the wireless communication device 20f is the wireless communication function itself, the wireless communication device 20f may be externally attached to the display device 20 other than the wireless communication device 20f. For example, the wireless communication device 20f is connected to the USB I / F of the display 20a, the PC 20b, the television receiver 20c, the set-top box 20d, or the projector 20e that does not have a built-in wireless communication function, thereby enabling these to wirelessly communicate with the terminal device 40. A state in which the wireless communication device 20f is connected to the display 20a, the PC 20b, the television receiver 20c, the set-top box 20d, or the projector 20e may be referred to as a wireless video communication system.

[0035] As the set-top box 20d, for example, a cable television receiver or a satellite broadcast receiver is known. As the wireless communication device 20f, a device compatible with the above-mentioned Miracast, Google Cast, and Airplay (connected to a display via USB or the like), a stick-type PC (dongle PC), and the like are known.

[0036] An application or a function thereof compatible with wireless communication may be pre-installed or may be installable in the display device 20. A part or all of the function may be realized by a hardware circuit.

[0037] Moreover, it is preferable that the display device 20 has a touch panel. The display device 20 wirelessly transmits a touch signal representing a touch made by a user to the terminal device 40, thereby enabling the user to operate the terminal device 40 on the display device 20.

[0038] <Hardware configuration example> The hardware configurations of the display device 20 and the terminal device 40 will be described with reference to FIGS.

[0039] <<Display device>> Fig. 3 is a block diagram showing a hardware configuration of a display device 20 according to an embodiment. The display device 20 shown in Fig. 3 has a display panel 102 on the front surface of a housing (not shown), and is capable of receiving a video signal from a terminal device 40 via wireless communication or a video cable 110 and displaying an image corresponding to the video signal on the display panel 102.

[0040] As shown in FIG. 3, the display device 20 includes a control unit 101, a display panel 102, a communication I / F 103 (Interface), a hard key 104, a speaker 109, a USB I / F (Interface) 105, an HDMI I / F 111, a power supply unit 107, and a battery 108.

[0041] The control unit 101 controls the overall operation of the display device 20. For example, the control unit 101 is realized by a control circuit such as an integrated circuit (IC) including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like.

[0042] The display panel 102 (an example of a display unit) displays various images (moving images, still images, etc.) in response to video signals supplied from the control unit 101. For example, a liquid crystal panel, an organic EL (Electro Luminescence) panel, etc. are used as the display panel 102. A touch sensor 102a is provided on the front surface of the display panel 102 so as to overlap the display panel 102. The speaker 109 outputs various sounds in response to audio signals supplied from the control unit 101.

[0043] The communication I / F 103 is an interface that controls wireless connection (including wireless communication) with the terminal device 40. The communication I / F 103 wirelessly communicates with the terminal device 40 (e.g., a notebook computer, a smartphone, etc.) and transmits and receives (wireless communication) control signals, video signals, etc. with the terminal device 40. The wireless communication standard used by the communication I / F 103 is, for example, Wi-Fi (registered trademark), etc.

[0044] The hard keys 104 are an interface that accepts input from a user by being operated by the user. For example, the display device 20 has a plurality of buttons provided on the side or front of the housing as the hard keys 104. These buttons are, for example, a power button, a selection button, a confirmation button, a back button, and the like. However, without being limited thereto, the display device 20 may have, as the hard keys 104, for example, a screen mute key that realizes a screen mute icon that disables operations on the screen with a hard key. For example, the display device 20 can perform various settings such as power on and off, brightness, contrast, and the like by operating the hard keys 104 by a user operation.

[0045] The USB I / F 105 is an interface for connecting the terminal device 40. The USB I / F 105 has a USB port 105A that complies with the USB standard, and a USB cable such as a video cable 110 is connected to the USB port 105A. This allows the USB I / F 105 to be connected to the terminal device 40 via the USB cable. For example, when a terminal (e.g., a notebook computer, a smartphone, etc.) is connected as the terminal device 40, the USB I / F 105 can transmit and receive control signals, video signals, power, etc. to and from the terminal. Also, for example, when an external power source is connected as the terminal device 40, the USB I / F 105 can receive power supplied from the external power source.

[0046] The display device 20 often includes a plurality of USB I / Fs 105, and the terminal device 40 can be connected to each of the plurality of USB I / Fs 105. For convenience of illustration, the display device 20 includes one USB I / F 105, but may include two or more USB I / Fs 105.

[0047] The HDMI I / F 111 is an interface for connecting the terminal device 40. The HDMI I / F 105 has an HDMI port 111A that complies with the HDMI standard, and an HDMI cable such as the video cable 110 is connected to the HDMI port 111A. This allows the HDMI I / F 111 to be connected to the terminal device 40 via the HDMI cable. For example, when a terminal (e.g., a notebook computer, a smartphone, etc.) is connected as the terminal device 40, the HDMI I / F 111 can transmit and receive control signals, video signals, power, etc. to and from the terminal.

[0048] The power supply unit 107 controls the supply of driving power to each unit of the display device 20. For example, when power is not supplied from the terminal device 40 (external power source, terminal, etc.) or when the power supplied from the terminal device 40 (external power source, terminal, etc.) is insufficient, the power supply unit 107 can supply the power stored in the battery 108 to each unit of the display device 20. Also, for example, when power is supplied from the terminal device 40 (external power source, terminal, etc.), the power supply unit 107 can supply the power supplied from the terminal device 40 to each unit of the display device 20. Also, for example, the power supply unit 107 can pass through the power supplied from the terminal device 40 (external power source, terminal, etc.) connected to one USB I / F 105 or HDMI I / F 111 and supply it to the terminal device 40 (terminal, etc.) connected to another USB I / F 105 or HDMI I / F 111.

[0049] The battery 108 stores power for driving the display device 20. Various types of rechargeable secondary batteries (for example, lithium ion batteries, lithium polymer batteries, etc.) are used for the battery 108. Note that the display device 20 (for example, the power supply unit 107) can charge the battery 108 with power supplied from a terminal device 40 (external power supply, terminal, etc.) connected to the USB I / F 105 or the HDMI I / F 111.

[0050] <<Terminal Device>> Fig. 4 is a block diagram showing a hardware configuration of a terminal device 40 according to an embodiment. In Fig. 4, a smartphone is taken as an example of the terminal device 40. As shown in Fig. 4, the terminal device 40 includes a CPU 401, a ROM 402, a RAM 403, an EEPROM 404, a CMOS sensor 405, an image sensor I / F 406, an acceleration / direction sensor 407, a media I / F 409, and a GPS receiver 411.

[0051] Of these, the CPU 401 controls the overall operation of the terminal device 40. The ROM 402 stores the CPU 401 and programs used to drive the CPU 401, such as the IPL. The RAM 403 is used as a work area for the CPU 401.

[0052] The EEPROM 404 reads and writes various data such as programs for the terminal device 40 under the control of the CPU 401 .

[0053] The CMOS (Complementary Metal Oxide Semiconductor) sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) and obtains image data under the control of the CPU 401. The CMOS sensor may be an imaging means such as a CCD (Charge Coupled Device) sensor.

[0054] The image sensor I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / azimuth sensor 407 is one of various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor.

[0055] A media I / F 409 controls reading and writing (storing) of data from and to a recording medium 408 such as a flash memory. A GPS receiving unit 411 receives GPS signals from GPS satellites.

[0056] The terminal device 40 also has a long-distance communication circuit 412, a CMOS sensor 413, an image sensor I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F (Interface) 419, a short-distance communication circuit 420, an antenna 420a of the short-distance communication circuit 420, and a touch panel 421.

[0057] Among these, the long-distance communication circuit 412 is a circuit that communicates with other devices via a wired or wireless network. The long-distance communication circuit 412 is capable of wireless communication using Wi-Fi, etc. The CMOS sensor 413 is a type of built-in imaging means that captures an image of a subject under the control of the CPU 401 to obtain image data.

[0058] The image sensor I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal.

[0059] The speaker 416 is a built-in circuit that converts an electrical signal into physical vibrations to generate sounds such as music and voice. The sound input / output I / F 417 is a circuit that processes input and output of sound signals between the microphone 415 and the speaker 416 under the control of the CPU 401.

[0060] The display 418 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) display that displays an image of a subject, various icons, etc. The external device connection I / F 419 is an interface for connecting various external devices.

[0061] The short-distance communication circuit 420 is a communication circuit such as NFC (Near Field Communication), Bluetooth, etc. The touch panel 421 is a type of input means that allows the user to operate the terminal device 40 by pressing the display 418.

[0062] The terminal device 40 also includes a bus line 410. The bus line 410 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 401 shown in FIG.

[0063] <About the function> Next, functions of the terminal device 40 and the display device 20 will be described with reference to Fig. 5. Fig. 5 is a functional block diagram that explains the functions of the terminal device 40 and the display device 20 by dividing them into blocks.

[0064] <<Terminal Device>> A playback application 301 and a mirroring application 302 run on the terminal device 40. The playback application 301 has a playback unit 41, a display control unit 42, and an operation reception unit 43, and the mirroring application 302 has a wired communication unit 44, a wireless communication unit 45, and a screen data acquisition unit 46. Each of these functional units of the terminal device 40 is a function or means realized by the CPU 401 shown in FIG. 4 executing instructions included in one or more programs installed in the terminal device 40. The programs are, for example, the playback application 301 and the mirroring application 302.

[0065] The playback application 301 is an application that plays back various contents, but since the terminal device 40 can transmit the screen itself displayed on the display 418, the playback application 301 is not necessary. Also, the mirroring application 302 is an application that acquires (captures) the screen displayed on the display 418 and transmits it to the display device 20. There is no problem if the playback application 301 and the mirroring application 302 are integrated.

[0066] The playback unit 41 decodes and expands video in a data format specific to the video, and reconstructs it into a frame (one screen's worth of image). The playback unit 41 can also change the resolution of the image to match the resolution of the display panel, and perform frame interpolation.

[0067] The display control unit 42 causes the frames generated by the playback unit 41 to be displayed on the display panel 102. The frame rate is, for example, 30 fps to 120 fps.

[0068] The operation acceptance unit 43 accepts user operations on the playback application 301. For example, the operation acceptance unit 43 accepts operations related to video playback, such as starting and stopping video playback, going back a certain number of seconds, going forward a certain number of seconds, volume, or brightness. The operation acceptance unit 43 accepts similar operations by a touch signal received by the wired communication unit 44 or the wireless communication unit 45 from the display device 20. The operation acceptance unit 43 also accepts operations for wireless connection setting performed by the user on the terminal device 40.

[0069] The screen data acquisition unit 46 captures the entire screen displayed on the display 418 at a predetermined speed (number of times per second) or a portion of the screen (the content portion of the playback application, an arbitrary application, or a user-selected range) as screen data.

[0070] The wired communication unit 44 repeatedly transmits the screen data acquired by the screen data acquisition unit 46 to each of the multiple display devices 20 via a video cable such as an HDMI cable, a USB cable, or a DisplayPort cable (registered trademark).

[0071] The wireless communication unit 45 repeatedly transmits the screen data acquired by the screen data acquisition unit 46 to each of the multiple display devices 20 via wireless communication such as Wi-Fi or Bluetooth. The speed at which the wireless communication unit 45 or the wired communication unit 44 transmits screen data to one display device 20 (the number of screen data transmitted per second) is called a transmission frame rate.

[0072] Moreover, the terminal device 40 has a registered AP storage unit 49 constructed in the EEPROM 404, the ROM 402, the RAM 403, etc. shown in Fig. 4. The registered AP storage unit 49 stores a list of APs registered in the terminal device 40 as APs to which the terminal device 40 can connect.

[0073] 6 shows an example of a list of APs registered in the registered AP storage unit 49. The terminal device 40 cannot connect to APs other than those registered in the registered AP storage unit 49. The registered AP storage unit 49 may exist in an IT system within a company. APs (access points) to which in-company terminals can connect are registered in the IT system. In this case, the terminal device 40 queries the IT system for the SSID of the AP to which it is going to connect, and connects to the AP only if the connection is permitted.

[0074] The registered AP storage unit 49 held by the terminal device 40 may be downloaded from an IT system. In this case, when it is difficult to inquire of the IT system, such as when outside the company, the terminal device 40 refers to the registered AP storage unit 49 held therein. In this way, the terminal device 40 can connect to an AP based on the latest list of registered APs when inside the company, and can determine whether to connect to an AP based on the list of registered APs when outside the company.

[0075] In FIG. 6, the SSID is used as the identification information of the AP, but the BSSID (Basic Service Set Identifier), the name of the AP, or the like may be used.

[0076] <<Display device>> Next, the display device 20 will be described. The functions of the display device 20 are mainly arranged in three layers, from the bottom up, a hardware control unit 30, an OS 27 (Operating System), and a connection application 39. Although there are other applications that run on the OS 27, only the main applications are shown in the description of this embodiment.

[0077] The hardware control unit 30 has a touch control unit 28, a wireless control unit 29, a wired control unit 31, an image / audio control unit 32, and a power control unit 33. Each of these functions of the hardware control unit 30 may be realized by, for example, an application or a device driver (an example of a program).

[0078] The touch control unit 28 converts the signal input from the touch sensor 102a into coordinates (X, Y coordinates with the upper left corner of the display panel 102 as the origin, for example) and sends them to the OS 27. The touch control unit 28 may further convert the signal input into a touched area or into a pressure included in the signal input and send them to the OS 27.

[0079] The wireless control unit 29 performs filtering, amplification, demodulation, A / D conversion, etc. on the radio waves of the wireless communication received by the communication I / F 103 to convert them into digital signals, performs decapsulation according to the communication protocol, and extracts the data. The wireless control unit 29 sends the data to the OS 27. This data is the video data and audio data from the terminal device 40. The wireless control unit 29 also obtains data from the OS 27, performs encapsulation, D / A conversion, modulation, and amplification of the data according to the communication protocol, and transmits the radio waves of the wireless communication from the communication I / F 103. An example of this data is a touch signal.

[0080] The wireless control unit 29 wirelessly communicates with another information processing device (terminal device 40) in the role determined by the determination unit 29a. Specifically, the wireless control unit 29 includes a function for communicating with the terminal device 40 in accordance with, for example, the Miracast specification.

[0081] The wireless control unit 29 has a function of an AP in Wi-Fi Direct. The AP transmits its own SSID to surrounding devices at regular intervals (SSID broadcast). The AP also determines whether the password transmitted by the terminal device 40 is the same as a preset password, and allows the connection of the terminal device 40.

[0082] Moreover, wireless control unit 29 has determination unit 29a. Determination unit 29a determines a role based on the role-related setting changed by setting change unit 25. Specifically, determination unit 29a includes a function of determining a group owner in a network group using an intent value, which will be described later, based on the Miracast specifications.

[0083] The wired control unit 31 decodes compressed video and audio from signals received by the USB I / F 105 or HDMI I / F 111 via a wired cable. The wired control unit 31 detects horizontal and vertical synchronization signals from the video to generate separation between scanning lines, and sends this video data for display to the OS 27. The wired control unit 31 also obtains data from the OS 27, and transmits the data from a predetermined pin terminal to the terminal device 40 via the wired cable. An example of this data is a touch signal.

[0084] The image and audio control unit 32 converts the video data acquired from the OS 27 into a format compatible with the display panel 102, such as RGB, and stores the converted data in a video memory. The image and audio control unit 32 applies a voltage to each cell of the display panel 102 according to the video data acquired from the video memory. The image and audio control unit 32 also generates a differential signal using the audio data acquired from the OS 27, and outputs the signal to the positive and negative terminals of the speaker.

[0085] The power supply control unit 33 controls power supply from the battery or from the external power supply depending on the shutdown process from the OS 27, or the input status of the power switch or external power supply. If there is a margin of power from the external power supply, the power supply control unit 33 charges the battery. The power supply control unit 33 manages the remaining battery capacity. As one form of power supply control, the power supply control unit 33 performs control of transition to and return from a power saving mode.

[0086] The connection application 39 has a first communication unit 21, a second communication unit 22, an operation reception unit 23, an output unit 24, a setting change unit 25, and a connection list management unit 26. Each function of the connection application 39 is a function or means realized by the CPU of the control unit 101 executing an instruction included in the connection application 39 (an example of a program).

[0087] The first communication unit 21 receives video data and audio data via the wired control unit 31, and passes the data to the output unit 24. In addition, the first communication unit 21 transmits a touch signal received by the operation receiving unit 23 to the terminal device 40 via the wired control unit 31.

[0088] The second communication unit 22 sends an SSID (Service Set Identifier) ​​and a password to the wireless control unit 29, and instructs the start of wireless communication with the terminal device 40, the maintenance of communication, and the end of communication. The second communication unit 22 receives video data and audio data via the wireless control unit 29 and passes them to the output unit 24. In addition, the second communication unit 22 transmits a touch signal accepted by the operation acceptance unit 23 via the wireless control unit 29 to the terminal device 40. The second communication unit 22 can communicate with the terminal device 40 directly, and can also communicate with the terminal device 40 via a normal access point.

[0089] The operation acceptance unit 23 accepts changes to role-related settings for the screen displayed by the output unit 24. Specifically, the operation acceptance unit 23 accepts settings for the multiple device simultaneous connection setting screen. The operation acceptance unit 23 also accepts touch operations on icons and touch operations on images from the terminal device 40. The operation acceptance unit 23 accepts pressing of an icon if the touch coordinates are within the circumscribing rectangle of the icon, and accepts an operation (handwritten input, button operation, etc.) on the terminal device 40 if the touch coordinates are not within the circumscribing rectangle of the icon but within the display range of the image. The touch coordinates on the display range of the image are transmitted to the terminal device 40 as a touch signal, and the touch coordinates on the icon are accepted as an operation of the display device 20.

[0090] In the case of an operation on the terminal device 40, the first communication unit 21 or the second communication unit 22 transmits a touch signal to the terminal device 40. The touch signal is obtained by converting touch coordinates on the display device 20 into coordinates in the effective pixel area of ​​the display 418 of the terminal device 40. The converted coordinates are, for example, the ratio of the X coordinate to the width of the image on the display device 20 and the ratio of the Y coordinate to the height.

[0091] The output unit 24 displays a screen for accepting settings related to roles. Specifically, the output unit 24 includes a function for displaying a multiple-device simultaneous connection setting screen. The output unit 24 also acquires video data and audio data (at least one of them) received by the first communication unit 21 or the second communication unit 22 from the terminal device 40, and controls the output of these by the image and audio control unit 32. The output unit 24 displays the video from the terminal device 40 on the source video display layer, and outputs the audio from the speaker 109.

[0092] The setting change unit 25 changes the setting related to the role when communicating wirelessly with the terminal device 40 in response to a user operation. Specifically, the setting change unit 25 changes the intent value in response to a setting related to simultaneous multiple device connection set by the user. One of the settings related to simultaneous multiple device connection is whether the user has set simultaneous multiple device connection to "permitted" or "not permitted." The setting change unit 25 changes the intent value depending on whether it has been set to "permitted" or "not permitted" (see FIG. 15). Furthermore, if the connection fails, the setting change unit 25 changes the simultaneous multiple device connection setting to "not permitted."

[0093] Furthermore, the setting change unit 25 changes the intent value based on the multiple simultaneous connection setting associated with the terminal device 40 in a connection list described later. Furthermore, if the connection fails, the setting change unit 25 changes or newly registers the multiple simultaneous connection setting with the terminal device 40 to "not permitted" in the connection list.

[0094] The connection list management unit 26 manages a connection list that is a list of terminal devices 40 to which the display device 20 has previously been successfully connected. In addition, in the connection list, a multiple device simultaneous connection setting set by the user ("Allowed" or "Not Allowed") or a multiple device simultaneous connection setting that has been automatically switched ("Not Allowed") is set in association with the terminal device 40 (see FIG. 7).

[0095] 7 shows a connection list stored in the connection list storage unit 38. This connection list is managed by the connection list management unit 26. The connection list is a list of terminal devices 40 to which the display device 20 has been successfully connected in the past. In this embodiment, the connection list management unit 26 records a list of terminal devices 40 to which the display device 20 has been connected, and also records settings of the multiple device simultaneous connection setting screen 210 in association with each terminal device 40 in the connection list.

[0096] 7, when connecting with the terminal devices 40 "ABCDE", "FGHIJ", and "PQRST", the multiple simultaneous connections were set to "not permitted" on the display device 20. When connecting with the terminal device 40 "KLMNO", the multiple simultaneous connections were set to "permitted" on the display device 20. This indicates that the terminal devices 40 "ABCDE", "FGHIJ", and "PQRST" may only be able to connect to registered APs, and that in order for the display device 20 to connect to these terminal devices 40, it may be necessary for the multiple simultaneous connections to be set to "not permitted".

[0097] When the display device 20 connects to a terminal device 40 recorded in the connection list, the setting change unit 25 automatically switches the multiple device simultaneous connection setting to the setting stored in the connection list storage unit 38. This allows optimal settings to be made without the user having to set the multiple device simultaneous connection setting screen 210 every time a connection is made.

[0098] <Example of simultaneous connections> 8 is a system configuration diagram of an example in which a plurality of terminal devices 40 are connected to the display device 20. When a plurality of terminal devices 40 are connected to the display device 20, the display device 20 is the group owner. As will be described later, whether the display device 20 or the terminal device 40 becomes the group owner is determined by the intent value. The intent value of the display device 20 that can be connected to a plurality of terminal devices 40 has conventionally been set in advance to a high value (e.g., 8 to 15).

[0099] Fig. 9 shows a screen configuration displayed by a display device 20 connected to multiple terminal devices 40. When multiple terminal devices 40 are connected to one display device 20, the display device 20 can simultaneously display images from terminal devices 40A and 40B in PBP (Picture by Picture) as shown in Fig. 9. The display device 20 can display two images simultaneously in PIP (Picture in Picture) as well as PBP.

[0100] <About AP connection restrictions for terminal devices> Fig. 10 is a diagram for explaining APs to which the connection of the terminal device 40 is restricted. In the registered AP storage unit 49 shown in Fig. 6, "ABCD1234" and "EFGH5678" are registered as APs to which the terminal device 40 can connect. In Fig. 10, APs 61 to 64 with SSIDs "ABCD1234", "IJKL9012", "EFGH5678", and "MNOP3456" exist around the terminal device 40.

[0101] The terminal device 40 is set to operate according to the corporate IT policy and is therefore prohibited from connecting to any AP other than the registered AP. Therefore, the terminal device 40 can connect to APs 61 and 63 with SSIDs "ABCD1234" and "EFGH5678", but cannot connect to APs 62 and 63 with SSIDs "IJKL9012" and "MNOP3456".

[0102] 11 shows a network list screen 200 displayed by the terminal device 40. In the case of a Windows (registered trademark) PC, the network list screen 200 is displayed by simultaneously pressing the Windows (registered trademark) key and the K key.

[0103] The terminal device 40, which is set to operate according to the corporate IT policy, displays a network list screen 200 shown in Fig. 11(a). The network list screen 200 shown in Fig. 11(a) clearly indicates that a network (AP) that is not registered as a network that the terminal device 40 can connect to is not connectable by displaying an x ​​mark 201 on the network list screen 200. The x mark 201 is only an example, and there are cases in which an AP that is not registered as a network that the terminal device 40 can connect to is not displayed.

[0104] A terminal device 40 that is not set to operate in accordance with the corporate IT policy displays a network list screen 200 shown in Fig. 11(b). Since the terminal device 40 in Fig. 11(b) at the same location is not prohibited from connecting to APs other than the registered APs, the networks marked with an x ​​mark 201 are not displayed.

[0105] In either case of FIG. 11(a) or (b), when the user selects a network (AP), the terminal device 40 starts the connection process.

[0106] <Processing during communication> Next, a process for connecting the terminal device 40 and the display device 20 will be described with reference to Fig. 12. Fig. 12 is a sequence diagram showing the flow of a process for connecting the terminal device 40 and the display device 20. Note that the roles of the terminal device 40 and the display device 20 in Fig. 12 may be reversed.

[0107] S101: In the scan phase, the terminal device 40 transmits a probe request (requesting a response from the display device 20) to the display device 20.

[0108] S102: Similarly, in the scan phase, the display device 20 transmits a probe request to the terminal device 40 (requesting a response from the terminal device 40).

[0109] S103: After the scan phase, the terminal device 40 enters a listen phase in which it waits for a response for a certain period of time. The channel at this time is set to 1.

[0110] S104: After the scan phase, the display device 20 enters a listen phase in which the display device 20 waits for a response for a certain period of time. The channel at this time is set to 6.

[0111] S105: Next, the terminal device 40 enters the search phase and transmits a probe request on channels 1, 6, and 11, respectively.

[0112] S106: Similarly, the display device 20 enters the search phase and transmits probe requests on channels 1, 6, and 11, respectively.

[0113] S107: It is assumed that the terminal device 40 is in the search phase and the display device 20 is in the listen phase. The terminal device 40 transmits probe requests on channels 1 and 6 in turn.

[0114] S108: Since the display device 20 was in the listen phase on channel 6, the probe request was received on channel 6. The display device 20 returned a probe response to the device 1.

[0115] S109: In response to the response, the terminal device 40 enters the network formation phase, and the terminal device 40 requests negotiation to the display device 20 (also transmits the intent value "3").

[0116] S110: The display device 20 responds to the negotiation, but it is assumed here that the response is unsuccessful.

[0117] S111: The terminal device 40 again requests negotiation to the display device 20.

[0118] S112: The display device 20 responds to the negotiation, which is assumed to be successful here (the display device 20 also sends the intent value "10").

[0119] S113: Both parties start negotiation. In this case, the intent value of the terminal device 40 is smaller than that of the display device 20, so the terminal device 40 becomes the client. The display device 20 becomes the group owner.

[0120] S114: The display device 20 and the terminal device 40 authenticate each other, and exchange information necessary for forming a network group.

[0121] S115: A Wi-Fi Simple Configuration (WSC) is exchanged between the display device 20 and the terminal device 40.

[0122] S116: The display device 20 and the terminal device 40 authenticate each other, and exchange information necessary for forming a network group.

[0123] S117: A 4-way handshake (authentication procedure) is performed between the display device 20 and the terminal device 40. Now that the connection between the display device 20 and the terminal device 40 is complete, video transmission from the terminal device 40 to the display device 20 is executed.

[0124] Fig. 13 is a flow chart for explaining the process in which the determination unit 29a determines a network owner in negotiation. As explained in Fig. 12, a network formation process is started when a device returns a Probe Response to a Probe Request sent by another device. Group Owner Negotiation is performed during the network formation process. The process in Fig. 13 shows a process in which one of the devices with a larger Intent Value becomes the group owner. In the explanation of Fig. 13, the Intent Value held by the display device 20 is assumed to be X1, and the Intent Value held by the terminal device 40 is assumed to be X2.

[0125] The decision unit 29a compares X2 received from the terminal device 40 with X1 of the display device 20 (its own device) and determines whether they are the same (S11).

[0126] If X1 and X2 are not the same (No in S11), the decision unit 29a judges whether or not X1 is smaller than X2 (S12).

[0127] If X1 is smaller than X2 (Yes in S12), the decision unit 29a determines that the terminal device 40 is the group owner (S13). The decision unit 29a determines that the display device 20 is a client.

[0128] If X1 is not smaller than X2 (No in S12), the decision unit 29a determines that the display device 20 is the group owner (S14).

[0129] If X1 and X2 are the same (Yes in S11), the decision unit 29a judges whether X1 and X2 are smaller than 15 (S15).

[0130] If X1 and X2 are smaller than 15 (Yes in S15), the decision unit 29a determines that the device that transmitted the tiebreaker bit (a value that is referenced when the intent values ​​are the same) equal to 1 is the group owner (S16).

[0131] If X1 and X2 are both 15 (No in S15), the determination unit 29a determines that the owner determination has failed (S17). In this case, the network formation is also terminated (connection fails).

[0132] Since the group owner is determined by the intent value in this manner, in order for a terminal device 40 that can only connect to registered APs to connect to the display device 20, the intent value of the display device 20 needs to be set so that the terminal device 40 becomes the group owner.

[0133] <Intent value setting> Therefore, in this embodiment, a setting as to whether or not simultaneous connection of multiple display devices 20 is possible is associated with an intent value.

[0134] Fig. 14 shows a multiple device simultaneous connection setting screen displayed by the display device 20. The multiple device simultaneous connection setting screen 210 may be displayed superimposed on the image display screen as in Fig. 9, or may be displayed as a pop-up on the image. The multiple device simultaneous connection setting screen 210 may be displayed on the same screen as the image, or may be displayed by an application other than the application for displaying the image. The multiple device simultaneous connection setting screen 210 is displayed by an application installed on the display device 20. The multiple device simultaneous connection setting screen 210 has a radio button associated with "Allow" 211 for two device simultaneous connection and a radio button associated with "Do not allow" 212. This setting also applies to multiple device simultaneous connections of two or more devices. Fig. 14(a) shows a state in which "Do not allow" 212 is selected, and Fig. 14(b) shows a state in which "Allow" 211 is selected. The setting change unit 25 can change the intent value according to the setting on the multiple device simultaneous connection setting screen 210.

[0135] FIG. 15 is a diagram for explaining the correspondence between the multiple simultaneous connection settings and the intent value. As shown in FIG. 15, when the multiple simultaneous connection is set to "Allowed", the intent value is set to 15 (maximum value). When the multiple simultaneous connection is set to "Not Allowed", the intent value is set to "0" (minimum value). The setting change unit 25 holds the correspondence between the multiple simultaneous connection settings and the intent value as shown in FIG. 15, and changes the intent value according to the multiple simultaneous connection setting. "0" and "15" are the minimum and maximum values ​​in the Miracast specifications, and a value that is easy or difficult to become a group owner may be set according to the standard. Also, when it is set to "Allowed", the intent value may be changed to "14", and when it is set to "Not Allowed", the intent value may be changed to "1".

[0136] FIG. 16 is a flowchart illustrating the process in which the setting change unit 25 switches the intent value.

[0137] As shown in FIG. 14, the operation reception unit 23 receives a setting of "permitted" or "not permitted" on the multiple-device simultaneous connection setting screen 210 (S21).

[0138] The setting change unit 25 judges whether "permitted" or "not permitted" has been set (S22).

[0139] If "Allowed" is set, the user wants to set the display device 20 as the group owner, so the setting change unit 25 sets the intent value to "15" (the maximum value) (S23).

[0140] If "not permitted" is set, the user wants to set the display device 20 as a client, so the setting change unit 25 sets the intent value to "0" (the minimum value) (S24).

[0141] Therefore, when the user sets "not permitted" on the multiple simultaneous connection setting screen 210, the intent value of the display device 20 becomes "0", which increases the possibility that the terminal device 40 will become the group owner. Since the display device 20 becomes a client, the display device 20 can transmit and receive video and audio by connecting to an AP provided by the terminal device 40. Also, when the user sets "permitted" on the multiple simultaneous connection setting screen 210, the intent value of the display device 20 becomes "15", which increases the possibility that the display device 20 will become the group owner. The display device 20 can receive and output video and audio from multiple clients.

[0142] Note that the intent value when set to "not permitted" does not necessarily have to be "0". Since the display device 20 and the terminal device 40 exchange intent values ​​in the connection process, the display device 20 only needs to be set to a smaller intent value than the terminal device 40. Similarly, the intent value when set to "permitted" does not necessarily have to be "15". Since the display device 20 and the terminal device 40 exchange intent values ​​in the connection process, the display device 20 only needs to be set to a larger intent value than the terminal device 40.

[0143] <<Connection flow>> FIG. 17 is a flow chart illustrating a process for connecting the terminal device 40 and the display device 20. As shown in FIG.

[0144] Next, the process of the terminal device 40 will be described. The user displays the network list screen 200 and selects an AP representing the display device 20. The wireless communication unit 45 starts a connection with the AP selected by the user (S31).

[0145] The wireless communication unit 45 performed the process shown in Fig. 12 (S32). Through the process in Fig. 12, the display device 20 either succeeds in connecting or fails to connect. If the connection is successful, the group owner is also determined.

[0146] If the connection is successful (Yes in S33), the wireless communication unit 45 starts transmitting video and audio (S34). The terminal device 40 communicates with the display device 20 in a role different from that of the display device 20. If the connection is unsuccessful (No in S33), the wireless communication unit 45 ends the process.

[0147] Next, the processing of the display device 20 will be described. The wireless control unit 29 of the display device 20 performed the processing shown in Fig. 12 (S35). Note that the setting change unit 25 has already changed the intent value set on the multiple device simultaneous connection setting screen 210. Through the processing of Fig. 12, the display device 20 either succeeds in connecting or fails to connect. If the connection is successful, the group owner is also determined.

[0148] If the connection is successful (Yes in S36), the wireless control unit 29 starts receiving video and audio (S37).

[0149] If the connection is unsuccessful (No in S36), the output unit 24 displays a pop-up message prompting the user to change the settings on the multiple-device simultaneous connection setting screen 210 (S38).

[0150] Fig. 18 shows a pop-up screen 220 that the display device 20 displays if the connection fails. The pop-up screen 220 in Fig. 18 displays a message 221 stating "Please set the multiple simultaneous connection setting to 'Do not allow' and try connecting from the PC again." The user can see this message 221 and display the multiple simultaneous connection setting screen 210, where it can be set to "Do not allow." The next time a connection is attempted, the display device 20 is more likely to be able to connect to the terminal device 40. The user can then have the terminal device 40 display a list of APs and try connecting again.

[0151] <Automatic switching of multiple simultaneous connection settings when connection fails> If a connection failure (interruption of the connection process) is detected, the setting change unit 25 may automatically switch the multiple device simultaneous connection setting to "not permitted." This can reduce the effort required for the user to change the multiple device simultaneous connection setting. This increases the possibility that the display device 20 will be able to connect to the terminal device 40 the next time a connection is attempted.

[0152] 19 is a flow chart illustrating the process in which the setting change unit 25 changes the multiple-device simultaneous connection setting when the display device 20 fails to connect to the terminal device 40. Steps S41 to S47 may be the same as those in FIG.

[0153] If the connection fails in step S46, the setting change unit 25 judges whether the multiple device simultaneous connection setting is "permitted" (S48). If the multiple device simultaneous connection setting is "not permitted" (No in S48), the multiple device simultaneous connection setting is already "not permitted", so the processing of the display device 20 ends.

[0154] If the multiple device simultaneous connection setting is "permitted" (Yes in S48), the setting change unit 25 changes the multiple device simultaneous connection setting to "not permitted" (S49).

[0155] Since "not permitted" has been set, the setting change unit 25 changes the intent value to "0" (S50).

[0156] In addition, the output unit 24 displays a pop-up message notifying the user that the multiple device simultaneous connection setting has been changed and prompting the user to perform the connection process again (S51).

[0157] Fig. 20 is an example of a pop-up screen 230 that the display device 20 displays when the multiple simultaneous connection setting has been changed. The pop-up screen 230 in Fig. 20 displays a message 231 stating "The multiple simultaneous connection setting has been changed to 'Not Allowed'. Please connect from your PC again." The next time a connection is made, the display device 20 is more likely to be able to connect to the terminal device 40. The user can have the terminal device 40 display a list of APs and start the connection again.

[0158] <Automatic update of multiple simultaneous connection settings in the connection list when a connection fails> The connection list registers a multiple-device simultaneous connection setting for when the display device 20 has succeeded in connecting to the terminal device 40. When the display device 20 connects to the terminal device 40, the display device 20 is automatically switched to the multiple-device simultaneous connection setting in the connection list, thereby increasing the possibility that the display device 20 can connect to the terminal device 40.

[0159] Therefore, when a failure in connection with the terminal device 40 (interruption of the connection process) is detected, the connection list management unit 26 sets the multiple simultaneous connection setting associated with the terminal device 40 in the connection list to "not permitted."

[0160] 21 is a flow chart for explaining the process in which the connection list management unit 26 registers "not permitted" in the multiple simultaneous connection setting in the connection list when the display device 20 fails to connect to the terminal device 40. Steps S61 to S67 may be similar to those in FIG. 20. However, in step S65, the setting change unit 25 tries two intent values. One is an intent value corresponding to the multiple simultaneous connection setting set on the multiple simultaneous connection setting screen 210. The other is an intent value based on the multiple simultaneous connection setting associated with the terminal device 40, which is searched for in the connection list by the setting change unit 25 when determining the group owner.

[0161] If the connection fails in step S66, the setting change section 25 determines whether or not the multiple-device simultaneous connection setting screen 210 is set to "permitted" (S68).

[0162] If the multiple-device simultaneous connection setting is set to "not permitted" on the multiple-device simultaneous connection setting screen 210 (No in S68), since it has already been set to "not permitted", the processing of the display device 20 ends.

[0163] If the multiple device simultaneous connection setting on the multiple device simultaneous connection setting screen 210 is set to “Allowed” (Yes in S68), the setting change unit 25 determines whether the terminal device 40 that performed the connection start process has been registered in the connection list (S69).

[0164] If the determination in step S69 is Yes, it is determined whether the multiple simultaneous connection setting registered in the connection list in association with the terminal device 40 is "Allowed" (S70). If the multiple simultaneous connection setting in the connection list is "Not Allowed" (No in S70), the display device 20 has already been set to "Not Allowed", and the processing ends.

[0165] If the multiple device simultaneous connection setting in the connection list is “Allowed” (Yes in S70), the setting change unit 25 changes the multiple device simultaneous connection setting registered in association with the terminal device 40 in the connection list to “Not Allowed” (S71).

[0166] On the other hand, if the terminal device 40 that performed the connection initiation process has not been registered in the connection list (No in S69), the setting change unit 25 registers the terminal device 40 that attempted to connect in the connection list, and sets the multiple device simultaneous connection setting to "not permitted" in association with the terminal device 40 that attempted to connect (S72).

[0167] Since the multiple device simultaneous connection setting in the connection list is set to "not permitted", the setting change unit 25 changes the intent value to "0" (S73).

[0168] Also, the output unit 24 displays a pop-up message informing the user that the multiple device simultaneous connection setting has been changed (S74). The pop-up screen 230 may be the same as that shown in FIG.

[0169] As a result, the next time the display device 20 initiates a connection with the same terminal device 40, the intent value of the display device 20 becomes "0", so that the display device 20 becomes a client, increasing the possibility of being able to connect to the terminal device 40.

[0170] <Major Effects> The display device 20 of this embodiment allows the terminal device 40, which is set to prohibit connection with APs other than the registered AP, to connect to the display device 20. Although there is no risk of information leakage when the terminal device 40 connects to the display device 20, the problem that the terminal device 40 cannot connect to the display device 20 because the terminal device 40 is set to prohibit connection can be solved.

[0171] <Other application examples> The above describes the best mode for carrying out the present invention using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0172] For example, in the present embodiment, the determination of the group owner when the display device 20 and the terminal device 40 connect has been described, but in a state in which the display device 20 and the terminal device 40 form a network group, another terminal device 40 may join the network group. In this case, if the display device 20 is the group owner and the other terminal device 40 is subject to restrictions on the registered AP, the other terminal device 40 cannot join the network group. If the display device 20 is the group owner and the other terminal device 40 is not subject to restrictions on the registered AP, the other terminal device 40 joins the network group as a client. If the display device 20 is a client and the other terminal device 40 is subject to restrictions on the registered AP, the other terminal device 40 cannot join the network group. If the display device 20 is a client and the other other terminal device 40 is not subject to restrictions on the registered AP, the other terminal device 40 joins the network group as a client (the group owner is the terminal device 40 that has already formed a network group).

[0173] Furthermore, in this embodiment, the case where the display device 20 displays video has been mainly described, but this embodiment can also be suitably applied to a case where the display device 20 receives only audio and outputs only audio.

[0174] In addition, in the present embodiment, the display device 20 is described as being portable, but the display device 20 may be a stationary type. In a conference room or the like, each user can display an image from his / her own terminal device 40 on a large display device 20. Examples of the large display device 20 include an electronic whiteboard and digital signage.

[0175] Furthermore, the terminal device 40 and the display device 20 may be of the same model. For example, if the terminal device 40 and the display device 20 are both electronic whiteboards, they can share each other's screens to hold a remote conference.

[0176] Moreover, the configuration example in FIG. 5 and the like is divided according to main functions in order to facilitate understanding of the processing by the display device 20. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing by the display device 20 can be divided into more processing units according to the processing contents. Also, it can be divided so that one processing unit includes more processes.

[0177] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0178] Embodiments of the present invention provide significant improvements in computer power and functionality. These improvements allow users to utilize computers that provide more efficient and robust interaction with tables, which are ways of storing and presenting information in information processing devices. Furthermore, embodiments of the present invention provide a better user experience through the use of more efficient, powerful and robust user interfaces. Such user interfaces provide better interaction between humans and machines.

[0179] <Additional Notes> [Appendix 1] An information processing device capable of wirelessly communicating with other information processing devices in a role of either a group owner or a client, a setting change unit that changes settings related to the role in response to a user operation; a determination unit that determines the role based on the role-related setting changed by the setting change unit; a wireless control unit that wirelessly communicates with the other information processing device in the role determined by the determination unit; An information processing device having the above configuration. [Appendix 2] an output unit that displays a screen for accepting settings regarding the role; an operation reception unit that receives a change to the setting related to the role on the screen; 2. The information processing device according to claim 1, [Appendix 3] When the wireless control unit fails to connect to the other information processing device, 3. The information processing device according to claim 2, wherein the output unit displays a message prompting a user to change a setting related to the role. [Appendix 4] The setting change unit sets an intent value associated with the role-related setting, the determination unit determines a larger one of the intent value transmitted from the other information processing device and the intent value of the information processing device itself as a group owner, The role-related setting is a multiple-device simultaneous connection setting that "allows" or "does not allow" multiple other information processing devices to connect to the information processing device simultaneously, The information processing device according to claim 2 or 3, wherein the setting change unit sets the intent value to a maximum value when the multiple device simultaneous connection setting is set to "Allowed", and sets the intent value to a minimum value when the multiple device simultaneous connection setting is set to "Not Allowed". [Appendix 5] When the wireless control unit fails to connect to the other information processing device, The information processing device according to claim 4, wherein the setting change unit sets the multiple-device simultaneous connection setting to "not permitted" and further sets the intent value to a minimum value. [Appendix 6] When the setting change unit sets the multiple device simultaneous connection setting to "not permitted," The information processing device according to claim 5, wherein the output unit displays a message indicating that the role-related setting has been changed and prompting the user to perform reconnection processing. [Appendix 7] a connection list management unit that stores a connection list of the other information processing devices to which the information processing device has successfully connected; the connection list management unit records whether the connection was successful with "permitted" or "not permitted" in association with the other information processing device, The information processing device according to claim 4, wherein the setting change unit changes the multiple simultaneous connection setting for the other information processing device that initiates the connection process to "Allowed" or "Not Allowed" corresponding to the setting in the connection list. [Appendix 8] When the wireless control unit fails to connect to the other information processing device, The information processing device according to claim 7, wherein the connection list management unit changes a setting of "permitted" associated with the other information processing device to which a connection has failed in the connection list to "not permitted." [Appendix 9] When the wireless control unit fails to connect to the other information processing device and the other information processing device to which the connection has failed is not registered in the connection list, The information processing device according to claim 7, wherein the connection list management unit registers the other information processing device to which a connection has failed in the connection list, and sets "not permitted" in association with the other information processing device. [Appendix 10] When the setting change unit sets the multiple simultaneous connection setting of the other information processing device to which the connection has failed in the connection list to “not permitted,” 10. The information processing device according to claim 8, wherein the output unit displays a message indicating that the role-related setting has been changed and prompting the user to perform reconnection processing. [Appendix 11] A display having the information processing device according to any one of claims 1 to 10, or connected to the information processing device according to any one of claims 1 to 10. [Appendix 12] the information processing device is a display device, the display device is capable of acquiring and displaying an image via wireless communication from a terminal device which is the other information processing device, The display device has a display unit that displays the image acquired from the terminal device and a setting screen of the multiple device simultaneous connection setting. 5. The information processing device according to claim 4. [Appendix 13] 13. The information processing device of claim 12, wherein the display device is a portable display device. [Appendix 14] The information processing device according to claim 12, wherein the display device is an electronic whiteboard device. [Explanation of symbols]

[0180] 20 Display device 40 Terminal Equipment 100 Communication Systems [Prior art documents] [Patent documents]

[0181] [Patent Document 1] Patent No. 7037358

Claims

1. An information processing device capable of wirelessly communicating with other information processing devices in a role of either a group owner or a client, a setting change unit that changes settings related to the role in response to a user operation; a determination unit that determines the role based on the role-related setting changed by the setting change unit; a wireless control unit that wirelessly communicates with the other information processing device in the role determined by the determination unit; An information processing device having the above configuration.

2. an output unit that displays a screen for accepting settings regarding the role; an operation reception unit that receives a change to the setting related to the role on the screen; The information processing apparatus according to claim 1 ,

3. When the wireless control unit fails to connect to the other information processing device, The information processing device according to claim 2 , wherein the output unit displays a message prompting a user to change a setting related to the role.

4. The setting change unit sets an intent value associated with the role-related setting, the determination unit determines a larger one of the intent value transmitted from the other information processing device and the intent value of the information processing device itself as a group owner, The role-related setting is a multiple-device simultaneous connection setting that "allows" or "does not allow" multiple other information processing devices to connect to the information processing device simultaneously, The information processing device according to claim 2 or 3, wherein the setting change unit sets the intent value to a maximum value when the multiple device simultaneous connection setting is set to "Allowed", and sets the intent value to a minimum value when the multiple device simultaneous connection setting is set to "Not Allowed".

5. When the wireless control unit fails to connect to the other information processing device, The information processing apparatus according to claim 4 , wherein the setting change unit sets the multiple device simultaneous connection setting to “not permitted” and further sets the intent value to a minimum value.

6. When the setting change unit sets the multiple device simultaneous connection setting to "not permitted," The information processing apparatus according to claim 5 , wherein the output unit displays a message notifying the user that the role-related setting has been changed and prompting the user to perform connection processing again.

7. a connection list management unit that stores a connection list of the other information processing devices to which the information processing device has successfully connected; the connection list management unit records whether the connection was successful with "permitted" or "not permitted" in association with the other information processing device, The information processing apparatus according to claim 4 , wherein the setting change unit changes the multiple simultaneous connection setting for the other information processing apparatus that initiates a connection process to "permitted" or "not permitted" associated with the other information processing apparatus in the connection list.

8. When the wireless control unit fails to connect to the other information processing device, The information processing device according to claim 7 , wherein the connection list management unit changes a setting of "permitted" associated with the other information processing device to which a connection has failed in the connection list to "not permitted."

9. When the wireless control unit fails to connect to the other information processing device and the other information processing device to which the connection has failed is not registered in the connection list, The information processing device according to claim 7 , wherein the connection list management unit registers the other information processing device to which a connection has failed in the connection list, and sets "not permitted" in association with the other information processing device.

10. When the setting change unit sets the multiple simultaneous connection setting of the other information processing device to which the connection has failed in the connection list to “not permitted,” The information processing apparatus according to claim 8 , wherein the output unit displays a message notifying the user that the role-related setting has been changed and prompting the user to perform connection processing again.

11. A display device comprising the information processing device according to claim 1 or connected to the information processing device according to claim 1.

12. the information processing device is a display device, the display device is capable of acquiring and displaying an image via wireless communication from a terminal device that is the other information processing device, The display device has a display unit that displays the image acquired from the terminal device and a setting screen of the multiple device simultaneous connection setting. The information processing device according to claim 4.

13. The information processing device according to claim 12 , wherein the display device is a portable display device.

14. The information processing device according to claim 12 , wherein the display device is an electronic whiteboard device.

15. A communication method performed by an information processing device capable of wirelessly communicating with other information processing devices in a role of either a group owner or a client, A process of changing a setting related to the role when wirelessly communicating with the other information processing device in response to a user operation; A process of determining the role based on the changed role-related setting; A process of wirelessly communicating with the other information processing device in the determined role; A communication method.

16. An information processing device that can wirelessly communicate with other information processing devices in the role of either a group owner or a client. a setting change unit that changes settings related to the role in response to a user operation; a determination unit that determines the role based on the role-related setting changed by the setting change unit; a wireless control unit that wirelessly communicates with the other information processing device in the role determined by the determination unit; A program to function as a

17. A communication system in which an information processing device can wirelessly communicate with another information processing device in a role of either a group owner or a client, The information processing device includes: a setting change unit that changes settings related to the role in response to a user operation; a determination unit that determines the role based on the role-related setting changed by the setting change unit; a wireless control unit that wirelessly communicates with the other information processing device in the role determined by the determination unit; having The other information processing device is A communication system that wirelessly communicates with the information processing device in a role different from that of the information processing device.

Images