Information processing systems, methods, and information processing programs

Abstract

When audio or video input / output devices are connected or disconnected, it is desirable that the user's intended input / output device is selected. [Solution] The information processing system includes an interface to which devices capable of outputting or inputting at least one of sound or video signals can be connected and disconnected. The information processing system includes a setting unit that sets one group including a plurality of devices wired to the information processing system as a priority group based on user operation, and a selection unit that selects an input / output device to output or input a signal from one or more devices connected to the information processing system. If one or more devices wired to the information processing system include devices included in the priority group, the selection unit selects one of the devices included in the priority group as an input / output device.

Description

[Technical Field] , , ,

[0005] ,

[0001] The present disclosure relates to an information processing system, method, and information processing program. [Background Art]

[0002] In an information processing apparatus, for example, as output destinations of sound, there can be a plurality of candidates such as a built-in speaker, an earphone jack, a monitor via a cradle, and a USB (Universal Serial Bus)-connected device (see, for example, Japanese Unexamined Patent Application Publication No. 2017-000757 (Patent Document 1)). [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2017-000757 [Summary of the Invention] [Problems to be Solved by the Invention]

[0004] When an input / output device for sound or video is connected or disconnected, it is desirable that the input / output device intended by the user be selected. [Means for Solving the Problems]

[0005] (Configuration 1) According to one embodiment, an information processing system is provided which has an interface to which devices capable of outputting or inputting at least one of sound or video signals can be connected and disconnected. The information processing system includes a setting unit that sets one group including a plurality of devices wired to the information processing system as a priority group based on user operation, and a selection unit that selects an input / output device to output or input a signal from one or more devices connected to the information processing system. If one or more devices wired to the information processing system include devices included in the priority group, the selection unit selects one of the devices included in the priority group as an input / output device.

[0006] According to Configuration 1, input / output devices are selected from various devices based on priority groups set based on user operations, thus increasing the likelihood that the user's intended input / output device will be selected.

[0007] (Configuration 2) In Configuration 1, the multiple devices may be predetermined devices. According to Configuration 2, the predetermined devices are set as the priority group, which improves user convenience.

[0008] (Configuration 3) In Configuration 2, the multiple devices may include devices that are always connected. According to Configuration 3, at least devices that are always connected are included in the priority group, which reduces the possibility of user confusion.

[0009] (Configuration 4) In Configuration 2 or 3, the multiple devices may include devices connected to a predetermined interface that can be wired and disconnected. According to Configuration 4, devices that are wired to a predetermined interface are included in the priority group regardless of whether the devices are wired, thus increasing the likelihood that the input / output device intended by the user will be selected.

[0010] (Configuration 5) In Configuration 4, the signal may be an audio signal. The predetermined interface may be a phone jack. According to Configuration 5, a device that supports audio input and output, such as earphones, headphones, or a headset, is connected to the phone jack. When a device is connected to the phone jack, it is presumed that the user intends to use the connected device. By including the device connected to the phone jack in a priority group, the likelihood of selecting the input / output device intended by the user can be increased.

[0011] (Configuration 6) In Configuration 5, multiple devices included in the priority group may be assigned priority levels for selection by the selection unit. The device connected to the phone jack may be assigned the highest priority level in the priority group. According to Configuration 6, when a device is connected to the phone jack, the connected device is assigned the highest priority level, making it possible to select an input / output device that matches the user's intentions.

[0012] (Configuration 7) In Configuration 4, the signal may be an audio signal. The selection unit may select an input / output device that outputs an audio signal. The predetermined interface may be HDMI®. When a video signal conforming to HDMI is output, it is presumed that the user expects the device outputting the video signal to not only display the video but also output audio. Configuration 7 makes it possible to select an input / output device that meets such user expectations.

[0013] (Configuration 8) In any of Configurations 1 to 7, the multiple devices may include devices that can be disconnected depending on the state of the information processing system. According to Configuration 8, since the devices to which the information processing system is connected in a particular state are included in the priority group, the likelihood of selecting the input / output device intended by the user can be increased.

[0014] (Configuration 9) In any of Configurations 1 to 8, the information processing system may be capable of displaying video on either the built-in display or a connected external display. The signal may also be an audio signal. The selection unit may select an input / output device that outputs an audio signal. One group may include a built-in microphone and an external display. According to Configuration 9, the built-in microphone can be selected as the input / output device regardless of whether the video is displayed on the built-in display or the external display. Since external displays often do not have microphones, selecting the built-in microphone as the input / output device increases the likelihood that the user's intended input / output device will be selected.

[0015] (Configuration 10) In Configuration 9, when an image is displayed on an external display, the selection unit may prioritize selecting the external display over the built-in speaker. According to Configuration 10, since external displays often have speakers, prioritizing the selection of the external display increases the likelihood that the user's intended input / output device will be selected.

[0016] (Configuration 11) In any of Configurations 1 to 10, multiple devices included in a priority group may have priority settings assigned to them within the priority group for selection by the selection unit. According to Configuration 11, by assigning priority settings, the likelihood of selecting the device intended by the user as an input / output device from among the multiple devices included in the priority group can be increased.

[0017] (Configuration 12) In any of Configurations 1 to 11, the settings unit may display at least one of several devices included in a group as an item selectable by the user, and when the user selects the displayed at least one device, the group may be set as the preferred group. According to Configuration 12, when the user selects any device in one scenario, in other scenarios, even if the selected device is not connected, other devices included in the group to which the selected device belongs will be selected, thereby increasing the likelihood that the user's intended input / output device will be selected.

[0018] (Configuration 13) In Configuration 12, the settings unit may display only one device from among multiple devices included in a group, and may not display the other devices. According to Configuration 13, even if multiple devices are included in a group, only one device included in that group is displayed, which reduces the possibility of user confusion.

[0019] (Configuration 14) In any of Configurations 1 to 13, the setting unit may allow the user to select the device currently to be used for input / output, and set the group containing the selected device as the priority group. According to Configuration 14, a priority group can be set according to the device selected by the user, thereby increasing the likelihood that the input / output device intended by the user will be selected.

[0020] (Configuration 15) In any of Configurations 1 to 14, if one or more devices are wirelessly connected to the information processing system, the selection unit may select one or more of the wirelessly connected devices as the input / output device, regardless of the devices included in the priority group. Configuration 15 increases the likelihood that the input / output device intended by the user will be selected.

[0021] (Configuration 16) In Configuration 15, the device wirelessly connected to the information processing system may be one of the sound output destination, sound input source, video output destination, and video input source. According to Configuration 16, the user's intention can be more reliably reflected.

[0022] (Configuration 17) According to another embodiment, there is provided a method executed in an information processing system including an interface to which a device capable of outputting or inputting at least one of sound or video can be connected and disconnected. The method includes setting, based on a user operation, one group including a plurality of devices wired to the information processing system as a priority group, and selecting an input / output device that outputs or inputs a signal from one or more devices wired to the information processing system. The selecting step includes, when one or more devices connected to the information processing system include a device included in the priority group, selecting any one of the devices included in the priority group as the input / output device.

[0023] (Configuration 18) According to yet another embodiment, there is provided an information processing program executed in an information processing system including an interface to which a device capable of outputting or inputting at least one of sound or video can be connected and disconnected. The information processing program causes one or more processors included in the information processing system to set, based on a user operation, one group including a plurality of devices wired to the information processing system as a priority group, and select an input / output device that outputs or inputs a signal from one or more devices wired to the information processing system. The selecting step includes, when one or more devices connected to the information processing system include a device included in the priority group, selecting any one of the devices included in the priority group as the input / output device.

Brief Description of the Drawings

[0024] [Figure 1]It is a schematic diagram showing a configuration example of an information processing system according to this embodiment. [Figure 2] It is a flowchart showing an example of a processing procedure for selecting an input / output device in an information processing apparatus according to this embodiment. [Figure 3] It is a flowchart showing an example of a processing procedure for selecting an input / output device in an information processing apparatus according to this embodiment. [Figure 4] It is a schematic diagram showing an example of a user interface screen related to setting change of an input / output device in an information processing apparatus according to this embodiment. [Embodiment for Carrying Out the Invention]

[0025] This embodiment will be described in detail while referring to the drawings. For the same or corresponding parts in the drawings, the same reference numerals are given and their descriptions will not be repeated.

[0026] [A. System Configuration Example] First, a configuration example of an information processing system according to this embodiment will be described.

[0027] FIG. 1 is a schematic diagram showing a configuration example of an information processing system 1 according to this embodiment. The information processing system 1 includes an information processing apparatus 100.

[0028] The information processing apparatus 100 is capable of executing at least one of sound output processing, sound input processing, video output processing, and video input processing. The information processing apparatus 100 may be a dedicated game machine, or may be a general-purpose computer such as a personal computer, a smartphone, or a tablet.

[0029] The information processing apparatus 100 may be placed on the cradle 200. The information processing system 1 may include the cradle 200. Hereinafter, a state where the information processing apparatus 100 is not placed on the cradle 200 is referred to as a "portable mode", and a state where the information processing apparatus 100 is placed on the cradle 200 is referred to as a "stationary mode".

[0030] In this specification, “device” encompasses the equipment available to the information processing device 100. It can also be said that “device” encompasses equipment connected to and connectable to the information processing system 1. In the following description, a device is assumed to be capable of at least one of the following: outputting an audio signal, inputting an audio signal, outputting a video signal, or inputting a video signal. That is, a device is capable of outputting or inputting at least one of either an audio or video signal.

[0031] At least one of the information processing device 100 and the cradle 200 includes an interface to which devices can be connected and disconnected via wired connections. That is, at least some devices can be connected and disconnected via wired connections to at least one of the information processing device 100 and the cradle 200. At least some devices may be permanently connected to the information processing system 1. Devices permanently connected to the information processing system 1 can be considered an example of devices that are wired to the information processing system 1.

[0032] The information processing device 100 includes a processing circuit 110, a microphone 120, a speaker 122, an audio processing circuit 124, a phone jack 126, a display 128, and USB ports 132 and 134.

[0033] The processing circuit 110 performs various processes, including those described later. The processing circuit 110 includes, for example, one or more processors 112, one or more memories 114, and one or more storage devices 116.

[0034] The processor 112 includes, for example, a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor 112 loads programs (for example, information processing programs 118) stored in the storage 116 into the memory 114 and executes them.

[0035] The memory 114 is a volatile storage medium accessible by the processor 112, and includes, for example, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory).

[0036] The storage 116 is a non-volatile storage medium accessible by the processor 112, and includes, for example, flash memory or a hard disk. The storage 116 may also include a storage medium that can be attached to or removed from the information processing device 100, such as a cartridge or an SD card. The storage 116 may store an information processing program 118 for performing processing as described later.

[0037] In this specification, the term "processor" includes, at a minimum, processing circuits that perform processing according to computer-readable instructions, such as CPUs and GPUs, and hardwired circuits, such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field Programmable Gate Arrays).

[0038] In this specification, the term “memory” includes at least the memory 114 and the storage 116.

[0039] In the information processing device 100, a System on Chip (SoC) in which functions such as a processor and memory are integrated may be used. In this case, the processor and memory reside on the same SoC (integrated circuit). Therefore, in this specification, the terms "processor" and "memory" include both independent configurations and integrated configurations.

[0040] The microphone 120 is located on the casing of the information processing device 100 and collects sound to generate an audio signal. The microphone 120 can also be considered a built-in microphone of the information processing device 100.

[0041] The speaker 122 is located in the casing of the information processing device 100 and generates sound from audio signals. The speaker 122 can also be considered a built-in speaker of the information processing device 100.

[0042] The audio processing circuit 124 is electrically connected to the phone jack 126. The audio processing circuit 124 provides an audio signal (specifically, a signal for outputting sound) to a device (e.g., an earphone or headset) inserted into the phone jack 126. The audio processing circuit 124 may also receive an audio signal (specifically, a signal indicating the sound collected by the device) from the device (e.g., a headset) inserted into the phone jack 126.

[0043] The phone jack 126 (and the audio processing circuit 124) is an interface for wired connection of the device.

[0044] The display 128 displays or outputs video according to the video signal generated by the processing circuit 110. The display 128 includes, for example, an LCD (Liquid Crystal Display) or an organic EL display. The display 128 is positioned so that its display surface is exposed in a part of the housing of the information processing device 100. The display 128 can also be called a built-in display or integrated display of the information processing device 100.

[0045] The information processing device 100 may further include one or more interfaces for wired connections of devices. For example, a USB port 132 is used for wired connections between the information processing device 100 and one or more devices.

[0046] USB port 134 is used to connect the information processing device 100 to the cradle 200. The information processing device 100 may receive power from the cradle 200 via USB port 134. By connecting to the cradle 200 via USB port 134, the information processing device 100 can also utilize devices connected to the cradle 200.

[0047] The cradle 200 includes a processing circuit 210, a USB connector 220, USB ports 222, 224, and 226, and a video connector 228.

[0048] The processing circuit 210 performs operations such as exchanging data with the information processing device 100. The processing circuit 210 may also perform operations such as exchanging data with devices wired to the USB connector 220, USB ports 222, 224, 226, and video connector 228. The processing circuit 210 may also function as a USB hub. The processing circuit 210 may include one or more processors, one or more memories, and one or more storage devices.

[0049] The USB connector 220 is primarily used to connect the information processing device 100 and the cradle 200. The USB port 134 of the information processing device 100 may be a female connector, while the USB connector 220 of the cradle 200 may be a male connector.

[0050] USB ports 222, 224, and 226 are used for wired connections between the cradle 200 and one or more devices.

[0051] The video connector 228 is an interface for outputting video signals to a device. The cradle 200 may also output audio signals to the monitor 300 in addition to video signals. In this case, the video connector 228 is also an interface for outputting audio signals to the device. The video connector 228 may conform to standards such as HDMI, DisplayPort, or Thunderbolt®. The monitor 300 is an example of a device and can also be called an external display.

[0052] The information processing system 1 can display images on either the display 128 or the monitor 300 of the information processing device 100. For example, in portable mode, the image may be displayed on the display 128, and in stationary mode, the image may be displayed on the monitor 300.

[0053] As a variation, the information processing device 100 may include one or more built-in cameras. The lenses of the built-in cameras may be partially exposed on the housing of the information processing device 100.

[0054] As a variation, the information processing device 100 may include an input unit that accepts user input (for example, a game controller, buttons, a directional pad, a keyboard, a mouse, etc.). The input unit may be located on the casing of the information processing device 100, or it may be detachable from the information processing device 100.

[0055] As a modified example, the information processing device 100 may include a video port, which is an interface for outputting at least one of a video signal and an audio signal.

[0056] Figure 1 illustrates a configuration conforming to the USB standard as an interface for wired device connection, but any interface can be used, not limited to this.

[0057] [B. Devices] Next, we will describe the devices connected to the information processing device 100 or the cradle 200.

[0058] The information processing device 100 includes, in addition to devices that are always connected, interfaces that allow devices to be connected and disconnected via wires. Furthermore, when the information processing device 100 is placed on the cradle 200, the information processing device 100 can also use devices connected to the cradle 200 as devices connected to the information processing device 100. Therefore, the information processing device 100 can utilize a variety of devices. For example, devices related to audio and video input and output can be exemplified as follows. Note that "standard devices" in the list below will be explained later.

[0059] (1) Audio output destination (speakers) • <Standard Device> Speaker 122 of Information Processing Device 100 • <Standard Devices> Earphones, headphones, headsets, etc. connected via a wired connection to the phone jack 126 of the information processing unit. • Earphones, headphones, headsets, etc. connected via a wired connection to USB port 132 of the information processing device 100 • Earphones, headphones, headsets, etc. connected via wire to at least one of the USB ports 222, 224, or 226 on the Cradle 200. • <Standard Device> Monitor 300 (and its speakers) connected via a wired connection to the video connector 228 of Cradle 200. (2) Audio input source (microphone) • <Standard device> Microphone 120 of information processing device 100 • <Standard Device> A microphone (or the microphone function of a headset) connected via a wire to the phone jack 126 of the information processing unit. • A microphone (or the microphone function of a webcam) connected via a wire to USB port 132 of the information processing device 100. • A wired microphone (or the microphone function of a smart speaker) connected to at least one of the USB ports 222, 224, or 226 on the Cradle 200. (3) Video output destination (display) • <Standard device> Display 128 of information processing device 100 • <Standard Device> Monitor 300 connected via wire to video connector 228 of cradle 200. (4) Video input source (camera) • A camera or other device connected via a wired connection to USB port 132 of the information processing device 100. • A camera or other device connected via a wire to at least one of the USB ports 222, 224, or 226 on the Cradle 200. The devices described above are examples only and are not limited to them. For example, when another device is connected to a device connected to the information processing device 100 or the cradle 200, that other device may be selected as the output destination or input source for sound or video.

[0060] For example, a game controller connected to the information processing device 100 by wire or wireless connection may include a microphone, phone jack, USB connector, etc. A device connected to such a game controller may be selected as the output destination or input source for sound or video.

[0061] [C. Standard Devices] The standard devices listed above may be devices connected to the information processing system 1 via a wired connection. The standard devices may also be predetermined devices. For example, the standard devices may include at least one of the always-connected devices, namely the speaker 122 and the microphone 120 of the information processing device 100. The standard devices may also include the always-connected display 128 of the information processing device 100. Furthermore, if the information processing device 100 includes a built-in camera (an example of an always-connected device), the built-in camera may be set as the standard device.

[0062] Furthermore, a standard device may include a device that is wired to a predetermined interface. For example, a standard device may include at least one of a device wired to the phone jack 126 and a device wired to the video connector 228. Here, the interface itself, such as the phone jack 126 or the video connector 228, may be set as a standard device. In other words, regardless of what device is wired to the phone jack 126 or the video connector 228, the connected device may be treated as a standard device.

[0063] If the predefined interface included in the standard device is a phone jack 126, this interface may be selected as at least one of the output destination and input source for audio signals. Furthermore, if the predefined interface included in the standard device is an HDMI-compliant video connector 228, this interface may be selected as at least one of the output destination for audio signals and output destination for video signals.

[0064] Furthermore, the standard devices may include devices that can be disconnected depending on the state of the information processing system 1. For example, in portable mode, the information processing device 100 cannot use devices connected via the cradle 200 (e.g., a monitor 300 connected to the video connector 228 of the cradle 200). The standard devices may include devices that can be disconnected in such portable or stationary modes.

[0065] [D. Priority Group] As described above, various devices can be directly or indirectly connected to the information processing device 100. In this embodiment, a "priority group" is set which includes one or more devices that are preferentially selected for selecting either an audio output destination, an audio input source, a video output destination, or a video input source. Devices included in the priority group (hereinafter also referred to as "priority devices") are preferentially selected as audio or video output destinations or input sources compared to devices not included in the priority group. The priority devices included in the priority group can be set arbitrarily. Note that there may be cases where no priority group is set, or where a priority group is set but does not include any devices.

[0066] For example, a priority group may include a group containing multiple standard devices (hereinafter also referred to as a "standard group"). That is, one group containing multiple standard devices (a standard group) may be set as the priority group.

[0067] The priority group may include, in addition to, a standard group containing multiple standard devices, or alternatively, any device selected according to user input. For example, a user may set a device connected via a wire to any USB port as the priority device.

[0068] For USB ports 132, 222, 224, and 226, the preferred device may be a specific device connected via wire to one of the USB ports 132, 222, 224, or 226, rather than the interface itself (i.e., the USB port itself).

[0069] [E. Input / Output Device Selection Process] Next, the procedure for selecting an input / output device in the information processing device 100 according to this embodiment will be described. For convenience of explanation, devices selected as the output destination or input source for sound or video will also be collectively referred to as "input / output devices."

[0070] The information processing device 100 selects an input / output device from one or more devices connected to the information processing system 1 to output or input a signal. The input / output device may be a device capable of both outputting and inputting sound signals, such as a headset. In other words, one input / output device may serve as both the output destination and the input source for sound.

[0071] When selecting an input / output device, if any of the priority devices included in the priority group are connected via a wired connection, that connected priority device will be selected as the input / output device.

[0072] Priority and selection rules may be pre-defined among multiple standard devices set as a priority group. In other words, a priority order for selection may be set for the multiple devices included in the priority group.

[0073] For example, a device (speaker) connected to the phone jack 126 may be selected with priority over the speaker 122 of the information processing device 100 and the speaker of the monitor 300. Similarly, a device (microphone) connected to the phone jack 126 may be selected with priority over the microphone 120 of the information processing device 100. In both portable and stationary modes, the device connected to the phone jack 126 may be given priority. That is, the device connected to the phone jack 126 may be assigned the highest priority in the priority group.

[0074] In handheld mode, the monitor 300 cannot be used, so the speaker 122 and display 128 of the information processing device 100 are prioritized. On the other hand, in stationary mode, the monitor 300 (speaker and display) may be prioritized over the speaker 122 and display 128 of the information processing device 100. That is, when an image is displayed on the monitor 300, the information processing device 100 may prioritize selecting the monitor 300 over the speaker 122 of the information processing device 100.

[0075] The priority order set for multiple priority devices included in a priority group may be predetermined (i.e., fixed), or it may be dynamically changed by the information processing device 100. Furthermore, the user may arbitrarily set or change the priority order.

[0076] If no priority group is set, or if the priority devices included in the priority group are not connected via wired connection, an input / output device may be selected from the connected devices according to a predetermined selection rule. For example, the most recently connected device may be selected; that is, the most recently connected device may be given the highest priority.

[0077] "The most recently connected device" refers to the most recently connected device among the devices connected at the time of determination. For example, if devices A, B, and C are connected in that order, and then device C is disconnected, then device B is considered the most recently connected device. Therefore, the information processing device 100 may store the connection history of devices. The connection history may be stored for each sound and video, or for each output and input. The number of connection histories stored is limited to a predetermined number (e.g., 10) from the most recent, and any connection histories exceeding this number may be deleted sequentially from the oldest.

[0078] Furthermore, when the information processing device 100 is connected to the cradle 200, when the information processing device 100 wakes up from sleep mode, or when the information processing device 100 is powered on or restarted, multiple devices may be considered to be connected simultaneously. In such cases, an input / output device may be selected from among the multiple simultaneously connected devices according to a pre-set priority order.

[0079] Figures 2 and 3 are flowcharts illustrating example processing steps for selecting an input / output device in an information processing device 100 according to this embodiment. Each step shown in Figures 2 and 3 may be implemented by one or more processors 112 of the information processing device 100 executing an information processing program 118. The processing steps shown in Figure 2 include processing steps for changing the selected input / output device, and the processing steps shown in Figure 3 include processing steps for selecting an input / output device.

[0080] Referring to Figure 2, the information processing device 100 determines whether or not an input / output device has been selected (step S2).

[0081] If an input / output device has been selected (YES in step S2), the information processing device 100 determines whether the user has changed the settings of the input / output device (step S4). Changing the settings of an input / output device by the user is an operation to change the output destination and input source of sound or video, etc. Changing the settings of an input / output device by the user may change the settings of the priority group (i.e., one or more priority devices). An example of changing the settings of an input / output device by the user will be described later.

[0082] If the user has not changed the settings of the input / output devices (NO in step S4), the information processing device 100 determines whether the connection status of the devices has changed (step S6). A change in the connection status of the devices includes the connection of a new device and the disconnection of any device.

[0083] If the device connection status has not changed (YES in step S6), the information processing device 100 maintains the current selection of input / output devices (step S8). Then, the process from step S2 onward is repeated.

[0084] When the user changes the settings of an input / output device (YES in step S4), or when the connection status of a device changes (YES in step S6), the information processing device 100 determines whether any of the priority devices included in the priority group are connected via a wired connection (step S10).

[0085] If any of the priority devices included in the priority group are connected via a wired connection (YES in step S10), the information processing device 100 selects an input / output device from the wired priority devices (step S12). In cases where multiple priority devices are connected via wired connections, the priority devices may be selected as input / output devices according to their priority. Then, the process from step S2 onward is repeated.

[0086] Thus, if the information processing device 100 has one or more devices wired to the information processing system 1 that include devices in a priority group, it selects one of the devices in the priority group as an input / output device.

[0087] If none of the priority devices included in the priority group are connected via wired connection (NO in step S10), the information processing device 100 determines whether the mode has been switched between portable mode and stationary mode (step S14).

[0088] When the mode is switched (YES in step S14), the information processing device 100 does not consider the standard devices that have become available due to the mode switch as newly connected, but selects the most recently connected device as the input / output device (step S16). Then, the process from step S2 onward is repeated.

[0089] However, the number of selectable standard devices may increase or decrease as the mode is switched. If multiple standard devices were set as a priority group immediately before the mode was switched, the input / output device will be selected according to the priority among the standard devices, so the selection of input / output devices may change as the number of standard devices increases or decreases. For example, if the speaker 122 of the information processing unit 100 is selected as the sound output destination in portable mode, and the system is switched to stationary mode, the monitor 300 may be selected as the sound output destination. Note that if the phone jack 126 is set to the highest priority in the priority group, the selection of the device connected to the phone jack 126 will be maintained even if the mode is switched.

[0090] If the mode has not been switched (NO in step S14), the information processing device 100 selects the most recently connected device as the input / output device (step S18). Then, the process from step S2 onward is repeated.

[0091] Referring to Figure 3, if no input / output device is selected (NO in step S2), the information processing device 100 determines whether a predetermined time (for example, 2 seconds) has elapsed (step S20).

[0092] If the predetermined time has not elapsed (NO in step S20), the information processing device 100 determines whether or not a device that was selected as an input / output device before sleep exists (step S22). If a device that was selected as an input / output device before sleep does not exist (NO in step S22), the process from step S20 onward is repeated.

[0093] If a device that was selected as an input / output device before sleep exists (YES in step S22), the information processing device 100 selects the input / output device that was selected before sleep as the current input / output device (step S24). Then, the process from step S2 onward is repeated.

[0094] The processing in steps S20 to S24 is for efficiently searching for devices. For example, when the information processing device 100 wakes from sleep, it may search for all connected devices (or unconnected devices) and then select an input / output device. However, since searching for all devices takes time, the information processing device 100 stores the input / output device that was selected before sleep (and, if necessary, the USB port to which that input / output device was connected), and if that selected input / output device exists when the device wakes up, it immediately selects that input / output device.

[0095] Once a predetermined time has elapsed (YES in step S20), the information processing device 100 executes the processes from step S26 onward. That is, after the process of searching for input / output devices selected before sleep is executed for a predetermined time, the information processing device 100 determines whether or not any of the priority devices included in the priority group are connected (step S26).

[0096] If any of the priority devices included in the priority group are connected (YES in step S26), the information processing device 100 selects an input / output device from the connected priority devices (step S28). If multiple priority devices are connected, a priority device is selected as the input / output device according to its priority. Then, the process from step S2 onward is repeated.

[0097] If none of the priority devices included in the priority group are connected (NO in step S26), the information processing device 100 selects the most recently connected device as the input / output device (step S30). Then, the process from step S2 onward is repeated.

[0098] Furthermore, in step S24, after a device that is not the preferred device is selected as an input / output device, the processing in steps S22 and S24 may be performed only if the device selected as the input / output device before sleep is the preferred device, so that the preferred device is not selected as an input / output device in step S12.

[0099] Note that the processing from step S20 onward may be executed even when the system is not waking from sleep. When the system is not waking from sleep, the information processing device 100 does not remember the input / output device that was selected before sleep, so in step S22, it determines that there is no device that was selected as an input / output device before sleep.

[0100] Furthermore, if the information processing device 100 can store the input / output device that was selected before, for example, before the power was turned off, not only before sleep mode, the processing from step S20 onward may be performed based on the input / output device that was selected before the power was turned off.

[0101] For the sake of explanation, the devices are referred to as "input / output devices" in Figures 2 and 3. In this embodiment, the process of selecting a device, as shown in Figures 2 and 3, is performed for both the output destination and input source of sound and video. For example, the process of selecting the output destination device for sound and the process of selecting the input source device for sound are performed separately. A device may be capable of input only, output only, or both. As an example, if a headset capable of both sound output and sound input is connected, the headset may be selected as the sound input source device, but not as the sound output destination device. As a variation, if a device is capable of both input and output, the process may be performed so that the device is either selected as both an input source and an output destination device, or not selected as either an input source or an output destination.

[0102] As a variation, instead of selecting the most recently connected device as the input / output device (steps S16, S18, S30, etc.), the input / output device may be selected according to a predetermined priority order. For example, the device may be searched for in the following order: built-in devices (devices that are always connected), devices connected to the USB port of the information processing device 100, and devices connected to the USB port of the cradle 200, and the first device found may be selected as the input / output device. Alternatively, the device names of connected devices may be searched alphabetically or in order of device identification number, and the first device found may be selected as the input / output device.

[0103] [F. Changing Input / Output Device Settings] Next, we will describe an example of a user changing the settings of an input / output device (step S4 in Figure 2).

[0104] Figure 4 is a schematic diagram showing an example of a user interface screen related to changing the settings of an input / output device in an information processing device 100 according to this embodiment.

[0105] Referring to Figure 4(A), the user interface screen 400 includes items 402 for selecting the audio output destination and audio input source, and items 404 for selecting the video output destination and video input source. In Figure 4(A), item 402 is selected.

[0106] The user interface screen 400 includes a frame 410 for displaying the currently selected output destination and input source, and a frame 420 for setting the priority group. The user interface screen 400 may also include a frame (audio input source) for setting the sound input source (microphone). Furthermore, when item 404 is selected, the user interface screen 400 may display frames for selecting the video output destination and video input source.

[0107] In frame 410, text 412, indicating the currently selected audio output destination (speaker), is displayed along with a speaker icon, and text 414, indicating the audio input source (microphone), is displayed along with a microphone icon. In Figure 4(A), both the audio output destination and audio input source are set to a device connected to the USB port (USB PnP Audio Device). The specific product name of the device may also be displayed.

[0108] In frame 420, text 422 is displayed, indicating the priority group currently set as the sound output destination (speaker). In Figure 4(A), "Automatic" is displayed as text 422. In this embodiment, "Automatic" indicates that no priority group is set. In this embodiment, it is determined that no priority device is connected in this state (step S10 in Figure 2 and step S26 in Figure 3). Therefore, the rule to select the most recently connected device is applied as the device selection rule. That is, the USB PnP Audio Device is the most recently connected device and is selected as the sound output destination.

[0109] Referring to Figure 4(B), when the user selects frame 420, a list 430 is displayed showing candidate priority groups for audio output destinations. Three items 432, 434, and 436 are displayed in list 430. The user selects the desired item by selecting the corresponding radio button. For example, if "Built-in Speaker" is selected, the built-in speaker is set as the priority device and the audio output destination, as described below. On the other hand, if "USB PnP Audio Device" is selected, that device is set as the priority device, but the audio output destination does not change.

[0110] Here, as shown in Figure 4, the item name is "Audio Output Destination." For users, understanding the concepts of priority group or priority device may be difficult. Therefore, by having the user select the device they currently want to output to, and then setting that device as both the priority device and the output destination device, we can meet the user's current request without causing confusion, and also align with the user's intentions when the device is plugged in or unplugged in the future.

[0111] If no preferred device is set, item 432, which indicates "Automatic," may be selected as the default in List 430.

[0112] When item 434, which indicates "main unit speaker," is selected, the information processing device 100 sets a standard group containing multiple standard devices as the preferred group. In this way, the information processing device 100 sets a standard group containing multiple standard devices as the preferred group based on user operation.

[0113] "Main unit speaker" refers to the speaker 122 (built-in speaker) of the information processing device 100. Speaker 122 is a standard device. In this embodiment, by selecting one standard device, a standard group including other standard devices may be set as the preferred group. In this embodiment, the standard group for sound output destinations includes speaker 122, devices connected to the phone jack 126, and devices connected to the video connector 228 of the cradle 200. Thus, the information processing device 100 may display at least one of the multiple standard devices included in the standard group as an item selectable by the user, and when the user selects the displayed at least one standard device, the standard group may be set as the preferred group. As shown in Figure 4(B), it is also possible to display only one standard device from the multiple standard devices included in the standard group and not display the other standard devices. For example, in stationary mode, item 434 included in list 430 may indicate "television" or the product name of the television, etc., instead of "main unit speaker". In this embodiment, regardless of the state of the information processing device 100, an item indicating one of the standard devices may always be included in list 430.

[0114] The user interface screen 400 shown in Figure 4(C) shows the state after the input / output device selection process (steps S10 and S12 in Figure 2) has been performed, following the setting of a standard group containing multiple standard devices as the preferred group in Figure 4(B). For example, the sound output destination has been changed to speaker 122. As a result, in frame 410, the text "Main unit speaker" 416, indicating the selected speaker 122, is displayed along with a speaker icon.

[0115] By performing the operations shown in Figure 4, the audio input source, video output destination, and video input source are set or changed.

[0116] In the user interface screen shown in Figure 4, the user is not explicitly notified when the priority group setting is changed; however, as a modification, explicit notification may be provided.

[0117] Furthermore, in the user interface screen shown in Figure 4, the user may be allowed to explicitly select one or more devices to be set as priority groups. The user may also be able to arbitrarily set multiple devices to be included in a single priority group. They may also be able to set the priority order among these multiple devices. Additionally, the user may be able to set multiple priority groups and select one of these priority groups to be used for the device selection process. A user interface screen or setting menu may be provided for making these settings and selections.

[0118] [G. Wireless connection] The connection between the device and the information processing device 100 or the cradle 200 may be wireless.

[0119] The information processing device 100 may include one or more interfaces for wirelessly connecting devices. For example, a wireless module 130 (see Figure 1) mediates wireless connections between the information processing device 100 and one or more devices. The wireless module 130 may support wireless networks such as Bluetooth®, ZigBee®, or wireless LAN (IEEE 802.11 standard).

[0120] Similarly, the cradle 200 may include a wireless module, which is an interface for wirelessly connecting the devices.

[0121] The following are examples of devices that can be wirelessly connected to the information processing device 100 or the cradle 200. • Earphones, headphones, headsets, etc., wirelessly connected via the wireless module 130 of the information processing device 100. • A microphone (or the microphone function of a headset) wirelessly connected via the wireless module 130 of the information processing device 100. • Cameras, etc., wirelessly connected via the wireless module 130 of the information processing device 100. The information processing device 100 may select a wirelessly connected device as an input / output device if such a device exists, regardless of the priority group settings. In other words, if one or more devices are wirelessly connected to the information processing system 1, the information processing device 100 may select any of the one or more wirelessly connected devices as an input / output device, regardless of which devices are included in the priority group. For example, the information processing device 100 may select a wirelessly connected device as an input / output device by treating it as a priority device while it is wirelessly connected, or it may forcibly select it as an input / output device independently of the priority device.

[0122] For example, if a wirelessly connectable device can only handle one of the following: audio output destination, audio input source, video output destination, or video input source, selecting the wirelessly connectable device as an input / output device may align with the user's intent. For instance, a USB port can be connected to a camera with video input and audio input and output functions, or a headset with audio input and output functions. While a user may not intend to use any of these functions, if only one function is available via wireless connection, as described above, the likelihood of not intending to use that function is low. Note that a device may also be capable of wirelessly connecting to multiple input / output destinations among audio output destination, audio input source, video output destination, and video input source.

[0123] If multiple devices are wirelessly connected, the most recently connected device among the wirelessly connected devices may be selected as the input / output device. Alternatively, the device may be selected according to the priority among the wirelessly connected devices. Furthermore, even if there are no restrictions on the devices that can be connected via the wireless module 130 of the information processing device 100, the wirelessly connected device may be selected with the highest priority.

[0124] [H. Variant] In the above embodiment, a standard group containing multiple standard devices was set, and this standard group could be set as a priority group. Then, one of the standard devices from this standard group was selected as an input / output device. Here, it is not necessary for the standard group containing multiple standard devices to be directly set as a priority group in terms of internal processing. For example, in terms of internal processing, one standard device may be set as a priority device, while at the same time, one device may be selected as a standard device from among predetermined standard device candidates in the state of the information processing device 100. In such a case as well, it can be considered that one group containing multiple devices is set as a priority group.

[0125] When a game controller connected to the information processing device 100 by wire or wirelessly includes a phone jack or USB connector, the method for selecting earphones or headsets connected via these as input / output destinations is not limited. For example, such connected devices may be treated as a priority group, similar to other wired devices. Such connected devices may or may not be included in a standard group. Alternatively, similar to wirelessly connected devices, such connected devices may be selected as input / output devices without being affected by priority group settings. Alternatively, they may be selected as input / output devices under different rules than those for wired and wirelessly connected devices described in the above embodiment.

[0126] In the above embodiment, an example was described in which wired and wirelessly connected devices are processed separately. However, wired and wirelessly connected devices may be treated without distinction. For example, a wirelessly connected device may be set as the priority device. If the priority group includes one or more wired priority devices and one or more wireless priority devices, the input / output devices may be selected according to the priority order in that priority group. Note that a specific device wirelessly connected to the wireless module 130, rather than the wireless module 130 itself which is the interface, may be selected as the priority device.

[0127] The information processing system 1 may consist only of the information processing device 100, or the information processing device 100 may be connectable to a device other than the cradle 200.

[0128] The information processing device 100 may also use external resources such as a server other than the information processing device 100 to perform processing according to this embodiment.

[0129] The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims rather than by the foregoing description, and all modifications within the meaning and scope equivalent to the claims are intended to be included. [Explanation of Symbols]

[0130] 1 Information processing system, 100 Information processing devices, 110, 210 Processing circuits, 112 Processors, 114 Memory, 116 Storage, 118 Information processing programs, 120 Microphones, 122 Speakers, 124 Audio processing circuits, 126 Phone jacks, 128 Displays, 130 Wireless modules, 132, 134, 222, 224, 226 USB ports, 200 Cradles, 220 USB connectors, 228 Video connectors, 300 Monitors, 400 User interface screens, 402, 404, 432, 434, 436 Items, 410, 420 Frames, 412, 414, 416, 422 Text, 430 Lists.

Claims

1. An information processing system having an interface to which a device capable of outputting or inputting at least one of sound or video signals can be connected and disconnected, A setting unit that, based on user operation, sets one group including multiple devices connected via wire to the information processing system as a priority group, The system includes a selection unit that selects an input / output device to output or input the signal from one or more devices connected to the information processing system, The selection unit, if one or more devices wired to the information processing system include devices included in the priority group, selects one of the devices included in the priority group as the input / output device in the information processing system.

2. The information processing system according to claim 1, wherein the plurality of devices are predetermined devices.

3. The information processing system according to claim 2, wherein the plurality of devices include devices that are always connected.

4. The information processing system according to claim 2 or 3, wherein the plurality of devices include devices connected to a predetermined interface that can be connected and disconnected via a wired connection.

5. The aforementioned signal is an audio signal. The information processing system according to claim 4, wherein the predetermined interface is a phone jack.

6. Multiple devices included in the aforementioned priority group are assigned a priority order for selection by the selection unit. The information processing system according to claim 5, wherein the device connected to the phone jack is assigned the highest priority in the priority group.

7. The aforementioned signal is an audio signal. The selection unit selects an input / output device that outputs an audio signal. The information processing system according to claim 4, wherein the predetermined interface is HDMI (registered trademark).

8. The information processing system according to claim 2 or 3, wherein the plurality of devices include a device that can be disconnected depending on the state of the information processing system.

9. The aforementioned information processing system is capable of displaying images on either its built-in display or a connected external display. The aforementioned signal is an audio signal. The selection unit selects an input / output device that outputs an audio signal. The information processing system according to claim 1 or 2, wherein one of the groups includes a built-in microphone and the external display.

10. The information processing system according to claim 9, wherein when an image is displayed on the external display, the selection unit prioritizes selecting the external display over the built-in speaker.

11. The information processing system according to claim 1, wherein a plurality of devices included in the priority group are assigned a priority order within the priority group for selection by the selection unit.

12. The aforementioned setting unit is, As an item that the user can select, at least one of the multiple devices included in the aforementioned group is displayed, The information processing system according to claim 2, wherein when at least one of the displayed devices is selected by the user, the one group is set as the preferred group.

13. The information processing system according to claim 12, wherein the setting unit displays one device from among a plurality of devices included in one group, and does not display the other devices.

14. The information processing system according to claim 9, wherein the setting unit allows the user to select a device to be used for input / output and sets the group including the selected device as a priority group.

15. The information processing system according to any one of claims 1 to 3, wherein the selection unit selects one or more wirelessly connected devices as the input / output device, regardless of the devices included in the priority group, if one or more devices are wirelessly connected to the information processing system.

16. The information processing system according to claim 15, wherein the device wirelessly connected to the information processing system is one of the following: a sound output destination, a sound input source, a video output destination, and a video input source.

17. A method performed in an information processing system having an interface to which a device capable of outputting or inputting at least one of sound or video signals can be connected and disconnected, The steps include setting a group of devices connected via wire to the information processing system as a preferred group based on user operation, The system comprises the step of selecting an input / output device to output or input the signal from one or more devices connected to the information processing system, The method comprising the step of selecting one or more devices wired to the information processing system, if those devices include devices included in the priority group, then selecting one of the devices included in the priority group as the input / output device.

18. An information processing program that runs on an information processing system having an interface to which a device capable of outputting or inputting at least one of sound or video signals can be connected and disconnected, wherein the information processing program is performed on one or more processors included in the information processing system, The steps include setting a group of devices connected via wire to the information processing system as a preferred group based on user operation, The system is made to perform the steps of selecting an input / output device to output or input the signal from one or more devices connected to the information processing system, The information processing program, wherein the selection step includes, if one or more devices wired to the information processing system include devices included in the priority group, selecting one of the devices included in the priority group as the input / output device.

Images