Information processing apparatus, and control method

Abstract

To automatically change to an appropriate camera among a plurality of cameras.SOLUTION: An information processing apparatus comprises: an internal camera; a connection portion to be connected to one or more external cameras; a memory temporarily storing image data of an image captured by the internal camera or an external camera; a processor performing processing using the image of the image data stored in the memory by implementing an application program; and a detection portion detecting an attention direction of a captured person on the basis of the image captured by the internal camera. In the information processing apparatus, the processor performs camera selection processing selecting a camera capturing an image to be used for processing from among the internal camera and the external cameras on the basis of a positional relationship between the internal camera and the external cameras and the attention direction of the person detected by the detection portion.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a control method.

Background Art

[0002] With the recent development of WFA (Work-From-Anywhere), web conferences (video conferences) are being held using personal computers (PCs) equipped with cameras in various locations and environments (see, for example, Patent Document 1). In addition, the use of multi-monitors by connecting an external display has also increased, and the opportunities for web conferences have also become more numerous.

[0003] Here, some external displays are equipped with cameras. In addition, with the widespread use of external cameras, external cameras are also attached to external displays without built-in cameras for use. Therefore, many users participate in web conferences with both an internal camera and an external camera installed in the PC.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, as described above, when participating in a web conference with both an internal camera and an external camera of a PC installed, if one is looking at the display of the camera not set as the camera to be used for the web conference during the meeting, the side face image will be shown as a participant in the meeting, which is not preferable when viewed by other participants. Although it is possible to manually switch the camera, it is time-consuming to operate. Also, the display to be focused on often changes during the meeting, and it is cumbersome and unrealistic to perform the operation of switching the camera each time.

[0006] The present invention has been made in view of the above circumstances, and one of its purposes is to provide an information processing apparatus and a control method that can automatically switch to an appropriate camera among a plurality of cameras.

Means for Solving the Problems

[0007] The present invention has been made to solve the above problems, and an information processing apparatus according to a first aspect of the present invention includes an internal camera, a connection unit connected to one or more external cameras, a memory that temporarily stores image data of an image captured by the internal camera or the external camera, a processor that performs processing using the image of the image data stored in the memory by executing an application program, and a detection unit that detects the attention direction of the person being imaged based on the image captured by the internal camera. The processor performs a camera selection process of selecting a camera that captures an image to be used for the processing from the internal camera and the external cameras based on the positional relationship between the internal camera and the external cameras and the attention direction of the person detected by the detection unit.

[0008] In the above information processing apparatus, the detection unit may detect the direction of the person's face as the attention direction of the person, and the processor may select a camera that captures an image to be used for the processing from the internal camera and the external cameras based on the positional relationship between the internal camera and the external cameras and the direction of the person's face detected by the detection unit in the camera selection process.

[0009] In the above information processing apparatus, the detection unit detects the line-of-sight direction of the person as the attention direction of the person, and in the camera selection process, the processor may select, based on the positional relationship between the internal camera and the external camera and the line-of-sight direction of the person detected by the detection unit, a camera for capturing an image to be used in the process from the internal camera and the external camera.

[0010] In the above information processing apparatus, the detection unit detects the face orientation of the person and the line-of-sight direction of the person as the attention direction of the person, and in the camera selection process, the processor may select, based on the positional relationship between the internal camera and the external camera, the face orientation of the person detected by the detection unit, and the line-of-sight direction of the person, a camera for capturing an image to be used in the process from the internal camera and the external camera.

[0011] In the above information processing apparatus, in the camera selection process, the processor may select a camera located at a position closer to the attention direction of the person among the internal camera and the external camera.

[0012] In the above information processing apparatus, in addition to the internal camera and the external camera, the processor has, as selectable options for the user, a virtual camera that selects and switches either the internal camera or the external camera by the camera selection process for capturing an image to be used in the process, and when the virtual camera is selected by the user, the camera selection process may be executed.

[0013] Further, the information processing apparatus according to the second aspect of the present invention includes an internal camera, a connection unit connected to one or more external cameras, a memory that temporarily stores image data of an image captured by the internal camera or the external cameras, a processor that performs processing using the image of the image data stored in the memory by executing an application program, and a detection unit that detects the direction of attention of a person being imaged based on the image captured by the internal camera. The processor causes the display unit to display, as selectable options for the user, a first option to select the internal camera, a second option to select the external camera, and a third option to select either the internal camera or the external camera as the camera for capturing the image used for the processing. When the third option is selected by the user, a camera selection process is performed to select the camera for capturing the image used for the processing from the internal camera and the external cameras based on the positional relationship between the internal camera and the external camera and the direction of attention of the person detected by the detection unit.

[0014] In the above information processing apparatus, the detection unit further detects the direction of attention of the person being imaged based on the image captured by the external camera, and the processor may detect the positional relationship between the internal camera and the external camera based on the direction of attention of the person detected based on the image captured by the internal camera by the detection unit and the direction of attention of the person detected based on the image captured by the external camera.

[0015] In the above information processing apparatus, the processor may detect the positional relationship between the internal camera and the external camera in response to the connection of the external camera.

[0016] In the above information processing apparatus, after the external camera is connected, the processor may detect the positional relationship between the internal camera and the external camera at predetermined time intervals.

[0017] In the information processing apparatus, the external camera is built in an external display device having an external display unit connected to the information processing apparatus, and the processor may detect the positional relationship between the internal camera and the external camera based on setting information of the position of the external display unit with respect to the position of the internal display unit provided in the information processing apparatus.

[0018] In the information processing apparatus, the processor may cause a display unit to display a setting screen on which a user can set the position of the external camera with respect to the position of the internal camera, and detect the positional relationship between the internal camera and the external camera based on the position of the external camera with respect to the position of the internal camera set by an operation of the user on the setting screen.

[0019] Further, a control method in an information processing apparatus including an internal camera, a connection unit that connects to one or more external cameras, a memory that temporarily stores image data of an image captured by the internal camera or the external camera, a processor that performs processing using the image of the image data stored in the memory by executing an application program, and a detection unit that detects a direction of attention of a person being imaged based on an image captured by the internal camera includes: a step in which the processor acquires the direction of attention of the person detected by the detection unit; and a step of selecting, from the internal camera and the external cameras, a camera that captures an image to be used for the processing based on the positional relationship between the internal camera and the external cameras and the direction of attention of the person detected by the detection unit.

[0020] Further, in the information processing apparatus according to the fourth aspect of the present invention, which includes an internal camera, a connection unit that connects to one or more external cameras, a memory that temporarily stores image data of an image captured by the internal camera or the external camera, a processor that performs processing using the image of the image data stored in the memory by executing an application program, and a detection unit that detects the attention direction of a person being imaged based on the image captured by the internal camera, the control method includes: a step in which the processor causes a display unit to display, as selectable options for the user, a first option of selecting the internal camera, a second option of selecting the external camera, and a third option of selecting either the internal camera or the external camera as the camera for capturing the image used in the processing; and a step of selecting, from the internal camera and the external camera, the camera for capturing the image used in the processing based on the positional relationship between the internal camera and the external camera and the attention direction of the person detected by the detection unit when the third option is selected by the user.

Advantages of the Invention

[0021] According to the above aspect of the present invention, it is possible to automatically switch to an appropriate camera among a plurality of cameras.

Brief Description of the Drawings

[0022]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

[0023] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [overview] First, an outline of this embodiment will be described. 1 is a perspective view showing an example of the external configuration of an information processing device according to this embodiment. Here, a notebook PC 1, which is a notebook (clamshell) type PC (Personal Computer), will be described as an example of the information processing device according to this embodiment.

[0024] The notebook PC 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis defined by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is shown as "θ".

[0025] The first housing 10 is also called an A cover or a display housing. The second housing 20 is also called a C cover or a system housing. In the following description, among the side surfaces of the first housing 10 and the second housing 20, the surfaces provided with the hinge mechanism 15 are respectively referred to as side surfaces 10c and 20c. Among the side surfaces of the first housing 10 and the second housing 20, the surfaces opposite to the side surfaces 10c and 20c are respectively referred to as side surfaces 10a and 20a. In the illustration, the direction from the side surface 20a to the side surface 20c is called "rear", and the direction from the side surface 20c to the side surface 20a is called "front". The right side and the left side with respect to the rear are respectively called "right" and "left". The left side surfaces of the first housing 10 and the second housing 20 are respectively referred to as side surfaces 10b and 20b, and the right side surfaces are respectively referred to as side surfaces 10d and 20d. Also, the state where the first housing 10 and the second housing 20 overlap and are completely closed (the state where the opening angle θ = 0°) is called the "closed state". In the closed state, the surfaces of the first housing 10 and the second housing 20 facing each other are respectively called their "inner surfaces", and the surfaces opposite to the inner surfaces are called "outer surfaces". Also, the state where the first housing 10 and the second housing 20 are open with respect to the closed state is called the "open state".

[0026] The appearance of the notebook PC1 shown in FIG. 1 shows an example of the open state. The open state is a state where the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the notebook PC1, and typically it is often used in a state where the opening angle θ is about 100 to 130°. Note that the range of the opening angle θ in the open state can be arbitrarily determined according to the range of the angle that can be rotated by the hinge mechanism 15 and the like.

[0027] On the inner surface of the first housing 10, a display unit 110 is provided. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display, etc. Further, an internal camera 120 as an imaging unit is provided in a region of the inner surface of the first housing 10 around the display unit 110. For example, the internal camera 120 is disposed on the side surface 10a side in the region around the display unit 110. Note that the position where the internal camera 120 is disposed is an example, and other locations may be used as long as it can face the direction facing the display screen of the display unit 110.

[0028] In the open state, the internal camera 120 captures a predetermined imaging range in the direction facing the display screen of the display unit 110 (i.e., the front of the notebook PC 1). The predetermined imaging range is a range of an angle of view determined by an imaging element included in the internal camera 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the internal camera 120 can capture an image including a person (user) existing in front of (the front side) the notebook PC 1.

[0029] Further, a power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct turning on or off the power, transition from the standby state to the normal operation state, transition from the normal operation state to the standby state, etc. The normal operation state is an operation state of the system in which processing can be executed without particular limitation, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0030] The standby state is a state in which at least a part of the system processing is restricted. For example, the standby state is a state in which the system is locked. In the state where the system is locked, a preset image (for example, an image for locking) that prevents the content being processed from being viewed is displayed on the display unit. To unlock, user login authentication is required. Also, the standby state may be a sleep state, a standby state, etc., and may correspond to a modern standby in Windows (registered trademark), an S3 state (sleep state) defined by ACPI, etc. For example, the standby state is a state with lower power consumption than the normal operation state.

[0031] Also, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices for receiving user operation inputs. Note that, as input devices, instead of or in addition to the keyboard 151 and the touch pad 153, a mouse or an external keyboard may be connected, or a touch panel for receiving operations on the display screen of the display unit 110 may be provided.

[0032] The notebook PC 1 detects a person existing in front of the notebook PC 1 based on the captured image captured by the internal camera 120.

[0033] FIG. 2 is a diagram showing an example of the detection range of a person of the notebook PC 1 according to the present embodiment. In the illustrated example, the detection range FoV (Field of View) in front of the notebook PC 1 is the range where a person can be detected. That is, the notebook PC 1 detects a user who exists in front of the notebook PC 1 and is using the notebook PC 1. The detection range FoV corresponds to the imaging angle of view of the images captured by the notebook PC 1. For example, the notebook PC 1 detects a face region in which the user's face is imaged and the orientation of the face (face angle) from the captured image captured by the internal camera 120.

[0034] Next, an example of connecting an external display and an external camera to the above-described notebook PC 1 and using it for a web conference or the like will be described.

[0035] FIG. 3 is a diagram showing an example of the usage environment of the notebook PC 1 according to the present embodiment. The notebook PC 1 is connected to an external display device 5 (display device). The external display device 5 includes a display unit 510 as an external display. For example, the notebook PC 1 and the external display device 5 are connected using an HDMI (registered trademark) cable, a USB (Type-C) cable, a DisplayPort cable, or the like. Note that the notebook PC 1 may be wirelessly connected to the external display device 5.

[0036] In addition, an external camera 520 is provided in the external display device 5 as an external imaging unit. For example, the external camera 520 is attached to the upper end of the external display device 5 and images a predetermined imaging range in the direction facing the display screen of the display unit 510 (external display), that is, in front of the external display. The predetermined imaging range is a range of an angle of view determined by an imaging element included in the external camera 520 and an optical lens provided in front of the imaging surface of the imaging element. That is, the external camera 520 images a user existing in front of the notebook PC 1 in a direction different from that of the internal camera 120 (a direction from the external display device 5 side). The external camera 520 is connected to the notebook PC 1 with a USB cable or the like and outputs image data of the captured image to the notebook PC 1. Note that the external camera 520 may be built in the external display device 5.

[0037] In the example of the usage environment shown in FIG. 3, the external display device 5 and the external camera 520 are located on the left side of the notebook PC 1 and the internal camera 120 as viewed by the user. In such a usage environment, the notebook PC 1 switches between the internal camera 120 and the external camera 520 according to the positional relationship between the internal camera 120 and the external camera 520 and the attention direction of the user in a web conference.

[0038] FIG. 4 is an explanatory diagram of camera switching control by the notebook PC 1 according to the present embodiment. FIG. 4(A) shows an example of an imaging image by the internal camera 120 and an imaging image by the external camera 520 when the user is looking at the direction of the notebook PC 1 in the usage environment of FIG. 3. The face of the user in the imaging image by the internal camera 120 faces forward, and the face of the user in the imaging image by the external camera 520 faces sideways. When the user is looking at the direction of the notebook PC 1, since the face of the user in the imaging image by the internal camera 120 faces forward, the internal camera 120 is used for the Web conference. For example, when the notebook PC 1 is using the external camera 520 in the Web conference and determines that the face of the user in the imaging image by the internal camera 120 faces forward, it switches from the external camera 520 to the internal camera 120.

[0039] FIG. 4(B) shows an example of an imaging image by the internal camera 120 and an imaging image by the external camera 520 when the user is looking at the direction of the external display device 5 in the usage environment of FIG. 3. The face of the user in the imaging image by the internal camera 120 faces sideways, and the face of the user in the imaging image by the external camera 520 faces forward. When the user is looking at the direction of the external display device 5, since the face of the user in the imaging image by the internal camera 120 does not face forward and faces the direction of the external camera 520, the external camera 520 is used for the Web conference. For example, when the notebook PC 1 is using the external camera 520 in the Web conference and determines that the face of the user in the imaging image by the internal camera 120 does not face forward and faces the direction of the external camera 520, it switches from the internal camera 120 to the external camera 520.

[0040] As described above, the notebook PC 1 according to the present embodiment selects a camera for capturing an image to be used for processing such as a Web conference based on the positional relationship between the internal camera 120 and the external camera 520, and the direction of gaze (e.g., the orientation of the face) of the user detected from the captured image captured by the internal camera 120. Hereinafter, the configuration of the notebook PC 1 according to the present embodiment will be described in detail.

[0041] [Hardware Configuration of Information Processing Apparatus] FIG. 5 is a schematic block diagram showing an example of the hardware configuration of the notebook PC 1 according to the present embodiment. In this FIG. 5, the same reference numerals are given to the configurations corresponding to the respective parts in FIG. 1. The notebook PC 1 includes a display unit 110, an internal camera 120, an external connection terminal 130, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an audio system 180, a microphone 181, a speaker 182, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0042] As shown in FIG. 1, the display unit 110 is an internal display incorporated in the notebook PC 1. The display unit 110 displays display data (image) generated based on system processing executed by the main processing unit 300 and processing of an application program operating on the system processing.

[0043] As shown in FIG. 1, the internal camera 120 is an imaging unit provided on the inner surface of the first housing 10. The internal camera 120 captures an image of an object within a predetermined imaging range (angle of view) in the direction (front) facing the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the internal camera 120 includes a visible light camera (RGB camera) that captures images using visible light and an infrared camera (IR camera) that captures images using infrared rays.

[0044] Note that the internal camera 120 may be configured to include either one of the visible light camera and the infrared camera, or may be configured to include both.

[0045] The external connection terminal 130 is a connection terminal for connecting to an external display device 5 and an external camera 520. For example, the external connection terminal 130 includes an HDMI (registered trademark) terminal, a USB Type-C terminal, a DisplayPort, etc., and is connected to the external display device 5 via a cable. Further, the external connection terminal 130 includes a USB Type-A terminal or a USB Type-C terminal, etc., and is connected to the external camera 520 via a cable. Note that the notebook PC 1 and the external display device 5, or the notebook PC 1 and the external camera 520 may be wirelessly connected via the communication unit 160.

[0046] The power button 140 outputs an operation signal to the EC 200 according to a user operation. The input device 150 is an input unit that receives an input from the user, and is configured to include, for example, a keyboard 151 and a touch pad 153. The input device 150 outputs an operation signal indicating the operation content to the EC 200 in response to receiving an operation on the keyboard 151 and the touch pad 153.

[0047] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0048] The storage unit 170 includes storage media such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), and a ROM (Read Only Memory). The storage unit 170 stores various programs such as an OS, a device driver, an application (for example, a web conference application), and other various data acquired by the operation of the program.

[0049] The audio system 180 has a microphone 181 and a speaker 182 connected thereto, and performs recording, playback, and output of audio data. For example, the audio system 180 converts an audio signal of voice picked up by the microphone 181 into digital audio data and transmits it to the main processing unit 300. Also, the audio system 180 converts the audio data transmitted from the main processing unit 300 into an analog audio signal and outputs it as voice from the speaker 182. The microphone 181 and the speaker 182 are used, for example, for picking up the voice uttered by a user (a participant in a web conference) and outputting the voices of other participants in the web conference when a web conference application is being executed.

[0050] The power supply unit 400 supplies power to each part according to the operating state of each part of the notebook PC 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into the voltage required for each part. The power whose voltage has been converted by the DC / DC converter is supplied to each part via each power supply system. For example, the power supply unit 400 supplies power to each part via each power supply system based on a control signal input from the EC 200.

[0051] The EC 200 is a microcomputer configured to include a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and an I / O (Input / Output) logic circuit, etc. The CPU of the EC 200 reads out a control program (firmware) stored in advance in its own ROM and executes the read control program to exhibit its functions. The EC 200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. Also, the EC 200 is connected to the power button 140, the input device 150, the power supply unit 400, etc.

[0052] For example, the EC 200 communicates with the power supply unit 400 to acquire information on the battery status (such as remaining capacity) from the power supply unit 400, and outputs to the power supply unit 400 control signals and the like for controlling the supply of power according to the operating state of each unit of the notebook PC 1. The EC 200 also acquires operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to processing by the main processing unit 300 among the acquired operation signals.

[0053] The face detection unit 210 is configured to include a processor that processes image data of an image captured by the internal camera 120. The face detection unit 210 acquires image data of an image captured by the internal camera 120 and temporarily stores the acquired image data in memory. The memory that stores the image data may be the system memory 304 or a memory (not shown) within the face detection unit 210.

[0054] For example, the face detection unit 210 performs face detection processing to detect a face area (area of a face image) and a face direction (face angle) from the captured image by processing image data of the captured image acquired from the internal camera 120. When the face detection unit 210 detects a face area from the captured image, it outputs face angle information indicating the face angle to the main processing unit 300.

[0055] Here, the face angle will be explained. For example, when the user's face is facing the notebook PC 1 (internal camera 120) (i.e., the user is facing the display unit 110 and the internal camera 120), the internal camera 120 captures an image of the user's front face. The face angle at this time (i.e., the face angle when the user's face is facing forward as seen from the internal camera 120) is set to 0 degrees. For example, as the user turns to the right, the horizontal face angle increases in the positive direction, and as the user turns to the left, the horizontal face angle increases in the negative direction. Furthermore, as the user turns upward, the vertical face angle increases in the positive direction, and as the user turns downward, the vertical face angle increases in the negative direction. Based on these definitions, the face detection unit 210 detects the user's face angle from the image captured by the internal camera 120.

[0056] Note that the face detection unit 210 can also perform face detection processing such as detecting a face region and the orientation (face angle) of the face from the captured image by processing the image data of the captured image captured by the external camera 520.

[0057] The main processing unit 300 includes a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and various application programs can be executed on the OS by system processing based on the OS (Operating System).

[0058] The CPU 301 is a processor that executes processing based on the BIOS program, processing based on the OS program, processing based on application programs operating on the OS, etc. For example, the CPU 301 executes processing such as an application for a web conference. Also, the CPU 301 performs camera switching control to switch between the internal camera 120 and the external camera 520 according to the positional relationship between the internal camera 120 and the external camera 520 and the attention direction of the user in the web conference based on the result of the face detection processing by the above-described face detection unit 210. Details of this camera switching control will be described later.

[0059] The GPU 302 is connected to the display unit 110 (internal display). The GPU 302 executes image processing based on the control of the CPU 301 to generate display data. The GPU 302 outputs the generated display data to the display unit 110 (internal display). Also, when the external display device 5 is connected, the display data generated by the GPU 302 is also output to the external display device 5 (external display) via, for example, the external connection terminal 130.

[0060] The chipset 303 has functions such as a memory controller function and an I / O controller function. For example, the chipset 303 controls the reading and writing of data from the system memory 304 by the CPU 301 and GPU 302, the storage unit 170, etc. Further, the chipset 303 controls the input and output of data from the display unit 110 (internal display), the internal camera 120, the communication unit 160, the audio system 180, and the EC 200. Also, the chipset 303 has a function as a sensor hub. For example, the chipset 303 acquires the face detection result (such as face angle information) obtained from the face detection unit 210 and outputs it to the CPU 301.

[0061] The system memory 304 is used as a loading area for programs executed by the CPU 301 and a working area for writing processing data. Also, the system memory 304 temporarily stores the image data of the captured image captured by the internal camera 120.

[0062] Note that the CPU 301, GPU 302, and chipset 303 may be configured as an integrated single processor, or some or each of them may be configured as individual processors. For example, in the normal operating state, all of the CPU 301, GPU 302, and chipset 303 are operating, but in the standby state, only at least a part of the chipset 303 is operating.

[0063] [Functional Configuration Regarding Camera Switching Control] Next, the configuration in which the notebook PC 1 performs camera switching control will be described in detail. Fig. 6 is a schematic block diagram showing an example of a configuration related to camera switching control according to this embodiment. In Fig. 6, components corresponding to those in Figs. 1 and 5 are assigned the same reference numerals. The camera switching control unit 310, virtual camera 320, face information acquisition unit 330, camera driver 340, and application 350 shown in this figure are functional configurations realized by the execution of each program in the main processing unit 300. The virtual camera 320 functions as a camera that automatically switches between the internal camera 120 and the external camera 520 under the control of the camera switching control unit 310.

[0064] The application 350 is, for example, a Web conference application, and can select the camera that captures an image of a user (participant) in a Web conference from among the internal camera 120, the external camera 520, and the virtual camera 320.

[0065] 7 is a diagram showing an example of a camera selection screen according to the present embodiment. The illustrated video setting screen G1 is an example of a UI (User Interface) for making various settings for the video to be displayed in the application 350. In a camera selection item indicated by reference numeral 11 in this video setting screen G1, it is possible to select a camera that captures images to be used in processing by the application 350. In this camera selection item, auto, internal camera, external camera A, etc. are displayed as camera options that the user can select. The user selects the desired camera by using the touchpad 153 or a mouse to move the cursor CA to an option and confirm (click) it.

[0066] Auto corresponds to the virtual camera 320 described above, and when this option is selected, the camera that captures the image used in the processing of the application 350 is automatically switched to either the internal camera 120 or the external camera 520.

[0067] The internal camera corresponds to the internal camera 120. When this option is selected, the camera that captures the image used for the processing of the application 350 is fixed to the internal camera 120. The image data of the captured image captured by the internal camera 120 is available in the application 350 via the camera driver 340.

[0068] The external camera A corresponds to the external camera 520. When this option is selected, the camera that captures the image used for the processing of the application 350 is fixed to the external camera 520. The image data of the captured image captured by the external camera 520 is available in the application 350 via the camera driver 340.

[0069] In addition, when a plurality of external cameras 520 are connected to the notebook PC 1, not only the external camera A but also options for a plurality of external cameras are displayed. In this figure, "Auto", "Internal Camera", and "External Camera A" are described as options, but this description is for convenience and can actually be any description for identifying the camera.

[0070] Returning to FIG. 6, the control when "Auto" (virtual camera 320) is selected by the user will be described. The camera switching control unit 310 performs a camera selection process of selecting a camera that captures an image used for the processing of the application 350 from the internal camera 120 and the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520 and the user's attention direction.

[0071] For example, the camera switching control unit 310 acquires, via the face information acquisition unit 330, face angle information indicating the direction (face angle) of the user's face detected by the face detection unit 210 as information indicating the user's attention direction. Note that the face angle information of the user acquired by the camera switching control unit 310 is the face angle information of the main user. When a plurality of user face regions are detected by the face detection unit 210, the user whose face region is closest to the center or the user whose face region is the largest is determined as the main user.

[0072] In the camera selection process, the camera switching control unit 310 selects the source of image data to be input to the virtual camera 320 from the image data of the captured image taken by the internal camera 120 and the image data of the captured image taken by the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520 and the direction of the user's face (face angle) detected by the face detection unit 210.

[0073] For example, the camera switching control unit 310 includes a position detection unit 311, a setting unit 312, a switching setting table 313, and a camera switching unit 314. When the external camera 520 is connected to the notebook PC 1, the position detection unit 311 initializes the positional relationship between the internal camera 120 and the external camera 520. For example, when the main processing unit 300 detects that the external camera 520 has been connected via the external connection terminal 130, the position detection unit 311 detects the positional relationship between the internal camera 120 and the external camera 520 in response to the connection of the external camera 520 to the notebook PC 1. Furthermore, after the external camera 520 is connected to the notebook PC 1, the position detection unit 311 may detect the positional relationship between the internal camera 120 and the external camera 520 at predetermined time intervals.

[0074] The positional relationship between the internal camera 120 and the external camera 520 refers to, for example, the position of the external camera 520 relative to the internal camera 120, and includes whether the external camera 520 is on the left or right side relative to the internal camera 120. Alternatively, the positional relationship between the internal camera 120 and the external camera 520 may include whether the external camera 520 is above or below the internal camera 120.

[0075] For example, the position detection unit 311 detects the positional relationship between the internal camera 120 and the external camera 520 based on the difference in the angle of the user's face detected by the face detection unit 210 from the images captured by the internal camera 120 and the external camera 520. In this case, the positional relationship between the internal camera 120 and the external camera 520 may include not only the left-right and top-bottom positional relationship but also information on the difference in position (the difference in the angle of the face from each camera).

[0076] The setting unit 312 sets, in the switching setting table 313, a threshold value of the face angle for switching between the internal camera 120 and the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520 detected by the position detection unit 311 and the face angle of the user.

[0077] In the switching setting table 313, the setting unit 312 sets it so that the camera located at the position closer to the direction of the user's face (attention direction) among the internal camera 120 and the external camera 520 is selected. Specifically, in the switching setting table 313, a threshold value of the face angle corresponding to the internal camera 120 and a threshold value of the face angle corresponding to the external camera 520 are set. For example, in the switching setting table 313, the range of the face angle for selecting the internal camera 120 (the range in which it is determined that the user is paying attention to the direction of the internal camera 120) and the range of the face angle for selecting the external camera 520 (the range in which it is determined that the user is paying attention to the direction of the external camera 520) may be set as the above-mentioned threshold values. Alternatively, the face angle for switching from the internal camera 120 to the external camera 520 and the face angle for switching from the external camera 520 to the internal camera 120 may be set as the above-mentioned threshold values.

[0078] The camera switching unit 314 switches whether to input the image data of the captured image captured by the internal camera 120 into the virtual camera 320 or to input the image data of the captured image captured by the external camera 520 into the virtual camera 320. For example, the camera switching unit 314 acquires the current face angle information of the user detected from the captured image captured by the internal camera 120 via the face information acquisition unit 330, and based on the acquired face angle information and the switching setting table 313, specifically, the camera switching unit 314 inputs the image data from the camera located at the position closer to the direction of the user's face (attention direction) among the internal camera 120 and the external camera 520 into the virtual camera 320.

[0079] When the internal camera 120 side is selected by the camera switch unit 314, the image data of the captured image captured by the internal camera 120 can be used in the application 350 via the camera driver 340. That is, the captured image captured by the internal camera 120 is displayed in the Web conference application.

[0080] On the other hand, when the external camera 520 is selected by the camera switch unit 314, the image data of the captured image captured by the external camera 520 can be used in the application 350 via the camera driver 340. That is, the captured image captured by the external camera 520 is displayed in the Web conference application.

[0081] [Operation of Camera Switching Control Process] Next, with reference to FIG. 8, the operation of the camera switching control process in which the notebook PC 1 switches between the internal camera 120 and the external camera 520 according to the orientation (face angle) of the user's face will be described. FIG. 8 is a flowchart showing an example of the camera switching control process according to the present embodiment.

[0082] (Step S101) The notebook PC 1 determines whether the internal camera 120 is on. If the internal camera 120 is off (NO), the notebook PC 1 ends the process because there is no need to perform the camera switching control process. On the other hand, if the internal camera 120 is on (YES), the notebook PC 1 proceeds to the process of step S103.

[0083] (Step S103) The notebook PC 1 determines whether the camera selection in the application 350 is set to auto (see FIG. 7). If the camera selection is other than auto (for example, the internal camera or the external camera) (NO), the notebook PC 1 ends the process because there is no need to perform the camera switching control process. On the other hand, if the camera selection is set to auto (YES), the notebook PC 1 proceeds to the process of step S105.

[0084] (Step S105) The notebook PC 1 acquires the current face angle of the user (main user) detected from the captured image captured by the internal camera 120. For example, the notebook PC 1 acquires the current face angle information of the user (main user) detected by the processing of the face detection unit 210 from the captured image captured by the internal camera 120. Then, it proceeds to the processing of step S107.

[0085] (Step S107) The notebook PC 1 selects either the internal camera 120 or the external camera 520 based on the face angle information acquired in step S105 and the switching setting table 313. That is, the notebook PC 1 selects either the internal camera 120 or the external camera 520 based on the current face angle of the user and the positional relationship between the internal camera 120 and the external camera 520. Then, it proceeds to the processing of step S109.

[0086] (Step S109) The notebook PC 1 switches the camera that captures the image input to the virtual camera 320 to the camera selected in step S107 from among the internal camera 120 and the external camera 520. Note that if the camera selected in step S107 is the currently selected camera, the notebook PC 1 maintains the currently selected camera as it is.

[0087] [Summary of the Embodiment] As described above, the notebook PC 1 (an example of an information processing device) according to this embodiment includes the internal camera 120, the external connection terminal 130 (an example of a connection unit) that connects to the external camera 520, the system memory 304 (an example of a memory), the main processing unit 300 (an example of a processor), and the face detection unit 210 (an example of a detection unit). For example, the system memory 304 temporarily stores image data of an image captured by the internal camera 120 or the external camera 520. The main processing unit 300 executes the application 350 (an example of an application program) to perform processing using the image data stored in the system memory 304. The face detection unit 210 detects the gaze direction of the user (an example of a person) being captured based on the image captured by the internal camera 120. Then, the main processing unit 300 performs a camera switching control process (an example of a camera selection process) to select a camera from the internal camera 120 and the external camera 520 to capture an image to be used for processing the application 350, based on the positional relationship between the internal camera 120 and the external camera 520 and the user's gaze direction detected by the face detection unit 210.

[0088] As a result, the notebook PC 1 switches between the internal camera 120 and the external camera 520 depending on the user's gaze direction, and can automatically switch to an appropriate camera from among multiple cameras. Furthermore, regardless of whether the internal camera 120 or the external camera 520 is selected, the notebook PC 1 detects the user's gaze direction using the internal camera 120, so there is no need for the external camera 520 to detect the user's gaze direction. Therefore, there is no need for special processing (for example, the above-mentioned camera switching control processing) to be performed on the external camera 520, and a general-purpose camera can be used as the external camera 520.

[0089] In the camera selection process, the main processing unit 300 selects the camera located closer to the user's gaze direction from among the internal camera 120 and the external camera 520.

[0090] As a result, the notebook PC 1 can automatically switch to an appropriate camera among multiple cameras in order to select the camera located closer to the user's line of sight among the internal camera 120 and the external camera 520.

[0091] For example, the face detection unit 210 detects the orientation (e.g., face angle) of the user's face as the user's line of sight. Then, in the above camera selection process, the main processing unit 300 selects a camera for capturing an image to be used in the processing of the application 350 from the internal camera 120 and the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520 and the orientation (e.g., face angle) of the user's face detected by the face detection unit 210.

[0092] As a result, the notebook PC 1 can automatically switch to an appropriate camera among multiple cameras in order to switch between the internal camera 120 and the external camera 520 according to the orientation (e.g., face angle) of the user's face.

[0093] In addition, the main processing unit 300 has a virtual camera 320 that selects and switches either the internal camera 120 or the external camera 520 by the above camera selection process as an option that can be selected by the user for the camera that captures an image to be used in the processing of the application 350, in addition to the internal camera 120 and the external camera 520. Then, when the virtual camera 320 is selected by the user (e.g., when Auto shown in FIG. 7 is selected), the main processing unit 300 executes the above camera selection process.

[0094] As a result, the notebook PC 1 can perform control to automatically switch between the internal camera 120 and the external camera 520 simply by the user selecting a specific option (e.g., Auto) in the existing camera selection UI, and thus can automatically switch to an appropriate camera among multiple cameras without performing complicated operations or special operations.

[0095] In addition, the notebook PC 1 (an example of an information processing apparatus) according to the present embodiment includes an internal camera 120, an external connection terminal 130 (an example of a connection portion) that connects to an external camera 520, a system memory 304 (an example of a memory), a main processing unit 300 (an example of a processor), and a face detection unit 210 (an example of a detection unit). For example, the system memory 304 temporarily stores image data of an image captured by the internal camera 120 or the external camera 520. The main processing unit 300 performs processing using the image of the image data stored in the system memory 304 by executing an application 350 (an example of an application program). The face detection unit 210 detects the attention direction of the person being imaged based on the image captured by the internal camera 120. Further, the main processing unit 300 provides, as selectable options for the user to select the camera for capturing the image used in the processing of the application 350, an "Internal Camera" (an example of a first option) for selecting the internal camera 120, an "External Camera A" (an example of a second option) for selecting the external camera 520, and an "Auto" (an example of a third option) for selecting either the internal camera 120 or the external camera 520, and displays them on the display unit 110 (or the display unit 510 of the external display device 5) (see FIG. 7). Then, when "Auto" is selected by the user, the main processing unit 300 performs a camera selection process of selecting the camera for capturing the image used in the application 350 processing from the internal camera 120 and the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520 and the attention direction of the user detected by the face detection unit 210.

[0096] As a result, when the user selects a specific option (e.g., auto) in the same way as when selecting the internal camera 120 or the external camera 520, the notebook PC 1 can perform control to automatically switch between the internal camera 120 and the external camera 520. Thus, the user can automatically switch to an appropriate camera among multiple cameras without performing complicated or special operations. Further, regardless of whether the internal camera 120 or the external camera 520 is selected, the notebook PC 1 detects the user's line of sight using the internal camera 120, so there is no need to detect the user's line of sight on the external camera 520 side. Therefore, there is no need to perform special processing (e.g., the above-described camera switching control processing) on the external camera 520 side, and a general-purpose camera can be applied as the external camera 520.

[0097] Also, the face detection unit 210 further detects the user's line of sight in the image captured by the external camera 520. Then, the main processing unit 300 detects the positional relationship between the internal camera 120 and the external camera 520 based on the user's line of sight detected based on the image captured by the internal camera 120 by the face detection unit 210 and the user's line of sight detected based on the image captured by the external camera 520.

[0098] As a result, the notebook PC 1 can detect the positional relationship between the internal camera 120 and the external camera 520 and switch to an appropriate camera according to the user's line of sight.

[0099] For example, the main processing unit 300 detects the positional relationship between the internal camera 120 and the external camera 520 in response to the connection of the external camera 520.

[0100] As a result, the notebook PC 1 can detect the positional relationship between the internal camera 120 and the external camera 520 at the timing when the external camera 520 is connected.

[0101] Further, after the external camera 520 is connected, the main processing unit 300 may detect the positional relationship between the internal camera 120 and the external camera 520 at predetermined time intervals (for example, at 30-minute intervals).

[0102] As a result, even if the positional relationship between the internal camera 120 and the external camera 520 changes after the external camera 520 is connected, the notebook PC 1 can update to the changed positional relationship and can switch to an appropriate camera according to the user's attention direction.

[0103] Further, the main processing unit 300 may cause the display unit 110 to display a setting screen on which the user can set the position of the external camera 520 relative to the position of the internal camera 120. The main processing unit 300 may detect the positional relationship between the internal camera 120 and the external camera 520 based on the position of the external camera 520 relative to the position of the internal camera 120 set by the user's operation on this setting screen.

[0104] FIG. 9 is a diagram showing an example of a camera position setting screen according to the present embodiment. The camera position setting screen G2 shown in this figure is displayed as a UI for the user to set the position of the external camera 520 relative to the position of the internal camera 120. The center of the camera position setting screen G2 corresponds to the position of the internal camera 120, and the positions to the left, right, up, and down relative to the center are options for the position of the external camera 520. The main processing unit 300 sets the position of the external camera 520 by performing an operation of moving the cursor CA to any of the positions to the left, right, up, and down and determining (clicking) using the touch pad 153 or a mouse or the like by the user. In the example shown in FIG. 9, “left” is selected as the position of the external camera 520, which indicates an operation of setting the position of the external camera 520 to the left according to the usage environment of FIG. 3.

[0105] As a result, since the notebook PC 1 can set the positional relationship between the internal camera 120 and the external camera 520 by a simple operation by the user, it can automatically switch to an appropriate camera among a plurality of cameras without performing complicated processing.

[0106] In the example shown in FIG. 9, a configuration has been described in which the position for setting the position of the external camera 520 can be selected from the positions in four directions: left, right, up, and down with respect to the position of the internal camera 120. However, the present invention is not limited to this. For example, the position of the external camera 520 may be configured to be selectable from the positions in two directions: left and right, or may be configured to be selectable from the positions in two directions: up and down. Further, the position of the external camera 520 may be configured to be selectable from positions more than four directions, such as adding upper left, lower left, upper right, and lower right to the four directions of left, right, up, and down. Further, in addition to the direction, a configuration may be adopted in which the distance from the internal camera 120 can be selected (for example, selected from less than 30 cm, 30 cm or more and less than 50 cm, 50 cm or more and less than 1 m, and 1 m or more).

[0107] Note that the external camera 520 may be incorporated in an external display device 5 (an example of an external display device) having an external display unit 510 connected to the notebook PC 1. In this case, the main processing unit 300 may detect the positional relationship between the internal camera 120 and the external camera 520 based on the setting information of the position of the external display unit 510 with respect to the position of the internal display unit 110 provided in the notebook PC 1. For example, the main processing unit 300 refers to the display arrangement information at the time of multi-display in the display settings of the OS (Operating System) as the setting information of the position of the external display unit 510 with respect to the position of the internal display unit 110.

[0108] Thereby, when the external camera 520 is incorporated in the external display device 5, the notebook PC 1 uses the arrangement information of the external display to detect the positional relationship between the internal camera 120 and the external camera 520. Therefore, the notebook PC 1 can automatically switch to an appropriate camera among a plurality of cameras without the user performing complicated operations or special operations.

[0109] In addition, in the notebook PC 1 according to the present embodiment, an internal camera 120, an external connection terminal 130 (an example of a connection part) that connects to an external camera 520, a system memory 304 (an example of a memory) that temporarily stores image data of an image captured by the internal camera 120 or the external camera 520, and an application 350 (an example of an application program), a main processing unit 300 (an example of a processor) that performs processing using the image of the image data stored in the system memory 304 by executing the application 350, and a face detection unit 210 (an example of a detection unit) that detects the attention direction of the user (an example of a person) being imaged based on the image captured by the internal camera 120. The control method in the notebook PC 1 includes a step in which the main processing unit 300 acquires the attention direction of the user (an example of a person) detected by the face detection unit 210, and based on the positional relationship between the internal camera 120 and the external camera 520 and the attention direction of the user detected by the face detection unit 210, selects a camera for capturing an image to be used for the processing of the application 350 from the internal camera 120 and the external camera 520.

[0110] As a result, in the control method of the notebook PC 1, since the internal camera 120 and the external camera 520 are switched according to the attention direction of the user, it is possible to automatically switch to an appropriate camera among a plurality of cameras. Further, in the control method of the notebook PC 1, regardless of which of the internal camera 120 and the external camera 520 is selected, since the attention direction of the user is detected using the internal camera 120, it is not necessary to detect the attention direction of the user on the external camera 520 side. Therefore, it is not necessary to perform special processing (for example, the above camera switching control processing) on the external camera 520 side, and a general-purpose camera can be applied as the external camera 520.

[0111] Also, in the notebook PC 1 according to this embodiment, an internal camera 120, an external connection terminal 130 (an example of a connection part) that connects to an external camera 520, a system memory 304 (an example of a memory) that temporarily stores image data of an image captured by the internal camera 120 or the external camera 520, and a main processing unit 300 (an example of a processor) that performs processing using the image of the image data stored in the system memory 304 by executing an application 350 (an example of an application program), and a face detection unit 210 (an example of a detection unit) that detects the attention direction of the user (an example of a person) being imaged based on the image captured by the internal camera 120. The control method includes a step in which the main processing unit 300 causes the display unit 110 (or the display unit 510 of the external display device 5) to display "Internal Camera" (an example of a first option) for selecting the internal camera 120, "External Camera A" (an example of a second option) for selecting the external camera 520, and "Auto" (an example of a third option) for selecting either the internal camera 120 or the external camera 520 as options that the user can select for the camera that captures the image used for the processing of the application 350 (see FIG. 7), and a step of selecting, from the internal camera 120 and the external camera 520, the camera that captures the image used for the application 350 processing based on the positional relationship between the internal camera 120 and the external camera 520 and the attention direction of the user detected by the face detection unit 210 when "Auto" is selected by the user.

[0112] As a result, the control method in the notebook PC 1 automatically switches between the internal camera 120 and the external camera 520 just by the user selecting a specific option (e.g., auto) in the same way as the operation when selecting the internal camera 120 or the external camera 520. Therefore, the appropriate camera among multiple cameras can be automatically switched without the user performing complicated or special operations. Also, regardless of whether the internal camera 120 or the external camera 520 is selected, the control method in the notebook PC 1 detects the user's attention direction using the internal camera 120, so there is no need to detect the user's attention direction on the external camera 520 side. Thus, there is no need to perform special processing (e.g., the above camera switching control processing) on the external camera 520 side, and a general-purpose camera can be applied as the external camera 520.

[0113] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments, and designs and the like within the scope not departing from the gist of the present invention are also included. For example, the respective configurations described in the above embodiments can be arbitrarily combined.

[0114] Note that the face detection unit 210 may detect the user's line-of-sight direction as the user's attention direction. Then, in the above camera selection process, the main processing unit 300 may select, from the internal camera 120 and the external camera 520, the camera for capturing an image to be used for the processing of the application 350 based on the positional relationship between the internal camera 120 and the external camera 520 and the user's line-of-sight direction detected by the face detection unit 210.

[0115] As a result, since the notebook PC 1 switches between the internal camera 120 and the external camera 520 according to the user's line-of-sight direction, the appropriate camera among multiple cameras can be automatically switched.

[0116] In addition, the face detection unit 210 may detect the orientation of the user's face (e.g., face angle) and the user's line of sight direction as the user's attention direction. Then, in the above camera selection process, the main processing unit 300 may select a camera for capturing an image to be used in the processing of the application 350 from the internal camera 120 and the external camera 520 based on the positional relationship between the internal camera 120 and the external camera 520, the orientation of the user's face (e.g., face angle) detected by the face detection unit 210, and the user's line of sight direction.

[0117] Thereby, since the notebook PC 1 switches between the internal camera 120 and the external camera 520 according to the orientation of the user's face (e.g., face angle) and the user's line of sight direction, it can automatically switch to an appropriate camera among a plurality of cameras.

[0118] Here, in a usage environment (see FIG. 3) where the user is conducting a Web conference or the like in front of two displays (an internal display and an external display), when the user looks at another display from the currently focused display, if it is a short time (instantaneous), it is often the case that only the line of sight is changed to the other display. On the other hand, when the user looks at another display carefully, it is conceivable that the face orientation is changed to the other display.

[0119] Therefore, when the notebook PC 1 switches between the internal camera 120 and the external camera 520 according to the orientation of the user's face (e.g., face angle), it can suppress the situation of switching the camera more than necessary following the change when the user's attention direction changes in a short time (instantaneous).

[0120] On the other hand, when the notebook PC 1 is for an application where it is desired to quickly switch the camera following the change when the user's attention direction changes in a short time (instantaneous), it can be realized by switching between the internal camera 120 and the external camera 520 according to the user's line of sight direction. Further, when the notebook PC 1 switches the internal camera 120 and the external camera 520 according to both the orientation of the user's face (e.g., face angle) and the direction of the user's line of sight, it can also switch between the control using the face orientation (e.g., face angle) and the control using the line of sight direction to the appropriate control according to the application, conditions, etc.

[0121] Also, in the above embodiment, a configuration example in which one external camera 520 is connected to the notebook PC 1 has been described, but a plurality of external cameras 520 may be connected. For example, the notebook PC 1 is based on the positional relationship between the internal camera 120 and the plurality of external cameras 520, and the direction of the user's attention detected from the captured image captured by the internal camera 120. Among the internal camera 120 and the plurality of external cameras 520, the camera located closest to the direction of the user's attention may be selected as the camera that captures the image used for the processing of the application 350.

[0122] Also, in the above embodiment, an example of switching between the internal camera 120 and the external camera 520 using the virtual camera 320 has been described, but the virtual camera 320 may not be used. For example, a configuration may be adopted in which the path through which image data is directly input from the internal camera 120 to the camera driver 340 and the path through which image data is directly input from the external camera 520 to the camera driver 340 are switched without using the virtual camera 320.

[0123] Further, the CPU 301 and the chipset 303 may be configured as individual processors, or may be integrated as one processor.

[0124] Further, in the above embodiment, an example in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303 has been shown. However, part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as individual processors, or may be integrated and configured as one processor. Also, part or all of the face detection unit 210 may be provided in the EC200.

[0125] Also, the above-described standby state may include a hibernation state, a power-off state, or the like. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Note that among the standby states, the standby state, the sleep state, the hibernation state, the power-off state, etc. are states in which the power consumption is lower than that in the normal operation state (a state in which power consumption is suppressed).

[0126] Incidentally, the above-described notebook PC1 has a computer system inside. Then, a program for realizing the functions of each configuration provided in the above-described notebook PC1 is recorded on a computer-readable recording medium, and the program recorded on this recording medium is read into the computer system and executed to perform the processing in each configuration provided in the above-described notebook PC1. Here, "reading the program recorded on the recording medium into the computer system and executing it" includes installing the program in the computer system. The "computer system" as used herein shall include hardware such as an OS and peripheral devices. Further, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, or dedicated line. Also, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, magneto-optical disk, ROM, CD-ROM, or a storage device such as a hard disk inside the computer system. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0127] Further, the recording medium also includes an internal or external recording medium provided so as to be accessible from a distribution server for distributing the program. Note that the program may be divided into a plurality of parts, downloaded at different timings, and then combined in each configuration provided in the notebook PC1, or the distribution servers for distributing the divided programs may be different. Furthermore, the "computer-readable recording medium" also includes a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network and holds the program for a certain period of time. Also, the above program may be for realizing a part of the above-described functions. Further, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

[0128] Furthermore, some or all of the functions of the notebook PC 1 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

[0129] Furthermore, the notebook PC 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC. [Explanation of symbols]

[0130] 1 Notebook PC, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit (internal display), 120 Internal camera (imaging unit), 130 External connection terminal, 140 Power button, 150 Input device, 151 Keyboard, 153 Touchpad, 160 Communication unit, 170 Memory unit, 180 Audio system, 181 Microphone, 182 Speaker, 200 EC, 210 Face detection unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 Camera switching control unit, 311 Position detection unit, 312 Setting unit, 313 Switching setting table, 314 Camera switching unit, 320 Virtual camera, 330 Face information acquisition unit, 340 Camera driver, 350 Application, 400 Power supply unit, 5 External display device, 510 Display unit (external display), 520 external camera

Claims

1. An internal camera, a connection unit for connecting to one or more external cameras, a memory for temporarily storing image data of an image captured by the internal camera or the external camera, a processor that performs processing using the image of the image data stored in the memory by executing an application program, a detection unit that detects the attention direction of a person being imaged based on an image captured by the internal camera, comprising: The processor, performs a camera selection process of selecting a camera that captures an image to be used for the processing from the internal camera and the external camera based on the positional relationship between the internal camera and the external camera and the attention direction of the person detected by the detection unit. An information processing apparatus.

2. The detection unit, detects the orientation of the person's face as the attention direction of the person, The processor, in the camera selection process, selects a camera that captures an image to be used for the processing from the internal camera and the external camera based on the positional relationship between the internal camera and the external camera and the orientation of the person's face detected by the detection unit. The information processing apparatus according to claim 1.

3. The detection unit, detects the line-of-sight direction of the person as the attention direction of the person, The processor, in the camera selection process, selects a camera that captures an image to be used for the processing from the internal camera and the external camera based on the positional relationship between the internal camera and the external camera and the line-of-sight direction of the person detected by the detection unit. The information processing apparatus according to claim 1.

4. The detection unit, detects the orientation of the person's face and the line-of-sight direction of the person as the attention direction of the person, The processor, in the camera selection process, selects a camera that captures an image to be used for the processing from the internal camera and the external camera based on the positional relationship between the internal camera and the external camera and the orientation of the person's face and the line-of-sight direction of the person detected by the detection unit. The information processing apparatus according to claim 1.

5. The processor, in the camera selection process, selects a camera located at a position closer to the attention direction of the person among the internal camera and the external camera. The information processing apparatus according to claim 1.

6. The processor, In addition to the internal camera and the external camera, a virtual camera that allows the user to select as an option the camera for capturing the image used in the processing, and that selects and switches either the internal camera or the external camera by the camera selection process, When the virtual camera is selected by the user, the camera selection process is executed. The information processing apparatus according to claim 1.

7. An internal camera, A connection unit that connects to one or more external cameras, A memory that temporarily stores image data of an image captured by the internal camera or the external camera, A processor that performs processing using the image of the image data stored in the memory by executing an application program, A detection unit that detects the attention direction of the person being imaged based on the image captured by the internal camera, Comprising The processor As options for the user to select the camera for capturing the image used in the processing, displays on the display unit a first option of selecting the internal camera, a second option of selecting the external camera, and a third option of selecting either the internal camera or the external camera, When the third option is selected by the user, a camera selection process is performed to select the camera for capturing the image used in the processing from the internal camera and the external camera based on the positional relationship between the internal camera and the external camera and the attention direction of the person detected by the detection unit. Information processing apparatus.

8. The detection unit Further detects the attention direction of the person being imaged based on the image captured by the external camera, The processor Detects the positional relationship between the internal camera and the external camera based on the attention direction of the person detected based on the image captured by the internal camera by the detection unit and the attention direction of the person detected based on the image captured by the external camera. The information processing apparatus according to claim 1 or claim 7.

9. The processor Detects the positional relationship between the internal camera and the external camera in response to the connection of the external camera. The information processing apparatus according to claim 8.

10. The processor After the external camera is connected, detects the positional relationship between the internal camera and the external camera at a predetermined time interval. The information processing apparatus according to claim 9.

11. The external camera is built into an external display device having an external display unit connected to the information processing apparatus, The processor, detects the positional relationship between the internal camera and the external camera based on setting information of the position of the external display unit with respect to the position of the internal display unit included in the information processing apparatus. The information processing apparatus according to claim 1 or claim 7.

12. The processor, causes a display unit to display a setting screen on which a user can set the position of the external camera with respect to the position of the internal camera, and detects the positional relationship between the internal camera and the external camera based on the position of the external camera with respect to the position of the internal camera set by a user operation on the setting screen. The information processing apparatus according to claim 1 or claim 7.

13. A control method in an information processing apparatus including: an internal camera; a connection unit that connects to one or more external cameras; a memory that temporarily stores image data of an image captured by the internal camera or the external camera; a processor that performs processing using the image of the image data stored in the memory by executing an application program; and a detection unit that detects a direction of attention of a person being imaged based on an image captured by the internal camera, the method comprising: The processor, acquiring the direction of attention of the person detected by the detection unit; selecting, based on the positional relationship between the internal camera and the external camera and the direction of attention of the person detected by the detection unit, a camera that captures an image to be used for the processing from the internal camera and the external camera; A control method including the above.

14. A control method in an information processing apparatus including: an internal camera; a connection unit that connects to one or more external cameras; a memory that temporarily stores image data of an image captured by the internal camera or the external camera; a processor that performs processing using the image of the image data stored in the memory by executing an application program; and a detection unit that detects a direction of attention of a person being imaged based on an image captured by the internal camera, the method comprising: The processor, A step of causing a display unit to display, as selectable options for the user, a first option of selecting the internal camera, a second option of selecting the external camera, and a third option of selecting either the internal camera or the external camera, as the camera for imaging the image used in the processing; When the third option is selected by the user, a step of selecting, as the camera for imaging the image used in the processing, from the internal camera and the external camera, based on the positional relationship between the internal camera and the external camera and the direction of attention of the person detected by the detection unit; A control method including the above.

Images