Information processing device, video providing method, and computer program

Abstract

The present invention switches and provides video in accordance with a condition when providing video captured by an imaging device to an application program. This information processing device includes a display device and a computing circuit, and is connected to a plurality of imaging devices. The computing circuit can provide a video selected from videos captured by the plurality of imaging devices to a predetermined application. The computing circuit acquires videos captured by the plurality of imaging devices, selects a video corresponding to a condition from the videos captured by the plurality of imaging devices, and provides the video to the application.

Description

Information processing device, video providing method, and computer program

[0001] The present disclosure relates to an information processing device, a video providing method, and a computer program. More specifically, the information processing device, the video providing method, and the computer program of the present disclosure switch video captured by a video capture device to an application program according to a condition.

[0002] Multiple cameras may be connected to an information processing device. Furthermore, among the images captured by the multiple cameras, only the image captured by one camera may be used. For example, when a web conference is held, the information processing device of each participant may capture an image of the participant with a camera and transmit and receive the captured image to and from the other participants using a web conference application program. Each information processing device can display the received image on a display. Each participant can proceed with the conference while checking the status of the other participants through the image displayed on their own display.

[0003] Participants can select and use either a camera built into an information processing device such as a laptop computer or an external camera connected to the information processing device. Furthermore, the number of external cameras that can be connected to the information processing device is not limited. In this case, the information processing device can transmit video captured by a camera set for transmission among multiple cameras that capture video to other users' information processing devices. Participants may also set a camera to capture video for transmission during a web conference (see, for example, Patent Document 1).

[0004] Japanese Patent Application Laid-Open No. 2020-17995

[0005] However, the process of setting up a camera using an application program or the like is complicated. Furthermore, after the camera is configured, it may not be optimal for transmission. Furthermore, the video captured by the camera itself may not be appropriate for a web conference. However, the process of setting up a camera that captures video for transmission and the process of switching the video to be transmitted are complicated. Therefore, it is difficult to immediately switch the video to be transmitted to an appropriate video.

[0006] The present disclosure relates to an information processing device, an image providing method, and a computer program that can provide images according to conditions when providing images captured by an imaging device to a computer program without requiring complex operations by the user.

[0007] The information processing device disclosed herein includes a display device, an arithmetic circuit connectable to a plurality of image capture devices, and a storage device storing a first application and a second application executed by the arithmetic circuit. The first application has a function of displaying an input image on the display device. The second application acquires images captured by the plurality of image capture devices and provides a first image among the images captured by the plurality of image capture devices to the first application as an input image. When a switching event occurs, the input image is switched from the first image to the second image.

[0008] Such general and specific aspects may be realized by a system, a method, and a computer program, as well as a combination thereof.

[0009] The information processing device, information providing method, and computer program disclosed herein can provide images according to conditions without requiring complicated operations by the user when providing images captured by an imaging device to an application program.

[0010] 2B is a block diagram showing a configuration of a web conference system according to the present disclosure; FIG. 2C is a diagram showing an example of a camera selection screen; FIG. 2D is a diagram showing another example of a camera selection screen; FIG. 2E is a diagram showing an example of switching the camera selection screen of FIG. 2B; FIG. 2F is a diagram showing an example of a notification displayed in switching process 1; FIG. 2G is a diagram showing an example of a notification displayed in switching process 2; FIG. 2H is a diagram showing a sequence diagram showing an example of processing executed in a web conference system; FIG. 2I is a flowchart showing an example of processing executed in a first user terminal; FIG. 2J is a flowchart showing an example of switching process 1; FIG. 2J is a flowchart showing an example of switching process 2; FIG. 2J is a flowchart showing an example of processing for determining a switching condition; FIG. 2I is a block diagram showing a configuration of a web conference system according to a fourth embodiment; FIG. 2J is a flowchart showing an example of processing executed in a first user terminal;

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings as appropriate. However, in the detailed description, unnecessary parts of the description of the prior art and substantially identical configurations may be omitted. This is for the sake of simplicity. Furthermore, the following description and the accompanying drawings are disclosed to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter of the claims.

[0012] The present disclosure provides an information processing device, a video providing method, and a computer program that enable the provision of video according to conditions when video captured by one or more cameras is provided from an information processing device to another information processing device. In the following, an example will be described in which the information processing device is an information processing device such as a laptop computer used by a user who is a participant in a web conference.

[0013] Conditions used to switch the video to be provided may include, for example, input of a switching operation signal by a user, a change in brightness of the video captured by the camera, occurrence of vibration in the camera, or movement of a person captured by the camera. For example, when a switching operation signal is input by a user, the information processing device may provide video captured by the camera selected by the operation signal. Furthermore, for example, when shaking occurs in the video, the information processing device may provide video captured by another camera. Shaking in the video occurs when movement of the camera itself causes a significant change in the captured video, or when continuous vibration occurs. Furthermore, for example, when a person captured by the camera disappears from the video being provided, or when the person's gaze turns in another direction, the information processing device may provide a predetermined video.

[0014] [First Embodiment: Camera Switching] <Configuration of Display System> Fig. 1 shows an example of a web conference system 1 according to the first embodiment. As shown in Fig. 1, the web conference system 1 includes user terminals 10 (10A to 10C) of multiple users participating in a web conference. Each of the user terminals 10A to 10C is connected via a network 30 so as to be able to communicate data. In the example shown in Fig. 1, the web conference system 1 includes three user terminals: a first user terminal 10A, a second user terminal 10B, and a third user terminal 10C. However, the number of user terminals that can participate in a web conference is not limited.

[0015] 1, the first user terminal 10A is an information processing device including an arithmetic circuit 11, an input device 12, a display device 13, a built-in camera 14, a storage device 15, a microphone 16, a speaker 17, and a communication circuit 18. For example, the user terminal 10A may be a notebook computer.

[0016] The arithmetic circuit 11 is a controller that controls the entire first user terminal 10A. For example, the arithmetic circuit 11 performs various processes related to a web conference by reading and executing a web conference application 151 stored in the storage device 15. The arithmetic circuit 11 also performs various processes related to switching the video to be provided by reading and executing a switching application 152 stored in the storage device 15. The arithmetic circuit 11 may be various processors such as a CPU, an MPU, a GPU, an FPGA, a DSP, an ASIC, or a dedicated hardware circuit.

[0017] The input device 12 is used for user operations and data input, and may be, for example, an operation button, a keyboard, a mouse, a touch panel, etc. The display device 13 may be a display.

[0018] The built-in camera 14 is built into the first user terminal 10 A. The built-in camera 14 can, for example, capture an image of the user using the first user terminal 10 A.

[0019] The microphone 16 can pick up sounds around the first user terminal 10A. The speaker 17 can output sounds received from, for example, an external device. A user can use the microphone 16 and the speaker 17 to pick up and output sounds and hold a conversation with other users participating in the web conference. The microphone 16 and the speaker 17 may be built into the first user terminal 10A. Alternatively, the microphone 16 and the speaker 17 may be externally attached.

[0020] The storage device 15 is a recording medium for recording various information. The storage device 15 is realized by, for example, a RAM, a ROM, a flash memory, a solid-state drive (SSD), a hard disk drive, or other storage devices, or an appropriate combination thereof. The storage device 15 can store, for example, a web conference application 151, a switching application 152, and captured video 153.

[0021] The communication circuit 18 performs data communication with other devices such as the other user terminals 10B and 10C. The data communication may be performed wired and / or wirelessly, following known communication standards, for example. For example, wired data communication may be performed by using a semiconductor integrated circuit communication controller operating in accordance with the Ethernet (registered trademark) standard and / or the USB (registered trademark) standard as the communication circuit 18. Wireless data communication may be performed by using a semiconductor integrated circuit communication controller operating in accordance with the IEEE 802.11 standard for wireless local area networks (LANs) and / or the fourth-, fifth-, and sixth-generation mobile communication systems, known as 4G, 5G, and 6G, for mobile communications, as the communication circuit 18.

[0022] The first user terminal 10A is also connected to external cameras 20A and 20B. In the following example, the external cameras 20A and 20B are described as being fixedly installed at locations where users participate in web conferences. The number of external cameras 20A and 20B connected to the first user terminal 10A is not limited. For example, the number of external cameras 20A and 20B connected to the first user terminal 10A can be changed by plugging and unplugging a connection cable.

[0023] In the following description, the video captured by the built-in camera 14 will be referred to as a first video, and the video captured by the external cameras 20A and 20B will be referred to as a second video, as necessary.

[0024] The web conference application 151 has a function of displaying input video on the display device 13. The web conference application 151 is an application that enables the first user terminal 10A to hold a web conference with the other user terminals 10B and 10C. The web conference application 151 also has a function of transmitting input video through a communication circuit. Specifically, the web conference application 151 transmits video captured by the built-in camera 14 or the external cameras 20A and 20B and sound picked up by the microphone, which is the input device 12, to the other user terminals 10B and 10C via the network 30. The web conference application 151 also displays video received from the other user terminals 10B and 10C via the network 30 on the display device 13. Furthermore, the web conference application 151 outputs sound received from the other user terminals 10B and 10C via the network 30 to the speaker, which is the display device 13. This allows the user of the first user terminal 10A to hold a web conference with users of the other user terminals 10B and 10C. For example, the web conference application 151 may be an application such as Microsoft Teams (registered trademark), Zoom (registered trademark), Google Meet (registered trademark), or Skype (registered trademark).

[0025] When the Web conference application 151 is executed, the switching application 152 switches the video to be transmitted from the first user terminal 10A to the other user terminals 10B and 10C according to conditions. Specifically, the switching application 152 acquires video captured by the multiple cameras 14, 20A, and 20B. The switching application 152 also provides the Web conference application 151 with a first video among the videos captured by the multiple cameras 14, 20A, and 20B as input video. Furthermore, when a switching event occurs, the switching application 152 switches the input video from the first video to the second video. For example, by switching the video provided by the first user terminal 10A to the switching application 152, the video to be transmitted to the other user terminals 10 and 10C can be switched.

[0026] The switching app 152 may be started, for example, in response to an operation via the input device 12. Alternatively, the switching app 152 may be started simultaneously with the start-up of the first user terminal 10A. Alternatively, the switching app 152 may be started simultaneously with the start-up of the web conference app 151.

[0027] The captured video 153 is an image captured by the built-in camera 14 and the external cameras 20A and 20B.

[0028] The configurations of the second user terminal 10B and the third user terminal 10C are the same as the configuration of the first user terminal 10A described above, and therefore will not be described here. In the following, the processing will be described as being executed in the first user terminal 10.

[0029] <Operation of Switching App> When a web conference is started according to the web conference application 151, the arithmetic circuit 11 switches the input video to be provided to the web conference application 151 from the first video to the second video in response to a switching event by executing the switching application 152. The second video is a video captured by one of the multiple cameras 14, 20A, and 20B that is different from the camera that captured the first video.

[0030] Priorities may be set in advance for the built-in camera 14 and the external cameras 20A and 20B. For example, the camera that captured the second video may be ranked lower than the camera that captured the first video. When a web conference is started and the first user terminal 10A transmits video to the other user terminals 10B and 10C, the arithmetic circuit 11 may transmit video from a camera with a higher priority. Furthermore, the switching application 152 switches the video to be provided to the other user terminals 10B and 10C depending on conditions. Conditions used to determine a switching event may include, for example, the following (Condition 1) and (Condition 2).

[0031] (Condition 1) Receipt of a switching operation signal When a switching operation signal is received, the arithmetic circuit 11 switches so as to provide the video of the camera selected by the operation signal to the other user terminals 10B and 10C.

[0032] FIG. 2A shows an example of a switching operation screen 400a. The switching operation screen 400a shown in FIG. 2A includes information 401a to 401c associated with cameras that capture images received by the first user terminal 10A. The arithmetic circuit 11 outputs the switching operation screen 400a to the display device 13. When information 401a to 401c associated with one of the cameras is selected via the input device 12, the arithmetic circuit 11 accepts this as a switching operation signal. The user operates a cursor 402 on the switching operation screen 400a to accept the selection of one of the pieces of information. FIG. 2A shows an example in which a "USB 2.0 Camera" camera is selected. In the example shown in FIG. 2A, the information 401a to 401c associated with the cameras is the identification information of the cameras. However, the information 401a to 401c associated with the cameras is not limited to the identification information of the cameras. For example, the information 401a to 401c associated with the camera may be various types of video, such as a moving image, a still image, a flip-through video made up of multiple moving images, etc. Figures 2B and 2C show an example in which the information 401a to 401c associated with the camera is video.

[0033] FIG. 2B is an example of a switching operation screen 400b that includes video captured by a camera as information 401a-401c associated with the camera. In FIG. 2B, video captured by a "USB 2.0 Camera" camera is selected. In addition to the information 401a-401c associated with the camera, the switching operation screen 400b in FIG. 2B also includes an update button 403 and a portrait / landscape switch button 404. The update button 403 is used when a new external camera is connected or when a connected external camera is removed or turned off. Pressing the update button 403 can update the information 401a-401c associated with the camera displayed on the switching operation screen 400b.

[0034] The vertical / horizontal switch button 404 switches between the vertical and horizontal orientations of the switching operation screen 400b. In the example of the switching operation screen 400b shown in Fig. 2B, the information 401a to 401c associated with the cameras is arranged horizontally. When the vertical / horizontal switch button 404 is pressed in the state of the switching operation screen 400b of Fig. 2B, the screen is switched to the switching operation screen 400c of Fig. 2C. In the example of the switching operation screen 400c shown in Fig. 2C, the information 401a to 401c associated with the cameras is arranged vertically.

[0035] (Condition 2) Occurrence of Shaky Images Shaky images can be unpleasant for users viewing the images. Therefore, when shaking is detected in the images captured by the built-in camera 14 while the images from the built-in camera 14 are being provided to the other user terminals 10B and 10C, the arithmetic circuit 11 determines that a switching event has occurred, causing the images from the external cameras 20A and 20B to be provided to the other user terminals 10B and 10C. When the external cameras 20A and 20B are used, a priority is set in advance for the external cameras 20A and 20B. The arithmetic circuit 11 switches to providing the image from the external camera with the higher priority.

[0036] Possible methods for detecting shaking of the built-in camera 14 include, for example, (i) a method using video, (ii) a method using a sensor, (iii) a method using input from an input device, (iv) a method using sound, (v) a method using AI, and (vi) a method using a combination of two or more of the above, which will be described below.

[0037] One example of a cause of shaking is when the user moves or drops the first user terminal 10A. When the first user terminal 10A moves or drops, the position of the built-in camera 14 itself changes significantly. Therefore, the arithmetic circuit 11 may detect the presence or absence of shaking based on the change in the position of the built-in camera 14 itself. Furthermore, the image captured by the built-in camera 14 itself also changes significantly. Therefore, the arithmetic circuit 11 may detect the presence or absence of shaking based on the difference between frames of the image captured by the built-in camera 14.

[0038] Another example of a cause of shaking may be a keystroke. A keystroke may cause a small, continuous vibration in the built-in camera 14. Therefore, the arithmetic circuit 11 may detect the presence or absence of shaking by detecting the continuous shaking. A keystroke also generates a keystroke sound. Therefore, the arithmetic circuit 11 may detect the presence or absence of shaking by detecting the keystroke sound. Furthermore, a keystroke occurs when the input device 12 is used. Therefore, the presence or absence of shaking may be detected by detecting an input on the input device 12.

[0039] Another example of a cause of shaking is a sudden change in brightness caused by closing the laptop computer. Therefore, the arithmetic circuit 11 may detect the presence or absence of shaking depending on whether or not there is a change in brightness of the image captured by the built-in camera 14.

[0040] (i) Use of Video When the change in consecutive frames of the video provided to the other user terminals 10B and 10C is within a predetermined range, the arithmetic circuit 11 determines that a switching event has occurred. For example, the arithmetic circuit 11 can use a motion vector or a difference between consecutive frames as a condition.

[0041] (Motion Vector) The arithmetic circuit 11 calculates a motion vector between consecutive frames of the first video. When the amount of motion between frames calculated from the motion vector exceeds a motion amount threshold, the arithmetic circuit 11 determines that a switching event has occurred.

[0042] (Brightness) The arithmetic circuit 11 determines that a switching event has occurred when the amount of change between consecutive frames of the primary video exceeds a change amount threshold. For example, the amount of change may be the amount of change in brightness.

[0043] (ii) Use of Sensor Values ​​The first user terminal 10A may have sensors (not shown) built in, such as a position sensor and / or a vibration sensor. When a value detected by the sensor is within a range of a predetermined condition determined according to the shaking of the image, the arithmetic circuit 11 determines that a switching event has occurred.

[0044] (iii) Use of Input from an Input Device When the amount of information input within a unit time via the keyboard, which is the input device 12, exceeds an information amount threshold, the arithmetic circuit 11 determines that a switching event has occurred. The information amount threshold is, for example, a threshold indicating that the amount of information input within a unit time is large enough to cause fluctuations.

[0045] (iv) Use of Sound When the volume of a sound acquired by the microphone 16 exceeds a volume threshold, the arithmetic circuit 11 determines that a switching event has occurred. The predetermined condition can be determined, for example, by the frequency of the sound. Specifically, the frequency of the sound can be the sound made when the first user terminal 10A is dropped, the sound made when a key is pressed, or the like.

[0046] (vi) Use of AI The arithmetic circuit 11 may determine the occurrence of a switching event using a pre-generated trained model. The trained model may be a machine-learned model trained using images with people and images without people. The trained model, for example, receives a video frame as input and outputs a determination result as to whether a person appears in a predetermined portion of the image. The trained model may also be a machine-learned model trained using an image including a person looking toward the camera and an image including a person looking in a completely different direction from the camera. The trained model, for example, receives a video frame as input and outputs a determination result as to whether a person in the image is looking toward the camera. The arithmetic circuit 11 may determine that a switching event has occurred when a user is not visible in the video or when the user is not looking toward the built-in camera 14.

[0047] (vi) Combination of the Above Conditions The arithmetic circuit 11 may determine that a switching event has occurred when two or more of the above conditions are met. For example, the arithmetic circuit 11 may determine that a switching event has occurred when the volume of the sound acquired by the microphone 16 exceeds a volume threshold and the amount of change between consecutive frames of the first video exceeds a change amount threshold.

[0048] When the execution of the switching application 152 determines that the video switching conditions are met in any of (i) to (vi) of (Condition 2) above, the arithmetic circuit 11 can switch the video to be transmitted to the other user terminals 10B and 10C. At this time, the arithmetic circuit 11 may notify the user of the switching by displaying a notification of the switching on the display device 13. The notification of the switching may also include a notification to the user confirming the user's consent to the switching. The notification of the switching may be notified to the user in advance or after the switching. Hereinafter, the process of displaying the "notification before switching" will be referred to as "switching process 1," and the process of displaying the "notification after switching" will be referred to as "switching process 2." Note that displaying the notification of the switching is not essential.

[0049] (Switching Process 1 (Notification Before Switching)) In switching process 1, when the arithmetic circuit 11 determines that a switching event has occurred, it starts timing and causes the display device 13 to display the switching of the input video before the switching of the input video. If the arithmetic circuit 11 receives an operation from the user indicating no switching in response to the notification before the completion of timing of a predetermined time (e.g., 30 seconds), the arithmetic circuit 11 does not switch the input video. On the other hand, if the arithmetic circuit 11 receives an operation from the user indicating whether switching is required or not before the completion of timing, or if the arithmetic circuit 11 does not receive an operation from the user indicating whether switching is required or not, the arithmetic circuit 11 switches the input video.

[0050] 3A shows an example of a notification 500a displayed before switching. The notification 500a includes, for example, the text "The screen has changed significantly, so the transmitted video will be switched. If you want to maintain this screen, click 'Keep'." The arithmetic circuit 11 displays the notification 500a on the display device 13 when it is determined that the conditions for switching the video are met.

[0051] When the user presses "KEEP" 501a displayed on the display device 13 via the input device 12, the arithmetic circuit 11 stops switching the video to be transmitted and terminates the display of the notification 500a. For example, the arithmetic circuit 11 starts timing using a timer (not shown) at the timing of displaying the notification 500a. Until a predetermined time has elapsed according to the timer, the arithmetic circuit 11 continues displaying the notification 500a without switching the video, even if "KEEP" 501a is not pressed. On the other hand, when the predetermined time has elapsed according to the timer, the arithmetic circuit 11 determines that maintenance is not necessary, terminates the display of the notification 500a, and executes switching.

[0052] (Switching Process 2 (Notification After Switching)) In switching process 2, when the calculation circuit 11 determines that a switching event has occurred, it starts timing and, after switching the input video, notifies the display device of the switching of the input video. Furthermore, if the calculation circuit 11 receives an operation by the user indicating no switching in response to the notification before the timing is complete, it returns the input video to video 1. On the other hand, if the calculation circuit 11 receives an operation by the user indicating a need for switching before the timing is complete, or if it does not receive an operation by the user indicating whether or not a need for switching is received, the calculation circuit 11 maintains the switching of the input video.

[0053] 3B shows an example of a notification 500b displayed after switching. The notification 500b includes, for example, the text "The screen has changed significantly, so the transmitted video has been switched. To return to the original screen, click 'Back'." When the arithmetic circuit 11 determines that the conditions for switching the video are met, it switches the video to be transmitted and displays the notification 500b on the display device 13.

[0054] When the user presses "Back" 501b displayed on the display device 13 via the input device 12, the arithmetic circuit 11 stops switching the video to be transmitted and terminates the display of the notification 500b. For example, the arithmetic circuit 11 also starts timing using a timer at the timing of displaying the notification 500b. Until a predetermined time has elapsed according to the timer, the arithmetic circuit 11 continues to display the notification 500b without switching the video, even if "Back" 502b is not pressed. On the other hand, when the predetermined time has elapsed according to the timer, the arithmetic circuit 11 determines that there is no need to switch back and terminates the display of the notification 500b.

[0055] The notifications 500a and 500b shown in Figures 3A and 3B are merely examples. Furthermore, the display method of the notifications 500a and 500b is not limited. For example, when the operation screens 400b and 400c shown in Figures 2B and 2C are displayed on the display device 13, the arithmetic circuitry 11 may display the notifications 500a and 500b by superimposing them on the operation screens 400b and 400c. The arithmetic circuitry 11 may display the notifications 500a and 500b at any position on the display device 13.

[0056] <Processing of Web Conference System> An example of processing executed by the Web conference system 1 will be described with reference to the sequence diagram shown in FIG.

[0057] The arithmetic circuit 11 starts the switching application 152 (S001).

[0058] The switching application 152 started in step S001 causes the arithmetic circuit 11 to determine an output target (S002).

[0059] The arithmetic circuit 11 also acquires images captured by the built-in camera 14 and the connected external cameras 20A and 20B (S003). For ease of explanation, the images captured by the multiple cameras 14, 20A, and 20B are shown by a single line in Fig. 4. However, the arithmetic circuit 11 acquires different images from each of the multiple cameras 14, 20A, and 20B.

[0060] The arithmetic circuit 11 also starts the Web conference application 151 (S004).

[0061] The Web conference application 151 started in step S004 causes the arithmetic circuit 11 to acquire the video designated as the output target by the switching application 152 (S005).

[0062] Furthermore, the arithmetic circuit 11 acquires the sound picked up by the microphone 16 through the Web conference application 151 (S006).

[0063] The Web conference application 151 causes the arithmetic circuit 11 to transmit the video acquired in step S005 and the audio acquired in step S006 to the other user terminals 10B and 10C participating in the Web conference (S007).

[0064] The arithmetic circuit 11 also receives video and audio transmitted from the other user terminals 10B and 10C (S008). Using the Web conference application 151, the arithmetic circuit 11 outputs (video display) the video received from the user terminals 10B and 10C in step S008 to the display device 13. Using the Web conference application 151, the arithmetic circuit 11 also outputs (audio playback) the audio received from the user terminals 10B and 10C in step S008 to the speaker 17. Optionally, using the Web conference application 151, the arithmetic circuit 11 outputs (video display) the video acquired in step S005 to the display device 13 (S009).

[0065] In this way, the arithmetic circuit 11 can transmit and receive video and audio to and from the other user terminals 10B and 10C, and can hold a Web conference.

[0066] The first user terminal 10A can execute a switching process during a Web conference, and switch the output target determined in step S002, as shown in Fig. 4. More specific processing in the first user terminal 10A will be described using the flowchart shown in Fig. 5.

[0067] 4 illustrates an example that focuses on the arithmetic circuit 11 of the first user terminal 10A. If the switching application 152 is stored in the storage device of the user terminals 10B and 10C, the user terminals 10B and 10C may execute the same processing as the user terminal 10A. Specifically, the user terminals 10B and 10C may also transmit selected images from images captured by multiple cameras to the first user terminal 10A, etc.

[0068] <User Terminal Processing> The processing executed by the first user terminal 10A when a Web conference is held will be described using the flowchart shown in Fig. 5. The following describes an example in which the arithmetic circuit 11 determines whether the above-mentioned (Condition 2) is met and then executes the switching processing.

[0069] First, the arithmetic circuit 11 starts the switching application 152 (S1). When the switching application 152 starts, the arithmetic circuit 11 (switching application 152) acquires images from each of the connected cameras 14, 20A, and 20B and can select the image from any of the cameras as the output target. In this case, the arithmetic circuit 11 may select the image captured by the camera set to the highest priority among the multiple cameras 14, 20A, and 20B as the output target.

[0070] The arithmetic circuit 11 also starts the Web conference application 151 and starts the Web conference in accordance with the user's operation via the input device 12 (S2). As a result, the user of the first user terminal 10A participates in the Web conference.

[0071] When the web conference starts in step S2, the arithmetic circuit 11 (web conference application 151) acquires one of the images acquired from each of the cameras 14, 20A, and 20B. The arithmetic circuit 11 (web conference application 151) also acquires sound obtained via the microphone 16 (S3). For example, the arithmetic circuit 11 (web conference application 151) acquires the image from the camera that was selected as the output target by the switching application 152 in step S1.

[0072] The arithmetic circuit 11 transmits the video and audio acquired in step S3 to the other user terminals 10B and 10C participating in the web conference (S4). When transmitting the video in step S4, the arithmetic circuit 11 (web conference application 151) transmits the video from the camera that was selected as the output target in step S1 to the other user terminals 10B and 10C.

[0073] The arithmetic circuit 11 also determines whether the video to be transmitted has been captured by the built-in camera 14 (S5).

[0074] If it is the built-in camera 14 (YES in S5), a switching process related to switching of video transmission is executed (S6). The switching process will be described in detail using the flowcharts shown in Figures 6A and 6B.

[0075] The arithmetic circuit 11 repeats the processes of steps S3 to S6 until the Web conference ends (S7).

[0076] As described above, the arithmetic circuit 11 switches the video to be transmitted in the switching process of step S6. Therefore, the arithmetic circuit 11 can realize easy switching without requiring the user to perform complicated procedures.

[0077] During the Web conference, the first user terminal 10A constantly acquires video and audio, transmits and receives them to and from the other user terminals 10B and 10C, and outputs them. The arithmetic circuit 11 continues the processes shown in Fig. 5 during the Web conference. The arithmetic circuit 11 may simultaneously execute processes that can be executed simultaneously among the processes shown in Fig. 5. Furthermore, the arithmetic circuit 11 may execute processes that can be executed in a reverse order among the processes shown in Fig. 5 in a reverse order.

[0078] <<Switching Process 1>> Fig. 6A is a flowchart showing an example of executing switching process 1 in step S6 described above with reference to Fig. 5. In switching process 1, after displaying a notification of switching, the video to be transmitted is switched.

[0079] When a web conference is started and video and audio are transmitted to the other user terminals 10B, 10B, the arithmetic circuit 11 determines whether a switching condition exists (S101). Specifically, the arithmetic circuit 11 determines whether a switching event has occurred under conditions such as the above-mentioned (Condition 2). An example of determining the switching condition will be described later with reference to FIG. 7.

[0080] If the result of the determination in step S101 indicates that switching is necessary (YES in S102), the arithmetic circuit 11 starts timing using a timer (S103).The arithmetic circuit 11 also causes the display device 13 to display a switching notification 500a (S104).

[0081] When "Maintain" 501a is pressed on the notification 500a displayed in step S104 (YES in S105), the arithmetic circuit 11 determines that switching is unnecessary, terminates the display of the notification 500a, and terminates the switching process (S106).

[0082] If "Maintain" 501a is not pressed in the notification 500a displayed in step S104 (NO in S105) and a certain period of time (e.g., 30 seconds) has elapsed (YES in S107), the arithmetic circuit 11 terminates the display of the switching notification 500a (S108).The arithmetic circuit 11 also switches the video to be transmitted and terminates the switching process (S109).

[0083] As described above, the user can confirm the switching of the video to be transmitted by the switching notification 500a. Note that the order of the above-described processes is an example. Therefore, if the video can be switched, some of the processes may be executed simultaneously or the order may be changed.

[0084] <<Switching Process 2>> Fig. 6B is a flowchart showing an example of executing switching process 2 in step S6 described above with reference to Fig. 5. In switching process 2, after switching the video to be transmitted, a notification of the switching is displayed.

[0085] When the Web conference is started and video and audio are transmitted to the other user terminals 10B, 10B, the arithmetic circuit 11 determines whether a switching condition is met (S111). Specifically, the arithmetic circuit 11 determines whether a switching event has occurred under the above-mentioned condition (Condition 2). An example of determining the switching condition will be described later with reference to FIG. 7.

[0086] If the result of the determination in step S111 indicates that switching is necessary (YES in S112), the arithmetic circuit 11 switches the video to be transmitted (S113), starts timing using a timer (S114), and causes the display device 13 to display a switching notification 500b (S115).

[0087] When "Return" 501b is pressed in the notification 500b displayed in step S115 (YES in S116), the arithmetic circuit 11 determines that switching is unnecessary and terminates the display of the notification 500b (S117). The arithmetic circuit 11 also restores the video to be transmitted and terminates the switching process (S118).

[0088] If "Back" 501b is not pressed in the notification 500b displayed in step S116 (NO in S116) and a certain period of time (e.g., 30 seconds) has elapsed (YES in S119), the calculation circuit 11 ends the display of the switching notification 500b and ends the switching process (S120).

[0089] As described above, the user can confirm the switching of the video to be transmitted by the switching notification 500b. Note that the order of the above-described processes is an example. Therefore, if the video can be switched, some of the processes may be executed simultaneously or the order may be changed.

[0090] <<Determination of Switching Condition>> Fig. 7 is a flowchart showing an example of executing step S101 described above in Fig. 6A and step S111 described above in Fig. 6B. In the example shown in Fig. 7, the switching condition is determined using the motion vector of the video in (i) of (Condition 2) described above.

[0091] The arithmetic circuit 11 obtains a motion vector from two consecutive frames (S201).

[0092] The arithmetic circuit 11 determines whether the image is shaking by using the motion vector calculated in step S201 (S202). Specifically, the arithmetic circuit 11 determines whether the motion vector is within a predetermined range. The predetermined range is set in advance for determining whether the image is shaking.

[0093] When it is determined that shaking is occurring (YES in S203), the arithmetic circuit 11 determines whether a timer (not shown) is timing (S204). The timer used in step S204 is a timer that starts timing when it is determined that shaking is occurring. This is because switching of the video to be transmitted is unnecessary when the shaking is temporary, but is necessary when the shaking is continuous.

[0094] If timing is in progress (YES in S204) and shaking has continued for a predetermined time (YES in S205), the arithmetic circuit 11 determines that a switching event has occurred (S206).

[0095] If timing is not in progress (NO in S204), the arithmetic circuit 11 starts timing (S207).

[0096] If it is determined that there is no shaking (NO in S203) and timing is in progress (YES in S208), the arithmetic circuit 11 ends timing (S209). The timing started in step S207 continues until it ends in step S209. Therefore, once timing has started, it is maintained even when a new motion vector is calculated in step S201 using the subsequently acquired video frame.

[0097] 7, the arithmetic circuit 11 determines whether to continue timing based on the presence or absence of shaking. Therefore, the arithmetic circuit 11 can determine that a switching event has occurred when shaking occurs for a certain period of time.

[0098] [Second Embodiment (Switching to Still Images)] A web conference system and user terminal according to the second embodiment will be described. The web conference system and user terminal according to the second embodiment have the same configuration as those described above with reference to FIG. 1, and will be described with reference to FIG. 1. In the web conference system 1 according to the second embodiment, the first user terminal 10A switches from transmitting video to transmitting still images under a predetermined condition. The predetermined condition is, for example, when the transmitted video shakes so much that it is uncomfortable for users of the other user terminals 10B and 10C.

[0099] In the second embodiment, the detection of shaking in the first user terminal 10A may be similar to (i) of (Condition 2) described above in the first embodiment. For example, the arithmetic circuit 11 determines that a switching event has occurred when the amount of change in consecutive frames of the first video exceeds a change amount threshold. Furthermore, a still image of one frame selected from consecutive frames of the first video is used as the second video. For example, when the first user terminal 10A detects shaking in a specific video, it switches from transmitting a moving image to transmitting a still image of the frame at the time the shaking was detected. As a result, the display devices 13 of the other user terminals 10B and 10C display a still image.

[0100] For example, even if the first user terminal 10A acquires video from only one camera, if the video captured by that camera becomes unsuitable for transmission, the video to be transmitted can be switched.

[0101] [Third Embodiment (Video Replacement)] A web conferencing system and user terminal according to the third embodiment will be described. The web conferencing system and user terminal according to the third embodiment have the same configuration as those described above with reference to FIG. 1, and will be described with reference to FIG. 1. In the web conferencing system 1 according to the second embodiment, the first user terminal 10A switches from transmitting video to transmitting still images under predetermined conditions. The predetermined conditions include, for example, when the built-in camera 14 shakes so much that it is uncomfortable for users of the other user terminals 10B and 10C, or when the video captured by the built-in camera 14 moves so violently.

[0102] In the third embodiment, the detection of shaking in the first user terminal 10A is similar to (i) of (Condition 2) described above in the first embodiment. For example, when the first user terminal 10A detects shaking in a specific video, it switches from transmitting a moving image to transmitting a still image that has been prepared in advance and stored in the storage device 15. As a result, the display devices 13 of the other user terminals 10B and 10C display a still image.

[0103] For example, even if the first user terminal 10A acquires video from only one camera, if the video captured by that camera becomes unsuitable for transmission, the video to be transmitted can be switched.

[0104] [Fourth Embodiment (Thermal Camera)] A web conferencing system and user terminal according to a fourth embodiment will be described. In each of the above-described embodiments, an example has been described in which the external camera receives visible light and generates a video signal. As shown in FIG. 8 as an example, in the web conferencing system 1 according to the fourth embodiment, the external camera detects invisible light information and generates a video signal. Here, the number of external cameras connected to the first user terminal 10A is not limited. Note that when multiple external cameras are connected to the first user terminal 10A, at least one of the external cameras may be a camera that detects invisible light information and generates a video signal.

[0105] For example, a camera that detects invisible light information and generates an image may be a thermal camera or an infrared camera. A thermal camera is a device that receives heat radiated from an object and generates a thermal image. An infrared camera is a device that irradiates an object with infrared light, detects the reflected infrared light, and generates an infrared image. Below, as shown in FIG. 8, the web conference system 1 will be described using an example in which one of the external cameras 20A, 20B connected to the first user terminal 10A, the first external camera 20A, is a thermal camera. Other than the fact that the first external camera 20A is a thermal camera, the configuration is the same as the web conference system 1 described above with reference to FIG. 1. In the following description, an image captured by a thermal camera will be described as a thermal image.

[0106] For example, in the web conference system 1 according to the fourth embodiment, the first user terminal 10A is located at a site where equipment maintenance is being performed and is used by a first user who performs the maintenance. The second user terminal 10B is located at a remote location from the equipment where maintenance is being performed and is used by a second user who supports the maintenance. The third user terminal 10C is located at a remote location from the equipment where maintenance is being performed and is used by a third user who supports the maintenance. During a web conference, the first user terminal 10A can acquire video images captured by a selected camera from the built-in camera 14, the first external camera 20A, or the second external camera 20B and transmit the captured video images to the other user terminals 10B and 10C. For example, when the first external camera 20A, which is a thermal camera, is selected, the first user terminal 10A can acquire a thermal image of the equipment as an output target via the first external camera 20A. The first user terminal 10A can also transmit the thermal image to the second user terminal 10B and the third user terminal 10C. Therefore, the second and third users can use the thermal image to check the status of the equipment.

[0107] 8, in the web conference system 1 to which a thermal camera is connected as an external camera, the input of an operation signal by a user is regarded as a switching event. Therefore, when the user inputs an operation signal to switch the video via the input device 12, the arithmetic circuit 11 switches the video to be output to other user terminals. Specifically, in the web conference system 1 according to the fourth embodiment, the video is switched when the condition 1 described above in the first embodiment is met.

[0108] (Format Adjustment) If the format of the video captured by the external cameras 20A and 20B differs from the format of the video handled by the web conference application 151, the arithmetic circuit 11 adjusts the format of the video captured by the external cameras 20A and 20B to match the format of the video handled by the web conference application 151. The file format, image size (number of pixels), resolution, etc. of the video handled by the web conference application 151 are predetermined. The web conference application 151 is intended to mainly use video from the built-in camera 14. Therefore, the format of the video signal handled by the web conference application 151 may be the same as the format of the video captured by the built-in camera 14. However, external cameras 20A and 20B, such as thermal cameras, are not intended to be used in the web conference system 1. Therefore, the format of the video captured by the external cameras 20A and 20B may differ from the format of the video signal handled by the web conference application 151. Therefore, the arithmetic circuit 11 can adjust the video in a format that is not compatible with the Web conference application 151 to suit the Web conference application 151.

[0109] For example, suppose the file format of the video handled by the web conference application 151 is Y2Y and the image size is 1280 x 720. Furthermore, suppose the file format of the video captured by the thermal camera is RGB and the image size is 160 x 120. The arithmetic circuit 11 converts the file format of the video captured by the thermal camera from RGB to Y2Y. The arithmetic circuit 11 also converts the image size of the video to 1280 x 720. In this case, simply multiplying one frame of the thermal camera image by six results in 960 x 720, not 1280 x 720. Therefore, the arithmetic circuit 11 converts the image size by, for example, pasting an enlarged image of the thermal camera image into the center of a 1280 x 720 black image.

[0110] This allows the users of the user terminals 10B and 10C to view, via the Web conference application 151, even videos that have been shot in a format that is not compatible with the Web conference application 151.

[0111] (Frame Rate Adjustment) The arithmetic circuit 11 can enable the connection with the camera only when capturing video, and can set the connection to standby at other times. This reduces the load on each user terminal 10A caused by the connection. For example, assume that the built-in camera 14 and the second external camera 20B are cameras that receive visible light to capture video signals. Assume also that the frame rate of the video captured by the built-in camera 14 and the second external camera 20B is 30 fps. Furthermore, assume that the frame rate of the video captured by the first external camera 20A, which is a thermal camera, is 10 fps.

[0112] One second is 1000 milliseconds. When capturing video with the built-in camera 14 or the second external camera 20B, the frame rate is 30 fps, so the arithmetic circuit 11 sets the waiting time for accessing the cameras 14 and 20B to approximately 30 milliseconds (1000 / 30 ≒ 33.333). On the other hand, when capturing video with the first external camera 20A, the frame rate is 10 fps, so the arithmetic circuit 11 sets the waiting time for accessing the first external camera 20A to 100 milliseconds (1000 / 10). More specifically, the arithmetic circuit 11 accesses the built-in camera 14 approximately every 30 milliseconds. On the other hand, the arithmetic circuit 11 accesses the first external camera 20A every 100 milliseconds.

[0113] If the video handled by the web application 151 is still the built-in camera 14 with a frame rate of 30 fps and the first external camera 20A with a frame rate of 10 fps, the difference in frame rates means that even if a thermal video is acquired, converted, and sent, the same video will end up being sent, resulting in a high load. The arithmetic circuit 11 can reduce unnecessary load by adjusting the standby time to match the frame rate of each camera.

[0114] When the first external camera 20A is used, the frame interval of the video becomes longer compared to when the built-in camera 14 and the second external camera 20B are used. Therefore, when the first external camera 20A, which has a frame rate different from that of the built-in camera 14, is used, the arithmetic circuit 11 transmits video frames adjusted to match the frame rate of the video captured by the built-in camera 14 to the other user terminals 10B and 10C. For example, the arithmetic circuit 11 again outputs the video frame most recently acquired from the first external camera 20A.

[0115] Using FIG. 9, a process executed by the first user terminal 10A while a Web conference is being held in the Web conference system 1 according to the fourth embodiment will be described.

[0116] First, the arithmetic circuit 11 starts the switching application 152 (S301).

[0117] The arithmetic circuit 11 also starts the Web conference application 151 and starts the Web conference in accordance with the user's operation via the input device 12 (S302).

[0118] When the switching application 152 is started, the arithmetic circuit 11 (switching application 152) acquires built-in camera information and sets the built-in camera as the target camera that captures the video to be output (S303). In this case, for example, it is specified that the video captured by the built-in camera 14 is set as the output target by default.

[0119] Next, the arithmetic circuit 11 (switching application 152) acquires information on the connected external cameras 20A and 20B (S304). The arithmetic circuit 11 stores the acquired camera information in the storage device 15 as currently available cameras.

[0120] Furthermore, when the switching application 152 is started, the arithmetic circuit 11 (switching application 152) starts detecting a switching event (S305).

[0121] When the arithmetic circuit 11 (switching application 152) detects a switching event (YES in S305), it updates the camera designated by the switching event as the target camera that captures the video to be output (S306).

[0122] The arithmetic circuit 11 (Web conference application 151) acquires the video from the target camera and also acquires the sound obtained via the microphone 16 (S307).

[0123] The arithmetic circuit 11 (switching application 152) determines whether the target camera is a thermal camera (S308).

[0124] If the target camera is not a thermal camera (NO in S308), the arithmetic circuit 11 (Web conference application 151) transmits the video and audio acquired in step S307 to the other user terminals 10B and 10C participating in the Web conference (S309).

[0125] Furthermore, the arithmetic circuit 11 (switching application 152) sets the first waiting time calculated according to the frame rate of the video captured by the target camera (S301). As described above, when the frame rate of the video captured by the target camera is 30 fps, the arithmetic circuit 11 sets about 30 milliseconds as the waiting time until the next video frame is acquired.

[0126] When the target camera is a thermal camera (YES in S308), the arithmetic circuit 11 (switching application 152) adjusts the format of the video acquired in step S307 to match the format of the Web conference application 151 (S311).

[0127] The arithmetic circuit 11 (Web conference application 151) also transmits the video adjusted in step S311 and the audio acquired in step S307 to the other user terminals 10B and 10C participating in the Web conference (S4).

[0128] The arithmetic circuit 11 (switching application 152) also sets the second waiting time calculated according to the frame rate of the video captured by the first external camera 20A, which is a thermal camera (S301). As described above, when the frame rate of the video captured by the target camera is 10 fps, the waiting time until the next video frame is acquired is set to approximately 100 milliseconds.

[0129] The arithmetic circuit 11 repeats the processes of steps S305 to S313 until the Web conference ends (S314). When capturing video during the repeated processes, the arithmetic circuit 11 accesses the camera and acquires video frames according to the waiting time set in step S310 or S313.

[0130] As described above, the arithmetic circuit 11 can switch between images even if the format and frame rate of the image captured by the external camera 20A differs from that of the built-in camera 14. This allows the web conference application 151 to be started, and the situation at a remote location to be grasped using images from various types of connected cameras as needed.

[0131] The arithmetic circuit 11 may simultaneously execute processes that can be executed simultaneously among the processes shown in Fig. 9. Furthermore, the arithmetic circuit 11 may execute processes that can be executed in a swapped order among the processes shown in Fig. 9 in a swapped order.

[0132] Overview of the embodiment (1) An information processing device of the present disclosure includes: a display device; an arithmetic circuit connectable to a plurality of image capturing devices; and a storage device that stores a first application and a second application executed by the arithmetic circuit; the first application has a function of displaying an input image on the display device; the second application acquires images captured by the plurality of image capturing devices; and provides a first image from among the images captured by the plurality of image capturing devices to the first application as the input image; and when a switching event occurs, the input image may be switched from the first image to the second image.

[0133] This allows the information processing device to switch to a video that meets the conditions when providing the video to the application program.

[0134] (2) In the information processing device of (1), the second image is an image captured by a camera among the plurality of camera devices that is different from the camera device that captured the first image, and the plurality of camera devices may be ranked in advance, and the ranking of the camera device that captured the second image may be lower than the ranking of the camera device that captured the first image.

[0135] This allows switching to a video with a lower priority level when a switching event occurs while a video with a higher priority level is being provided.

[0136] (3) In the information processing device of (1) to (2), the second application may calculate a motion vector between successive frames of the first video, and determine that the switching event has occurred when the amount of motion between the frames obtained from the motion vector exceeds a motion amount threshold.

[0137] This allows the video to be switched depending on the amount of motion between frames.

[0138] (4) In the information processing device of (1) to (3), the second application may determine that the switching event has occurred when an amount of change between consecutive frames of the first video exceeds a change amount threshold.

[0139] This allows the video to be switched depending on the amount of change between frames.

[0140] (5) In the information processing device of (1) to (4), the arithmetic circuit may be connected to a keyboard, and the second application may determine that the switching event has occurred when the amount of information input via the keyboard within a unit time exceeds an information amount threshold.

[0141] This allows the video to be switched depending on the amount of information input within a unit time.

[0142] (6) In the information processing device of (1) to (5), the arithmetic circuit may be connected to a microphone, and the second application may determine that the switching event has occurred when the volume of the sound captured by the microphone exceeds a volume threshold.

[0143] This allows the video provided to be switched depending on the volume of the sound picked up by the microphone.

[0144] (7) In the information processing device of (1) to (5), the arithmetic circuit may be connected to a microphone, and the second application may determine that the switching event has occurred when the volume of the sound captured by the microphone exceeds a volume threshold and the amount of change between consecutive frames of the first video exceeds a change amount threshold.

[0145] This allows the video to be switched depending on the volume of the sound picked up by the microphone and the amount of change between frames.

[0146] (8) In the information processing device of (1) to (7), when the second application determines that the switching event has occurred, it starts timing and, after switching the input image, notifies the display device of the switching of the input image; if it receives an operation by the user to not switch in response to the notification before the timing is complete, it returns the input image to the first image; and if it receives an operation by the user to switch before the timing is complete, or if it does not receive an operation by the user to switch, it may maintain the switching of the input image.

[0147] This allows the user to know that the video has been switched, and also allows the user to return the video to its original state if the video is no longer required.

[0148] (9) In the information processing device of (1) to (7), when the second application determines that the switching event has occurred, it starts timing and notifies the display device of the switching of the input video before switching the input video, and if it receives a user's operation to not switch in response to the notification before the timing is complete, it does not switch the input video, and if it receives a user's operation to switch before the timing is complete or does not receive a user's operation to switch, it may switch the input video.

[0149] This allows the user to know in advance that the video will be switched, and allows the video to be switched only when necessary.

[0150] (10) In the information processing device of (1) to (4), the second application determines that the switching event has occurred when the amount of change in consecutive frames of the first video exceeds a change amount threshold, and the second video may be a still image video of one frame selected from consecutive frames of the first video.

[0151] This allows switching from providing moving images to providing still images in response to the shaking of the video.

[0152] (11) In the information processing device of (1), the second image may be a preset image.

[0153] This allows a preset image to be provided when the captured image is not suitable for transmission.

[0154] (12) In the information processing device of (1) to (11), the plurality of image capturing devices may include an internal image capturing device that is built into the information processing device and an external image capturing device that is fixedly installed outside the information processing device, and the first image may be an image captured by the internal image capturing device, and the second image may be an image captured by the external image capturing device.

[0155] This allows for transmission of images captured by an external camera when the images captured by the built-in camera are not suitable for transmission.

[0156] (13) In the information processing device of (1) to (12), the plurality of image capturing devices may include a first image capturing device that detects visible light and generates a video signal, and a second image capturing device that detects invisible light and generates a video signal, the first image may be an image based on the video signal generated by the first image capturing device, and the second image may be an image based on the video signal generated by the second image capturing device.

[0157] This makes it possible to obtain and provide information that cannot be confirmed by visible light. (14) In the information processing device of (13), the invisible light detected by the second image capture device may be infrared light.

[0158] This allows a thermal or infrared image to be acquired and provided.

[0159] (15) In the information processing device of (1) to (14), the arithmetic circuit may be connectable to a communication circuit, and the first application may be an application that realizes a web conference and has a function of transmitting the input video through the communication circuit.

[0160] This allows you to easily switch between videos used in a web conference.

[0161] (16) In the information processing device of (1) to (15), when the second frame rate of the second video is different from the first frame rate of the first video, the second application may generate a new second video in which the second frame rate of the second video is adjusted to match the first frame rate, and when the switching event occurs, switch from the first video to the new second video.

[0162] This allows a video with a frame rate different from that of the video used in the Web conference to be used in the Web conference.

[0163] (17) The provision method of the present disclosure is a provision method executed by a plurality of imaging devices, a display device, and an arithmetic circuit connectable to a storage device, wherein the storage device stores an application that is executed by the arithmetic circuit and has a function of displaying input video on the display device, and the provision method may acquire video captured by the plurality of imaging devices, provide a first video among the videos captured by the plurality of imaging devices to the application as the input video, and switch the input video from the first video to a second video among the videos captured by the plurality of imaging devices in response to the occurrence of a predetermined event.

[0164] This allows the information processing device to switch to a video that meets the conditions when providing the video to the application program.

[0165] (18) In the provision method of (17), the second image is an image captured by a camera device among the plurality of camera devices that is different from the camera device that captured the first image, and the plurality of camera devices may be ranked in advance, and the ranking of the camera device that captured the second image may be lower than the ranking of the camera device that captured the first image.

[0166] This allows switching to a video with a lower priority level when a switching event occurs while a video with a higher priority level is being provided.

[0167] (19) In the providing method of (17), when the amount of change between successive frames of the first video exceeds a change amount threshold, it is determined that the switching event has occurred, and the second video may be a still image of one frame selected from the successive frames of the first video.

[0168] This allows switching from providing moving images to providing still images in response to the shaking of the video.

[0169] (20) In the providing method of (17), the second image may be a preset image.

[0170] This allows a preset image to be provided when the captured image is not suitable for transmission.

[0171] (21) In the provision methods of (17) to (20), the plurality of image capturing devices may include an internal image capturing device that is built into an information processing device having the arithmetic circuit, and an external image capturing device that is fixedly installed outside the information processing device, and the first image may be an image captured by the internal image capturing device, and the second image may be an image captured by the external image capturing device.

[0172] This allows for transmission of images captured by an external camera when the images captured by the built-in camera are not suitable for transmission.

[0173] (22) In the providing methods of (17) to (21), the application may be an application that realizes a Web conference and has a function of transmitting the input video through the communication circuit.

[0174] This allows you to easily switch between videos used in a web conference.

[0175] (23) The computer program of the present disclosure may cause an arithmetic circuit to execute the methods of (17) to (22).

[0176] This allows switching to a video that meets certain conditions when providing the video to an application program.

[0177] The information processing device, video providing method, and computer program according to all claims of the present disclosure are realized by cooperation of hardware resources, such as a processor, a memory, and a computer program.

[0178] The information processing device, video providing method, and computer program described in the present disclosure are useful for optimal video sharing when an information processing device connected to multiple image capture devices is used for a web conference.

Claims

1. a computing circuit connectable to a display device and a plurality of image capturing devices; a storage device for storing a first application and a second application to be executed by the arithmetic circuit; Equipped with the first application has a function of displaying an input image on the display device; The second application Acquire images captured by the plurality of image capturing devices; providing a first image among the images captured by the plurality of image capture devices to the first application as the input image; When a switching event occurs, the input video is switched from the first video to the second video; the plurality of image capturing devices include a first image capturing device that detects visible light and generates a video signal, and a second image capturing device that detects invisible light and generates a video signal; the first image is an image based on a video signal generated by the first image capturing device, the second image is an image based on a video signal generated by the second image capturing device; Information processing device.

2. The plurality of photographing devices are ranked in advance, The ranking of the camera that captured the second video is lower than the ranking of the camera that captured the first video. The information processing device according to claim 1 .

3. The second application determining a motion vector between successive frames of the first image; determining that the switching event has occurred when the amount of motion between the frames obtained from the motion vector exceeds a motion amount threshold; The information processing device according to claim 2 .

4. The second application determining that the switching event has occurred when a change amount between consecutive frames of the first video exceeds a change amount threshold; The information processing device according to claim 2 .

5. The arithmetic circuit comprises: Connected to a keyboard, the second application determines that the switching event has occurred when the amount of information input via the keyboard within a unit time exceeds an information amount threshold; The information processing device according to claim 2 .

6. The arithmetic circuit comprises: Connected to a microphone The second application determines that the switching event has occurred when the volume of the sound acquired by the microphone exceeds a volume threshold. The information processing device according to claim 2 .

7. The arithmetic circuit comprises: Connected to a microphone the second application determines that the switching event has occurred when the volume of the sound acquired by the microphone exceeds a volume threshold and the amount of change between consecutive frames of the first video exceeds a change amount threshold; The information processing device according to claim 2 .

8. The second application When it is determined that the switching event has occurred, timing is started, and after the input video is switched, the switching of the input video is notified by the display device; If a user's operation to reject the switching in response to the notification is received before the time measurement is completed, the input image is returned to the first image; accepting an operation by the user to change the input image before the time measurement is completed, or maintaining the change of the input image if an operation by the user to change the input image is not accepted.

8. The information processing device according to claim 3.

9. The second application When it is determined that the switching event has occurred, timing is started, and before the switching of the input video, a notification of the switching of the input video is given by the display device; If a user's operation to not switch the input video is received in response to the notification before the time measurement is completed, the input video is not switched, accepting an operation by the user to change the input image before the time measurement is completed, or if an operation by the user to change the input image is not accepted, executing the change of the input image.

8. The information processing device according to claim 3.

10. The second application determining that the switching event has occurred when a change amount between consecutive frames of the first video exceeds a change amount threshold; the second image is a still image of one frame selected from consecutive frames of the first image; 5. The information processing device according to claim 1.

11. The second image is a preset image. The information processing device according to claim 1 .

12. the plurality of photographing devices include a built-in photographing device that is built into the information processing device and an external photographing device that is fixedly installed outside the information processing device, the first image is an image captured by the built-in image capture device, The second image is an image captured by the external image capturing device. The information processing device according to claim 1 .

13. (delete)

14. the invisible light detected by the second image capture device is infrared light; The information processing device according to claim 1 .

15. the arithmetic circuit is connectable to a communication circuit; the first application is an application for realizing a Web conference and has a function of transmitting the input video through the communication circuit; 15. The information processing device according to claim 1.

16. When the second frame rate of the second image is different from the first frame rate of the first image, the second application generates a new second image by adjusting the second frame rate of the second image to match the first frame rate, and switches from the first image to the new second image when the switching event occurs; 16. The information processing device according to claim 1,

17. A providing method executed by a plurality of image capture devices, a display device, and a computing circuit connectable to a storage device, the method comprising: the storage device stores an application that is executed by the arithmetic circuit and has a function of displaying an input video on the display device; The providing method includes: Acquire images captured by the plurality of image capturing devices; providing a first image among the images captured by the plurality of image capturing devices to the application as the input image; switching the input video from the first video to a second video among the videos captured by the plurality of image capturing devices in response to an occurrence of a predetermined event; the plurality of image capturing devices include a first image capturing device that detects visible light and generates a video signal, and a second image capturing device that detects invisible light and generates a video signal; the first image is an image based on a video signal generated by the first image capturing device, the second image is an image based on a video signal generated by the second image capturing device; How it is provided.

18. The plurality of photographing devices are ranked in advance, The ranking of the camera that captured the second video is lower than the ranking of the camera that captured the first video. The method of claim 17.

19. determining that the switching event has occurred when a change amount between consecutive frames of the first video exceeds a change amount threshold; the second image is a still image of one frame selected from consecutive frames of the first image; The method of claim 17.

20. The second image is a preset image. The method of claim 17.

21. the plurality of photographing devices include a built-in photographing device that is built into the information processing device having the arithmetic circuit, and an external photographing device that is fixedly installed outside the information processing device, the first image is an image captured by the built-in image capture device, The second image is an image captured by the external image capturing device. The method of claim 17.

22. the arithmetic circuit is connectable to a communication circuit; the application is an application for realizing a web conference and has a function of transmitting the input video through the communication circuit; The method of claim 17.

23. A computer program causing a computing circuit to carry out the method according to any one of claims 17 to 22.