Information processing apparatus, information processing method, program

The information processing apparatus optimizes image transmission from multiple devices by determining suitability and switching based on device status, reducing load and enhancing efficiency.

JP7711707B2Active Publication Date: 2025-07-23SONY GROUP CORP
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2022536179
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-07-13
Filing Date
2021-06-11
Publication Date
2025-07-23
Estimated Expiration
2041-06-11

AI Technical Summary

Technical Problem

When using multiple imaging devices, continuously transmitting images from all devices can lead to increased processing load and waste, making it inefficient.

Method used

An information processing apparatus that determines the suitability of each imaging device for image transmission and selectively switches devices based on various factors such as power status, recording medium capacity, failure status, and environmental conditions.

Benefits of technology

Reduces network communication load, memory capacity burden, and facilitates efficient image selection by ensuring only appropriate devices transmit images, improving usability and speed of image reporting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007711707000001
    Figure 0007711707000001
  • Figure 0007711707000002
    Figure 0007711707000002
  • Figure 0007711707000003
    Figure 0007711707000003
Patent Text Reader

Abstract

This information processing device comprises a control unit which performs: a condition determination process that determines whether a condition pertaining to an image capturing operation in an image capturing device is suitable for image transmission; and a selection process that selects, from among a plurality of image capturing devices, an image capturing device that causes a captured image to be transmitted on the basis of the condition determination process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This technology relates to an information processing apparatus, an information processing method, and a program, and particularly to a control technology related to image transmission from a plurality of imaging devices.

Background Art

[0002] It is generally performed to transmit an image (still image or moving image) captured by an imaging device to another device, such as a computer device such as a cloud server. In Patent Document 1 below, a technology related to the transmission of image data and metadata is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, for reporting purposes such as television broadcasts and web distribution, immediately after a cameraman captures an image at a location such as a sports venue or an event venue, the captured still image or moving image may be uploaded to an external server device to submit the image. In recent years, for example, as called a multi-camera system, a plurality of imaging devices are arranged at a sports venue or the like, imaging is performed at various angles and angles of view, and those images are also transmitted. Also, in fixed-point cameras (live cameras), surveillance cameras, etc., a plurality of imaging devices may be arranged at a certain target location, and imaging may be performed at various angles and distances, for example.

[0005] When using a plurality of imaging devices in this way, if images are always transmitted from all the imaging devices to the server device or if all the imaging devices are always kept in an operating state, there may be cases where it is not preferable, such as an increase in the processing load and a waste of images. Therefore, in the present disclosure, a technique is proposed in which when imaging is possible with a plurality of imaging devices, an appropriate imaging device is selected and image transmission is performed.

Means for Solving the Problem

[0006] The information processing apparatus according to this technology includes a control unit that performs a situation determination process for determining whether a situation regarding an imaging operation in an imaging device is a situation suitable for image transmission, and a selection process for selecting, based on the situation determination process, an imaging device that transmits an imaging image among a plurality of imaging devices. For example, assume an information processing apparatus that can transmit and receive images and other information to and from an imaging device. The information processing apparatus can receive images from each of a plurality of imaging devices. In this case, the situation of each imaging device is determined so that it is possible to select which imaging device transmits the imaging image.

[0007] In the information processing apparatus according to the above-described technology, it is conceivable that the control unit performs the situation determination process for the imaging device selected as the device that performs imaging image transmission, and when it is determined that the imaging device is not in a situation suitable for image transmission, the selection process is performed so that the imaging device that performs image transmission is switched to another imaging device among the plurality of imaging devices. For example, while an imaging device is selected as the device that performs imaging image transmission based on the selection process, the situation of the imaging device is checked to determine whether it is in a situation suitable for continuing image transmission.

[0008] In the information processing apparatus according to the above-described technology, it is conceivable that the control unit makes an information request to the imaging device and performs the situation determination process based on the information transmitted from the imaging device in response to the information request. That is, the information used for the determination process is requested from the information processing apparatus side to the imaging device.

[0009] In the information processing apparatus according to the present technology described above, it is conceivable that the control unit performs the situation determination process based on the notification information from the imaging device selected as the device that performs imaging image transmission. That is, the imaging device side transmits notification information to the information processing apparatus when necessary or at regular timings. The information processing apparatus performs a situation determination process for the imaging device during image transmission according to the notification information.

[0010] In the information processing apparatus according to the present technology described above, it is conceivable that the control unit performs the situation determination process for two or more of the plurality of imaging devices, and in the selection process, based on the situation determination process and the designation information related to imaging, the imaging device that transmits the imaging image is selected from among the plurality of imaging devices. The designation information related to imaging is assumed to be information that designates various conditions related to imaging, such as, for example, the position, direction, angle of view, person or article to be the subject, date and time, scenery, brightness, etc. to be imaged.

[0011] In the information processing apparatus according to the present technology described above, it is conceivable that the designation information is information on the position of the subject. For example, a selection is made to image a subject at a specific position.

[0012] In the information processing apparatus according to the present technology described above, it is conceivable that the designation information is information that designates the imaging target. For example, an appropriate imaging device is selected to image a specific person or the like as the imaging target.

[0013] In the information processing apparatus according to the present technology described above, it is conceivable that in the situation determination process, the power supply situation of the imaging device is determined. For example, the remaining battery level of the imaging device, the situation such as whether it is an external power supply / battery, etc. is determined.

[0014] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the failure situation of the imaging device. For example, it is determined whether or not there is any problem in the imaging device.

[0015] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the situation of the recording medium of the imaging device. For example, the recordable capacity of the recording medium in the imaging device, or the determination of the problem of the recording medium, etc. is performed.

[0016] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the situation of the imaging environment of the imaging device. For example, the light amount and weather at the location where the imaging device is arranged are determined.

[0017] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the situation of the distance to the imaging target of the imaging device. For example, the situation of the distance from the location where the imaging device is arranged to a specific subject is determined to select an appropriate imaging device. Or an appropriate imaging device is selected from the relationship between the function of the imaging device and the distance.

[0018] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the compatibility situation between the captured image of the imaging device and the communication speed. For example, according to the communication situation of the network, it is possible to determine the imaging device 1 with an appropriate captured image size.

[0019] In the information processing apparatus according to the present technology described above, in the situation determination process, it is conceivable to determine the situation of the imaging direction or the imaging angle of view of the imaging device. It can be determined whether the situation is suitable for imaging a predetermined subject depending on the imaging direction and the angle of view of the imaging device.

[0020] The information processing method of the present technology includes a situation determination process for determining whether the situation regarding the imaging operation in the imaging device is a situation suitable for image transmission, and a selection process for selecting, based on the situation determination process, an imaging device that transmits the captured image among a plurality of imaging devices, which is performed by the information processing device. In this way, an imaging device in an appropriate situation is selected so that image transmission can be performed. The program according to the present technology is a program that causes the information processing device to execute the above-described situation determination process and selection process. This facilitates the realization of the above-described information processing device.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Modes for Carrying Out the Invention

[0022] Hereinafter, the embodiments will be described in the following order. <1. System Configuration> <2. Configurations of Imaging Devices, Server Devices, and Client Terminals> <3. First and Second Embodiments> <4. Third and Fourth Embodiments> <5. Fifth and Sixth Embodiments> <6. Summary and Variations>

[0023] <1. System Configuration> FIG. 1 shows an example of the system configuration of the embodiment. This system is a system in which a plurality of imaging devices 1 can transmit images and the like to a server device 2. For example, a plurality of imaging devices 1, a server device 2, and a client terminal 3 are communicable via a network 6. In the present disclosure, the term "image" includes still images and moving images.

[0024] As the imaging device 1, various imaging devices such as a video camera and a still camera are assumed. The illustrated imaging device 1 may be assumed to be a camera used by a cameraman at a sports or event venue, or may be, for example, a surveillance camera or a fixed-point camera. Also, a camera used by a general user for imaging may be assumed, not limited to business use. The use case is not particularly limited. From each imaging device 1, information such as images can be transmitted to the server device 2, for example, by FTP (File Transfer Protocol) communication. The image uploaded from the imaging device 1 to the server device 2 may be in a file format such as JPEG (Joint Photographic Experts Group), or may be binary information that is not in a file format such as RGB data. In particular, the data format is not limited.

[0025] In the present disclosure, the "captured image" refers to the image captured by the imaging device 1. Therefore, an image that has been captured and recorded on a recording medium is also included in the "captured image". For example, an image captured by the imaging device 1 and transmitted externally without being recorded on a recording medium within the imaging device 1, and an image that has been recorded on a recording medium within the imaging device 1 and then read from the recording medium and transmitted externally are both considered to be transmissions of captured images.

[0026] Both the server device 2 and the client terminal 3 are information processing devices formed by computer equipment. However, since the server device 2 provides a service for image transfer and the client terminal 3 is an information processing device of a customer who uses the transfer service provided by the server device 2, in the present disclosure, they are referred to as the "server device" and the "client terminal" for the sake of distinction.

[0027] The server device 2 is assumed to be a device that functions as a so-called cloud server. Of course, it is not limited to the form of a cloud server. Although the control unit 2a is shown in the server device 2, the control unit 2a executes situation determination processing, selection processing, etc. as will be described later. The server device 2 performs storage of images and the like uploaded from the imaging device 1, provides them to the client terminal 3, and conducts other information exchanges.

[0028] The client terminal 3 represents an information processing device to which a cameraman delivers images, such as a broadcasting station, a newspaper company, a news agency, etc. Note that the broadcasting station, etc. are just examples, and the delivery destinations are not limited.

[0029] The network 6 is assumed to be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or other various networks.

[0030] In the example of FIG. 1, the imaging device 1 communicates with the server device 2 via the base station 4. The base station 4 is, for example, a base station of 4G communication (the fourth-generation mobile communication system) and 5G communication (the fifth-generation mobile communication system). An MEC (Mobile Edge Computing) 5 may be arranged in the base station 4. The communication of each imaging device 1 may be performed via the processing of the MEC 5, or some functions of the server device 2 may be executed by the MEC 5.

[0031] The sensing device 9 generally shows various sensor devices arranged, for example, in an event venue where the imaging device 1 is arranged. It is assumed that the sensing device 9 can transmit the detected information to the server device 2. As the sensing device 9, for example, sensor devices such as illuminance, weather, temperature, humidity, air volume, and wind direction in the vicinity where the imaging device 1 is arranged are assumed. Also, sensors that can detect sound (volume), sensors that can analyze the sound content, and position sensors are also conceivable. Although the sensing device 9 is shown as a separate body from the imaging device 1, it may be built into the imaging device 1.

[0032] By constructing an image transmission system using multiple cameras as shown in FIG. 1, for example, images captured by a plurality of imaging devices 1 can be transferred to the client terminal 3 via the server device 2, and can be used, for example, for broadcasting or distribution, or for news articles on the client terminal 3 side. Of course, uses such as simply viewing on the client terminal 3 and monitoring uses are also conceivable.

[0033] However, if images are constantly transmitted from the imaging device 1 arranged as a multi-camera, the network load and the processing load of each part may increase. Also, if too many images are provided, it will be troublesome to select images on the client terminal 3, deteriorating the usability of the images or impairing the speed of reporting. Therefore, in this embodiment, the server device 2 selects (including switching) an imaging device suitable for image transmission, thereby reducing the network communication load, the memory capacity burden, and facilitating the selection operation. Further, images with appropriate image content are transmitted according to the situation. in Thereby, realization of reduction of the load of network communication, reduction of memory capacity burden, facilitation of selection work, etc. is achieved. Further, image transmission of an image with appropriate image content according to the situation is performed.

[0034] <2. Configuration of Imaging Device, Server Device, Client Terminal, and MEC> Hereinafter, configuration examples of the imaging device 1, the server device 2, and the client terminal 3 will be described. First, a configuration example of the imaging device 1 will be described with reference to FIG. 2.

[0035] The imaging device 1 includes, for example, a lens system 11, an imaging element unit 12, a camera signal processing unit 13, a recording control unit 14, a display unit 15, a communication unit 16, an operation unit 17, a camera control unit 18, a memory unit 19, a driver unit 22, a sensor unit 23, and a power supply unit 24.

[0036] The lens system 11 includes lenses such as a zoom lens and a focus lens, and a diaphragm mechanism. The light (incident light) from the subject is guided by this lens system 11 and focused on the imaging element unit 12.

[0037] The imaging element unit 12 is configured to include an image sensor 12a (imaging element) such as a CMOS (Complementary Metal Oxide Semiconductor) type or a CCD (Charge Coupled Device) type. In this imaging element unit 12, for the electrical signal obtained by photoelectrically converting the light received by the image sensor 12a, for example, CDS (Correlated Double Sampling) processing, AGC (Automatic Gain Control) processing, etc. are executed, and further A / D (Analog / Digital) conversion processing is performed. Then, the imaging signal as digital data is output to the subsequent camera signal processing unit 13 and camera control unit 18.

[0038] The camera signal processing unit 13 is configured as an image processing processor by, for example, a DSP (Digital Signal Processor) or the like. This camera signal processing unit 13 performs various signal processes on the digital signal (imaging image signal) from the imaging element unit 12. For example, as a camera process, the camera signal processing unit 13 performs pre-processing, synchronization processing, YC generation processing, resolution conversion processing, file formation processing, etc.

[0039] In the pre-processing, for the imaging image signal from the imaging element unit 12, clamp processing for clamping the black levels of R, G, B to a predetermined level, correction processing between the color channels of R, G, B, etc. are performed. In the synchronization processing, color separation processing is performed so that the image data for each pixel has all the color components of R, G, B. For example, in the case of an imaging element using a Bayer array color filter, demosaicing processing is performed as the color separation processing. In the YC generation processing, a luminance (Y) signal and a color (C) signal are generated (separated) from the R, G, B image data. In the resolution conversion processing, resolution conversion processing is executed on the image data subjected to various signal processes.

[0040] In the file formation processing, for example, for the image data subjected to the above various processes, for example, compression encoding for recording or communication, formatting, generation and addition of metadata, etc. are performed to generate a file for recording or communication. For example, image files in formats such as JPEG, TIFF (Tagged Image File Format), and GIF (Graphics Interchange Format) are generated as still image files. It is also conceivable to generate image files in formats such as the MP4 format used for recording MPEG-4 compliant video and audio. It is also conceivable to generate image files as RAW (RAW) image data.

[0041] For metadata, the camera signal processing unit 13 generates it to include information on processing parameters within the camera signal processing unit 13, various control parameters obtained from the camera control unit 18, information indicating the operating states of the lens system 11 and the imaging element unit 12, mode setting information, imaging environment information (such as date and time, location), identification information of the imaging device itself, information on the attached lens, information on pre-registered camera operators (name, identification information), IPTC (International Press Telecommunications Council) metadata, etc. Note that IPTC metadata is metadata in a format formulated by media corporate groups, and can describe various types of information such as "Description / Caption", "Description Writer", "Headline", "Keywords", etc.

[0042] The recording control unit 14 performs recording and playback on a recording medium, for example, using a non-volatile memory. The recording control unit 14 performs processes such as recording video data, still image data, and other images and metadata on the recording medium. The actual form of the recording control unit 14 can be considered in various ways. For example, the recording control unit 14 may be configured as a flash memory built into the imaging device 1 and its write / read circuit. Also, the recording control unit 14 may be in the form of a card recording / playback unit that performs recording and playback access on a recording medium that can be attached to and detached from the imaging device 1, such as a memory card (portable flash memory, etc.). Additionally, the recording control unit 14 may be realized as an HDD (Hard Disk Drive) or the like in a form built into the imaging device 1.

[0043] The display unit 15 is a display unit that performs various displays for the image capturer, and is, for example, a display panel or a viewfinder using a display device such as a liquid crystal panel (LCD: Liquid Crystal Display) or an organic EL (Electro-Luminescence) display arranged on the housing of the imaging device 1. The display unit 15 executes various displays on the display screen based on the instructions of the camera control unit 18. For example, the display unit 15 displays a reproduced image of the image data read from the recording medium by the recording control unit 14. In addition, the image data of the captured image resolution-converted for display by the camera signal processing unit 13 is supplied to the display unit 15, and the display unit 15 may perform a display based on the image data of the captured image according to the instructions of the camera control unit 18. As a result, a so-called through image (subject monitoring image), which is a captured image such as during composition confirmation or video recording, is displayed. In addition, the display unit 15 executes displays such as various operation menus, icons, messages, etc., that is, displays as a GUI (Graphical User Interface) on the screen based on the instructions of the camera control unit 18.

[0044] The communication unit 16 performs wired or wireless data communication and network communication with external devices. For example, it transmits and outputs captured image data (still image files and video files) and metadata to external information processing devices, display devices, recording devices, playback devices, etc. In addition, the communication unit 16 functions as a network communication unit to perform communication via the network 6 and can perform various data transmissions and receptions with servers, terminals, etc. on the network. For example, in the case of this embodiment, the communication unit 16 performs communication processing to transmit the captured image data, metadata, etc. to the server device 2. In addition, as the communication unit 16, it may also be possible to perform mutual information communication, for example, by short-range wireless communication such as Bluetooth (registered trademark), WI-FI (registered trademark) communication, NFC (Near Field Communication), or infrared communication. The communication unit 16 may include a wired connection unit, and the imaging device 1 and other devices may be capable of mutually performing data communication by wired connection communication.

[0045] The operation unit 17 generally shows input devices for the user to perform various operation inputs. Specifically, the operation unit 17 shows various operation elements (keys, dials, touch panels, touch pads, etc.) provided on the housing of the imaging device 1. An operation of the user is detected by the operation unit 17, and a signal corresponding to the input operation is sent to the camera control unit 18.

[0046] The camera control unit 18 is constituted by a microcomputer (arithmetic processing unit) having a CPU (Central Processing Unit). The memory unit 19 stores information and the like used by the camera control unit 18 for processing. The illustrated memory unit 19 comprehensively shows, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, and the like. The memory unit 19 may be a memory area built in a microcomputer chip as the camera control unit 18, or may be constituted by a separate memory chip. The camera control unit 18 controls the entire imaging device 1 by executing programs stored in the ROM, flash memory, etc. of the memory unit 19. For example, the camera control unit 18 controls the shutter speed of the imaging element unit 12, gives instructions for various signal processes in the camera signal processing unit 13, imaging operations and recording operations according to user operations, playback operations of recorded image files, operations of the lens system 11 such as zoom, focus, and aperture adjustment in the lens barrel, user interface operations, settings of communication methods and transmission destinations by the communication unit 16, and operations of necessary respective parts.

[0047] The RAM in the memory unit 19 is used for temporarily storing data, programs, etc. as a work area during various data processes of the CPU of the camera control unit 18. The ROM and flash memory (non-volatile memory) in the memory unit 19 are used to store the OS (Operating System) for the CPU to control each part, content files such as image files, application programs for various operations, firmware, and various setting information. Examples of various setting information include communication setting information, exposure setting as setting information related to the imaging operation, shutter speed setting, mode setting, white balance setting as setting information related to image processing, color setting, setting related to image effects, custom key setting and display setting as setting information related to operability, etc.

[0048] In the driver unit 22, for example, a motor driver for a zoom lens drive motor, a motor driver for a focus lens drive motor, a motor driver for a diaphragm mechanism motor, etc. are provided. These motor drivers apply a drive current to the corresponding driver according to an instruction from the camera control unit 18, and cause the movement of the focus lens and zoom lens, the opening and closing of the diaphragm blades of the diaphragm mechanism, etc. to be executed.

[0049] The sensor unit 23 comprehensively shows various sensors mounted on the imaging device. As the sensor unit 23, for example, an IMU (inertial measurement unit) is mounted, and for example, angular velocity (gyro) sensors of three axes of pitch, yaw, and roll can detect the angular velocity, and an acceleration sensor can detect the acceleration. Also, as the sensor unit 23, for example, a position information sensor, an illuminance sensor, etc. may be mounted. Also, it is assumed that the sensor unit 23 is provided with a distance measurement sensor. The distance measurement sensor can measure the distance from the imaging device 1 to the subject at the time of imaging, and add the distance information as metadata to the captured image.

[0050] Various types of information detected by the sensor unit 23, such as position information, distance information, illuminance information, IMU data, etc., are added as metadata to the captured image together with the date and time information managed by the camera control unit 18.

[0051] The power supply unit 24 outputs the necessary power supply voltage Vcc to each unit using the battery 24a as the power source. The on / off of the supply of the power supply voltage Vcc by the power supply unit 24, that is, the on / off of the power supply of the imaging device 1, is controlled by the camera control unit 18. Also, the capacity of the battery 24a, that is, the remaining battery level, can be detected by the camera control unit 18. Note that the power supply unit 24 may be configured to be able to output the power supply voltage Vcc based on an external power source, for example, by connecting an AC adapter or receiving the supply of a DC power supply voltage.

[0052] Next, a configuration example of the information processing device 70 that can be applied as the server device 2, the client terminal 3, and the MEC 5 is shown in FIG. 3. The CPU 71 of the information processing device 70 executes various processes according to programs stored in the ROM 72 and the non-volatile memory unit 74 such as, for example, an EEP-ROM (Electrically Erasable Programmable Read-Only Memory), or programs loaded from the storage unit 79 into the RAM 73. The RAM 73 also appropriately stores data and the like necessary for the CPU 71 to execute various processes. The CPU 71, the ROM 72, the RAM 73, and the non-volatile memory unit 74 are interconnected via a bus 83. An input / output interface 75 is also connected to this bus 83.

[0053] An input unit 76 composed of an operator and an operation device is connected to the input / output interface 75. For example, as the input unit 76, various operators and operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, a remote controller, etc. are assumed. An operation of the user is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0054] In addition, a display unit 77 composed of an LCD or an organic EL panel, etc., and an audio output unit 78 composed of a speaker, etc. are connected to the input / output interface 75 either integrally or separately. The display unit 77 is a display unit that performs various displays, and is constituted by, for example, a display device provided on the housing of the information processing apparatus 70, a separate display device connected to the information processing apparatus 70, or the like. The display unit 77 executes displays of images for various image processes, moving images of processing targets, etc. on the display screen based on instructions from the CPU 71. In addition, the display unit 77 performs displays as various operation menus, icons, messages, etc., that is, as a GUI (Graphical User Interface) based on instructions from the CPU 71.

[0055] A storage unit 79 composed of a hard disk, a solid-state memory, etc., and a communication unit 80 composed of a modem, etc. may be connected to the input / output interface 75.

[0056] The communication unit 80 performs communication processing via a transmission path such as the Internet, communication with various devices by wired / wireless communication, bus communication, etc.

[0057] In addition, a drive 81 is connected to the input / output interface 75 as necessary, and a removable recording medium 82 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted. With the drive 81, data files such as image files and various computer programs can be read from the removable recording medium 82. The read data files are stored in the storage unit 79, or images and audio included in the data files are output by the display unit 77 and the audio output unit 78. In addition, computer programs, etc. read from the removable recording medium 82 are installed in the storage unit 79 as necessary.

[0058] In this information processing apparatus 70, for example, software for the processing of the present embodiment can be installed via network communication by the communication unit 80 or via a removable recording medium 82. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0059] For example, when the information processing apparatus 70 is the server apparatus 2, software for the situation determination processing, the selection processing, and the processing for the image providing service including the selection processing described below will be installed. In that case, the CPU 71 functions as the control unit 2a in FIG. 1 and performs necessary processing. Various communications performed by the server apparatus 2 will be performed via the communication unit 80.

[0060] When the information processing apparatus 70 is the client terminal 3, in the process of the processing described below, interface processing using the input unit 76, the display unit 77, etc. is executed under the control of the CPU 71. Various communications performed by the client terminal 3 will be performed via the communication unit 80.

[0061] In the fifth and sixth embodiments, the processing of the MEC 5 is described, and that processing is the processing performed by the CPU 71 when the information processing apparatus 70 is the MEC 5.

[0062] <3. First and Second Embodiments> The first embodiment will be described regarding the operation of image transmission from the imaging apparatus 1 to the server apparatus 2 and image provision to the client terminal 3.

[0063] FIG. 4 shows an example of the communication and processing procedure as the first embodiment. In the description of each of the embodiments to be described below, as shown in FIG. 4, the transmission and reception between the imaging apparatus 1, the server apparatus 2, and the client terminal 3 are indicated by arrows with the symbol TP** (where "**" is a numerical value), and the processing of each apparatus is indicated by the symbol PS**. The vertical direction (from top to bottom) of the figure corresponds to the progress of time. For multiple imaging devices 1, they are distinguished by adding alphabets to the numerical codes, such as imaging devices 1A, 1B, and so on. Note that the figure shows that the number of imaging devices 1 is multiple. For example, in FIG. 4, for the sake of simplicity of illustration and description, two imaging devices 1A and 1B are shown. However, this is not limited to the case of two imaging devices 1, and cases of three or more are also included.

[0064] The first embodiment in FIG. 4 is an example of switching the imaging device 1 that transmits an image according to a situation determination. In the first embodiment, as a typical example, communication and processing of the procedure as shown in FIG. 4 may be performed.

[0065] · Communication TP1 A communication session is established between the server device 2 and a certain imaging device 1B among the multiple imaging devices. · Communication TP2 A communication session is established between the server device 2 and a certain imaging device 1A among the multiple imaging devices. While establishing communication sessions with each imaging device 1 in this way, the server device 2 selects one of the imaging devices 1 as a device for performing imaging and transmitting the captured image. The selection at this point may be by an arbitrary operation, or may be according to the device status of each imaging device 1 or the establishment feasibility of the session, etc. The selection process in this case is not limited. For example, in the example of this figure, it is assumed that the server device 2 initially selects the imaging device 1A among the multiple imaging devices 1 for which communication sessions have been established as the device (source of the transmitted captured image) for transmitting the image.

[0066] Depending on the communication method adopted, for the communication sessions between the server device 2 and each imaging device 1, for the imaging devices 1 that are not selected as the source of the transmitted captured image, the server device 2 may disconnect the session, or may also maintain the period when they are not selected as the source of the transmitted captured image. When disconnecting the session, the session may be established every time an attempt is made to select the source of the transmitted captured image.

[0067] · Communication TP3 An imaging request is sent from the client terminal 3 to the server device 2. For example, when a user of the client terminal 3 performs an operation to request an image of the multi-camera system, such as an operation to request still image capture, an imaging request is sent to the server device 2. Of course, there may also be a request for video imaging / transmission. It is also conceivable that the client terminal 3 automatically sends an imaging request periodically or at a specific time.

[0068] · Communication TP4 In response to the imaging request, the server device 2 sends an imaging request to a certain imaging device 1A that is being selected as the transmission source of the captured image. · Communication TP5 The imaging device 1A performs imaging in response to the imaging request and sends the image as the imaging result to the server device 2. Metadata may also be sent in addition to the image. · Communication TP6 The server device 2 transfers the image as the imaging result sent from the imaging device 1A to the client terminal 3. Thereby, the client terminal 3 can view the image corresponding to the request.

[0069] By performing the above Communication TP3 to Communication TP5 as needed, the client terminal 3 can request still image capture and receive a still image, or request video imaging and view the video streaming. In this way, when a certain imaging device 1A is selected as the transmission source of the captured image by the server device 2 and imaging and transmission are performed by the imaging device 1A in response to a request from the client terminal 3, the server device 2 repeatedly performs a situation determination on the imaging device 1A. That is, the communication TP7, TP8, and the process PS1 indicated by the dashed line are repeated, for example, periodically.

[0070] · Communication TP7 The server device 2 makes an information request to the imaging device 1A. For example, it requests to send information such as a failure status or battery level. · Communication TP8 The imaging device 1A transmits information to the server device 2 in response to an information request. · Processing PS1 The server device 2 performs a situation determination process based on the information received from the imaging device 1A, and determines the necessity of switching the imaging device 1 serving as the transmission source of the captured image.

[0071] If, as a result of the situation determination, it is determined that the imaging device 1A is in a situation suitable for performing imaging and image transmission as it is, the selected state of the imaging device 1A is maintained. That is, the state where imaging and image transmission in response to an imaging request from the client terminal 3 are performed by the imaging device 1A is maintained. On the other hand, if, as a result of the situation determination, it is determined that the imaging device 1A is in a situation not suitable for performing imaging and image transmission, a switching process from the imaging device 1A to another imaging device 1 (for example, the imaging device 1B) is performed.

[0072] · Processing PS2 The server device 2 performs a process of switching the imaging device 1 selected to perform imaging and image transmission from the imaging device 1A to, for example, the imaging device 1B. After performing the switching in this way, the server device 2 repeatedly performs a situation determination for the imaging device 1B. That is, the communication TP9, TP10, and processing PS3 indicated by the broken line are repeated, for example, periodically.

[0073] · Communication TP9 The server device 2 makes an information request to the imaging device 1B. For example, it requests to transmit information such as a failure situation and battery level. · Communication TP10 The imaging device 1B transmits information to the server device 2 in response to the information request. · Processing PS3 The server device 2 performs a situation determination process based on the information received from the imaging device 1B, and determines the necessity of switching the imaging device 1.

[0074] That is, after the switching is performed, immediately thereafter, it is necessary to monitor whether the imaging device 1B after the switching is in an appropriate situation as the imaging device 1 that performs imaging and image transmission. If it is in an inappropriate situation, switching processing to another imaging device 1 is further performed. On the other hand, if the switched imaging device 1B is in an appropriate situation as the imaging device 1 that performs imaging and image transmission, the selected state of the imaging device 1B is maintained. In that case, for example, subsequent communication is performed as shown in the figure.

[0075] · Communication TP11 An imaging request is transmitted from the client terminal 3 to the server device 2. · Communication TP12 The server device 2 transmits an imaging request to the selected imaging device 1B in response to the imaging request. · Communication TP13 The imaging device 1B performs imaging in response to the imaging request, and transmits an image as an imaging result to the server device 2. Metadata may be transmitted in addition to the image. · Communication TP14 The server device 2 transfers the image as the imaging result transmitted from the imaging device 1B to the client terminal 3. Thereby, the client terminal 3 can view the image corresponding to the request.

[0076] For example, in the case of a multi-camera system for facility monitoring or traffic monitoring, by such an operation, an imaging device 1 suitable for monitoring can be selected and image transmission can be performed.

[0077] Note that the order and processing of the communication TP shown above are not necessarily the order shown in the figure. For example, the timing of the generation of the request from the client terminal 3 is indefinite. Therefore, before communication TP3 to communication TP6 are performed, situation determination may be performed as monitoring of the imaging device 1A in communication TP7, TP8, and processing PS1. Basically, as appears in the above communication procedure, the server device 2 sequentially performs a situation determination process on the imaging device 1 selected as the device that captures and transmits an image (the transmission source of the captured image), and as a selection process according to the situation, performs a process of continuing the selection state or switching the imaging device 1 to the selection state.

[0078] Regarding the types of information transmitted from the imaging device 1 for situation determination and the situation determination process according to the information, various examples can be considered, such as operation status determination, imaging suitability status determination, imaging environment status determination, communication suitability status determination, and the like. These details will be summarized and explained after the description of the following second embodiment.

[0079] The communication and processing procedures of the second embodiment are shown in FIG. 5. Hereinafter, the same parts as the above-described communication and processing are denoted by the same reference numerals to avoid redundant detailed description. The second embodiment is an example in which the imaging device 1 transmits information for situation determination to the server device 2 by push notification instead of an information request from the server device 2.

[0080] In the example of FIG. 5, the server device 2 shows a state in which it establishes a session with the imaging device 1A as communication TP2 and selects it as the device that performs imaging image transmission (the transmission source of the captured image). In that state, communication TP3, communication TP4, communication TP5, and communication TP6 are performed in the same manner as in FIG. 4. Then, the communication TP8A for monitoring and the process PS1 shown by the broken line part are repeatedly performed. In this case, as communication TP8A, the imaging device 1A transmits information such as a failure status and battery remaining amount to the server device 2, for example. The server device 2 performs a situation determination process based on the information received from the imaging device 1A and determines the necessity of switching the imaging device 1.

[0081] When switching the imaging device 1 that performs image transmission is performed, for example, the server device 2 establishes a session with the imaging device 1B as communication TP15. Thereafter, as shown by the broken line portion, it will be monitored whether the imaging device 1B after the switching is in an appropriate situation as a device for performing imaging and transmitting the captured image. In this case, as the communication TP10A, the imaging device 1B transmits information such as a failure situation and the remaining battery level to the server device 2, for example. The server device 2 performs a situation determination process based on the information received from the imaging device 1B as the process PS3, and determines the necessity of switching the imaging device 1.

[0082] Also in the second embodiment in this way, the server device 2 performs a situation determination process on the imaging device 1 selected as a device for capturing and transmitting an image, and as a selection process according thereto, performs a process of continuing the selection state or switching the device for capturing and transmitting an image.

[0083] An example of the process of the server device 2 for the operations of the first and second embodiments is shown in FIG. 6. FIG. 6 is an example of the process executed by the control unit 2a (CPU 71 in FIG. 3) of the server device 2.

[0084] As the loop process LP1 in FIG. 6, the control unit 2a repeatedly performs the processes from step S101 to step S104 for each imaging device 1.

[0085] In step S101, the control unit 2a performs a process of establishing a communication session with a certain imaging device 1.

[0086] In step S102, the control unit 2a receives necessary information from the imaging device 1 connected by communication and performs a situation determination. In the first embodiment, this is a process in which the control unit 2a makes an information request to a certain imaging device 1, receives the transmission information from the corresponding imaging device, and performs a situation determination of the imaging device 1. Also in the second embodiment, in response to receiving information as a push notification from a certain imaging device 1, the control unit 2a performs a process of performing a situation determination of the imaging device 1.

[0087] In step S103, the control unit 2a branches the process according to the situation determination result. If the currently connected imaging device 1 is not in a situation suitable as the transmission source of the captured image, the control unit 2a proceeds to step S104, disconnects the session with the imaging device 1, and performs the process from step S101 with another imaging device 1.

[0088] If it is determined that the currently connected imaging device 1 is in a situation appropriate for image capturing and image transmission, the control unit 2a proceeds from step S103 to the loop process LP2. In the loop process LP2, the control unit 2a repeatedly performs the processes from step S110 to step S122 until an end request is received. This is a process of selecting the imaging device 1 during communication connection as the device of the transmission source of the captured image, and performing the process corresponding to the request from the client terminal 3 while performing the monitoring process for the selected imaging device 1.

[0089] In step S110, the control unit 2a receives necessary information from the imaging device 1 during communication connection and performs a situation determination. Also in the first embodiment, the control unit 2a makes an information request to a certain imaging device 1, receives the transmission information from the corresponding imaging device, and performs the process of determining the situation of the imaging device 1. Also in the second embodiment, when the control unit 2a receives information as a push notification from a certain imaging device 1, it performs the process of determining the situation of the imaging device 1.

[0090] In step S111, the control unit 2a branches the process according to the situation determination result. If it is determined that the imaging device 1 currently selected as the transmission source of the captured image is in a situation appropriate for image capturing and image transmission, the control unit 2a proceeds from step S111 to step S112 and determines whether a capture request from the client terminal 3 has been received. If not received, the control unit 2a repeats the process from step S110.

[0091] When the imaging request from the client terminal 3 is received, the control unit 2a proceeds from step S112 to step S120 and transmits the imaging request to the currently selected imaging device 1. Then, the control unit 2a performs the process of receiving the imaging result from the imaging device 1 in step S121, and performs the process of transmitting the imaging result to the client terminal 3 in step S122. As a result, when an imaging image is requested from the client terminal 3, the server device 2 can provide the image transmitted from the currently selected imaging device 1 as the transmission source of the imaging image to the client terminal 3.

[0092] Also, at the stage of step S111, if it is determined that the currently selected imaging device 1 is not in a situation suitable as the transmission source of the imaging image, the control unit 2a proceeds to step S130, disconnects the session with the imaging device 1, and returns to the loop process LP1. Then, the above-described process is performed. The loop process LP1 in this case is a process of switching the imaging device 1 to be the transmission source of the imaging image. When an appropriate imaging device 1 can be selected, it proceeds from step S103 to the loop process LP2, selects the imaging device 1 as the transmission source of the imaging image, and performs the situation monitoring process and the process of responding to requests from the client terminal 3.

[0093] Here, in step S102 and step S110, a situation determination process is performed to determine whether the target imaging device is appropriate as the transmission source of the imaging image. A specific example of this will be given. As the situation determination process, determinations such as the operating status, imaging suitability status, imaging environment status, and communication suitability status can be considered.

[0094] First, the determination of the operating status of the imaging device 1 will be described. The operating status is the situation regarding the operation of the imaging device 1. For example, the power status, the status of the recording medium, the failure status, etc. can be given as specific examples of the operating status.

[0095] First, the determination of the power status means, for example, determining the situation such as the remaining battery level of the imaging device 1, whether an external power source is used or the built-in battery is used as the power source. For example, when using a built-in battery, a decrease in the remaining battery level may hinder subsequent imaging and image transmission. Therefore, the control unit 2a acquires information such as the remaining battery level from the imaging device 1 and determines the battery status, such as whether the remaining level is above a predetermined level. If the remaining level is above the predetermined level, it is considered an appropriate situation as the transmission source of the captured image. On the other hand, when it is determined that the level is insufficient, it is determined as an inappropriate situation as the transmission source of the captured image.

[0096] Note that, based on the remaining battery level status, not only is the suitability / inappropriateness of one imaging device 1 that is the target of the situation determination process determined, but also the remaining battery level statuses of all the imaging devices 1 are compared, and the imaging device 1 with the most remaining level may be set as the imaging device 1 to be selected next in the switching process.

[0097] As an example of the operating status of the imaging device 1, determination of the recording medium status can also be considered. In the imaging device 1, as an imaging operation is The recording control unit 14 records the captured image data and metadata on the recording medium. And there is a case where an image or the like is read from the recording medium and transmitted from the communication unit 16. In that case, when the remaining amount of the recordable capacity of the recording medium decreases, appropriate operations may not be able to be continued. Therefore, the control unit 2a acquires information on the remaining recordable capacity of the recording medium from the imaging device 1 and determines the situation, such as whether the remaining capacity is above a predetermined level. If the remaining capacity is above the predetermined level, it is considered an appropriate situation as the transmission source of the captured image. On the other hand, when it is determined that the capacity is insufficient, it is determined as an inappropriate situation as the transmission source of the captured image.

[0098] Note that, based on the remaining capacity status of the recording medium, not only is the suitability / inappropriateness of one imaging device 1 that is the target of the situation determination process determined, but also the remaining capacity statuses of all the imaging devices 1 are compared, and the imaging device 1 with the most remaining capacity may be set as the imaging device 1 to be selected next in the switching process.

[0099] As an example of the operating status of the imaging device 1, determination of a failure status can also be considered. In the imaging device 1, due to some malfunction, it may not be able to continue proper operation. Therefore, the control unit 2a acquires information indicating normal operation or a failure status from the imaging device 1 and performs a failure status determination. If it is operating normally, it is set as an appropriate status as the transmission source of the captured image. On the other hand, when some malfunction has occurred, it is determined as an inappropriate status as the transmission source of the captured image.

[0100] Next, as a situation determination, it will be explained how to determine the imaging environment status, that is, whether the imaging device is in an appropriate imaging environment. As an example of this, there is determination of the light quantity status. For example, the control unit 2a acquires information of a light quantity sensor corresponding to the position of the imaging device 1 (for example, information of the sensing device 9 built in or arranged in the vicinity of the imaging device 1), and determines the light quantity status around the imaging device 1. Accordingly, it is determined whether the imaging device 1 is in an environment suitable for imaging. For example, at night when the light quantity is low, a high-sensitivity imaging device 1 is considered suitable, and during the day when the light quantity is high, a high-resolution imaging device 1 is considered suitable. Similar suitability determinations can also be made according to the weather. For example, in the case of cloudy or rainy weather, a high-sensitivity imaging device 1 is considered suitable, and in the case of clear weather, a high-resolution imaging device 1 is considered suitable, etc. Furthermore, depending on the arrangement of each imaging device 1, there may be cases where the image quality deteriorates due to the influence of wind and rain. Therefore, depending on the weather, it can also be determined that the imaging device 1 arranged in a state where it is less affected by wind and rain is in a suitable imaging environment status.

[0101] Next, as a situation determination, it will be explained how to determine the imaging suitability status, that is, whether the imaging device is one that can capture a more appropriate image. As an example of determining the imaging suitability status, it is conceivable to determine the distance status to the subject. For example, when it is desired to acquire information about a distant subject, the imaging device 1 with a telephoto lens is selected and information is transmitted. When you want to obtain information about a nearby subject, select the imaging device 1 with the standard lens and send the information. That is, based on the distance to the subject, a situation determination is made as to whether the imaging device 1 is the optimal one, and a process of selecting it as the transmission source is performed.

[0102] As an example of determining the imaging suitability situation, an example of determining the imaging direction or imaging angle of view situation of the imaging device 1 can also be considered. Depending on the imaging direction and angle of view of the imaging device 1, it can be determined whether it is a situation suitable for imaging a predetermined subject.

[0103] Next, an example of determining whether it is an imaging device that captures an image suitable for the communication suitability situation, that is, the communication situation, can be considered. For example, in a situation where the communication speed of the network 6 is reduced, among the imaging devices 1, it can be determined that the imaging device 1 that transmits an imaging image with a smaller data amount is suitable. Conversely, in a situation where a network environment with smooth communication can be used, it can be determined that the imaging device 1 that transmits an imaging image with a large data amount, such as a higher-resolution image, is a transmission source suitable for the situation.

[0104] In the processes of step S102 and step S110, any one of the above examples of situation determination may be performed, or a combination of a plurality of determinations may be performed. Of course, situation determination other than those listed above may be performed. Also, each of the above examples can be applied in combination in the examples after the third embodiment described below.

[0105] <4. Third and Fourth Embodiments> The third and fourth embodiments are examples of selecting a device that transmits an imaging image among a plurality of imaging devices 1 based on the situation determination process for the imaging device 1 and the operation specification information regarding imaging performed at the client terminal 3.

[0106] An example of the communication and processing procedure as the third embodiment is shown in FIG. 7. · Communication TP1 A communication session is established between the server device 2 and a certain imaging device 1B among the plurality of imaging devices. · Communication TP2 A communication session is established between the server device 2 and a certain imaging device 1A among the plurality of imaging devices.

[0107] In this way, the server device 2 establishes communication sessions with each of the plurality of imaging devices 1. Although only two imaging devices 1A and 1B are shown in the figure, for example, if there are five imaging devices 1, communication sessions are established with those five imaging devices 1.

[0108] · Communication TP20 The imaging device 1A transmits information such as the operating status, the angle of view, and the orientation (imaging direction) to the server device 2. · Communication TP21 The imaging device 1B transmits information such as the operating status, the angle of view, and the orientation (imaging direction) to the server device 2.

[0109] In this way, each imaging device 1 transmits information indicating its own situation to the server device 2. In this case, the server device 2 may transmit an information request to each imaging device 1, and the received imaging device 1 may transmit information accordingly. Alternatively, for example, each imaging device 1 may transmit information as a periodic push notification or the like. If there are imaging devices 1 that are not shown in the figure and there are three imaging devices 1, those imaging devices 1 also transmit information to the server device 2 in the same manner.

[0110] The information transmission from each such imaging device 1 is executed sequentially and repeatedly. As a result, the server device 2 can sequentially determine the situation of each imaging device 1. Note that the situation determination includes, as described above, the operating status, the imaging suitability situation, the imaging environment situation, the communication suitability situation, and the like. Depending on what kind of situation determination is performed, the type of information transmitted by the imaging device 1 may be determined. The server device 2 may also request the imaging device 1 to transmit information by specifying specific information.

[0111] · Processing PS4 Through the user interface (UI) on the client terminal 3, information such as the position and size of the imaging target (e.g., the size of the imaging range and the corresponding field of view, etc.) is specified and input. · Communication TP23 An imaging request is sent from the client terminal 3 to the server device 2. In this case, along with the imaging request, information such as position and size is also sent as the specified information set in the processing PS4.

[0112] An example of the UI screen and specified information on the client terminal 3 in this case will be described. FIG. 8A shows an example of the UI screen displayed on the client terminal 3. For example, consider the transfer of an imaging image in a stadium. An image of the stadium as the event venue (real image is also possible) is displayed on the screen, and the user can specify any location by operating the cursor 50 to move the pointer 51. Then, the imaging request button 52 is operated with the pointer 51 positioned at the desired location. In response, the client terminal 3 will execute the communication TP23. The imaging request at that time shall include the position indicated by the pointer 51 as the specified information. Of course, the above is just an example. For example, it is also conceivable to specify a certain range and desire to specify the imaging range. Note that such a UI screen may be provided by the server device 2 to the client terminal 3. For example, the server device 2 enables the client terminal 3 to view and operate the UI screen through a web page or the like.

[0113] FIG. 8B is an example showing a camera icon 53 on the UI screen. For example, when four imaging devices 1 are arranged in the event venue, it is an example showing the positions and imaging directions of those imaging devices 1 on the UI screen. As described in the communication TP20 and TP21, the server device 2 can obtain the arrangement position information and imaging direction (orientation) information from each imaging device 1, and thus provide the UI screen with the camera icon 53 added to the client terminal 3. The camera icon 53 can also represent, for example, the current field of view of each imaging device 1 based on the angle of the triangular portion.

[0114] · Processing PS5 The server device 2 performs optimal device selection processing in response to an imaging request including specified information. In this case, the server device 2 makes a determination of the status of each imaging device 1 (determination of the operating status, imaging suitability status, imaging environment status, communication suitability status, etc. described above) and makes a selection reflecting the position and the like indicated by the specified information. For example, the server device 2 selects an imaging device 1 that can image the position according to the specified information of the imaging position and is suitable for imaging and image transmission as the situation. In that sense, it is conceivable to perform a suitability / incompatibility determination based on the determination result of the imaging direction and the field of view situation according to the specified information.

[0115] · Communication TP24 The server device 2 transmits an imaging request to a certain imaging device 1A selected in the selection process. · Communication TP25 The imaging device 1A performs imaging in response to the imaging request and transmits an image and metadata as the imaging result to the server device 2. · Communication TP26 The server device 2 transfers the image as the imaging result transmitted from the imaging device 1A to the client terminal 3. As a result, the client terminal 3 can view the image taken at the position specified on the UI screen.

[0116] Next, a fourth embodiment will be described with reference to FIG. 9. The fourth embodiment is also an example of reflecting specified information by the UI screen, but uses an aerial image. In the event venue, a plurality of imaging devices 1A, 1B, 1C... are arranged, and one imaging device 1BV is arranged to capture an aerial image. In this case, the imaging devices 1A, 1B, 1C... are installed so as to fit within the imaging field of view of the imaging device 1BV.

[0117] As communication TP30, communication TP31, communication TP32, and communication TP33, the server device 2 establishes communication sessions with each of the imaging devices 1A, 1B, 1C, and imaging device 1BV. Also, as communication TP34, communication TP35, and communication TP36, each of the imaging devices 1A, 1B, and 1C transmits information such as its operating status, field of view angle, and orientation (imaging direction) to the server device 2. As a result, the server device 2 can determine the status of each of the imaging devices 1A, 1B, and 1C.

[0118] In process PS6, for example, at the client terminal 3, an operation to specify an imaging target is performed on a UI screen such as those in FIGS. 8A and 8B described above, or on another screen. For example, it is possible to specify a specific athlete, person, specific object, etc. Then, as communication TP38, the client terminal 3 transmits an imaging request including the designation information of the imaging target to the server device 2.

[0119] In response to such an imaging request, communication TP40 and process PS7 enclosed by a dashed line are repeatedly performed. As communication TP40, the imaging device 1BV transmits an aerial view image to the server device. As process PS7, the server device 2 performs a process of selecting an appropriate imaging device 1 as the image transmission source based on the aerial view image, the designation information, and the status determination of each imaging device 1.

[0120] In this case, the server device 2 determines the position of the imaging target (a specific athlete, etc.) from the aerial view image. Also, it determines the timing at which the imaging target will be captured by each imaging device 1. For example, in the case of a track race, based on the moving speed of the imaging target, the course, etc., and the arrangement positions of the respective imaging devices 1, the optimal imaging device 1 is predicted and selected for each timing. Also, the selection is made taking into account the status determination of the operating status, imaging suitability status, imaging environment status, communication suitability status, etc. of each imaging device 1.

[0121] Then, as communication TP24, the server device 2 transmits an imaging request to a certain imaging device 1A selected in the selection process. The imaging device 1A performs imaging in response to an imaging request and transmits an image and metadata as an imaging result to the server device 2 via communication TP25. The server device 2 transfers the image as an imaging result transmitted from the imaging device 1A to the client terminal 3 via communication TP26.

[0122] Such communication TP24, communication TP25, and communication TP26 are performed while the imaging device 1 selected in the process PS7 is switched at each timing. That is, the server device 2 transmits an imaging request to the optimal imaging device 1 selected in the process PS7 at each time point. As a result, on the client terminal 3, an image of, for example, a specific player specified on the UI screen can be viewed as an image captured by an appropriate imaging device 1 according to the position of the player at each time point.

[0123] By the way, when an aerial image is obtained as described above, the aerial image may be made viewable on the client terminal 3 and used on the UI screen. For example, FIG. 10 shows an example in which a real image or a model image corresponding to the real image as an aerial image is used as the UI screen. A user of the client terminal 3 can operate the cursor 50 on the aerial image to specify, for example, a specific player 56. As a result, it is expected that the user can more accurately recognize and operate the imaging target. A camera icon 53 may be displayed on the aerial image.

[0124] An example of the processing of the server device 2 for the operations of the third and fourth embodiments is shown in FIG. 11. FIG. 11 is an example of the processing executed by the control unit 2a of the server device 2.

[0125] The control unit 2a repeats the processing of step S150 for each imaging device 1 (including the imaging device 1BV that captures an aerial image) as the loop processing LP10 in FIG. 11. That is, in step S150, the control unit 2a performs processing to establish a communication session with the imaging device 1.

[0126] Subsequently, the control unit 2a repeats the loop process LP11 until an end request is received. First, as the loop process LP12, the control unit 2a repeatedly performs the process of step S160 for each imaging device 1. In this case, it is conceivable that the imaging device 1 does not include the imaging device 1BV, but since the imaging device 1BV may also be selected as one of the image transmission sources in some cases, it may be included in the imaging device 1. In this step S160, the control unit 2a performs the process of receiving the transmission information from the imaging device 1. That is, it is the process corresponding to the communications TP20 and TP21 in FIG. 7, and the communications TP34, TP35, and TP36 in FIG. 8.

[0127] In step S161, the control unit 2a checks whether an imaging request has been received from the client terminal 3. If not received, the control unit 2a returns to the loop process LP12.

[0128] If an imaging request has been received from the client terminal 3, the control unit 2a proceeds from step S161 to step S162 and performs the process of selecting the optimal imaging device 1 from the information from each imaging device 1 and the imaging request information including the specified information. That is, it performs the processes described as the process PS5 in FIG. 7 and the process PS7 in FIG. 9.

[0129] After selecting the optimal imaging device 1, in step S163, the control unit 2a transmits an imaging request to the selected imaging device 1. Then, the control unit 2a performs the process of receiving the imaging result from the imaging device 1 in step S164 and performs the process of transmitting the imaging result to the client terminal 3 in step S165. As a result, when an imaging image including specified information is requested from the client terminal 3, the server device 2 can select an appropriate imaging device 1 and provide the image transmitted from that imaging device 1 to the client terminal 3.

[0130] <5. Fifth and Sixth Embodiments> The fifth and sixth embodiments are examples in which situation determination is performed as processing of the MEC5. Note that an example of performing streaming transmission of video will be described.

[0131] First, the fifth embodiment will be described with reference to FIG. 12. This is an example in which the MEC5 performs processing to determine the situation of the currently selected imaging device 1 and switch the image transmission source, as in the first and second embodiments.

[0132] · Communication TP30 A communication session is established between the server device 2 and the MEC5. · Communication TP31, Communication TP32 Communication sessions are established between the MEC5 and each of the imaging devices 1A and 1B.

[0133] · Communication TP33 The server device 2 transmits optimal device selection logic to the MEC5. The optimal device selection logic is logic that indicates what kind of situation determination is performed and how to select an appropriate imaging device 1 as the image transmission source based on the determination result. That is, it is the logic of the situation determination and selection processing of the server device 2 in the first and second embodiments. · Processing PS20 The MEC5 stores the optimal device selection logic.

[0134] · Communication TP34, Communication TP35 Each imaging device 1 transmits information such as its operating status, field of view angle, and orientation (imaging direction) to the MEC5. In this case, the MEC5 may transmit an information request to each imaging device 1, and the received imaging device 1 may transmit information accordingly, or for example, each imaging device 1 may transmit information as a periodic push notification.

[0135] · Processing PS21 The MEC5 performs optimal device selection processing. That is, using the optimal device selection logic, it performs situation determination of each imaging device 1 and selection of the optimal imaging device 1. As the situation determination, there are the operating status, the imaging suitability status, the imaging environment status, the communication suitability status, etc. as described above. According to these situation determinations, the imaging device 1 suitable for image transmission is selected.

[0136] · Communication TP36 MEC5 transmits a streaming start request to a certain imaging device 1B selected by the optimal device selection logic. Although not shown in the figure, in response to this, the imaging device 1B starts streaming transmission. The streaming image is transmitted to the server device 2 via MEC5 and stored, or transferred to the client terminal 3 and displayed and output.

[0137] During the period when streaming transmission is being performed from a certain imaging device 1, the following operations indicated by the broken line part are repeated in the same manner as the above communication TP34, communication TP35, and processing PS21. · Communication TP40, Communication TP41 Each imaging device 1 transmits information such as the operating status, the angle of view, and the orientation (imaging direction) to MEC5. · Processing PS22 MEC5 performs optimal device selection processing.

[0138] Thereby, during the streaming transmission from a certain imaging device 1B, monitoring is performed on changes in the situation of the imaging device 1B and the fact that other imaging devices 1 have become in a more appropriate situation. And if necessary, the subsequent processing PS23 and later are performed.

[0139] · Processing PS23 MEC5 determines that it is appropriate to switch the imaging device 1 as the image transmission source and selects an appropriate imaging device 1. · Communication TP42 MEC5 transmits a streaming stop request to the imaging device 1B. Thereby, the imaging device 1B stops streaming transmission. · Communication TP43 MEC5 transmits a streaming start request to the imaging device 1A determined to be in an appropriate situation. Thereby, the imaging device 1A starts streaming transmission.

[0140] With the above processing, the source of the streaming transmission can be switched according to the situation determination in MEC5. For example, it is suitable for systems such as live cameras, weather cameras, and surveillance cameras. Also, in the case of such an example, even if the network 6 between MEC5 and the server device 2 is disconnected, the optimal imaging device 1 can be determined based on the logic deployed on MEC.

[0141] Examples of the processing for such operations are shown in FIGS. 13 and 14. FIG. 13 shows the processing of the server device 2. The control unit 2a of the server device 2 performs processing to establish a communication session with MEC5 in step S201. Then, in step S202, the control unit 2a transmits the optimal device selection logic to MEC5.

[0142] FIG. 14 shows the processing of MEC5. The processing of MEC5 is the processing of the CPU 71 when the information processing device 70 in FIG. 3 is MEC5.

[0143] MEC5 establishes a communication session with the server device 2 in step S301. In step S302, MEC5 receives the optimal device selection logic from the server device 2 and stores it.

[0144] MEC5 repeats step S303 as the loop process LP30 for the number of imaging devices 1. In this step S303, MEC5 establishes a communication session with the imaging device 1.

[0145] Subsequently, MEC5 repeats the loop process LP31 until an end request is received. First, MEC5 repeats step S310 as the loop process LP32 for the number of imaging devices 1. In this step S310, MEC5 performs processing to receive the transmission information from the imaging device 1. That is, it corresponds to the processing of communication TP34 and communication TP35 in FIG. 12, and communication TP40 and communication TP41 in FIG. 8.

[0146] In step S320, MEC5 determines the optimal imaging device 1 using the optimal device selection logic. In step S321, MEC5 branches the process based on whether to switch the imaging device 1 of the image transmission source according to the determination result. If the selection state is to be maintained, it returns to the loop process LP32 as it is.

[0147] If the imaging device 1 of the image transmission source is to be switched, MEC5 proceeds from step S321 to step S322 and sends a video streaming stop request to the currently streaming imaging device 1. Note that at this point, if video streaming has not been performed yet, it is not necessary to send a streaming stop request. That is, it is the case where the imaging device 1 was first selected at the start of streaming transmission in the process PS21.

[0148] In step S323, MEC5 sends a video streaming start request to the selected imaging device 1. Then it returns to the loop process LP32. As described above, the operation as shown in FIG. 12 is executed.

[0149] Subsequently, the sixth embodiment will be described with reference to FIG. 15. This is an example in which MEC5 makes a selection taking into account the situation determination and the specified information. The specified information may be received from the client terminal 3 by the server device 2 as in the third and fourth embodiments, but it is also conceivable that the server device 2 independently specifies a specific imaging object.

[0150] · Communication TP30 A communication session is established between the server device 2 and MEC5. · Communication TP41, Communication TP42, Communication TP43 A communication session is established between MEC5 and each of the imaging devices 1A, 1B, and 1C.

[0151] After this, the following operations enclosed by the dashed line are repeated. · Communication TP44 The server device 2 transmits an imaging request including designation information such as an imaging target to the MEC 5, for example. · Communication TP45, Communication TP46, Communication TP47 Each imaging device 1 transmits information such as an image and an operating status to the MEC 5.

[0152] · Processing PS30 The MEC 5 performs an optimal image selection process. In this case, among the images transmitted from each imaging device 1, an optimal image suitable for the designation information is selected. It is considered that an image of a device inappropriate for imaging is not selected as the situation of the imaging device 1. · Communication TP48 The MEC 5 transmits the information selected by the optimal image selection process to the server device 2.

[0153] As described above, an operation of collecting information from the imaging device 1 on the MEC 5 and determining information to be passed to the server device 2 is executed. The MEC 5 is given a role of overall control of the imaging device 1.

[0154] Examples of processes for such operations are shown in FIGS. 16 and 17. FIG. 16 shows the processing of the server device 2. The control unit 2a of the server device 2 performs a process of establishing a communication session with the MEC 5 in step S201. The control unit 2a transmits an imaging request including designation information to the MEC 5 in step S210 at a timing as required.

[0155] FIG. 17 shows the processing of the MEC 5. The MEC 5 establishes a communication session with the server device 2 in step S301. Also, the MEC 5 repeats step S303 as many times as the number of imaging devices 1 in the loop process LP30. In this step S303, the MEC 5 establishes a communication session with the imaging device 1.

[0156] Subsequently, MEC5 repeats loop process LP40 until it receives an end request. First, MEC5 checks whether it has received an imaging request from server device 2 in step S350. If it has not received the request, the following processing is not performed, and the check in step S350 continues.

[0157] When an imaging request is received, MEC5 repeats step S351 as loop process LP41 for the number of imaging devices 1. In this step S351, MEC5 performs the process of receiving the captured image and various information from imaging device 1. That is, it corresponds to the processes of communication TP45, communication TP46, and communication TP47 in FIG. 15.

[0158] In step S352, MEC5 performs optimal image selection. In step S353, MEC5 transmits the selected imaging result to server device 2.

[0159] As described above, the operation as shown in FIG. 15 is executed. In the case of this sixth embodiment, it is an example of selecting an image in consideration of the situation determination process and the specified information, and is one aspect of an example of selecting imaging device 1 that is the transmission source of the image transmitted to server device 2 as a result.

[0160] <6. Summary and Modification Examples> According to the above embodiments, the following effects can be obtained. The server device 2 of the embodiment includes a control unit 2a that performs a situation determination process for determining whether the situation regarding the imaging operation in imaging device 1 is a situation suitable for image transmission, and a selection process for selecting imaging device 1 that transmits the captured image among a plurality of imaging devices 1 based on the situation determination process. For example, assume that the site where imaging is performed is a sports or other event venue, etc., and imaging by a plurality of imaging devices 1 is carried out. By determining which imaging device 1 is appropriate for the current imaging and causing it to transmit an image, it becomes possible to selectively capture or receive comprehensively desirable images, such as stable images or images with good content. Therefore, it is possible to improve the quality of the image content, the stability of the operation, and the reliability such as no missing images by imaging with a plurality of imaging devices 1 as so-called multi-cameras. In the embodiment, one imaging device 1 is selected from among the plurality of imaging devices 1, but it may be possible to select a plurality of imaging devices 1. For example, two imaging devices 1 out of five may be selected to execute image transmission. Alternatively, in some cases, it is also assumed that the image transmission from all the imaging devices 1 is switched to be executed.

[0161] The server device 2 according to the first, second, and fifth embodiments performs a situation determination process on the imaging device being selected as the device that performs imaging image transmission, and when it is determined that the imaging device 1 is not in a situation suitable for image transmission, the imaging device 1 that performs image transmission is selected so that it can be switched to another imaging device 1 among the plurality of imaging devices 1. Thereby, for example, arbitrarily or by a selection process, in a situation where a certain imaging device 1 is selected as the device that transmits an imaging image, it is possible to cope with a case where the imaging device 1 is no longer in an appropriate situation for imaging and perform a switch. This contributes to the improvement of the image quality and the stability of the image transmission operation.

[0162] In the first embodiment, as an example, the server device 2 makes an information request to the imaging device 1 and performs a situation determination process based on the information transmitted from the imaging device 1 in response to the information request. Thereby, it is possible to perform a situation determination process on the imaging device for which it is necessary to perform a determination process, and the process is made more efficient. In particular, instead of always performing the situation determination process for all imaging devices 1, for example, by repeatedly making an information request to the imaging device that is currently transmitting an image and performing the situation determination process, only the necessary situation determination is executed, which also has effects such as improving the system operation efficiency and reducing the traffic load by reducing unnecessary communication.

[0163] In the second embodiment, the server device 2 is based on the notification information from the imaging device 1 that is currently being selected as the device for transmitting the captured image situation determination process to perform 。 That is, the imaging device side is made to transmit notification information to the information processing device at necessary times or at regular timings, etc. The information processing device performs a situation determination process for the imaging device during image transmission according to the notification information. Thereby, it is only necessary to monitor the information transmitted as a push notification or the like from the imaging device 1 that is selected as the device for performing image transmission, and there is a possibility that the processing load on the server device 2 side can be reduced. In particular, if the imaging device 1 transmits a push notification when there is a change or fluctuation in the situation, the server device 2 can perform the situation determination process and take countermeasures when necessary without always performing monitoring.

[0164] In the third and fourth embodiments, the server device 2 performs a situation determination process for two or more of the plurality of imaging devices 1, and in the selection process, an example of selecting an imaging device that transmits a captured image among the plurality of imaging devices 1 based on the situation determination process and the specified information regarding imaging has been described. Thereby, it is possible to monitor the situations of the respective imaging devices 1 arranged as a multi-camera, select the imaging device 1 that can be determined to be optimal, and execute image transmission.

[0165] In the third embodiment, information on the position of the subject is cited as the specified information. As a result, it is possible to select an imaging device 1 suitable for imaging at a specific position among the imaging devices 1 arranged as a multi-camera and execute image transmission. For example, by specifying a position on the client terminal 3 side, it becomes possible to provide an image desired by the client side.

[0166] In the fourth embodiment, information for designating an imaging object is cited as the designation information. As a result, among the imaging devices 1 arranged as a multi-camera, it is possible to select an imaging device 1 suitable for imaging a specific person or the like as an imaging object and execute image transmission. For example, by designating an imaging object on the client terminal 3 side, it becomes possible to provide an image desired by the client side.

[0167] As an example of the situation determination process of the embodiment, determination of the power supply situation of the imaging device 1 has been described. For example, determination is made about the remaining battery level of the imaging device, the situation such as whether it is an external power supply / battery, etc. As a result, it is determined whether the imaging device 1 is in a power supply situation suitable for continuous imaging / image transmission, and a selection process for switching the imaging device 1 can be performed as necessary. As a result, it is possible to switch from an imaging device 1 that is likely to become unable to image due to the power supply situation to another imaging device 1 and continue stable image transmission of still images and moving images.

[0168] As an example of the situation determination process of the embodiment, determination of the failure situation of the imaging device 1 has been described. As a result, it is possible to monitor that the imaging device 1 is in a situation where it is not suitable for continuous imaging / image transmission due to equipment failure, and a selection process for switching the imaging device 1 can be performed as necessary. Therefore, stable image transmission can be continued in the multi-camera system.

[0169] As an example of the situation determination process of the embodiment, determination of the situation of the recording medium of the imaging device 1 has been described. For example, determination is made about the recordable capacity of the recording medium in the imaging device 1 or defects of the recording medium. As a result, it is possible to continuously record captured images appropriately by the imaging device 1, and to monitor whether stable image transmission is possible or not.

[0170] As an example of the situation determination process of the embodiment, an example of determining the situation of the imaging environment of the imaging device 1 has been described. For example, the amount of light and the weather at the location where the imaging device is arranged are determined. Thereby, it is determined whether the imaging device 1 can appropriately perform image imaging. For example, in a stadium or an event venue, the lighting situation and the influence of the weather vary depending on the location, and the imaging device 1 that achieves an appropriate brightness state for imaging may change at each time point. It is possible to cope with such changes in the brightness situation. Also, assuming live cameras or the like fixedly arranged at various locations, the installation location and imaging direction of the imaging device 1 vary between a situation suitable for imaging and an unsuitable situation due to the influence of rain or wind. It is possible to select a suitable imaging device 1 according to such a situation.

[0171] As an example of the situation determination process of the embodiment, an example of determining the situation of the distance to the imaging target of the imaging device 1 has been described. For example, the situation of the distance from the location where the imaging device 1 is arranged to a specific subject is determined to select an appropriate imaging device 1. Alternatively, an appropriate imaging device 1 is selected based on the relationship between the function of the imaging device 1 and the distance. Thereby, it is possible to select the imaging device 1 having an appropriate distance relationship with the subject. Also, it is possible to select the imaging device 1 equipped with a telephoto lens for a distant subject, or to select the imaging device 1 equipped with a standard lens for a nearby subject.

[0172] As an example of the situation determination process of the embodiment, an example of determining the compatibility situation between the captured image of the imaging device 1 and the communication speed has been described. Thereby, it is possible to select the imaging device 1 that captures an image with an appropriate data size according to the current communication speed by the network 6. For example, when the communication speed is decreasing, the imaging device 1 with a small data size of the captured image is selected to avoid a large amount of data transmission.

[0173] As an example of the situation determination process in the embodiment, a determination of the situation of the imaging direction or the imaging angle of view of the imaging device 1 has been described. Depending on the imaging direction and the angle of view of the imaging device, it can be determined whether the situation is suitable for imaging a predetermined subject. Thereby, it is possible to select the imaging device 1 having an appropriate imaging direction and angle of view for the target subject, and it is possible to obtain a desirable image as an image of the target subject.

[0174] In the embodiment, the processing of the server device 2 and the information processing device 70 as the MEC 5 has been mainly described. However, as a specific example of the information processing device of the present disclosure, for example, it is not limited to an information processing device as a cloud server or an MEC, and various examples can be considered. Examples of the information processing device include a personal computer device, a tablet-type information processing device, a mobile phone device, a game device, an audio device, a video device, a communication device, a television device, and various examples are assumed. Any device capable of performing arithmetic operations as information processing, for example, a device incorporating a microcomputer, can be realized as the information processing device of the present disclosure.

[0175] The program of the embodiment is a program that causes a device such as a CPU, a DSP, or the like, or a device including these to execute the processing of the server device 2 and the MEC 5 described above. That is, the program of the embodiment is a program that causes the information processing device to execute a situation determination process for determining whether the situation regarding the imaging operation in the imaging device 1 is a situation suitable for image transmission, and a selection process for selecting the imaging device 1 that transmits the captured image among a plurality of imaging devices 1 based on the situation determination process. With such a program, the server device 2 and the MEC 5 described above can be realized by various computer devices.

[0176] These programs can be recorded in advance in an HDD as a recording medium built in a device such as a computer device, a ROM in a microcomputer having a CPU, or the like. Alternatively, it can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), Blu-ray Disc (registered trademark), magnetic disk, semiconductor memory, memory card, etc. Such a removable recording medium can be provided as so-called packaged software. In addition to installing such a program from a removable recording medium to a personal computer or the like, it can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0177] Also, according to such a program, it is suitable for wide provision of the server device 2 and MEC 5 of the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, a mobile phone, a personal computer, a game device, a video device, a PDA (Personal Digital Assistant), etc., the smartphone or the like can be made to function as the server device 2 and the imaging device 1 of the present disclosure.

[0178] Note that the effects described in this specification are merely examples and are not limited, and there may be other effects.

[0179] Note that this technology can also adopt the following configurations. (1) A situation determination process for determining whether the situation regarding the imaging operation in the imaging device is a situation suitable for image transmission, and A selection process for selecting an imaging device that transmits an imaging image among a plurality of imaging devices based on the situation determination process, and An information processing apparatus including a control unit that performs the above. (2) The control unit Perform the above-described situation determination process for the imaging device selected as the device that performs imaging image transmission, When it is determined that the imaging device is not in a situation suitable for image transmission, perform the above-described selection process so that the imaging device that performs image transmission can be switched to another imaging device among the plurality of imaging devices The information processing apparatus according to (1) above. (3) The control unit makes an information request to the imaging device, and performs the above-described situation determination process based on the information transmitted from the imaging device in response to the information request The information processing apparatus according to (1) or (2) above. (4) The control unit performs the above-described situation determination process based on the notification information from the imaging device selected as the device that performs imaging image transmission The information processing apparatus according to (1) or (2) above. (5) The control unit Performs the above-described situation determination process for two or more imaging devices among the plurality of imaging devices, In the above-described selection process, based on the above-described situation determination process and the designation information regarding imaging, select an imaging device that transmits an imaging image among the plurality of imaging devices The information processing apparatus according to (1) above. (6) The above-described designation information is information on the position to be the subject The information processing apparatus according to (5) above. (7) The above-described designation information is information that designates an imaging target The information processing apparatus according to (5) above. (8) In the above-described situation determination process, determine the power supply situation of the imaging device The information processing apparatus according to any one of (1) to (7) above. (9) In the above-described situation determination process, determine the failure situation of the imaging device The information processing apparatus according to any one of (1) to (8) above. (10) In the situation determination process, the situation of the recording medium of the imaging device is determined. The information processing apparatus according to any one of (1) to (9) above. (11) In the situation determination process, the situation of the imaging environment of the imaging device is determined. The information processing apparatus according to any one of (1) to (10) above. (12) In the situation determination process, the situation of the distance to the imaging target of the imaging device is determined. The information processing apparatus according to any one of (1) to (11) above. (13) In the situation determination process, the compatibility situation between the captured image of the imaging device and the communication speed is determined. The information processing apparatus according to any one of (1) to (12) above. (14) In the situation determination process, the situation of the imaging direction or imaging angle of view of the imaging device is determined. The information processing apparatus according to any one of (1) to (13) above. (15) A situation determination process for determining whether the situation regarding the imaging operation in the imaging device is a situation suitable for image transmission, and A selection process for selecting an imaging device that transmits a captured image among a plurality of imaging devices based on the situation determination process, and An information processing method performed by the information processing apparatus. (16) A situation determination process for determining whether the situation regarding the imaging operation in the imaging device is a situation suitable for image transmission, and A selection process for selecting an imaging device that transmits a captured image among a plurality of imaging devices based on the situation determination process, and A program that causes the information processing apparatus to execute.

Description of Signs

[0180] 1 Imaging device 2 Server device 2a Control unit 3 Client terminal 4 Base station 5 MEC 6 Network 70 Information Processing Device 71 CPU

Claims

1. A situation determination process for determining whether a situation regarding an imaging operation in an imaging device is a situation suitable for image transmission, and a selection process for selecting, based on the situation determination process, an imaging device that transmits an imaging image among a plurality of imaging devices, comprising a control unit that performs the above, wherein in the situation determination process, at least one of a power supply situation of the imaging device, a failure situation of the imaging device, and a situation of a recording medium of the imaging device is determined. An information processing device.

2. The control unit, performs the situation determination process for an imaging device being selected as a device that performs imaging image transmission, and when it is determined that the imaging device is not in a situation suitable for image transmission, performs the selection process so that the imaging device that performs image transmission can be switched to another imaging device among the plurality of imaging devices. The information processing device according to Claim 1.

3. The control unit makes an information request to the imaging device and performs the situation determination process based on the information transmitted from the imaging device in response to the information request. The information processing device according to Claim 1.

4. The control unit performs the situation determination process based on notification information from an imaging device being selected as a device that performs imaging image transmission. The information processing device according to Claim 1.

5. The control unit, performs the situation determination process for two or more imaging devices among the plurality of imaging devices, and in the selection process, selects an imaging device that transmits an imaging image among the plurality of imaging devices based on the situation determination process and designation information regarding imaging. The information processing device according to Claim 1.

6. The designation information is information on a position to be a subject. The information processing device according to Claim 5.

7. The designation information is information that designates an imaging target. The information processing device according to Claim 5.

8. In the situation determination process, a situation of the imaging environment of the imaging device is determined. The information processing device according to Claim 1.

9. In the situation determination process, a situation of the distance to the imaging target of the imaging device is determined. The information processing device according to Claim 1.

10. In the situation determination process, a compatibility situation between the imaging image of the imaging device and the communication speed is determined. The information processing device according to Claim 1.

11. In the situation determination process, a situation of the imaging direction or imaging angle of view of the imaging device is determined. The information processing device according to Claim 1.

12. An information processing device, a situation determination process for determining whether a situation regarding an imaging operation in an imaging device is a situation suitable for image transmission, A selection process of selecting an imaging device that transmits an imaging image among a plurality of imaging devices based on the situation determination process; is performed; In the situation determination process, a determination is made on at least one of the power supply situation of the imaging device, the failure situation of the imaging device, and the situation of the recording medium of the imaging device information processing method.

13. A situation determination process for determining whether a situation related to an imaging operation in an imaging device is a situation suitable for image transmission; A selection process of selecting an imaging device that transmits an imaging image among a plurality of imaging devices based on the situation determination process; is caused to be executed by an information processing device; In the situation determination process, a process of determining at least one of the power supply situation of the imaging device, the failure situation of the imaging device, and the situation of the recording medium of the imaging device A program for causing an information processing device to execute.

Citation Information

Patent Citations

  • Information processing apparatus and information processing method, and program

    JP2007150781A

  • Multi-eye camera

    JP2008196891A

  • Information processor, information processing system and program

    JP2014075742A

  • Camera, photography control program and photography control method, and camera system

    JP2014239318A

  • Camera selecting method and video distribution system

    JP2016213808A