Information processing system, information processing method, and information processing apparatus

Abstract

An information processing system (1) comprises a specifying means (12) for specifying, according to an analysis result based on an image to be encoded and delivered, the image quality of an area including a specific part used for analysis in an image to be delivered, and a control means (13) for providing a control to deliver an image of which the area including the specific part has the image quality.

Description

Technical Field

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing apparatus.

Background Art

[0002] Techniques for performing various analyses (medical treatment, diagnosis, inspection) based on images are known. In relation to this technique, Patent Document 1 describes an invention in which a learned model obtained by learning the compression rate of image data generated by equipment such as X-ray CT is used to maintain the image quality of the expanded image at a desired level. Also, regarding parts that do not require observation, it is described that the degree of compression is increased. Further, Patent Document 2 describes an invention in which, in a remote desktop that transfers screen data of a processing result to a client, the operation state of the client is determined, and the quality of medical image data is adjusted based on the determination result and the available bandwidth of the network.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, Patent Document 1 does not consider how to handle the case where analysis is performed based on an image distributed via a network. Also, Patent Document 2 does not consider how to handle the case where it is difficult to perform analysis based on an image. Therefore, Patent Documents 1 and 2 have a problem in that, for example, analysis based on an image (including a still image and a moving image (video)) distributed via a network may not be appropriately executed.

[0005] An object of the present disclosure is to provide a technique capable of appropriately performing analysis based on an image distributed via a network in view of the above-described problems. **Means for Solving the Problems**

[0006] In a first aspect according to the present disclosure, an information processing system includes: a specifying means for specifying the image quality of a region including a specific part used for analysis in a distributed image according to an analysis result based on the encoded and distributed image; and a control means for performing control to distribute an image of the image quality for the region including the specific part.

[0007] In a second aspect according to the present disclosure, there is provided an information processing method for executing: a process of specifying the image quality of a region including a specific part used for analysis in a distributed image according to an analysis result based on the encoded and distributed image; and a process of performing control to distribute an image of the image quality for the region including the specific part.

[0008] In a third aspect according to the present disclosure, an information processing apparatus includes: a specifying means for specifying the image quality of a region including a specific part used for analysis in a distributed image according to an analysis result based on the encoded and distributed image; and a control means for performing control to distribute an image of the image quality for the region including the specific part. **Advantages of the Invention**

[0009] According to one aspect, analysis based on an image distributed via a network can be appropriately performed. **Brief Description of the Drawings**

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0011] <One Embodiment> The principles of the present disclosure are described with reference to several exemplary embodiments. These embodiments are described for illustrative purposes only and are intended to help those skilled in the art understand and implement the present disclosure without suggesting any limitations on the scope of the present disclosure. The disclosure described herein may be implemented in various ways other than those described below. In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] <Configuration> Referring to FIG. 1, the configuration of an information processing apparatus 10 according to an embodiment will be described. FIG. 1 is a diagram showing an example of the configuration of the information processing apparatus 10 according to the embodiment. The information processing apparatus 10 has a specific part 12 and a control part 13. Each of these parts may be realized by the cooperation of one or more programs installed in the information processing apparatus 10 and hardware such as the processor 101 and the memory 102 of the information processing apparatus 10.

[0013] The specific unit 12 determines, for example, the image quality of the area of a specific part in an image according to the analysis result based on the encoded and distributed image. Also, the specific unit 12 receives (acquires) various types of information from the storage unit inside the information processing apparatus 10 or an external device. The specific unit 12 executes various processes based on the image captured by the imaging device 20 and distributed. The specific unit 12 may, for example, cause an analysis module or the like inside or outside the information processing apparatus 10 to perform an analysis (inspection, analysis, estimation) based on the area of a specific part of the subject in the image. For example, the heart rate may be analyzed based on the image of the area of the subject's face. When the analysis is to be executed by an external device, the specific unit 12 may transmit the image to the external device and acquire the analysis result from the external device.

[0014] The control unit 13 transmits (outputs) information based on the determination result by the specific unit 12 to each processing unit inside the information processing apparatus 10 or an external device. The control unit 13 transmits, for example, information (command) for causing an image with the image quality determined by the specific unit 12 for the area of the specific part to be distributed. Here, the command may include, for example, information indicating the area of the specific part and information indicating the image quality of the area of the specific part.

[0015] Note that the information processing apparatus 10 may be the device to which the image captured by the imaging device 20 and encoded is distributed, or may be the device from which the image captured by the imaging device 20 and encoded is distributed.

[0016] <Processing> Next, with reference to FIG. 2, an example of the processing of the information processing apparatus 10 according to the embodiment will be described. FIG. 2 is a flowchart showing an example of the processing of the information processing apparatus 10 according to the embodiment.

[0017] In step S1, the specifying unit 12 determines the second image quality of the area of the specific part in the second image captured by the imaging device 20 according to the analysis result based on the area of the specific part of the subject with the first image quality in the first image captured by the imaging device 20 and distributed via the network. Subsequently, the control unit 13 causes the second image with the area of the specific part having the second image quality to be distributed (step S2).

[0018] (Example of processing when the information processing apparatus 10 is the apparatus of the image distribution destination) When the information processing apparatus 10 is the apparatus of the image distribution destination, the specifying unit 12 may receive an image via the network N. Then, the specifying unit 12 may determine the image quality according to the analysis result based on the image. Then, the control unit 13 may transmit a command for setting (changing) the image distributed from the apparatus of the distribution destination to the said image quality to the said apparatus of the distribution destination.

[0019] (Example of processing when the information processing apparatus 10 is the apparatus of the image distribution source) When the information processing apparatus 10 is the apparatus of the image distribution source, the specifying unit 12 may receive an image from the imaging device 20 built in the information processing apparatus 10 via the internal bus. Further, the specifying unit 12 may receive an image from an external (external) imaging device 20 connected to the information processing apparatus 10 by a cable or the like via an external bus (for example, a USB (Universal Serial Bus) cable, an HDMI (registered trademark) (High-Definition Multimedia Interface) cable, an SDI (Serial Digital Interface) cable). Then, the specifying unit 12 may determine the image quality according to the analysis result based on the encoded image. Then, the specifying unit 12 may determine the image quality according to the analysis result based on the encoded image by a module or the like that performs the encoding process inside the information processing apparatus 10. Note that the analysis based on the encoded image may be executed by the information processing apparatus 10 or by an external device. Then, the control unit 13 may transmit a command for setting (changing) the image distributed from the information processing apparatus 10 to the said image quality to the module that performs the encoding process inside the information processing apparatus 10 or the imaging device 20.

[0020] <Hardware Configuration> FIG. 3 is a diagram showing a hardware configuration example of the information processing apparatus 10 according to the embodiment. In the example of FIG. 3, the information processing apparatus 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components may be connected by a bus or the like. The memory 102 stores at least a part of the program 104. The communication interface 103 includes an interface necessary for communication with other network elements.

[0021] When the program 104 is executed by the cooperation of the processor 101 and the memory 102 and the like, at least a part of the processing of the embodiment of the present disclosure is performed by the computer 100. The memory 102 may be of any type suitable for a local technical network. The memory 102 may be, as a non-limiting example, a non-transitory computer-readable storage medium. Also, the memory 102 may be implemented using any suitable data storage technology such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown for the computer 100, there may be several physically different memory modules in the computer 100. The processor 101 may be of any type. The processor 101 may include a general-purpose computer, a dedicated computer, a microprocessor, a digital signal processor (DSP), and one or more processors based on a multi-core processor architecture as a non-limiting example. The computer 100 may have a plurality of processors such as an application-specific integrated circuit chip that is temporally dependent on a clock that synchronizes the main processor.

[0022] Embodiments of the present disclosure may be implemented in hardware or dedicated circuitry, software, logic or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor or other computing device.

[0023] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, that are executed on a device on a target actual processor or virtual processor to execute the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The functions of the program modules may be combined or divided among the program modules as desired in various embodiments. The machine-executable instructions of the program modules can be executed within a local or distributed device. In a distributed device, the program modules can be arranged on both local and remote storage media.

[0024] The program code for executing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes are provided to a processor or controller of a general-purpose computer, a dedicated computer, or other programmable data processing devices. When the program code is executed by the processor or controller, the functions / operations in the flowchart and / or the implementation block diagram are executed. The program code is executed entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine, partly on a remote machine, or entirely on a remote machine or server.

[0025] The program can be stored using various types of non-transitory computer-readable media and supplied to a computer. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media, magneto-optical recording media, optical disk media, semiconductor memories, etc. Magnetic recording media include, for example, flexible disks, magnetic tapes, hard disk drives, etc. Magneto-optical recording media include, for example, magneto-optical disks, etc. Optical disk media include, for example, Blu-ray disks, CD (Compact Disc)-ROM (Read Only Memory), CD-R (Recordable), CD-RW (ReWritable), etc. Semiconductor memories include, for example, solid state drives, mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (random access memories), etc. Also, the program may be supplied to the computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.

[0026] <System Configuration> Next, referring to FIG. 4, the configuration of the information processing system 1 according to the embodiment will be described. FIG. 4 is a diagram showing a configuration example of the information processing system 1 according to the embodiment. In the example of FIG. 4, the information processing system 1 includes an information processing apparatus 10A and an information processing apparatus 10B (hereinafter, simply referred to as "information processing apparatus 10" when there is no need to distinguish). Note that the number of the information processing apparatus 10A and the information processing apparatus 10B is not limited to the example of FIG. 4.

[0027] Note that the technology of the present disclosure may be used, for example, in the measurement of biological information based on an image of a patient in a video conference (video call, online medical treatment) between a doctor and a patient (human, animal). Further, the technology of the present disclosure may be used, for example, in the analysis (identification) of a person and the analysis (estimation) of behavior based on an image of a surveillance camera. Further, the technology of the present disclosure may be used, for example, in the analysis (inspection) of a product based on an image of a surveillance camera in a factory or a plant.

[0028] In the example of FIG. 4, the information processing apparatus 10A and the information processing apparatus 10B are connected so as to be able to communicate via the network N. Examples of the network N include, for example, the Internet, a mobile communication system, a wireless LAN (Local Area Network), a LAN, and short-range wireless communication such as BLE (Bluetooth (registered trademark) Low Energy). Examples of the mobile communication system include, for example, the fifth-generation mobile communication system (5G), the fourth-generation mobile communication system (4G), the third-generation mobile communication system (3G), and the like.

[0029] The information processing apparatus 10A may be, for example, a device such as a smartphone, a tablet, or a personal computer. The information processing apparatus 10A encodes an image (including a still image and a moving image (video)) captured by a built-in or external imaging device (camera) 20 by an arbitrary encoding method and distributes it to the information processing apparatus 10B via the network N. The encoding method may include, for example, H.265 / HEVC (High Efficiency Video Coding), AV1 (AOMedia Video 1), H.264 / MPEG-4 AVC (Advanced Video Coding), and the like.

[0030] The information processing apparatus 10B may be, for example, a device such as a personal computer, a server, a cloud, a smartphone, or a tablet. The information processing apparatus 10B may, for example, cause a display device to display an image distributed from the information processing apparatus 10A. Further, the information processing apparatus 10B may, for example, perform analysis based on the image distributed from the information processing apparatus 10A. When the processing such as the specification of the image quality of the present disclosure is performed in the apparatus that is the distribution source of the image, the information processing apparatus 10A is an example of the "information processing apparatus" of the present disclosure. When the processing such as the specification of the image quality of the present disclosure is performed in the apparatus that is the distribution destination of the image, the information processing apparatus 10B is an example of the "information processing apparatus" of the present disclosure.

[0031] <First Embodiment> <Processing> Next, with reference to FIGS. 5 to 7, an example of the processing of the information processing system 1 according to the embodiment will be described. FIG. 5 is a sequence diagram showing an example of the processing of the information processing system 1 according to the embodiment. FIG. 6 is a diagram showing an example of the image quality change content DB (database) 601 according to the embodiment. FIG. 7 is a diagram showing an example of the area of a specific part according to the embodiment.

[0032] Hereinafter, as an example, in the case of measuring biometric information based on an image of a patient in a video conference (video call, online medical treatment) between a doctor and a patient, an example of determining the image quality of a specific part or the like in the doctor's information processing apparatus 10B will be described. Hereinafter, it is assumed that the processing such as the establishment of the video conference session has already been completed between the patient's information processing apparatus 10A and the doctor's information processing apparatus 10B.

[0033] In step S101, the information processing apparatus 10A distributes (transmits) a first image obtained by encoding the area of the specific part of the subject in the image captured by the imaging apparatus 20 with the first image quality to the information processing apparatus 10B via the network N.

[0034] Subsequently, the specifying unit 12 of the information processing apparatus 10B acquires the analysis result of the information of the subject based on the region of the specific part of the subject with the first image quality in the received first image (step S102). Note that the specifying unit 12 of the information processing apparatus 10B may acquire the analysis result from an external device (an example of the "analysis means"), or may acquire the analysis result by an analysis module (an example of the "analysis means") inside the information processing apparatus 10B. Here, the analysis process based on the image (the process of estimating (calculating, inferring, measuring) various information of the subject) may be executed by, for example, AI (Artificial Intelligence) using deep learning or the like. The analysis target (the item of the subject information) may include at least one of, for example, heart rate, respiratory rate, blood pressure, swelling, percutaneous arterial oxygen saturation, pupil size, throat swelling, and the degree of periodontal disease. Note that the analysis target may be specified (selected, set) in advance by a doctor or the like. Further, the specifying unit 12 of the information processing apparatus 10B may determine one or more analysis targets based on the result of the medical interview input in advance from the patient by a predetermined website or the like.

[0035] The information processing apparatus 10B may estimate the heart rate based on the video of the region where the patient's skin is exposed (for example, the region of the face (an example of the "specific part")). In this case, the information processing apparatus 10B may estimate the heart rate based on, for example, the transition (period) of the change in the skin color.

[0036] Further, the information processing apparatus 10B may estimate the respiratory rate based on the video of the region of the patient's chest (upper body). In this case, the information processing apparatus 10B may estimate the respiratory rate based on, for example, the period of the movement of the shoulder (an example of the "specific part").

[0037] Further, the information processing apparatus 10B may estimate the blood pressure based on the video of the region where the patient's skin is exposed (for example, the region of the face (an example of the "specific part")). In this case, the information processing apparatus 10B may estimate the blood pressure based on, for example, the difference and shape of the pulse waves estimated from two locations on the face (for example, the forehead and the cheek (an example of the "specific part")).

[0038] In addition, the information processing apparatus 10B may estimate the percutaneous arterial oxygen saturation (SpO2) based on an image of an area where the patient's skin is exposed (for example, an area of the face (an example of a "specific site")). Note that red is likely to be transmitted when hemoglobin is combined with oxygen, and blue is less likely to be affected by the combination of hemoglobin and oxygen. Therefore, the information processing apparatus 10B may estimate SpO2 based on, for example, the difference in the degree of change between blue and red of the skin near the cheekbone under the eyes (an example of a "specific site").

[0039] In addition, the information processing apparatus 10B may estimate the degree of swelling, for example, based on an image of an area of the patient's eyelid (an example of a "specific site"). Also, the information processing apparatus 10B may estimate the size of the pupil (pupil diameter), for example, based on an image of an area of the patient's eye (an example of a "specific site"). Further, the information processing apparatus 10B may estimate the degree of throat swelling, periodontal disease, etc., for example, based on an image of an area inside the patient's oral cavity (an example of a "specific site").

[0040] In step S102, when the analysis is successful (for example, when the reliability of the estimated result calculated by AI or the like is equal to or higher than a threshold value), the specific unit 12 of the information processing apparatus 10B may cause the display device to display the biometric information (vital sign) of the patient, which is the analysis result, and may not execute the processing after step S103. Note that the specific unit 12 of the information processing apparatus 10B may continue the analysis and display the analysis result in real time.

[0041] On the other hand, if the analysis fails in step S102, the specifying unit 12 of the information processing apparatus 10B determines the image quality of the region of the specific part in the second image captured by the imaging device 20 of the information processing apparatus 10A to be higher than the first image quality (step S103). Thereby, for example, when the analysis of a certain analysis target fails, the region of the specific part corresponding to the analysis target is made higher in image quality (higher definition). Therefore, the possibility of succeeding in subsequent analysis (the reliability (accuracy) of the analysis result) can be improved. Also, for example, even in an image where the distance from the imaging device 20 to the patient is relatively large, the accuracy of the analysis can be improved. Also, by making only the region of the specific part higher in image quality, an increase in the bandwidth used for distribution can be reduced. Note that the second image may be the same image as the first image or a different image. For example, when the image is distributed in real time, the first image is the image captured during the process of step S101, and the second image is the image captured at a time point after the process of step S104.

[0042] Note that when the analysis result is an analysis failure due to the failure to detect a subject (for example, a person, an example of the "specific part"), the specifying unit 12 of the information processing apparatus 10B may make the entire second image higher in image quality. Also, when the analysis result is an analysis failure due to the failure to detect, for example, the face of a subject (an example of the "specific part"), the specifying unit 12 of the information processing apparatus 10B may make the region of the subject in the second image higher in image quality. Also, when the analysis result is an analysis failure due to the failure to detect, for example, the eyes, mouth, cheeks, etc. (an example of the "specific part"), the specifying unit 12 of the information processing apparatus 10B may make at least a part (for example, the face) of the subject higher in image quality.

[0043] Also, when the value of the reliability of the analysis result calculated based on, for example, deep learning or the like is equal to or less than a threshold value, the specifying unit 12 of the information processing apparatus 10B may determine that the analysis has failed. Then, the specifying unit 12 of the information processing apparatus 10B may determine the content of the image quality change according to the analysis item for which the analysis has failed. In this case, the specifying unit 12 of the information processing apparatus 10B may refer to, for example, the image quality change content DB601 and extract information on the content of the image quality change corresponding to the analysis target for which the analysis has failed. Note that the image quality change content DB601 may be stored (registered, set) in the storage device inside the information processing apparatus 10B, or may be stored in a DB server or the like outside the information processing apparatus 10B. In the example of FIG. 6, the content of the image quality change is recorded in the image quality change content DB601 in association with the analysis target. In the example of FIG. 6, for example, when the analysis of the heart rate fails, it is stipulated to increase the image quality of the face area or the like.

[0044] Then, the specifying unit 12 of the information processing apparatus 10B may specify the area of the part defined by the determined content of the image quality change in the image captured by the imaging apparatus 20. Here, the specifying unit 12 of the information processing apparatus 10B may determine, by AI or the like, a rectangular (square or rectangular) area including parts such as the face based on the distributed image, and use the rectangular area as the area of the specifying part. Note that the information indicating the area of the specifying part may include, for example, the coordinate positions of the pixels at the lower left and upper right of the area. Alternatively, the information indicating the area of the specifying part may include, for example, information on a map (QP map) that sets quantization parameters (QP values) of coding for each specific pixel area unit (for example, 16 pixels in length × 16 pixels in width).

[0045] Then, the specifying unit 12 of the information processing apparatus 10B may determine information indicating the image quality of the region of the specific part based on the encoding method or the like of the image captured by the imaging apparatus 20. In this case, the information indicating the image quality of the region of the specific part may include, for example, at least one of the encoding bit rate, the encoding frame rate, and the encoding quantization parameter (QP value). Note that the specifying unit 12 of the information processing apparatus 10B can increase the image quality, for example, by setting the encoding bit rate of the second image quality to be higher (larger) than the encoding bit rate of the first image quality. Further, the specifying unit 12 of the information processing apparatus 10B can increase the image quality, for example, by setting the encoding frame rate of the second image quality to be higher (larger) than the encoding frame rate of the first image quality. Further, the specifying unit 12 of the information processing apparatus 10B can increase the image quality, for example, by setting the encoding quantization parameter (QP value) of the second image quality to be smaller than the encoding bit rate of the first image quality.

[0046] When hierarchical encoding (SVC, Scalable Video Coding) is used as the encoding method of the image captured by the imaging apparatus 20, the specifying unit 12 of the information processing apparatus 10B may determine to use the entire image as the base layer and the region of the specific part as the enhancement layer. In this case, the information indicating the image quality of the region of the specific part may include the bit rate of each layer of 1 or more including at least the enhancement layer.

[0047] Further, the information indicating the image quality of the region of the specific part may include the settings of the imaging apparatus 20. The settings of the imaging apparatus 20 may include settings related to adjustment of the image quality of the image output from the imaging apparatus 20 and settings related to control of the imaging apparatus 20. The settings related to adjustment of the image quality of the image output from the imaging apparatus 20 may include, for example, at least one of the bit depth (color depth), brightness, contrast, color tone, vividness, white balance, backlight correction, and gain of the image output from the imaging apparatus 20. The settings related to control of the imaging apparatus 20 may include, for example, at least one of zoom, focus, and exposure.

[0048] (Example of determining image quality based on the reliability of analysis results) The specifying unit 12 of the information processing apparatus 10B may determine the second image quality of the second image based on the reliability of the analysis result based on the first image. In this case, the specifying unit 12 of the information processing apparatus 10B may determine the second image quality to be a higher image quality as the reliability of the analysis result based on the first image is lower. Thereby, for example, it is possible to determine the image quality that can obtain a predetermined analysis accuracy more appropriately. Further, the specifying unit 12 of the information processing apparatus 10B may determine the second image quality to be a lower image quality as the reliability of the analysis result based on the first image is higher. Thereby, for example, when the analysis accuracy is sufficiently high or the like, the communication amount (bit rate) due to the distribution of the second image can be reduced by reducing the image quality.

[0049] (Example of reducing the increase in the communication amount of the second image) The specifying unit 12 of the information processing apparatus 10B may increase the image quality of the region of a specific part (for example, the face of a patient) and reduce the image quality of the part other than the specific part. Thereby, for example, an increase in the communication amount of the second image can be reduced. In this case, the specifying unit 12 of the information processing apparatus 10B may, for example, determine the region of the specific part to be the second image quality and determine the region other than the specific part to be the third image quality lower than the first image quality. Then, the specifying unit 12 of the information processing apparatus 10B may transmit information for causing the information processing apparatus 10A to distribute a second image in which the region of the specific part is the second image quality and the region other than the specific part is the third image quality to the information processing apparatus 10A.

[0050] (Example of determining image quality based on fluctuations in bandwidth) The specifying unit 12 of the information processing apparatus 10B may determine the second image quality based on the variation in the available bandwidth in the network N to which the image captured by the imaging apparatus 20 is distributed. Thereby, when the available bandwidth is small, by reducing the image quality, it is possible to reduce the distortion of the distributed image. Also, the second image quality may be determined based on the predicted value of the available bandwidth. Thereby, for example, compared with the case where the image quality is reduced after the bandwidth has decreased, it is possible to further reduce the video distortion between when the bandwidth has decreased and when the image quality is reduced. Also, the specifying unit 12 of the information processing apparatus 10B may determine the second image quality and the third image quality based on the variation. Thereby, for example, when there is no margin in the bandwidth for increasing the image quality of the face region, it is possible to increase the image quality of the face region and reduce the image quality of the regions other than the face, and reduce the distortion of the distributed image.

[0051] Note that the specifying unit 12 of the information processing apparatus 10B may perform machine learning in advance on the communication log information when transmitting an image in the past in the network N, wireless quality information such as radio wave intensity, and the relationship between the day of the week, time, weather, and the available bandwidth, and calculate the available bandwidth and the predicted value of the bandwidth. The specifying unit 12 of the information processing apparatus 10B may determine the second image quality based on the calculated predicted value. Thereby, for example, when it is predicted that there will be no margin in the bandwidth for increasing the image quality of the face region, it is possible to increase the image quality of the face region and reduce the image quality of the regions other than the face, and reduce the distortion of the distributed image.

[0052] Subsequently, the control unit 13 of the information processing apparatus 10B transmits information (command) for causing the information processing apparatus 10A to distribute a second image in which the region of the specific part is of the second image quality (step S104). Here, the command may include, for example, information indicating the region of the specific part and information indicating the image quality of the region of the specific part.

[0053] Subsequently, based on the received command, the information processing device 10A sets (changes) the region of a specific part of the subject in the image captured by the imaging device 20 to the second image quality (step S105). Subsequently, the information processing device 10A distributes (transmits) a second image obtained by encoding the region of the specific part of the subject in the image captured by the imaging device 20 with the second image quality to the information processing device 10B via the network N (step S106). In the example of FIG. 7, the region 711 of the patient's face in the second image 701 is encoded with the second image quality.

[0054] Subsequently, the specific part 12 of the information processing device 10B acquires an analysis result of the subject based on the region of the specific part of the subject with the second image quality in the received second image (step S107). Note that the process of step S107 may be the same as the process of step S102. When the analysis result obtained in step S107 is information indicating that the analysis has failed, the information processing device 10B may repeat the processes after step S103.

[0055] Also, in the process of step S105, if the information processing device 10A does not support the image quality specified by the received command, it may return a response indicating that to the information processing device 10B. In this case, the specific part 12 of the information processing device 10B may display a message indicating that the analysis has failed. Thereby, the doctor can, for example, instruct the patient to approach the imaging device 20 through voice in a call or the like.

[0056] (Example of identifying a person from an image of the imaging device 20 which is a surveillance camera) In the above-described example, an example of measuring biological information in a video conference between a doctor and a patient has been described. Hereinafter, an example of identifying a person from an image of the imaging device 20 which is a surveillance camera will be described. In this case, the video of the imaging device 20 may be distributed from the information processing device 10A to the information processing device 10B.

[0057] First, when the specifying unit 12 of the information processing apparatus 10B cannot detect a person based on the image of the imaging apparatus 20, the image quality of the entire image may be enhanced. Also, when the specifying unit 12 of the information processing apparatus 10B cannot identify who the person is based on the image of the imaging apparatus 20, the region of a specific part such as the face of the person may be enhanced in image quality. Further, when the specifying unit 12 of the information processing apparatus 10B cannot identify the action of a person based on the image of the imaging apparatus 20, the region of the entire body of the person may be enhanced in image quality.

[0058] (Example of inspecting a product using the image of the imaging apparatus 20) Hereinafter, an example of inspecting a product using the image of the imaging apparatus 20 which is a surveillance camera will be described. In this case, the video of the imaging apparatus 20 may be distributed from the information processing apparatus 10A to the information processing apparatus 10B.

[0059] First, when the specifying unit 12 of the information processing apparatus 10B cannot detect a product based on the image of the imaging apparatus 20, the image quality of the entire image may be enhanced. Also, when the specifying unit 12 of the information processing apparatus 10B cannot inspect the product based on the image of the imaging apparatus 20, the region of a specific part of the product may be enhanced in image quality.

[0060] (Example of inspecting a facility using the image of the imaging apparatus 20) Hereinafter, an example of inspecting a facility using the image of the imaging apparatus 20 mounted on a drone or a robot that autonomously moves on the ground will be described. In this case, the video of the imaging apparatus 20 may be distributed from the information processing apparatus 10A mounted on the drone or the like to the information processing apparatus 10B.

[0061] First, when the specifying unit 12 of the information processing apparatus 10B cannot detect the region of an inspection target (for example, a steel tower, electric wires, etc.) based on the image of the imaging apparatus 20, the image quality of the entire image may be enhanced. Also, when the specifying unit 12 of the information processing apparatus 10B cannot inspect a component of the inspection target (for example, an insulator) (for example, measure damage, degree of deterioration, etc.) based on the image of the imaging apparatus 20, the region of a specific part including the component of the inspection target etc. may be enhanced in image quality.

[0062] <Second Embodiment> <Process> In the example of FIG. 5, an example of determining the image quality of a specific part or the like by the physician's information processing apparatus 10B was described. Hereinafter, with reference to FIG. 8, an example of determining the image quality of a specific part or the like by the patient's information processing apparatus 10A will be described. FIG. 8 is a sequence diagram showing an example of the process of the information processing system 1 according to the embodiment.

[0063] In step S201, the control unit 13 of the information processing apparatus 10A distributes (transmits) a first image obtained by encoding a region of a specific part of the subject in the image captured by the imaging apparatus 20 with a first image quality to the information processing apparatus 10B via the network N. Subsequently, the specifying unit 12 of the information processing apparatus 10A acquires an analysis result of the information of the subject based on the region of the specific part of the subject with the first image quality in the encoded first image (step S202). Here, the specifying unit 12 of the information processing apparatus 10A may acquire, for example, only information indicating the reliability of the analysis result of the subject information. In this case, the specifying unit 12 of the information processing apparatus 10A may predict (estimate, infer) the reliability of the analysis result of the subject information using, for example, AI or the like. If the analysis fails in step S202, the specifying unit 12 of the information processing apparatus 10A determines the image quality of the region of the specific part in the second image captured by the imaging apparatus 20 of the information processing apparatus 10A to be a second image quality higher than the first image quality (step S203).

[0064] Subsequently, the control unit 13 of the information processing apparatus 10A sets (changes) the region of the specific part of the subject in the image captured by the imaging apparatus 20 to the second image quality (step S204). Subsequently, the information processing apparatus 10A distributes (transmits) a second image obtained by encoding the region of the specific part of the subject in the image captured by the imaging apparatus 20 with the second image quality to the information processing apparatus 10B via the network N (step S205).

[0065] Subsequently, the specifying unit 12 of the information processing apparatus 10A acquires an analysis result of the subject based on the area of the specific part of the subject with the second image quality in the encoded second image (step S206). Note that the processes of step S201, step S204, and step S205 may be the same as the processes of step S201, step S105, and step S106 in FIG. 5, respectively. Also, the processes of step S202, step S203, and step S206 may be the same as the processes of step S102, step S103, and step S107 in the information processing apparatus 10B in FIG. 5, respectively. Note that, also in the information processing apparatus 10B, analysis processes similar to the processes of step S202 and step S206 may be executed in parallel.

[0066] <Modification Example> The information processing apparatus 10 may be a device included in one housing, but the information processing apparatus 10 of the present disclosure is not limited thereto. Each part of the information processing apparatus 10 may be realized by cloud computing configured by, for example, one or more computers. Also, at least part of the processing of the information processing apparatus 10 may be realized by, for example, another information processing apparatus 10. Such information processing apparatuses 10 are also included in an example of the "information processing apparatus" of the present disclosure.

[0067] Note that the present disclosure is not limited to the above-described embodiments, and can be appropriately modified without departing from the spirit thereof.

[0068] Some or all of the above-described embodiments may be described as follows in the following supplementary notes, but are not limited thereto. (Supplementary Note 1) Specific means for specifying the image quality of an area including a specific part used for analysis in a distributed image according to an analysis result based on the encoded and distributed image, Control means for performing control to distribute an image of the quality in which the area including the specific part is the image quality, An information processing system having the above. (Supplementary Note 2) The specific means Specifies the image quality according to the reliability of the analysis result, The information processing system according to Supplementary Note 1. (Supplementary Note 3) The specific means When the subject cannot be detected based on the distributed image, the image quality is specified for the entire image, When the specific part of the subject cannot be detected based on the distributed image, the image quality is specified for the area of the subject, When analysis based on the area of the specific part of the distributed image cannot be performed, the image quality is specified for the area of the specific part, The information processing system according to Supplementary Note 1 or 2. (Supplementary Note 4) The specific means When the reliability of the analysis result is equal to or lower than the threshold value, the analysis means is made to execute analysis based on the image of the image quality, The information processing system according to any one of Supplementary Notes 1 to 3. (Supplementary Note 5) The specific means Based on the available bandwidth in the network where the image is distributed, the image quality is specified, The information processing system according to any one of Supplementary Notes 1 to 4. (Supplementary Note 6) The specific means When analysis based on the area of the specific part cannot be performed, the area of the specific part is made to have a high image quality and the area other than the specific part is made to have a low image quality, The information processing system according to any one of Supplementary Notes 1 to 5. (Supplementary Note 7) The image quality includes image quality based on at least one of the encoding bit rate, encoding frame rate, encoding quantization parameter, area and bit rate setting of each layer of hierarchical encoding, and the setting of the imaging device that captures the image. The information processing system according to any one of Supplementary Notes 1 to 6. (Supplementary Note 8) Processing for specifying the image quality of the area including the specific part used for analysis in the distributed image according to the analysis result based on the encoded and distributed image, A process for controlling the delivery of an image of the quality in an area including the specific part, An information processing method for executing the above. (Appendix 9) In the specific process, The image quality is specified according to the reliability of the analysis result. The information processing method according to Appendix 8. (Appendix 10) In the specific process, When the subject cannot be detected based on the delivered image, the image quality is specified for the entire image. When the specific part of the subject cannot be detected based on the delivered image, the image quality is specified for the area of the subject. When the analysis based on the area of the specific part of the delivered image cannot be performed, the image quality is specified for the area of the specific part. The information processing method according to Appendix 8 or 9. [[ID=2 3]] (Appendix 11) In the specific process, When the reliability of the analysis result is equal to or less than a threshold value, the analysis based on the image of the image quality is executed by the analysis means. The information processing method according to any one of Appendices 8 to 10. (Appendix 12) In the specific process, The image quality is specified based on the available bandwidth in the network where the image is delivered. The information processing method according to any one of Appendices 8 to 11. (Appendix 13) In the specific process, When the analysis based on the area of the specific part of the subject of the image cannot be performed, the area of the specific part is made into high image quality and the area other than the specific part is made into low image quality. The information processing method according to any one of Appendices 8 to 12. (Appendix 14) The image quality includes at least one of the encoding bit rate, encoding frame rate, encoding quantization parameter, area and bit rate setting of each layer of hierarchical encoding, and the setting of the imaging device that captures the image. The information processing method according to any one of Appendices 8 to 13. (Appendix 15) Specific means for specifying the image quality of an area including a specific part used in the analysis in the distributed image according to the analysis result based on the image encoded and distributed; Control means for performing control to distribute an image of the image quality in the area including the specific part; An information processing apparatus having the above. (Appendix 16) The specific means is Specifying the image quality according to the reliability of the analysis result. The information processing apparatus according to Appendix 15. (Appendix 17) The specific means is When the subject cannot be detected based on the distributed image, specifying the image quality for the entire image; When the specific part of the subject cannot be detected based on the distributed image, specifying the image quality for the area of the subject; When the analysis based on the area of the specific part of the distributed image cannot be performed, specifying the image quality for the area of the specific part. The information processing apparatus according to Appendix 15 or 16. (Appendix 18) The specific means is When the reliability of the analysis result is equal to or lower than a threshold value, causing the analysis means to perform an analysis based on the image of the image quality. The information processing apparatus according to any one of Appendices 15 to 17. (Appendix 19) The specific means is Specifying the image quality based on the available bandwidth in the network where the image is distributed. The information processing apparatus according to any one of Appendices 15 to 18. (Appendix 20) The specific means is When the analysis based on the area of the specific part cannot be performed, the area of the specific part is made to have high image quality, and the areas other than the specific part are made to have low image quality. The information processing apparatus according to any one of Appendices 15 to 19. (Appendix 21) The image quality includes the image quality based on at least one of the encoding bit rate, the encoding frame rate, the encoding quantization parameter, the area and bit rate setting of each layer of hierarchical encoding, and the setting of the imaging device that captures the image. The information processing apparatus according to any one of Appendices 15 to 20.

Explanation of Signs

[0069] 1 Information processing system 10 Information processing apparatus <� 10A Information processing apparatus 10B Information processing apparatus 12 Specific part 13 Control part 20 Imaging device N Network

Claims

1. Specific means for specifying the image quality of an area including a specific part used in analysis in a distributed image according to an analysis result based on the distributed and encoded image; Control means for performing control to distribute an image of the area including the specific part with the image quality; and, The specific means is, Based on the inability to detect a subject based on the distributed image, the inability to detect the specific part of the subject based on the distributed image, and the reliability of the analysis result based on the area of the specific part of the distributed image being equal to or lower than a threshold value, specifying the image quality for the area of the specific part, An information processing system.

2. The specific means is, Specifying the image quality according to the reliability of the analysis result, The information processing system according to claim 1.

3. The specific means is, When a subject cannot be detected based on the distributed image, specifying the image quality for the entire image, When the specific part of the subject cannot be detected based on the distributed image, specifying the image quality for the area of the subject, When the reliability of the analysis result based on the area of the specific part of the distributed image is equal to or lower than a threshold value, specifying the image quality for the area of the specific part, The information processing system according to claim 1 or 2.

4. The specific means is, When the reliability of the analysis result is equal to or lower than a threshold value, causing an analysis means to perform an analysis based on the image of the image quality, The information processing system according to any one of claims 1 to 3.

5. The specific means is, Specifying the image quality based on the available bandwidth in the network where the image is distributed, The information processing system according to any one of claims 1 to 4.

6. The specific means is, When analysis based on the area of the specific part cannot be performed, enhancing the image quality of the area of the specific part and reducing the image quality of areas other than the specific part, The information processing system according to any one of claims 1 to 5.

7. The image quality includes image quality based on at least one of the encoding bit rate, encoding frame rate, encoding quantization parameter, area and bit rate setting of each layer of hierarchical encoding, and the settings of the imaging device that captures the image, The information processing system according to any one of claims 1 to 6.

8. A process for specifying the image quality of an area including a specific part used in analysis in a distributed image according to an analysis result based on the distributed and encoded image; a process of performing control to cause an image of the image quality to be distributed in an area including the specific part; execute, and further, in response to the fact that a subject cannot be detected based on the distributed image, the specific part of the subject cannot be detected based on the distributed image, and the reliability of the analysis result based on the area of the specific part of the distributed image is equal to or lower than a threshold value, execute a process of specifying the image quality for the area of the specific part; an information processing method.

9. a specifying means for specifying the image quality of an area including a specific part used for analysis in a distributed image according to an analysis result based on the encoded and distributed image; a control means for performing control to cause an image of the image quality to be distributed in an area including the specific part; having the specifying means is in response to the fact that a subject cannot be detected based on the distributed image, the specific part of the subject cannot be detected based on the distributed image, and the reliability of the analysis result based on the area of the specific part of the distributed image is equal to or lower than a threshold value, specify the image quality for the area of the specific part; an information processing apparatus.

10. the specifying means is specify the image quality according to the reliability of the analysis result; The information processing apparatus according to claim 9.

Images