Information processing device, information processing method, and program

Abstract

To execute noise reduction processing that considers the position of OSD information even if the position of the OSD information is not attached to an input image.SOLUTION: An information processing device acquires an image with superimposed OSD information, acquires a region of OSD information from the image, and sets parameters used for noise reduction in the image on the basis of the image in a first sub-region that is a sub-region of the image that is not superimposed on the region of the OSD information.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Surveillance cameras have been used as one of the crime prevention measures. Surveillance cameras are installed in various environments, and it is desired that they provide images with high visibility. In recent years, it has been known to use image sharpening technology to improve the visibility of camera images. An example of image sharpening processing is imaging at low illuminance at night. In imaging at low illuminance, the gain of the surveillance camera is increased to capture the subject, which generates noise and results in an image with poor visibility. For this reason, a technology called noise reduction is known to remove noise. As a method of performing noise reduction, a noise reduction method using DL (Deep Learning) has also been proposed instead of the conventional rule-based method. When performing noise reduction, the amount of noise in the input image may be estimated in order to set an appropriate noise reduction strength. However, camera information such as aperture value and shutter speed, or date information may be superimposed as OSD (On Screen Display) on the image from the surveillance camera. In addition, when changing the camera settings, a menu screen may be superimposed as OSD and the user may operate it. In the case where an OSD is superimposed in this way, if noise estimation is performed in the OSD area, an erroneous estimation may be made, and the noise reduction strength setting may not be set appropriately.

[0003] Patent Document 1 discloses a method for informing a user that an OSD is superimposed on an area that affects image analysis and prompting the user to change the superimposed position of the OSD when the OSD is determined to be superimposed on the area. Patent Document 2 discloses a method for applying noise reduction only to the OSD area based on the coordinate position of the OSD area. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-197594 [Patent Document 2] JP 2001-346072 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology, there is a problem that it is difficult to appropriately reduce noise when the position of the OSD information is not given. For example, in the technology described in Patent Document 1, there is little freedom to change the superimposition position for an OSD such as a menu that occupies most of the screen, and it is often difficult to set an image analysis area avoiding the OSD. In addition, in the technology described in Patent Document 2, it is assumed that the position of the OSD information can be obtained, and if the OSD area information cannot be obtained, it is not possible to set only the OSD area as the target for image processing.

[0006] An object of the present invention is to execute noise reduction processing taking into account the position of OSD information even when the position of OSD information is not added to an input image. [Means for solving the problem]

[0007] In order to achieve the object of the present invention, for example, an information processing device according to one embodiment has the following configuration: That is, the information processing device is characterized by having a first acquisition means for acquiring an image on which OSD information is superimposed, a second acquisition means for acquiring an area of ​​the OSD information from the image, and a setting means for setting parameters used for noise reduction in the image based on an image in a first partial area, which is a partial area of ​​the image that does not overlap with the area of ​​the OSD information. Effect of the Invention

[0008] Even if the position of the OSD information is not added to the input image, noise reduction processing is executed taking the position of the OSD information into consideration. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an information processing device according to a first embodiment. [Diagram 2] 5 is a flowchart showing an example of information processing according to the first embodiment. [Diagram 3] FIG. 2 is a diagram for explaining an input video according to the first embodiment. [Figure 4] FIG. 2 is a diagram for explaining an input video on which an OSD according to the first embodiment is superimposed. [Diagram 5] FIG. 2 is a diagram for explaining an input video on which an OSD according to the first embodiment is superimposed. [Figure 6] FIG. 4 is a diagram for explaining an overlap determination region according to the first embodiment. [Figure 7] 3 is a diagram for explaining candidates for OSD information according to the first embodiment. FIG. [Figure 8] FIG. 2 is a diagram for explaining an analysis region that is set according to the first embodiment. [Figure 9] FIG. 2 is a diagram for explaining an analysis region that is set according to the first embodiment. [Figure 10] FIG. 4 is a diagram for explaining the process of setting an analysis region according to the first embodiment. [Figure 11] 11A and 11B are diagrams for explaining a process of setting an analysis region from a divided region. [Figure 12] 10 is a flowchart showing an example of information processing according to the second embodiment. [Figure 13] 11 is a flowchart showing an example of information processing according to the third embodiment. [Figure 14] FIG. 13 is a diagram showing an example of a packet structure of an identifier according to the third embodiment. [Figure 15] FIG. 11 is a diagram for explaining reference to an identifier according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and redundant descriptions are omitted.

[0011] [Embodiment 1] Hereinafter, an information processing device according to the first embodiment of the present invention will be described. Fig. 1 is a configuration diagram of an information processing device 100. Fig. 1 is a block diagram showing an example of a hardware configuration of the information processing device 100 according to this embodiment.

[0012] 1, an information processing device 100 includes an input video receiving unit 102, an image processing unit 103, an OSD acquisition unit 104, a CPU 105, a video output driving unit 106, a frame memory 108, a GPU 109, a ROM 110, a RAM 111, an operation unit 112, and a display driving unit 113. The functional units shown in FIG. 1 are connected to each other so as to be able to communicate with each other via an internal bus 115. It is assumed that the processing by each functional unit is executed by the CPU 105.

[0013] The input video receiving unit 102 acquires an image to be processed. The input video receiving unit 102 according to the present embodiment can receive video from outside the information processing device 100 via an input video terminal 101. An interface used to receive video may be SDI (Serial Digital Interface), HDMI (registered trademark) (High Definition Multimedia Interface), DisplayPort (registered trademark), or the like. By using these interfaces, it is possible to acquire real-time video such as an output video of a camera (imaging device). Note that the input video receiving unit 102 does not need to receive video from the outside as long as it can acquire an image to be processed. For example, the information processing device 100 may have an imaging function, and an image captured by the imaging function may be the processing target. In the following, the image to be processed is described as using an input video received from outside the information processing device 100. In addition, in the processing described below, an image of one frame included in the input video is the processing target, but multiple frames of the input video may be processed continuously.

[0014] The image processing unit 103 performs various image processing on the image acquired by the input video receiving unit 102. The image processing unit 103 may perform, as the image processing, image sharpening processing such as noise reduction, gradation correction, or sharpness correction. The image processing unit 103 may also perform, as the image processing, image analysis processing for estimating the amount of noise in the input video, or processing such as generation or superimposition of an OSD image related to the setting information of the information processing device 100.

[0015] The input video receiving unit 102 according to the present embodiment can acquire an image (superimposed image) in which OSD information (described later) is superimposed on the input video as an image to be processed. In the following, an example in which the OSD acquisition unit 104 detects an area of ​​the OSD information on the superimposed image will be described.

[0016] The OSD acquisition unit 104 acquires an area of ​​OSD information (OSD area) from the input video acquired by the input video receiving unit. Here, the OSD information is information indicating an OSD (On Screen Display) to be superimposed on the input video. The OSD information may be, for example, a menu image such as OSD501 shown in FIG. 5 described later, or a character string with a transparent (or semi-transparent) background such as OSD503 or OSD505. The OSD acquisition unit 104 according to the present embodiment acquires information (candidate information) indicating candidates of OSD to be superimposed, and determines whether the acquired OSD candidate is superimposed on the superimposed image, thereby making it possible to determine whether the OSD is superimposed on the superimposed image.

[0017] Here, the candidate information may be acquired as a table as shown in FIG. 7, for example. In the example of FIG. 7, an OSD index, which is information for identifying the candidate information (OSD area indicated by the candidate information), and information (coordinate information) indicating the position of the OSD area are stored in the table for each candidate. In this embodiment, the OSD area is a rectangular area, and the coordinate information is indicated by the start coordinates and end coordinates in the horizontal direction of the image and the start coordinates and end coordinates in the vertical direction of the image. The process using the candidate information will be described later with reference to FIG. 5 and FIG. 6. Note that, here, the candidate information is assumed to be stored in ROM 110 in advance, but may be acquired from an external device such as an imaging device (not shown).

[0018] For example, the information processing device 100 can obtain the type of camera to be used (for example, capturing an input image), obtain OSD candidate information associated with the obtained type, and perform subsequent determination processing. For this purpose, the information processing device 100 may record the camera type and the OSD candidate information in association with each other. These processes will be described later with reference to Figs. 5 to 7.

[0019] Furthermore, the OSD acquisition unit 104 may acquire metadata indicating the presence or absence of an OSD in the input video, or the position of an OSD area in the input video.

[0020] The CPU 105 is a central processing unit (CPU) for controlling each function of the information processing device 100, and is mainly used for controlling image processing. In order to drive the CPU 105, a read only memory (ROM) 110 and a RAM 111 are connected to the CPU 105.

[0021] The image generated by the image processing unit 103 is output to the outside of the information processing device 100 via a video output driving unit 106 and a video output terminal 107. As an interface used for outputting the image to the outside, SDI, HDMI, DisplayPort, or the like can be used arbitrarily. By using these interfaces, it becomes possible to display real-time images on an external monitor or the like.

[0022] The frame memory 108 is a storage device generally called RAM (Random Access Memory), and is an element that can temporarily store video signals and read them out when necessary. Video signals are huge amounts of data, so high speed and large capacity are required. As the frame memory 108, DDR4-SDRAM (Dual Data Rate 4 - Synchronous Dynamic RAM) or the like may be used.

[0023] The GPU 109 is used to perform image sharpening processing by DL (Deep Learning). Since the image sharpening processing by DL requires a huge amount of calculations to be processed in parallel, in this embodiment, the image sharpening processing is described as being performed using a GPU, which has a higher parallel processing capability than a CPU. However, the processing described below may be executed by either a CPU or a GPU. For example, all of the processing according to this embodiment may be performed by the GPU 109, or a part of it may be performed by the GPU 109.

[0024] The ROM 110 is a non-volatile element, and stores programs for operating the CPU 105, various adjustment parameters, and the like. Programs read from the ROM 110 are deployed in the volatile RAM 111 and executed. The RAM 111 is a RAM separate from the frame memory 108, and is assumed here to be slower and have a smaller capacity than the frame memory 108.

[0025] The operation unit 112 accepts operations by a user. For example, the operation unit 112 may acquire an operation via a physical interface such as a button, an analog key, or a switch provided in the information processing device 100, may acquire an operation via an external device such as a USB interface, or may acquire an operation on the display unit 114 which is a touch panel. The operation unit 112 may also acquire a user operation using a web browser or the like via a network. The operation unit 112 according to this embodiment can acquire an operation for changing a setting menu of the information processing device 100.

[0026] The display drive unit 113 and the display unit 114 can display an image generated by the image processing unit 103. The display unit 114 may perform display processing on a display provided in the information processing device 100, for example, or may perform display processing on a display device (not shown) that is an external device of the information processing device 100. For example, the display unit 114 displays an image or a setting menu processed by the image processing unit 103 or the GPU 109, making it possible to check the operating status of the information processing device 100. The display unit 114 may perform display processing on a (small and low-power consumption) display such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence), or may perform display processing on a resistive or capacitive thin-film element called a touch panel.

[0027] The CPU 105 generates, as the OSD information, a character string (text information) for informing the user of the setting state of the information processing device 100 or a menu for setting the information processing device 100, and displays a superimposed image superimposed on the input video on the display unit 114. Here, the OSD information used may be, in addition to the text information, an imaging assist display such as a histogram, a vector scope, a waveform monitor, a zebra, a peaking, or a false color.

[0028] The image processing unit 103 according to the present embodiment sets parameters (noise reduction parameters) used for noise reduction in the superimposed image based on an image in a partial region in the superimposed image that does not overlap with the OSD region. Hereinafter, the partial region used for setting the noise reduction parameters can be set by any method. For example, the image processing unit 103 may set the noise reduction parameters based on the entire region in the superimposed image that does not overlap with the OSD region. Hereinafter, the above-mentioned partial region used when setting the noise reduction parameters by the image processing unit 103 according to the present embodiment may be referred to as an "analysis region."

[0029] Hereinafter, an example of the setting process of the partial area not overlapping with the OSD area performed by the image processing unit 103 and the OSD acquisition unit 104 will be described with reference to FIG. 2 to FIG. 11. The OSD acquisition unit 104 according to the present embodiment can acquire candidate information of the OSD to be overlapped, and determine whether or not the acquired candidate OSD is overlapped in the input video. For example, the OSD acquisition unit 104 may compare a data value of a predetermined area (overlap determination area) in the input video with a data value of an image of the overlap determination area in an overlap image in which the corresponding candidate OSD area is overlapped, which is included in the overlap determination area information described later, to determine whether or not the candidate OSD is overlapped in the input video. Hereinafter, the above-mentioned "data value of the overlap determination area in an overlap image in which the corresponding candidate OSD area is overlapped, which is included in the overlap determination area information" may be expressed as a data value associated with the overlap determination area. Herein, when the data values ​​match, the OSD acquisition unit 104 determines that the candidate OSD associated with the overlap determination area is overlapped. In this case, the determination of whether two predetermined regions of an image match can be performed by any method of comparing the similarity of two images. For example, the difference between the components of corresponding pixel positions of two predetermined regions of an image (assuming that the size is the same) is calculated, and if the sum of the differences is less than a threshold value, the predetermined regions may be determined to match.

[0030] In this embodiment, there are multiple overlap determination areas, and the process described below is performed for each of them. However, the number of overlap determination areas is not limited to the example described, and there may be only one. Here, an overlap determination area corresponding to each of the multiple pieces of candidate information is provided, and information indicating the overlap determination area (overlap determination area information) and the candidate information are associated with each other by a common OSD index. This overlap determination area information can also be expressed as being associated with the type of camera associated with the associated candidate information.

[0031] 6 is a diagram showing an example of a table storing overlap determination area information according to this embodiment. The overlap determination area information according to this embodiment includes an OSD index indicating corresponding candidate information, coordinate information of the overlap determination area, and a data value associated with the overlap determination area. The overlap determination area according to this embodiment is a rectangular area similar to the OSD area, and its coordinate information is indicated by start and end coordinates in the horizontal direction of the image and start and end coordinates in the vertical direction of the image. Here, the data value associated with the overlap determination area may be, for example, fixed value data such as background, or bitmap data of a font.

[0032] In the following description, the OSD area and the overlap determination area according to the present embodiment are rectangular areas, but the shapes of the areas are not limited to these shapes as long as the processing can be performed in the same manner. For example, the OSD area and both sub-determination areas may be circular areas, and their coordinate information may be indicated by the coordinates of the center point and the radius. In the present embodiment, the data value of the image of the overlap determination area in the overlap image in which the above-mentioned candidate OSD area is overlapped is included in the overlap determination area information, but similar information may be stored as a data value associated with the candidate information (for example, in the table of FIG. 7).

[0033] The OSD acquisition unit 104 according to the present embodiment acquires a plurality of candidates for OSD to be superimposed on the superimposed image, and for each of the acquired candidates, determines whether or not it is superimposed on the superimposed image, and records the OSD determined to be superimposed. Next, the image processing unit 103 sets a partial area in the superimposed image that does not overlap with the OSD area of ​​the candidate determined to be superimposed as a partial area (analysis area) used when generating noise reduction parameters. In the following description, it is assumed that an item for setting the type of camera to be used (connected to the information processing device 100) is provided on the menu of the OSD 501, and the type of camera to be used can be acquired according to a user input via the operation unit 112. Similarly, it is assumed that various inputs such as addition or deletion of OSD area candidates by the user can be performed.

[0034] Fig. 2 is a flowchart showing an example of information processing performed by the information processing device 100 according to this embodiment. The processing shown in Fig. 2 is started when the information processing device 100 is started, or when a setting for performing noise reduction is made by a user operation via the operation unit 112. Furthermore, the processing shown in Fig. 2 may be repeatedly executed when a setting for performing noise reduction is made.

[0035] In S201, the input video receiving unit 102 receives an input video. Here, the input video receiving unit 102 may receive an input video as shown in Fig. 3 in which an OSD is not superimposed on the input video from the camera, or may receive an input video (superimposed image) as shown in Fig. 4 in which an OSD is superimposed on the input video from the camera.

[0036] In S202, CPU 105 acquires information about the camera connected to information processing device 100. Here, CPU 105 may acquire the camera information in advance by a user operation via operation unit 112, or may acquire the camera information from a camera connected to information processing device 100. Next, CPU 105 loads the acquired camera information in RAM 111. Here, the camera information includes information indicating the type of the camera.

[0037] In S203, the OSD acquisition unit 104 acquires overlap determination area information associated with the type of camera acquired in S202. Here, the OSD acquisition unit 104 acquires all overlap determination area information corresponding to OSD indexes 0 to 2 shown in FIG. 6. In S204, the OSD acquisition unit 104 judges whether the value of the OSD index currently set as the processing target is smaller than the OSD overlap determination count. The OSD index to be processed is initialized to 0, and is increased by the loop processing of S204 to S208. Here, the OSD index is acquired in S203, and is used as information for identifying the OSD area corresponding to each candidate information of the OSD area (and overlap determination area). The OSD overlap determination count is the number of times to perform OSD overlap determination obtained from the table acquired in S203. If the OSD index is smaller than the OSD overlap determination count, the process proceeds to S205, otherwise, if it is determined that the OSD overlap determination is completed, the process proceeds to S209.

[0038] In S205, the OSD acquisition unit 104 determines whether or not a corresponding OSD candidate is superimposed on the superimposition determination area of ​​the input video corresponding to the OSD index to be processed. If it is determined that the OSD candidate is superimposed, the process proceeds to S206, and if it is determined that the OSD candidate is not superimposed, the process proceeds to S208.

[0039] Hereinafter, with reference to FIG. 5, an example of a case where it is determined whether or not OSD 501 is superimposed on input video 500 will be described. OSD 501 in FIG. 5 is an example showing a display in the case where OSD candidates corresponding to OSD indexes 0 to 2 are superimposed on the input video. Based on the information acquired in S203, image processing unit 103 determines whether or not a data value in superimposition determination area 502 matches a data value associated with OSD 501. Here, the data value associated with OSD 501 is a data value corresponding to a rectangular area with a horizontal start coordinate 900 and an end coordinate 1200, and a vertical start coordinate 200 and an end coordinate 300, which is an area associated with OSD index 0, as shown in FIG. 6. Also, when the OSD superimposition determination area has an area of ​​fixed data such as a background, it may be determined whether the data of all areas match.

[0040] 5 is an OSD in which the background of the character string is transparent (or semi-transparent). When using such an OSD, when determining whether or not the OSD 501 is superimposed on the input video 500, only a part of a rectangular area including the bitmap image data of the OSD may be used to compare only the area that is not transparent or semi-transparent. Although the case where there are three OSD candidate areas is illustrated in FIG. 6, the number of candidate areas is not limited to this and can be set arbitrarily. In S206, the OSD acquisition unit 104 stores in the RAM 111 an OSD index corresponding to the superimposition determination area in which it is determined in S205 that the OSD candidate is superimposed.

[0041] In S207, the OSD acquisition unit 104 acquires position information of the OSD candidate corresponding to the OSD index stored in S206. Here, it is assumed that the coordinate information of the OSD area as stored in Fig. 7 is acquired as the position information. In S208, the OSD acquisition unit 104 increments the value of the OSD index to be processed by 1, and returns the process to S204.

[0042] In S209, the image processing unit 103 sets an analysis area. Here, a partial area in the superimposed image that does not overlap with the OSD area of ​​the candidate determined to be superimposed is set as the analysis area. Here, the analysis area is a rectangular area, and is indicated by, for example, start and end coordinates in the horizontal direction of the image and start and end coordinates in the vertical direction of the image.

[0043] Here, the image processing unit 103 refers to the OSD index corresponding to the overlap determination area in which it is determined that the OSD candidate is overlapped, which was stored in the RAM 111 in S206. Next, the image processing unit 103 sets a partial area that does not overlap with the OSD candidate corresponding to the referred OSD index as an analysis area.

[0044] The image processing unit 103 can set an analysis area according to a combination of candidates determined to be superimposed on the superimposed image among the multiple OSD area candidates. For example, the image processing unit 103 may set analysis area candidates corresponding to each combination of candidates determined to be superimposed on the superimposed image in advance, and acquire such corresponding analysis areas in S209. In this way, the image processing unit 103 can select an analysis area that does not overlap with the OSD from among the multiple analysis area candidates.

[0045] FIG. 10 is a diagram for explaining an example of such an analysis region. In FIG. 10, position information of the analysis region according to the combination of OSD candidates determined to be superimposed on the superimposed image is stored in a table of analysis regions together with a number (here, 0 to 7) indicating the analysis region for each combination of candidates. For example, if it is determined in S205 that all OSD candidates are not superimposed on the superimposed image, the candidate with number 0 is set as the analysis region. In FIG. 8, the analysis region with number 0 is illustrated as analysis region 801. Also, for example, if it is determined in S205 that all OSD candidates are superimposed on the superimposed image, the candidate with number 7 is set as the analysis region. In FIG. 9, the analysis region with number 7 is illustrated as analysis region 901.

[0046] Also, for example, the image processing unit 103 may divide the superimposed image into a plurality of partial regions (split regions), and set a group of split regions that do not overlap with candidates for OSDs determined to be superimposed on the superimposed image as the analysis region. FIG. 11 is a diagram for explaining the analysis region set using the split regions in this way. In FIG. 11, the superimposed image 1100 is divided into 5×5 split regions of equal size in advance, and coordinate information of the split regions is stored. Here, OSD 1101, OSD 1102, and OSD 1103 are superimposed on the superimposed image 1100, and a partial region 1104 for five split regions that do not overlap with the OSDs is set as the analysis region. In this case, it may be determined whether or not an OSD is superimposed for each split region, and a split region that does not overlap with an OSD may be selected based on the coordinate information of the OSD.

[0047] In S210, the image processing unit 103 performs a video analysis process including setting noise reduction parameters from the analysis region set in S209. Here, the video analysis process refers to a process for acquiring the state of the input video, including a process for estimating the amount of noise in the input video, or a process for determining whether the input video is the same as the video of the previous frame. In S211, the CPU 105 updates the noise reduction parameters. In S212, the image processing unit 103 performs noise reduction on the superimposed image using the noise reduction parameters updated in S211, and ends the process in FIG. 2. If the parameters are updated in S211 to indicate that noise reduction is not to be performed, noise reduction processing does not need to be performed.

[0048] Here, the setting of the noise reduction parameters in S210 may be a process of dividing the estimated noise amount into stages such as small / medium / large, and setting the degree of noise reduction in stages such as low / medium / high according to the division result. Also, for example, the image processing unit 103 may calculate the noise reduction parameters each time S209 is performed based on the image of the analysis region. The setting of the noise reduction parameters from the predetermined region and the noise reduction based on the set noise reduction parameters can be arbitrarily adopted from a commonly used noise reduction technique, and a detailed description thereof will be omitted here.

[0049] According to this configuration, the area of ​​the OSD information is obtained from the image on which the OSD information is superimposed, and the parameters used for noise reduction can be set based on the image in the partial area that does not overlap with the area of ​​the OSD information in the image. Therefore, even if the position of the OSD information is not attached to the input image, it is possible to perform noise reduction processing that takes the position of the OSD information into consideration.

[0050] In FIG. 2, an example of selecting an analysis area that does not overlap with the OSD from among a plurality of analysis area candidates is described. However, as described above, the analysis area does not need to be selected in this manner as long as it is an area that does not overlap with the OSD. For example, the image processing unit 103 may set the entire area in the superimposed image excluding the area of ​​the OSD information as the analysis area, or may set the rectangular area of ​​the largest area set so as not to overlap with the OSD area in the superimposed image as the analysis area. In addition, the process of acquiring the superimposed OSD is not limited to the determination process using the data value as shown in FIG. 6, and can be performed by arbitrarily adopting a known technique for identifying an object in an image. For example, the OSD acquisition unit 104 may detect the OSD area from the superimposed image by using a learning model that has been previously trained to estimate the OSD area from the input image.

[0051] In the present embodiment, it has been described that there are overlap judgment areas corresponding to a plurality of pieces of candidate information. However, for example, there may be a plurality of overlap judgment areas for one piece of candidate information, and there may be a plurality of pieces of candidate information for one overlap judgment area. For example, when there are a plurality of overlap judgment areas for one piece of candidate information, each piece of candidate information may include the above-mentioned "data value of the image of the overlap judgment area in the overlap image in which the OSD area of ​​the corresponding candidate is overlapped," and each piece of candidate information may be used to perform the overlap judgment of the OSD in the overlap judgment area.

[0052] [Embodiment 2] The information processing device according to the second embodiment can determine whether or not an OSD is superimposed on the superimposed image, in addition to the processing performed by the information processing device 100 according to the first embodiment. When it is determined that an OSD is not superimposed on the superimposed image, the information processing device according to this embodiment does not perform the noise reduction parameter update processing of S209 to S211. The information processing device according to this embodiment has a similar configuration to the information processing device 100 shown in FIG. 1 and can perform similar processing, so a description of superimposition will be omitted.

[0053] Fig. 12 is a flowchart showing an example of information processing performed by the information processing device according to this embodiment. The processing shown in Fig. 12 is performed similarly to Fig. 2 of the first embodiment except that S1201 is additionally performed, so a description of the superimposition will be omitted. If it is determined in S204 that the OSD index is equal to or greater than the OSD superimposition determination count, the processing proceeds to S1201 instead of S209.

[0054] In S1201, the image processing unit 103 determines whether or not an OSD is superimposed on the superimposed image. Here, it is assumed that if the OSD index stored in S206 exists, it is determined that an OSD is superimposed on the superimposed image. If it is determined that an OSD is superimposed on the superimposed image, the process proceeds to S209, and if not, the process proceeds to S212 without performing the noise reduction parameter update process of S209 to S211.

[0055] According to this processing, when the OSD is not superimposed on the input image, noise reduction can be performed without updating the noise reduction parameters. Therefore, it is possible to omit unnecessary noise reduction processing within a range that is not easily affected by the OSD superimposition.

[0056] [Embodiment 3] The information processing device according to the third embodiment acquires an identifier together with an input image from a camera, and acquires an area of ​​OSD information to be superimposed on the input image based on the acquired identifier. The information processing device according to the present embodiment has a similar configuration to the information processing device 100 shown in Fig. 1 and can perform similar processing, so a description of superimposition will be omitted.

[0057] The identifier acquired by the information processing device according to the present embodiment will be described below. FIG. 14 is a diagram showing an example of a packet structure of an identifier acquired by the information processing device according to the present embodiment. In the packet structure shown in FIG. 14, an ancillary specified by SMPTE is stored. This identifier is composed of 10 bits of each of the Type 2 ancillary packets (ANC packets) shown in FIG. 14. ADF (Ancillary Data Flag) is a flag for detecting an ancillary packet. In addition, a predetermined value indicating that it is an ancillary related to OSD is set in DID (Data ID) and SDID (Secondary Data ID), which are header areas for identifying the type of ANC packet. The number of UDWs (User Data Words) is set in DC (Data Count). User data is stored in UDW. The format of these data stored in the packet structure may be any format as long as the information can be acquired as a value. CS (Check Sum) is a checksum, and an error detection code is set.

[0058] FIG. 15 shows an example of an ANC packet that stores information about OSD. In FIG. 15(a), 0x000 of sample number 0, 0x3FF of sample number 1, and 0x3FFF of sample number 2 are ADF. 0x250 of sample number 3 is DID, and 0x101 of sample number 4 is SDID. 0x20B of sample number 5 is DC, indicating that there are 11 UDWs. 0x101 of sample number 6 is data indicating whether an OSD is superimposed on the input video, for example, 0 indicates that it is not superimposed, and 1 indicates that it is superimposed. 0x101 of sample number 7 is data indicating how many OSDs are superimposed on the input video, and in this example, it indicates that one OSD is superimposed. 0x200 of sample number 8 is an OSD index, which corresponds to the OSD index shown in FIG. 6.

[0059] In this example, the coordinate information of the OSD superimposed on the input video is indicated by sample numbers 9 to 16. 0x12C of sample number 9 and 0x101 of sample number 10 indicate the horizontal start coordinate of the first OSD. In this packet structure, the start coordinate and end coordinate of the horizontal direction of the image of the OSD having a rectangular area, as well as the start coordinate and end coordinate of the vertical direction of the image, are each indicated by 16-bit data. Here, the start coordinate of the horizontal direction of the image of the OSD is divided into the lower 8 bits and the upper 8 bits and stored in sample numbers 9 and 10, respectively. Similarly, 0x1DC of sample number 11 and 0x205 of sample number 12 indicate the end coordinate in the horizontal direction. Moreover, 0x296 of sample number 13 and 0x200 of sample number 14 indicate the start coordinate in the vertical direction. Moreover, 0x120 of sample number 15 and 0x203 of sample number 16 indicate the end coordinate in the vertical direction.

[0060] Sample number 17 is the checksum. The checksum is calculated using 9-bit data, and the 9th bit is the complement of the 8th bit, making it 10-bit data. Note that in the example of Fig. 15, there is one OSD to be superimposed, but if there are two or more OSDs, the coordinate information of the second and subsequent OSDs is stored following sample number 16.

[0061] Fig. 15(b) shows the 10-bit configuration of DID, SDID, DC, UDW, and CS. In the configuration shown in Fig. 15(b), bits 0 to 7 are an 8-bit data area, the 8th bit is an even parity bit indicating an error detection code, and the 9th bit is the complement of the 8th bit.

[0062] 15 is an example of storage of information related to OSD that is added as an identifier, and is not limited to such a configuration as long as it can store similar information. Also, the identifier does not need to be acquired simultaneously with the input video, and may be acquired from the imaging device at a different timing.

[0063] Fig. 13 is a flowchart showing an example of information processing performed by the information processing device according to this embodiment. The processing shown in Fig. 13 is performed in the same manner as in Fig. 2 of the first embodiment, except that S1301 to S1302 are performed instead of S201 to S208, and therefore a redundant description will be omitted.

[0064] In S1301, the input video receiving unit 102 acquires an input video and an identifier. The acquisition of the input video is the same process as S201 in Fig. 2. The acquisition of the identifier may be performed simultaneously with the acquisition of the input video as described above, or may be performed at a different timing.

[0065] In S1302, the CPU 105 acquires the presence or absence of an OSD to be superimposed on the input video and the coordinate information of the OSD to be superimposed based on the acquired identifier, and proceeds to S209. In S209, the analysis region is set so as not to overlap with the OSD whose coordinate information was acquired in S1302.

[0066] According to this process, it is possible to refer to the coordinates of the OSD by referring to the identifier, without directly acquiring the coordinate information of the OSD. Therefore, even if the position of the OSD information is not added to the input image, it is possible to execute the noise reduction process taking the position of the OSD information into consideration.

[0067] The disclosure of this specification includes the following information processing device, information processing method, and program. (Item 1) A first acquisition means for acquiring an image on which OSD information is superimposed; a second obtaining means for obtaining an area of ​​the OSD information from the image; a setting means for setting parameters to be used for noise reduction in the image based on an image in a first partial region, which is a partial region in the image that does not overlap with a region of the OSD information; An information processing device comprising: (Item 2) a third acquiring means for acquiring a candidate area of ​​the OSD information; a first determination means for determining whether or not the candidate for the OSD information area is superimposed on the image; The information processing device described in item 1, characterized in that the first partial area is a partial area in the image that does not overlap with a candidate area of ​​OSD information determined to be overlapped by the first determination means. (Item 3) a fourth acquiring means for acquiring, from the image, a first data value which is a data value of a second partial region in the image corresponding to the candidate region of the OSD information; and a fifth acquiring means for acquiring a second data value which is a data value of the second partial area when the candidate for the OSD information area is superimposed on the image, The information processing device described in item 2, characterized in that the first determination means determines whether or not a candidate area for the OSD information is superimposed on the image based on the first data value and the second data value. (Item 4) The information processing device described in item 3, characterized in that the first determination means determines that a candidate area for the OSD information is superimposed on the image when it is determined that the first data value and the second data value match. (Item 5) The information processing device described in item 2, characterized in that the first partial area is a partial area that is set according to a combination of candidates for the OSD information area that are determined to be superimposed by the first determination means, among multiple candidates for the OSD information area. (Item 6) A sixth acquisition means for acquiring a candidate for the first partial region, 2. The information processing device according to item 1, wherein the first partial region is selected from candidates for the first partial region so as not to overlap with a region of the OSD information. (Item 7) A generating unit is further provided for generating a plurality of divided regions by dividing the image, 2. The information processing device according to item 1, wherein the first partial area is configured from among the plurality of divided areas, a divided area that does not overlap with an area of ​​the OSD information. (Item 8) The display device further includes a second determination unit for determining whether or not the OSD information areas overlap each other for each of the divided areas, The information processing device described in item 7, characterized in that the first partial area is composed of a divided area among the multiple divided areas that is determined by the second determination means not to overlap with the area of ​​the OSD information. (Item 9) A seventh acquisition means for acquiring an identifier from an imaging device that captured the image, 2. The information processing device according to item 1, wherein the second acquisition means acquires an area of ​​the OSD information based on the identifier. (Item 10) acquiring an image on which OSD information is superimposed; obtaining an area of ​​the OSD information from the image; setting parameters to be used for noise reduction in the image based on an image in a first partial region, which is a partial region in the image that does not overlap with a region of the OSD information; An information processing method comprising: (Item 11) A program for causing a computer to function as each of the means of the information processing device according to any one of items 1 to 9.

[0068] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0069] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0070] 101: video input terminal, 102: input video receiving unit, 103: image processing unit, 104: OSD acquisition unit, 105: CPU, 106: video output driving unit, 107: video output terminal, 108: frame memory, 109: GPU, 110: ROM, 111: RAM, 112: operation unit, 113: display driving unit, 114: display unit, 115: internal bus

Claims

1. A first acquisition means for acquiring an image on which OSD information is superimposed; a second acquiring means for acquiring an area of ​​the OSD information from the image; a setting means for setting a parameter to be used for noise reduction in the image based on an image in a first partial region which is a partial region in the image that does not overlap with a region of the OSD information; An information processing device comprising:

2. a third acquiring means for acquiring a candidate for the OSD information area; a first determination means for determining whether or not the candidate for the OSD information area is superimposed on the image, 2 . The information processing device according to claim 1 , wherein the first partial area is a partial area in the image that does not overlap with a candidate area for the OSD information that is determined to be overlapped by the first determination means.

3. a fourth acquiring means for acquiring, from the image, a first data value which is a data value of a second partial area in the image corresponding to a candidate area of ​​the OSD information; and a fifth acquiring means for acquiring a second data value which is a data value of the second partial area when the candidate for the OSD information area is superimposed on the image, 3. The information processing apparatus according to claim 2, wherein the first determination means determines whether or not the candidate for the OSD information area is superimposed on the image based on the first data value and the second data value.

4. 4. The information processing device according to claim 3, wherein the first determination means determines that the candidate area for the OSD information is superimposed on the image when it is determined that the first data value and the second data value match.

5. 3. The information processing device according to claim 2, wherein the first partial area is a partial area that is set according to a combination of candidates for the OSD information area that are determined to be superimposed by the first determination means, among a plurality of candidates for the OSD information area.

6. A sixth acquisition means for acquiring a candidate for the first partial region is further provided, The information processing device according to claim 1 , wherein the first partial area is selected from candidates for the first partial area so as not to overlap an area of ​​the OSD information.

7. A generating unit for generating a plurality of divided regions by dividing the image, 2 . The information processing device according to claim 1 , wherein the first partial area is one of the plurality of divided areas that does not overlap with an area of ​​the OSD information.

8. a second determination unit that determines whether or not the OSD information area overlaps with the divided area; 8. The information processing device according to claim 7, wherein the first partial area is constituted by a divided area, among the plurality of divided areas, that is determined by the second determining means not to overlap with an area of ​​the OSD information.

9. A seventh acquisition means for acquiring an identifier from an imaging device that captured the image, 2. The information processing apparatus according to claim 1, wherein the second acquisition means acquires an area of ​​the OSD information based on the identifier.

10. acquiring an image on which OSD information is superimposed; obtaining an area of ​​the OSD information from the image; setting parameters to be used for noise reduction in the image based on an image in a first partial region, which is a partial region in the image that does not overlap with a region of the OSD information; An information processing method comprising:

11. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 9.

Images