Shooting System

Abstract

To create a picture without lens distortion while using a wide angle lens.SOLUTION: A photographing system 10 includes: photographing means 12 including a wide angle lens 12a; and a control unit 11. The control unit 11 includes: a distortion correction parameter arithmetic unit 11a for calculating a distortion correction parameter from a correction mark 42a of a photographed picture 1 obtained through the wide angle lens 12a; and a correction processing unit 11b for correcting the photographed picture using the distortion correction parameter.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an imaging system for imaging a subject. [Background technology]

[0002] Conventionally, there is known a photographing system for photographing a person to be photographed. Such a photographing system has a housing in which the person to be photographed fits, and a photographing means (camera) and a light projecting unit are installed inside the housing. The person to be photographed sits on a chair inside the housing and is photographed.

[0003] In conventional imaging systems, the distance between the camera and the person being photographed is short because the inside of the housing is narrow. Therefore, in imaging systems, the person being photographed adjusts the height of the chair to align the face position with the camera, but the task of adjusting the chair height is cumbersome.

[0004] On the other hand, a mechanism for vertically moving the camera in accordance with the position of the face of the person being photographed has also been considered, but the mechanism for vertically moving the camera is expensive.

[0005] It is also considered to use a wide-angle lens on the camera to capture the entire body of the person being photographed, but lens distortion may occur in the obtained image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent Publication No. 2019-129353 Summary of the Invention [Problem to be solved by the invention]

[0007] The present disclosure has been made in consideration of these points, and aims to provide an imaging system that can obtain images without lens distortion, without the need to adjust the chair height or requiring a camera movement mechanism. [Means for solving the problem]

[0008] The present disclosure relates to an imaging system comprising: a background board including a background body and a plurality of correction marks provided on the background body; an imaging device including a lens for obtaining an image consisting of an image of a subject positioned in front of the background board and an image of a background; and a control unit to which the image obtained by the imaging device is sent, the control unit having a distortion correction parameter calculation unit for determining distortion correction parameters for the image obtained from the shape of the correction marks in the background image among the images obtained by the imaging device through the lens; and a correction processing unit for performing correction processing on the image obtained by the distortion correction parameter calculation unit to obtain a corrected image.

[0009] The present disclosure relates to an imaging system, wherein the control unit has a chromakey compositing unit that performs chromakey compositing using a corrected image obtained by the correction processing unit and a desired template selected by an operation panel to obtain a chromakey composite image.

[0010] The present disclosure is an imaging system, in which the lens is a wide-angle lens having a shorter focal length than a standard lens.

[0011] The present disclosure relates to an imaging system, in which the background body of the background plate and the correction mark have the same color system.

[0012] The present disclosure relates to an imaging system, wherein the distortion correction parameter calculation unit determines a distortion correction parameter for the captured image from a shape of a correction mark that is closest to the person image among a plurality of correction marks.

[0013] The present disclosure is a photography system, in which the background plate is installed on one side of an enclosure that surrounds the person to be photographed.

[0014] The present disclosure relates to a background board that is placed behind a person to be photographed by an imaging device, the background board including a background body and a plurality of correction marks provided on the background body.

[0015] The present disclosure relates to a background plate, in which the colors of the background body and the correction marks of the background plate are of the same color family. Effect of the Invention

[0016] According to the present disclosure, it is possible to obtain an image free of lens distortion without adjusting the chair height and without requiring a camera movement mechanism. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram showing the entire imaging system according to the present embodiment. [Diagram 2] FIG. 2 is a block diagram showing the functional configuration of the imaging system. [Diagram 3] FIG. 3 shows the layout of components inside the housing. [Figure 4] FIG. 4 is a flowchart showing the photographing operation of the photographing system. [Figure 5A] FIG. 5A is a diagram showing an example of a background plate. [Figure 5B] FIG. 5B is a diagram showing a modified example of the background plate. [Figure 5C] FIG. 5C is a diagram showing a modified example of the background plate. [Figure 6] FIG. 6 shows image data obtained by the photographing device. [Figure 7] FIG. 7 is a diagram showing a chromakey composite image. [Figure 8] FIG. 8 is a diagram showing a modified example of the imaging system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] <Present embodiment> Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. 1 to 7 are diagrams showing an embodiment of an imaging system according to the present disclosure.

[0019] As shown in FIG. 1 to FIG. 3, the photographing system 10 includes a housing 20 having a bottom plate 21, a top plate 22, and a side plate 23, and a partition wall 20C that divides the inside of the housing 20 into a photographing space 20A and a storage space 20B. A camera (photographing device) and a light projecting unit 34, an operation panel 15, a detection sensor 13, and a cashier 33 are provided on the partition wall 20C side of the storage space 20B of the housing 20. A floor surface 25 made of a metal plate is also provided on the bottom plate 21. Here, the housing 20 surrounds a person P to be photographed, which will be described later, and functions as an enclosure. The enclosure is not limited to one that surrounds the person P from the top, bottom, and entire sides, but may also surround the person P from only the front and rear. Furthermore, a printer 17 and a control unit 11 are provided in order from the bottom to the top on the side plate 23 side facing the partition wall 20C in the storage space 20B.

[0020] Also, a chair 45 for the person P to be photographed to sit on is provided on the floor 25 .

[0021] Among the above-mentioned components, the operation panel 15 is used by the person P to be photographed when he / she faces the camera 12, and is also a panel to be operated by the person P to be photographed. In this case, the operation panel 15 displays the corrected image 2 trimmed by the trimming processing unit 11c, which will be described later, and the person P can confirm this corrected image 2. Furthermore, the operation panel 15 can also display the chromakey composite image 5 obtained by the chromakey composite unit 11d, which will be described later.

[0022] As described above, the camera 12, the light-projecting unit 34, and the operation panel 15 are installed on the partition wall 20C side within the storage space 20B of the housing 20, and within the shooting space 20A, on the side panel 23 side facing the partition wall 20C, a background board 40 for chromakey processing is provided to cut out the entire body of the person being photographed from the obtained photographed image.

[0023] Further, on the partition wall 20C side within the storage space 20B of the housing 20, below the operation panel 15 as described above, the detection sensor 13 and the cashier 33 are disposed in this order from top to bottom.

[0024] Further, an outlet 17a for the printer 17 is provided on the outer surface of the side plate 23 of the housing 20.

[0025] Further, in addition to the control unit 11 and the printer 17, a storage unit 16, the printer 17, an I / O (Input / Output) unit 31, and a speaker 32 are built into the storage space 20B of the housing 20.

[0026] The camera 12 described above is a camera for photographing the person P, and is adapted to obtain a still image of the person P or a moving image of the person P within the housing 20.

[0027] 2, the control unit 11 is composed of a CPU (Central Processing Unit) and a RAM (Random Access Memory), reads out various programs such as a system program, a face image capture processing program, and an image processing program stored in the storage unit 16, develops them in the RAM, and centrally controls the operation of each unit according to the programs. Then, the control unit 11 generates an image shot for each shot based on an image captured by a camera 12 (described later).

[0028] The camera 12 is composed of an optical lens, an optical sensor such as a CCD (Charge Coupled Device), an A / D (Analog / Digital) converter, etc., and when taking a picture, the subject image input through the optical lens is photoelectrically converted by the optical sensor to generate an image signal (analog). Then, the A / D converter obtains digital image data from the analog image signal, and outputs the digital image data to the control unit 11.

[0029] The detection sensor 13 is an optical sensor or the like that detects the entry of a person P to be photographed into the photographing space 10A of the photographing system 10, and outputs a detection signal to the control unit 11.

[0030] The operation panel 15 has various function keys such as a touch panel, a photo type selection switch (hereinafter referred to as SW) for selecting the type of photo, a shooting SW for instructing the start of shooting, and a print SW for instructing the printing of the captured image, and outputs an operation signal corresponding to the operated key to the control unit 11.

[0031] Operation panel 15 also has an LCD (Liquid Crystal Display) or the like, and displays various operation screens such as a guide screen explaining the shooting procedure and a selection screen for selecting the type of photo, according to a control signal from control unit 11. When subject P faces camera 12 directly, operation panel 15 also displays a facial image of subject P photographed by camera 12, etc.

[0032] The storage unit 16 stores the system program, various processing programs such as a face image photographing processing program and an image processing program, and data processed by each program, etc. The storage unit 16 also stores a plurality of templates (background images around the image of the person to be photographed) 3 (see FIG. 5C), which will be described later.

[0033] The printer 17 performs print output based on image data input from the control unit 11. The printing method used by the printer 17 is a dye-sublimation transfer method in which an image is formed by sublimating and transferring a coloring material. However, it is also possible to use a melt transfer recording method in which a recording medium and an image receiving material are superimposed and heat is applied to transfer the recording layer of the recording medium to the image receiving layer of the image receiving material to form an image, or an electrophotographic method, an inkjet method, or any other printing method. It is also possible to use a method in which a silver halide photographic image is formed.

[0034] The I / O unit 31 is an interface that mediates the exchange of information between the control unit 11 and the speaker 32, cashier 33, and light-projecting unit 34, and transmits control signals from the control unit 11 to the speaker 32, cashier 33, and light-projecting unit 34, and also outputs signals from the speaker 32, cashier 33, and light-projecting unit 34 to the control unit 11.

[0035] The speaker 32 outputs an audio signal of a guide announcement input from the control unit 11 via the I / O unit 31 .

[0036] The cashier 33 is a cash register equipped with a deposit port for coins and bills, a refund port for change, etc. The cashier 33 detects the amount of money deposited through the deposit port, calculates the amount of change, and discharges coins or bills in the calculated amount of change through the refund port to settle the fee.

[0037] The light projecting unit 34 emits light at the timing and in the amount of light emitted instructed by the control unit 11 .

[0038] In addition, the camera 12 has a built-in wide-angle lens 12a, and the camera 12 can obtain a photographed image 1 through the wide-angle lens 12a, which captures substantially the entire body of the person P sitting in a chair 45 (see FIG. 6). The photographed image 1 of the person P captured through the wide-angle lens 12a is sent to the control unit 11.

[0039] In the present embodiment, the wide-angle lens 12a included in the camera (imaging device) 12 is a lens that can capture a wider range than a standard lens, and refers to a lens with a focal length of approximately 40 mm or less, specifically, a lens with a focal length of 35 mm, 28 mm, or 24 mm.

[0040] In addition, when the subject P is photographed by the camera 12, a background board 40 is placed behind the subject P, so that the captured image 1 captured by the camera 12 includes both a person image 1A of the subject P and a background image 1B of the background board 40.

[0041] As shown in FIG. 5A, background board 40 has a color that is not generally found in the clothing of subject P, such as green or blue, so that chromakey compositing processing, which will be described later, can be performed with high accuracy.

[0042] The background plate 40 also has a background body 41 and a plurality of correction marks 42 that are provided on the background body 41 and are used when determining distortion correction parameters, which will be described later.

[0043] In this embodiment, the plurality of correction marks 42 on the background plate 40 are made up of square holes arranged in a grid pattern on the background body 41 .

[0044] In FIG. 5A, when the color of the background plate 40 is green, the colors of the background body 41 and the multiple correction marks 42 are all the same shade of green.

[0045] On the other hand, when the color of the background plate 40 is blue, the colors of the background body 41 and the plurality of correction marks 42 are all the same shade of blue.

[0046] The correction marks 42 on the background plate 40 are not limited to square-shaped holes, and may be circular holes arranged in a grid pattern on the background body 41 (see FIG. 5B).

[0047] Alternatively, the correction marks 42 of the background plate 40 are not limited to being made up of square holes, but may be made up of cross hackings provided on the background body 41 (see FIG. 5C).

[0048] Next, a description will be given of control unit 11 to which photographed image 1 is sent. As shown in Fig. 2 and Fig. 6, control unit 11 has a distortion correction parameter calculation unit 11a that calculates distortion correction parameters for photographed image 1 from the shape of correction mark 42 in background image 1B obtained by photographing background board 40, out of photographed image 1 obtained by camera 12 through wide-angle lens 12a, and a correction processing unit 11b that performs correction processing on photographed image 1 using the distortion correction parameters calculated by distortion correction parameter calculation unit 11a to calculate corrected image 2.

[0049] In addition, the correction processing unit 11b is connected to a trimming processing unit 11c that trims the corrected image 2 obtained by the correction processing unit 11b to a size for an identification photograph. In addition, the trimming processing unit 11c is connected to a chromakey compositing unit 11d that obtains a chromakey composite image 5 by chromakey compositing using the corrected image 2 obtained by the correction processing unit 11b and a desired template 3 selected by the operation panel 15.

[0050] In this embodiment, distortion correction parameter calculation unit 11a of control unit 11 determines distortion correction parameters for photographed image 1 from the shape of correction mark 42 in background image 1B of photographed image 1. In this case, photographed image 1 is image data obtained through wide-angle lens 12a, and lens distortion caused by wide-angle lens 12a occurs, and this lens distortion gradually increases from the center of photographed image 1 toward the periphery.

[0051] The distortion correction parameter calculation unit 11a identifies correction marks 42a in the vicinity of the person image 1A, specifically, in the vicinity of the face position 1a of the person image 1A, among the multiple correction marks 42 in the background image 1B of the photographed image 1. Then, the distortion correction parameter is obtained from the shape of the identified correction mark 42a. In this case, for example, when the correction mark 42 on the background board 40 is a square-shaped eye (see FIG. 5A), the distortion correction parameter calculation unit 11a obtains distortion correction parameters that return the shape of the correction mark 42a identified in the photographed image 1 to a square shape.

[0052] As described above, the photographed image 1 obtained through the wide-angle lens 12a has lens distortion caused by the wide-angle lens 12a, and therefore the identified correction mark 42a is similarly distorted. In this case, by performing correction processing using parameters that return the distorted correction mark 42a to a square shape, the lens distortion caused by the wide-angle lens 12a can be corrected for the photographed image 1, particularly for the person image 1A near the identified correction mark 42a.

[0053] Using the distortion correction parameters thus calculated by the distortion correction parameter calculation unit 11a, the correction processing unit 11b performs a correction process on the captured image 1. As a result, the correction processing unit 11b generates a corrected image 2 obtained by correcting the captured image 1.

[0054] As described above, when the subject P operates the operation panel 15 to select a desired template 3 from the plurality of templates 3 stored in the memory unit 16, the chromakey composition unit 11d of the control unit 11 performs chromakey composition of the selected template 3 and the corrected image 2.

[0055] Then, in the chromakey compositing unit 11d, a chromakey composite image 5 is generated by chromakey compositing the template 3 and the corrected image 2, and this chromakey composite image 5 is sent from the control unit 11 to the operation panel 15, and the chromakey composite image 5 is displayed on this operation panel 15 (see Figure 7).

[0056] Next, the operation of this embodiment having such a configuration will be described with reference to FIG.

[0057] First, when the person P to be photographed enters the housing 20, the detection sensor 13 detects the person P. At this time, guidance is displayed on the operation panel 15. At the same time, an announcement voice related to the shooting guide is output from the speaker 32. During this time, the person P to be photographed sits on the chair 45 inside the housing 20.

[0058] Next, the fee is inserted into the cashier 33, where the amount deposited is checked and an operation screen is displayed on the operation panel 15.

[0059] Thereafter, as shown in FIG. 4, the photographing operation is carried out following the guidance displayed on the operation panel 15.

[0060] The person P to be photographed selects a desired template 3 on the operation panel 15. In this case, a plurality of templates 3 that will serve as background images around the image of the person P to be photographed are stored in advance in the storage unit 16.

[0061] Next, the person P is photographed through the wide-angle lens 12a of the camera 12. In this way, the photographed image 1 of the person P is obtained by the camera 12. Next, the photographed image 1 of the person P is sent from the camera 12 to the control unit 11.

[0062] In the control unit 11, the photographed image 1 is first sent to the distortion correction parameter calculation unit 11a, which detects the face position 1a of the person image 1A in the photographed image 1. The distortion correction parameter calculation unit 11a identifies a correction mark 42a that serves as a reference for distortion correction based on the face position 1a of the person image 1A. At this time, the distortion correction parameter calculation unit 11a identifies a correction mark 42a in the vicinity of the face position 1a, for example, the first correction mark 42a from the face position 1a.

[0063] Next, in the distortion correction parameter calculation unit 11a, from the shape of the identified correction mark 42a, for example, if the correction mark 42 has square meshes, a distortion correction parameter is calculated that returns the shape of the identified correction mark 42a to a square shape.

[0064] Next, the captured image 1 is corrected in the correction processing section 11b using the distortion correction parameters calculated in the distortion correction parameter calculation section 11a to obtain a corrected image 2.

[0065] Next, the corrected image 2 obtained in the correction processing unit 11b is trimmed in the trimming processing unit 11c to the size for an identification photograph, and the trimmed corrected image 2 is displayed on the operation panel 15 so that the photographed person P can check the trimmed corrected image 2.

[0066] Next, the trimmed corrected image 2 is sent from the trimming processing section 11c to the chromakey composition section 11d.

[0067] In this chromakey composition unit 11d, first, only the portrait image is extracted from the corrected image 2. Next, in this chromakey composition unit 11d, the extracted portrait image is chromakey-composited with a desired template 3 preselected on the operation panel 15, and a chromakey composite image 5 is obtained.

[0068] The chromakey composite image 5 obtained by combining the corrected image 2 and the template 3 in the chromakey composition section 11d of the control section 11 is then sent from the control section 11 to the operation panel 15, and the chromakey composite image 5 is displayed on this operation panel 15.

[0069] The person P to be photographed checks the chromakey composite image 5 displayed on the operation panel 15 and operates the operation panel 15. The control unit 11 releases the shutter a predetermined time after the operation of the operation panel 15. This generates an image shot.

[0070] Thereafter, a photo print is generated by the printer 17 based on the image shot of the chromakey composite image 5, and the photo print is discharged from the outlet 17a of the printer 17. Alternatively, the image shot may be sent to an external server (not shown) via the WiFi router 18 and the network.

[0071] As described above, according to this embodiment, it is possible to obtain photographed image 1 by photographing substantially the entire body of person P sitting in chair 45 using camera 12 having wide-angle lens 12a without making housing 20 excessively large, and it is possible to obtain corrected image 2 in which lens distortion has been corrected by correcting photographed image 1 using distortion correction parameters. In this case, since wide-angle lens 12a is used for photographing, substantially the entire body of person P can be photographed regardless of the sitting height of person P, and therefore person P does not need to adjust the height of chair 45 or move camera 12 up or down.

[0072] Furthermore, the distortion correction parameter calculation unit 11a identifies the correction mark 42a closest to the face position 1a among the multiple correction marks 42 on the background board 40, and calculates the distortion correction parameter from the shape of this specified correction mark 42a, so that lens distortion at the face position 1a of the person image 1A in particular in the photographed image 1 can be reliably corrected.

[0073] Furthermore, since the colors of the background body 41 and the correction mark 42 of the background board 40 are the same color system, for example, blue or green, even if the background board 40 has the correction mark 42, there is no problem with the chromakey compositing process in the chromakey compositing section 11d of the control section 11.

[0074] <Modification> Next, a modification of this embodiment shown in FIG. 8 will be described.

[0075] In the above embodiment, an example has been shown in which a background board 40 is placed on one side of the housing 20, and a person to be photographed P sitting in front of the background board 40 is photographed by the camera 12. However, the present invention is not limited to this example, and it is also possible to place a large background board 40 in a television studio as shown in FIG. 8, have multiple people to be photographed, for example three people to be photographed P, sit in front of the background board 40 at a distance from each other, and photograph the three people to be photographed P by the camera 12 having a built-in wide-angle lens 12a.

[0076] In the modification shown in FIG. 8, three subjects P are photographed by a camera 12, and thus a photographed image 1 is obtained.

[0077] In the control unit 11, based on the captured image 1 from the camera 12, a distortion correction parameter is calculated for each photographed person P in the distortion correction parameter calculation unit 11a in the same manner as in the above-mentioned embodiment, and correction processing is performed in the correction processing unit 11b using the correction parameter.

[0078] Specifically, the distortion correction parameter calculation unit 11a of the control unit 11 identifies the correction mark 42a closest to the face position 1a for each subject P in the captured image 1, and calculates the distortion correction parameter for each subject P in the captured image 1 from the shape of this identified correction mark 42a.

[0079] Next, in the correction processing section 11b, using the distortion correction parameters for each photographed person P calculated in the distortion correction parameter calculation section 11a, a correction process is performed on the photographed image 1 for each region including each photographed person P, and a corrected image 2 is calculated.

[0080] The corrected images 2, which have been corrected for each area including each person P, are cut out and combined close to each other. Therefore, no lens distortion remains in the area of ​​each person P in the combined corrected image 2. The combined image thus formed is then subjected to chromakey compositing processing in the chromakey compositing section 11d to obtain a chromakey composite image 5, which is used for broadcasting on a TV or the like.

[0081] When multiple subjects P are seated in front of a background board 40 and photographed with a camera 12 including a wide-angle lens 12a, it is possible to photograph all of the subjects P with one camera 12, but it is possible that the wide-angle lens 12a will cause significant lens distortion in the photographed image 1. In this modified example, the lens distortion of the area including each of the subjects P can be reliably corrected, and a chromakey composite image without lens distortion can be obtained by combining the corrected images after correction and performing chromakey compositing processing on this combined image. This chromakey composite image can be broadcast on a TV or the like. [Explanation of symbols]

[0082] 1. Captured images 1A Portrait 1a Face position 1B Background image 2 Corrected image 3. Templates 5 Chromakey composite images 10. Shooting System 11 Control section 11a Distortion correction parameter calculation section 11b Correction processing section 11c Trimming processing section 11d Chromakey Compositing Section 12 Camera 12a Wide-angle lens 13 Detection sensor 15 Operation Panel 16 Memory section 17 Printers 17a Outlet 20. Cabinet 21 Bottom plate 22 Tabletop 23 Side Panel 31 I / O Unit 32 Speaker 33 Cashier 34 Light projector 40 Background board 41 Background body 42 Correction Mark

Claims

1. a background plate including a background body and a plurality of correction marks provided on the background body, the plurality of correction marks being arranged in a vertical direction and a plurality of correction marks arranged in a horizontal direction to form a grid shape; an image capturing device for capturing an image of a person to be photographed positioned in front of the background plate and a background image, the image capturing device including a lens; a control unit to which the captured image obtained by the imaging device is sent, the control unit includes a distortion correction parameter calculation unit that calculates a distortion correction parameter for the captured image from the shape of the correction mark of the background image of the captured image obtained by the image capturing device through the lens; a correction processing unit that performs a correction process on the captured image using the distortion correction parameter calculated by the distortion correction parameter calculation unit to calculate a corrected image, The distortion correction parameter calculation unit calculates a distortion correction parameter for the captured image from a shape of a first correction mark for the person image among a plurality of correction marks in the background image of the actually captured captured image.

2. 2. The photographing system according to claim 1, wherein the control unit includes a chromakey compositing unit that performs chromakey compositing using the corrected image obtained by the correction processing unit and a desired template selected by an operation panel to obtain a chromakey composite image.

3. 3. The photographing system according to claim 1, wherein said lens is a wide-angle lens having a focal length shorter than that of a standard lens.

4. 4. The photographing system according to claim 1, wherein the background body and the correction marks of the background plate have the same color system.

5. 5. The photographing system according to claim 1, wherein the background plate is installed on one surface of an enclosure surrounding the person to be photographed.

Images