Perspective image display system and method

Abstract

The invention provides a perspective image display system and method. The perspective image display system includes: a photographer photographing device for photographing a photographer; a plurality of subject imaging devices for imaging a subject to be imaged; a viewing angle detection unit that detects the viewing angle of the photographer on the basis of the photographer portrait captured by the photographer imaging device; a portrait linking unit that links the plurality of portraits by linking overlapping portions of the subject portraits captured by the plurality of subject imaging devices; and a portrait generation unit that generates a perspective image by homographically converting the plurality of subject portraits linked by the portrait linking unit on the basis of the angle of view of the photographer.

Description

Technical Field

[0001] The invention relates to a perspective image display system and method. Background Art

[0002] In recent years, research and development that contributes to energy efficiency has been underway in order to ensure access to affordable, reliable, sustainable, and advanced energy for more people.

[0003] Homograph transformation is usually used for see through display. However, since homography is a deformation process of a two-dimensional image, the image will be distorted for three-dimensional objects with depth. The depth information used in homography is the length of the vertical line corresponding to the two-dimensional surface. Therefore, it is impossible to find the best "distance to the object" for generating multiple candidate three-dimensional structures. In order to perform homography, it is necessary to measure the distance to the subject.

[0004] When a portable camera device that integrates a camera and a display unit, such as a smartphone or tablet, is used to shoot a subject, if the position of the photographer's eyes and the actual field of view (angle of view) determined by feature points in the environment are different, the position and viewing angle of the camera of the portable camera device will also be different. There will be inconsistencies such as position deviation (offset), color shift, and size (enlargement or reduction) between the "real scene" perceived by the photographer and the "displayed image". It is known that there will be inconsistencies (discomfort) between the visual information and physical sensory information perceived by the photographer.

[0005] If there is a mismatch (discomfort) between the visual information and the body sensory information perceived by the camera user, especially when the camera user moves the subject's position to bring it within the camera's field of view while watching the "display image" to shoot, the camera user (user) must get used to finding the subject under the condition that the screen display range is narrower than the field of view. It takes some time for the camera user (user) to get used to it and he must concentrate.

[0006] Prior art literature

[0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2013-061988

[0008] Patent document 2: Japanese Patent Application No. 2018-112790

[0009] Patent document 3: Japanese Patent Application No. 2020-006913

[0010] Patent document 4: Japanese Patent Application No. 2020-080074

[0011] Patent document 1 discloses a display control device, a display control method, and a display control program. Patent document 2 discloses an information processing device, a control method, and a program thereof. Patent document 3 discloses a dominant eye judgment device. Patent document 4 discloses a sight line detection device, a program, and a sight line detection method. However, when a clear object cannot be determined, the distance cannot be calculated. Therefore, homography transformation cannot be applied.

[0012] However, in the present technology, a problem remains how to display a transparent image without causing discomfort without measuring the distance to the subject. Summary of the invention

[0013] In order to solve the above-mentioned problems, the present invention aims to achieve a transparent image display without measuring the distance to the subject and thus producing a comfortable feeling. Furthermore, it contributes to energy efficiency.

[0014] According to an embodiment of the present invention, a perspective image display system is provided. The perspective image display system includes: a cameraman camera device for photographing a cameraman; a plurality of subject camera devices for photographing a subject as a photographing object; a view angle detection unit for detecting the view angle of the cameraman through the cameraman portrait photographed by the cameraman camera device; a portrait connection unit for connecting the overlapping parts of the subject portraits photographed by the plurality of subject camera devices to connect the plurality of portraits; and a portrait generation unit for performing homography transformation on the plurality of subject portraits connected by the portrait connection unit based on the view angle of the cameraman, thereby generating a perspective image.

[0015] According to an embodiment of the present invention, the perspective image display system further includes: an image area limiting unit that limits the viewing angle of one end of the subject image captured by the plurality of subject imaging devices along the viewing angle detected by the viewing angle detection unit.

[0016] According to an embodiment of the present invention, in the above-mentioned perspective image display system, a focal position of a lens of each of the plurality of subject imaging devices is located at an end of a display unit of the perspective image display system.

[0017] According to another embodiment of the present invention, a perspective image display method is provided. The perspective image display method includes: photographing a photographer to obtain a portrait of the photographer; photographing a subject as a photographing object; detecting the perspective of the photographer based on the portrait of the photographer; connecting overlapping parts of the portraits of the photographed subject to each other to connect multiple portraits; and performing homography transformation on the connected multiple subject portraits based on the perspective of the photographer to generate a perspective image.

[0018] According to an embodiment of the present invention, the perspective image display method further includes: limiting the viewing angle of one end of the subject portrait along the detected viewing angle of the photographer portrait.

[0019] According to the embodiment of the present invention, even if the distance to the object is not measured, homography transformation can still be used to generate a perspective image display without discomfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 4 is a schematic diagram of the architecture of a perspective image display system according to an embodiment of the present invention.

[0021] Figure 2A and Figure 2B FIG. 1 is a schematic diagram showing the arrangement of a camera person imaging device and a subject imaging device according to an embodiment of the present invention.

[0022] Figure 3 This is a schematic diagram of a situation illustrating how to obtain information about the cameraman and detect the viewing angle.

[0023] Figure 4 It is a schematic diagram of the process of obtaining information about a cameraman and detecting a viewing angle according to an embodiment of the present invention.

[0024] Figure 5A and Figure 5B is a definition of the optical parameters required in the embodiment of the present invention

[0025] Figure 6 FIG. 4 is a schematic diagram of a perspective image display method according to an embodiment of the present invention.

[0026] Figure 7 It is an explanatory diagram of a method for superimposing images according to an embodiment of the present invention.

[0027] Fig. 8A A method of determining overlapping portions of images according to an embodiment of the present invention is described below.

[0028] Figure 8B A method of determining a connection line when overlapping images according to an embodiment of the present invention is described below.

[0029] Fig. 9A and Fig. 9B The perspective image display system 100 of the present invention is illustrated as an example of a configuration in which a central camera is provided.

[0030] Fig.10 FIG. 1 is another diagram for explaining another method of generating an image required for displaying a perspective image according to an embodiment of the present invention.

[0031] Fig.11A and Fig. 11BThis is an example of performing homography transformation on a plurality of connected subject images according to an embodiment of the present invention.

[0032] Fig.12 FIG. 1 is an explanatory diagram of focus design of a subject imaging device according to an embodiment of the present invention.

[0033] Fig.13A and Fig. 13B This is a diagram illustrating the principle of focus design of the subject imaging device according to the embodiment of the present invention.

[0034] Description of Reference Numerals

[0035] 100: Perspective image display system

[0036] 102: Cameraman Camera Device

[0037] 104: Subject camera device

[0038] 106: Viewing angle detection unit

[0039] 108: Image connection department

[0040] 110: Portrait Generation Department

[0041] 112: Image area restriction unit

[0042] 114: Display unit

[0043] 120: Control Department

[0044] 130: Image sensor

[0045] 140: Lens

[0046] A: Photographer DETAILED DESCRIPTION

[0047] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0048] Figure 1 FIG. 1 is a schematic diagram of the architecture of a perspective image display system according to an embodiment of the present invention. Figure 1 As shown, the perspective image display system 100 includes at least a photographer imaging device 102 , a plurality of subject imaging devices 104 , a viewing angle detection unit 106 , an image combining unit 108 , and an image generating unit 110 .

[0049] The perspective image display system 100 is used, for example, when inspecting a vehicle. In the following description, the engine compartment of the vehicle is used as an example, but this application is only used as an example and is not intended to limit the scope of application of the present invention. The perspective image display system 100 is, for example, a smart phone or a tablet. The perspective image display system 100 can also be called a portable camera device.

[0050] The cameraman camera device 102 is used to shoot the cameraman. The cameraman camera device 102 mainly obtains information related to the cameraman. In addition, the cameraman camera device 102 can also obtain the distance and angle between the cameraman and the perspective image display system 100. As an example, the cameraman camera device 102 is a camera configured on one side of a smart phone or a tablet, which is used to shoot the cameraman.

[0051] The plurality of subject imaging devices 104 are used to capture the subject as the capture object. As an example, the subject imaging device 104 is a camera disposed on the other side of a smartphone or a tablet, and is used to capture the capture object.

[0052] Figure 2A and Figure 2B FIG. 2 is a schematic diagram showing the configuration of a camera operator imaging device and a subject imaging device according to an embodiment of the present invention. Figure 2A or Figure 2B , which illustrates the installation position of the camera camera 102. Figure 2A The fluoroscopic image display system 100 includes two subject imaging devices 104 , which are respectively provided on the upper side and the lower side (with respect to the long side direction of the fluoroscopic image display system 100 ) of the fluoroscopic image display system 100 . Figure 2B The fluoroscopic image display system 100 includes four subject imaging devices 104 , which are respectively provided at four corners of the fluoroscopic image display system 100 .

[0053] The angle of view detection unit 106 detects the angle of view of the cameraman from the cameraman's image captured by the camera device.

[0054] The image connecting unit 108 connects the overlapping parts of the subject images captured by the plurality of subject imaging devices 104 to connect the plurality of images.

[0055] The image generating unit 110 generates a perspective image by performing homography transformation on the plurality of subject images connected by the image connecting unit 108 based on the viewpoint of the photographer.

[0056] According to an embodiment of the present invention, as an alternative embodiment, Figure 1The perspective image display system 100 shown may further include an image region limiting unit 112. The image region limiting unit 112 limits the viewing angle of one end of the image of the subject captured by the plurality of subject imaging devices along the viewing angle detected by the viewing angle detection unit.

[0057] In the above embodiment, the viewing angle detection unit 106, the image connection unit 108, the image generation unit 110, and the image area restriction unit 112 can be implemented as independent components. However, the viewing angle detection unit 106, the image connection unit 108, the image generation unit 110, and the image area restriction unit 112 can also be integrated into a single control unit 120 for implementation. The control unit 120 can be designed separately to implement the control of the above-mentioned units, or it can be a part of the control unit of the camera device 102.

[0058] The operations of the viewing angle detection unit 106 , the image connection unit 108 , the image generation unit 110 , and the image region restriction unit 112 will be described in further detail below.

[0059] Figure 3 This is a schematic diagram of a situation illustrating how to obtain information about the cameraman and detect the viewing angle. Figure 4 1 is a flow chart of obtaining the information of the cameraman and detecting the viewing angle according to an embodiment of the present invention. The cameraman's information and face recognition are existing technologies and can be obtained by any existing method. The present invention does not specifically limit this. The following description is only an example.

[0060] The present invention is directed to detecting the viewing angle (field of view) of the photographer's portrait, that is, the viewing angle of the photographer A detected by the viewing angle detection unit 106 of the perspective image display system 100 .

[0061] like Figure 3 and Figure 4 As shown, first, in step S100, the cameraman camera device 102 of the perspective image display system 100 is started. For example, a switching key can be pressed in the shooting mode of the perspective image display system 100, and the camera that shoots the cameraman, that is, the cameraman camera device 102, shoots the cameraman to obtain a portrait of the cameraman.

[0062] Next, in step S102, face recognition can be performed on the photographer A. Here, for example, the facial information (three-dimensional shape data) of the photographer (user) A is pre-registered in the memory of the perspective image display system 100, so that the distance from the photographer's camera device 102 (i.e., camera) can be estimated according to the size of the face of the photographer A during "face recognition". In addition, in head shape recognition, face recognition can also be performed using a depth camera.

[0063] In step S104, the eyes of the photographer A are detected. In step S106, the position of the dominant eye of the photographer A is detected. In face recognition, the positions of the two "eyes" can be detected, and the position of the "dominant eye" when viewed from the camera device 102 of the photographer can also be detected. The "dominant eye" can also be pre-registered in the memory of the perspective image display system 100. In step S108, the distance from the eyes of the photographer A is detected. In addition, in step S110, the angle of the sight line position is detected.

[0064] In step S112, the sight line angle to the upper side of the display unit 114 is calculated. In step S114, the sight line angle to the lower side of the display unit 114 is calculated. Steps S112 and S114 correspond to the operations performed by the viewing angle detection unit 106 described above.

[0065] Before continuing the description, some terms required for the present invention are defined first. Figure 5A and Figure 5B is a definition of various optical parameters required in the embodiments of the present invention, wherein Figure 5A and Figure 5B This is an example of the eyes of the photographer A being at different sight lines. Figure 5A The situation shown is that the position of the eye of the photographer A is roughly located in the middle of the display unit 114 of the perspective image display system (taking a smartphone as an example) 100, and the line of sight incident angle of the eye of the photographer A (the angle entering the display unit 114) is almost 0. Figure 5A The situation shown is that the position of the eye of the photographer A is approximately located at the middle position of the display unit 114 of the perspective image display system (for example, a smartphone) 100, and the sight line incident angle of the eye of the photographer A (the angle of incident on the display unit 114) is not 0, that is, the sight line of the eye forms an angle with the plane of the display unit 114. The following are the definitions of each parameter:

[0066] Display range R: From one end to the other end of the smartphone display

[0067] Camera angle of view φ: The maximum range that the camera can capture.

[0068] Field of view: The range that a person can see visually.

[0069] Viewing angle α: The angle required to see the display range in the field of view.

[0070] Line of sight L: A line connecting the eye position to the center of the screen of the display unit.

[0071] Right line of sight LR1: A connecting line from the eye position to the right end of the screen of the display unit.

[0072] Left line of sight LL1: A line connecting the eye position to the left end of the screen of the display unit.

[0073] Sight incident angle θ: the incident angle from the eye position to the center of the screen of the display unit.

[0074] Right sight line incident angle θR: The incident angle from the eye position to the right end of the screen.

[0075] Left sight line incident angle θL: The incident angle from the eye position to the left end of the screen.

[0076] In the above definition, the camera in the camera angle φ refers to the above-mentioned object camera device 104. In addition, for the sake of simplicity, Figure 5A and Figure 5B Only one subject imaging device 104 is shown, but even when there are two or more, the definition is the same. Figure 5A , Figure 5B In the figure, the image range captured by the subject camera 104 is AC. The oblique line portion outside the extended line of sight LR2 extending from the right line of sight LR1 of the eye of the photographer A is the portion outside the field of view angle α of the eye of the photographer A. Therefore, in the subsequent processing, the image range AC1 outside the field of view is cut by the image area limiting unit 112 (which will be described in detail later).

[0077] Figure 6 is a schematic diagram of a perspective image display method according to an embodiment of the present invention. Figure 6 , two subject camera devices 104 will be used as an example to illustrate the perspective image display method of the embodiment of the present invention. Figure 5A In addition, the perspective image display system 100 is taken as an example of a horizontal perspective image display system 100, and the two subject imaging devices 104 are respectively located on the left and right sides.

[0078] like Figure 6 As shown, when the cameraman A is photographed by the cameraman camera device 102 of the perspective image display system (for example, a smartphone) 100, the angle of view of the cameraman A is detected by the angle of view detection unit 106 based on the cameraman portrait. Figure 4 In steps S112 and S114 shown, the sight angle from the eye of the cameraman A to the right side of the display unit 114 and the sight angle from the eye of the cameraman A to the left side of the display unit 114 are calculated. That is, the viewing angle α, the right sight angle θR, and the left sight angle θL are calculated as the "angle of view of the cameraman A".

[0079] Next, the camera angle of view of the right subject camera 104R is φR, and the angle of view range RCR of the image captured by the right subject camera 104R is from the lower limit range LUC to the upper limit range LUU. In addition, the camera angle of view of the left subject camera 104L is φL, and the angle of view range LCR of the image captured by the left subject camera 104L is from the lower limit range LCC to the upper limit range LCU. Thus, the range captured by the two subject camera devices 104R and 104L is the photographic range R_PH (angle of view range LCC to LUU).

[0080] Furthermore, the image area limiting unit 112 limits the angle of view of one end of the image of the subject captured by the plurality of subject imaging devices along the angle of view detected by the angle of view detecting unit 106. Figure 6 As shown, based on the extended line of sight LR2 extending from the right line of sight LR1 of the cameraman A, it can be known that the angle of view φR1 other than the extended line of sight LR2 of the cameraman A's camera device 104R for the right object in the camera angle of view φR is outside the field of view α of the cameraman A. Therefore, only the portion of the camera angle of view φ'R of the camera angle of view φR can be used for perspective image display (φR=φ'R+φR1). Similarly, based on the extended line of sight LL2 extending from the left line of sight LL1 of the cameraman A, it can be known that the angle of view φL1 other than the extended line of sight LL2 of the camera angle of view φL of the camera device 104L for the left object in the camera angle of view φL is outside the field of view α of the cameraman A. Therefore, only the portion of the camera angle of view φ'L of the camera angle of view φL can be used for perspective image display (φL=φ'L+φL1).

[0081] In addition, the range between the extended sight lines LR2 and LL2 on the left and right sides, i.e., the range R_ST displayed as the perspective image, is between EC and EU. Therefore, the image area limiting unit 112 limits the display of the image captured by the right subject camera 104R between EU and LUU and the image captured by the left subject camera 104L between LCC and EC.

[0082] Then, the position avoiding the object is estimated in the lower limit range LUC of the right object imaging device 104R and the upper limit range LCU of the left object imaging device 104L.

[0083] Next, an image for perspective image display is generated based on the upper limit EC and lower limit EU of the estimated perspective image display range R_ST, the lower limit range LUC of the right object camera 104R, and the upper limit range LCU of the left object camera 104L.

[0084] Next, a method of overlapping a plurality of images, that is, the execution mode of the image connecting unit 108 described above, will be described. Figure 7 It is an explanatory diagram of a method for superimposing images according to an embodiment of the present invention. Figure 7 Two subject imaging devices 104 are also used as an example for explanation, namely the right subject imaging device 104R and the left subject imaging device 104L mentioned above.

[0085] like Figure 7 As shown, the image captured by the right object camera 104R is the viewing angle range RCR, and the image captured by the left object camera 104L is the viewing angle range LCR, wherein the overlapping portion of the two is the overlapping range OP. In addition, the range R_ST of the perspective image display is between the upper limit EC and the lower limit EU.

[0086] The overlapping range OP can be determined by, for example, obtaining the correlation between the two images. It should be noted that, because the right object camera 104R and the left object camera 104L have different shooting angles, the images in the overlapping range are not equal. Fig. 8A A method of determining overlapping portions of images according to an embodiment of the present invention is described below.

[0087] like Fig. 8A As shown, first, a portion of the left side of the image RCR of the right-side subject camera 104R and a portion of the right side of the image LCR of the left-side subject camera 104L are taken as the evaluation range of the overlapping portion of the two, and the widths of the two portions can be roughly the same. Next, the correlation between the two images is calculated within this evaluation range. After that, the correlation between the two images is calculated while changing the evaluation range. In this way, the evaluation range with the highest correlation is found. Finally, the evaluation range with the highest correlation is taken as the overlapping portion.

[0088] The method of connecting two images is to first determine the overlap range OP. According to the embodiment of the present invention, the connection method can be performed in different ways. First, the central part of the overlap range OP can be used as the connection line, such as Figure 7 In addition, the connecting line should avoid the position of the subject.

[0089] besides, Figure 8BAnother method for determining a connection line when overlapping images according to an embodiment of the present invention is illustrated. First, the overlapping range OP of the image RCR of the right subject camera 104R and the overlapping range OP of the image LCR of the left subject camera 104L are cut into multiple parts with a certain width. Then, the correlation of each corresponding cut part in the overlapping part OP of the image RCR and the image LCR is calculated. If the correlation is high, it is estimated that the position is a position where it will not be uncomfortable to view the subject using either the right subject camera 104R or the left subject camera 104L.

[0090] According to the embodiment of the present invention, each cut part of the above two images is subjected to a fast Fourier transform (FFT) to obtain the frequency component. If there are more high-frequency components, the image changes more, indicating that the structure is complex. On the contrary, if there are more low-frequency components, it means that the important part is not captured. As a connecting part, the correlation should be high, and the low-frequency component is more suitable. Therefore, the part with high correlation in the low-frequency area is used as a candidate for the connecting line, such as Figure 7 As for the correlation, as an example, when the contrast of pixels in a certain part is almost the same, it can be judged that the correlation is high.

[0091] Thus, after the connection line is determined, the image captured by the right-side subject camera 104R and the image captured by the left-side subject camera 104L can be connected within the range from EC to EU to generate an image required for perspective image display.

[0092] Furthermore, the present invention can also generate the image required for perspective image display without using the method of connecting images. Fig. 9A and Fig. 9B The perspective image display system 100 of the present invention is illustrated as an example of a configuration in which a central camera is provided. Fig.10 FIG. 1 is another diagram for explaining another method of generating an image required for displaying a perspective image according to an embodiment of the present invention.

[0093] like Fig. 9A and Fig. 9B As shown, the perspective image display system 100 is provided with five subject imaging devices, one of which is a central subject imaging device 104C provided in the center. Fig. 9A The other four shown are arranged at the center of each side of the perspective image display system 100. Fig. 9B The other four shown are arranged at the four corners of the perspective image display system 100. Figure 2A The structure is equipped with a central subject camera device 104C.

[0094] Under this framework, Fig.10 As an example, a right-side subject imaging device 104R, a left-side subject imaging device 104L, and a center subject imaging device 104C are provided. Fig.10 As shown, the image captured by the right subject camera 104R is the range RCR, the image captured by the left subject camera 104L is the range LCR, and the image captured by the center subject camera 104C is the range CCR. The range CCR of the image captured by the center subject camera 104C basically includes the range RCR and the range LCR.

[0095] When the central subject image capturing device 104C is used, the end of the range CCR of the image captured by the central subject image capturing device 104C must be adjusted according to the angle of view of the photographer detected by the angle of view detection unit 106 based on the photographer image.

[0096] First, the end position (such as EU) of the range RCR of the image captured by the right-side subject camera 104R and the end position (such as EC) of the range LCR of the image captured by the left-side subject camera 104L can be estimated from the viewing angle (i.e., the viewing angle of the photographer detected by the viewing angle detection unit 106).

[0097] Then, the image sequence of the right subject camera 104R and the left subject camera 104L at positions EU and EC is used to find the position with the highest correlation with the image of the center subject camera 104C, and this position is used as the end position. Alternatively, an area with a high correlation with the images of the right subject camera 104R and the left subject camera 104L is found, and the portion within the area limited by the above-mentioned angle of view is used as the end.

[0098] In this way, in this embodiment, it is not necessary to overlap the images captured by each subject imaging device 104 , and it is only necessary to determine the end of the image captured by the central subject imaging device 104C.

[0099] Next, the plurality of subject images connected by the image connection unit 108 are homographically transformed. As an example, the range RCR of the image captured by the right subject camera 104R and the range LCR of the image captured by the left subject camera 104L are connected in the above manner to generate an image for perspective image display. Thereafter, the image generation unit 110 performs homographic transformation on the image for perspective image display based on the view angle of the photographer (generated by the view angle detection unit 106) to generate a perspective image.

[0100] Fig.11A and Fig. 11BFIG. 1 is an example of performing homographic transformation on a plurality of connected subject images according to an embodiment of the present invention. Fig.11A As shown, the display unit 114 of the perspective image display system 100 is tilted relative to the line of sight of the cameraman A. At this time, a sense of distance is caused by the difference in the distance of the line of sight. At this time, the image R_ST is homographically transformed by the image generation unit 110 based on the view angle of the cameraman A detected by the view angle detection unit 106 to display an image R_ST1 when the surface of the display unit is virtually perpendicular to the line of sight of the cameraman A.

[0101] Also, if Fig. 11B As shown, the display unit 114 of the perspective image display system 100 is perpendicular to the line of sight of the photographer A. However, the imaging plane of the object (perspective area R_ST or imaging area R_PH) is tilted relative to the line of sight of the photographer A, thus creating a sense of distance. This state is a perspective display state, so there is no need to perform homography transformation.

[0102] Fig.12 An illustration of the focus design of the subject camera device according to an embodiment of the present invention. In order to achieve the perspective image display of the present invention, the lens focus of the subject camera device 104 of the perspective image display system (smartphone) 100 must be adjusted. Fig.12 As shown, the subject imaging device 104 has a lens 140 and an image sensor 130 for imaging the subject behind the lens 140 of the subject imaging device 104. The lens 140 of the subject imaging device 104 has a viewing angle φ. The focal point of the lens of the subject imaging device 104 is generally located at a position F1. However, according to an embodiment of the present invention, the position of the focal point of the lens of the subject imaging device 104 is designed so that, when viewed from the outside, the focal point F2 is located at the end of the display unit 114 of the imaging device.

[0103] like Fig.13A As shown, when the focal point of the lens of the subject camera 104 is generally located at position F1 (i.e., at Fig.12 When the image sensor 130 is shown in FIG. 1 , the right line of sight LR1 of the cameraman A (the right side is used as an example) is the connection between the eye and the right side of the display unit 114 of the perspective image display system 100. At this time, when the cameraman A looks from the direction of the right line of sight LR1, the focus position (entrance pupil position) F1 of the corresponding extended line of sight LR2 does not match the end position of the display unit 114. At this time, the right line of sight LR1 of the cameraman A and the extended line of sight LR2 cannot be connected, causing the final perspective image to look uncomfortable.

[0104] On the contrary, if Fig. 13BAs shown, if the focus of the lens of the subject camera 104 is set at position F2 (i.e., the end of the display unit 114), the right line of sight LR1 of the photographer A and the extended line of sight LR2 can be connected, and the formed perspective image will not look uncomfortable.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A perspective image display system, characterized in that: include: A camera device for photographing the cameraman, used for photographing the cameraman; A plurality of subject camera devices for photographing the subject as the photographing object; A viewing angle detection unit detects the viewing angle of the cameraman through the cameraman portrait taken by the cameraman camera device; an image connecting unit for connecting overlapping portions of the subject images captured by the plurality of subject imaging devices to connect the plurality of images; The image generating unit generates a perspective image by performing a homographic transformation on the plurality of subject images connected by the image connecting unit based on the viewpoint of the photographer.

2. The perspective image display system according to claim 1, characterized in that: Also includes: The image area limiting unit limits an angle of view of one end of the subject image captured by the plurality of subject imaging devices along the angle of view detected by the angle of view detecting unit.

3. The perspective image display system according to claim 1, characterized in that: A focal position of a lens of each of the plurality of subject imaging devices is located at an end of a display unit of the perspective image display system.

4. A perspective image display method, characterized in that: include: photographing the photographer to obtain a portrait of the photographer; photographing a subject as a photographing object; Based on the cameraman portrait, detecting the cameraman's viewing angle; The overlapping parts of the images of the photographed object are connected to each other to connect multiple images; Based on the viewpoint of the photographer, the connected plurality of subject images are homographically transformed to generate a perspective image.

5. The perspective image display method according to claim 4, characterized in that: Also includes: The angle of view of one end of the subject image is limited along the detected angle of view of the photographer image.

Images