Method of displaying three-dimensional image for television screen
By correcting image positions on a TV screen using distance data and binocular parallax, the method effectively displays three-dimensional images, addressing the unnatural viewing experience in existing technologies and enhancing depth perception and balance.
Patent Information
- Application Number
- JP2023081153
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing methods for displaying stereoscopic images on a television screen do not effectively utilize measured distance data to correct image positions for binocular parallax, leading to an unnatural viewing experience.
The method involves correcting the image position on a TV screen using distance data to align with the pupillary distance of the human eyes, employing binocular parallax values, and utilizing VR goggles or stereoscopic glasses to synchronize and display images for a three-dimensional effect.
This approach allows for accurate representation of three-dimensional images on a TV screen, providing a stable and balanced viewing experience by aligning image positions with measured distances and parallax, enhancing the sense of depth and balance.
Smart Images

Figure 2024165212000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a method for displaying stereoscopic images on a television screen. [Background technology]
[0002] Movies are also screened using digital image data, and many users obtain image data via the Internet. The two-dimensional image captured by a television camera is different from the situation when viewed by a human being. The present invention provides a three-dimensional image by adding distance data to two-dimensional image data. An image (avatar) displayed in a two-dimensional virtual space (metaverse) set up on a television screen is made to appear as a three-dimensional image displayed in a three-dimensional virtual space. The present invention provides a method for acquiring distance data of image data, and a method for processing the image data using the acquired distance data and viewing the processed image. The following documents describe a method for measuring the distance to a subject by correlating the position of an image of the subject identified from a television screen captured by a television camera. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6719494 [Patent Document 2] Patent No. 7195093 Summary of the Invention
[0004] [Problem to be solved by the invention]
[0005] The method described in the above patent document is capable of measuring the distance to a subject in an image, but does not disclose how to express an image using this measured distance. [Means for solving the problem]
[0006] The image position of the subject on the TV screen is corrected using the distance data from the subject. The method of correcting the image position can take the form of relating the image displayed on the television screen to the image distance, and correcting the image position so that the image of the subject appears to be at the subject distance based on the interpupillary distance between the left and right eyes of a human being. Another method of correcting the image position described above is to use the binocular parallax value of the distance from the subject to correct the display position of the image so that the subject on the television screen appears at the position of the image on the left and right television screens viewed by the left and right eyes. By viewing the image of the subject with the left and right eyes using a VR goggle, the image of the subject can be moved so that it appears to be at a position at the measured distance, with the image corrected to appear as if it were on the left and right television screens. Alternatively, the images of the subject at the corrected positions on the left and right television screens are displayed on each other's television screens, and the images of the subject at the corrected positions are viewed with the left and right eyes using stereoscopic glasses with light-shielding filters that are synchronized with each other, so that the subject can be viewed as if the images of the subject are at a position at the measured distance.
[0007] The distance data can be the distance measured of the subject in an image using a numerically controlled laser distance measuring device, which the inventor of the present application has already obtained, in accordance with Patent No. 6719494, which shines a measuring laser light toward the subject in an image recognized from a television screen captured by a television camera. In addition, the distance data can be determined by measuring the distance of a subject recognized by image recognition, using measurement light emitted from a distance measurement light-emitting element at the position of the image element of a pixel-emitting distance measurement television camera, derived from the position of the image of the subject recognized by image recognition from a television screen captured using a pixel-emitting distance measurement television camera according to Patent No. 7195093, by concentrating the measurement light on the subject and measuring the reflected light. Furthermore, the distance data can be obtained by measuring the reflected light emitted by a distance measurement light-emitting element at the position of the image element of the pixel light-emitting distance measurement television camera, focusing the measurement light on the subject, and measuring the distance obtained by accurately measuring the shape of the subject. In addition, the distance data can be the distance of an image-recognized subject measured at the position of the light-receiving element of a pixel-receiving distance measurement television camera where the reflected light of distance measurement light irradiated onto the subject is focused, derived from the position of the image of the subject recognized from a television screen captured using a pixel-receiving distance measurement television camera.
[0008] In addition, the distance data can be measured by receiving the reflected measurement light irradiated onto the subject by a distance measuring light receiving element at the position of the image element of the pixel receiving distance measuring television camera, and the distance can be used as an accurate measurement of the shape of the subject. Moreover, the distance data can be a set distance to a subject on a television screen. The distance data can be calculated from the shape of the subject on the television screen. The distance data may include a measured distance, a set distance, and a calculated distance. Effect of the Invention
[0009] By using the accurately measured distance to the shape of the object, an image of the shape of the object can be displayed, providing a television screen on which the object can be viewed three-dimensionally. [Brief description of the drawings]
[0010] [Figure 1] An explanatory diagram of how a subject 1 is photographed by a television camera 2. [Diagram 2] An explanatory diagram of how a subject 1 photographed by a television camera 2 is image-recognized, and then a measuring laser beam 5 from a laser distance measuring device 4 is irradiated onto the image-recognized subject 1 to measure a distance L-1. [Diagram 3]An explanatory diagram showing how human vision measures the distance to a subject 1 using binocular disparity resulting from interpupillary distance 9. [Figure 4] An explanatory diagram of right eye disparity 14 and left eye disparity 15 that arise in human vision from interpupillary distance 9. [Diagram 5] An explanatory diagram showing the absence of binocular disparity on a 2D television screen within the wide 3D visual field of a human. [Figure 6] An explanatory diagram showing the relationship between the display position of subject 21 on a television screen 18 when subject 1 is photographed by a television camera 2, and the right-eye correction value 25 of the position where subject 22 appears on the television right-eye screen 19, which corresponds to the corrected position for binocular parallax at the distance L-1 measured by a laser distance measuring device 4, and the right-eye correction value 26 of the position where subject 23 appears on the television right-eye screen 20. [Figure 7] An explanatory diagram showing how the left and right screens, the right-eye screen 19 and the left-eye screen 20, are viewed in 3D using VR goggles 40, with the distance to the subject 1 at the position of the image of the subject 21 on the television screen 18 captured by the television camera 2 measured using a laser distance measuring device 4, and the binocular parallax of the measured distance position used to calculate the corrected position of the subject 21 on the television screen 18. [Figure 8] An explanatory diagram showing how the distance to the subject 1 in an image of the position of the subject 21 on a television screen 18 captured by a television camera 2 is measured using a laser distance measuring device 4, and the position of the subject 21 on the television screen 18 is calculated and corrected using the binocular parallax of the measured distance position, and the right-eye screen and left-eye screen are displayed alternately, and a 3D screen is viewed through the light-blocking filter of stereoscopic glasses 89 synchronized with the mutual display. [Figure 9]The soccer players A47, B48 wearing VR goggles 40 are photographed by television cameras 2A, 2B and appear in soccer player images 47A, 48A on television screens 18A, 18B. The distance and direction of the soccer players A47, B48 to the soccer players 47A, 48A wearing the VR goggles 40 is measured using laser distance measuring devices 4A, 4B, and the soccer players 47B, 48B on the game television screen are projected and displayed at the position 49 of the soccer ball on a game television screen 57 using the measured distance and direction. The positions of the soccer players 47B and 48B on the match TV screen on the game TV screen 57 are corrected to the position of binocular parallax of a human wide field of vision using the distance measured for the soccer players A47 and B48, and images of the soccer players 52 and 53 on the right-eye match TV screen are displayed at a right-eye match correction position 50 on the right-eye screen 19 of the TV, and images of the soccer players 54 and 55 on the left-eye match TV screen are displayed at a left-eye match correction position 51 on the left-eye screen 20 of the TV, and both screens are displayed on the left and right TV screens of the VR goggles 40 of the soccer players 47 and 48 wearing VR goggles. The soccer players 47 and 48 wearing VR goggles are deployed as avatars at the positions of the measured distances in the virtual space of the metaverse set by actual measurements, and a reality match is played in the actual measured space of the metaverse. [Figure 10] An explanatory diagram in which the soccer game screen of game device 56 is displayed using operation console 32, the positions of the images of soccer players 58, 59, 60, 61, 62, 63 displayed on game TV screen 57 are corrected to the positions of binocular parallax in the human field of vision according to the distance of each set position, and displayed on right eye TV screen 19 at the positions of game soccer players 58R, 59R, 60R, 61R, 62R, 63R, and displayed on left eye TV screen 20 as a stereoscopic TV screen at the positions of game soccer players 58L, 59L, 60L, 61L, 62L, 63L, and the soccer game screen of game device 56 is viewed through VR goggles 40 and a match is played. [Figure 11]An explanatory diagram of a soccer game played on game devices 56 using an operation console 32, in which images of positions of soccer players 58, 59, 60, 61, 62, 63 displayed on a game television screen 57 are compared with the soccer player image data 64 of each to calculate the distance, and according to the calculated distance, the parallax of the positions of soccer players 58, 59, 60, 61, 62, 63 on the game television screen 57, which arises from the human interpupillary distance 9, is corrected, and the positions of game soccer players 58R, 59R, 60R, 61R, 62R, 63R and the positions of game soccer players 58L, 59L, 60L, 61L, 62L, 63L are displayed alternately on a game television screen 57A, and the players play against each other on game devices 56 through stereoscopic glasses 89 which open and close alternately according to the displays. [Figure 12] An explanatory diagram in which measurement light is projected from a spotlight 84 onto subjects 66, 67, 68, 69, which correspond to the positions of subjects 70, 71, 72, 73 on a television screen and photographed using a television camera 2, and the reflected light is used to measure the distances to subjects 66, 67, 68, 69 using a TOF distance measurement television camera 65, and the measured distances are used to correct for binocular parallax. Images of the positions of subjects 70, 71, 72, 73 are displayed on the right-eye television screen 19, and subjects 70R, 71R, 72R, 73R on the right-eye television screen, and subjects 70L, 71L, 72L, 73L on the left-eye television screen 20 are displayed, and the 2D screen displayed on the television screen 18 is displayed on the right-eye television screen 19 and left-eye television screen 20 of the VR goggles 40, allowing the images to be viewed as a 3D screen. [Figure 13]The reflected light of measurement light projected from a projector 84 onto subjects 66, 67, 68, 69 corresponding to the positions of subjects 70, 71, 72, 73 on the television screen, which are photographed using a pixel-receiving distance measuring television camera 78, is measured using the pixel-receiving distance measuring television camera 78 to measure the distances between the subjects 66, 67, 68, 69, and the positions of game soccer players 58R, 59R, 60R, 61R, 62R, 63R and the positions of game soccer players 58L, 59L, 60L, 61L, 62L, 63L are displayed on the left and right game television screens 57A, which are corrected for binocular parallax using the measured distances, and are opened and closed according to the displays. [Figure 14] An image of the subject 68 is formed by natural light reflected from the subject 68 at the position of an image element 93 of an image element unit 92 that shows the screen captured by a pixel-receiving distance measurement television camera 78. Distance measurement light irradiated from a projector 84 onto a subject 86 is also focused at the position of the image element 93, similar to natural light. A measuring element 100 incorporated at the position of the image element 93 of the image element unit 92 of the pixel-receiving distance measurement television camera can measure the distance of the subject 68 in the image at the position of the image element 93. An explanatory diagram of an example in which the derived position of an image signal formed by imaging at the image element 93 is corrected to the N+ side of the right-eye television screen 19 and the N− side of the left-eye television screen 20 from the position of the N image element shown in the image element 96 of the image element unit 92 of the pixel-receiving distance measurement television camera, using the binocular parallax at the position of the measured distance. [Figure 15]The pixel light-emitting distance measuring television camera 86 photographs subjects 66, 67, 68, 69 corresponding to the positions of subjects 70, 71, 72, 73 on a television screen 18. The measurement light emitted from a light-emitting element 103 is installed at the position of an image element that forms an image at the position of the image element of the pixel light-emitting distance measuring television camera 86 for the subjects 70, 71, 72, 73 and derives an image signal. The measurement light is condensed and irradiated onto the subjects 66, 67, 68, 69. The reflected light is received by a photoreceiver 87 to measure the distances to the subjects 66, 67, 68, 69. Using the measured distances, the positions of the images of subjects 70, 71, 72, and 73 on the television screen 18 are corrected for binocular parallax, and subjects 70R, 71R, 72R, and 73R for the right-eye television screen and subjects 70L, 71L, 72L, and 73L for the left-eye television screen are displayed on a stereoscopic television screen 88, and the images are viewed on a 3D screen using mutually synchronized stereoscopic glasses 89. [Figure 16] At the position of an image element 93 of an image element unit 105 that shows the screen photographed by a pixel light emission distance measurement television camera 86, an image of the subject 68 is formed by natural light reflected from the subject 68. Measurement light emitted by a light emitting element 103 installed at the position of the image element 93 where the image of the subject 68 is formed is also focused and irradiated at the position of the subject 68 through an optical lens 91 of the pixel light emission distance measurement television camera 86. The reflected light focused and irradiated on the subject 86 is received by a light receiver 87 to measure the distance. An explanatory diagram of an example in which the position of the image signal derived by forming an image at the position of the image element 93 is corrected to the position of the N+ side of the right eye television screen 19 and the N- side of the left eye television screen 20 using the binocular parallax of the position of the measured distance, from the position of the N image element shown in the row of the image element unit 105 of the pixel light emission distance measurement television camera. [Figure 17]13 is an explanatory diagram of an example in which the position N at which the pixels of the image of the subject image B 72R on the right eye television screen displayed on a 3D television screen 88 are displayed is corrected to a pixel on the N+3 side, the position N at which the pixels of the image of the subject image B 72L on the left eye television screen displayed is corrected to a pixel on the M-2 side, the position N at which the pixels of the image of the subject image D 73R on the right eye television screen displayed is corrected to a pixel on the N+5 side, and the position N at which the pixels of the image of the subject image D 73L on the left eye television screen displayed is corrected to a pixel on the N-4 side, using the binocular disparity of the measured distance positions between the images of the subjects C72 and D73 on the television screen displayed on a television screen 18 photographed using a pixel light emission distance measurement television camera 86 and the subjects 67 and 68. [Figure 18] The distance measuring light emitting element of the pixel light emitting distance measuring television camera 86 is made to emit light to the image signals of the subjects A70, B71, C72, and D73 on the television screen 18, and the distances to the subjects A66, B67, C68, and D69 and the distances 79, 80, 81, and 82 to the subjects A66, B67, C68, and D69 are measured, and the distance measurement signals obtained by photographing using the pixel light emitting distance measuring television camera 86 are added in synchronization with the image signals obtained by photographing using the pixel light emitting distance measuring television camera 86. The data signal 34 consisting of the distance measurement signals added in synchronization with the image signals is connected to the Internet using the controller 31 and transmitted via the Internet network 113, and a stereoscopic television screen 88 is displayed using the three-dimensional image position calculation circuit 46 that received the data signal 34. [Figure 19] An explanatory diagram in which a smartphone 114 is provided with the function of a pixel-receiving distance measuring television camera 78 or a pixel-emitting distance measuring television camera 86, and the distance measurement signal obtained by photographing is synchronized with the image signal obtained by photographing and added to the data signal 34, which is then transmitted via an Internet connection, and a 3D television screen 88 is displayed on the television screen of the smartphone 116 using the data signal 34 acquired by the smartphone 116 via the Internet network 113. EXAMPLES
[0011] Example 1 The subject 1 in FIG. 1 is photographed by a television camera 2, and the image of the subject 21 appearing on a television screen 18 is identified using an image recognition method or the like. The position of the image of the identified subject 21 on the television screen 18 is obtained as a numerical value (coordinate value). In FIG. 1, reference numeral 31 denotes a controller, which receives an image signal 27 from the television camera 2 and displays the subject 21 on the television screen 18 . Moreover, reference numeral 3 indicates the shooting range of the television camera 2. A laser distance measuring device 4 driven by a numerically controlled driving mechanism irradiates measurement laser light toward the subject 1 in the direction of the subject 1 shown in an image on a television screen 18 obtained by photographing the subject 1 with a television camera 2, and the distance to the subject 1 is measured using a driving numerical value associated with the position of the subject 21 on the television screen 18 of the driving mechanism. The method for measuring this distance can be the method described in Patent Documents 1 and 2.
[0012] In Figure 2, the controller 31 transmits driving data of the numerically controlled laser distance measuring device 4 in the form of a numerical control signal 29 to the laser distance measuring device 4, receives a control position signal 30 indicating the position to which the driving mechanism is driven, and receives a distance signal 28 measured by driving and irradiating the subject 1 with the measurement laser light 5. The position of the subject 1 is grasped by driving the laser distance measuring device 4 and pointing it in the direction of the subject 1 and using the distance to the subject 1 measured by the laser distance measuring device 4. Working Example Using the right and left eyes of a human being, the difference in the direction of gaze of the left and right eyes occurs when the subject 1 is located at a distance L-1 in Figure 3. By moving and displaying an image of the subject 1 to a position that creates a difference in the direction of the gaze toward the subject 1, the distance L-1 from the subject 1 can be recognized using both the right and left eyes of a human being. Example: Humans visually judge the distance to the subject 1 from the external shape of the subject 1 that they have already recognized and the size of the subject 1 that they have experienced.
[0013] Humans perceive distance by recognizing the binocular disparity of the right eye subject's line of sight 10 looking at subject 1 resulting from interpupillary distance 9 in Figure 4, the right eye subject's line of sight 11 looking at distant position 6, the right eye subject's line of sight 12, and the left eye subject's line of sight 13, as distance, and the right eye parallax 14 and left eye parallax 15. Example: Human distance measurement is performed with or without recognition by recognizing and, if necessary, adjusting the left and right gazes to the recognized subject, using the horizontal binocular disparity of the left and right eyes in FIG. 5 . Therefore, in the three-dimensional motion field shown in FIG. 5, it feels strange to display the three-dimensional image motion on the television screen capturing the television camera shooting range 3 as two-dimensional image motion. When 3D movements within a 2D screen that occupies a large proportion of a person's 3D space are displayed as 2D movements, such as on a large television screen, movie screen, or VR goggles, it can upset the human sense of balance.
[0014] Example: Position 21 of the subject on television screen 18 in Figure 6 is corrected (modified) to position 22 of the right-eye subject image on television right-eye screen 19 viewed with right eye 7 at right-eye correction value 25, and to position 23 of the left-eye subject image on television left-eye screen 20 viewed with left eye 8 at left-eye correction value 26. In this way, images of the subjects 22, 23 shifted in position are created on the left and right screens, and by having the subject view each of the left and right eyes, the viewer can virtually recognize the distance to the position of the image 21 of the subject shown on the television screen 18. The amount of subject shift for this object is determined by binocular parallax. The image of the subject is displayed on an LCD television screen or an organic television screen that displays an image 22 of the subject with a right-eye correction value and an image 23 of the subject with a right-eye correction value, and the image of the subject is displayed at each pixel where the position of each pixel that displays the subject on the television screen has been corrected for binocular parallax at the position where the distance to the subject shown in each pixel is measured. The positions of the pixels displaying all the subjects reflected on the television screen are displayed on the right and left television screens by pixels at positions where the right and left parallaxes are corrected, using the measured distances from the subjects reflected at the positions of all the pixels.
[0015] Using the distance to the subject reflected in each pixel that displays the image of the subject in three-dimensional space shown on a two-dimensional television screen, the subject is displayed on the television screens of the right and left VR goggles using pixels at positions where the right and left binocular disparity has been corrected, allowing the image of the subject to be viewed as a three-dimensional television screen. Working Example The controller 31 in FIG. 7 identifies the image 21 of the subject on the television screen 18 captured by the television camera 2 using a method such as image recognition. Using the drive numerical value of the laser distance measuring device 4 of the numerically controlled drive mechanism associated with the position of the image 21 of the subject on the television screen 18, a measurement laser light 5 is irradiated onto the subject 1, and the distance between the identified image 21 of the subject shown on the television screen 18 and the subject 1 is measured. A computer 35 receives the image signal 27 and the distance signal 28 contained in a data signal 34 from the controller 31 . Then, computer 35 displays image 21 of the identified subject, and uses image signal 27 of the pixels of subject 1 and the distance of distance signal 28 of the identified and measured subject to correct the right and left binocular disparity so that the subject appears to be at a distance, calculates right-eye correction value 25 on right-eye television screen 19 to create all of the pixels of the subject at position 22 of the image of the subject of the right-eye correction value on the right-eye television screen 19, and calculates left-eye correction value 26 on left-eye television screen 20 to create all of the pixels of the subject at position 23 of the image of the subject of the left-eye correction value on the left-eye television screen 19.
[0016] Computer 35 sends to controller 31 via data signal 34 correction values for all pixels in which the identified object appears on right-eye television screen 19 and left-eye television screen 20 . The right-eye television screen 19 and left-eye television screen 20 created in this way are transmitted from controller 31 to VR goggles 40 as right-eye image signal 38 and right-eye image signal 39. By using VR goggles 40 to display right-eye television screen 19 and left-eye television screen 20 on the left and right screens, a three-dimensional image of the distance to subject 1 measured by measurement laser light 5 can be reproduced. The above operation can be performed continuously, and the laser distance measuring device 4 continuously measures the distance between the subject 1 and the image 21 of the subject, and the position of the image 21 of the subject on the television screen 18 is continuously calculated and corrected using the distance continuously measured. A user wearing VR goggles 40 capable of creating a three-dimensional screen showing subject 1 can view right-eye television screen 19 and left-eye television screen 20 separately with each eye using VR goggles 40. Reference numeral 32 denotes an operation console for measuring the distance to each subject individually.
[0017] FIG. 8 shows a modification of the embodiment described in FIG. In the example of FIG. 8, a stereoscopic image calculator 46 is connected to the controller 31, making it possible to create a stereoscopic television image 88. A stereoscopic image calculator 46 uses the measured distance to the subject 1 to create a right-eye television screen 19 and a left-eye television screen 20 in which the position of the subject image 21 on the television screen 18 is corrected for binocular parallax so that the subject 1 appears at a distant position. The stereoscopic image calculator 46 displays the right-eye image at the right eye image position 36 and the left-eye image at the left eye image position 37 alternately on the stereoscopic television screen 88 . Furthermore, the stereoscopic image calculator 46 sends an image switching signal 41 to the controller 31 . Based on the screen switching signal 41, the controller 31 transmits a light-shielding filter switching signal 42 to the stereoscopic glasses 89, and opens and closes the right-eye light-shielding filter 44 and the left-eye light-shielding filter 45 of the stereoscopic glasses 89 in synchronization with the screens on the stereoscopic television screen 88 on which the images at the right-eye image position 36 and the left-eye image position 37 are displayed. A user watching a stereoscopic television screen 88 can see with his / her right eye the screen displaying the image at right-eye image position 36 on the stereoscopic television screen 88 when right-eye light-shielding filter 44 of the stereoscopic glasses 89 is open, and can see with his / her left eye the screen displaying the image at left-eye television screen 37 on the stereoscopic television screen 88 when left-eye light-shielding filter 45 of the stereoscopic glasses 89 is open.
[0018] The two-dimensional screen of the television screen 18 showing an image 21 of a subject, the screen showing the subject at the corrected right-eye image position 36 of the stereoscopic television screen 88, and the screen showing the subject at the corrected left-eye image position 37 of the stereoscopic television screen 88 are mutually projected, and the screens of the stereoscopic television screen 88 can be viewed with the left and right eyes as three-dimensional stereoscopic screens. FIG. 9 is a diagram showing a configuration for implementing a match between soccer players on a stereoscopic screen in a virtual space (metaverse) using the present invention. Soccer players 47 and 48 are located at physically separate locations and each wears a pair of VR goggles 40 . Using a method similar to that shown in FIG. 2, soccer player A 47 wearing VR goggles 40 is photographed by television camera 2A, and the image of soccer player image A 47A on television screen 18A is displayed on the screen, and the image of soccer player image A 47A on television screen 18A is identified using a method such as image recognition. The distance between the identified position of the image of soccer player image A 47A on the television screen 18A and the soccer player 47 wearing the VR goggles 40 is measured using the drive numerical value of the drive mechanism of the associated laser distance measuring device 4A. Similarly, the image of soccer player B 48A on the television screen 18B is identified using a method such as image recognition from a screen on which soccer player B 48A is displayed, the image being captured by television camera 2B of soccer player B 48 wearing VR goggles 40.
[0019] The distance between the identified position of the image of soccer player image B 48A on the television screen 18B and the soccer player 48 wearing the VR goggles 40 is measured using the drive numerical value of the drive mechanism of the associated laser distance measuring device 4B. The three-dimensional image position calculation circuit 46 receives the image signal 27 and the image distance signal 28 of the identified soccer players A and B from the controller 31 located at the physically separated position, and displays a match image on the metaverse television screen 57B created using the measured distance in accordance with the measured distance. Specifically, the three-dimensional image position calculation circuit 46 takes images of soccer players 47A on the television screen 18A and soccer player 48A on the television screen 18B, which are taken by television cameras 2A and 2B of soccer players 47 and 48 wearing VR goggles 40, and matches the measured distance to position 49 of the image of the soccer pole of the competing game on television screen 57B in the actual measured metaverse, and develops the identified images of soccer player 47A competing and soccer player 48A competing. Using a three-dimensional image position calculation circuit 46, the positions of the images on the screen that corrects binocular parallax are calculated so that the images of soccer players 47B, 48B on the competition television screen displayed on the metaverse television screen 57B, and soccer players 47, 48 wearing VR goggles 40 are seen at the measured distance, and the images are corrected to the image positions of soccer players A52, B53 on the right eye competition television screen from right eye competition correction position 50 on the right eye television screen 19, and are corrected to the image positions of soccer players A54, B55 on the left eye competition television screen from left eye competition correction position 51 on the left eye television screen 20.
[0020] The right-eye television screen 19 and the left-eye television screen 20 on which the corrected image is displayed are displayed by any method on the left and right screens of the VR goggles 40 of the soccer players 47 and 48 wearing the VR goggles 40. Soccer players 47 and 48 wearing VR goggles can compete against each other while viewing stereoscopic images displayed on the left and right television screens of the VR goggles 40. An opponent of soccer player 47 wearing VR goggles of user A of game device 56 can play a realistic soccer game by viewing the stereoscopic screen of VR goggles 40 of the image of subject soccer player B 53 on the right eye television screen 19 and the image of subject soccer player B 55 on the left eye television screen 20 of the opponent, who is displaying the soccer game on a television screen in the metaverse, and an opponent of soccer player B 48 wearing VR goggles of user B of game device 56 can play a realistic soccer game by viewing the stereoscopic screen of VR goggles 40 of the image of subject soccer player B 52 on the right eye television screen 19 and the image of subject soccer player B 54 on the left eye television screen 20 of the opponent, who is displaying the soccer game on a television screen in the metaverse. Similarly, several opponents connected to the three-dimensional image position calculation circuit 46 can measure the distance to the opponents and play a realistic soccer game by watching the opponents displayed on the three-dimensional screen through the VR goggles 40.
[0021] Furthermore, when viewing only the same metaverse television screen 57B with both eyes using VR goggles 40, the sense of human binocular disparity is not obtained, leading to a loss of sense of balance and unstable behavior. However, when the right eye television screen 19 and the left eye television screen 20, which have been corrected for binocular parallax, are viewed on the left and right screens of the VR goggles 40, the sense of human binocular parallax is obtained, enabling stable behavior with a sense of balance. Therefore, the images of avatars that join the virtual space of the Metaverse will be displayed on a television screen in the virtual space after correcting for binocular disparity on the television screen. Even with the 4K and 8K television screens currently on the market, a sense of instability remains because human binocular disparity cannot be completely corrected. 10 shows a soccer player game television screen 57 of a game device 56 in which a soccer player can be controlled using the control console 32. The positions of the images of soccer players 58, 59, 60, 61, 62, 63 shown on a game television screen 57 are adjusted to match the positions of the distances set for the game on the game television screen 57, and the distances of the opposing soccer players are displayed at the positions of game soccer players 58R, 59R, 60R, 61R, 62R, 63R on the right-eye television screen 19 and at the positions of game soccer players 58L, 59L, 60L, 61L, 62L, 63L on the left-eye television screen 20 so that the positions appear to be corrected by calculating binocular parallax using a three-dimensional image position calculation circuit 46.
[0022] By projecting the right-eye television screen 19 and the left-eye television screen 20 onto the left and right television screens of the VR goggles 40, the user operating the soccer game can see a three-dimensional stereoscopic screen and enjoy a realistic game. Example The distance of each game soccer player is calculated by using pre-set soccer player image data to calculate the distance of the position of the soccer player's image on the game screen, and the distance of the image position by comparing the size of the soccer player's image. Using the operation console 32 in FIG. 11, the soccer game screen of the game device 56 is displayed on a game television screen 57, and the images of soccer players 58, 59, 60, 61, 62, and 63 are displayed on the game television screen 57, and the images of the soccer players are compared with the respective soccer player image data 64 to calculate the distance. Using the distance thus calculated, the position of the binocular parallax is corrected so that it appears at the distance position of the human visual field, and the images are displayed at positions on the right and left game television screens 57A, respectively. The screen of the image of the game soccer players 58R, 59R, 60R, 61R, 62R, 63R for the right eye, which are displayed on the right and left game television screens 57A, is viewed with the right eye of the user operating the device by opening the right eye light-shielding filter 44 of the stereoscopic glasses 89 in synchronization with the display of the screen for the right eye 7, and the screen of the image of the game soccer players 58L, 59L, 60L, 61L, 62L, 63L for the left eye is viewed with the left eye of the user operating the device by opening the left eye light-shielding filter 45 of the stereoscopic glasses 89 in synchronization with the display of the screen for the left eye 8.
[0023] This allows a user wearing the stereoscopic glasses 89 and operating the game device 56 to watch a realistic soccer game on a stereoscopic screen. In the above-mentioned embodiments, the distance to the subject is described as being measured using the methods of Patent Documents 1 and 2. However, the distance to the subject in the embodiment shown in FIG. 12 can also be measured using a TOF distance measuring television camera 65. Measurement light projected from a light source 84 is shone on subjects 66, 67, 68, 69 in real space that are shown in images A70, B71, C72, D73 of the subject on the television screen 18 obtained by photographing using the television camera 2, and the reflected light is used to measure the distances to the positions of the subjects 66, 67, 68, 69 from the screen measured using the TOF distance measurement television camera 65, and the distances are measured by aligning the reflected light with the positions of the images of the subjects shown in images A70, B71, C72, D73 of the subject on the television screen 18 measured by the TOF distance measurement television camera 65. The positions of the images of subjects 70, 71, 72, and 73 on the television screen 18 are corrected using a three-dimensional image position calculation circuit 46 to correct the binocular parallax of the distance positions of subjects 66, 67, 68, and 69 measured by a TOF distance measurement television camera 65, and displayed so that the images of subjects 70R, 71R, 72R, and 73R on the right-eye television screen are displayed on the right-eye television screen 19, and the images of subjects 70L, 71L, 72L, and 73L on the left-eye television screen are displayed on the left-eye television screen 20 at their respective positions.
[0024] Even with this configuration, a user wearing the VR goggles 40 can view a three-dimensional image with the left and right eyes using the VR goggles 40 without any problems. In current television games, players compete on a television screen 18, which creates a sense of incongruity due to binocular parallax. However, when viewing the right eye television screen 19 and the left eye television screen 20, which have been corrected for binocular parallax, the sense of human binocular parallax is obtained, so a stable competitive game can be played with a sense of balance. Embodiment The present invention can also be realized by using a pixel-receiving distance measuring television camera 78 in which the function corresponding to the above-mentioned TOF distance measuring television camera 65 is integrated into a television camera. The reflected light of measurement light projected from a light projector 84 onto subjects 66, 67, 68, and 69 appearing in images of subjects A71, B72, C72, and D73 on a television screen obtained by photographing using an image element incorporated in the pixel-receiving distance measuring television camera 78 in Figure 13 is received by a measurement element installed at the position of the image element incorporated in the pixel-receiving distance measuring television camera 78, and the distances to the subjects 66, 67, 68, and 69 are measured with a time lag.
[0025] The positions of the images of subjects 70, 71, 72, and 73 on the television screen 18 captured by pixel-receiving distance measurement television camera 78, and the binocular parallax of the distance positions of subjects 66, 67, 68, and 69 measured by pixel-receiving distance measurement television camera 78, are corrected for display position using 3D image position calculation circuit 46, and a stereoscopic screen in which the images of subjects 70R, 71R, 72R, and 73R on the right-eye television screen and the images of subjects 70L, 71L, 72L, and 73L on the left-eye television screen are mutually displayed on a stereoscopic television screen 88 can be viewed using the mutually synchronized stereoscopic glasses. A user viewing a stereoscopic screen using the stereoscopic glasses can view a stereoscopic screen in which the images of the screen captured by the image elements of the pixel-receiving distance measuring television camera 78 are displayed at the positions of the image elements with the positions of the image elements of the images corrected for binocular parallax using the distance of the images of the screen measured by the measuring elements at the positions of the image elements, using the stereoscopic glasses which open and close in synchronization with each other. Natural light reflected from the subject 68 in FIG. 14 of the embodiment passes through an optical lens 91 of the pixel-receiving distance measuring television camera 78, and an image of the subject 68 is formed at the position of an image element 93 of an image element unit 92. The R, G, and B image elements 97, 98, and 99 constituting the image element 93 generate RGB image signals of an image of the subject 68.
[0026] Distance measurement light irradiated from the light projector 84 to the subject 86 is also collected at the position of the image element 93 in the same manner as natural light. The distance to the subject 68 shown in the image at the position of the image element 93 can be measured by the measuring element 100 incorporated at the position of the image element 93 of the image element unit 92 arranged in a row of the pixel-receiving distance measuring television camera 78. The image signal generated by imaging at image element 93 is corrected using the binocular disparity at the measured distance position to horizontally correct the position at which the image signal is derived from the position of the N image elements shown in image element row 101 to the N+ side of right-eye television screen 19 and the N- side of left-eye television screen 20, thereby correcting the position of image element unit 92 that derives RGB image signals that capture subjects 66, 67, 68, 69 captured by pixel receiving distance measuring television camera 78, and obtaining the position of the pixel that displays the image signal of image element 93 on 3D television screen 88. By correcting the positions of the pixels that display all the image signals that display the images of the subjects 66, 67, 68, and 69 captured by the pixel-receiving distance measuring television camera 78, the subjects 66, 67, 68, and 69 can be viewed as images seen with the real eye. EMBODIMENTS The present invention can also be realized by using a pixel light emitting distance measuring television camera 86 in which the function equivalent to the above light emitter is integrated into the camera.
[0027] The subjects 66, 67, 68, and 69 in Figure 15 are photographed using a pixel-emitting distance measurement television camera 86, and images of subjects A70, B71, C72, and D73 on the television screen are derived as they appear on the television screen 18. Measurement light is emitted from light-emitting elements incorporated in the positions of the image elements appearing in the image element unit of the pixel-emitting distance measurement television camera 86, and the reflected light of the measurement light that is focused and strikes the subjects 66, 67, 68, and 69 is received by a photoreceiver 87, and the distances to the subjects corresponding to the positions of the image elements at the positions where the images of subjects A70, B71, C72, and D73 are appearing are measured with a time lag. The positions of the images of subjects 70, 71, 72, and 73 on the television screen 18 captured by pixel light-emitting distance measurement television camera 86 and the binocular parallax of the distance positions of subjects 66, 67, 68, and 69 measured by pixel light-emitting distance measurement television camera 86 are corrected using three-dimensional image position calculation circuit 46, and the positions of the pixels displaying the images of subjects 70, 71, 72, and 73 are displayed on a stereoscopic television screen 88, where the images of subjects 70R, 71R, 72R, and 73R on the right-eye television screen and the images of subjects 70L, 71L, 72L, and 73L on the left-eye television screen are mutually displayed, and the stereoscopic screen can be viewed using the mutually synchronized stereoscopic glasses 89.
[0028] The user can view a stereoscopic screen using the stereoscopic glasses 89, which open and close in synchronization with each other, by using the stereoscopic glasses 89 to mutually display images at the pixel positions on a stereoscopic television screen 88, with the positions of the image elements of the image being corrected for binocular parallax using the distance of the image on the screen measured by the image elements of the pixel light emission distance measuring television camera 86 using the light emitting elements at the positions of the image elements. In the above embodiment, the image of the subject is described as being displayed on a television screen or a video game screen, but the present invention can also be applied to image media that displays the subject in three dimensions on an animation television screen or a CG television screen, including a movie screen. In the embodiment, the image captured by the pixel light emitting distance measuring television camera 86 in FIG. 16 is formed at the position of the image element 93 of the image element unit 105 by reflection of natural light from the subject 68 through an optical lens 91. The measurement light emitted by the light-emitting element 103, which is installed at the position of the image element 93 where the image of the subject 68 is formed, is also focused and irradiated at the position of the subject 68 through the optical lens 91 of the pixel light-emitting distance measuring television camera 86. The reflected light that is focused and irradiated on the subject 86 is measured by a light receiver 87 with a time lag, and the distance to the subject 86 is measured.
[0029] The image signal generated by imaging at image element 93 is displayed on a stereoscopic television screen 88 which uses the binocular parallax at the position of the measured distance to correct the position of image element N from which the image signal is derived from the position of N image elements of image element unit 105 arranged in a row of pixel light-emitting distance measuring television camera 86 to the N+ side of right-eye television screen 19 and the N- side of left-eye television screen 20 in a row, and the light-shielding filters of the stereoscopic glasses which are synchronized with each other are opened and closed so that the stereoscopic television screen 88 captured by pixel light-emitting distance measuring television camera 86 can be viewed. In an embodiment, one pixel displaying an image C72 of subjects 67 and 68 on the television screen 18 when the subjects are photographed using the pixel light emission distance measurement television camera 86 in Figure 17, and one pixel displaying an image D73 of the subject on the television screen 18, are enlarged pixel units of the stereoscopic television screen 88 and displayed as pixel A109 of horizontal pixel row unit A107 and pixel B110 of horizontal pixel row unit B108. The image signals corresponding to the positions of the M-th pixels 109 and 110 of the horizontal pixel row units A107 and B108 of the stereoscopic television screen 88, which display one pixel of the image of the subjects C72 and D73, are generated by the image element 93 of the pixel light receiving image element unit 101 of the pixel light receiving distance measuring television camera 78 in FIG. 14, which shows the positions A71 and B72 of the image of the subject on the television screen 18, which is the position of the image of the subject 67 and 68 photographed using the TOF television camera, or the pixel light receiving distance measuring television camera 78, or the pixel light emitting distance measuring television camera 86. 16. A data signal 43 consisting of an image signal 27 and a distance signal 28 obtained by adding to the image signal 27 a distance signal 28 measured using a measuring element 100 incorporated in the position of the pixel light-receiving distance measurement television camera image element 96 of the image element 93, or by adding to the image signal 27 an image signal 27 derived in the image element 93 of the pixel light-emitting image element unit 107 of the pixel light-emitting distance measurement television camera 86 of FIG. 16 and a distance signal 28 measured using a light-emitting element 103 incorporated in the position of the pixel light-emitting distance measurement television camera image element 102 of the image element 93.
[0030] The positions on the television screen 18 that display one pixel of the subjects C72 and D73 on the television screen correspond to positions M of pixel A109 and pixel B110 of pixel units A107 and B108 that display pixels of the stereoscopic television screen 88. The position of the subject shown in the image signal 27 of the data signal 43 on the stereoscopic television screen 88 is calculated using the distance signal 28 to correct the binocular parallax of the distance from the subject. The position where the pixels of the stereoscopic television screen 88 are displayed is corrected so that position M on the horizontal row of pixels of the television screen of the image B72R of the subject on the right-eye television screen is displayed to a pixel on the M+3 side, and position M on the horizontal row of pixels of the television screen of the image B72L of the subject on the left-eye television screen is displayed to a pixel on the M-2 side. In this example, position M at which image D73R of the subject on the right-eye television screen is displayed in a row of pixels on the television screen is corrected to a pixel on the M+5 side, and position M at which image D73L of the subject on the left-eye television screen is displayed in a row of pixels on the television screen is corrected to a pixel on the M-4 side. The positions of the corrected images of image C72R of the subject on the right eye television screen, image C72L of the subject on the left eye television screen, and image D73R of the subject on the right eye television screen, and image D73L of the subject on the left eye television screen, which are displayed on the 3D television screen 88, are determined by measuring the distance between the position of the image element in which the subject appears and the point corresponding to the image element of the subject appearing in the image when the television camera photographs the subject, and adding distance signal data from the subject corresponding to the point appearing in the image element to the image signal data derived from the image element in which the subject appears.
[0031] The distance data added to the image signal of the subject is used to correct the binocular parallax and display the image of the subject on a stereoscopic television screen 88, so that the stereoscopic television screen 88 can be viewed with stereoscopic glasses. By adding either a distance for correcting the binocular parallax of a subject shown on a television screen or a numerical value for correcting the binocular parallax to an image signal, a user watching the television screen can choose to watch either a normal television screen or a three-dimensional television screen using the distance and the numerical value for correcting the binocular parallax. Example: The subjects A66, B67, C68, and D69 are photographed using a pixel light-emitting distance measurement television camera 86 in Figure 18, and the image signal showing the television screen 18 showing the subjects A70, B71, C72, and D73 on the television screen is generated by causing distance measurement light-emitting elements provided at the positions of the image elements of the image element unit of the pixel light-emitting distance measurement television camera 86 that show the images of the subjects A70, B71, C72, and D73 on the television screen to emit light with a time lag and irradiate the light towards the subjects A66, B67, C68, and D69. The time at which the light for measuring the distance is reflected from the subjects A66, B67, C68, and D69 is measured using a photoreceiver 87, and the distance to the subjects A66, B67, C68, and D69 is calculated and obtained. The measured distance is added to an image signal captured by an image element at the position of the light emitting element, with the position being adjusted accordingly. Data 34 of the distance signal added to the image signal, or data 34 consisting of a correction signal for correcting the binocular disparity at the distance position added to the image signal, is transmitted via an Internet connection using controller 31, and a 3D television screen 88 that shows the positional relationship of subjects A 66, B 67, C 68, and D 69, created using a 3D image position calculation circuit 46 that receives data 34 via Internet network 113, can be viewed through stereoscopic glasses 89.
[0032] Example: Using a smartphone 114 equipped with the functions of the pixel light receiving distance measuring television camera 78 or pixel light emitting distance measuring television camera 86 in Figure 19, subjects A66, B67, C68, and D69 are photographed, and image signals of a television screen 18 showing subjects A70, B71, C72, and D73 on the television screen are obtained. Distance signals measuring the distances to subjects A66, B67, C68, and D69 or correction signals obtained from the measured distances are added to the image signals, and data 34 is transmitted by connecting to the Internet, and data 34 is received by a smartphone 116 via the Internet network 113. Using a three-dimensional image position calculation function provided in smartphone 116, a stereoscopic television screen 88 displayed on the television screen of smartphone 116 can be viewed through stereoscopic glasses 89. [Explanation of symbols]
[0033] 1. Subject 1A Subject A 1B Subject B 2. Television Camera 2A Television Camera A 2B Television Camera B 3 Television camera range 3A Television camera shooting range A 3B Television camera shooting range B 4. Laser distance measuring device 4A Laser distance measuring device A 4B Laser distance measuring device B 5. Measurement laser light 6 Far position 7 Right Eye 8 Left Eye 9 Interpupillary distance 10 Right eye subject gaze 11 Left eye subject gaze 12 Right eye far gaze 13 Left eye distance gaze 14 Right eye disparity 15 Left eye parallax 16 Object Distance 17 far distance 18. Television Screen 18A TV Screen A 18B TV Screen B 18C Television Screen C 18D TV Screen D 19 Right Eye TV Screen 20 Left Eye TV Screen 21 Images of the subject 22 Position of the image of the subject with the right eye correction value 23 Left eye correction value subject image position 24 Center position of the subject 25 Right eye correction value 26 Left eye correction value 27 Image Signal 28 Distance Signal 29 Numerical Control Signals 30 Control position signal 31 Controller 32 Control console 33 Operation Signal 34 Data Signal 35 Computers 36 Right eye image position 37 Left Eye Image Position 38 Right eye image signal 39 Right eye image signal 40 VR goggles 41 Screen switching signal 42 Light blocking filter switching signal 43 Stereoscopic Screen Signal 44 Right Eye Shading Filter 45 Left Eye Shading Filter 46 3D image position calculation circuit 47 Soccer Player A 47A Soccer player image A 47B Soccer player A on TV match screen 48 Soccer Player B 48A Soccer player image B 48B Soccer players on TV match screen B 49 Soccer ball position 50 Right eye match correction position 51 Left eye match correction position value 52 Right eye image of soccer player A on TV screen 53 Right eye image of soccer player B on TV screen 54 Image of soccer player A on the left-eye TV screen 55 Image of soccer player B on the left-eye TV screen 56 Gaming Equipment 57 Game TV screen 57A Right Left Gaming TV Screen 57B Metaverse TV Screen 58 Game Soccer Player C Image Position 58L Game soccer player C correction image position 58R Game soccer player C's correction image position 58S Game Soccer Player C Image Standard 59 Game Soccer Player D Image Position 59L Game soccer player D correction image position 59R Game soccer player D correction image position 59S Game Soccer Player D Image Standard 60 Game Soccer Player E Image Position 60L Game soccer player E correction image position 60R Game soccer player E correction image position 60S Game Soccer Player E Image Standard 61 Game Soccer Player F Image Position 61L Game soccer player F correction image position 61R Game soccer player F correction image position 61S Game Soccer Player F Image Standard 62 Game Soccer Player G Image Position 62L Game soccer player G correction image position 62R Game soccer player G correction image position 62S Game Soccer Player G Image Standard 63 Game Soccer Player H Image Position 63L Game soccer player H correction image position 63R Game soccer player H correction image position 63S Game Soccer Player H Image Standard 64 Soccer player image data 65 TOF distance measurement television camera 66 Subject A 67 Subject B 68 Subject C 69 Subject D 70 Image of a subject on a TV screen A 70R Right eye Image A of the subject on the TV screen 70L Left eye Image A of the subject on the TV screen 71 Image of subject on TV screen B 71R Right eye Image B of the subject on the TV screen 71L Left eye Image B of subject on TV screen 72 Image of a subject on a television screen C 72R Right eye Image of subject on TV screen C 72L Left eye Image of subject on TV screen C 73 Image of a subject on a television screen D 73R Right eye Image of subject on TV screen D 73L Right eye Image of subject on TV screen D 74 Distance of subject A 75 Distance of subject B 76 Distance to subject C 77 Distance of subject D 78-pixel distance measuring TV camera 79 Distance to subject A 80 Distance to subject B 81 Distance to subject C 82 Distance of subject D 83 Measurement position signal 84 Floodlight 85 Light Signal 86-pixel luminous distance measuring TV camera 87 Receiver 88 3D TV Screen 89 Stereo glasses 90 Light receiving signal 91 Optical Lenses Image sensor unit for 92-pixel distance measuring TV camera 93 Image element 94 Reflection and Concentration 95 Irradiation Light 96-pixel light-receiving distance measuring TV camera image element 97 R image element 98G image sensor 99 B image element 100 Measuring element 101-pixel light-receiving image sensor unit 102-pixel light-emitting distance measuring TV camera image element 103 Light emitting element 104 Reflected light Image sensor unit for 105-pixel luminous distance measuring TV camera 106 Measurement light 107 Pixel column unit A 108 Pixel column unit B 109 Pixel A 110 Pixel B 111 Pixel Light A 112 Pixel Light B 113 Internet Network 114 Smartphone A 115 Smartphone B 116 Smartphone C [Industrial Applicability]
[0034] Digital movie screens, 3D TV screens, 3D TV games, remote battle games, medical endoscopes, Internet shooting screens, TV screens for remote work, TV screens for metaverse spaces, image editing for TV cameras, CG image editing,
Claims
1. A method for projecting an image of a subject on a television screen at a position on the television screen that is corrected for binocular disparity relative to the position of the subject.
2. A method for correcting a position on an image signal that displays the subject on the television screen, using a position of the subject, so that the subject is displayed at a binocular parallax position on the television screen.
3. A method for correcting the position of the subject on the image signal so that the subject is displayed at a binocular parallax position on the television screen, using a position signal between the subject and the position of the television camera that captured the television screen displayed in the image signal, which is associated with the position of the television screen on the image signal.
4. a position signal of the subject appearing in the image signal is added to a position on the image signal of the television screen, the position signal being related to the subject appearing in the image signal.
5. At a position on the image signal of the television screen, A method comprising adding a signal for correcting binocular disparity of a position of a subject shown in the image signal.
6. A method characterized by irradiating the subject with measurement light for distance measurement, measuring the reflected light of the measurement light from the subject using a television camera to photograph the subject, using a measurement element at the position of the image element of the television camera where the image of the subject is captured, measuring the reflected light, calculating and obtaining the position of the subject, and correcting the binocular parallax of the obtained position for the position at which the subject is captured on the television camera screen.
7. A method characterized by emitting measurement light for distance measurement at a position of an image element of the television camera where an image of the subject obtained by photographing the subject using the television camera is displayed, measuring the reflected light that is condensed and irradiated onto the subject with a distance measuring instrument, calculating and acquiring a position of the subject, and correcting the binocular parallax of the acquired position for the position at which the subject is displayed on the television camera screen.
8. 8. A method according to claim 1, characterized in that the position of a pixel displaying the subject on the television screen is corrected for binocular disparity by displaying the subject at a pixel located at a position obtained by correcting the binocular disparity of the position of the subject displayed at the pixel.
9. 8. The method according to claim 1, characterized in that the image for correcting the binocular disparity shown on the television screen is displayed on the television screen of both eyes of the VR goggles.
10. 7. The method according to claim 1, wherein the images for correcting the binocular disparity shown on the television screen are displayed on the television screen for each of the left and right eyes.
11. 7. The method according to claim 1, wherein the left and right light blocking filters of the stereoscopic glasses are opened and closed in synchronization with a display on a television screen for each of the left and right eyes.
12. A method according to any one of claims 1 to 6, characterized in that an image of a character displayed on any one of a movie screen, an RPG game screen, an animation television screen, a television game screen, and a CG television screen, is displayed at a position on the screen that has been corrected for binocular disparity relative to the character.
13. A method according to any one of claims 1 to 6, characterized in that an image of the character displayed on the television screen and a position of the character on the television screen with binocular disparity corrected are displayed on the television screen connected via an Internet network.
14. A method according to any one of claims 1 to 6, characterized in that the character is displayed at a position on the television screen connected via an Internet network, where the binocular disparity of the image of the character is corrected.
15. A method according to any one of claims 1 to 6, characterized in that a signal in which a position signal of the subject shown in the image signal is added to a position on the image signal of the television screen is displayed on a television screen connected via an Internet network at a position where the binocular disparity of the image position of the position signal is corrected.
16. A method according to any one of claims 1 to 6, characterized in that a signal to which a binocular disparity correction signal for a position of a subject shown in the image signal has been added to a position on the image signal of the television screen is displayed on a television screen connected via an Internet network.
17. A method according to any one of claims 1 to 6, characterized in that an image of a subject displayed on a metaverse screen is displayed at a position on the metaverse screen that is corrected for binocular disparity at the position of the subject.
18. A method according to any one of claims 1 to 6, characterized in that an image of an avatar participating in a metaverse screen is displayed at a position on the metaverse screen that is corrected for binocular disparity of the position of the avatar.
19. A method according to any one of claims 1 to 6, comprising: a means for recognizing a subject in a captured image; a means for performing a correction to shift the position of an image of the subject to a position of binocular parallax using a distance to the subject; and a means for displaying the corrected image.
Citation Information
Patent Citations
A method for calculating three-dimensional drive numerical values of a three-dimensional numerically driven control device in drive measurement of a tracking laser distance measuring device.
JP6719494B2
How to measure distance in images captured by a television camera
JP7195093B2
