Display method of image to be gazed on television screen

Abstract

To provide a display method with which a narrow field of view can be gazed while a wide field of view is viewed.SOLUTION: In a method, by using a drive numerical value that associates a subject 1 with a position of an image 7 of a subject to be gazed on a screen imaged by a television camera 2, a drive mechanism of a numerical control television camera 3 is driven to image the subject 1 to be gazed, and an image imaged by the numerical control television camera 3 is displayed at a position, which corresponds to a position of an image 7 of the subject to be gazed on a television screen 4, of a pasted television screen 8 on a composite television screen 6 so that the image imaged to be gazed can be identified while understanding the surrounding situation around the image to be gazed without shifting a line of sight to the subject to be gazed.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] To provide an invention which changes an image on a television screen to an image that is easier to gaze at and displays it at a position on the television screen where the image is gazed at. [Background technology]

[0002] The subject of the image being watched displayed on the television screen is enlarged and photographed using a driving numerical value for driving a driving mechanism of a numerically controlled television camera, which is associated with the position of the image on the television screen photographed by the television camera, and the enlarged and photographed image of the subject is pasted and projected at the position on the television screen where the image of the subject is to be displayed, allowing the viewer to focus on the subject of the image being watched without shifting his or her line of sight on the television screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5547605 [Patent Document 2] Patent No. 6719494 Summary of the Invention

[0004] [Problem to be solved by the invention]

[0005] This method allows monitoring and remote operation by viewing a television camera screen photographed by a television camera via the Internet, with a television screen enlarged to a position where a desired part is gazed at while viewing a wide television screen adapted to a wide human field of vision. [Means for solving the problem]

[0006] In order to match the situation when watching a TV screen captured by a TV camera with the situation when a human is present at the scene, the position of the image of the screen that the human gazes at on the screen where the TV camera captures the range of the human field of vision is captured by a TV camera is captured by another TV camera. By attaching and continuously displaying a television screen that is easier to recognize at a portion of the screen that is gazed at on a television screen that reflects the range of a person's visual field, the person can continue to recognize the screen at the position that is gazed at without shifting his or her line of sight. The part at which the person is gazing is identified by using an image shown on a television screen, and another numerically controlled television camera capable of photographing the identified subject on a television screen that is easier to recognize is driven to photograph the part at which the person is gazing by using a zoom function and a focus adjustment function provided in the numerically controlled television camera. The location of interest on the television screen is measured using a numerically controlled laser distance measuring device, and the distance from the subject's body to the location of interest is measured. Depending on the measured distance, subjects captured in a narrow angle of view can be recognized from the same line of sight. It provides a television screen that makes it appear as if a human is present at the site when remote monitoring or remote work operation is performed using image data sent via the Internet.

[0007] Effect of the Invention

[0008] It will be easier to operate the robot using a television camera. [Brief description of the drawings]

[0009] [Figure 1] An explanatory diagram showing how the drive mechanism of a numerically controlled television camera 3 is driven using a drive numerical value associated with the position of an image 7 of the subject being gazed upon on a screen where a television camera 2 photographs the subject 1, and the image photographed by the numerically controlled television camera 3 is displayed at a position on a television screen 8 pasted onto a composite television screen 6 that corresponds to the position of the image 7 of the subject being gazed upon on a television screen 4. [Diagram 2]An explanatory diagram showing how a laser distance measuring device 15 attached to a numerically controlled television camera 3 is used to measure the distance to the subject being gazed upon as it appears in the center direction of the numerically controlled television camera 3, and how the zoom and focus functions of the numerically controlled television camera 3 are adjusted to correspond to the measured distance, and the image of the subject 1 being gazed upon is displayed on a television screen 8 attached to a composite television screen 6 at a position corresponding to the position of an image 7 of the subject on a television screen 4. [Diagram 3] An explanatory diagram showing how a numerically controlled laser distance measuring device 18 is driven using a drive numerical value associated with the position of the subject in the image of the subject 1 being gazed at on a screen photographed by a television camera 2, which then irradiates the subject 1 being gazed at with a measuring laser light to measure the distance to the subject 1, and the image of the subject 1 being gazed at, photographed by adjusting the zoom and focus functions of the numerically controlled television camera 3 according to the measured distance, is displayed on a television screen 8 attached to the position of the image 7 of the subject shown on a composite television screen 6. [Figure 4] An explanatory diagram showing how the image of the subject 1 being gazed upon on a screen captured by a television camera 2 is used to enlarge the image of the subject 1 using the digital zoom function of the television camera 2, and the enlarged image is displayed at a television screen 8 position on a composite television screen 6 corresponding to the position of the subject image 7 on a television screen 4. [Diagram 5] An explanatory diagram in which a numerically controlled laser distance measuring device associated with the camera 2 is driven to emit a measuring laser beam 16 at the position of the subject in the image of the subject 1 that the camera 2 is looking at on a screen, thereby measuring the distance to the subject 1, and then a screen in which the image of the subject 1 is enlarged using a digital zoom function and displayed at a position on the television screen 8 of the numerically controlled television camera on a composite television screen 6 that corresponds to the position of the image 7 of the subject on the television screen 4. [Figure 6]An explanatory diagram showing how a television screen photographed by a television camera 2 is projected onto a composite television screen 6A via an Internet network 23, and how the gaze position on the composite television screen 6A is recognized via the Internet network 23 by a television screen 8 pasted onto the composite television screen 6, which is projected via the Internet network 23, and a screen photographed by a numerically controlled television camera 3. [Figure 7] An explanatory diagram in which a television screen captured by a television camera 2 is projected onto a composite television screen 6A via an Internet network 23, and the gaze position on the composite television screen 6A is recognized as a screen displayed on a television screen 8 attached at the position of the gazed-at image 7 on the composite television screen 6A projected via the Internet network 23, using the distance to the subject 1 captured at the position of the gazed-at image 7 measured via the Internet network 23 by a numerically controlled television camera 3 and adjusted using either the zoom function or the focal length function. [Figure 8] A television screen photographed by the television camera 2 is displayed on the composite television screen of the smartphone A24 via the Internet network 23, and the image 7 of the gazed subject photographed by adjusting either the zoom function or the focal length function of the numerically controlled television camera 3 using the distance from the subject 1 reflected at the position of the image 7 of the gazed subject measured by the numerically controlled laser distance measuring device 18 via the Internet network 23 is displayed at the position of the attached television screen 8 on the composite television screen of the smartphone B25 via the Internet network 23. Or, an explanatory diagram for displaying and recognizing the television screen 8 attached on the composite television screen of the smartphone C26. EXAMPLES

[0010] Example: A subject 1 in FIG. 1 is photographed by a television camera 2, and an image 7 of the subject is displayed on a television screen 4. The subject 1 is then viewed with attention. In order to make the image 7 of the subject more visible, a driving mechanism for changing the shooting direction of the numerically controlled television camera 3 is driven to shoot the image 7 of the subject on the numerically controlled television screen 8 so that it can be more visible. The position of the image 7 of the subject on the television screen 4 is captured so as to be more visible on the numerically controlled television screen 8; the drive values ​​of the drive positions at which the drive mechanism of the numerically controlled television camera 3 is driven are associated, and the position of the image 7 of the subject on the television screen 4 captured by the television camera 2 of the subject 1 at several different positions is captured so as to be more visible on the numerically controlled television screen 8; the drive values ​​of the several different drive positions at which the drive mechanism of the numerically controlled television camera 3 is driven are used to capture the positions of all of the images 7 of the subject on the television screen 4 captured by the television camera 2 of the subject 1 at all different positions so as to be more visible on the numerically controlled television screen 8; the drive values ​​of all of the drive positions at which the drive mechanism of the numerically controlled television camera 3 is driven are obtained using an interpolation calculation formula;

[0011] The acquired drive numerical value, which is associated with the position of an image 7 of the subject being gazed upon that appears on a television screen 4 photographed by a television camera 2, is used to drive the drive mechanism of a numerically controlled television camera 3 to photograph an enlarged image of the subject being gazed upon, and the image of the enlarged subject is attached to the position of the subject being gazed upon on a composite television screen 6 of the numerically controlled television camera 3 so that it can be seen from the above, thereby making it possible to recognize the subject being gazed upon. The position of the image of the gazed-at subject is identified by an image recognition method or the like, and the subject whose position has been identified can be displayed. By continuously identifying the image displayed on the television screen 4 or continuously pointing to a specific position on the television screen 4, the image of the subject on the composite television screen 6 can be tracked and displayed.

[0012] Example: To measure the center direction of the numerically controlled television camera screen 5 in Figure 2, a laser distance measuring device attached to the drive mechanism of the numerically controlled television camera 3 is irradiated with measurement laser light to measure the distance to the subject reflected in the center direction of the numerically controlled television camera screen 5. A zoom mechanism provided in the numerically controlled television camera 3 is driven to match the measured distance, and an image of the subject shown in the numerically controlled television camera 3 is enlarged and photographed. Also, a focal length adjustment mechanism provided in the numerically controlled television camera 3 is driven to photograph a clear image of the subject shown in the numerically controlled television camera 3. Using the measured distance to the subject 1, an image 7 of the subject gazed upon on a television camera screen 4 is identified, and a recognizable image captured by a numerically controlled television camera 3 is displayed on a television screen 8 attached at the gazed upon position on the television camera screen 4. By changing the display of the image gazed at on the TV camera screen 4 to a composite TV screen 6 with a numerically controlled TV camera screen 5 pasted thereon, a recognizable image photographed by the numerically controlled TV camera 3 is displayed at the gazed position, and the image of the gazed object can be identified and recognized without moving the line of sight while being aware of the images reflected around the gazed position.

[0013] Example: In order to better view the image 7 of the subject being gazed at that appears on a television screen 4 in which the subject 1 in Figure 3 is photographed using a television camera 2, a drive mechanism that changes the direction of distance measurement of a numerically controlled laser distance measuring device 18 is driven, and distance measuring laser light 16 is irradiated onto the subject 1 appearing in the image on the television screen 4. The position of an image 7 of a subject on a television screen 4 photographed using a television camera 2 is associated with a drive value of a drive position of the drive mechanism in which a distance measuring laser light 16 of a numerically controlled laser distance measuring device 18 is irradiated onto the subject 1, and the positions of the images of the subject 1 shown on the television screen 4 photographed by the television camera 2 at several different positions are associated with the positions of the images of the subject 1 shown on the television screen 4 photographed by the television camera 2 at several different positions, and the distance measuring laser light 16 of the numerically controlled laser distance measuring device 18 is irradiated onto the subject 1 at several different positions, and the television camera 2 photographs the subject 1 at all different positions using the several different drive values ​​of the drive position of the drive mechanism. By obtaining the positions of all the different images of the subject 1 displayed on the television screen 4 and all the drive numerical values ​​of the drive positions of the drive mechanism by irradiating the distance-measuring laser light 16 of the numerically controlled laser distance measuring device 18 to the subject 1 at all the different positions using an interpolation formula, the distance-measuring laser light 16 of the numerically controlled laser distance measuring device 18 can be irradiated to the subject 1 or the subject at the position indicated on the television screen 4 in association with the position of the image 7 of the subject being gazed upon on the television camera screen 4 or the position indicated on the television screen 4, thereby measuring the distance to the subject 1 or the subject.

[0014] Using the position of the image 7 of the gazed upon subject on a television screen 4 or the measured distance to a position indicated on the television screen 4, a zoom mechanism provided in the numerically controlled television camera 3 that photographs the subject 1 is driven to enlarge and photograph the subject or the image of the subject shown in the numerically controlled television camera 3. Also, a focal length adjustment mechanism provided in the numerically controlled television camera 3 is driven to photograph the subject shown in the numerically controlled television camera 3 or an image of the subject clearly. Using the measured distance to the subject 1, an image 7 of the subject gazed upon on a television camera screen 4 is identified, and a screen photographed into an image that can be recognized is displayed on a television screen 8 attached to the gazed upon position on the television camera screen 4. By changing the display of the image gazed at on the television camera screen 4 to a composite television screen 6 with a numerically controlled television camera screen 5 pasted thereon, a recognizable image photographed by the numerically controlled television camera 3 is displayed at the gazed position, and the image of the gazed object can be identified and recognized without moving the line of sight while being aware of the images reflected around the gazed position.

[0015] Example: In FIG. 4, the subject 1 is photographed by a television camera 2 in an image sensor unit within the range in which the subject 1 is captured, and the image of the subject 1 is enlarged using a digital zoom function and displayed on a television screen 8 attached to a composite television screen 6 at a position corresponding to the position of the subject image 7 on the television screen 4. The image gazed at on the TV camera screen 4 is projected on a pasted TV screen 8 enlarged by a digital zoom function at the position of the image gazed at on the TV camera screen 4, and a recognizable image enlarged by the digital zoom function using the screen photographed by the TV camera 2 is displayed at the gazed position, so that the image of the gazed-at subject can be identified and recognized without moving the line of sight while being aware of the images reflected around the gazed-at position. By changing the screen photographed by the television camera 2 to a composite television screen 6 on which an enlarged recognizable image is pasted, the recognizable image photographed by the television camera 2 is displayed at the gazed position, and the image of the gazed subject can be identified and recognized without moving the line of sight while being aware of the images reflected around the gazed position.

[0016] Example: At the position of the image 7 of the subject on the television screen 4 photographed using the television camera 2 in Figure 5, the distance measuring laser light 16 of a numerically controlled laser distance measuring device 18 is irradiated onto the subject 1, and the distance between the subject 1 and the image being gazed upon on the television screen 4 is measured using the associated drive numerical value of the drive position of the drive mechanism. The image signal of the image element in the range where the object 1 is captured in the image element unit where the object 1 is photographed by the television camera 2 is enlarged and displayed in accordance with the measured distance at a position of a television screen 8 pasted on a composite television screen 6, which corresponds to the position of the object image 7 on a television screen 4, by using a digital zoom function. Without shifting the line of sight to view the television screen 4, the viewer can identify the image 7 of the gazed-at subject in the enlarged image on the attached television screen 8 while being aware of the images reflected around the gazed-at position, and can recognize the subject.

[0017] Example: The gaze position on the composite television screen 6A displayed via the Internet 23 of the television screen 4 captured by the television camera 2 in Figure 6 is associated, via the Internet 23, with the drive numerical value of the drive mechanism that changes the shooting direction of the numerically controlled television camera 3 using the method described above, and an enlarged image of the gazed upon subject 7 captured by driving the numerically controlled television camera 3 using the associated drive numerical value can be recognized as a television screen 8 pasted onto the composite television screen 6 displayed via the Internet 23. Example: The drive value of a drive mechanism that changes the direction of irradiation of distance measuring laser light 16 of a numerically controlled laser distance measuring device 18 is associated via the Internet network 23 to the position of the image 7 being gazed upon on the composite television screen 6A shown via the Internet network 23 in Figure 7 using the method described above, and the distance to the subject 1 appearing at the position of the image 7 being gazed upon, measured by driving the numerically controlled laser distance measuring device 18 using the associated drive value, is used to adjust either the zoom function or the focal length function of the numerically controlled television camera 3, so that the image 7 of the subject being gazed upon, photographed by the numerically controlled television camera 3, can be recognized as a screen displayed on a pasted television screen 8 at the position of the image 7 being gazed upon on the composite television screen 6A shown via the Internet network 23.

[0018] The subject 1 reflected in the enlarged image can be recognized at the position of the image 7 of the subject being gazed at while viewing the peripheral images of the attached television screen 8 without shifting the line of sight to view the image 8 being gazed at on the composite television screen 6 displayed via the Internet network 23. Example: A television screen captured using the television camera 2 of FIG. 8 is displayed on the composite television screen of a smartphone A24 via the Internet network 23, and a measuring laser light is irradiated via the Internet network 23 to the subject captured in the shooting range 9 of the television camera 2 at the position of the image 7 of the subject being gazed upon on the composite television screen of the smartphone A24 or at the designated position, and the driving numerical value of the numerically controlled laser distance measuring device 18 associated with the method described above is driven to adjust either the zoom function or the focal length function of the numerically controlled television camera 3 using the measured distance from the subject 1 captured at the position of the image 7 of the subject being gazed upon, and the image of the image 7 of the subject being gazed upon or the image of the designated position is pasted on the composite television screen of a smartphone B25 via the Internet network 23 at the position of the image 7 of the subject being gazed upon or at the designated position, and a television screen 8 is displayed. By displaying the television screen 8 on which the subject being gazed at or the image at the designated position at the same position of the gaze without shifting the line of sight to look at the position of the image 7 of the subject being gazed at or the image at the designated position, the user can see the surrounding situation at the scene being photographed using the television camera 2 and recognize the image 7 of the subject being gazed at or the image at the designated position. Furthermore, if necessary, the image 7 of the object being gazed at or the television screen of the image at the designated position can be displayed and recognized on the composite television screen of the smartphone C26.

[0019] [Explanation of symbols]

[0020] 1. Subject 2. Television Camera 3. Numerically controlled television camera 4 TV camera screen 5 Numerical control TV camera screen 6. Composite TV Screen 6A Composite TV Screen A 7. Image of the subject 8. Attached TV Screen 9. Television camera coverage 10. Shooting range of a numerically controlled television camera 11 Television camera image signal 12. Numerically controlled television camera image signal 13 Drive signal 14 Drive position signal 15 Laser distance measuring device 16 Measurement laser light 17 Distance measurement signal 18 Numerical control laser distance measuring device 19 Composite TV screen signal 20 Controller 21 Connector 22 Data Signal 23 Internet Network 24 Smartphone A 25 Smartphone B 26 Smartphone C [Industrial Applicability]

[0021] The place to be gazed at on a wide shooting range TV screen photographed by a wide-angle TV camera at a distant place is photographed by a sandwiched angle TV camera and displayed on an enlarged TV screen, so that the place to be gazed at on the wide shooting range TV screen is displayed on an easily visible TV screen as if a human were watching it in the presence.

Claims

1. The position of an image of a subject that is captured on a television screen by using a television camera is associated with a drive value of a drive position of the drive mechanism that captures an image of the subject using a television camera of a drive mechanism that changes a shooting direction of a numerical control, and the position of the image of the subject at several different positions that is captured on the television screen by using the television camera to capture the image of the subject at several different positions is associated with the drive value of the drive position of the drive mechanism that captures the image of the subject at several different positions using the television camera of the drive mechanism, and the position of the image of the subject at several different positions that is captured on the television screen by using the television camera of the drive mechanism to capture the image of the subject at several different positions is associated with the drive value of the drive position of the drive mechanism that captures the image of the subject at several different positions. A method for displaying a television screen captured by driving the television camera of the drive mechanism using the obtained drive numerical values ​​at the position of the image of the subject at all of the positions that will be displayed on the television screen and at the position of all of the drive numerical values ​​of the drive position of the drive mechanism for capturing the images of the subject at all of the positions using the television camera of the drive mechanism, at the position of the image of the subject at all of the positions that will be displayed on the television screen and at the specified position, the method comprising the steps of: calculating and acquiring, using an interpolation method, the positions of the image of the subject at all of the positions that will be displayed on the television screen and at all of the drive numerical values ​​of the drive position of the drive mechanism for capturing the images of the subject at all of the positions using the television camera of the drive mechanism; and displaying, at the position of the image of the subject at all of the positions that will be displayed on the television screen and obtained by capturing the images of the subject using the television camera, or at the specified position, the television screen captured by driving the television camera of the drive mechanism using the obtained drive numerical values.

2. 2. A method according to claim 1, characterized in that the distance measured by a laser distance measuring device attached to the driving mechanism so as to measure the distance in the direction of the center of the television screen photographed by the television camera of the driving mechanism is used to adjust either the zoom function or the focus function of the television camera of the driving mechanism, so that the television screen photographed by the television camera of the driving mechanism is displayed at the position of an image of the subject that appears on the television screen obtained by photographing the subject using the television camera, or at the indicated position.

3. 2. A method according to claim 1, further comprising the steps of: associating a position of an image of the subject shown on a television screen obtained by photographing the subject using the television camera with a drive numerical value of a drive position of a laser distance measuring device of the drive mechanism that irradiates the subject with the measurement laser light of a laser distance measuring device of the drive mechanism that changes the measurement direction of a numerical control; and calculating the positions of the images of the subject at several different positions shown on the television screen obtained by photographing the subject at several different positions using the television camera and the drive numerical value of the several different drive positions of the laser distance measuring device of the drive mechanism that irradiates the subject at several different positions with the measurement laser light of the laser distance measuring device, A method characterized by calculating and obtaining, using an interpolation method, the position of the image and the drive numerical values ​​of the drive positions of the laser distance measuring device of the driving mechanism that irradiates the measurement laser light of the laser distance measuring device to the subject at all of the positions, driving the laser distance measuring device of the driving mechanism using the obtained drive numerical values ​​to the position of the image of the subject displayed on a television screen obtained by photographing the subject using the television camera or to a specified position, and adjusting either the zoom function or the focus function of the television camera of the driving mechanism using the measured distance to the subject, so as to display the television screen photographed by the television camera of the driving mechanism at the position of the image of the subject displayed on a television screen obtained by photographing the subject using the television camera or to the specified position.

4. 2. A method according to claim 1, characterized in that an image of the subject that appears on a television screen obtained by photographing the range in which the subject appears using the television camera is enlarged and photographed using a digital zoom function of the television camera, and the image of the subject is displayed at the position of the image of the subject that appears on the television screen.

5. A method according to claim 3, characterized in that the laser distance measuring device of the driving mechanism is driven using the driving value obtained in association with the method described above at the position of an image of the subject obtained by photographing the subject using the television camera and appearing on a television screen, the measurement laser light is irradiated onto the subject to measure the distance to the subject, and the image of the subject within the range in which the image of the subject is displayed is enlarged using a digital zoom function of the television camera corresponding to the measured distance, and the image of the subject is displayed at the position of the image of the subject appearing on the television screen.

6. A method according to any one of claims 1 to 5, characterized in that a television screen captured using the television camera is associated with the position of an image of the subject on the television screen displayed via the Internet using the method described above, and an enlarged image of the subject is captured by driving the numerical control using the drive numerical value of the numerically controlled television camera, and is displayed at the position of the image of the subject on the television screen via the Internet.

7. A method according to claims 1 to 5, characterized in that the position of an image of the subject on a television screen displayed via the Internet, where the subject is photographed using the television camera, or the screen of the numerically controlled television camera, which is photographed by driving the driving mechanism using the driving numerical value of the laser distance measuring device of the driving mechanism obtained by the method described above, irradiating the subject with a measurement laser light, and adjusting either the zoom function or the focus function of the numerically controlled television camera using the measured distance to the subject, is displayed at the position of the image of the subject on the television screen displayed via the Internet.

8. A method according to claims 1 to 5, characterized in that a television screen captured by driving the drive mechanism using the drive numerical values ​​of the numerically controlled television camera associated with the method described above is displayed at the position of the image of the subject on the television screen of a smartphone displayed via the Internet, or at the specified position, at the position of the image of the subject on the smartphone, or at the specified position.

Images