Image display method

Abstract

To improve the user's forward visibility in dark environments. [Solution] The image display device comprises a camera, a distance sensor, an illuminance sensor, a light / dark determination device, an image generation device, an image storage device, an image search device, a visual image determination device, and a display device. The camera captures images of real objects in front of the user and obtains camera images. The image generation device generates distance images based on the data from the distance sensor, corresponding to the camera images and representing the distance to each position of the real object. The light / dark determination device determines whether the user's location is bright or dark based on the data from the illuminance sensor. The image storage device stores the camera images and distance images obtained in bright areas as a set. The image search device searches for and identifies distance images corresponding to the obtained dark area distance image from the already stored distance images of bright areas in dark areas. The visual image determination device determines the visual image based on the camera images included in the same set as the identified distance image. The display device displays the visual image.

Claims

1. An image display method in an image display device that displays a visual image for the user to see, The aforementioned image display device is A camera that captures images of the area in front, An illuminance sensor that detects ambient brightness, Control unit and It includes a display unit, The control unit, The system is controlled to acquire data on ambient brightness detected by the illuminance sensor. Based on the aforementioned data, control is performed to determine the ambient brightness and darkness. In the determination described above, if it is determined that the surroundings are dark, the system recognizes the image as a dark-area image and controls the system to acquire a bright-area image corresponding to the dark-area image. Based on the aforementioned bright-field image, control is performed to determine the visually perceptible image. The system is controlled to detect the difference region between the dark image and the bright image. The system controls the determination of the visible image by performing an insertion process that inserts the corresponding image of the difference region in the dark image into the corresponding region of the difference region in the bright image. The display unit displays the visual image. Image display method.

2. In the image display method described in claim 1, The control unit, Control to acquire location information, Based on the positional information associated with the aforementioned image, control is performed to narrow down the bright area image. Image display method.

3. In the image display method described in claim 1, The control unit, The system controls the system to determine whether the cause of the difference region lies in the dark image or the bright image. If it is determined that the aforementioned cause is present in the bright-area image, the system controls the execution of the insertion process. Image display method.

4. An image display method in an image display device that displays a visual image for the user to see, The aforementioned image display device is A camera that captures images of the area in front, An illuminance sensor that detects ambient brightness, Control unit and It includes a display unit, The control unit, The system is controlled to acquire data on ambient brightness detected by the illuminance sensor. Based on the aforementioned data, control is performed to determine the ambient brightness and darkness. In the determination described above, if it is determined that the surroundings are dark, the system recognizes the image as a dark-area image and controls the system to acquire a bright-area image corresponding to the dark-area image. Based on the aforementioned bright-field image, control is performed to determine the visually perceptible image. The system is controlled to detect the difference region between the dark image and the bright image. The system controls the selection of a bright image that corresponds to the dark image and is different from the bright image. The system controls the system to determine the visible image by performing an insertion process in which the corresponding image of the detected difference region in the selected bright-field image is inserted into the corresponding region of the difference region in the bright-field image. The display unit displays the visual image. Image display method.

5. An image display method in an image display device that displays a visual image for the user to see, The aforementioned image display device is A camera that captures images of the area in front, An illuminance sensor that detects ambient brightness, Control unit and It includes a display unit, The control unit, The system is controlled to acquire data on ambient brightness detected by the illuminance sensor. Based on the aforementioned data, control is performed to determine the ambient brightness and darkness. In the determination described above, if it is determined that the surroundings are dark, the system recognizes the image as a dark-area image and controls the system to acquire a bright-area image corresponding to the dark-area image. Based on the aforementioned bright-field image, control is performed to determine the visually perceptible image. The system is controlled to detect the difference region between the dark image and the bright image. The system controls the system to determine whether the cause of the difference region lies in the dark image or the bright image. If the aforementioned cause is determined to be in the dark image, the system controls the system to determine the visible image by performing an enhancement process that emphasizes the corresponding area of ​​the difference region in the bright image. The display unit displays the visual image. Image display method.

6. An image display method in an image display device that displays a visual image for the user to see, The aforementioned image display device is A camera that captures images of the area in front, An illuminance sensor that detects ambient brightness, Control unit and It includes a display unit, The control unit, The system is controlled to acquire data on ambient brightness detected by the illuminance sensor. Based on the aforementioned data, control is performed to determine the ambient brightness and darkness. In the determination described above, if it is determined that the surroundings are dark, the system recognizes the image as a dark-area image and controls the system to acquire a bright-area image corresponding to the dark-area image. Based on the aforementioned bright-field image, control is performed to determine the visually perceptible image. The system is controlled to detect the difference region between the dark image and the bright image. The system controls the system to determine whether the cause of the difference region lies in the dark image or the bright image. If the aforementioned cause is determined to be in the dark image, the system controls the system to determine the visible image by performing an insertion process to insert an artificial image corresponding to the characteristics of the difference region into the corresponding region of the difference region in the bright image. The display unit displays the visual image. Image display method.

7. In the image display method described in claim 1, The control unit, Control the system to acquire multiple images of bright light, Based on the aforementioned multiple bright-field images, control is used to determine the visible image. Image display method.

8. An image display method in an image display device that displays a visual image for the user to see, The aforementioned image display device is A camera that captures images of the area in front, An illuminance sensor that detects ambient brightness, Control unit and Display unit and Equipped with a light source, The light source illuminates a portion of the camera's field of view. The control unit, The system is controlled to acquire data on ambient brightness detected by the illuminance sensor. Based on the aforementioned data, control is performed to determine the ambient brightness and darkness. In the determination described above, if it is determined that the surroundings are dark, the system recognizes the image as a dark-area image and controls the system to acquire a bright-area image corresponding to the dark-area image. Based on the aforementioned bright-field image, control is performed to determine the visually perceptible image. The camera is controlled to detect the illumination area of ​​the light source in the dark image captured in the dark place, The system controls the determination of the visible image by performing an insertion process that inserts the corresponding image of the illuminated area in the dark image into the corresponding area of ​​the illuminated area in the bright image. The display unit displays the visual image. Image display method.

9. In the image display method described in claim 1, The image display device includes a head-mounted display, The head-mounted display comprises the camera, the illuminance sensor, and the display unit. Image display method.

Images