Display method and control system

Abstract

The present invention provides a display method and system that can report the presence of an object to a user without causing the user to feel uncomfortable. The display method uses a display device that can image both inside and outside a lens region and be visually recognized by a user, wherein, when displaying one or more objects from a prescribed region inside the lens toward outside the lens region, the display device displays objects near the prescribed region in a different manner from objects near the prescribed region, in terms of at least one of density, depth of color, brightness, size, or the like.

Description

Technical Field

[0001] This invention relates to display methods and systems. Background Technology

[0002] Previously, technologies for detecting obstacles near a vehicle and reporting them to the driver were known. For example, Japanese Patent Application Publication No. 2005-35488 discloses a vehicle obstacle detection device comprising an obstacle detection mechanism for detecting obstacles near a vehicle and a vibration generating mechanism for vibrating the vehicle's handle. In this vehicle obstacle detection device, when the obstacle detection mechanism detects an obstacle, the vibration generating mechanism vibrates the handle to report the presence of the obstacle to the driver. Summary of the Invention

[0003] Furthermore, the obstacle detection device for vehicles described in Japanese Patent Application Publication No. 2005-35488 switches the vibration frequency generated by the vibration generating mechanism based on the distance between the obstacle detected by the obstacle detection mechanism and the vehicle, thereby allowing the driver to identify the distance to the obstacle. However, the vibration applied to the handle is limited to the left and right direction, thus preventing the driver from identifying the distance to the obstacle in the up, down, or forward and backward directions. Furthermore, the driver may experience discomfort from the vibration applied to the handle. Therefore, this prior art suffers from insufficient user-friendliness. While visual spatial information has been considered, prior art has also resulted in a sense of incongruity for the user.

[0004] This invention was made with such consideration in mind, and one of its objectives is to provide a display method and system that can spatially report the presence of an object to the user without causing the user to feel uncomfortable.

[0005] The display method of the present invention adopts the following structure.

[0006] (1): One aspect of the present invention provides a display method that uses a display device capable of imaging both within and outside the lens area and enabling visual recognition by a user, wherein when the display device displays one or more objects from a predetermined area within the lens toward the outside of the lens area, the objects near the predetermined area are displayed in a manner that differs from objects far from the predetermined area in that at least one of density, color depth, brightness, and size.

[0007] (2): Based on the above (1) scheme, the display device displays objects near the specified area in a manner that is higher in density, darker in color, brighter in brightness, or larger in size than objects far from the specified area and imaged outside the lens area.

[0008] (3): Based on the above scheme (1) or (2), the display device displays objects near the specified area in a manner that is less dense, lighter in color, less bright, or smaller in size compared to objects far from the specified area and imaged within the lens area.

[0009] (4): Based on any of the above schemes (1) to (3), the display device displays an anthropomorphic image, and the specified area is an area close to the anthropomorphic image or an area containing at least a part of the anthropomorphic image.

[0010] (5): Based on any of the above schemes (1) to (4), the display device displays an anthropomorphic image, and the display device also determines the display position of the anthropomorphic image through the user's operation.

[0011] (6): Based on any of the above schemes (1) to (5), the display device continuously displays one or more objects from the specified area toward a determined location outside the lens area.

[0012] (7): Based on the above (6) scheme, the location to be determined is a risk assessment location obtained by an external identification agency.

[0013] (8): Based on the above scheme (6) or (7), the display device further sets the degree of difference of the display pattern according to the distance between the determined location and the display device.

[0014] (9): Based on the above scheme (8), the closer the distance between the determined location and the display device, the greater the expansion of the width of the one or more objects from the starting point to the ending point by the display device.

[0015] (10): Based on any of the above schemes (1) to (9), the display device is a display device in which the visual recognizability of the image formed outside the lens area is reduced compared to the visual recognizability of the image formed within the lens area.

[0016] (11): Based on any of the above schemes (1) to (10), the display device is a display device with a columnar lens structure.

[0017] (12): Based on any of the above schemes (1) to (11), the display device is mounted on a mobile body.

[0018] (13): Based on the above (12) scheme, the display device, when the user riding on the mobile body is not visually recognizing the determined location, makes the density higher, the color darker, the brightness higher, or the size larger compared to when the user is visually recognizing the determined location.

[0019] (14): Based on the above (12) scheme, the display device displays the object in such a way that the lower the external illuminance of the moving body, the more blurred the object becomes.

[0020] (15): Based on the above (12) scheme, the display device improves the degree of difference in the display pattern when the user riding on the mobile body is not visually recognizing the determined location compared to when the user is visually recognizing the determined location.

[0021] (16): A system control of the present invention enables a display device to image in both the lens area and outside the lens area and to be visually recognized by a user, wherein the system comprises: a display control unit that controls the display based on the display device; and a display pattern determination unit that determines the display pattern based on the display device. When the display control unit causes the display device to display one or more objects from a predetermined area inside the lens toward the outside of the lens area, the display pattern determination unit determines that the display pattern of objects near the predetermined area is different from that of objects far from the predetermined area, including at least one of density, color depth, brightness, and size.

[0022] According to the schemes (1) to (16), it is possible to report the spatial existence of an object to the user without causing the user to feel uncomfortable.

[0023] According to the scheme in (9), users can more reliably identify the presence of objects that are close to the vehicle and have a high risk of collision.

[0024] According to the schemes of (13) or (15), the risk of collision can be conveyed more reliably to users who are looking to the side while driving.

[0025] According to the scheme in (14), users can visually identify objects without experiencing eye fatigue. Attached Figure Description

[0026] Figure 1 This is a block diagram showing the equipment mounted on the vehicle.

[0027] Figure 2 This is a diagram showing an example of a display device mounted on a vehicle.

[0028] Figure 3 This is a diagram used to illustrate the structure of a lenticular lens in a display device.

[0029] Figure 4 It is a diagram used to explain the functions of a display device.

[0030] Figure 5 This is a diagram used to illustrate the relationship between camera-based object detection and display of objects based on display devices.

[0031] Figure 6 This diagram illustrates an example of a scenario where a display device is used to report the presence of a detected object to the user.

[0032] Figure 7 These are other examples of scenarios where a display device is used to report the presence of detected objects to the user.

[0033] Figure 8 These are other examples of scenarios where a display device is used to report the presence of detected objects to the user.

[0034] Figure 9 These are other examples of scenarios where a display device is used to report the presence of detected objects to the user.

[0035] Figure 10 This is a flowchart illustrating an example of the operation of a control device.

[0036] Figure 11 This is a diagram illustrating an example of the display pattern of an object based on a display device.

[0037] Figure 12 These are diagrams illustrating other examples of display patterns for objects based on display devices.

[0038] Figure 13 These are diagrams illustrating other examples of display patterns for objects based on display devices.

[0039] Figure 14 This diagram illustrates the blurring process performed on the lens area of ​​a display device.

[0040] Figure 15 This is a diagram illustrating a user moving the display position of an anthropomorphic image.

[0041] Figure 16 It is a diagram used to illustrate how the display appearance of an object changes based on the display device as the display position of the anthropomorphic image moves. Detailed Implementation

[0042] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Figure 1 This is a block diagram showing the equipment mounted on vehicle 1. Vehicle 1 includes a camera 10, a radar device 12, a LIDAR (Light Detection and Ranging) device 14, an object recognition device 16, a vehicle sensor 18, an in-vehicle camera 20, a control device 100, and a display device 200. Vehicle 1 is an example of a "moving body," and the structure including part or all of the camera 10, radar device 12, LIDAR 14, and object recognition device 16 is an example of an "external recognition mechanism."

[0043] Camera 10 is, for example, a digital camera utilizing a solid-state imaging element such as CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor). Camera 10 can be mounted anywhere on vehicle 1. Camera 10 can be mounted on the upper part of the windshield, behind the interior rearview mirror, or at the front of the vehicle body. When shooting from the rear, camera 10 can be mounted on the upper part of the rear windshield or the tailgate. When shooting from the side, camera 10 can be mounted on the rearview mirror on the door.

[0044] Radar device 12 radiates millimeter-wave or other radio waves to the periphery of vehicle 1 and detects radio waves (reflected waves) reflected from surrounding objects to detect at least the position (distance and orientation) of the objects. Radar device 12 can be installed at any location on vehicle 1. Radar device 12 can also detect the position and speed of objects using FM-CW (Frequency Modulated Continuous Wave) method.

[0045] The LIDAR 14 illuminates the perimeter of vehicle 1 and measures the scattered light. The LIDAR 14 detects the distance to an object based on the time from the emission of light to the reception of light. The illuminated light is, for example, a pulsed laser. The LIDAR 14 is mounted at any location on vehicle 1.

[0046] The object recognition device 16 performs sensor fusion processing on some or all of the detection results from the camera 10, radar device 12, and LIDAR 14 to identify the position, type, speed, etc., of objects surrounding the vehicle 1. Objects include, for example, other vehicles (e.g., surrounding vehicles within a specified distance), pedestrians, bicycles, and road structures. Road structures include, for example, road signs, traffic signals, intersections, curbs, median strips, guardrails, and fences. Road structures may also include road markings (hereinafter referred to as markings), pedestrian crossings, bicycle crossings, temporary stop lines, etc., painted or affixed to the road surface. Additionally, objects may include obstacles such as fallen objects on the road (e.g., cargo from other vehicles, signs placed around the road). The object recognition device 16 outputs the recognition results to the control device 100. The object recognition device 16 can also output the detection results from the camera 10, radar device 12, and LIDAR 14 to the control device 100 as is. The function of the object recognition device 16 may also be included in the control device 100.

[0047] The vehicle sensor 18 includes a vehicle speed sensor for detecting the speed of the vehicle 1, an acceleration sensor for detecting acceleration, a yaw rate sensor for detecting yaw rate (e.g., the rotational angular rate about a vertical axis passing through the center of gravity of the vehicle 1), and an orientation sensor for detecting the orientation of the vehicle 1. The vehicle sensor 18 sends the detected vehicle information to the control device 100.

[0048] Like camera 10, the in-vehicle camera 20 is a digital camera that utilizes a solid-state imaging element such as CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The in-vehicle camera 20 is, for example, located in the center of the dashboard of vehicle 1, and captures images of the interior space. Specifically, the in-vehicle camera 20 detects the actions of the driver and front passenger of vehicle 1 and sends the detected actions to the control device 100.

[0049] The control device 100 includes, for example, a display control unit 110 and a display mode determination unit 120. These components are implemented by executing programs (software) through hardware processors such as CPUs (Central Processing Units). Some or all of these components can be implemented using hardware (including circuitry) such as LSIs (Large Scale Integration), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), and GPUs (Graphics Processing Units), or through the coordinated operation of software and hardware. The program can be pre-stored on storage devices such as HDDs (Hard Disk Drives) and flash memory (storage devices with non-transitory storage media), or stored on removable storage media such as DVDs and CD-ROMs (non-transitory storage media), and installed by mounting the storage media onto a drive device. The control device 100 is an example of a "system".

[0050] The display control unit 110 enables the image to be visually recognized on the display device 200. Specifically, the display control unit 110 controls the display device 200 to display the image in a manner determined by the display pattern determination unit 120, which will be described later. The display control unit 110 also determines image information other than the display pattern determined by the display pattern determination unit 120, such as the image's range, position, and orientation.

[0051] The display pattern determination unit 120 determines the display pattern of at least one object on the display device 200 based on object information received from the object recognition device 16 and vehicle information received from the vehicle sensor 18. The display pattern refers, for example, to some or all of the density, color depth, brightness, and size of the elements constituting the object. Details regarding the display pattern determined by the display pattern determination unit 120 will be described later.

[0052] The display device 200 is, for example, a three-dimensional display with a cylindrical lens structure, such as a looking glass. The display device 200 may also be a three-dimensional display with other structures. Figure 2 This diagram shows an example of a display device 200 mounted on vehicle 1. Figure 2 As described above, the display device 200 is positioned on the dashboard opposite the driver's seat. The display device 200 displays, for example, an anthropomorphic image I and a speedometer M. The anthropomorphic image is an image representing a real or fictional animal (including a human), plant, robot, or other entity; preferably, it is an image that uses animation to depict actions performed by a human.

[0053] Figure 3 This is a diagram illustrating the cylindrical lens structure of the display device 200. Figure 3 In this image, which combines the vertical lines (V) and horizontal lines (H) into a lenticular image, a plate (cylindrical lens) S, composed of countless tiny fish-cake-shaped convex lenses arranged side by side, is placed on top of the image. Because of the parallax of the user's two eyes, one eye perceives the vertical lines while the other eye perceives the horizontal lines by passing through plate S. Thus, the user can perceive an image with a sense of depth.

[0054] Figure 4 This diagram illustrates the functions of the display device 200. Figure 4 In this display device 200, in addition to the anthropomorphic image I and the speedometer M, an object diffuses toward the rear of the anthropomorphic image I. The object is displayed, for example, in the form of light or sand. The display device 200 can image both within and outside the lens area, thus allowing the user to stereoscopically identify objects extending from within the lens area toward the outside. However, the display device 200 also has the characteristic that the visual recognizability of the image formed outside the lens area is lower than that of the image formed within the lens area.

[0055] exist Figure 4 In this display device 200, the object is displayed in a continuous, integrated shape, but the method of displaying the object is not limited to this. For example, the display device 200 may also display the object as a collection of multiple intermittently distributed elements, or it may display the object in a manner in which multiple elements flow in a certain direction.

[0056] Next, the mechanism by which the camera 10 and the display device 200 report the presence of objects around the vehicle 1 to the user will be explained. Figure 5 This diagram illustrates the relationship between object detection based on camera 10 and object display based on display device 200. Here, camera 10 is specifically used to detect objects present in front of vehicle 1, and the distance and angle between vehicle 1 and the object are measured. Figure 5 In the diagram, CL represents the vehicle's axis of rotation, P represents the pedestrian, DL represents the distance between vehicle 1 and pedestrian P, and θ represents the angle of pedestrian P relative to the vehicle's axis of rotation CL. The object recognition device 16 derives information about distance DL and angle θ (and may also include height information) by performing a position transformation process from the image space captured by camera 10 to a plane observed from above. This processing can be performed in the display device 200 or by a processor attached to camera 10. The display device 200 obtains the distance DL and angle θ information from the object recognition device 16.

[0057] The display control unit 110 calculates a spatial vector from the anthropomorphic image I to the pedestrian P based on the acquired distance DL, angle θ, and height information from the anthropomorphic image I on the display device 200 to the camera 10. Based on the calculated spatial vector, the display control unit 110 calculates the orientation of an object displayed from beside the anthropomorphic image I towards the pedestrian P. The position of the pedestrian P is an example of "determining a location."

[0058] Next, the display pattern determination unit 120 of the control device 100 determines the display pattern of an object displayed from beside the anthropomorphic image I towards the pedestrian P based on the detection results of the camera 10 and the calculation results of the display control unit 110. Specifically, the display pattern determination unit 120 determines the density, color depth, brightness, or size of the object. Based on the determined display pattern, the display control unit 110 of the control device 100 causes the display device 200 to display the object. The area beside the anthropomorphic image I is an example of a "predefined area within a lens".

[0059] In this way, the display control unit 110 continuously displays one or more objects, for example, from a designated area toward a determined location outside the lens area. The determined location is a risk assessment location obtained by an external recognition mechanism such as the camera 10 or the object recognition device 16. Figure 5 In the example, the location of pedestrian P is a risk assessment location obtained by an external identification agency, and the location of the object facing pedestrian P is displayed.

[0060] exist Figure 5 In this context, the display device 200 displays dot-shaped objects from beside the anthropomorphic image I towards the pedestrian P. As mentioned earlier, the display device 200 has the characteristic that the visual recognition of the image formed outside the lens area is lower than that of the image formed within the lens area. Therefore, when displaying objects in the same manner, the decrease in visual recognition between the lens area and outside the lens area becomes significant, which may cause a sense of disorientation for the user. Therefore, when the display device 200 displays more than one object from a predetermined area within the lens towards the outside of the lens area, the display mode determination unit 120 determines the display mode in a way that makes the display mode of objects near the predetermined area different from that of objects far from the predetermined area, including at least one of density, color depth, brightness, and size. For example, in... Figure 5In this display pattern determination unit 120, the dot-shaped objects displayed near the designated area (close to the anthropomorphic image I) are larger than the dot-shaped objects displayed far from the anthropomorphic image I. Furthermore, the display pattern determination unit 120 makes the color of the dot-shaped objects near the anthropomorphic image I darker than the color of the dot-shaped objects far from the anthropomorphic image I. Alternatively, or on this basis, the display pattern determination unit 120 makes the brightness of the dot-shaped objects near the anthropomorphic image I higher than the brightness of the dot-shaped objects far from the anthropomorphic image I. Alternatively, or on this basis, the display pattern determination unit 120 makes the density of the dot-shaped objects near the anthropomorphic image I higher than the density of the dot-shaped objects far from the anthropomorphic image I. By determining the display pattern in a way that makes the display patterns of objects near the designated area different from those near the designated area in terms of at least one of density, color depth, brightness, and size, the visual discontinuity of the objects can be reduced, and the user's sense of unease can be decreased.

[0061] In this embodiment, the display device 200 displays the object starting from the side of the anthropomorphic image I, but the starting point of the object, i.e., the defined area within the lens, is not limited to this. It can be any area close to the anthropomorphic image I or any area containing at least a part of the anthropomorphic image I.

[0062] Figure 6 This diagram illustrates an example of a scenario where a display device 200 reports the presence of a detected object to a user. Figure 6 In the scenario where vehicle 1 is driving in a city, camera 10 confirms the presence of pedestrian P to the right front of vehicle 1 through the windshield F. Display device 200 displays a strip-shaped object with an extended width, positioned from beside the anthropomorphic image I towards pedestrian P. Display mode determination unit 120 determines the display mode of the object by the fact that the closer the strip-shaped object is to the anthropomorphic image I, the higher the density and brightness of the dots forming the strip. In this way, display mode determination unit 120 determines the display mode such that objects near a specified area have higher density, darker color, higher brightness, or larger size compared to objects far from the specified area and imaged outside the lens area. This reduces visual discontinuity of the object and minimizes user discomfort.

[0063] Figure 7 These are other examples of scenarios where a display device 200 reports the presence of detected objects to a user. Figure 7 In the scene, vehicle 1 is traveling on the road, and camera 10, through the windshield F, confirms the presence of pedestrian P to the right front of vehicle 1. Figure 7In the left portion, the display device 200 displays an extended strip-shaped object from beside the anthropomorphic image I towards the pedestrian P. Then, the vehicle 1 moves further forward, as... Figure 7 As shown in the right part, when the distance between vehicle 1 and pedestrian P decreases, the size of the spatial vector from the anthropomorphic image I to pedestrian P calculated by the display control unit 110 also decreases. When the size of this spatial vector decreases, the display pattern determination unit 120 determines the display pattern of the object by increasing the width expansion from the starting point to the ending point of the object displayed on the display device 200. That is, the closer the location is to the display device 200, the greater the width expansion from the starting point to the ending point of one or more objects is determined by the display pattern determination unit 120. In this way, by setting the degree of difference in display patterns based on the distance between the location and the display device 200, the user can more reliably identify the presence of objects that are close to vehicle 1 and have a higher risk of collision.

[0064] Figure 8 The diagram illustrates another example of a scenario where a display device 200 is used to report the presence of a detected object to a user. Figure 8 The image shows vehicle 1 turning right at an intersection from above, with a cyclist P approaching from the right rear of vehicle 1. At this time, the user of vehicle 1 cannot confirm the presence of pedestrian P through the windshield F. However, camera 10 identifies the presence of pedestrian P, and display device 200 displays the object from beside the anthropomorphic image I towards pedestrian P, thus allowing the user to visually recognize the presence of the bicycle, which is not visible in their field of vision.

[0065] Figure 9 These are other examples of scenarios where a display device 200 reports the presence of detected objects to a user. Figure 9 In the left portion of the image, the user of vehicle 1 is facing forward while driving, and a pedestrian P is located to the right front of vehicle 1. The display device 200 displays an object from beside the anthropomorphic image I towards the pedestrian P. Here, it is assumed that the user is looking to the side while driving. In this case, the in-vehicle camera 20 detects the user looking to the side and transmits this information to the control device 100 via the object recognition device 16. The display pattern determination unit 120 of the control device 100 determines the display pattern of the object by expanding the width of the object to be displayed on the display device 200 based on the user looking to the side. The display device 200 displays the object by expanding the width of the object based on the determined display pattern. In this way, the difference in display pattern is increased compared to the case where the user of vehicle 1 is visually recognizing a certain location, even when the user is not visually recognizing the location, thereby enabling a more reliable transmission of the risk of collision to the user who is looking to the side while driving.

[0066] exist Figure 9 In this method, the display device 200 displays the object by expanding its width when the user is looking to the side. Alternatively, when the user in vehicle 1 is not visually identifying a location, the display device 200 may display the object in a manner that makes up the density of the dots constituting the object, its color is darker, its brightness is higher, or its size is larger compared to when the user is visually identifying the location. In this method, the risk of collision can also be conveyed more reliably to the user who is looking to the side.

[0067] Figure 10 This is a flowchart illustrating an example of the operation of the control device 100. The processing in this flowchart begins at a desired time, such as when the power supply to the vehicle 1 is turned on, and then repeats itself, for example, at a predetermined cycle.

[0068] First, the display control unit 110 of the control device 100 determines whether an obstacle is detected around the vehicle 1 based on the object information obtained from the object recognition device 16 (step S1). For example, if a moving object exists within a radius of 200m of the vehicle 1, the display control unit 110 determines that an obstacle is detected around the vehicle 1.

[0069] If no obstacle is detected around vehicle 1, the display control unit 110 of the control device 100 causes the display device 200 to display only the anthropomorphic image I (step S2). Afterwards, the control device 100 returns the process to step S1 and performs the determination again. As a result, the processing in this flowchart begins when the power to vehicle 1 is turned on, and during the period when no obstacle is detected around vehicle 1, only the anthropomorphic image I is always displayed.

[0070] When an obstacle is detected around vehicle 1, the display pattern determination unit 120 of control device 100 determines the display pattern of the object to be displayed from the side of the anthropomorphic image I toward the obstacle based on the object information obtained from object recognition device 16 (step S3). Based on the determined display pattern, the display control unit 110 of control device 100 causes display device 200 to display both anthropomorphic image I and the object (step S4). Afterwards, control device 100 returns to step S1 and performs the determination again. As a result, for example, while vehicle 1 is moving, during the period when an obstacle is detected around vehicle 1, display device 200 displays both anthropomorphic image I and the object; afterwards, when the obstacle is sufficiently far away from vehicle 1, display device 200 displays only anthropomorphic image I.

[0071] Next, refer to Figures 11 to 13Various examples of display patterns of objects based on the display device 200 will be explained. Figure 11 This diagram illustrates an example of the display pattern of an object based on the display device 200. Figure 11 In this display device 200, an extended arrow-shaped object is displayed from the side of the anthropomorphic image I toward the object. The closer the arrow is to the side of the anthropomorphic image I, the higher the density of the dots forming the arrow and the higher the brightness. This reduces the visual discontinuity of the object caused by the decrease in visual discernibility between the lens area and the outside of the lens area, and reduces the user's sense of unease.

[0072] Figure 12 These are diagrams illustrating other examples of display patterns of objects based on the display device 200. Figure 12 In this image, the display device 200 displays a strip of object of constant width from beside the anthropomorphic image I towards the object. The closer the strip is to the anthropomorphic image I, the brighter it becomes. Thus, with... Figure 11 Similarly, it can reduce visual discontinuities of objects and reduce the user's sense of incongruity.

[0073] Figure 13 These are diagrams illustrating other examples of display patterns of objects based on the display device 200. Figure 13 In the image, display device 200 displays multiple dot-shaped objects from the side of the anthropomorphic image I toward the object. The closer the objects are to the anthropomorphic image I, the higher their density. Thus, with... Figure 11 as well as Figure 12 Similarly, it can reduce visual discontinuities of objects and reduce the user's sense of incongruity.

[0074] Next, refer to Figure 14 Methods for reducing visual discontinuities of objects between the lens area and the outside of the lens area are explained. Figure 14 This diagram illustrates the blurring process performed on objects within the lens area of ​​the display device 200. Figure 14 The starting point of the diagram shown is around the anthropomorphic image I.

[0075] like Figure 14 As shown in the left part, within the lens area of ​​the display device 200, the user can almost not perceive any blurriness when identifying objects. However, outside the lens area, the image is blurred, so unless blurring is applied to the objects within the lens area, the user will perceive a visual discontinuity in the objects.

[0076] Therefore, as Figure 14As shown by the double-dotted line, the display device 200 performs blurring on the object within the lens region in a manner that ensures consistent blurring at the boundary points between the lens region and the outside of the lens region. The result is, as... Figure 14 As shown in the right part, the user can also recognize blurred objects within the lens area. This reduces visual discontinuities in objects and minimizes the user's sense of unease.

[0077] like Figure 14 As shown in the left part, not only outside the lens area, but also within the lens area, the further away from the starting point, the greater the blurriness in user recognition. Therefore, the display device 200 displays objects near the designated area in a manner that makes them less dense, lighter in color, less bright, or smaller in size compared to objects far from the designated area and imaged within the lens area. This reduces the visual discontinuity of objects within the lens area.

[0078] Furthermore, the lower the external illuminance of vehicle 1, the stronger the blurring effect of the display device 200 on more than one object. This is because when the external illuminance is low, the user perceives the object as brighter, causing eye fatigue. By blurring the object when the external illuminance of vehicle 1 is low, the user can visually recognize the object without experiencing eye fatigue.

[0079] Alternatively, the display device 200 may have a touch panel, allowing the user to determine the display position of the anthropomorphic image I. Figure 15 This diagram illustrates the scenario where the user moves the display position of the anthropomorphic image I. For example... Figure 15 As shown, the user moves the anthropomorphic image I, initially positioned directly to the left of the speedometer M, by touching a position further to the left on the display device 200. Thus, the user can move the anthropomorphic image I away from themselves if they find it obstructive, or conversely, move it closer to themselves if they wish to utilize it more effectively. Alternatively, the display position of the anthropomorphic image I can be determined by detecting the user's hand movements using the in-vehicle camera 20.

[0080] Figure 16 This diagram illustrates how the display appearance of an object on the display device 200 changes as the display position of the anthropomorphic image I moves. Figure 6 Similarly, when vehicle 1 is driving in the city, camera 10 confirms through the windshield F that there is a pedestrian P to the right front of vehicle 1. Figure 16As shown, the display pattern of the object changes as the anthropomorphic image I moves. This is because when the anthropomorphic image I moves, the vector from the anthropomorphic image I on the display device 200 to the camera 10 also changes, and consequently, the vector from the anthropomorphic image I to the pedestrian P calculated by the display pattern control unit 110 also changes. The display pattern determination unit 120 determines the display pattern of the object based on the changed vector, and the display device 200 displays the object based on the determined display pattern. In other words, the display device 200 can flexibly display the object in response to the movement of the user's anthropomorphic image I.

[0081] According to the embodiments described above, when the display device 200 displays one or more objects from a predetermined area within the lens toward the outside of the lens area, it displays objects near the predetermined area in a manner that differs from objects far from the predetermined area in at least one of the following display patterns: density, color depth, brightness, and size. This allows the user to perceive the spatial presence of objects without feeling uncomfortable.

[0082] The implementation methods described above are as follows.

[0083] A control device, wherein,

[0084] The control device includes:

[0085] Storage device, which stores a program; and

[0086] Hardware processor,

[0087] The control device is configured to perform the following processing by executing a program stored in the storage device via the hardware processor:

[0088] A display device capable of imaging both within and outside the lens area and enabling visual recognition by a user, when displaying more than one object from a predetermined area within the lens towards the outside of the lens area, displays objects near the predetermined area in a manner that differs from objects far from the predetermined area in at least one of the following display patterns: density, color depth, brightness, and size.

[0089] The above describes specific embodiments of the present invention, but the present invention is not limited to such embodiments in any way, and various modifications and substitutions can be applied without departing from the spirit of the present invention.

Claims

1. A display method using a display device capable of imaging both within and outside the lens area of ​​a cylindrical lens and enabling visual recognition by a user, wherein, When the display device displays one or more objects from a designated area within the lens toward the outside of the lens area, it displays objects near the designated area within the lens area in a manner that differs from objects near the designated area outside the lens area in at least one of the following display patterns: density, color depth, brightness, and size.

2. The display method according to claim 1, wherein, The display device displays objects near the designated area in a manner that is higher in density, darker in color, brighter in brightness, or larger in size compared to objects far from the designated area and imaged outside the lens area.

3. The display method according to claim 1 or 2, wherein, The display device displays objects near the designated area in a manner that is lower in density, lighter in color, lower in brightness, or smaller in size compared to objects far from the designated area and imaged within the lens area.

4. The display method according to claim 1 or 2, wherein, The display device displays anthropomorphic images. The defined area is the area that is close to the anthropomorphic image, or the area that contains at least a portion of the anthropomorphic image.

5. The display method according to claim 1 or 2, wherein, The display device displays anthropomorphic images. The display device also determines the display position of the anthropomorphic image based on user input.

6. The display method according to claim 1 or 2, wherein, The display device continuously displays one or more objects from the designated area toward a predetermined location outside the lens area.

7. The display method according to claim 6, wherein, The determined location is a risk assessment location obtained by an external identification agency.

8. The display method according to claim 6, wherein, The display device also sets the degree of difference in the display pattern based on the distance between the determined location and the display device.

9. The display method according to claim 8, wherein, The closer the location is to the display device, the greater the width expansion of the one or more objects from the starting point to the ending point is caused by the display device.

10. The display method according to claim 1 or 2, wherein, The display device is a display device in which the visual recognizability of the image formed outside the lens area is reduced compared to the visual recognizability of the image formed within the lens area.

11. The display method according to claim 1 or 2, wherein, The display device is a display device with a cylindrical lens structure.

12. The display method according to claim 6, wherein, The display device is mounted on a mobile body.

13. The display method according to claim 12, wherein, When the user riding on the mobile body is not visually identifying the location, the display device makes the density higher, the color darker, the brightness higher, or the size larger compared to when the user is visually identifying the location.

14. The display method according to claim 12, wherein, The display device displays the object in such a way that the lower the external illuminance of the moving body, the more blurred the one or more objects become.

15. The display method according to claim 12, wherein, The display device increases the degree of difference in the display pattern when the user riding on the mobile body is not visually identifying the location compared to when the user is visually identifying the location.

16. A control system that controls a display device capable of imaging both within and outside the lens region of a cylindrical lens and enabling a user to visually recognize it, wherein, The control system includes: a display control unit that controls the display based on the display device; and a display mode determination unit that determines the display mode based on the display device. When the display control unit causes the display device to display one or more objects from a predetermined area within the lens toward the outside of the lens area, the display pattern determination unit causes the display pattern of objects near the predetermined area within the lens area to differ from that of objects near the predetermined area outside the lens area, including at least one of density, color depth, brightness, and size.

17. A display method using a display device capable of imaging both within and outside the lens area and enabling visual recognition by a user, wherein, When the display device displays one or more objects from a designated area within the lens toward the outside of the lens area, it displays objects near the designated area in a manner that differs from objects far from the designated area in at least one of the following display patterns: density, color depth, brightness, and size. The display device continuously displays one or more objects from the designated area toward a predetermined location outside the lens area.

18. The display method according to claim 17, wherein, The determined location is a risk assessment location obtained by an external identification agency.

19. The display method according to claim 17 or 18, wherein, The display device also sets the degree of difference in the display pattern based on the distance between the determined location and the display device.

20. The display method according to claim 19, wherein, The closer the location is to the display device, the greater the width expansion of the one or more objects from the starting point to the ending point is caused by the display device.

Images