Information transmission system and information transmission method using light in the near-infrared region
The near-infrared based information transmission system addresses the limitations of LiDAR in autonomous driving by accurately displaying and recognizing traffic control information, enhancing safety and security in autonomous driving operations.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NISSAN CHEM CORP
- Filing Date
- 2022-01-27
- Publication Date
- 2026-07-07
AI Technical Summary
Existing LiDAR technology in autonomous driving systems struggles to accurately recognize traffic control information such as traffic signs and lacks secure 'offline' information exchange, leading to potential safety risks and insufficient accuracy in autonomous driving operations.
An information transmission system using a display device and recognition device that utilize near-infrared light to display and recognize distinct regions, enabling accurate transmission and recognition of traffic control information, allowing for 'offline' information exchange.
The system enhances the safety and accuracy of autonomous driving by enabling precise display and recognition of traffic control information, reducing risks associated with hacking and improving operational safety through secure 'offline' communication.
Smart Images

Figure 0007885533000002 
Figure 0007885533000001
Abstract
Description
Technical Field
[0001] The present invention relates to an information transmission system and an information transmission method using light in the near-infrared region. Specifically, the present invention relates to an information transmission system for transmitting information, which includes a display device that displays first and second regions, which are at least two regions distinguishable by light in the near-infrared region; and a recognition device that recognizes the first and second regions, which are the at least two regions, based on light in the near-infrared region.
[0002] Further, the present invention relates to an information transmission method for transmitting information, which includes (I) a step of displaying first and second regions, which are at least two regions distinguishable by light in the near-infrared region; and (II) a step of recognizing the first and second regions, which are the at least two regions, based on light in the near-infrared region.
Background Art
[0003] In recent years, as an essential technology required for autonomous driving of automobiles and the like, there is a sensor technology called LiDAR (Light Detection and Raging, Laser Imaging Detection and Ranging). This is a sensor technology that emits reference light in the near-infrared region, for example, 905 nm or 1550 nm, from a light source to an object, and grasps the position of the object from information on the reflected light from the object. It enables a more precise grasp of the object than conventional radars using radio waves, and is attracting attention because it can simultaneously detect the distance and shape to the object even at night.
[0004] In addition, in autonomous driving, so-called "online" systems that recognize position information of automobiles and the like, traffic control information, etc. via the cloud, and "offline" systems that do not use the "online" are considered. In the "online", cyberattacks due to terrorism are conceivable, and an "offline" system is required in terms of security.
[0005] On the other hand, "offline" systems require that location information for vehicles, traffic control information, etc., be recognized literally "offline." For example, each vehicle needs to recognize its own location information and traffic control information, and such "offline" systems are required.
[0006] For example, Patent Document 1 discloses that safety on the road can be improved by an identification system that allows the driver or the vehicle itself (whether autonomous or semi-autonomous) to obtain readable and useful information regarding road signs, roadways, and nearby roadway information. [Prior art documents] [Patent Documents]
[0007] [Patent Document 1] Japanese Patent Publication No. 2018-508064. [Overview of the Initiative] [Problems that the invention aims to solve]
[0008] However, Patent Document 1 is limited to road signs, roadways, and nearby roadway information, and there is a need for a system that can enable safer operation in autonomous driving. While LiDAR technology in autonomous driving can obtain information such as the distance to other vehicles in front of and behind the vehicle, and information about pedestrians in the direction of travel, it cannot recognize traffic control information such as traffic signs, or if it does, the accuracy of the recognition is insufficient. Therefore, if there is a system that allows each vehicle to recognize traffic control information "offline," it will be possible to provide safer autonomous driving technology.
[0009] Furthermore, if various information such as the speed, acceleration, and turns of preceding or nearby vehicles can be obtained, safer operation can be achieved with autonomous driving. In addition, if there is mutual authentication between information obtained "online" and information obtained "offline" regarding traffic control information, it is conceivable that the risk to safety can be reduced even if hacking occurs "online".
[0010] Therefore, the object of the present invention is to provide an information transmission system and / or information transmission method in LiDAR technology for autonomous driving that accurately displays traffic control information such as traffic signs using light in the near-infrared region and transmits information by recognizing it. In particular, the object of the present invention is to provide an information transmission system and / or information transmission method in LiDAR technology for autonomous driving that enables so-called "offline" information exchange.
[0011] Furthermore, in addition to the above objectives, an object of the present invention is to provide an information transmission system and / or information transmission method that can transmit information with high accuracy using light in the near-infrared region, not limited to LiDAR technology in autonomous driving. [Means for solving the problem]
[0012] To solve the above problems, the inventors have come up with the following invention. <1> A display device that displays a first and second region, which are at least two regions distinguishable by light in the near-infrared region; and A recognition device that recognizes at least two regions, a first and a second region, based on light in the near-infrared region; An information transmission system having, The information transmission system includes: an information input unit for inputting information; a code conversion unit for converting the information input in the information input unit into a code; a signal conversion unit for converting the code converted by the code conversion unit into signals corresponding to the first and second regions; and a display unit for displaying the signals as the first and second regions. That would be good.
[0013] <2> the above <1> In this, the recognition device preferably includes: a receiving unit that receives first and second regions displayed on a display device as near-infrared light; a reconversion unit that reconverts the light corresponding to the first and second regions received by the receiving unit back into the code; and an information reconversion unit that reconverts the code back into the information; and an information output unit that outputs the information obtained by the information reconversion unit. <3> the above <1> or <2> In this configuration, it is preferable that either the display device or the recognition device has a light source in the near-infrared region.
[0014] <4> the above <3> In this configuration, the recognition device has a light source in the near-infrared region, and the receiving unit receives the reflected near-infrared light from the display device. <5> the above <4> In this context, the display device is preferably equipped with a retroreflective plate.
[0015] <6> the above <1> ~ <5> In any of these, the near-infrared region is preferably in the 700-2500 nm range, more preferably in the 700-1700 nm range, more preferably in the 800-1000 nm range or the 1400-1700 nm range. <7> the above <1> ~ <6> In either of these, it is preferable that the first region and the second region differ due to the difference in transmittance.
[0016] <8> (I) A step of displaying a first and a second region which are at least two regions that can be distinguished by light in the near-infrared region; and (II) A step of recognizing the first and second regions, which are at least two regions, based on light in the near-infrared region; A method of transmitting information that has the means to transmit information.
[0017] <9> the above <8> In, The above step (I) is, (I)-1 The process of inputting information; (I)-2 The process of converting the information into a code; (I) - The step of converting the code into signals corresponding to the first and second regions; and (I) - The step of displaying the signals as the first and second regions; which has where the step (II) is (II) - 1 The step of receiving the first and second regions as light in the near-infrared region; (II) - 2 The step of re-converting the code from the light in the near-infrared region corresponding to the first and second regions; (II) - 3 The step of re-converting the information from the code; (II) - 4 The step of outputting the information; is preferably provided.
Advantages of the Invention
[0018] According to the present invention, in the LiDAR technology for autonomous driving, an information transmission system and / or an information transmission method can be provided, which uses light in the near-infrared region to accurately display traffic control information such as traffic signs and transmits information by recognizing it. Particularly in the LiDAR technology for autonomous driving, an information transmission system and / or an information transmission method can be provided, which enables so-called "offline" information exchange.
[0019] In addition to or in addition to the above effects, according to the present invention, an information transmission system and / or an information transmission method can be provided, which can accurately transmit information using light in the near-infrared region, not limited to the LiDAR technology for autonomous driving.
Brief Description of the Drawings
[0020] [Figure 1] It is a chart illustrating the information transmission system of the present invention.
Embodiments for Carrying Out the Invention
[0021] The present invention relates to a display device that displays a first and second region, which are at least two regions that can be distinguished by light in the near-infrared region; and A recognition device that recognizes at least two regions, a first and a second region, based on light in the near-infrared region; An information transmission system having, The display device provides an information transmission system comprising: an information input unit for inputting information; a code conversion unit for converting the information input in the information input unit into a code; a signal conversion unit for converting the code converted by the code conversion unit into signals corresponding to the first and second regions; and a display unit for displaying the signals as the first and second regions. The information transmission system of the present invention enables the transmission of information from the display device to the recognition device.
[0022] Furthermore, the present invention provides (I) a step of displaying a first and a second region which are at least two regions that can be distinguished by light in the near-infrared region; and (II) A step of recognizing the first and second regions, which are at least two regions, based on light in the near-infrared region; The present invention provides an information transmission method that transmits information using [a specific method / tool]. The information transmission method of the present invention can transmit information by recognizing the information placed in the first and second regions displayed in the information display process using a recognition device. The following provides a detailed explanation of each of these points.
[0023] <Information transmission system> The information transmission system of the present invention is a display device that displays a first and second region, which are at least two regions that can be distinguished by light in the near-infrared region; and The device includes a recognition device that recognizes a first and a second region, which are at least two regions, based on light in the near-infrared region. By having the display device and recognition device, information can be transmitted between the display device and the recognition device using light in the near-infrared region.
[0024] In this application, the near-infrared region refers to the region between 700 and 2500 nm. Light in the near-infrared region may be light of a specific wavelength within that region, or light of a specific range of wavelengths within that region. Examples of specific wavelengths of light include, but are not limited to, 905 nm and 1550 nm, which are used in LiDAR technology. Furthermore, the wavelength is preferably in the 700-1700nm range, more preferably in the 800-1000nm range or the 1400-1700nm range, and either a specific wavelength within these ranges or a specific range of wavelengths within these ranges may be used.
[0025] For example, when applying the information transmission system of the present invention to autonomous driving technology, it is preferable to equip each vehicle with a display device and a recognition device. Furthermore, it is preferable that the information transmission system of the present invention be formed not within a single vehicle, but between a display device or recognition device in one vehicle and a recognition device or display device in another vehicle, thereby enabling information transmission between vehicles. For example, a display device of the system of the present invention is installed in a leading vehicle A, and a recognition device of the system of the present invention is installed in a following vehicle B, which is different from vehicle A. By displaying information such as the speed and speed change information of the leading vehicle A, and information about the direction of travel (e.g., turning left or right), on the display device, and vehicle B recognizing this information with its recognition device, the operation of autonomous driving can be made safer.
[0026] Furthermore, for example, by installing a display device for the system of the present invention near a traffic sign, or separately from a traffic sign, and displaying information about the traffic sign using the display device, while each vehicle is equipped with a recognition device for the system of the present invention and recognizes the information about the traffic sign displayed by the display device, it is possible to perform automated driving in accordance with the traffic signs, thereby making the operation of automated driving safer.
[0027] Although the application of the system of the present invention to autonomous driving technology has been described above by way of example, the system of the present invention is not limited to this example. For example, the information transmission system of the present invention can be used as a security system. Specifically, while providing a display device of the system of the present invention in a safe, by using a portable recognition device, for example, by providing a recognition device of the system of the present invention in a smartphone, or by a reverse configuration, a security system can be provided that can open the safe by displaying the first and second regions carrying key information on the display device and recognizing the first and second regions carrying the information that becomes the key (key) to be displayed. The above security system is also an example and the present invention is not limited thereto.
[0028] <<A. Display device>> The display device in the system of the present invention A(1) An information input unit for inputting information; A(2) A code conversion unit for converting the information input in the information input unit into a code; A(3) A signal conversion unit for converting the code converted by the code conversion unit into signals corresponding to the first and second regions; and A(4) A display unit for displaying the signals as the first and second regions; may preferably be included.
[0029] A(1) The information input unit inputs desired information. The information input unit is not particularly limited as long as it can input desired information. For example, in the operation of an autonomous vehicle, when the information to be input is information on the traveling direction of "turning right or left", a CPU (Central Processing Unit) that processes the information on the traveling direction of "turning right or left" transmitted from a navigation system can be used as A(1) the information input unit. Also, when inputting information on the traveling direction of "turning right or left" in the operation of a vehicle by a driver (human), the operation of a wiper and transmission means interlocking therewith can be used as A(1) the information input unit.
[0030] The information depends on the environment in which the information transmission system of the present invention is used, but is not particularly limited as long as it can be converted into a code by the A(2) code conversion unit. For example, as described above, when the information transmission system of the present invention is used in autonomous driving, the information may include, but is not limited to, information indicated by traffic signs; information on the speed and speed changes of the preceding vehicle, information on the direction of travel such as turning left or right; information on the speed and speed changes of the following vehicle; and information indicated by traffic signals. Furthermore, when the information transmission system of the present invention is used as the security system described above, the information can be, for example, a key, but is not limited to this.
[0031] In the system of the present invention, the information can be dynamic information. Here, dynamic information refers to information that changes over time, or information that can be displayed as time progresses on the A(4) display unit of the display device of the present invention, which will be described in detail later. Examples of dynamic information, when the present invention is applied to the operation of automobiles, include, but are not limited to, information on the speed of preceding or adjacent vehicles, acceleration information, information on the direction of travel such as turning left or right, and information indicated by traffic signals. Furthermore, speed limits on expressways can change over time, so they are dynamic information. Moreover, traffic information for each road changes over time, so it is dynamic information. Furthermore, when a large amount of information is to be handled, the display unit A(4) of the display device of the system of the present invention displays the large amount of information in multiple parts at high speed, which also constitutes dynamic information in the present invention. In addition to displaying a large amount of information in multiple parts at high speed, the case where multiple pieces of information are repeatedly displayed at high speed, for example, when three pieces of information, such as Information 1, Information 2, and Information 3, are displayed in sequence, for example, Information 1 → Information 2 → Information 3 → Information 1 → Information 2 → Information 3 →..., which also constitutes dynamic information in the present invention. The dynamic information mentioned above is merely an example and not an exhaustive list.
[0032] A(2) The code conversion unit converts the information input in A(1) the information input unit into a code. The code conversion unit depends on the code used in the system of the present invention, but is not particularly limited as long as it can convert the input information into a code. For example, if the code used in the system of the present invention is a two-dimensional code (so-called QR code (registered trademark)) and the information is information related to the direction of travel, such as "turn right or left", then the A(2) code conversion unit can be a CPU or other device that processes the "turn right" information into a predetermined two-dimensional code in the system of the present invention.
[0033] The code is not particularly limited as long as it can convert the input information and convert it back into information. It is also preferable that it can be displayed in the first and second areas and that the displayed information in the first and second areas can be converted back into information. Examples of codes include, but are not limited to, characters, symbols, shapes, pictures, one-dimensional codes such as JAN codes and XPAND codes, two-dimensional codes including stacked two-dimensional codes and matrix two-dimensional codes, and three-dimensional codes.
[0034] The A(3) signal conversion unit converts the code converted by the A(2) code conversion unit into signals corresponding to the first and second regions. The A(3) signal conversion unit is not particularly limited as long as it can convert the code into signals corresponding to the first and second regions. For example, if the code used in the system of the present invention is a two-dimensional code (so-called QR code®) and the A(4) display unit described later is a liquid crystal screen, the A(3) signal conversion unit can be a CPU or the like that processes the first region by assigning "0" to "black" and the second region by assigning "1" to "white".
[0035] The A(4) display unit is not particularly limited as long as it can display the signal as at least two regions, the first and second regions, that can be discriminated by light in the near-infrared region. Examples of the display unit include, but are not limited to, a liquid crystal display element; a light control element using a liquid crystal method, an electrochromic (EC) method, an SPD (Suspended Particle Device) method, a gasochromic method, etc.
[0036] On the display device side of the system of the present invention, there may be devices other than the above-described A(1) information input unit to A(4) display unit. For example, it is preferable that the display device side of the system of the present invention includes a retroreflective plate.
[0037] <<B. Recognition Device>> The recognition device in the system of the present invention has a B(1) receiving unit that receives the first and second regions displayed on the display device as light in the near-infrared region; a B(2) reconversion unit that reconverts the light corresponding to the first and second regions received by the receiving unit into the code; a B(3) information reconversion unit that reconverts the code into the information; and a B(4) information output unit that outputs the information obtained by the information reconversion unit. It preferably has these.
[0038] The B(1) receiving unit is not particularly limited as long as it can receive the first and second regions displayed on the display device as light in the near-infrared region. Examples include, but are not limited to, a light receiving element using a semiconductor such as silicon or indium gallium arsenide.
[0039] The re-conversion unit B(2) is not particularly limited as long as it re-converts the light corresponding to the first and second regions received by the receiver into the code. For example, the signal conversion unit A(3) described above uses a CPU that processes by assigning "black" as "0" to the first region and "white" as "1" to the second region. The re-conversion unit B(2) could use a CPU that processes in the reverse direction of the processing performed by the signal conversion unit A(3), that is, by re-converting "black" in the first region to "0" and "white" in the second region to "1" into the code, but is not limited to these.
[0040] The information re-conversion unit B(3) is not particularly limited as long as it re-converts the code to the aforementioned information. For example, the code conversion unit A(2) described above is a CPU that converts the information "turn right" into a two-dimensional code predetermined in the system of the present invention. The information re-conversion unit B(3) could be a CPU that performs processing in the reverse direction of the processing performed by the code conversion unit A(2), that is, a CPU that assigns "turn right" as predetermined "information" in the system of the present invention from the code (e.g., a two-dimensional code) obtained by the re-conversion unit B(2), but is not limited to these.
[0041] The B(4) information output unit is not particularly limited as long as it outputs the information obtained by the B(3) information re-conversion unit. Depending on the target of the output, for example, in the operation of an autonomous vehicle, if the information to be output is information about the direction of travel, such as "turn right or left," the B(4) information output unit can be a CPU or other device that processes the information in a way that makes the operation of the vehicle safer. Specifically, if the information obtained is "turn right," the B(4) information output unit can process the expected deceleration of the preceding vehicle A, the change in the direction of travel of the vehicle itself due to the change in the direction of travel of the preceding vehicle A, etc. Also, for example, in the operation of a vehicle by a driver, the B(4) information output unit can be a device that outputs the "turn right or left" of the preceding vehicle A as an audio announcement, and / or a device that projects it as an image.
[0042] The recognition device side of the system of the present invention may have devices other than the B(1) receiving unit to B(4) information output unit described above. For example, the recognition device side of the system of the present invention preferably has a light source in the near-infrared region, and the receiving unit receives the reflected near-infrared light from the display device.
[0043] <Methods of Information Transmission> This application is, (I) A step of displaying a first and a second region which are at least two regions that can be distinguished by light in the near-infrared region; and (II) A step of recognizing the first and second regions, which are at least two regions, based on light in the near-infrared region; The present invention provides an information transmission method that transmits information using [a specific method / tool].
[0044] <<(I) Process>> The above step (I) is, (I)-1 The process of inputting information; (I)-2 The process of converting the information into a code; (I)-3 A step of converting the code into signals corresponding to the first and second regions; and (I)-4 A step of displaying the signal as the first and second regions; It is good to have it.
[0045] (I)-1 is the process of inputting information. The above-mentioned A(1) information input unit enables the (I)-1 process. That is, the (I)-1 process is the process of inputting desired information. For example, in the operation of an autonomous vehicle, if the information to be input is the direction of travel, such as "turn right or left," the information can be input by a CPU that processes the "turn right or left" direction of travel information transmitted from the navigation system. Furthermore, when a driver (human) inputs information about the direction of travel, such as "turning right or left," the operation of the turn signal and the corresponding communication means can be included in step (I)-1. Furthermore, the definition of "information" is the same as described above.
[0046] (I)-2 is the process of converting the information obtained above into code. The code conversion unit A(2) described above can perform step (I)-2. That is, step (I)-2 converts the information input in step (I)-1 into a code. The code has the same definition as described above. For example, if the code used in the method of the present invention is a two-dimensional code (so-called QR code®) and the information is information about the direction of travel, such as "turn right or left", then step (I)-2 can be performed by a CPU or the like that converts the "turn right" information into a predetermined two-dimensional code in the system of the present invention.
[0047] (I)-3 is the process of converting the code into signals corresponding to the first and second regions. The above-mentioned A(3) signal conversion unit enables the (I)-3 step. That is, the code converted in step A(I)-2 is converted into signals corresponding to the first and second regions. For example, if the code used in the method of the present invention is a two-dimensional code (so-called QR code®) and the display in (I)-4 described later is performed on a liquid crystal screen, the (I)-3 step can be performed by a CPU or the like that assigns "0" as "black" to the first region and "1" as "white" to the second region for processing.
[0048] Step (I)-4 is a step in which the signals obtained in step (I)-3 above are displayed as the first and second regions. The above-described A(4) display unit enables the (I)-4 process. That is, the signal is displayed as a first and second region, which are at least two regions that can be distinguished by light in the near-infrared region. For example, as described above, the (I)-4 process can be performed using a liquid crystal display element; a dimming element using a liquid crystal method, electrochromic method, SPD method, and gaschromic method, etc.
[0049] Step (I) of the method of the present invention may further include steps other than those described above (I)-1 to (I)-4. For example, step (I) of the method of the present invention may include a step of enhancing the markings as first and second areas. For example, this step can be carried out by providing a retroreflective plate.
[0050] <<(II) Process>> The above (II) process is, (II)-1 A step of receiving the first and second regions as near-infrared light; (II)-2 A step of re-converting the code from light in the near-infrared region corresponding to the first and second regions; (II)-3 A step of re-converting the information from the code; (II)-4 Step of outputting the above information; It is good to have it.
[0051] (II)-1 is a step in which the first and second regions are received as light in the near-infrared region. The receiving unit B(1) described above can perform step (II)-1. This is the step of receiving the first and second regions displayed in step (I)-4 above as light in the near-infrared region. For example, step (II)-1 can be performed using a photodetector made of a semiconductor such as silicon or indium gallium arsenide.
[0052] (II)-2 is a step of re-converting the code from light in the near-infrared region corresponding to the first and second regions. The re-conversion unit B(2) described above can perform step (II)-2. That is, it re-converts the light corresponding to the first and second regions received in step (II)-1 into a code. For example, step (II)-2 can be performed by a CPU that performs a process of re-converting the "black" corresponding to the first region into "0" and the "white" corresponding to the second region into "1" into a code.
[0053] (II)-3 is a step of re-converting the information from the code. The above-mentioned B(3) information re-conversion unit enables the (II)-3 step. That is, it re-converts the code obtained in the (II)-2 step into information. The (II)-3 step can be performed by a CPU or the like that performs a process of assigning predetermined "information," such as "turn right," from the code (e.g., a two-dimensional code) obtained in the (II)-2 step to the system of the present invention.
[0054] (II)-4 is the process of outputting the aforementioned information. The information output unit B(4) described above can perform step (II)-4. Step (II)-4 outputs the information obtained in step (II)-3 above. Depending on the target of the output, for example, in the operation of an autonomous vehicle, if the information to be output is information about the direction of travel, such as "turn right or left", then step (II)-4 can be performed by a CPU or the like that processes the information in a way that makes the operation of the vehicle safer. Specifically, if the information is "turn right", then step (II)-4 can further process the expected deceleration of the preceding vehicle A, the change in the direction of travel of the own vehicle in response to the change in the direction of travel of the preceding vehicle A, etc. Also, for example, in the case of a vehicle operated by a driver, there are steps such as outputting the "turn right or left" of the preceding vehicle A as an audio announcement and / or projecting it as an image.
[0055] Step (II) of the method of the present invention may include steps other than those described above (II)-1 to (II)-4. For example, step (II) of the method of the present invention preferably includes a step of irradiating a display device with near-infrared light from a near-infrared light source. Furthermore, the irradiated light is preferably reflected by the display unit, and the reflected light is preferably received in step (II)-1.
[0056] The system of the present invention can be applied to various technologies, including autonomous driving technology. While examples will be provided below, the applications of the system of the present invention are not limited to these. For example, by installing a display device of the present invention on the windshield or nearby, or on the rear window or nearby, of each automobile, and by installing a recognition device in each automobile, information communication between vehicles can be performed. The following explanation will be given using Figure 1, which is a chart illustrating the information transmission system of the present invention. Specifically, the display device 11 of the system 1 of the present invention displays various information about "Vehicle A," such as the direction of travel of "Vehicle A," including information about its direction of travel, such as "turning left," and vehicle speed information, such as "stopped" or, if the vehicle is in motion, its "speed," via the A(1) information input unit 111; A(2) code conversion unit 112; A(3) signal conversion unit 113; and A(4) display unit 114. Meanwhile, the recognition device 12 in "Vehicle B" recognizes the various information emitted by "Vehicle A" via the B(1) receiving unit 121; B(2) reconversion unit 122; B(3) information reconversion unit 123; and B(4) information output unit 124. This enables the transmission of information between vehicles, providing safer operation. In the above, examples of information displayed by "Vehicle A" include information about the direction of travel, such as "turn left," and vehicle speed information, such as "stopped" or, if the vehicle is in motion, its "speed." However, the information is not limited to these examples and may also include information emitted from other display devices, such as information obtained from other vehicles or traffic control information, as will be described later.
[0057] More specifically, it will be explained below that when the preceding "car A" turns left, the display device 11 of the system 1 of the present invention displays that information, and the following "car B" can recognize the information of the preceding "car A" turning left using the recognition device 12 of the system 1 of the present invention. For the sake of explanation, it will be assumed that the A(4) display unit 114 displays a two-dimensional code that is displayed in the near-infrared region. If the preceding "vehicle A" is making a left turn, in the case of autonomous driving, the unit controlling the operation inputs the "left turn information" to the A(1) information input unit 111. In the case of operation by a driver rather than autonomous driving, the "left turn information" is input to the A(1) information input unit 111 from the turn signal switching information.
[0058] The left-turn information is converted into a code in the A(2) code conversion unit 112. The coding of "turn left" and the decoding of "turn left" from the code are predetermined in this system. The code, which represents "turn left," is converted into a signal in the A(3) signal conversion unit 113, and then displayed in the A(4) display unit 114 according to the signal. The conversion from code to signal and the re-conversion from signal to code are predetermined in this system. A(4) In the display unit 114, "left turn information" is displayed using a two-dimensional code that can be identified in the near-infrared region.
[0059] The recognition device 12 mounted on the following "vehicle B" receives a two-dimensional code that is discriminable in the near-infrared region, displayed on the A(4) display unit 114 of "vehicle A," at the B(1) receiving unit 121. It is preferable that "vehicle B" also emits light in the near-infrared region, and the two-dimensional code can be discriminated in the near-infrared region by the light reflected by the A(4) display unit 114 of "vehicle A." The two-dimensional code obtained by the receiving unit 121 (B(1)) is decoded into the information "turn left" by the re-conversion unit 122 (B(2)). As mentioned above, the coding of "turn left" and the decoding of "turn left" from the code are predetermined in this system. The decoded information is re-converted into information used in this system by the B(3) Information Re-conversion Unit 123 and passed to the B(4) Information Output Unit 124. When the vehicle is operated by a driver, the B(4) Information Output Unit 124 can alert the driver to the "left turn" information through voice and / or images. In the case of autonomous driving, the "left turn information" can be used to predict subsequent information such as the deceleration information and the direction of travel information of "Vehicle A," which can be used to ensure safe autonomous driving.
[0060] The information transmission of the present invention system will be further explained below. However, in the following explanation, the "display" and "recognition" of the "information" used in the present invention system will be mainly described, and the explanations of A(1) Information Input Unit to A(4) Display Unit and B(1) Receiving Unit to B(4) Information Output Unit will be omitted.
[0061] In the case of various traffic signs, in addition to the sign (or in place of the sign, depending on the situation in which the vehicle can be operated solely by autonomous driving), a display device of the system of the present invention is provided, and the information indicated by the sign is displayed on the display device, while a recognition device is provided in the vehicle, the vehicle does not need to recognize the traffic sign as an image, and the recognition device of the system of the present invention can recognize the sign from the code displayed on the display device, thereby providing more accurate autonomous driving. In the case of vehicle operation by a driver, the B(4) information output unit of the recognition device can be said to be voice guidance and / or display on a screen. Furthermore, in cases where it is necessary to change the speed, including speed limits, such as on highways, the display device of the present invention can change and display information such as speed limits. The recognition device of this system can then accurately recognize the information displayed on the display device, thereby making autonomous driving safer.
[0062] Furthermore, in the case of traffic signs, if there are multiple signs, the display device of the present invention can rapidly switch and display multiple codes corresponding to the multiple signs and transmit them. The recognition device of the present invention can recognize the rapidly switched multiple codes at high speed using recognition techniques conventionally known in LiDAR technology, thereby making autonomous driving safer. In the case of a driver operating a vehicle, the system of the present invention can recognize multiple signs, and by recognizing traffic signs without the driver moving their viewpoint, the safety of driver-operated vehicle operation can be enhanced.
[0063] Furthermore, even when only a single traffic sign is present, the display device of the present invention can rapidly switch between transmitting a code indicating the single sign and a blank state, enabling highly accurate recognition even with a single code (single sign), thereby making the operation of vehicles, such as autonomous driving, safer. In addition, by mounting cameras other than the system of the present invention on the vehicle, traffic signs can be recognized by both the system of the present invention and the camera's sign recognition, further enhancing the safety of vehicle operations, such as autonomous driving. Note that rapidly switching between transmitting a code indicating a single sign and a blank state is included in the "dynamic information" described above.
[0064] By installing the display device of the present invention in place of or together with a convex mirror, and having the display device provide information about objects in blind spots that cannot be recognized by the convex mirror in the form of a code, and by having a vehicle equipped with the recognition device of the system of the present invention recognize this blind spot object information in the form of a code, the operation of the vehicle, such as autonomous driving, can be made safer.
[0065] In this case, the display device of the present invention, which is installed in place of or together with a convex mirror, preferably has a sensor that recognizes objects in the blind spot (e.g., pedestrians, animals, etc., which are not equipped with the display device of the system of the present invention), and / or a recognition device of the system of the present invention. The display device of the present invention can provide information on objects in the blind spot, such as those recognized by the sensor and automobiles recognized by the recognition device of the system of the present invention, thereby making the operation of automobiles, such as autonomous driving, safer, as described above. Note that the information on objects in the blind spot is included in the "dynamic information" described above.
[0066] By installing the display device of the present invention together with a traffic light, having the display device provide signal switching information as a code, and having a vehicle equipped with the recognition device of the system of the present invention recognize this code, smoother vehicle operation can be achieved. For example, a few seconds before a signal switches from green to yellow, from yellow to red, or from red to green, the display device of the present invention displays the number of seconds as a code, and a vehicle equipped with the recognition device of the system of the present invention receives and recognizes this code, thereby achieving smoother vehicle operation. The signal switching information is included in the "dynamic information" described above.
[0067] Furthermore, by providing a roadside unit equipped with the display device and recognition device of the present invention, the recognition device of the roadside unit can recognize the traffic volume from the display device of the present invention installed in the vehicle and change the signal switching of the traffic signals, thereby enabling smoother vehicle operation. Furthermore, by having an emergency vehicle equipped with the display device of the present invention code and display that it is an emergency, and by having a recognition device installed on the roadside recognize the code and change the signal switching of the traffic light, it is possible to realize smoother operation of the emergency vehicle. Furthermore, in addition to recognizing the approach of an emergency vehicle by the roadside recognition device as described above, the system of the present invention also recognizes the approach of an emergency vehicle and codes and displays this information on a display device of the present invention installed in the vehicle. This allows following vehicles to recognize the code and reduce their speed and / or change lanes to the roadside, thereby enabling smoother operation of emergency vehicles.
[0068] The system of the present invention allows for the operation of automobiles, particularly autonomous driving, in a so-called "offline" manner. However, by sharing this with an "online" system, safety can be enhanced, and even if problems such as hacking occur in the "online" environment, the risk to safety can be mitigated.
[0069] In addition to the operation of the vehicles described above, applications to traffic systems are also conceivable. Instead of an automatic vehicle license plate recognition system, the so-called N-system, a system having the recognition device and display device of the present invention can be used. Specifically, a display device is provided for each vehicle, and the display device displays the vehicle's ID (e.g., vehicle license plate), the date and time of display, and the location (position coordinates). Meanwhile, the recognition device of the present invention recognizes this display and, based on the information obtained, can achieve effects such as identifying speeding vehicles, early detection of witness vehicles at accident scenes, tracking and identifying criminals, and deterring violations and illegal activities. In this case, if the information to be displayed cannot be shown all at once, it can be displayed using multiple codes. For example, the vehicle ID can be displayed using the first code, the display date and time using the second code, and the location coordinates using the third code, and by rapidly switching between these first to third codes, a large amount of information can be displayed. Furthermore, as described above, the recognition device of the system of the present invention can recognize multiple codes that are switched at high speed, and therefore can achieve the above effects.
[0070] Although the system of the present invention has been described as being used in the operation of automobiles, the system of the present invention is not limited to the operation of automobiles. For example, as mentioned above, it can be used in the security system of a safe. Furthermore, by using the display device of the present invention as a tag, and equipping a smartphone or other device with the recognition device of the present invention, the tag and smartphone can be used in security systems other than safes, such as anti-theft tags for bags, bicycle keys, and so on. Furthermore, the display device of the present invention can display advertisements, and the recognition device of the present invention can recognize these advertisements. For example, by displaying an advertisement for a restaurant on the side of a road using the display device of the system of the present invention, and having a vehicle equipped with the recognition device of the system of the present invention recognize the advertisement, the menu offered by the restaurant can be displayed along with the advertisement.
[0071] The following will provide a detailed description of the system of the present invention, particularly the display device of the system of the present invention, and more particularly the liquid crystal display element used in the display section of the display device of the system of the present invention, as reference examples. However, the present invention is not limited to these reference examples.
[0072] (Reference example) [Fabrication of liquid crystal display elements] <Reference example 1> <<Fabrication of liquid crystal composition (1)>> IBXA (manufactured by Osaka Organic Chemical Industry Co., Ltd.) (3.0g), 2-hydroxyethyl methacrylate (manufactured by Tokyo Chemical Industry Co., Ltd.) (0.4g), KAYARADFM-400 (manufactured by Nippon Kayaku Co., Ltd.) (3.0g), KAYARADHX220 (manufactured by Nippon Kayaku Co., Ltd.) (3.0g), and Karenz MTPE1 (manufactured by Showa Denko Corporation) (0.6g) were mixed and stirred at 60°C for 2 hours to prepare a polymerizable compound solution. Subsequently, the prepared polymerizable compound solution, MLC-3018 (manufactured by Merck & Co.) (9.5g), and Omnirad184 (manufactured by IGM Resins) (0.5g) were mixed and stirred at 25°C for 6 hours to obtain liquid crystal composition (1).
[0073] <<Preparation of Normal Type PDLC Film>> Two 150 x 150 mm PET substrates with ITO electrodes (length: 150 mm, width: 150 mm, thickness: 0.1 mm) were prepared and washed with pure water. A 20 μm spacer was applied to the ITO surface of one of the substrates. Then, the liquid crystal composition (1) was dropped onto the ITO surface of the substrate with the spacer applied using the ODF method. Next, the two substrates were bonded together so that their ITO surfaces faced each other, to obtain a PDLC film before processing. When dropping the liquid crystal composition and bonding using the ODF method, a glass substrate was used as a support substrate for the PET substrates with ITO electrodes. The support substrate was then removed before irradiation with ultraviolet light. This PDLC film before processing was subjected to an illuminance of 20 mW / cm². 2 Using a metal halide lamp, wavelengths below 350 nm were filtered out, and ultraviolet irradiation was performed for 60 seconds. This resulted in obtaining a normal type PDLC film.
[0074] <Reference example 2> <<Preparation of liquid crystal composition (2)>> IBXA (manufactured by Osaka Organic Chemical Industry Co., Ltd.) (2.4g), KAYARADFM-400 (manufactured by Nippon Kayaku Co., Ltd.) (1.2g), KAYARADHX220 (manufactured by Nippon Kayaku Co., Ltd.) (2.4g), KAYARADHX620 (manufactured by Nippon Kayaku Co., Ltd.) (2.4g), NK ester ATM-35E (manufactured by Shin Nakamura Chemical Industry Co., Ltd.) (0.6g), Karenz MTBD1 (manufactured by Showa Denko Corporation) (0.4g), and Karenz MTPE1 (manufactured by Showa Denko Corporation) (0.60g) were mixed and stirred at 60°C for 2 hours to prepare a polymerizable compound solution. Subsequently, the prepared polymerizable compound solution, Sb-323030 (manufactured by Champagne Co., Ltd.) (8.50g), and Omnirad184 (manufactured by IGM Resins Co., Ltd.) (0.10g) were mixed and stirred at 25°C for 6 hours to obtain liquid crystal composition (2).
[0075] <<Fabrication of reverse-type PDLC film>> A liquid crystal alignment agent for vertical mode (SE-H682) was pressure filtered through a membrane filter with a pore size of 1 μm. The obtained solution was coated onto the ITO surface of a 150 × 150 mm PET substrate with ITO electrodes (length: 150 mm, width: 150 mm, thickness: 0.2 mm), which had been washed with pure water, using a bar coater. The substrate was then heated in a heat-circulating clean oven at 120°C for 2 minutes to obtain a substrate with a liquid crystal alignment film thickness of 100 nm. Two substrates with the obtained liquid crystal alignment films were prepared, and an 8 μm spacer was applied to the liquid crystal alignment film surface of one of the substrates. Subsequently, the liquid crystal composition (2) was dropped onto the liquid crystal alignment film surface of the substrate with the spacer applied using the ODF method, and then the two substrates were bonded together so that their liquid crystal alignment film interfaces faced each other to obtain a PDLC film before processing. This PDLC film before processing was subjected to an illuminance of 20 mW / cm². 2 Using a metal halide lamp, wavelengths below 350 nm were filtered out, and ultraviolet irradiation was performed for 60 seconds. This resulted in obtaining a reverse-type PDLC film.
[0076] <Reference example 3> First, a substrate with electrodes was prepared. The substrate was an alkali-free glass substrate measuring 30 mm x 35 mm and 0.7 mm thick. ITO (Indium-Tin-Oxide) electrodes were formed on the substrate, with an electrode width of 3 μm, a spacing of 6 μm between electrodes, and a comb-shaped pattern at a 10° angle to the long side of the substrate, forming the first and second pixels. Each pixel measures approximately 5 mm vertically and 5 mm horizontally. Hereafter, this will be referred to as the IPS substrate (first substrate). Next, SE-6414 (manufactured by Nissan Chemical Corporation), a liquid crystal alignment agent for horizontal alignment, was filtered through a pore size filter of 1.0 μm. Then, the SE-6414 was applied and deposited by spin coating to the prepared first substrate and to a counter substrate, a back-side ITO substrate (hereinafter referred to as the second substrate), which had an ITO film deposited on its back surface and columnar spacers with a height of 3.0 μm.
[0077] Next, the film was dried on a hot plate at 80°C for 80 minutes, then baked at 230°C for 20 minutes to obtain a coating with a thickness of 100 nm. The polyimide film on the first substrate was oriented in the direction of the comb teeth, while the polyimide film on the second substrate was oriented in the direction perpendicular to the comb electrode. The orientation was performed using the rubbing method with a rubbing device manufactured by Iinuma Gauge Co., Ltd., rubbing cloth (YA-20R) manufactured by Yoshikawa Kako Co., Ltd., a rubbing roller (diameter 10.0 cm), a stage feed speed of 20 mm / s, a roller rotation speed of 1000 rpm, and a pressing pressure of 0.4 mm. Subsequently, the two types of substrates described above were combined so that their orientation directions were parallel, and the surrounding area was sealed, leaving a liquid crystal injection port, to create an empty cell with a cell gap of approximately 3.3 μm. MLC-3019 (manufactured by Merck) was vacuum injected into this empty cell at room temperature, and then the injection port was sealed to create an antiparallel oriented liquid crystal cell. The resulting liquid crystal cell constitutes an IPS mode liquid crystal display element. After that, the obtained liquid crystal cell was heat-treated at 120°C for 10 minutes. This resulted in obtaining a positive liquid crystal IPS cell.
[0078] <Reference example 4> First, a substrate with electrodes was prepared. The substrate was an alkali-free glass substrate measuring 30 mm x 35 mm and 0.7 mm thick. ITO (Indium-Tin-Oxide) electrodes were formed on the substrate, with an electrode width of 3 μm, a spacing of 6 μm between electrodes, and a comb-shaped pattern at a 10° angle to the long side of the substrate, forming the first and second pixels. Each pixel measures approximately 5 mm vertically and 5 mm horizontally. Hereafter, this will be referred to as the IPS substrate (first substrate). Next, SE-6414 (manufactured by Nissan Chemical Corporation), a liquid crystal alignment agent for horizontal alignment, was filtered through a pore size filter of 1.0 μm. Then, the SE-6414 was applied and deposited by spin coating to the prepared first substrate and to a counter substrate, a back-side ITO substrate (hereinafter referred to as the second substrate), which had an ITO film deposited on its back surface and columnar spacers with a height of 3.0 μm.
[0079] Next, the film was dried on a hot plate at 80°C for 80 minutes, then baked at 230°C for 20 minutes to obtain a coating with a thickness of 100 nm. The polyimide film on the first substrate was oriented in a direction perpendicular to the comb-tooth electrode, while the polyimide film on the second substrate was oriented in the direction of the comb-tooth electrode. The orientation was performed using the rubbing method with a rubbing device manufactured by Iinuma Gauge Co., Ltd., rubbing cloth (YA-20R) manufactured by Yoshikawa Kako Co., Ltd., a rubbing roller (diameter 10.0 cm), a stage feed speed of 20 mm / s, a roller rotation speed of 1000 rpm, and a pressing pressure of 0.4 mm. Subsequently, the two types of substrates described above were combined so that their orientation directions were parallel, and the surrounding area was sealed, leaving a liquid crystal injection port, to create an empty cell with a cell gap of approximately 3.3 μm. MLC-7026-100 (manufactured by Merck) was vacuum injected into this empty cell at room temperature, and then the injection port was sealed to create an antiparallel oriented liquid crystal cell. The resulting liquid crystal cell constitutes an IPS mode liquid crystal display element. After that, the obtained liquid crystal cell was heat-treated at 120°C for 10 minutes. This resulted in obtaining a negative liquid crystal IPS cell.
[0080] [Evaluation of transmittance differences in liquid crystal display elements] The transmittance was evaluated using a UV-3600 ultraviolet-visible-near-infrared spectrophotometer (Shimadzu Corporation). Specifically, the transmittance of each liquid crystal display element obtained in Examples 1 to 4 was measured using air as a reference. The evaluation was performed by comparing the absolute value of the difference between the transmittance with and without AC voltage applied. The results are shown in Table 1.
[0081] Table 1 shows the following: Whether using a wavelength of 905 nm or 1550 nm, the liquid crystal display elements of Reference Examples 1 to 4 exhibit a difference between the transmittance when an AC voltage is applied and when no voltage is applied. Therefore, Reference Examples 1 to 4 can display at least two regions, the first and second regions, which can be distinguished by near-infrared light, due to this difference in transmittance.
[0082] [Table 1]
Claims
1. A display device that displays a first and second region, which are at least two regions that can be distinguished by light in the near-infrared region; and A recognition device that recognizes at least two regions, a first and a second region, based on light in the near-infrared region; An information transmission system having, The display device includes: an information input unit for inputting information; a code conversion unit for converting the information input in the information input unit into a code; a signal conversion unit for converting the code converted by the code conversion unit into signals corresponding to the first and second regions; and a display unit for displaying the signals as the first and second regions. The recognition device includes: a receiving unit that receives the first and second regions displayed on the display device as near-infrared light; a reconversion unit that reconverts the light corresponding to the first and second regions received by the receiving unit into the code; and an information reconversion unit that reconverts the code into the information; and an information output unit that outputs the information obtained by the information reconversion unit. The information transmission system comprising a recognition device having a light source in the near-infrared region, and a receiving unit receiving reflected near-infrared light from the display device.
2. The information transmission system according to claim 1, wherein the display device comprises a retroreflective plate.
3. The information transmission system according to claim 1 or 2, wherein the near-infrared region is in the region of 700 to 2500 nm.
4. The information transmission system according to any one of claims 1 to 3, wherein the first region and the second region are distinguished by the difference in transmittance.