Information processing method

Abstract

To reduce the possibility that drivers feel uncomfortable about displayed contents.SOLUTION: In an information processing method by an information processing device including a control unit, a communication unit, and a storage unit, the information processing device is capable of communicating with a vehicle 2. The information processing method includes setting a longitudinal direction of an arrow projected onto a road to be longer, the longer a distance between the vehicle 2 and a right / left turning point of the vehicle 2 is, and projecting the arrow more faintly, the longer the distance is.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing method. [Background technology]

[0002] Conventionally, when it is estimated that a change in road type will occur midway along the vehicle's driving route, a technology is known in which a close driving route image showing the driving lane closer to the vehicle than the boundary position of the road type and a distant driving route image are superimposed on the foreground seen by the driver of the vehicle (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-187068 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned background art, depending on the right / left turn point and the position of the vehicle, the driver may feel uncomfortable with the displayed content.

[0005] The purpose of the present disclosure, made in consideration of such circumstances, is to reduce the possibility that the driver will feel uncomfortable with the displayed content. [Means for solving the problem]

[0006] An information processing method according to an embodiment of the present disclosure includes: An information processing method by an information processing device including a control unit, a communication unit, and a storage unit, The information processing device is capable of communicating with a vehicle, A vertical direction of the arrow projected onto the road is set to be longer as the distance between the vehicle and a right / left turning point of the vehicle is longer; projecting the arrow lighter as the distance increases; Includes. Effect of the Invention

[0007] According to an embodiment of the present disclosure, it is possible to reduce the possibility that the driver will feel uncomfortable with the displayed content. [Brief description of the drawings]

[0008] [Figure 1] FIG. 13 is a diagram showing a projected arrow. [Diagram 2] FIG. 13 is a diagram illustrating the determination of two-dimensional coordinates. [Diagram 3] 11A and 11B are diagrams showing arrows drawn by the information processing method of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The information processing system of this embodiment includes an information processing device 1 and a vehicle 2 that can communicate with each other via a network NW. The network NW includes, for example, a mobile communication network, the Internet, or a fixed communication network. The process executed by the information processing device 1 may be executed by multiple information processing devices 1 that are distributed.

[0010] The information processing device 1 may be a server that supports the provision of services by a business operator. The information processing device 1 may be installed, for example, in a facility dedicated to the business operator or in a shared facility including a data center.

[0011] The information processing device 1 includes a control unit 11, a communication unit 12, and a storage unit 13. The components of the information processing device 1 are connected to each other so as to be able to communicate with each other.

[0012] The control unit 11 includes, for example, one or more general-purpose processors including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit 11 may include one or more dedicated processors specialized for specific processing. Instead of including a processor, the control unit 11 may include one or more dedicated circuits. The dedicated circuits may be, for example, a FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 11 may include an ECU (Electronic Control Unit). The control unit 11 transmits and receives any information via the communication unit 12.

[0013] The communication unit 12 includes a communication module compatible with one or more wired or wireless LAN (Local Area Network) standards for connecting to a network. The communication unit 12 may include a module compatible with one or more mobile communication standards including LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation). The communication unit 12 may include a communication module compatible with one or more short-range communication standards or specifications including Bluetooth (registered trademark), AirDrop (registered trademark), IrDA, ZigBee (registered trademark), Felica (registered trademark), or RFID. The communication unit 12 transmits and receives any information via the network.

[0014] The memory unit 13 includes, but is not limited to, for example, a semiconductor memory, a magnetic memory, an optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The memory unit 13 may function as, for example, a main memory device, an auxiliary memory device, or a cache memory. The memory unit 13 may store information resulting from analysis or processing by the control unit 11. The memory unit 13 may store various information related to the operation or control of the information processing device 1, etc. The memory unit 13 may store system programs, application programs, embedded software, etc. The memory unit 13 may be provided outside the information processing device 1 and accessed by the information processing device 1.

[0015] The vehicle 2 includes a display unit 21, an on-board camera 22, and a navigation system 23. The components of the vehicle 2 are connected to each other so as to be able to communicate with each other.

[0016] The display unit 21 and the in-vehicle camera 22 transmit position setting information to synchronize the three-dimensional position coordinates. The in-vehicle camera 22 and the navigation system 23 transmit and receive information on the three-dimensional position coordinates and the vehicle position to each other. The navigation system 23 transmits the information on the three-dimensional position coordinates and the vehicle position to the information processing device 1. The navigation system 23 may transmit information on the position and direction of right and left turns to the information processing device 1. The information processing device 1 transmits information on the arrow three-dimensional position coordinates to the navigation system 23.

[0017] As shown in Fig. 1, a vehicle 2 travels in a direction AR. An arrow Y indicating right / left turns and the direction of travel is projected onto the road as route guidance by the front display of the vehicle 2. This eliminates the need for the driver to look at the navigation screen. An information processing method for projecting the arrow Y will now be described in detail.

[0018] [Process 1. Determining 2D coordinates on the road] The control unit 11 of the information processing device 1 determines the two-dimensional coordinate values ​​on the road of each of the nine points (i.e., points A to I) required to draw the arrow Y from the two-dimensional coordinate values ​​on the road of the corner. The position of the vehicle-mounted camera 22 differs depending on the vehicle. Therefore, the control unit 11 may calibrate the actual position on the vehicle-mounted camera 22 from the three-dimensional coordinates photographed by the vehicle-mounted camera 22 and map data.

[0019] [Process 2. 3D position coordinate synchronization setting] The control unit 11 converts the two-dimensional floor coordinate values ​​into three-dimensional floor coordinate values. Premise a) The 3D floor data captured in advance has the floor surface in the upper left corner of the map as the origin (0,0,0). Premise b) The actual number of meters for one pixel on the map is calculated in advance from the 3D map data (hereafter, 1px = N(m)).

[0020] As a conversion process, the control unit 11 multiplies the three-dimensional map coordinate value by N(m) to obtain the (x, y) coordinate value on the three-dimensional map. At this time, since points A and B are points on the road surface, their z coordinates are set to 0.

[0021] If the map 2D coordinate value of point A is (x2DA, y2DA), the floor 3D coordinate value of point A is (x2DA×N, y2DA×N, 0).

[0022] If the two-dimensional floor coordinate value of point B is (x2DB, y2DB), the three-dimensional floor coordinate value of point B is (x2DB×N, y2DB×N, 0).

[0023] At this time, the distances in pixels between the display unit 21, the vehicle-mounted camera 22, and the map may be adjusted.

[0024] [Process 3. Convert map 3D coordinates to in-vehicle camera 3D coordinates] The control unit 11 converts the map three-dimensional coordinate values ​​into the current three-dimensional coordinates of the vehicle-mounted camera 22. Premise a) The position information of the vehicle (the vehicle-mounted camera 22) is constantly updated. Premise b) Information regarding the current direction in which the vehicle-mounted camera 22 is facing is also constantly updated from the vehicle 2.

[0025] As the conversion process, the control unit 11 executes the following process. Step 1. Subtract the map 3D coordinate value of the right / left turn point from the map 3D coordinate value to convert it into 3D coordinates with the right / left turn point as the origin. Step 2. Subtract the distance traveled to the current location from the coordinate value converted in step 1 to convert it into a three-dimensional coordinate value with the current location as the origin. Step 3. For the coordinate values ​​converted in step 2, convert the coordinates so that the current direction is the positive direction of the y-axis. Step 4: The three-dimensional coordinate values ​​converted in step 3 are set as the three-dimensional coordinate values ​​of the vehicle-mounted camera 22.

[0026] [Process 4: Conversion from 3D coordinates of the vehicle-mounted camera 22 to 2D coordinates of the vehicle-mounted camera 22] The control unit 11 captures an image of a space using the vehicle-mounted camera 22 and converts the image into two-dimensional information. The distance between the vehicle-mounted camera 22 and the camera plane (i.e., the focal length) can be set arbitrarily depending on the device.

[0027] As shown in FIG. 2, the control unit 11 determines the two-dimensional coordinate values ​​of the points A and B of the vehicle-mounted camera 22 as follows. (1) About the two-dimensional x coordinate As shown in A of Figure 2, on the floor surface RS when looking at the road from above, points A and B are in the same horizontal position but different vertical positions. Looking at the intersections of the camera plane CH with points A and B, point B is to the right of point A on the screen. (2) About the two-dimensional y coordinate As shown in Fig. 2B, when the road is viewed from the side, points A and B on the floor surface RS are in the same vertical position but different horizontal positions. Looking at the intersections of the camera plane CH with points A and B, point B is above point A on the screen.

[0028] As a result, the positional relationship between point A and point B on the screen is such that point B is set to the upper right of point A as shown in Fig. 3. The control unit 11 determines the two-dimensional coordinate values ​​of the nine points by the above processes 1 to 4. The control unit 11 draws an arrow Y using the determined coordinate values. As shown in Fig. 3, the arrow Y has a fan-shaped shape. The arrow Y may be updated periodically.

[0029] As described above, the control unit 11 sets the arrow Y to have a fan-shaped shape depending on the distance from the vehicle 2 to the right / left turn position. The control unit 11 determines the position to project the arrow Y from the right / left turn position on the map. When the vehicle 2 reaches the determined position, the control unit 11 transmits the drawn arrow Y to the vehicle 2. The vehicle 2 projects the arrow Y onto the road.

[0030] Additionally or alternatively, the control unit 11 may simultaneously perform the following techniques to make the arrow Y more visible. (Method 1) The vertical direction of the arrow Y is set to be longer in accordance with the distance between the right / left turning point of the vehicle 2 and the vehicle 2, thereby improving visibility. The longer the distance, the longer the vertical direction of arrow Y should be set (i.e., making arrow Y longer in the vertical direction) to make it easier for the driver to notice the right / left turn point. If the distance is short, set the vertical direction of arrow Y to be short. (Method 2) The transparency is changed depending on the distance between the right / left turning point of vehicle 2 and vehicle 2. For example, the longer the distance, the lighter the arrow Y will be projected. -Improve visibility so that drivers can judge the distance to the next right or left turn. If things are far away but are the same color, it's hard to judge the distance. (Method 3) The color of the arrow Y is changed according to the brightness of the surroundings. - Visibility differs depending on the color in bright and dark places. In bright places, it will appear blue, and in dark places, it will appear yellow. The brightness information may be acquired by the vehicle-mounted camera 22.

[0031] As described above, according to this embodiment, the information processing device 1 executes operations including setting the vertical direction of the arrow Y projected onto the road to be longer as the distance between the vehicle 2 and the right / left turn point of the vehicle 2 becomes longer, and projecting the arrow Y more faintly as the distance becomes longer. With this configuration, the information processing device 1 sets the arrow Y to a shape that spreads out toward the end depending on the distance to the right / left turn point, so that the arrow Y can be made to look closer to how it would look if it were actually drawn on the road.

[0032] Although the present disclosure will be described based on various drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Other modifications are possible within the scope of the present disclosure. For example, the functions included in each means or step can be rearranged so as not to cause logical inconsistencies, and multiple means or steps can be combined into one or divided.

[0033] For example, in the above embodiment, a program for executing all or part of the functions or processes of the information processing device 1 can be recorded in a computer-readable recording medium. The computer-readable recording medium includes a non-transitory computer-readable medium, such as a magnetic recording device, an optical disk, a magneto-optical recording medium, or a semiconductor memory. The program is distributed by, for example, selling, transferring, or lending a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. The program may also be distributed by storing the program in the storage of an arbitrary server and transmitting the program from the arbitrary server to another computer. The program may also be provided as a program product. The present disclosure can also be realized as a program executable by a processor. [Explanation of symbols]

[0034] 1. Information processing device

Claims

[Claim 1] An information processing method by an information processing device including a control unit, a communication unit, and a storage unit, The information processing device is capable of communicating with a vehicle, A vertical direction of the arrow projected onto the road is set to be longer as the distance between the vehicle and a right / left turning point of the vehicle is longer; projecting the arrow lighter as the distance increases; An information processing method comprising:

Images