Information processing method, information processing device, program, and storage medium

The method adjusts audio output volumes based on the vehicle's proximity to turning points, addressing the lack of intuitive audio guidance in conventional systems, thereby improving user understanding of upcoming turns on two-wheeled vehicles.

WO2024247183A1PCT designated stage expired Publication Date: 2024-12-05HONDA MOTOR CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/020331
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional techniques for guiding vehicle users through turns do not effectively utilize audio output to intuitively convey the direction of upcoming turns, especially when using mobile terminals for calls or route guidance on two-wheeled vehicles.

Method used

An information processing method that communicates with an audio output device worn by the user, adjusting the left and right audio volumes based on the vehicle's proximity to a turning point on the route guidance, allowing the user to intuitively grasp the driving situation by biasing sound volumes accordingly.

Benefits of technology

Enables users to intuitively understand the approach to turning points during route guidance, enhancing safety and usability by clearly indicating the direction of turns through audio cues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023020331_05122024_PF_FP_ABST
    Figure JP2023020331_05122024_PF_FP_ABST
Patent Text Reader

Abstract

An information processing method according to the present disclosure includes, in an information processing device that communicates with a voice output device worn by a user, the steps of: acquiring a guidance route for a vehicle used by the user; and causing the voice output device to output voice via communication with the voice output device while the guidance route is being traveled by the vehicle. The step for outputting the voice includes biasing the right and left volumes of the voice according to the degree of proximity of the vehicle to a point where the vehicle makes a right or a left turn on the guidance route.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing method, information processing device, program, and storage medium

[0001] The present invention relates to an information processing method, an information processing device, a program, and a storage medium.

[0002] Conventionally, there are known techniques for informing a vehicle user of the direction of an obstacle by sound. Patent Literature 1 discloses a technique for outputting a warning sound via a speaker when an obstacle is approaching within a predetermined distance, with the sound image being localized in the direction in which the obstacle is detected.

[0003] Japanese Patent Application Laid-Open No. 2020-123143

[0004] However, there are cases where a person is riding a saddle-type vehicle (sometimes simply called a two-wheeled vehicle or a motorcycle) while using a call function or a route guidance function of a mobile terminal. The above-mentioned conventional technology does not take into consideration outputting audio related to route guidance to the occupant's headset, for example.

[0005] The present invention has been made in view of the above-mentioned problems, and its purpose is to realize a technology that allows a user to intuitively grasp the driving situation toward a point where a right or left turn is to be made during route guidance.

[0006] According to the present invention, there is provided an information processing method, comprising: in an information processing device that communicates with an audio output device worn by a user, acquiring a guide route for a vehicle used by the user; and outputting audio from the audio output device via communication with the audio output device while the vehicle is traveling along the guide route, wherein outputting the audio includes biasing the left and right volume of the audio depending on the degree of proximity of the vehicle to a point on the guide route where the vehicle makes a right or left turn.

[0007] According to the present invention, in route guidance, the user can intuitively grasp the driving situation toward a point where a right or left turn is to be made.

[0008] Other features and advantages of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings, in which the same or similar elements are designated by the same reference numerals.

[0009] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments of the present invention, and together with the description are used to explain the principles of the present invention.A side view of a saddle-ride type vehicle according to an embodiment of the present invention.A front view of the saddle-ride type vehicle of FIG. 1.A block diagram showing an example of the configuration of a saddle-ride type vehicle according to an embodiment.A diagram showing an overview of a route guidance system according to an embodiment.A block diagram showing an example of the hardware configuration of a terminal device according to an embodiment.A block diagram showing an example of the software configuration of a terminal device according to an embodiment.A block diagram showing an example of the configuration of an audio output device according to an embodiment.A diagram explaining audio output on a guided route according to an embodiment.A diagram explaining an example of audio output according to proximity according to an embodiment.A flowchart showing an example of route guidance processing according to an embodiment.A diagram explaining an example of audio output according to a driving lane according to an embodiment.A diagram explaining an example of audio output in which a sound source is present in a specific direction regardless of the orientation of the user's head (orientation of the audio output device) according to an embodiment.

[0010] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention as claimed, and not all combinations of features described in the embodiments are necessarily essential to the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Furthermore, the same reference numerals are used for the same or similar components, and redundant explanations will be omitted.

[0011] 1 and 2, arrows X, Y, and Z indicate directions that are perpendicular to one another, with the X direction indicating the front-to-rear direction of the saddle-riding type vehicle, the Y direction indicating the width direction (left-to-right direction) of the saddle-riding type vehicle, and the Z direction indicating the up-to-down direction. In the following description, the left and right of the saddle-riding type vehicle refer to the left and right when viewed from the forward direction. The front and rear of the front-to-rear direction of the saddle-riding type vehicle may also be simply referred to as the front and rear.

[0012] The information processing device according to this embodiment is used in a route guidance system that provides route guidance for a vehicle. In the following description, the information processing device will be described as an example of a terminal device, such as a smartphone, a tablet terminal, or a wearable terminal. However, the information processing device is not limited to this example, and may be incorporated into a vehicle or may be a device attached to a vehicle for use. As will be described later, in the example route guidance system, for example, the terminal device and an audio output device are connected via wireless communication, and the terminal device controls the output of audio guidance from the audio output device while the vehicle is traveling along a guided route. The audio output device may be, for example, a headset integrated with a helmet.

[0013] In the terminal device, audio from each application, such as a route guidance application, is output to an audio output device, and the terminal device can be operated by user input to the audio output device. For example, the terminal device can output to the audio output device output of various functions that can be implemented in the terminal device, such as weather information, navigation, calls, messages, or music playback. Furthermore, operations related to these various functions can be acquired via a microphone or buttons provided on the audio output device. This configuration allows the user to use the functions of the terminal device without interfering with driving operations while the vehicle is traveling.

[0014] <Example of External Configuration of Saddle-Riding Type Vehicle> An example of the external configuration of a vehicle according to this embodiment will be described. Fig. 1 is a right side view of a saddle-riding type vehicle 1 according to one embodiment of the present invention, and Fig. 2 is a front view of the saddle-riding type vehicle 1.

[0015] The saddle-ride type vehicle 1 is, for example, a touring motorcycle suitable for long-distance travel, but the present invention is applicable to various types of saddle-ride type vehicles including other types of motorcycles, and is also applicable to electric vehicles using a motor as a drive source in addition to vehicles using an internal combustion engine as a drive source. Hereinafter, the saddle-ride type vehicle 1 may be referred to as vehicle 1.

[0016] The vehicle 1 is provided with a power unit 2 between front wheels FW and rear wheels RW. In this embodiment, the power unit 2 includes a horizontally opposed six-cylinder engine 21 and a transmission 22. The driving force of the transmission 22 is transmitted to the rear wheels RW via a drive shaft (not shown), thereby rotating the rear wheels RW.

[0017] The power unit 2 is supported by a body frame 3. The body frame 3 includes a pair of left and right main frames 31 extending in the X direction. A fuel tank 5 and an air cleaner box (not shown) are disposed above the main frames 31. In front of the fuel tank 5, there is provided a meter panel MP equipped with an electronic image display device and the like that displays various information to the user, i.e., the rider.

[0018] A head pipe 32 is provided at the front end of the main frame 31, rotatably supporting a steering shaft (not shown) that is turned by the handlebars 8. A pair of left and right pivot plates 33 is provided at the rear end of the main frame 31. The lower ends of the pivot plates 33 are connected to the front end of the main frame 31 by a pair of left and right lower arms (not shown), and the power unit 2 is supported by the main frame 31 and the lower arms. A pair of left and right seat rails (not shown) extending rearward is also provided at the rear end of the main frame 31, and the seat rails support a seat 4a on which a rider sits, a seat 4b on which a passenger sits, a rear trunk 7b, etc.

[0019] The pivot plate 33 supports the front end of a rear swing arm (not shown), which extends in the fore-and-aft direction, so that it can swing freely. The rear swing arm is capable of swinging up and down, and supports the rear wheel RW at its rear end. An exhaust muffler 6 that silences exhaust from the engine 21 is provided on the sides of the lower part of the rear wheel RW, extending in the X direction. Left and right saddlebags 7a are provided on the sides of the upper part of the rear wheel RW.

[0020] A front suspension mechanism 9 that supports a front wheel FW is configured at the front end of the main frame 31. The front suspension mechanism 9 includes an upper link 91, a lower link 92, a fork support 93, a cushion unit 94, and a pair of left and right front forks 95.

[0021] The upper link 91 and the lower link 92 are disposed at a vertical interval at the front end of the main frame 31. The rear end portions of the upper link 91 and the lower link 92 are pivotally connected to supports provided at the front end portion of the main frame 31. The front end portions of the upper link 91 and the lower link 92 are pivotally connected to a fork support 93. The upper link 91 and the lower link 92 each extend in the fore-and-aft direction and are disposed substantially parallel to each other.

[0022] The cushion unit 94 has a structure in which a shock absorber is inserted into a coil spring, and its upper end is supported so as to be able to swing freely by the main frame 31. The lower end of the cushion unit 94 is supported so as to be able to swing freely by the lower link 92.

[0023] The fork support 93 is cylindrical and tilts rearward. The front end of an upper link 91 is rotatably connected to the front upper portion of the fork support 93. The front end of a lower link 92 is rotatably connected to the rear lower portion of the fork support 93.

[0024] A steering shaft 96 is supported by the fork support 93 so as to be rotatable about its axis. The steering shaft 96 has a shaft portion (not shown) that passes through the fork support 93. A bridge (not shown) is provided at the lower end of the steering shaft 96, and a pair of left and right front forks 95 are supported on this bridge. A front wheel FW is rotatably supported by the front forks 95. The upper end of the steering shaft 96 is connected via a link 97 to a steering shaft (not shown) that is rotated by the handlebars 8. The steering shaft 96 rotates when the handlebars 8 is steered, and the front wheel FW is steered.

[0025] The vehicle 1 is equipped with a brake device 19F that brakes the front wheels FW and a brake device 19R that brakes the rear wheels RW. The brake devices 19F, 19R are configured to be operable by the rider's operation of the brake lever 8a or the brake pedal 8b. The brake devices 19F, 19R are, for example, disc brakes. When there is no need to distinguish between the brake devices 19F, 19R, they will be collectively referred to as brake devices 19.

[0026] A headlight unit 11 that emits light ahead of the vehicle 1 is disposed at the front of the vehicle 1. The headlight unit 11 of this embodiment is a twin-lens type headlight unit that includes a right light emitting portion 11R and a left light emitting portion 11L that are symmetrical on the left and right. However, a single-lens type or triple-lens type headlight unit, or an asymmetric twin-lens type headlight unit may also be employed.

[0027] The front of the vehicle 1 is covered by a front cowl 12, and the front sides of the vehicle 1 are covered by a pair of left and right side cowls 14. A screen 13 is disposed above the front cowl 12. The screen 13 is a windshield that reduces wind pressure experienced by the rider while riding, and is formed, for example, from a transparent resin member.

[0028] A pair of left and right side mirror units 15 are disposed on the sides of the front cowl 12. The side mirror units 15 support side mirrors (not shown) that allow the rider to view the rear.

[0029] In this embodiment, the front cowl 12 is made up of cowl members 121 to 123. The cowl member 121 extends in the Y direction and constitutes the main body of the front cowl 12, and the cowl member 122 constitutes the upper portion of the cowl member 121. The cowl member 123 is disposed below and spaced apart from the cowl member 121.

[0030] An opening exposing the headlight unit 11 is formed between the cowl member 121 and the cowl member 123 and between the pair of left and right side cowls 14, with the upper edge of this opening being defined by the cowl member 121, the lower edge being defined by the cowl member 123, and the left and right side edges being defined by the side cowls 14.

[0031] An imaging unit 16A and a radar 16B are disposed behind the front cowl 12 as detection devices that detect the situation ahead of the vehicle 1. The radar 16B is, for example, a millimeter-wave radar. The imaging unit 16A includes an imaging element such as a CCD image sensor or a CMOS image sensor, and an optical system such as a lens, and captures an image of the area ahead of the vehicle 1. The imaging unit 16A is disposed behind a cowl member 122 that constitutes the upper part of the front cowl 12. An opening 122a is formed through the cowl member 122, and the imaging unit 16A captures an image of the area ahead of the vehicle 1 through the opening 122a.

[0032] The radar 16B is disposed behind the cowl member 121. The presence of the cowl member 121 makes the presence of the detection unit 16 less noticeable when viewed from the front of the vehicle 1, thereby preventing the deterioration of the appearance of the vehicle 1. The cowl member 121 is made of a material that is permeable to electromagnetic waves, such as resin.

[0033] The imaging unit 16A and the radar 16B are disposed in the center of the front cowl 12 in the Y direction when viewed from the front of the vehicle. By disposing the imaging unit 16A and the radar 16B in the center of the vehicle 1 in the Y direction, wider imaging and detection ranges can be obtained on the left and right sides of the front of the vehicle 1, making it possible to detect the situation ahead of the vehicle 1 more accurately. Furthermore, since the front of the vehicle 1 can be monitored equally on the left and right sides with one imaging unit 16A and one radar 16B, it is particularly advantageous to provide one imaging unit 16A and one radar 16B instead of multiple units.

[0034] <Example of functional configuration of saddle-ride type vehicle> Figure 3 is a block diagram of the control device 10 of the vehicle 1, and only the configuration necessary for the description that follows is shown. The vehicle 1 is equipped with a control unit (ECU) 10a. The control unit 10a includes a processor such as a CPU, a storage device such as a semiconductor memory, an input / output interface or a communication interface with an external device, etc. The storage device stores programs executed by the processor, data used by the processor for processing, etc. The control unit 10a may be equipped with multiple sets of processors, storage devices, interfaces, etc. corresponding to the respective functions of the vehicle 1.

[0035] The control unit 10a acquires the detection results of the imaging unit 16A and the radar 16B and constantly recognizes the objects and road conditions around the vehicle 1. The control unit 10a also acquires information from the GPS sensor 17, the communication device 18, and the map information database DB. The GPS sensor 17 detects location information indicating the current location of the vehicle 1. The communication device 18 acquires map information and traffic information through wireless communication with a server (not shown) that provides such information. The communication device 18 may be capable of wireless communication with a terminal device carried by a user of the vehicle 1. The communication device 18 may transmit at least one of various types of information to the terminal device, such as the detection results of the vehicle 1, map information, location information, speed information, and control information for linking with an application on the terminal device. The map information database DB can store highly accurate map information, and the control unit 10a can more accurately identify the shape of the road on which the vehicle 1 is traveling and the position of the vehicle 1 on the lane based on this map information, etc.

[0036] The control unit 10a can control the actuators of the power unit 2 and the brake 19. In this embodiment, the control unit 10a controls these when performing speed limit processing, which will be described later. The control unit 10a can also control the display of the meter panel MP. In this embodiment, various warning displays are displayed on the meter panel MP for the user, i.e., the rider. In this embodiment, the warning is issued by displaying an image on the meter panel MP, but it may also be issued by lighting or flashing a lamp, or by issuing an audio warning. The audio warning may be issued by controlling an audio output device provided in the user's helmet to output audio via wireless communication.

[0037] <Outline of Route Guidance System> Next, an outline of the route guidance system according to this embodiment will be described with reference to FIG. 4 . In the route guidance system 400, for example, a terminal device 410 is communicably connected to an audio output device 420 and a vehicle 430. The vehicle 430 may be the same as the vehicle 1 described above. The terminal device 410 is an information processing device capable of providing route guidance for the vehicle 430 used by the user, and is, as described above, an example of a smartphone, tablet device, or wearable device. The terminal device 410 transmits at least one of audio data and control information to the audio output device 420, causing the audio output device 420 to output audio. At this time, the terminal device 410 can control the output from the left and right speakers of the audio output device 420. The content of the audio output by the audio output device 420 is not particularly limited as long as it is audio that can be output from a general terminal device. For example, the audio may be audio notifying information from an application, such as a route guidance application, music being played, or a call voice received from a terminal device used by another user. The following description will be given on the assumption that the terminal device 410 according to this embodiment basically causes the audio output device 420 to output guidance voice from a route guidance application.

[0038] The audio output device 420 is a device worn by the user that outputs audio received from the terminal device 410. The audio output device 420 may be, for example, a headset integrated with a helmet or wireless earphones. The audio output device 420 is not particularly limited in form as long as it is wirelessly connected to the terminal device 410 and can output audio in different modes (different audio or different volume) on the left and right. The audio output device 420 according to this embodiment includes a communication unit that enables communication via Bluetooth (registered trademark) and is connected to the terminal device 410.

[0039] The terminal device 410 connects to the vehicle 430 and performs a process to start a route guidance application. In the vehicle 430, the control unit 10a transmits to the terminal device 410 a start signal for an application implemented in the terminal device 410. The communication device 18 of the vehicle 430 is a communication unit that enables wireless communication with the terminal device 410, for example, by Bluetooth (registered trademark).

[0040] <Configuration of Terminal Device> Fig. 5 shows an example of the hardware configuration of the terminal device 410. The terminal device 410 includes, for example, a control unit 510, a storage unit 520, a communication unit 530, a display unit 540, and an operation unit 550. The control unit 510 includes one or more processors such as a CPU and a memory device such as a semiconductor memory, and executes programs stored in the storage unit 520 to perform various processes. The storage unit 520 is a non-volatile storage device such as a semiconductor memory or a hard disk. The programs stored in the storage unit 520 include an application program for a navigation service provided by the route guidance system according to this embodiment. This application program may be downloaded from a server or distributed on a storage medium such as a CD-ROM.

[0041] The storage unit 520 also stores map data that can be used for route guidance for the vehicle 430. The map data stored in the storage unit 520 may include information related to route search, in addition to names of places and buildings, etc. The information related to route search includes information related to nodes corresponding to connection points in a road network, including guidance points in route guidance such as intersections, and information related to links for roads formed between nodes.

[0042] The communication unit 530 is a communication unit that enables wireless communication via Bluetooth (registered trademark) between the audio output device 420 and the vehicle 430. The display unit 540 includes a display panel such as a liquid crystal display, and is capable of displaying processing results, such as displaying a map during route guidance together with the current location. The operation unit 550 includes, for example, a touch panel and buttons, and acquires user input based on the user's contact with the touch panel or the like. The operation unit 550 may acquire, for example, the user's destination or position information, which will be described later, to be used in a route guidance system.

[0043] 6 shows an example of the software configuration of the terminal device 410 according to this embodiment. The terminal device 410 according to this embodiment includes, for example, a position acquisition unit 601, a path acquisition unit 602, a proximity determination unit 603, a volume determination unit 604, and an audio output control unit 605.

[0044] The position acquisition unit 601 acquires the position of the terminal device 410 as the position of the vehicle 430. The position acquisition unit 601 may, for example, receive a Global Navigation Satellite System (GNSS) signal using a GPS sensor (not shown) and acquire the position of the terminal device 410 based on the received GNSS signal. The position acquisition unit 601 may also acquire, as the position of the vehicle 430, position information acquired by the GPS 17 included in the vehicle 430.

[0045] Furthermore, the position acquisition unit 601 can acquire the user's destination to be used in the route guidance system. For example, the position acquisition unit 601 can acquire the destination based on a voice input by the user to a microphone provided in the audio output device 420. Alternatively, the position acquisition unit 601 may acquire the user's destination based on an input by the user to a touch panel of the terminal device 410, for example. Furthermore, the destination may be acquired based on an input by the user when using a route guidance application, or may be set in advance.

[0046] The route guidance system 400 according to this embodiment may allow a user to search for a destination by voice input. The destination may be searched for, for example, by name, by address, or by category, such as a gas station or a parking lot.

[0047] The route acquisition unit 602 acquires a guide route to be used in route guidance for the vehicle 430. The route acquisition unit 602 according to this embodiment acquires the guide route based on the vehicle position, destination, and map data acquired by the position acquisition unit 601. The route acquisition unit 602 may transmit the vehicle position and destination to an external server or the vehicle 430 and acquire the guide route from the external server or the vehicle 430. Note that if the download of the guide route (or map data) from the external server or the vehicle 430 to the terminal device 410 has been completed in advance, the terminal device 410 can also implement this embodiment without additional communication with the external server as long as only Bluetooth communication has been established between the terminal device 410 and the audio output device 420.

[0048] The proximity determination unit 603 determines the degree of proximity of the vehicle 430 to a point (guidance point) where the vehicle 430 makes a right or left turn on the guidance route. The guidance point is, for example, an intersection or a branching point. For example, the proximity determination unit 603 can determine the degree of proximity of the vehicle 430 using the distance from the current position of the vehicle 430 to the guidance point (the point where the vehicle 430 makes a right or left turn). In this case, the terminal device 410 can cause the audio output device 420 to output route guidance audio at a point a predetermined distance before the vehicle 430 reaches the guidance point (for example, 5 km before, 2 km before, 1 km before, 500 m before, 200 m before, etc.). The terminal device 410 outputs audio guidance at each of a plurality of points a predetermined distance before the vehicle 430 reaches the guidance point.

[0049] 8 , when the vehicle 430 approaches a guidance point (intersection) where the vehicle 430 is to turn left, the terminal device 410 causes the audio output device 420 to output a route guidance voice 800 at a point a predetermined distance before the vehicle 430 reaches the guidance point. The route guidance voice 800 includes a guidance voice such as, for example, "Turn left at the intersection 500 m ahead."

[0050] The volume determination unit 604 determines the left and right volume of the audio depending on the degree of proximity of the vehicle 430 to the guidance point. For example, the volume determination unit 604 increases the bias in the left and right volume of the audio as the degree of proximity of the vehicle 430 to the guidance point increases. In other words, the volume determination unit 604 increases the bias in the left and right volume of the audio depending on the degree of proximity of the vehicle 430 to the guidance point. The volume determination unit 604 can increase the bias in the left and right volume of the audio as the distance from the current position of the vehicle 430 to the guidance point decreases. In this case, when the vehicle 430 makes a right turn, the volume determination unit 604 biases the audio to the right with respect to the current traveling direction of the vehicle 430, and when the vehicle 430 makes a left turn, the volume determination unit 604 biases the audio to the left with respect to the current traveling direction of the vehicle 430.

[0051] For example, as shown in FIG. 9 , when the distance from the current position of the vehicle 430 to the guide point 900 is 1 km, the volume determination unit 604 can determine the left and right volume levels so that the ratio of the left volume to the right volume in the audio output device 420 is 85:15. Furthermore, when the distance from the current position of the vehicle 430 to the guide point 900 is 500 m, the volume determination unit 604 can determine the left and right volume levels so that the ratio of the left volume to the right volume in the audio output device 420 is 90:10. Furthermore, when the distance from the current position of the vehicle 430 to the guide point 900 is 200 m, the volume determination unit 604 can determine the left and right volume levels so that the ratio of the left volume to the right volume in the audio output device 420 is 98:2. Furthermore, although not explicitly shown in FIG. 9 , when the current position of the vehicle 430 reaches the guide point 900 (i.e., when it turns), the volume determination unit 604 may determine the left and right volume levels so that the ratio of the left volume to the right volume is 100:0. This allows the user to clearly distinguish between left and right volume levels.

[0052] The volume determination unit 604 can, for example, store table data in the memory unit 520 that associates multiple degrees of proximity with the left and right volumes corresponding to each degree of proximity, and determine the volume according to the degree of proximity by referring to the table data.

[0053] In this way, in this embodiment, the volume determination unit 604 controls the bias in the left and right volume of the audio depending on the degree of proximity of the vehicle 430 to the guidance point, so that the user can intuitively grasp the situation as they approach the guidance point (the driving situation toward the guidance point) during route guidance.

[0054] The proximity determination unit 603 may determine the proximity of the vehicle 430 using the time it takes for the vehicle 430 to reach the guidance point. In this case, the terminal device 410 can cause the audio output device 420 to output route guidance audio at each point: a predetermined time before or at the time the vehicle 430 reaches the guidance point (e.g., 5 minutes, 2 minutes, 1 minute, 30 seconds, 10 seconds, 0 seconds, etc.). In this case, the volume determination unit 604 can increase the bias in the left and right volume of the audio as the time until the vehicle 430 reaches the guidance point decreases. This also allows the user to intuitively grasp the situation of approaching the guidance point (driving situation toward the guidance point) during route guidance.

[0055] The audio output control unit 605 transmits at least one of audio data and control information to control the audio output by the audio output device 420 so that audio is output at the left and right volumes determined by the volume determination unit 604 .

[0056] <Configuration of Audio Output Device> An example configuration of a headset will be described with reference to Fig. 7 as an example of the audio output device 420. The audio output device 420 includes, for example, a communication unit 710, an input unit 720, an output unit 730, an AIF 731, a DAC 732, and an amplifier 733. The communication unit 710 is a communication unit for wireless communication with the terminal device 410, and transmits and receives various data between the devices, including, for example, at least one of guidance voice data and control information.

[0057] The input unit 720 acquires user input for an application running on the terminal device 410. The input unit 720 according to this embodiment includes, for example, a sound pickup device (microphone) and acquires user voice input for inputting a destination, etc. The input unit 720 may also include, for example, a dial-type or toggle-type mechanical switch and acquire user input for adjusting the output volume or setting the audio on / off, etc.

[0058] The AIF (Audio Interface) 731 transmits audio signals received from the terminal device 410 to the DAC 732 for each left and right channel. The DAC (Digital to Analog Converter) 732 converts the digital signal input from the AIF 731 into an analog signal. The amplifier 733 amplifies the analog signal input from the DAC 732 and supplies it to the output unit 730. The output unit 730 includes, for example, a speaker associated with the user's right ear and a speaker associated with the user's left ear. With this configuration, the audio received from the terminal device 410 is output from each speaker at the volume determined by the volume determination unit 604.

[0059] <Route Guidance Processing> With reference to FIG. 10 , the route guidance processing executed by the terminal device 410 according to this embodiment will be described. The route guidance processing is realized by the control unit 510 (processor thereof) of the terminal device 410 expanding and executing a program stored in the storage unit 520 in memory, and by causing the various units shown in FIG. 6 to function. The following description will discuss an example of controlling the left and right volume of a guidance voice generated using a route guidance application. However, this processing is not limited to controlling the left and right volume of a guidance voice, and may also control the left and right volume of a call voice or music. In the case of a call voice or music, for example, the left and right volume of the call voice or music may be biased at the same timing as the degree of proximity at which the guidance voice is generated. The (temporary) bias in the volume of the guidance voice, call voice, or music allows the user to intuitively grasp whether to turn right or left at the next guidance point and the situation regarding the approach to the guidance point.

[0060] In S1001, the control unit 510 receives a start signal for the route guidance application from the control unit 10a of the vehicle 430 via the communication unit 530 and starts route guidance. Here, the control unit 10a can transmit the start signal to the terminal device 410 in response to, for example, the start of the vehicle 430. Alternatively, the control unit 10a may transmit the start signal to the terminal device 410 in response to a signal from the terminal device 410 that has executed the route guidance application. Furthermore, the control unit 10a may transmit the start signal to the terminal device 410 upon detecting that the user has started using the vehicle 430 (for example, by getting on the vehicle). The transmission of the start signal by the control unit 10a is not limited to the above example and may be performed by any method.

[0061] In S1002, the position acquisition unit 601 acquires position information of the current location and destination of the vehicle 430. As described above, the position acquisition unit 601 can acquire the location of the terminal device 410 as the location of the vehicle 430 using, for example, a GPS function, and acquire the destination through voice input by the user. In S1003, the route acquisition unit 602 acquires a guide route that includes, for example, multiple guide points, based on the current location, destination, and map data acquired in S1002.

[0062] In S1004, the proximity determination unit 603 identifies a guidance point where the next right or left turn is to be made on the guidance route acquired in S1003. Then, in S1005, the proximity determination unit 603 determines the degree of proximity between the current position of the vehicle 430 and the guidance point. As described above, the proximity determination unit 603 can determine the degree of proximity of the vehicle 430 using the distance from the current position of the vehicle 430 to the guidance point (a point where the vehicle 430 makes a right or left turn). In this case, for example, the proximity determination unit 603 determines whether the current position of the vehicle 430 is a point a predetermined distance before the guidance point is reached (e.g., 5 km before, 2 km before, 1 km before, 500 m before, 200 m before, etc.). Furthermore, the proximity determination unit 603 may determine the degree of proximity of the vehicle 430 using the time it takes for the vehicle 430 to reach the guidance point. In this case, the proximity determination unit 603 determines whether the vehicle 430 will arrive at the guidance point a predetermined time before (for example, 5 minutes, 2 minutes, 1 minute, 30 seconds, 10 seconds, etc.) based on, for example, the traveling speed of the vehicle 430 and the distance to the guidance point.

[0063] In S1006, the audio output control unit 605 causes the audio output device 420 to output audio when the proximity between the current position of the vehicle 430 and the guidance point is a predetermined distance or a predetermined time ago. In this process, first, the volume determination unit 604 determines the left and right volume levels to be output by the audio output device 420 in accordance with the proximity determined by the proximity determination unit 603 (as described above with reference to FIG. 9 ). Then, the audio output control unit 605 transmits at least one of audio data and control information to the audio output device 420 so that the audio output device 420 outputs audio at the left and right volume levels determined by the volume determination unit 604.

[0064] In S1007, the control unit 510 determines whether the vehicle 430 has passed the guidance point (for example, based on the determination result of the proximity determination unit 603). If the control unit 510 determines that the vehicle 430 has passed the guidance point, the process proceeds to S1008; otherwise, the process returns to S1005. In this way, the terminal device 410 causes the audio output device 420 to output gradually different sounds at multiple degrees of proximity until the vehicle 430 reaches the guidance point.

[0065] In S1008, the control unit 510 determines whether or not a next guidance point exists on the guidance route acquired in S1003. If the control unit 510 determines that a next guidance point exists, the process returns to S1004; otherwise, the process ends.

[0066] As described above, in the above embodiment, the terminal device 410 that communicates with the audio output device 420 worn by the user acquires a guide route for the vehicle 430 used by the user, and causes the audio output device 420 to output audio while the vehicle 430 is traveling along the guide route. At this time, the left and right volumes of the audio are biased according to the degree of approach of the vehicle 430 up to a point on the guide route where the vehicle 430 makes a right or left turn. In this way, the user can intuitively grasp the situation of approaching the guide point (the driving situation toward the guide point) during route guidance.

[0067] (Other Embodiments) In the above-described embodiment, the left and right volumes of the sounds output by the sound output device 420 are controlled according to the proximity of the vehicle 430 to the guidance point. However, the left and right volumes of the sounds output by the sound output device 420 may also be controlled according to the lane in which the vehicle 430 is traveling. For example, the control unit 510 may bias the left and right volumes of the sounds according to the current lane in which the vehicle 430 is traveling when traveling toward the guidance point on the guidance route. For example, the control unit 510 may increase the bias in the left and right volumes of the sounds the farther the current lane is from a lane suitable for turning right or left on the guidance route.

[0068] 11 shows an example of controlling the bias of left and right audio in accordance with the relationship between the lane in which vehicle 430 is traveling and the lane suitable for turning right or left on the guidance route. For example, when turning left at an intersection where guidance point 1100 is located, it is assumed that the leftmost lane is predetermined as the lane suitable for turning left. In this case, when vehicle 430 is traveling in the leftmost lane, control unit 510 determines the left and right volume of the guidance audio "Turn left at the intersection 500 meters ahead" so that the ratio of the left volume to the right volume is 80:20.

[0069] On the other hand, when the vehicle 430 is traveling in the rightmost lane, the control unit 510 determines the left and right volumes of the guidance voice "Turn left at the intersection 500 m ahead" so that the ratio of the left volume to the right volume is 95:5.

[0070] This allows the user to intuitively grasp whether the vehicle is traveling in an appropriate lane when heading toward a guidance point during route guidance (the driving situation toward the guidance point). In the example described with reference to FIG. 11 , the farther the current driving lane is from a lane suitable for turning right or left on the guided route (i.e., the higher the urgency), the greater the bias in the left and right volume of the audio. In addition to this processing, the farther the current driving lane is from a lane suitable for turning right or left on the guided route (i.e., the higher the urgency), the greater the overall volume may be increased. That is, the control unit 510 determines the left and right volume difference so that the farther the current driving lane is from a lane suitable for turning right or left on the guided route, the greater the bias in the left and right volume of the audio. Then, the farther the current driving lane is from a lane suitable for turning right or left on the guided route, the greater the left and right volume of the audio while maintaining the bias. This allows the user to more intuitively grasp the level of urgency depending on the driving lane.

[0071] In the above description, the left and right volumes output by the audio output device 420 are controlled according to the proximity of the vehicle 430 to the guide point and the lane in which the vehicle 430 is traveling.

[0072] In the above-described voice guidance for a specific proximity or a specific lane, the volume determination unit 604 may localize a sound image as if the sound source were present in a specific direction, regardless of the direction the user's head is facing. For example, the volume determination unit 604 may acquire sensor information from a gyro sensor built into the audio output device 420 and localize the sound image by adjusting the volume or timing of the sound output from the audio output device 420 on the left and right.

[0073] By outputting a guidance voice to the user at a guidance point where a right or left turn is made, in which the sound image is localized in the direction of the turn, it is possible to provide a guidance voice that makes it easy to intuitively understand the direction. On the other hand, if the direction in which the user's head is facing changes, the position of the sound image will change relative to the direction of travel of the vehicle. To prevent such changes, the volume determination unit 604 localizes the sound image relative to the direction of travel of the vehicle.

[0074] FIG. 12 shows an example of audio output that presents a sound source in a specific direction, regardless of the orientation of the user's head (the orientation of the audio output device). For example, when the vehicle is approaching guidance point 900, the volume determination unit 604 outputs, for example, an audio guidance message such as "Turn left at the intersection 200 meters ahead" with a left-right volume ratio of 98:2. In this case, if the audio output device 420 worn on the user's head is facing forward in the direction of travel, a sound image is formed in direction 1200 based on this volume ratio. In this case, the volume determination unit 604 corrects the left and right volumes according to the orientation of the audio output device 420, thereby controlling the audio output so that the sound image is in the same direction relative to the direction of travel (i.e., direction 1200). In other words, audio is output as if a sound source is present in a specific direction, regardless of the orientation of the user's head. This also allows the user to intuitively grasp the driving situation as they approach a point where they will make a right or left turn.

[0075] Furthermore, in the route guidance system according to this embodiment, the audio output device is configured to output audio at guidance points, but in addition, lighting of line LEDs on the meter panel may also be used. For example, the terminal device 410 may cause the meter panel of the vehicle 430 or a panel of a helmet incorporating the audio output device 420 to emit light indicating the direction of right or left turns, along with the audio guidance for right or left turns. In this light-emitting display, for example, a brightness bias may be generated between the brightness of the right direction and the brightness of the left direction.

[0076] Summary of the embodiment 1. The information processing method of the above embodiment includes, in an information processing device (e.g., 410, 430) that communicates with an audio output device (e.g., 420) worn by a user, acquiring a guide route for a vehicle used by the user (e.g., S1003), and outputting audio from the audio output device via communication with the audio output device while the vehicle is traveling on the guide route (e.g., S1006), wherein outputting the audio includes biasing the left and right volumes of the audio in accordance with the degree of proximity of the vehicle to a point on the guide route where the vehicle makes a right or left turn (e.g., S1005, S1006).

[0077] According to this embodiment, the user can intuitively grasp the situation when approaching the guidance point (the driving situation toward the guidance point) during route guidance.

[0078] 2. In the information processing method of the above embodiment, outputting the sound includes increasing the bias in left and right volume of the sound as the vehicle approaches a point where the vehicle makes a right or left turn.

[0079] According to this embodiment, the user can intuitively grasp the degree of proximity to the guide point during route guidance.

[0080] 3. In the information processing method of the above embodiment, outputting the sound includes increasing the bias in left and right volume of the sound as the distance from the current position of the vehicle to the point where the vehicle makes a right or left turn becomes shorter.

[0081] According to this embodiment, the user can intuitively grasp the degree of proximity to the guide point according to the distance to the guide point.

[0082] 4. In the information processing method of the above embodiment, outputting the sound includes increasing the bias in left and right volume of the sound as the time until the vehicle reaches a point where the vehicle makes a right or left turn is shorter.

[0083] According to this embodiment, the user can intuitively grasp the degree of proximity to the guide point based on the time it takes to reach the guide point.

[0084] 5. In the information processing method of the above embodiment, outputting the sound includes biasing the sound to the right with respect to the current traveling direction of the vehicle when the vehicle is making a right turn, and biasing the sound to the left with respect to the current traveling direction of the vehicle when the vehicle is making a left turn.

[0085] According to this embodiment, it becomes possible to intuitively grasp whether to turn right or left at the next guide point based on the bias in the volume.

[0086] 6. In the information processing method of the above embodiment, the voice is a guidance voice for route guidance of the vehicle based on the guide route.

[0087] According to this embodiment, the bias in the volume of the guidance voice makes it possible to intuitively grasp whether to turn right or left at the next guidance point and the degree of proximity to the guidance point.

[0088] 7. In the information processing method of the above embodiment, the voice includes a call voice received from a terminal device used by another user.

[0089] According to this embodiment, it is possible to intuitively grasp whether to turn right or left at the next guide point and the degree of proximity to the guide point, based on the bias in the volume of the call voice.

[0090] 8. In the information processing method according to the above embodiment, the audio includes music being played.

[0091] According to this embodiment, it becomes possible to intuitively grasp whether to turn right or left at the next guide point and the degree of proximity to the guide point, based on the bias in the volume of the music being played.

[0092] 9. In the information processing method of the above embodiment, the information processing device is a terminal device.

[0093] According to this embodiment, even if the vehicle does not have the function, the user can use the terminal device to intuitively grasp the situation of approaching the guidance point during route guidance.

[0094] 10. In the information processing method of the above embodiment, the information processing device is included in the vehicle.

[0095] According to this embodiment, with a simple configuration consisting of only a vehicle and a voice output device, it becomes possible to intuitively grasp the situation of approaching a guidance point during route guidance.

[0096] 11. The information processing method of the above embodiment further includes receiving a start signal from a control unit of the vehicle, which is a saddle-ride type vehicle, and in response to receiving the start signal, acquiring the guide route is started.

[0097] According to this embodiment, it is possible to start the route guidance process in response to the start of use of the vehicle.

[0098] 12. The information processing method of the above embodiment includes, in an information processing device (e.g., 410, 430) that communicates with an audio output device (e.g., 420) worn by a user, acquiring a guide route for a vehicle used by the user (e.g., S1003), and outputting audio from the audio output device via communication with the audio output device while the vehicle is traveling on the guide route (e.g., S1006), wherein outputting the audio biases the left and right volumes of the audio according to the current driving lane when the vehicle is traveling toward a point on the guide route where it will make a right or left turn.

[0099] According to this embodiment, when receiving route guidance, the user can intuitively grasp whether or not they are driving in the appropriate lane when heading towards a guidance point (driving conditions towards the guidance point).

[0100] 13. In the information processing method of the above embodiment, outputting the sound includes increasing a bias in left and right volume of the sound as the current driving lane is farther away from a driving lane suitable for turning right or left on the guide route.

[0101] According to this embodiment, the user can intuitively grasp the degree of deviation from the appropriate lane during route guidance.

[0102] 14. In the information processing method of the above embodiment, outputting the sound includes increasing the bias between the left and right volumes of the sound the farther the current driving lane is from a driving lane suitable for turning right or left on the guided route, and then increasing the left and right volumes of the sound while maintaining the bias the farther the current driving lane is from a driving lane suitable for turning right or left on the guided route.

[0103] According to this embodiment, during route guidance, the user can more intuitively grasp the degree of urgency based on the degree of deviation from the appropriate lane.

[0104] 15. In the information processing method of the above embodiment, the voice is a guidance voice for route guidance of the vehicle based on the guide route.

[0105] According to this embodiment, the bias in the volume of the guidance voice makes it possible to intuitively grasp whether to turn right or left at the next guidance point and the degree of proximity to the guidance point.

[0106] 16. In the information processing method of the above embodiment, the voice includes a call voice received from a terminal device used by another user.

[0107] According to this embodiment, it is possible to intuitively grasp whether to turn right or left at the next guide point and the degree of proximity to the guide point, based on the bias in the volume of the call voice.

[0108] 17. In the information processing method according to the above embodiment, the audio includes music being played.

[0109] According to this embodiment, it becomes possible to intuitively grasp whether to turn right or left at the next guide point and the degree of proximity to the guide point, based on the bias in the volume of the music being played.

[0110] 18. The information processing device (e.g., 410, 430) of the above embodiment is an information processing device that communicates with an audio output device worn by a user, and includes: route acquisition means (e.g., 602) that acquires a guide route for a vehicle used by the user; and control means (e.g., 605) that causes the audio output device to output audio via communication with the audio output device while the vehicle is traveling on the guide route, and the control means biases the left and right volumes of the audio depending on the degree of proximity of the vehicle to a point on the guide route where the vehicle makes a right or left turn.

[0111] According to this embodiment, the user can intuitively grasp the situation when approaching the guidance point (the driving situation toward the guidance point) during route guidance.

[0112] 19. The information processing device (e.g., 410, 430) of the above embodiment is an information processing device that communicates with an audio output device worn by a user, and includes: route acquisition means (e.g., 602) that acquires a guide route for a vehicle used by the user; and control means (e.g., 605) that causes the audio output device to output audio via communication with the audio output device while the vehicle is traveling on the guide route, and the control means biases the left and right volumes of the audio according to the current driving lane when the vehicle is traveling on the guide route toward a point where it will make a right or left turn.

[0113] According to this embodiment, when receiving route guidance, the user can intuitively grasp whether or not they are driving in the appropriate lane when heading towards a guidance point (driving conditions towards the guidance point).

[0114] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention.

[0115] 501: control unit, 601: position acquisition unit, 602: route acquisition unit, 603: proximity determination unit, 604: volume determination unit, 605: audio output control unit

Claims

1. An information processing method comprising: in an information processing device that communicates with an audio output device worn by a user, acquiring a guide route for a vehicle used by the user; and causing the audio output device to output audio via communication with the audio output device while the vehicle is traveling along the guide route, wherein outputting the audio includes biasing the left and right volume of the audio depending on the degree of proximity of the vehicle to a point on the guide route where the vehicle makes a right or left turn.

2. The information processing method according to claim 1, characterized in that outputting the audio includes increasing the bias in left and right volume of the audio the greater the proximity of the vehicle to a point where the vehicle will make a right or left turn.

3. The information processing method according to claim 2, characterized in that outputting the audio includes increasing the bias in left / right volume of the audio the shorter the distance from the current position of the vehicle to the point where the vehicle makes a right / left turn.

4. The information processing method according to claim 2, characterized in that outputting the audio includes increasing the bias in left and right volume of the audio the shorter the time it takes for the vehicle to reach a point where the vehicle will make a right or left turn.

5. The information processing method of claim 1, characterized in that outputting the sound includes biasing the sound to the right side of the current traveling direction of the vehicle when the vehicle is making a right turn, and biasing the sound to the left side of the current traveling direction of the vehicle when the vehicle is making a left turn.

6. The information processing method according to claim 1, wherein the voice is a guidance voice for route guidance of the vehicle based on the guide route.

7. The information processing method according to claim 1, wherein the voice includes a call voice received from a terminal device used by another user.

8. The information processing method according to claim 1, wherein the audio includes music being played.

9. The information processing method according to claim 1, wherein the information processing device is a terminal device.

10. The information processing method according to claim 1, wherein the information processing device is included in the vehicle.

11. The information processing method according to claim 1, further comprising receiving a start signal from a control unit of the vehicle, which is a saddle-type vehicle, and in response to receiving the start signal, acquiring the guide route is started.

12. An information processing method comprising: in an information processing device that communicates with an audio output device worn by a user, acquiring a guide route for a vehicle used by the user; and, while the vehicle is traveling on the guide route, causing the audio output device to output audio via communication with the audio output device, wherein the outputting of the audio is characterized in that the left / right volume of the audio is biased depending on the current driving lane when the vehicle is traveling on the guide route toward a point where it is to make a right / left turn.

13. The information processing method of claim 12, characterized in that outputting the audio includes increasing the bias in left / right volume of the audio the farther the current driving lane is from a driving lane suitable for turning right or left on the guide route.

14. The information processing method of claim 12, characterized in that outputting the audio includes increasing the bias in the left and right volumes of the audio the farther the current driving lane is from a driving lane suitable for turning right or left on the guided route, and then increasing the left and right volumes of the audio while maintaining the bias the farther the current driving lane is from a driving lane suitable for turning right or left on the guided route.

15. The information processing method according to claim 12, wherein the voice is a guidance voice for route guidance of the vehicle based on the guide route.

16. The information processing method according to claim 12, wherein the voice includes a call voice received from a terminal device used by another user.

17. The information processing method according to claim 12, wherein the audio includes music being played.

18. An information processing device that communicates with an audio output device worn by a user, comprising: a route acquisition means for acquiring a guided route for a vehicle used by the user; and a control means for causing the audio output device to output audio via communication with the audio output device while the vehicle is traveling on the guided route, wherein the control means biases the left and right volume of the audio depending on the degree of approach of the vehicle to a point on the guided route where the vehicle makes a right or left turn.

19. An information processing device that communicates with an audio output device worn by a user, comprising: a route acquisition means for acquiring a guided route for a vehicle used by the user; and a control means for causing the audio output device to output audio via communication with the audio output device while the vehicle is traveling on the guided route, wherein the control means biases the left and right volume of the audio depending on the current driving lane when the vehicle is traveling toward a point on the guided route where it will make a right or left turn.

20. A program for causing an information processing device to execute each step of the information processing method according to any one of claims 1 to 17.

21. A storage medium storing a program for causing an information processing device to execute each step of the information processing method according to any one of claims 1 to 17.

Citation Information

Patent Citations

  • Direction presentation system

    JP2020123143A

  • Sound navigation method and personal navigation device using same

    CN101782401A

  • Navigation device attached to helmet

    JP1999148837A

  • Direction information communicator

    JP2007031875A