Audio and video control device and audio and video control method

Abstract

To provide a novel technology that can provide a passenger of a vehicle with an immersive feeling about traveling.SOLUTION: A sound image control device includes: an acquisition unit that acquires vehicle information concerning acceleration in a longitudinal direction of a vehicle; and a sound image control unit that, based on the vehicle information acquired by the acquisition unit, moves sound image localization of sounds outputted from at least two speakers included in the vehicle in the longitudinal direction of the vehicle.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an audio - video control device and an audio - video control method.

Background Art

[0002] Patent Document 1 discloses a method of changing the position of a specific sound source according to the speed of a vehicle or the amount of depression of the accelerator.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A technique is desired that can give a sense of immersion in driving to the passengers of a vehicle by a method different from the method described in Patent Document 1. The present disclosure aims to provide a new technique that can give a sense of immersion in driving to the passengers of a vehicle.

Means for Solving the Problems

[0005] An audio - video control device according to an aspect of the present disclosure includes an acquisition unit that acquires vehicle information related to acceleration in the longitudinal direction of the vehicle, and an audio - video control unit that moves the audio - visual localization of sound output from at least two speakers provided in the vehicle in the longitudinal direction of the vehicle based on the vehicle information acquired by the acquisition unit.

[0006] An audio - video control device according to another aspect of the present disclosure includes an acquisition unit that acquires vehicle information related to acceleration in the lateral direction of the vehicle, and an audio - video control unit that moves the audio - visual localization of sound output from at least two speakers provided in the vehicle in the lateral direction of the vehicle based on the vehicle information acquired by the acquisition unit.

[0007] Another aspect of the present disclosure relates to an audio-visual control method implemented by a computer, which acquires vehicle information regarding acceleration in the longitudinal direction of the vehicle, and moves the audio-visual localization of the sound output from the at least two speakers in the longitudinal direction of the vehicle based on the acquired vehicle information.

[0008] Another aspect of the present disclosure relates to an audio-visual control method implemented by a computer, which acquires vehicle information regarding acceleration in the lateral direction of the vehicle, and moves the audio-visual localization of the sound output from the at least two speakers provided in the vehicle in the lateral direction of the vehicle based on the acquired vehicle information.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

MODE FOR CARRYING OUT THE INVENTION

[0010] A: First Embodiment A1: Audio Control Device 1 FIG. 1 is a diagram showing an example of the audio control device 1 according to the first embodiment. The audio control device 1 is mounted on the vehicle 100. The vehicle 100 is an electric vehicle without an engine. The vehicle 100 is operated by a driver of the vehicle 100. The vehicle 100 may execute autonomous driving. The vehicle 100 includes the audio control device 1, wheels 2a to 2d, a wheel control unit 3, a vehicle speed meter 3A, an operation unit 4, speakers 5a and 5b.

[0011] FIG. 2 is a diagram showing an example of the vehicle 100. FIG. 2 shows, in addition to the vehicle 100, an x-axis 8a along the longitudinal direction of the vehicle 100, a y-axis 8b along the lateral direction of the vehicle 100, a first position i1, a second position i2, and a third position i3. The first position i1, the second position i2, and the third position i3 are arranged in the longitudinal direction (the direction along the x-axis 8a) of the vehicle 100. The second position i2 exists in front of the first position i1 in the longitudinal direction of the vehicle 100. The third position i3 exists between the first position i1 and the second position i2 in the longitudinal direction of the vehicle 100.

[0012] The vehicle 100 includes a passenger compartment 100a, a front left door 7a, a front right door 7b, a rear left door 7c, and a rear right door 7d. The passenger compartment 100a has speakers 5a and 5b, a seat 6, a part of the front left door 7a, a part of the front right door 7b, a part of the rear left door 7c, and a part of the rear right door 7d.

[0013] Each of the speakers 5a and 5b is a speaker set having a plurality of speakers. Each of the speakers 5a and 5b may be a single speaker. The speakers 5a and 5b are an example of at least two speakers provided in the vehicle 100. The speakers 5a and 5b emit various sounds. For example, the speakers 5a and 5b emit a virtual engine sound.

[0014] The engine sound is a sound including the sound generated by the engine itself, the intake sound caused by the intake of the engine, and the exhaust sound caused by the exhaust of the engine. The engine sound may be only the sound generated by the engine itself, or a combination of the sound generated by the engine itself and the intake sound, or a combination of the sound generated by the engine itself and the exhaust sound. The engine sound may further include a sound indicating noise.

[0015] Speaker 5a includes speakers 5a1 to 5a3. Speaker 5a1 is located at the front left door 7a. Speaker 5a2 is located at the front right door 7b. Speaker 5a3 is located at the front part in the passenger compartment 100a. Each of speakers 5a, 5a1, 5a2, and 5a3 is an example of a first speaker.

[0016] Speaker 5b is located behind speaker 5a in the longitudinal direction of the vehicle 100. Speaker 5b includes speakers 5b1 to 5b3. Speaker 5b1 is located at the rear left door 7c. Speaker 5b2 is located at the rear right door 7d. Speaker 5b3 is located at the rear part in the passenger compartment 100a. Each of speakers 5b, 5b1, 5b2, and 5b3 is an example of a second speaker.

[0017] The audio control device 1 shown in FIG. 1 causes speakers 5a and 5b to emit a virtual engine sound. The audio control device 1 moves the sound image localization of the sound output from speakers 5a and 5b in the longitudinal direction of the vehicle 100. The sound image is the perceived sound source of the sound output from speakers 5a and 5b. The sound image localization means the position of the sound image. In the present embodiment, by causing speakers 5a and 5b to emit sound, the sound image localization is performed for any or all of the passengers sitting on the seat 6. Note that only the driver (passenger) sitting in the driver's seat may be the target of the sound image localization.

[0018] Each of wheels 2a and 2b is a front wheel of the vehicle 100. Each of wheels 2c and 2d is a rear wheel of the vehicle 100. The vehicle 100 may have additional wheels in addition to wheels 2a to 2d.

[0019] The wheel control unit 3 controls the rotation of each of wheels 2a and 2b. Instead of controlling the rotation of each of wheels 2a and 2b, the wheel control unit 3 may control the rotation of each of wheels 2c and 2d. The wheel control unit 3 may control the rotation of each of wheels 2a to 2d. The wheel control unit 3 includes a motor 31, an accelerator pedal 32, a shift lever 33, a motor control unit 34, and a power transmission unit 35.

[0020] The motor 31 generates power based on electric power. The accelerator pedal 32 and the shift lever 33 are each operated by the driver of the vehicle 100. The accelerator pedal 32 and the shift lever 33 may each be automatically operated.

[0021] The position of the accelerator pedal 32 is adjusted by the driver of the vehicle 100. The position of the accelerator pedal 32 corresponds to the "opening degree of the accelerator". The opening degree of the accelerator increases in accordance with an increase in the difference between the position of the accelerator pedal 32 and the reference position of the accelerator pedal 32. The opening degree of the accelerator decreases in accordance with a decrease in the difference between the position of the accelerator pedal 32 and the reference position of the accelerator pedal 32. The reference position of the accelerator pedal 32 is the position of the accelerator pedal 32 in a situation where the accelerator pedal 32 is not being operated. When the position of the accelerator pedal 32 coincides with the reference position of the accelerator pedal 32, the opening degree of the accelerator is "0".

[0022] The difference between the position of the accelerator pedal 32 and the reference position of the accelerator pedal 32 can be referred to as the "displacement amount of the accelerator pedal 32". The displacement amount of the accelerator pedal 32 may be used as the opening degree of the accelerator.

[0023] The accelerator pedal 32 is an example of an accelerator. When the vehicle 100 has an accelerator lever instead of the accelerator pedal 32, the accelerator lever is an example of an accelerator.

[0024] The shift lever 33 is selectively set by the driver of the vehicle 100 to any position among the drive range, the parking range, the reverse range, and the neutral range.

[0025] The motor control unit 34 detects the position of the accelerator pedal 32 and the position of the shift lever 33. Since the method of detecting the position of the accelerator pedal 32 and the position of the shift lever 33 is well-known, a detailed description thereof is omitted.

[0026] The motor control unit 34 controls the motor 31 based on the position of the accelerator pedal 32 and the position of the shift lever 33. For example, the motor control unit 34 generates rotation direction information and rotation speed information based on the position of the accelerator pedal 32 and the position of the shift lever 33. The rotation direction information is information that determines the rotation direction of the motor 31. The rotation speed information is information that determines the rotation speed of the motor 31. The motor control unit 34 sets the rotation direction of the motor 31 to the rotation direction determined by the rotation direction information. The motor control unit 34 sets the rotation speed of the motor 31 to the rotation speed determined by the rotation speed information. Since the method of controlling the rotation (rotation direction and rotation speed) of the motor 31 based on the position of the accelerator pedal 32 and the position of the shift lever 33 is well-known, a detailed description thereof will be omitted.

[0027] The power transmission unit 35 is a set of reduction gears. The power transmission unit 35 transmits the power generated by the motor 31 to the wheels 2a and 2b. The power transmission unit 35 may transmit the power generated by the motor 31 to the wheels 2c and 2d instead of the wheels 2a and 2b. The power transmission unit 35 may transmit the power generated by the motor 31 to the wheels 2a to 2d.

[0028] The vehicle speed meter 3A measures the speed of the vehicle 100. The vehicle speed meter 3A generates speed information a1 based on the measurement result of the speed of the vehicle 100. The speed information a1 is information indicating the speed of the vehicle 100. The change in the speed information a1 indicates the degree of acceleration in the longitudinal direction of the vehicle 100. Therefore, the speed information a1 is an example of information that determines the degree of acceleration in the longitudinal direction of the vehicle 100.

[0029] The information that determines the degree of acceleration in the longitudinal direction of the vehicle 100 may include information that specifies the degree of acceleration in the longitudinal direction of the vehicle 100. The information that determines the degree of acceleration in the longitudinal direction of the vehicle 100 is an example of vehicle information regarding the acceleration in the longitudinal direction of the vehicle 100. The vehicle information regarding the acceleration in the longitudinal direction of the vehicle 100 is not limited to the information that determines the degree of acceleration in the longitudinal direction of the vehicle 100. The vehicle information regarding the acceleration in the longitudinal direction of the vehicle 100 may be information that indicates the degree of acceleration in the longitudinal direction of the vehicle 100 (for example, information that indicates the acceleration in the longitudinal direction of the vehicle 100). The vehicle information regarding acceleration is a concept that includes the information that determines the degree of acceleration and the information that indicates the degree of acceleration.

[0030] The motor control unit 34 generates the accelerator information b1 based on the position of the accelerator pedal 32. The accelerator information b1 is information that indicates the opening degree of the accelerator.

[0031] The operation unit 4 is, for example, a touch panel. The operation unit 4 is not limited to the touch panel and may also be an operation panel having various operation buttons. The operation unit 4 receives operations performed by the passengers of the vehicle 100. Hereinafter, the "passengers of the vehicle 100" will be simply referred to as "passengers".

[0032] The audio - video control device 1 includes a storage device 11 and a processing device 12. The storage device 11 may be an external element of the audio - video control device 1.

[0033] The storage device 11 is a computer - readable recording medium (for example, a non - transitory computer - readable recording medium). The storage device 11 includes a non - volatile memory and a volatile memory. The non - volatile memory is, for example, ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, RAM (Random Access Memory).

[0034] The storage device 11 stores the program p1 and various information. The program p1 defines the operation of the audio-visual control device 1. The storage device 11 may store the program p1 read from a storage device in a server (not shown). In this case, the storage device in the server is an example of a computer-readable recording medium.

[0035] The processing device 12 includes one or more CPUs (Central Processing Units). The one or more CPUs are an example of one or more processors. Each of the processing device, the processor, and the CPU is an example of a computer.

[0036] The processing device 12 reads the program p1 from the storage device 11. By executing the program p1, the processing device 12 functions as the acquisition unit 13, the generation unit 14, and the audio-visual control unit 15. At least one of the acquisition unit 13, the generation unit 14, and the audio-visual control unit 15 may be implemented by a circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array).

[0037] The acquisition unit 13 acquires speed information a1 from the vehicle speed meter 3A. For example, the acquisition unit 13 first transmits a request for the speed information a1 to the vehicle speed meter 3A. The acquisition unit 13 acquires the speed information a1 transmitted from the vehicle speed meter 3A in response to the request for the speed information a1. When the vehicle speed meter 3A actively transmits the speed information a1 to the acquisition unit 13, the acquisition unit 13 may acquire the speed information a1 actively transmitted from the vehicle speed meter 3A. The acquisition unit 13 acquires the accelerator information b1 from the motor control unit 34. For example, the acquisition unit 13 first transmits a request for the accelerator information b1 to the motor control unit 34. The acquisition unit 13 acquires the accelerator information b1 transmitted from the motor control unit 34 in response to the request for the accelerator information b1. When the motor control unit 34 actively transmits the accelerator information b1 to the acquisition unit 13, the acquisition unit 13 may acquire the accelerator information b1 actively transmitted from the motor control unit 34. The speed information a1 and the accelerator information b1 are communicated via CAN (Controller Area Network). The speed information a1 and the accelerator information b1 may be communicated via a communication protocol different from CAN.

[0038] The generation unit 14 generates a sound signal c1 based on the speed information a1 and the accelerator information b1 acquired by the acquisition unit 13. The sound signal c1 is a surround signal indicating a virtual engine sound. The generation unit 14 includes a determination unit 141 and a signal generation unit 142.

[0039] The determination unit 141 determines the rotational speed of the virtual engine based on the speed information a1. The virtual engine is a virtual engine virtually mounted on the vehicle 100. The determination unit 141 determines the rotational speed of the virtual engine by using the reference information e.

[0040] The reference information e is information indicating the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine. The reference information e is stored in the storage device 11.

[0041] The determination unit 141 determines the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 by using the reference information e. When the determination unit 141 determines the rotational speed of the virtual engine, it generates rotational speed information f1 indicating the rotational speed of the virtual engine.

[0042] The reference information e may include first reference information e1 and second reference information e2. The first reference information e1 is information indicating the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is accelerating. The second reference information e2 is information indicating the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is decelerating and when the vehicle 100 is traveling at a constant speed.

[0043] Even when the reference information e includes the first reference information e1 and the second reference information e2, the determination unit 141 determines the rotational speed of the virtual engine based on the speed information a1.

[0044] For example, the determination unit 141 first determines whether the vehicle 100 is accelerating based on the change in the speed information a1.

[0045] When the determination unit 141 determines that the vehicle 100 is accelerating, it determines the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 by using the first reference information e1.

[0046] When the determination unit 141 determines that the vehicle 100 is not accelerating, it determines that the vehicle 100 is decelerating or traveling at a constant speed.

[0047] When the determination unit 141 determines that the vehicle 100 is decelerating or traveling at a constant speed, it determines the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 by using the second reference information e2.

[0048] Even when the reference information e includes the first reference information e1 and the second reference information e2, when the determination unit 141 determines the rotational speed of the virtual engine, it generates rotational speed information f1 indicating the rotational speed of the virtual engine.

[0049] The signal generation unit 142 generates a sound signal c1 based on the rotational speed information f1 and the accelerator information b1.

[0050] First, the signal generation unit 142 determines the driving state of the vehicle 100 based on the rotational speed information f1 and the accelerator information b1. For example, the signal generation unit 142 determines the driving state of the vehicle 100 by using the driving information g1.

[0051] The driving information g1 is information indicating the correspondence between the rotational speed of the virtual engine, the opening degree of the accelerator, and the driving state of the vehicle 100. The driving information g1 is stored in the storage device 11.

[0052] The signal generation unit 142 determines the driving state of the vehicle 100 corresponding to both the rotational speed of the virtual engine indicated by the rotational speed information f1 and the opening degree of the accelerator indicated by the accelerator information b1 by using the driving information g1.

[0053] Subsequently, the signal generation unit 142 generates a sound signal c1 based on the driving state of the vehicle 100. For example, the signal generation unit 142 generates the sound signal c1 by using the sound information h1.

[0054] The sound information h1 is information indicating the correspondence between the driving state of the vehicle 100 and the sound data indicating the virtual engine sound. The sound data indicates the virtual engine sound corresponding to the driving state of the vehicle 100. The sound information h1 is stored in the storage device 11.

[0055] The signal generation unit 142 generates a sound signal c1 corresponding to the driving state of the vehicle 100 by using the sound information h1.

[0056] The sound signal c1 is a multi-channel sound signal. The sound signal c1 includes a sound signal c1a for the speaker 5a and a sound signal c1b for the speaker 5b. Each of the sound signals c1a and c1b is a multi-channel sound signal. When the speaker 5a is a single speaker, the sound signal c1a is a single-channel sound signal. When the speaker 5b is a single speaker, the sound signal c1b is a single-channel sound signal.

[0057] Based on the speed information a1 acquired by the audio-visual control unit 15, the audio-visual localization of the sound output from the speakers 5a and 5b is moved in the longitudinal direction of the vehicle 100. For example, the audio-visual control unit 15 generates acceleration information based on the speed information a1. The acceleration information indicates the acceleration of the vehicle 100. The audio-visual control unit 15 moves the audio-visual localization of the sound output from the speakers 5a and 5b in the longitudinal direction of the vehicle 100 based on the acceleration information.

[0058] The audio-visual control unit 15 generates the audio signal c2a for the speaker 5a by adjusting the amplitude of the audio signal c1a based on the acceleration information. The audio-visual control unit 15 generates the audio signal c2b for the speaker 5b by adjusting the amplitude of the audio signal c1b based on the acceleration information.

[0059] Each of the audio signals c2a and c2b is a multi-channel audio signal. When the speaker 5a is a single speaker, the audio signal c2a is a single-channel audio signal. When the speaker 5b is a single speaker, the audio signal c2b is a single-channel audio signal.

[0060] The audio-visual control unit 15 provides the audio signal c2a to the speaker 5a. The audio-visual control unit 15 provides the audio signal c2b to the speaker 5b. The audio signals c2a and c2b affect the audio-visual localization of the sound output from the speakers 5a and 5b.

[0061] A2: Reference information e The reference information e indicates the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine. The rotational speed of the virtual engine depends on the speed of the vehicle 100 and the virtual transmission.

[0062] The virtual transmission is a transmission that is virtually mounted on the vehicle 100. The virtual transmission has three gears, namely gears J1 to J3. Gear J1 corresponds to the first gear in the virtual transmission. Gear J2 corresponds to the second gear in the virtual transmission. Gear J3 corresponds to the third gear in the virtual transmission. Each of gears J1, J2, and J3 can also be referred to as a shift gear. The virtual transmission only needs to have one or more gears.

[0063] Figure 3 is a diagram showing an example of the correspondence relationship indicated by the reference information e, that is, a diagram showing an example of the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine. In Figure 3, the horizontal axis indicates the speed of the vehicle 100, and the vertical axis indicates the rotational speed of the virtual engine.

[0064] The reference information e shows the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine for each of the gears J1 to J3. The maximum rotational speed MAX1 of the virtual engine indicates the maximum rotational speed of the virtual engine. The maximum rotational speed of the virtual engine is, for example, 9000 rpm (revolutions per minute). The maximum rotational speed of the virtual engine is not limited to 9000 rpm.

[0065] The reference information e includes first reference information e1 and second reference information e2. The first reference information e1 is information showing the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is accelerating. The second reference information e2 is information showing the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is decelerating and at a constant speed.

[0066] Figure 4 is a diagram showing an example of the correspondence relationship indicated by the first reference information e1, that is, a diagram showing an example of the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is accelerating. In Figure 4, the horizontal axis indicates the speed of the vehicle 100, and the vertical axis indicates the rotational speed of the virtual engine.

[0067] The first reference information e1 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is less than the speed V1, specifically, the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for gear J1.

[0068] The speed V1 is the speed of the vehicle 100 when the rotational speed of the virtual engine using gear J1 reaches the rotational speed MAX1. The speed V1 may be less than the speed of the vehicle 100 when the rotational speed of the virtual engine using gear J1 reaches the rotational speed MAX1.

[0069] The first reference information e1 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is equal to or greater than the speed V1 and less than the speed V2, specifically, the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for gear J2.

[0070] The speed V2 is the speed of the vehicle 100 when the rotational speed of the virtual engine using gear J2 reaches the rotational speed MAX1. The speed V2 may be a speed that is less than the speed of the vehicle 100 when the rotational speed of the virtual engine using gear J2 reaches the rotational speed MAX1 and greater than the speed V1.

[0071] The first reference information e1 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is equal to or greater than the speed V2, specifically, the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for gear J3.

[0072] Figure 5 is a diagram showing an example of the correspondence relationship indicated by the second reference information e2, that is, a diagram showing an example of the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine when the vehicle 100 is decelerating and at a constant speed. In Figure 5, the horizontal axis represents the speed of the vehicle 100, and the vertical axis represents the rotational speed of the virtual engine.

[0073] The second reference information e2 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is greater than the speed V4, as the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for the gear J3. The speed V4 is greater than the speed V1 and less than the speed V2.

[0074] The second reference information e2 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is greater than the speed V3 and less than or equal to the speed V4, as the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for the gear J2. The speed V3 is greater than or equal to 0 and less than the speed V1.

[0075] The second reference information e2 shows the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine when the speed of the vehicle 100 is less than or equal to the speed V3, as the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for the gear J1.

[0076] A3: Driving information g1 The driving information g1 shows the correspondence between the rotational speed of the virtual engine, the opening degree of the accelerator, and the driving state of the vehicle 100.

[0077] Figure 6 is a diagram showing an example of the correspondence shown by the driving information g1. In Figure 6, the horizontal axis represents the rotational speed of the virtual engine, and the vertical axis represents the opening degree of the accelerator. The driving state of the vehicle 100 is divided into regions K1 to K25 according to the rotational speed of the virtual engine and the opening degree of the accelerator. Hereinafter, when it is not necessary to distinguish the regions K1 to K25 from each other, each of the regions K1 to K25 is referred to as "region K". The number of regions K is not limited to 25, and may be a number smaller than 25 or a number larger than 25.

[0078] A4: Sound information h1 The sound information h1 is information showing the correspondence between the driving state of the vehicle 100 and sound data indicating a virtual engine sound corresponding to the driving state of the vehicle 100.

[0079] FIG. 7 is a diagram showing an example of the correspondence relationship indicated by the sound information h1. The sound information h1 shows the correspondence relationship between the regions K1 to K25 indicating the driving state of the vehicle 100 and the sound data M1 to M25 defining the sound signal.

[0080] The sound data M1 to M25 correspond one-to-one with the regions K1 to K25. For example, the sound data M1 corresponds to the region K1, and the sound data M25 corresponds to the region K25. The sound data M1 to M25 are different from each other. Hereinafter, when it is not necessary to distinguish the sound data M1 to M25 from each other, each of the sound data M1 to M25 is referred to as "sound data M".

[0081] The sound data M indicates a virtual engine sound corresponding to the corresponding region K (the driving state of the corresponding vehicle 100). The sound data M indicates a sound imitating the engine sound of an actually existing engine. The sound data M may indicate the engine sound of an imaginary engine.

[0082] A5: Description of the operation FIG. 8 is a diagram showing an example of the operation of the audio control device 1. Hereinafter, it is assumed that the vehicle speed meter 3A generates speed information a1 indicating the speed of the vehicle 100. It is assumed that the motor control unit 34 generates accelerator information b1 indicating the opening degree of the accelerator. It is assumed that the reference information e indicating the correspondence relationship between the speed of the vehicle 100 and the rotational speed of the virtual engine includes the first reference information e1 shown in FIG. 4 and the second reference information e2 shown in FIG. 5.

[0083] When the operation unit 4 receives a generation operation from the occupant, which is an operation for instructing the generation of the sound signal c1, the operation shown in FIG. 8 starts. The operation shown in FIG. 8 is repeated until the operation unit 4 receives an end operation from the occupant, which is an operation for instructing the end of the generation of the sound signal c1.

[0084] In step S101, the acquisition unit 13 acquires the speed information a1 from the vehicle speed meter 3A and acquires the accelerator information b1 from the motor control unit 34.

[0085] Subsequently, in step S102, the acquisition unit 13 stores the speed information a1 in the storage device 11. Therefore, the storage device 11 stores the history of the speed information a1.

[0086] The history of the speed information a1 is left in the storage device 11 until the operation unit 4 receives an end operation from the passenger. When the operation unit 4 receives an end operation from the passenger, the acquisition unit 13 deletes the history of the speed information a1 from the storage device 11. Therefore, the history of the speed information a1 is not stored in the storage device 11 when the operation unit 4 receives a generation operation from the passenger.

[0087] When the acquisition unit 13 stores the speed information a1 in the storage device 11, the acquisition unit 13 provides the speed information a1 to the determination unit 141. Also, the acquisition unit 13 provides the accelerator information b1 to the signal generation unit 142.

[0088] Subsequently, in step S103, the determination unit 141 determines whether the vehicle 100 is accelerating based on the change in the speed information a1.

[0089] In step S103, the determination unit 141 determines whether the speed of the vehicle 100 is increasing (whether it is accelerating) by referring to the history of the speed information a1.

[0090] For example, the determination unit 141 first identifies the speed information a1 stored in the current step S102 and the speed information a1 stored in the previous step S102 from the history of the speed information a1. If the speed information a1 stored in the previous step S102 does not exist in the storage device 11, the determination unit 141 uses "0" as the speed of the vehicle 100 indicated by the speed information a1 stored in the previous step S102.

[0091] Subsequently, the determination unit 141 determines whether the speed of the vehicle 100 indicated by the speed information a1 stored in the current step S102 is higher than the speed of the vehicle 100 indicated by the speed information a1 stored in the previous step S102. An increase in the speed of the vehicle 100 means that the vehicle 100 is accelerating. Therefore, determining whether the speed of the vehicle 100 is increasing means determining whether the vehicle 100 is accelerating.

[0092] If the speed of the vehicle 100 indicated by the speed information a1 stored in the current step S102 is higher than the speed of the vehicle 100 indicated by the speed information a1 stored in the previous step S102, the determination unit 141 determines that the vehicle 100 is accelerating.

[0093] When the determination unit 141 determines in step S103 that the vehicle 100 is accelerating, it determines the rotational speed of the virtual engine by using the first reference information e1 in step S104.

[0094] In step S104, the determination unit 141 first determines, as the rotational speed during acceleration, the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 from among the rotational speeds of the virtual engine indicated by the first reference information e1. Subsequently, the determination unit 141 determines the rotational speed during acceleration as the rotational speed of the virtual engine.

[0095] For example, when the vehicle 100 is accelerating and the speed of the vehicle 100 is less than the speed V1, the determination unit 141 first selects the correspondence between the speed of the vehicle 100 and the rotational speed of the virtual engine for the gear J1 indicated by the first reference information e1. Subsequently, the determination unit 141 determines, as the rotational speed during acceleration, the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 from among the rotational speeds of the virtual engine indicated for the gear J1. Subsequently, the determination unit 141 determines the rotational speed during acceleration as the rotational speed of the virtual engine.

[0096] When the determination unit 141 determines in step S103 that the vehicle 100 is not accelerating, it determines that the vehicle 100 is decelerating or maintaining a constant speed. Subsequently, the determination unit 141 determines the rotational speed of the virtual engine using the second reference information e2 in step S105.

[0097] In step S105, first, the determination unit 141 identifies, as the corresponding rotational speed, the rotational speed of the virtual engine corresponding to the speed of the vehicle 100 indicated by the speed information a1 from among the rotational speeds of the virtual engine indicated by the second reference information e2. Subsequently, the determination unit 141 determines the corresponding rotational speed as the rotational speed of the virtual engine.

[0098] When the rotational speed of the virtual engine is determined in step S104 or step S105, in step S106, the determination unit 141 generates rotational speed information f1 indicating the rotational speed of the virtual engine. The determination unit 141 provides the rotational speed information f1 to the signal generation unit 142.

[0099] Subsequently, in step S107, the signal generation unit 142 determines the driving state of the vehicle 100 based on the rotational speed information f1 and the accelerator information b1.

[0100] In step S107, the signal generation unit 142 determines the driving state of the vehicle 100 using the rotational speed information f1, the accelerator information b1, and the driving information g1. The regions K1 to K25 indicated by the driving information g1 indicate the driving state of the vehicle 100. The signal generation unit 142 determines, as the driving state of the vehicle 100, the region K corresponding to both the rotational speed of the virtual engine indicated by the rotational speed information f1 and the opening degree of the accelerator indicated by the accelerator information b1 from among the regions K1 to K25 indicated by the driving information g1.

[0101] Subsequently, in step S108, the signal generation unit 142 generates an audio signal c1 based on the driving state of the vehicle 100.

[0102] In step S108, the signal generation unit 142 generates an audio signal c1 using the driving state of the vehicle 100 and the audio information h1. First, the signal generation unit 142 reads out, as the corresponding audio data, the audio data M corresponding to the area K determined as the driving state of the vehicle 100 from among the audio data M1 to M25 indicated by the audio information h1. Subsequently, the signal generation unit 142 generates an audio signal c1 that indicates the sound indicated by the corresponding audio data in a multi-channel manner. The audio signal c1 includes an audio signal c1a for the speaker 5a and an audio signal c1b for the speaker 5b. Subsequently, the signal generation unit 142 provides the audio signal c1 (the audio signals c1a and c1b) to the audio-visual control unit 15.

[0103] Subsequently, in step S109, the audio-visual control unit 15 controls the sound localization of the sounds output from the speakers 5a and 5b based on the acceleration information.

[0104] In step S109, the audio-visual control unit 15 first determines the acceleration in the forward direction of the vehicle 100 based on the speed information a1. Hereinafter, the acceleration in the forward direction of the vehicle 100 is referred to as "forward acceleration". The audio-visual control unit 15 determines the acceleration information indicating the forward acceleration using the history of the speed information a1 stored in the storage device 11.

[0105] For example, the audio-visual control unit 15 first specifies the speed information a1 stored in the current step S102 as the speed information a1A. Subsequently, the audio-visual control unit 15 specifies the speed information a1 stored in the previous step S102 as the speed information a1B. Subsequently, the audio-visual control unit 15 specifies the speed difference by subtracting the speed of the vehicle 100 indicated by the speed information a1B from the speed of the vehicle 100 indicated by the speed information a1A. Subsequently, the audio-visual control unit 15 generates the acceleration information indicating the forward acceleration by dividing the speed difference by the time between the execution of the current step S102 and the execution of the previous step S102. When the speed information a1 stored in the previous step S102 does not exist in the storage device 11, the audio-visual control unit 15 uses "0" as the speed of the vehicle 100 indicated by the speed information a1B.

[0106] When the speed of the vehicle 100 indicated by the speed information a1A is greater than the speed of the vehicle 100 indicated by the speed information a1B, the speed information a1A indicates acceleration in the forward direction. When the speed of the vehicle 100 indicated by the speed information a1A is not greater than the speed of the vehicle 100 indicated by the speed information a1B, the speed information a1A does not indicate acceleration of the vehicle 100 in the forward direction.

[0107] When the forward acceleration is a positive value, the sound image control unit 15 sets the sound image localization of the sound output from the speakers 5a and 5b based on the forward acceleration. For example, when the speed information a1A indicates acceleration of the vehicle 100 in the forward direction, the sound image control unit 15 sets the sound image localization at a position shifted more in the forward direction of the vehicle 100 than when the speed information a1A does not indicate acceleration of the vehicle 100 in the forward direction.

[0108] The smaller the forward acceleration is, the closer the sound image control unit 15 brings the sound image localization to the first position i1. The larger the forward acceleration is, the closer the sound image control unit 15 brings the sound image localization to the second position i2.

[0109] FIG. 9 is a diagram showing an example of the relationship between the forward acceleration and the sound image localization (position of the sound image) in the x-axis 8a direction. The relationship between the forward acceleration and the sound image localization in the x-axis 8a direction is not limited to the relationship shown in FIG. 9. For example, the smaller the forward acceleration is, the closer the sound image localization may stepwise approach the first position i1. The larger the forward acceleration is, the closer the sound image localization may stepwise approach the second position i2.

[0110] The sound image control unit 15 moves the sound image localization of the sound output from the speakers 5a and 5b in the longitudinal direction of the vehicle 100 by controlling the amplitude of the sound signal c2a and the amplitude of the sound signal c2b based on the forward acceleration. Controlling the amplitude of the sound signal c2a and the amplitude of the sound signal c2b based on the forward acceleration is an example of controlling the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker based on vehicle information.

[0111] The audio control unit 15 moves the audio localization in the longitudinal direction of the vehicle 100 by, for example, changing the magnitude relationship between the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b.

[0112] FIG. 10 is a diagram showing a relationship Da between the sound pressure of the sound output from the speaker 5a and the forward acceleration, and a relationship Db between the sound pressure of the sound output from the speaker 5b and the forward acceleration.

[0113] The smaller the forward acceleration is, the smaller the audio control unit 15 makes the amplitude of the sound signal c2a. For this reason, the smaller the forward acceleration is, the smaller the audio control unit 15 makes the sound pressure of the sound output from the speaker 5a located at the front of the vehicle 100.

[0114] The smaller the forward acceleration is, the larger the audio control unit 15 makes the amplitude of the sound signal c2b. For this reason, the smaller the forward acceleration is, the larger the audio control unit 15 makes the sound pressure of the sound output from the speaker 5b located at the rear of the vehicle 100.

[0115] The larger the forward acceleration is, the larger the audio control unit 15 makes the amplitude of the sound signal c2a. For this reason, the larger the forward acceleration is, the larger the audio control unit 15 makes the sound pressure of the sound output from the speaker 5a located at the front of the vehicle 100.

[0116] The larger the forward acceleration is, the smaller the audio control unit 15 makes the amplitude of the sound signal c2b. For this reason, the larger the forward acceleration is, the smaller the audio control unit 15 makes the sound pressure of the sound output from the speaker 5b located at the rear of the vehicle 100.

[0117] The speaker 5a outputs the virtual engine sound indicated by the sound signal c2a at a sound pressure corresponding to the amplitude of the sound signal c2a. The speaker 5b outputs the virtual engine sound indicated by the sound signal c2b at a sound pressure corresponding to the amplitude of the sound signal c2b. For this reason, the passenger can recognize the audio that moves back and forth according to the degree of acceleration of the vehicle 100.

[0118] Hereinafter, the operation shown in FIG. 8 is repeated until the operation unit 4 receives the end operation from the passenger.

[0119] A6: Summary of the First Embodiment When the speed information a1A indicates acceleration of the vehicle 100 forward, the audio-visual control unit 15 sets the audio-visual localization at a position shifted forward of the vehicle 100 compared to the audio-visual localization when the speed information a1A does not indicate acceleration of the vehicle 100 forward. When the vehicle 100 accelerates forward, the passenger receives a force directed rearward of the vehicle 100. For this reason, when the vehicle 100 accelerates forward, the passenger obtains a feeling that the audio-visual moves forward of the vehicle 100 while receiving a force directed rearward of the vehicle 100. Therefore, compared with the case where the audio-visual does not move forward of the vehicle 100, the passenger is more likely to obtain a feeling of being pressed rearward of the vehicle 100 as the vehicle 100 accelerates forward. Thus, the passenger can obtain a sense of immersion in driving.

[0120] B: Modification The modified aspects in the first embodiment are shown below. Two or more aspects arbitrarily selected from the following aspects may be appropriately combined within a range where they do not conflict with each other.

[0121] B1: First Modification In the first embodiment, the audio-visual control unit 15 may move the audio-visual localization in the front-rear direction of the vehicle 100 without changing the magnitude relationship between the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b.

[0122] For example, the audio-visual control unit 15 controls the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b as shown in FIG. 11. The audio-visual control unit 15 controls the amplitude of the sound signal c2a and the amplitude of the sound signal c2b based on the forward acceleration to realize the relationships Da and Db shown in FIG. 11. Note that the second position i2 in the first modification is located rearward of the second position i2 in the first embodiment.

[0123] According to the first modification example, the audio-visual control unit 15 can move the audio-visual image forward of the vehicle 100 without adjusting, for example, the sound pressure of the sound output from the speaker 5b.

[0124] B2: Second modification example In the first embodiment and the first modification example, the audio-visual control unit 15 may set the sound localization of the sounds output from the speakers 5a and 5b based on the forward acceleration even when the forward acceleration is a negative value (when the vehicle 100 is decelerating).

[0125] FIG. 12 is a diagram showing an example of the relationship between the forward acceleration and the sound localization (position of the audio-visual image) in the x-axis 8a direction. When the forward acceleration is "0", the audio-visual control unit 15 sets the sound localization of the sounds output from the speakers 5a and 5b to the third position i3. The smaller the forward acceleration, the closer the audio-visual control unit 15 moves the sound localization of the sounds output from the speakers 5a and 5b to the first position i1. The larger the forward acceleration, the closer the audio-visual control unit 15 moves the sound localization of the sounds output from the speakers 5a and 5b to the second position i2.

[0126] The relationship between the forward acceleration and the sound localization (position of the audio-visual image) in the x-axis 8a direction is not limited to the relationship shown in FIG. 12. For example, the smaller the forward acceleration, the sound localization may gradually approach the first position i1. The larger the forward acceleration, the sound localization may gradually approach the second position i2.

[0127] For example, the audio-visual control unit 15 moves the sound localization of the sounds output from the speakers 5a and 5b in the front-rear direction of the vehicle 100 by changing the magnitude relationship between the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b.

[0128] FIG. 13 is a diagram showing the relationship Da between the sound pressure of the sound output from the speaker 5a and the acceleration in the forward direction, and the relationship Db between the sound pressure of the sound output from the speaker 5b and the acceleration in the forward direction. The audio control unit 15 realizes the relationships Da and Db shown in FIG. 13 by controlling the amplitudes of the sound signal c2a and the sound signal c2b based on the acceleration in the forward direction.

[0129] According to the second modification, when the vehicle 100 is decelerating, the passenger can obtain a feeling that the audio image moves. Therefore, the passenger can obtain a sense of immersion in driving.

[0130] B3: Third Modification In the first embodiment, the audio control unit 15 may set the audio localization when the speed information a1A indicates acceleration of the vehicle 100 forward to a position shifted rearward of the vehicle 100 compared to the audio localization when the speed information a1A does not indicate acceleration of the vehicle 100 forward.

[0131] The smaller the acceleration in the forward direction is, the closer the audio control unit 15 brings the audio localization of the sounds output from the speakers 5a and 5b to the second position i2. The larger the acceleration in the forward direction is, the closer the audio control unit 15 brings the audio localization of the sounds output from the speakers 5a and 5b to the first position i1.

[0132] FIG. 14 is a diagram showing an example of the relationship between the acceleration in the forward direction and the audio localization (position of the audio image) in the x-axis 8a direction. The relationship between the acceleration in the forward direction and the audio localization in the x-axis 8a direction is not limited to the relationship shown in FIG. 14. The smaller the acceleration in the forward direction is, the closer the audio localization may gradually approach the second position i2. The larger the acceleration in the forward direction is, the closer the audio localization may gradually approach the first position i1.

[0133] FIG. 15 is a diagram showing the relationship Da between the sound pressure of the sound output from the speaker 5a and the acceleration in the forward direction, and the relationship Db between the sound pressure of the sound output from the speaker 5b and the acceleration in the forward direction.

[0134] The smaller the forward acceleration is, the greater the audio control unit 15 makes the amplitude of the sound signal c2a provided to the speaker 5a located at the front of the vehicle 100. For this reason, the smaller the forward acceleration is, the greater the sound pressure of the sound output from the speaker 5a located at the front of the vehicle 100 by the audio control unit 15 becomes.

[0135] The smaller the forward acceleration is, the smaller the audio control unit 15 makes the amplitude of the sound signal c2b provided to the speaker 5b located at the rear of the vehicle 100. For this reason, the smaller the forward acceleration is, the smaller the sound pressure of the sound output from the speaker 5b located at the rear of the vehicle 100 by the audio control unit 15 becomes.

[0136] The greater the forward acceleration is, the smaller the audio control unit 15 makes the amplitude of the sound signal c2a provided to the speaker 5a located at the front of the vehicle 100. For this reason, the greater the forward acceleration is, the smaller the sound pressure of the sound output from the speaker 5a located at the front of the vehicle 100 by the audio control unit 15 becomes.

[0137] The greater the forward acceleration is, the greater the audio control unit 15 makes the amplitude of the sound signal c2b provided to the speaker 5b located at the rear of the vehicle 100. For this reason, the greater the forward acceleration is, the greater the sound pressure of the sound output from the speaker 5b located at the rear of the vehicle 100 by the audio control unit 15 becomes.

[0138] Also in the third modification example, the audio control unit 15 may move the sound image localization in the front-rear direction of the vehicle 100 without changing the magnitude relationship between the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b.

[0139] According to the third modification example, a passenger can recognize an audio image that moves rearward in response to an increase in the acceleration of the vehicle 100. When the vehicle 100 accelerates forward, the passenger receives a force directed rearward of the vehicle 100. For this reason, when the vehicle 100 accelerates forward, the passenger obtains a feeling that the audio image moves rearward of the vehicle 100 while receiving a force directed rearward of the vehicle 100. Therefore, compared with the case where the audio image does not move, the passenger may be more likely to obtain a feeling of moving rearward of the vehicle 100 together with the audio image as the vehicle 100 accelerates forward. Thus, the passenger can obtain a sense of immersion in driving.

[0140] B4: Fourth Modification Example In the first embodiment and the first to third modification examples, the audio control unit 15 may change the position of the audio image by executing an audio image localization process as shown in Patent Document 1 described above.

[0141] In the audio image localization process, the audio control unit 15 operates as follows, for example. The audio control unit 15 uses a sound transfer function (head-related transfer function: HRTF) in the space from the sound source arranged at the target position of the audio image to the ears of the passenger. The audio control unit 15 generates a sound signal c2a and a sound signal c2b by executing a convolution process based on the sound transfer function on the sound signal c1.

[0142] When the audio control unit 15 changes the position of the audio image by the audio image localization process, the localization of the audio image can be moved in the front-rear direction of the vehicle 100 regardless of the positional relationship between the speaker 5a and the speaker 5b. For this reason, when the audio control unit 15 changes the position of the audio image by the audio image localization process, the speaker 5b does not have to be located rearward of the speaker 5a. For example, the speaker 5b may be located to the right or left of the speaker 5a. Further, even when the speaker 5a and the speaker 5b are at the same positions as those shown in the first embodiment and the first to third modification examples, the audio image can be localized further forward than, for example, the second position i2.

[0143] According to the fourth modification example, regardless of the positional relationship between the speaker 5a and the speaker 5b, the sound image localization can be moved in the longitudinal direction of the vehicle 100.

[0144] B5: Fifth modification example In the first embodiment and the first to fourth modification examples, the vehicle 100 may have an acceleration sensor 91 that detects the acceleration in the forward direction.

[0145] FIG. 16 is a diagram showing an example of the vehicle 100 further including the acceleration sensor 91. The acquisition unit 13 acquires the output of the acceleration sensor 91, that is, the information indicating the acceleration in the forward direction. The audio control unit 15 may determine the acceleration in the forward direction by using the output of the acceleration sensor 91 acquired by the acquisition unit 13 instead of the speed information a1. The output of the acceleration sensor 91 is another example of the vehicle information regarding the acceleration in the longitudinal direction of the vehicle 100. The output of the acceleration sensor 91 is also an example of the information indicating the degree of acceleration in the longitudinal direction of the vehicle 100.

[0146] The generation unit 14 may use the output of the acceleration sensor 91 instead of the speed information a1. For example, the generation unit 14 determines whether the vehicle 100 is accelerating based on the output of the acceleration sensor 91. Further, instead of showing the correspondence relationship between the rotation speed of the virtual engine, the opening degree of the accelerator, and the running state of the vehicle 100, the running information g1 shows the correspondence relationship between the rotation speed of the virtual engine, the output of the acceleration sensor 91, and the running state of the vehicle 100. The generation unit 14 determines the running state of the vehicle 100 by using the running information g1, the rotation speed information f1, and the output of the acceleration sensor 91.

[0147] The generation unit 14 may generate the sound signal c1 corresponding to the output of the acceleration sensor 91 by using the information indicating the correspondence relationship between the output of the acceleration sensor 91 and the sound signal c1.

[0148] According to the fifth modification example, the audio control unit 15 can change the position of the sound image based on the output of the acceleration sensor 91.

[0149] B6: Sixth modification example In the first embodiment and the first to fifth modification examples, the vehicle 100 may include an acceleration sensor 92 that detects the acceleration of the vehicle 100 in the left - right direction.

[0150] FIG. 17 is a diagram showing an example of the vehicle 100 further including the acceleration sensor 92. The acceleration sensor 92 detects the acceleration in the right direction when the vehicle 100 turns right. The acceleration sensor 92 detects the acceleration in the left direction when the vehicle 100 turns left. The acquisition unit 13 may acquire the output of the acceleration sensor 92, that is, the information indicating the acceleration of the vehicle 100 in the left - right direction. The audio - visual control unit 15 may determine the acceleration of the vehicle 100 in the left - right direction using the output of the acceleration sensor 92 acquired by the acquisition unit 13.

[0151] The audio - visual control unit 15 may move the audio - visual localization of the sound output from the speakers 5a and 5b in the left - right direction of the vehicle 100 based on the output of the acceleration sensor 92. The audio - visual control unit 15 moves the audio - visual localization of the sound output from the speakers 5a and 5b in the left - right direction of the vehicle 100, for example, by executing an audio - visual localization process.

[0152] For example, the greater the acceleration in the right direction, the closer the audio - visual localization of the sound output from the speakers 5a and 5b is to the right end 100R of the vehicle 100. The greater the acceleration in the left direction, the closer the audio - visual localization of the sound output from the speakers 5a and 5b is to the left end 100L of the vehicle 100.

[0153] When the vehicle 100 accelerates in the right direction, the passenger receives a force directed toward the left of the vehicle 100. Therefore, when the vehicle 100 accelerates in the right direction, the passenger obtains a feeling that the audio - visual moves in the right direction of the vehicle 100 while receiving a force directed toward the left of the vehicle 100. Thus, compared with the case where the audio - visual does not move, the passenger is more likely to obtain a feeling of being pressed toward the left of the vehicle 100 as the vehicle 100 accelerates in the right direction. Therefore, the passenger can obtain a sense of immersion in driving.

[0154] When the vehicle 100 accelerates to the left, the passenger experiences a force directed to the right of the vehicle 100. Therefore, when the vehicle 100 accelerates to the left, the passenger obtains a feeling that the sound image moves to the left of the vehicle 100 while experiencing a force directed to the right of the vehicle 100. Accordingly, compared to the case where the sound image does not move, the passenger is more likely to feel being pressed against the right side of the vehicle 100 as the vehicle 100 accelerates to the left. Thus, the passenger can obtain a sense of immersion in driving.

[0155] The sound image control unit 15 may move the sound image localization of the sounds output from the speakers 5a and 5b closer to the left end 100L of the vehicle 100 as the acceleration in the right direction increases. In this case, the sound image control unit 15 moves the sound image localization of the sounds output from the speakers 5a and 5b closer to the right end 100R of the vehicle 100 as the acceleration in the left direction increases.

[0156] In this configuration, when the vehicle 100 accelerates to the right, the passenger obtains a feeling that the sound image moves to the left of the vehicle 100 while experiencing a force directed to the left of the vehicle 100. Accordingly, compared to the case where the sound image does not move, the passenger may be more likely to feel moving to the left of the vehicle 100 together with the sound image as the vehicle 100 accelerates to the right. Thus, the passenger can obtain a sense of immersion in driving.

[0157] Also, when the vehicle 100 accelerates to the left, the passenger obtains a feeling that the sound image moves to the right of the vehicle 100 while experiencing a force directed to the right of the vehicle 100. Accordingly, compared to the case where the sound image does not move, the passenger may be more likely to feel moving to the right of the vehicle 100 together with the sound image as the vehicle 100 accelerates to the left. Thus, the passenger can obtain a sense of immersion in driving.

[0158] In the sixth modification, the sound image control unit 15 omits the process of moving the sound image localization of the sounds output from the speakers 5a and 5b in the front-rear direction.

[0159] In the sixth modification example, when the audio control unit 15 does not omit the process of moving the sound image localization of the sound output from the speakers 5a and 5b in the front-rear direction of the vehicle 100, for example, by executing the sound image localization process, the sound image localization is moved in the front-rear direction.

[0160] In the sixth modification example, the generation unit 14 may generate the sound signal c1 corresponding to the output of the acceleration sensor 92 by using the information indicating the correspondence relationship between the output of the acceleration sensor 92 and the sound signal c1.

[0161] B7: Seventh modification example In the sixth modification example, the audio control unit 15 may move the sound image localization of the sounds output from the speakers 5a and 5b in the left-right direction by controlling the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b based on the output of the acceleration sensor 92. In this case, the speaker 5b is arranged to the left of the speaker 5a. For example, the speaker 5a is arranged in the front right door 7b, and the speaker 5b is arranged in the front left door 7a. The speaker 5a may be arranged in the rear right door 7d, and the speaker 5b may be arranged in the rear left door 7c.

[0162] When the audio control unit 15 moves the position of the sound image to the right, it increases the sound pressure of the sound output from the speaker 5a and decreases the sound pressure of the sound output from the speaker 5b. When the audio control unit 15 moves the position of the sound image to the left, it decreases the sound pressure of the sound output from the speaker 5a and increases the sound pressure of the sound output from the speaker 5b. The audio control unit 15 changes both the sound pressure of the sound output from the speaker 5a and the sound pressure of the sound output from the speaker 5b by controlling both the amplitude of the sound signal c2a and the amplitude of the sound signal c2b.

[0163] According to the seventh modification example, the audio control unit 15 can move the sound image localization of the sounds output from the speakers 5a and 5b in the left-right direction without executing the sound image localization process of moving the sound image localization in the left-right direction. In the seventh modification example, the audio control unit 15 omits the process of moving the sound image localization of the sounds output from the speakers 5a and 5b in the front-rear direction.

[0164] B8: Eighth Modification In the first embodiment, the first to seventh modifications, the audio - video control unit 15 may include the generation unit 14. In this case, the audio - video control unit 15 may generate the sound signal c1 based on vehicle information (for example, speed information a1, acceleration information, the output of the acceleration sensor 91, or the output of the acceleration sensor 92). For example, the sound data M1 to M25 shown in FIG. 7 are pre - associated with the acceleration that can be specified by the vehicle information, and the audio - video control unit 15 generates the sound signal c1 based on the sound data M corresponding to the acceleration specified by the vehicle information. The sound data M1 to M25 may indicate the waveform of the sound, the pitch of the sound, and the level of the sound. The sound data M1 to M25 are different from each other in at least one of the waveform shape, pitch, and level.

[0165] Also, the audio - video control unit 15 may indirectly control the audio - video localization from the vehicle information without directly controlling the audio - video localization from the vehicle information. For example, the audio - video control unit 15 may move the audio - video localization in the front - rear direction of the vehicle 100 or the left - right direction of the vehicle 100 based on the characteristics of the sound (for example, pitch or level) indicated by the sound signal c1 generated by the audio - video control unit 15.

[0166] Taking an example, the higher the pitch of the sound indicated by the sound signal c1, the closer the audio - video control unit 15 moves the audio - video localization to the first position i1. The lower the pitch of the sound indicated by the sound signal c1, the closer the audio - video control unit 15 moves the audio - video localization to the second position i2. The audio - video control unit 15 may also move the audio - video localization closer to the second position i2 as the pitch of the sound indicated by the sound signal c1 is higher. In this case, the audio - video control unit 15 moves the audio - video localization closer to the first position i1 as the pitch of the sound indicated by the sound signal c1 is lower.

[0167] The audio-visual control unit 15 may move the audio-visual localization closer to the first position i1 as the level of the sound indicated by the sound signal c1 is higher. In this case, the audio-visual control unit 15 moves the audio-visual localization closer to the second position i2 as the level of the sound indicated by the sound signal c1 is lower. The audio-visual control unit 15 may move the audio-visual localization closer to the second position i2 as the level of the sound indicated by the sound signal c1 is higher. In this case, the audio-visual control unit 15 moves the audio-visual localization closer to the first position i1 as the level of the sound indicated by the sound signal c1 is lower.

[0168] Instead of moving the audio-visual localization closer to the first position i1, the audio-visual control unit 15 may move the audio-visual localization closer to the right end 100R. In this case, instead of moving the audio-visual localization closer to the second position i2, the audio-visual control unit 15 moves the audio-visual localization closer to the left end 100L.

[0169] Instead of moving the audio-visual localization closer to the first position i1, the audio-visual control unit 15 may move the audio-visual localization closer to the left end 100L. In this case, instead of moving the audio-visual localization closer to the second position i2, the audio-visual control unit 15 moves the audio-visual localization closer to the right end 100R.

[0170] According to the eighth modification example, the audio-visual control unit 15 moves the audio-visual localization in the longitudinal direction of the vehicle 100 or in the left-right direction of the vehicle 100 based on the characteristics (pitch or level) of the sound (the sound output from the speakers 5a and 5b) indicated by the sound signal c1. For this reason, the passenger can obtain a sense of immersion in driving and can obtain a feeling that the audio-visual localization changes according to the change in the characteristics of the sound output from the speakers 5a and 5b.

[0171] B9: Ninth Modification Example In the first embodiment, the first modification example to the eighth modification example, the sound indicated by the sound signal c1 is not limited to the virtual engine sound, and may be, for example, the cry of an animal or a piece of music having a tempo equal to or higher than a reference tempo. The reference tempo is, for example, a tempo equal to or higher than the average heart rate of a human. A piece of music having a tempo equal to or higher than the reference tempo is another example of the sound corresponding to the acceleration of the vehicle. In the first embodiment, the first modification example to the eighth modification example, the vehicle 100 is not limited to an electric vehicle, and may be an automobile that runs using an engine as a power source. The virtual engine sound indicated by the sound signal c1 in the situation where the vehicle 100 is accelerating is an example of the sound corresponding to the acceleration of the vehicle.

[0172] C: Aspects grasped from the above-described embodiments and modification examples The following aspects are grasped from at least one of the above-described embodiments and modification examples.

[0173] C1: First aspect An audio-visual control device according to an aspect (first aspect) of the present disclosure includes an acquisition unit that acquires vehicle information related to acceleration in the front-rear direction of a vehicle, and an audio-visual control unit that moves the audio-visual localization of sound output from at least two speakers provided in the vehicle in the front-rear direction of the vehicle based on the vehicle information acquired by the acquisition unit.

[0174] According to this aspect, it is possible to move the audio-visual localization in the front-rear direction of the vehicle in conjunction with the acceleration in the front-rear direction of the vehicle. A passenger can more easily recognize the acceleration in the front-rear direction of the vehicle than when not recognizing the movement of the audio-visual localization. Therefore, the passenger can obtain a sense of immersion in driving.

[0175] C2: Second aspect In an example of the first aspect (second aspect), the at least two speakers include a first speaker and a second speaker located behind the first speaker, and the audio control unit controls the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker based on the vehicle information, thereby moving the sound image localization in the longitudinal direction of the vehicle. According to this aspect, for example, the sound image localization can be moved in the longitudinal direction of the vehicle without using a transfer function of sound.

[0176] C3: Third aspect In an example of the second aspect (third aspect), the audio control unit moves the sound image localization in the longitudinal direction of the vehicle by changing the magnitude relationship between the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker. According to this aspect, compared with a configuration in which the magnitude relationship between the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker is not changed, the amount of movement of the sound image localization in the longitudinal direction of the vehicle can be increased.

[0177] C4: Fourth aspect In an example of any one of the first aspect to the third aspect (fourth aspect), when the vehicle information indicates acceleration of the vehicle forward, the audio control unit sets the sound image localization at a position moved more forward in the vehicle than the sound image localization when the vehicle information does not indicate acceleration of the vehicle forward. According to this aspect, when the vehicle accelerates forward, the sound image localization moves forward. Therefore, when the vehicle accelerates forward, the passenger obtains a feeling that the sound image moves forward while being in a state of receiving a force toward the rear of the vehicle. Therefore, compared with the case where the sound image does not move, the passenger is more likely to obtain a feeling of being pressed against the rear of the vehicle as the vehicle accelerates forward. Thus, the passenger can obtain a sense of immersion in driving.

[0178] C5: Fifth aspect In an example of any one of the first to fourth aspects (the fifth aspect), the sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle. According to this aspect, when the vehicle accelerates, the passenger can obtain a feeling that the sound image localization of the sound corresponding to the acceleration of the vehicle moves in the front-rear direction.

[0179] C6: The sixth aspect In an example of any one of the first to fifth aspects (the sixth aspect), the sound output from the at least two speakers is a sound generated based on the vehicle information, and the sound image control unit moves the sound image localization in the front-rear direction of the vehicle based on the pitch or level of the sound output from the at least two speakers. According to this aspect, the passenger can obtain a sense of immersion in driving and can obtain a feeling that the sound image localization changes in response to a change in the pitch or level of the sound output from the speaker.

[0180] C7: The seventh aspect The sound image control device according to an aspect of the present disclosure (the seventh aspect) includes an acquisition unit that acquires vehicle information regarding acceleration in the left-right direction of the vehicle, and a sound image control unit that moves the sound image localization of the sound output from at least two speakers provided in the vehicle in the left-right direction of the vehicle based on the vehicle information acquired by the acquisition unit.

[0181] According to this aspect, it is possible to move the sound image localization in the left-right direction of the vehicle in conjunction with the acceleration in the left-right direction of the vehicle. The passenger can more easily recognize the acceleration in the left-right direction of the vehicle than when not recognizing the movement of the sound image localization. Therefore, the passenger can obtain a sense of immersion in driving.

[0182] C8: The eighth aspect In an example of the seventh aspect (eighth aspect), the at least two speakers include a first speaker and a second speaker located to the left of the first speaker, and the audio control unit controls the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker based on the vehicle information, thereby moving the sound image localization in the left-right direction of the vehicle. According to this aspect, for example, the sound image localization can be moved in the left-right direction of the vehicle without using the transfer function of sound.

[0183] C9: Ninth aspect In an example of the seventh aspect or the eighth aspect (ninth aspect), the sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle. According to this aspect, the passenger can obtain a feeling that the sound image localization of the sound corresponding to the acceleration of the vehicle moves in the left-right direction when the vehicle accelerates.

[0184] C10: Tenth aspect In an example of any one of the seventh aspect to the ninth aspect (tenth aspect), the sound output from the at least two speakers is a sound generated based on the vehicle information, and the audio control unit moves the sound image localization in the left-right direction of the vehicle based on the pitch or level of the sound output from the at least two speakers. According to this aspect, the passenger can obtain a sense of immersion in driving and can obtain a feeling that the sound image localization changes according to the change in the pitch or level of the sound output from the speaker.

[0185] C11: Eleventh aspect The audio control method according to an aspect of the present disclosure (eleventh aspect) is an audio control method realized by a computer, which acquires vehicle information regarding acceleration in the front-rear direction of the vehicle, and moves the sound image localization of the sound output from the at least two speakers in the front-rear direction of the vehicle based on the acquired vehicle information.

[0186] According to this aspect, in conjunction with the acceleration in the longitudinal direction of the vehicle, it is possible to move the sound image localization in the longitudinal direction of the vehicle. The passenger can more easily recognize the acceleration in the longitudinal direction of the vehicle than when not recognizing the movement of the sound image localization. Therefore, the passenger can obtain a sense of immersion in driving.

[0187] C12: Aspect 12 The sound control method according to an aspect (Aspect 12) of the present disclosure is a sound control method realized by a computer, which acquires vehicle information regarding acceleration in the lateral direction of the vehicle, and based on the acquired vehicle information, moves the sound image localization of the sound output from at least two speakers provided in the vehicle in the lateral direction of the vehicle.

[0188] According to this aspect, in conjunction with the acceleration in the lateral direction of the vehicle, it is possible to move the sound image localization in the lateral direction of the vehicle. The passenger can more easily recognize the acceleration in the lateral direction of the vehicle than when not recognizing the movement of the sound image localization. Therefore, the passenger can obtain a sense of immersion in driving.

Explanation of Reference Numerals

[0189] 1... Sound control device, 3... Wheel control unit, 4... Operation unit, 5a... Speaker, 5b... Speaker, 11... Storage device, 12... Processing device, 13... Acquisition unit, 14... Generation unit, 15... Sound control unit, 31... Motor, 32... Accelerator pedal, 33... Shift lever, 34... Motor control unit, 35... Power transmission unit.

Claims

1. An acquisition unit that acquires vehicle information related to acceleration in the longitudinal direction of the vehicle; A generation unit that generates a sound signal indicating a sound corresponding to the acceleration of the vehicle based on the sound information stored in the storage device and the vehicle information; An audio control unit that moves the sound image localization of the sound output from at least two speakers provided in the vehicle in the longitudinal direction of the vehicle based on the vehicle information; comprising: The sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle indicated by the sound signal; The sound output from the at least two speakers is a sound generated based on the vehicle information; The audio control unit moves the sound image localization in the longitudinal direction of the vehicle based on the level of the sound output from the at least two speakers; An audio control device.

2. The at least two speakers include a first speaker and a second speaker located behind the first speaker; The audio control unit moves the sound image localization in the longitudinal direction of the vehicle by controlling the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker based on the vehicle information; The audio control device according to claim 1.

3. The audio control unit moves the sound image localization in the longitudinal direction of the vehicle by changing the magnitude relationship between the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker; The audio control device according to claim 2.

4. The audio control unit sets the sound image localization when the vehicle information indicates acceleration of the vehicle forward to a position moved forward of the vehicle compared to the sound image localization when the vehicle information does not indicate acceleration of the vehicle forward; The audio control device according to any one of claims 1 to 3.

5. An acquisition unit that acquires vehicle information related to acceleration in the lateral direction of the vehicle; A generation unit that generates a sound signal indicating a sound corresponding to the acceleration of the vehicle based on the sound information stored in the storage device and the vehicle information; An audio control unit that moves the sound image localization of the sound output from at least two speakers provided in the vehicle in the lateral direction of the vehicle based on the vehicle information; comprising: The sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle indicated by the sound signal; The sound output from the at least two speakers is a sound generated based on the vehicle information; The audio-visual control unit moves the audio-visual localization in the left-right direction of the vehicle based on the levels of sounds output from the at least two speakers. An audio-visual control device. **Claim 6** The at least two speakers include a first speaker and a second speaker located to the left of the first speaker. The audio-visual control unit moves the audio-visual localization in the left-right direction of the vehicle by controlling the sound pressure of the sound output from the first speaker and the sound pressure of the sound output from the second speaker based on the vehicle information. The audio-visual control device according to claim 5. **Claim 7** An audio-visual control method implemented by a computer, comprising: acquiring vehicle information regarding acceleration in the front-rear direction of the vehicle; generating a sound signal indicating a sound corresponding to the acceleration of the vehicle based on the sound information stored in a storage device and the vehicle information; moving the audio-visual localization of the sound output from at least two speakers provided in the vehicle in the front-rear direction based on the vehicle information; the sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle indicated by the sound signal; the sound output from the at least two speakers is a sound generated based on the vehicle information; moving the audio-visual localization in the left-right direction of the vehicle based on the levels of the sounds output from the at least two speakers. An audio-visual control method. **Claim 8** An audio-visual control method implemented by a computer, comprising: acquiring vehicle information regarding acceleration in the left-right direction of the vehicle; generating a sound signal indicating a sound corresponding to the acceleration of the vehicle based on the sound information stored in a storage device and the vehicle information; moving the audio-visual localization of the sound output from at least two speakers provided in the vehicle in the left-right direction based on the vehicle information; the sound output from the at least two speakers is a sound corresponding to the acceleration of the vehicle indicated by the sound signal; the sound output from the at least two speakers is a sound generated based on the vehicle information; the audio-visual control unit moves the audio-visual localization in the left-right direction of the vehicle based on the levels of the sounds output from the at least two speakers. An audio-visual control method.

Images