Device and method for controlling a sound signal

Abstract

The task is to reduce the feeling of a driver sitting in and driving a mobile body that something is wrong by audibly compensating for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing an engine noise. Included are a sound effect generation unit, which generates a plurality of sound effects by means of a simulation engine noise as a sound signal that reproduces an engine noise generated in a mobile body or a simulator simulating the operation of the mobile body, and a sound image position control unit, which controls the sound image position as the position at which the sound image of the plurality of sound effects is localized, based on the acceleration of the mobile body or the simulator and an estimated value of the auditory acceleration as the acceleration that is physically perceived by the occupant of the mobile body or the simulator when hearing the engine noise.

Description

[Technical field]

[0001] The present disclosure relates to a device and a method for controlling a sound signal. [Background technology]

[0002] A passenger compartment sound field control device has been proposed, which can generate a vivid engine noise in the passenger compartment of a mobile vehicle, such as a motor vehicle, reflecting the driving conditions. A conventional technique proposed is a device (see patent document 1) that can enhance the realistic impression for a driver sitting in and driving a mobile vehicle by, for example, giving an artificially generated engine noise (simulated engine noise) an effect that reinforces the sense of space. [Previous state documents][Patent documents]

[0003] [Patent document 1] Patent publication no. JP 2007-10810 A [Summary of the invention][Problem to be solved by the invention]

[0004] However, the conventional technique described in patent document 1 has the following problem. A driver, for example, may feel that something is wrong if there is a difference between the actual acceleration of a vehicle and the acceleration physically perceived by the driver upon hearing an engine noise. Specifically, the driver may feel that something is wrong, e.g., that "the acceleration is not linear or delayed," if, when accelerating, only the engine speed increases and the vehicle speed does not increase. With the aforementioned conventional technique, the difference between the actual acceleration of the vehicle and the acceleration physically perceived by the driver upon hearing an engine noise cannot be audibly compensated for, so the feeling that something is wrong cannot be reduced for a driver sitting in and driving the vehicle.

[0005] The present disclosure serves to solve the above problem and aims to reduce the feeling of a driver sitting in and driving a mobile body that something is wrong by audibly compensating for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing an engine noise. [Means of solving the problem]

[0006] A sound signal control device according to the present disclosure comprises a sound effect generation unit that generates a plurality of sound effects by means of a simulation engine noise as a sound signal, which reproduces an engine noise generated in a mobile body or a simulator simulating the operation of the mobile body, and a sound image position control unit which, based on the acceleration of the mobile body or simulator and an estimated value of the auditory acceleration as acceleration physically perceived by an occupant of the mobile body or simulator when hearing the engine noise, controls the sound image position as the position where the sound image of the majority of sound effects is localized.

[0007] In a sound signal control method according to the present disclosure, by means of a sound effect generation unit using a simulation engine noise as a sound signal that reproduces an engine noise generated by a mobile body or a simulator simulating the operation of the mobile body, a plurality of sound effects are generated, and controlled by a sound image position control unit based on the acceleration of the mobile body or simulator and an estimated value of the auditory acceleration as acceleration that is physically perceived by an occupant of the mobile body or simulator when hearing the engine noise, the sound image position as the position at which the sound image of the majority of sound effects is localized. [Effects of the invention]

[0008] According to the present disclosure, the feeling that something is wrong can be reduced in a driver sitting in and driving a mobile body. [Brief explanation of the drawings] [ Fig. 1] Fig. Figure 1 is a block diagram showing the structure of the sound signal control device in a first embodiment. [ Fig. 2] Fig. Figure 2 is an example showing the specific construction of the sound signal control device in the first embodiment. [ Fig. 3] Fig. Figure 3 is a view showing the hardware setup of the sound signal control device in the first embodiment. [ Fig. 4] Fig. Figure 4 is a flowchart showing the operation of the sound signal control device in the first embodiment. [ Fig. 5] Fig. Figure 5 is a block diagram showing the structure of the sound signal control device in a second embodiment. [ Fig. 6] Fig. Figure 6 is a flowchart showing the operation of the sound signal control device in the second embodiment. [ Fig. 7] Fig. Figure 7 is a block diagram showing the structure of the sound signal control device in a third embodiment. [ Fig. 8] Fig. Figure 8 is a flowchart showing the operation of the sound signal control device in the third embodiment. [ Fig. 9] Fig. Figure 9 is a block diagram showing the structure of the sound signal control device in a fourth embodiment. [ Fig. 10] Fig. Figure 10 is a flowchart showing the operation of the sound signal control device in the fourth embodiment. [ Fig. 11] Fig. Figure 11 is a block diagram showing the structure of the sound signal control device in a fifth embodiment. [ Fig. 12] Fig. Figure 12 is a flowchart showing the operation of the sound signal control device in the fifth embodiment. [ Fig. 13] Fig. Figure 13 is a block diagram showing the structure of the sound signal control device in a sixth embodiment. [ Fig. 14] Fig. Figure 14 is a flowchart showing the operation of the sound signal control device in the sixth embodiment. [Forms for carrying out the invention]

[0009] The following embodiments are explained with reference to the drawings. The following embodiments are merely examples, and various modifications are possible within the scope of the present invention. In the explanation of the embodiments and in the drawings, identical or corresponding components are designated with the same reference numerals. Explanations of components designated with the same reference numerals are appropriately omitted or simplified. In the following embodiments, "unit" can also be appropriately interpreted as "circuit," "step," "sequence," or "process." First embodiment <aufbau>

[0010] A sound signal control device according to the first embodiment is based on Fig. 1 to Fig. 4 explained. Fig. Figure 1 is a block diagram showing the construction of a sound signal control device 1 according to the first embodiment.

[0011] In Fig. 1. The sound signal control device 1 consists of a sound effect generation unit 2 and a sound image position control unit 3. The sound effect generation unit 2 consists of a sound signal generation unit 4 and a sound signal control unit 5. The sound image position control unit 3 consists of an auditory acceleration estimation unit 6, a sound image position calculation unit 7, and a delay time calculation unit 8.

[0012] A mobile body 20 is a mobile body in which a driver 24 sits as a passenger and which can be moved by the driver 24 driving or steering. In addition to the driver 24, another passenger 25 may also sit as a passenger in the mobile body 20. The mobile body 20 is, for example, a motor vehicle, a two-wheeler, a truck, a railway, a ship, or an aircraft. The mobile body 20 comprises an engine 21, driven devices (not shown) such as a steering mechanism or vehicle wheels, and propulsion resources such as a battery or fuel. The engine 21 is, for example, an internal combustion engine such as a gasoline engine or a diesel engine, or an electric motor. The engine 21 can also be a hybrid structure in which an internal combustion engine and an electric motor are combined.

[0013] The mobile body 20 can also be a driving simulator that simulates the operation of the mobile body 20. The driving simulator simulates, for example, the movement or driving state of the mobile body 20, or the operation of the engine. The driving simulator includes a control device (not shown), such as a computer, to simulate the operation of the mobile body 20. The driving simulator can also include an audio device, such as a loudspeaker (not shown), or a display device, such as a screen (not shown), to convey the movement state of the mobile body 20 to the driver 24. The driving simulator can also include an enclosure in which the driver 24 can sit, just as in an actual mobile body. The control device of the driving simulator can generate a simulated engine noise, representing an engine noise simulating the operation of the engine 21.The control device of the driving simulator can change the volume, sound quality, frequency characteristics, etc., of the simulated engine noise according to the driving input of the driver 24, just as with an actual vehicle. The simulated engine noise can also be emitted by means of an audio device (e.g., a loudspeaker) installed in place of the engine 21 so that it is heard by the driver 24. The simulated engine noise can also be emitted through one or more of the loudspeakers 23a to 23d.

[0014] Unless otherwise stated, the following description of the mobile body 20 includes a driving simulator of the mobile body 20. Unless otherwise stated, the description also includes the motor noise generated by the motor 21 of the mobile body 20, including a simulation motor noise generated by the driving simulator of the mobile body 20.

[0015] The sound effect generation unit 2 generates a simulated engine noise 102 based on engine noise information 101. This simulated engine noise is a sound signal that reproduces an engine noise generated by the mobile body 20. The sound effect generation unit 2 then generates a plurality of sound effects 103 using a plurality of delay times 107, described below, and the simulated engine noise 102. The plurality of sound effects 103 expresses some or all of the sound effects 103a to 103d. If an individual explanation of the sound effects 103a to 103d is not required, they are summarized as the plurality of sound effects 103.

[0016] The sound image position control unit 3, based on the engine noise information 101 and speed information 104, controls a sound image position 106, which represents a position at which a sound image 26, created by means of the plurality of sound effects 103, is localized. The sound image is an auditory sound source that arises when one and the same sound acts on the left and right ear of a person from different directions. The driver 24 or a passenger 25 perceives the sound image 26 at the position represented by the sound image position 106.

[0017] The sound signal generation unit 4 uses the various pieces of information represented by the engine noise information 101 to generate the simulated engine noise 102, which is an audio signal that reproduces an engine noise generated by the mobile body 20. For example, the simulated engine noise 102 is a digital signal divided into a specific frame length (10 msec) with a sampling frequency of 16 kHz and an amplitude resolution of 16 bits, and is generated for each frame cycle. For the sake of simplicity, a frame cycle of 10 msec is specified and synchronized with the same time length as the frame length, although the frame cycle is not limited to 10 msec. For example, the frame cycle could also be 20 msec and have a different time length than the frame length (10 msec). In this case, for example,The simulation engine noise 102 is generated as a digital signal from two continuing frame parts of the frame with the same content.

[0018] The engine noise information 101 is information relating to the engine 21 with which the mobile body 20 is equipped, and may include engine speed information or engine shape information, e.g., internal combustion engine or electric motor. For example, the engine noise information 101 may also be synchronized with the frame cycle of the simulation engine noise 102 and acquired per specific frame cycle, the frame cycle of the engine noise information 101 being not limited to this. The cycle for acquiring the engine noise information 101 may also not be synchronized with the frame cycle of the simulation engine noise 102. The engine noise information 101 may also be information relating to a simulation engine noise generated by the driving simulator of the mobile body 20.

[0019] The engine speed information includes, for example, the rotational speed of the output shaft of engine 21 per unit of time or the number of discharges of the respective cylinders per unit of time. This engine speed information can be acquired, for example, via an ECU (Electronic Control Unit) 22 controlling engine 21. The engine speed information can also be estimated from an electrical signal from the ignition coil or from vibrations of engine 21. Furthermore, the engine speed information can also be obtained from signals derived from the rotational speed of a transmission, a drive shaft, or a drive pinion connected to engine 21. The engine speed information can also be acquired by the control unit controlling the driving simulator.

[0020] If, for example, engine 21 is an internal combustion engine, the engine's shape information refers to information concerning the shape of the internal combustion engine. Information regarding the shape of the internal combustion engine includes, for example, the number of cylinders, the number of rotors, the arrangement of the cylinders (inline, V, boxer, etc.), the ignition method (spark ignition, compression ignition, etc.), the presence / absence of a turbocharger, etc. If, for example, engine 21 is an electric motor, the engine's shape information also includes information concerning the shape of the electric motor. Information regarding the shape of the electric motor includes, for example, the number of electric motors, the output of the electric motor, etc. The information regarding the shape of the electric motor can also include information regarding the format of the simulated internal combustion engine and information regarding the shape or type of the simulated mobile body (e.g.,Sports cars, SUVs (Sport Utility Vehicles), motorcycles, buses, trucks, trains, ships, airplanes, etc.) are included.

[0021] The sound signal generation unit 4 can also generate the simulated engine noise 102 based on information other than the engine noise information 101. For example, the sound signal generation unit 4 can also record an engine noise in the passenger compartment or in the engine compartment of the mobile body 20 in real time using a microphone and generate the recorded engine noise as the simulated engine noise 102. Or the sound signal generation unit 4 can generate the simulated engine noise 102 by processing or correcting a previously recorded engine noise. Furthermore, the sound signal generation unit 4 can also, for example, detect vibrations of the engine 21 using a vibration sensor and generate the simulated engine noise 102 by estimating the engine noise based on the detected vibrations of the engine 21.Preferably, the simulation engine noise 102 is generated based on the shape of the mobile body 20; however, the shape of the mobile body 20 and the type of mobile body used for the simulation engine noise 102 can also be different. For example, if the mobile body 20 is a motor vehicle, the simulation engine noise 102 can also be the engine noise of an aircraft (e.g., the engine noise of a gas turbine). The simulation engine noise 102 can also be generated, for example, using a signal tone such as a sine wave or square wave.

[0022] The sound signal control unit 5 generates a plurality of sound effects 103 by delaying the simulation engine noise 102 according to a plurality of delay times 107 described below. More specifically, the sound signal control unit 5 generates sound effects 103a to 103d by delaying the simulation engine noise 102 according to the respective delay times 107a to 107d of the filters 9a to 9d. As with the simulation engine noise 102, the respective frame length of the sound effects 103a to 103d is, for example, 10 ms. The filters 9a to 9d are, for example, filters that change the phase of the signal. For example, the filters 9a to 9d are all-pass filters, phase shifters, or delay filters.

[0023] The sound effects 103a to 103d are emitted, for example, by means of loudspeakers 23a to 23d, directed towards the driver 24 sitting in the mobile body 20. If, in addition to the driver 24, a passenger 25 is also sitting in the mobile body 20, the generated sound effects 103a to 103d can also be emitted towards the passenger 25.

[0024] It will now be explained how, by means of an “acoustic vection”, which is a special feature of the sound signal control device of the present embodiment, a feeling of movement is given to the driver 24 sitting in the mobile body 20.

[0025] In general, an acceleration physically perceived by the driver 24 upon hearing an engine noise is a psychologically perceived acceleration based on the driver's past experiences. Specifically, the driver 24 feels an acceleration of the vehicle 20 when the volume of the engine noise increases with increasing engine speed and the frequency of the engine noise becomes higher.

[0026] Furthermore, a phenomenon based on perceptual psychology is known as visually induced self-movement (vection). Vection is the phenomenon whereby a viewer presented with a visual stimulus moving uniformly in a wide field of vision experiences an illusory self-movement in the opposite direction to this movement. As a concrete example, an observer sitting on a stationary train who sees a moving train on the opposite track will experience the illusory sensation that their train is moving. Generally, vection is a phenomenon related to visual perception; however, it is also known that vection occurs in auditory perception due to the movement of sounds. Vection in auditory perception is referred to as "acoustic vection."In the present embodiment, the “acoustic sensation” of the driver 24 is induced by the sound image position control unit 3 moving the localization position of the simulated engine noise 102 (i.e., the sound image 26). As a result, the driver 24, seated in the mobile body 20, perceives that the mobile body 20 is accelerating.

[0027] In the present application, a distinction is made between the accelerations physically perceived by the driver 24 when hearing the engine noise. A psychologically perceived acceleration based on the driver's past experiences is referred to as "auditory acceleration," while a physically perceived acceleration induced by a movement of the simulated engine noise 102 (i.e., acoustic vection) is referred to as "acoustic vection acceleration." Since the engine noise is also heard by a passenger 25 in addition to the driver 24, the definition of auditory acceleration and acoustic vection acceleration can include a passenger 25 as well.

[0028] Both acoustic vection acceleration and auditory acceleration are accelerations that the driver 24 physically perceives when hearing the engine noise; however, the characteristics of acoustic vection acceleration and auditory acceleration differ. Acoustic vection acceleration is perceived solely through the "movement" of the sound image 26. Therefore, acoustic vection acceleration is independent of the sound quality of the sound effects that make up the sound image. Furthermore, during acoustic vection acceleration, the driver 24 has the illusion that he is moving. As with physical acceleration (acceleration G), acoustic vection acceleration therefore has a characteristic similar to that of acceleration during actual movement.Therefore, with acoustic vection acceleration, the difference between the perceived acceleration and the actual acceleration of the mobile body 20 can be acoustically detected (staged). In other words, acoustic vection acceleration makes it possible to reduce the difference between the actual acceleration of the mobile body 20 and the acoustic vection acceleration (i.e., the psychologically perceived acceleration due to the increase in volume from the engine noise, rotational speed, etc.). By controlling the acoustic vection acceleration according to the difference between the perceived acceleration and the actual acceleration of the mobile body 20, it can be ensured that no excessive acoustic vection acceleration occurs.The control of the acceleration physically perceived by the driver (24) is based on the acoustic acceleration, thus reducing the driver's (24) feeling that something is wrong. This eliminates the driver's (24) dissatisfaction that "the acceleration is not linear or delayed." Furthermore, smooth driving is possible without the driver (24) having to apply even more throttle.

[0029] Furthermore, the position of the sound image 26 can be freely controlled by means of the psychoacoustic effect known as the "precedence effect." The "precedence effect" is the phenomenon that the same tone, emitted from two different directions, one of which is delayed, is perceived as a tone from the direction of the tone that first arrives at the ear. Due to the "precedence effect," the position of the sound image 26 changes according to the different arrival times of the tone from a plurality of different directions. In the sound signal control device of the present embodiment, the position of the sound image 26 can be freely controlled by controlling the respective delay time of the plurality of tone effects. That is, it can be ensured that the driver 24 perceives different changes in the position of the sound image 26.

[0030] The auditory acceleration assessment unit 6 estimates the auditory acceleration using the engine noise information 101 and outputs auditory acceleration information 105, which represents the assessed value of the auditory acceleration. The auditory acceleration information 105 can include not only the driver 24 but also a passenger 25. The auditory acceleration information 105 can be determined, for example, by a regression formula using linear regression analysis with data obtained beforehand through a sensory evaluation test. Formula (1) is an example of a regression formula. Using formula (1), the auditory acceleration A' can be estimated based on the change ΔR in the engine speed of engine 21. [Equation 1] A'=α⋅ΔR+β

[0031] Here, α and β are constants that were determined using a sensory evaluation test.

[0032] The sound image position control unit 7 calculates the sound image position 106 based on the auditory acceleration information 105 and the velocity information 104. This position represents the position of the sound image 26 perceived by the driver 24, which is the sound image generated by the plurality of sound effects 103. More specifically, the sound image position 106 is calculated such that the sound image 26 moves when there is a difference between the auditory acceleration A', which the driver 24 physically perceives based on the engine noise, and the actual acceleration A of the mobile body 20.

[0033] The velocity information 104 represents the actual speed and direction of movement of the mobile body 20. Apart from information from a vehicle speed sensor with which the mobile body 20 is equipped and the steering angle of the steering wheel, the velocity information 104 can be obtained, for example, from GPS (Global Positioning System), IMU (Inertial Measurement Unit), or an ECU 22 of the mobile body 20. For example, the velocity information 104 can also be acquired, like the frame cycle of the simulation engine noise 102, for a given frame cycle, without requiring synchronization with the simulation engine noise 102. The actual acceleration A of the mobile body 20 can be determined using the velocity information 104 by deriving the velocity of the mobile body 20 or the difference over a given time.Furthermore, the actual acceleration A of the mobile body 20 can also be determined directly using an acceleration sensor with which the mobile body 20 is equipped.

[0034] The delay time calculation unit 8 calculates a plurality of delay times 107 according to the sound image position 106, which represents the position at which the sound image 26 is localized. The plurality of delay times 107 comprises some or all of the delay times 107a to 107d. The calculation method for the delay times 107a to 107d is described below. If an individual explanation of the delay times 107a to 107d is not required, they are summarized as a plurality of delay times 107.

[0035] Fig. Figure 2 is an example showing the specific construction of the sound signal control device 1 according to the first embodiment. In the example in Fig. In the mobile body 20, the vehicle is a motor vehicle. The driver 24 and the passenger 25 are seated in the vehicle body 20. Loudspeakers 23a to 23d are arranged to surround the driver 24 and the passenger 25. Loudspeakers 23a and 23b are located in front of the driver 24 and the passenger 25. Loudspeakers 23c and 23d are located behind the driver 24 and the passenger 25.

[0036] A D / A 27 is a digital-to-analog converter that converts the majority of sound effects 103, which are digital signals, into analog signals. An amplifier 28 is, for example, an audio amplifier that amplifies the majority of sound effects 103 output by the D / A 27. The majority of amplified sound effects 103 are each sent to the loudspeakers 23a to 23d. The sound image 26 generated by the sound effects 103a to 103d is then perceived by the driver 24.

[0037] If there is a difference between the auditory acceleration A' that the driver 24 physically perceives and the actual acceleration A of the mobile body 20, the sound image position control unit 7 moves the sound image position so that an "acoustic vection" is induced. As in Fig. As shown in Figure 2, when the mobile body 20 is accelerated, for example the sound image 26 is moved from in front of the driver 24 to the rear (arrow “R” in Figure 2). Fig. 2) Furthermore, when the mobile body 20 slows down, for example the sound image 26 is moved from behind the driver 24 to the front (arrow “F” in Fig. 2) In this way, by moving the sound image 26, an “acoustic vection” can be induced in the driver 24, so that the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise can be audibly compensated.

[0038] Here, t is given as the number of the current frame, and A'(t) and A(t) are given as the auditory acceleration of the current frame and the actual acceleration of the mobile body 20 of the current frame, respectively. If the acceleration with which the sound image 26 moves (i.e., the acoustic vection acceleration) is defined as a(t) = A'(t) - A(t), and the direction of movement of the sound image 26 is restricted to the direction of movement of the mobile body 20, the distance (i.e., the displacement magnitude of the position of the sound image) Δx(t) by which the sound image 26 moves per frame can be expressed, for example, by formula (2). [Equation 2] x(t)=(1 / 2)a(t)⋅t2+v0⋅t+x0x(t−1)=(1 / 2)a(t−1)⋅(t−1)2+v0⋅(t−1)+x0Δx(t)=x(t)−x(t−1)

[0039] Here, x0 and v0 are the position of the sound image 26 at t = 0, and the speed of movement of the sound image 26 at t = 0, respectively. For example, x0 could be the mean position of the motor 21, and v0 = 0.

[0040] In formula (2), Δx(t), the difference between the sound image position (x(t)) of the current frame and the sound image position (x(t - 1)) of the previous frame of sound image 26, is greater the greater the difference between the auditory acceleration A' and the actual acceleration A of the mobile body 20. That is, the greater the difference between the two accelerations, the greater the distance by which sound image 26 moves. In the example of formula (2), the difference between the auditory acceleration A' and the actual acceleration of the mobile body 20 is compensated, and there is no limit to this compensation. For example, if the acceleration a(t) of the movement of sound image position 106 is ensured to be greater than the actual acceleration A of the mobile body 20, a stronger sensation of acceleration can be created.

[0041] The delay time calculation unit 8 calculates a plurality of delay times 107 according to the sound image position 106(x(t)), which represents the position at which the sound image 26 is localized. An example of the calculation of the delay times will now be explained, in which, as in Fig. Figure 2 shows that a line segment CL is defined as the midpoint between the driver 24 and the passenger 25, and the sound image 26 is moved forwards and backwards along this line segment CL. The midpoint indicates that the distance from any point on the line segment CL to the driver 25 and the distance from this point to the passenger 26 are equal. While the sound signal transmission characteristic (acoustic space characteristic) in the passenger compartment is actually influenced by reflection or diffraction due to the seats or windows, for the sake of simplicity, the passenger compartment is treated here as a sound field free from reflection or diffraction.

[0042] The effects of refraction or diffraction in the passenger compartment can be reduced, for example, by using filters with a characteristic inverse to the acoustic characteristics of the passenger compartment. For instance, the acoustic characteristics of the passenger compartment can be determined using an impulse response. Specifically, the impulse response can be obtained by emitting a reference signal, such as a time-stretched pulse (TSP), from the respective loudspeakers and acquiring this reference signal using a microphone installed at the driver's position. Filter coefficients can then be calculated from the impulse response, which have the inverse characteristics of the acoustic characteristics of the passenger compartment.By adding the filter coefficients of the inverse characteristic obtained in this way to the filter coefficients of filters 9a to 9d, it is possible to correct the tone effects 103a to 103d in signals where the effects of refraction or diffraction are eliminated.

[0043] First, the case is explained in which a sound image 26a is localized in the center between the two front speakers using only loudspeakers 23a and 23b. In this case, the distance from loudspeaker 23a to sound image 26a is equal to the distance from loudspeaker 23b to sound image 26a, so that the delay time 107a and the delay time 107b can have the same value. This makes the arrival time of the sound effect 103a emitted by loudspeaker 23a at sound image 26a equal to the arrival time of the sound effect 103b emitted by loudspeaker 23b at sound image 26a. Consequently, the sound image 26a generated by sound effect 103a and sound effect 103b is localized in the center between the two front speakers.

[0044] The case is then explained in which a sound image 26b is localized in the center between the two rear speakers using only loudspeakers 23c and 23d. As with the two front speakers, the delay times 107c and 107d can be set to the same value. This makes the arrival time of the sound effect 103c emitted by loudspeaker 23c at sound image 26b equal to the arrival time of the sound effect 103d emitted by loudspeaker 23d at sound image 26b. Consequently, the sound image 26b generated by sound effect 103c and sound effect 103d is localized in the center between the two rear speakers.

[0045] Next, the case is explained in which the sound image 26 is moved forwards and backwards along the line segment CL using the four loudspeakers 23a to 23d. If the delay times 107a to 107d are set to the same value, the sound effects 103a to 103d emitted by loudspeakers 23a to 23d all have the same arrival time at sound image 26. Consequently, sound image 26 is localized at the middle position of the four loudspeakers. Sound image 26 can apparently be considered to be a sound image generated by sound images 26a and 26b. Therefore, if a specific time difference is provided between the group of delay times 107a and 107b, and between the group of delay times 107c and 107d, the "precedence effect" arises between sound image 26a and sound image 26b. This causes the position of sound image 26 on line segment CL to change according to the time difference.To locate the sound image 26 in front of the center position of the four loudspeakers, the arrival times of the sound effects emitted by the front loudspeakers are advanced relative to the arrival times of the sound effects emitted by the rear loudspeakers. That is, the delay time of delay time group 107a and delay time 107b should be set shorter than the delay time of delay time group 107c and delay time 107d. Furthermore, to locate the sound image 26 behind the center position of the four loudspeakers, the arrival times of the sound effects emitted by the rear loudspeakers are advanced relative to the arrival times of the sound effects emitted by the front loudspeakers.This means that the delay time of delay time group 107c and delay time 107d should be set smaller than the delay time of delay time group 107a and delay time 107b. In other words, by controlling the delay times between the front and rear speakers, it is possible to move the sound image 26 forwards and backwards.

[0046] An example has been explained above in which the sound image 26 is moved forwards and backwards. Following the same principle, the sound image 26 can also be moved left and right. Specifically, a certain time difference can be provided between the delay times of the loudspeakers on the right side (i.e., the group with delay time 107a and delay time 107c) and the delay times of the loudspeakers on the right side (i.e., the group with delay time 107b and delay time 107d). Consequently, by controlling the respective delay time of the majority of sound effects, the position of the sound image 26 can be freely controlled.

[0047] The arrival time difference between the majority of sound effects 103 is determined according to the sound image position (x(t)) of the current frame, represented by the sound image position 106. The delay time calculation unit 8 calculates the respective delay times of the sound effects 103a to 103d based on the determined arrival time difference and outputs them as delay times 107a to 107d.

[0048] The respective installation positions of loudspeakers 23a to 23d are preferably arranged so that they are as in the example of Fig. 2 surround the driver 24 or the passenger 25, without any limitation. Since the interior shape of the mobile body 20 varies depending on the type of mobile body 20, the respective installation positions of the loudspeakers 23a to 23d can be modified accordingly. Furthermore, the height of the respective installation positions of the loudspeakers 23a to 23d is preferably based on, for example, the ear height of the driver 24 or the passenger 25, without any limitation. For example, the loudspeakers 23a to 23d can also be mounted on the ceiling of the mobile body 20 or near the footwell of the driver 24. The number of loudspeakers is also not limited to four, but can, for example, be five or more. With at least two loudspeakers, movement of the sound image position 26 is possible, for example, a configuration with two loudspeakers, loudspeaker 23a and loudspeaker 23c, is also possible.

[0049] In the example in Fig. 2. By moving the sound image 26 along the driver 24, a sensation of acceleration (or deceleration) is audibly compensated, and there are no restrictions on this. For example, the sound image 26 can also be moved from the right side to the left side (or from the left side to the right side) of the driver 24, according to the speed information 104. By moving the sound image 26 from left to right, a sensation of rotation of the vehicle 20 can be created for the driver 24, thus increasing driving satisfaction.

[0050] For example, Fig. In the following, the loudspeakers 23a to 23d are arranged horizontally, although there is no restriction to a horizontal arrangement of the loudspeakers. The loudspeakers can also be arranged at top-bottom positions of the driver 24, so that, for example, loudspeaker 23b is located at a head position of the driver 24 and loudspeaker 23d is located at a footwell position of the driver 24. By arranging the loudspeakers at top-bottom positions of the driver 24, the sound image 26 can also be moved in the top-bottom direction of the driver 24. By moving the sound image 26 in the top-bottom direction of the driver 24, for example, the feeling that something is wrong when driving a three-dimensionally moving mobile object (airplane, drone, submarine, etc.) can be reduced. <hardware>

[0051] The respective structures of the in Fig. The sound signal control device 1 shown in Figure 1 can be implemented, for example, by a computer as an information processing device in which a processor is built. Fig. Figure 3 is a view showing the hardware setup of the sound signal control device 1 according to the first embodiment. Fig. 3 The sound signal control device 1 consists of a processor 30, a memory 31, a storage device 32, an interface 33 and a signal path 34.

[0052] The computer containing the 30 processor could be a microcomputer for embedded devices or a system-on-a-chip (SoC). Alternatively, it could be a portable computer such as a smartphone or tablet.

[0053] Processor 30 controls the entire sound signal control device 1. Processor 30 could be, for example, a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), etc. Processor 30 can be a single processor or a multiprocessor. The sound signal control device 1 can also include, in addition to a computer, a processing circuit such as an ASIC (Application Specific Integrated Circuit), etc. The processing circuit can be a simple circuit or a complex circuit.

[0054] Memory 31 is a main storage device of the sound signal control device 1. For example, memory 31 stores the data required for the operation of processor 31. Memory 31 is, for example, a RAM (Random Access Memory).

[0055] The storage device 32 is an auxiliary storage device of the sound signal control device 1. The storage device 32 stores, for example, initial value data, programs, error logs, etc., required for the operation of the sound signal control device 1. The storage device 32 is, for example, a ROM (Read Only Memory), HDD (Hard Disk Drive), or SSD (Solid State Drive).

[0056] Interface 33 is an input / output interface for transmitting data to an external device connected to the sound signal control device 1. Interface 33 is, for example, a NIC (Network Interface Controller). In this example, the external device is... Fig. 3 e.g. around the D / A 27 or the ECU 22. Interface 33 inputs engine noise information 101 and speed information 104, output by the ECU 22, into the processor 30. Interface 33 outputs a plurality of sound effects 103, which are output by the processor 30, to the D / A 27. Interface 33 is also a device that inputs information and execution commands required for the control processing of the sound signal control device 1.

[0057] Signal path 34 is a transmission path (bus) for carrying out data transmission between the in Fig. 3 specified respective components of the sound signal control device 1.

[0058] The processor 30 reads an acoustic signal control program, stored in the storage device 32, into the memory 31 via the signal path 34. This program is executed by the processor 30, enabling the various processing operations of the acoustic signal control method to be implemented. The storage device 32 stores the program and the data for implementing the acoustic signal control method of the first embodiment. The acoustic signal control program can also be supplied from outside the acoustic signal control device 1 via the interface 33. Furthermore, the acoustic signal control program can also be provided by means of a computer-readable non-volatile storage medium (e.g., a CD (Compact Disc), DVD (Digital Versatile Disc), flash memory, etc.). That is, the acoustic signal control program can also be provided as a program product.

[0059] The sound signal control device 1 is installed in the mobile body 20, although there is no restriction on this. If the mobile body 20 is, for example, a driving simulator, it can also consist of a computer, etc., located at a different location than the mobile body 20. In this case, the various information from the mobile body 20 can be entered into the sound signal control device 1 on a computer, for example, by transmitting data via a communication network connected to interface 33. Furthermore, the majority of sound effects 103 generated by the sound signal control device 1 on a computer can be sent to the D / A27 of the mobile body 20, for example, via a communication network. The communication network is, for example, a wired or wireless network, a dedicated line such as a LAN (Local Area Network), etc., or the Internet. <betrieb>

[0060] Next, the operation of the sound signal control device in the first embodiment will be explained. Fig. Figure 4 is a block diagram illustrating the structure of the sound signal control device 1 in the first embodiment.

[0061] In step ST1, the sound signal generation unit 4 generates a simulation engine noise 102 using the engine noise information 101 (step ST1).

[0062] In step ST2, the auditory acceleration estimation unit 6 uses the engine noise information 101 to estimate the auditory acceleration and outputs auditory acceleration information 105, which represents information about the estimated value of the auditory acceleration (step ST2).

[0063] In step ST3, the sound image position control unit 7 calculates the sound image position 106 based on the auditory acceleration information 105 and the speed information 104, which represents the position of the sound image 26 perceived by the driver 24, which is the sound image 26 generated by means of the majority of sound effects 103 (step ST3).

[0064] In step ST4, the delay time calculation unit 8 calculates a plurality of delay times 107 according to the position represented by the sound image position 106. Specifically, it calculates the delay times of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as delay times 107a to 107d (step ST4).

[0065] In step ST5, the sound signal control unit 5 generates a plurality of sound effects 103 by delaying the simulation engine noise 102 according to the plurality of delay times 107 (step ST5).

[0066] It is sufficient if the processing of step ST1 takes place before the processing of step ST5, so that the processing of step ST1 can also take place after any of the processing of steps ST2 to ST4.

[0067] As stated above, the sound signal control device of the present embodiment generates a plurality of sound effects based on the motor noise information and the plurality of delay times by means of a simulation motor noise that reproduces a motor noise generated in the mobile body, and controls the delay times of the plurality of sound effects based on the motor noise information and the speed information, thereby controlling the sound image position, which represents the position at which the sound image generated by means of the plurality of sound effects is localized.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body. Second embodiment

[0068] In the first embodiment described above, the sound image position is controlled by delaying a plurality of sound effects, whereby the control method for the sound image position is not limited to delay. The sound image position can also be controlled, for example, by changing the volume of the plurality of sound effects. This is explained as the second embodiment.

[0069] Fig. Figure 5 is a block diagram showing the construction of the sound signal control device 1 according to the second embodiment. In comparison with Fig. The first new structure consists of an amplification calculation unit 10 and amplification control units 11a to 11d. The other structures and operations are the same as in [previous text]. Fig. 1, so that an explanation is omitted.

[0070] The gain calculation unit 10 calculates gains, which represent the volume of the majority of sound effects 103, according to the sound image position 106, which represents the position at which the sound image 26 is located. The resulting gains are output as a plurality of gains 108. The plurality of gains 108 comprises some or all of the gains 108a to 108d. If an individual explanation of the gains 108a to 108d is not required, they are summarized as a plurality of gains 108.

[0071] In the amplification calculation unit 10, a method generally referred to as "panning" can be used to change the position of the sound image 26 by controlling the volume of the majority of sound effects 103. Specifically, in the example of Fig. 2. To locate the sound image 26 in front of the center position of the four speakers, the volume of the sound effects emitted by the front speakers is increased relative to the volume of the sound effects emitted by the rear speakers. That is, the gain (i.e., the volume) of the group containing gain 108a and gain 108b should be greater than the gain (i.e., the volume) of the group containing gain 108c and gain 108d. Furthermore, to locate the sound image 26 behind the center position of the four speakers, the volume of the sound effects emitted by the rear speakers is increased relative to the volume of the sound effects emitted by the front speakers. That is, the gain of the group containing gain 108c and gain 108d should be greater than the gain of the group containing gain 108a and gain 108b.As a result, by controlling the respective volume of the majority of sound effects 103, the position of the sound image 26 can be freely controlled.

[0072] The sound signal control unit 5 generates a plurality of sound effects 103 by controlling the volume of the simulated engine noise 102 according to the plurality of gains 108. More specifically, the sound signal control unit 5 generates the sound effects 103a to 103d by controlling the volume of the simulated engine noise 102 according to the gains 108a to 108d using the gain control units 11a to 11d. For example, the gain control units 11a to 11d are devices that control the amplitude of a digital signal, such as an amplifier or a damper. The gain control units 11a to 11d can also have filters with an inverse characteristic to the acoustic room characteristic, as in the filters 9a to 9d shown in the first embodiment.

[0073] Fig. Figure 6 is a flowchart showing the operation of the sound signal control device 1 in the second embodiment. The respective processes from step ST1 to step ST3 are the same as those described in Figure 6. Fig. 1 are shown in the first embodiment, so an explanation is omitted.

[0074] In step ST4A, the gain calculation unit 10 calculates, according to the position represented by the sound image position 106, the plurality of gains 108, which represent the volume of the plurality of sound effects 103. Specifically, it calculates the gains of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as gains 108a to 108d (step ST4A).

[0075] In step ST5A, the sound signal control unit 5 generates a plurality of sound effects 103 by controlling the volume of the simulation engine noise 102 according to the plurality of amplifications 108 (step ST5A).

[0076] As described above, the sound signal control device of the present embodiment generates a plurality of sound effects based on the motor noise information and the plurality of amplifications representing the volume of the plurality of sound effects, by means of a simulation motor noise that reproduces a motor noise generated in the mobile body, and controls the amplifications of the plurality of sound effects based on the motor noise information and the speed information, thereby controlling the sound image position, which represents the position at which the sound image generated by means of the plurality of sound effects is localized.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body. Third embodiment

[0077] In the first embodiment described above, the sound image position is controlled by delaying a plurality of sound effects, whereby the control method for the sound image position is not limited to delay. The sound image position can, for example, also be controlled by adding reverberation to the plurality of sound effects. This is explained as the third embodiment.

[0078] Fig. 7 is a block diagram showing the structure of the sound signal control device 1 according to the third embodiment. In comparison with Fig. The new structures consist of a reverberation time calculation unit 12 and reverberation control units 13a to 13d. The other structures and operations are the same as in Fig. 1, so that an explanation is omitted.

[0079] The reverberation time calculation unit 12 calculates reverberation times, based on the sound image position 106, which represents the position where the sound image 26 is located. These reverberation times represent the duration of the reverberation of the majority of sound effects 103. The resulting reverberation times are output as a plurality of reverberation times 109. The reverberation times 109 represent a portion or all of the reverberation times 109a to 109d. If an individual explanation of the reverberation times 109a to 109d is not required, they are summarized as a plurality of reverberation times 109.

[0080] Generally, a sound source with a long reverberation time is likely to be affected by reflections or diffractions, so it is perceived as coming from a distance. Conversely, a sound source with a short reverberation time is likely to be affected by reflections or diffractions very little, so it is perceived as a nearby sound source. Consequently, by applying this principle and controlling the respective reverberation time of most sound effects, the position of the sound image can be controlled. Specifically, in the example of Fig. 2. To locate the sound image 26 in front of the central position of the four loudspeakers, the reverberation times of the sound effects emitted by the front loudspeakers are shortened compared to the reverberation times of the sound effects emitted by the rear loudspeakers. That is, the reverberation times of reverberation time group 109a and reverberation time 109b should be set shorter than the reverberation times of reverberation time group 109c and reverberation time 109d. Furthermore, to locate the sound image 26 behind the central position of the four loudspeakers, the reverberation times of the sound effects emitted by the rear loudspeakers are shortened compared to the reverberation times of the sound effects emitted by the front loudspeakers. That is, the reverberation times of reverberation time group 109c and reverberation time 108d should be set shorter than the reverberation times of reverberation time group 109a and reverberation time 109b.As a result, by controlling the respective reverberation times of the majority of sound effects 103, the position of the sound image 26 can be freely controlled.

[0081] The sound signal control unit 5 generates a plurality of sound effects 103 by applying reverberation to the simulated engine noise 102 according to the plurality of reverberation times 109. More specifically, the sound signal control unit 5 generates the sound effects 103a to 103d by controlling the reverberation time of the simulated engine noise 102 (in other words, by applying reverberation) according to the reverberation times 109a to 109d using the reverberation control units 13a to 13d. For example, the reverberation control units 13a to 13d are filters that generate reverberation, such as comb filters, etc. The reverberation control units 13a to 13d can also have filters with an inverse characteristic to the acoustic room characteristic, as with the filters 9a to 9d described in the first embodiment.

[0082] Fig. Figure 8 is a flowchart showing the operation of the sound signal control device 1 in the third embodiment. The respective processes from step ST1 to step ST3 are the same as those described in Figure 8. Fig. 1 are shown in the first embodiment, so an explanation is omitted.

[0083] In step ST4B, the reverberation time calculation unit 12 calculates, according to the position represented by the sound image position 106, the plurality of reverberation times 109, which represent the times during which the reverberation of the plurality of sound effects 103 continues. Specifically, it calculates the reverberation times of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as reverberation times 109a to 109d (step ST4B).

[0084] In step ST5B, the sound signal control unit 5 generates a plurality of sound effects 103 by applying a reverberation to the simulation engine noise 102 according to the plurality of reverberation times 109 (step ST5B).

[0085] As described above, the sound signal control device of the present embodiment generates a plurality of sound effects by means of a simulated motor noise that reproduces a motor noise generated by the mobile body, and controls the reverberation times of the plurality of sound effects based on the motor noise information and the speed information, thereby controlling the sound image position, which represents the position at which the sound image generated by means of the plurality of sound effects is localized.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body. Fourth embodiment

[0086] The setup of the first embodiment can also be combined with the setup of the second embodiment. Specifically, delay times can be generated for the majority of sound effects, and the volume of the delayed majority of sound effects can also be controlled. This is explained as the fourth embodiment.

[0087] Fig. Figure 9 is a block diagram showing the construction of the sound signal control device 1 according to the fourth embodiment. Compared with Fig. Each new structure is assigned the amplification calculation unit 10 and the amplification control units 11a to 11d. The other structures and operations are the same as in [previous example]. Fig. 1, so that an explanation is omitted.

[0088] The gain calculation unit 10 calculates gains, which represent the volume of the majority of sound effects 103, according to the sound image position 106, which represents the position at which the sound image 26 is located. The resulting gains are output as a plurality of gains 108.

[0089] The sound signal control unit 5 controls the volume of the majority of sound effects 103 according to the majority of amplifications 108. More specifically, the sound signal control unit 5 controls the volume of the sound effects 103a to 103d according to the amplifications 108a to 108d by means of the amplification control units 11a to 11d.

[0090] Humans perceive the position of a sound image by means of a slight difference in sound information generated in the left and right ear due to the position of a sound source, i.e., an object that produces sound waves. In the low-frequency range, the interaural time difference (ITD) is dominant, and in the high-frequency range, the interaural level difference (ILD) is dominant. Therefore, due to the frequency characteristics of the simulated engine noise 102 (i.e., the majority of sound effects 103), controlling the position of the sound image 106 solely by controlling the delay time or solely by controlling the volume can be difficult.Furthermore, if there is a large difference in delay times between the individual sound effects for the majority of sound effects 103, specifically if the difference in delay times generally exceeds 0.04 seconds, the majority of sound effects will no longer be localized as a single sound image. As a result, the majority of sound effects will be perceived as isolated echoes, so that no precedence effect is created. Therefore, if the control of delay times and the control of gains are combined when controlling the sound image position 106 using the majority of sound effects 103, the weaknesses of both control methods can be compensated for, and the sound image position 106 can be controlled precisely.

[0091] As a method combining the control of delay times and gains of the majority of sound effects 103, the sound image position 106 can be controlled, for example, by controlling the low-frequency components of the majority of sound effects 103 using delay times, and controlling the high-frequency components of the majority of sound effects 103 using gains. More specifically, delay times are calculated by the delay time calculation unit 8 for the low-frequency components of the simulation engine noise 102 below a certain threshold (e.g., frequency components below 2000 Hz), and gains are calculated by the gain calculation unit 10 for the high-frequency components of the simulation engine noise 102 greater than or equal to a certain threshold (e.g., frequency components greater than or equal to 2000 Hz).The specified threshold is not limited to 2000 Hz, but can also have a different value. For example, the specified threshold can be appropriately modified according to the frequency characteristics of the simulated motor noise 102 or the type of mobile body.

[0092] Regarding the calculation method for the delay times and gains, the control of the sound image position 106 by means of the delay times and gains can also be proportionally divided according to the frequency of the simulation engine noise 102, irrespective of a certain threshold value. For example, the proportion of control by the delay times and the control by the gains can be such that as the frequency of the simulation engine noise 102 increases (i.e., the majority of sound effects 103), the proportion of control by the gain increases.

[0093] As another method for combining the control of the delay times and the gains of the plurality of sound effects 103, for example, if the delay times of the plurality of sound effects 103 exceed a predetermined threshold (e.g., 0.04 seconds), the sound image position can be controlled by generating a volume difference corresponding to the respective delay times through the plurality of sound effects 103. More specifically, if the threshold representing the predetermined delay time difference is exceeded as a result of the calculation of the sound image position 106 by the sound image position calculation unit 7, the plurality of gains 108 are calculated by the gain calculation unit 10 instead of the delay time calculation unit 8, such that the sound image 26 is localized at the position representing the sound image position 106.The threshold representing the specific delay time difference is not limited to 0.04 seconds, but can also have a different value. For example, the threshold representing the specific delay time difference can also be appropriately modified according to the type of vehicle, the size of the passenger compartment, etc. Furthermore, regarding the calculation method for the delay times and the gains, a proportional distribution according to the length of the delay time is possible, regardless of the threshold representing a specific delay time. For example, the proportion of control for the delay times and the control of the gains can be such that the proportion of control through gain increases with increasing delay time.

[0094] Fig. Figure 10 is a flowchart showing the operation of the sound signal control device 1 in the fourth embodiment. The respective processes from step ST1 to step ST4 are the same as those described in Figure 10. Fig. 1 are shown in the first embodiment, so an explanation is omitted.

[0095] In step ST4A, the gain calculation unit 10 calculates the plurality of gains 108, which represent the volume of the plurality of sound effects 103, according to the position represented by the sound image position 106. Specifically, it calculates the gains of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as gains 108a to 108d (step ST4A).

[0096] In step ST5, the sound signal control unit 5 generates a plurality of sound effects 103 by delaying the simulation engine noise 102 according to the plurality of delay times 107 (step ST5).

[0097] In step ST6A, the sound signal control unit 5 controls the volume of the majority of sound effects 103 according to the majority of amplifications 108. More specifically, the sound signal control unit 5 controls the volume of the sound effects 103a to 103d according to the amplifications 108a to 108d by means of the amplification control units 11a to 11d (step ST6A).

[0098] As described above, the sound signal control device of the present embodiment generates a plurality of sound effects by means of a simulated motor noise that reproduces a motor noise generated in the mobile body, and controls the delay times of the plurality of sound effects and the amplifications of the plurality of sound effects based on the motor noise information and the speed information, thereby controlling the position of the sound image, which represents the position at which the sound image generated by means of the plurality of sound effects is localized.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body.

[0099] Furthermore, by combining the control of delay times and the control of gains in the sound signal control device of the present embodiment when controlling the sound image position by means of the plurality of sound effects, the weaknesses of both control methods can be compensated for and the sound image position can be controlled precisely. Fifth embodiment

[0100] The setup of the first embodiment can also be combined with the setup of the third embodiment. Specifically, the majority of sound effects can be delayed, and furthermore, the majority of sound effects can be given reverberation. This is explained as the fifth embodiment.

[0101] Fig. Figure 11 is a block diagram showing the construction of the sound signal control device 1 according to the fifth embodiment. Compared with Fig. Each new structure is equipped with the reverberation time calculation unit 12 and the reverberation control units 13a to 13d. The other structures and operations are the same as in [previous example]. Fig. 1, so that an explanation is omitted.

[0102] The reverberation time calculation unit 12 calculates reverberation times, which represent the times during which the reverberation of the majority of sound effects 103 continues, according to the sound image position 106, which represents the position at which the sound image 26 is located. The resulting reverberation times are output as a plurality of reverberation times 109.

[0103] The sound signal control unit 5 applies reverberation to the majority of sound effects 103, corresponding to the majority of reverberation times 109. More specifically, the sound signal control unit 5 controls (applies reverberation to) the reverberation times of sound effects 103a to 103d, corresponding to the reverberation times 109a to 109d, by means of the reverberation control units 13a to 13d.

[0104] Fig. Figure 12 is a flowchart showing the operation of the sound signal control device 1 in the fifth embodiment. The respective processes from step ST1 to step ST4 are the same as those described in Figure 12. Fig. 1 are shown in the first embodiment, so an explanation is omitted.

[0105] In step ST4B, the reverberation time calculation unit 12 calculates, according to the position represented by the sound image position 106, the plurality of reverberation times 109, which represent the times during which the reverberation of the plurality of sound effects 103 continues. Specifically, it calculates the reverberation times of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as reverberation times 109a to 109d (step ST4B).

[0106] In step ST5, the sound signal control unit 5 generates a plurality of sound effects 103 by delaying the simulation engine noise 102 according to the plurality of delay times 107 (step ST5).

[0107] In step ST6B, the sound signal control unit 5 controls the reverberation times of the majority of sound effects 103 according to the majority of reverberation times 109. More specifically, the sound signal control unit 5 controls the reverberation times of the sound effects 103a to 103d according to the reverberation times 109a to 109d by means of the reverberation control units 13a to 13d (step ST6B).

[0108] As described above, the sound signal control device of the present embodiment generates a plurality of sound effects by means of a simulated motor noise that reproduces a motor noise generated in the mobile body, controls the delay times of the plurality of sound effects based on the motor noise information and the speed information, and controls the reverberation times of the plurality of sound effects, thus controlling the sound image position, which represents the position at which the sound image generated by means of the plurality of sound effects is localized.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body.

[0109] By combining the control of delay times and the control of reverberation times in the sound signal control device of the present embodiment when controlling the sound image position by means of the plurality of sound effects, the weaknesses of the control by means of the delay times can also be compensated for and the sound image position can be controlled precisely. Sixth embodiment

[0110] The setup of the first embodiment can also be combined with the setup of the second embodiment and the setup of the third embodiment. Specifically, delay times can be generated for the majority of sound effects, the volume of the majority of sound effects can be controlled, and the majority of sound effects can be given reverberation. This is described as the sixth embodiment.

[0111] Fig. Figure 13 is a block diagram showing the construction of the sound signal control device 1 according to the sixth embodiment. Compared with Fig. Each new structure is equipped with the following: gain calculation unit 10, gain control units 11a to 11d, reverberation time calculation unit 12, and reverberation control units 13a to 13d. The other structures and operations are the same as in [previous example]. Fig. 1, so that an explanation is omitted.

[0112] The gain calculation unit 10 calculates gains, which represent the volume of the majority of sound effects 103, according to the sound image position 106, which represents the position at which the sound image 26 is located. The resulting gains are output as a plurality of gains 108.

[0113] The reverberation time calculation unit 12 calculates reverberation times, which represent the times during which the reverberation of the majority of sound effects 103 continues, according to the sound image position 106, which represents the position at which the sound image 26 is located. The resulting reverberation times are output as a plurality of reverberation times 109.

[0114] The sound signal control unit 5 controls the volume of the majority of sound effects 103 according to the majority of amplifications 108. More specifically, the sound signal control unit 5 controls the volume of the sound effects 103a to 103d according to the amplifications 108a to 108d by means of the amplification control units 11a to 11d.

[0115] Furthermore, the sound signal control unit 5 applies a reverberation to the majority of sound effects 103, corresponding to the majority of reverberation times 109. More specifically, the sound signal control unit 5 controls (i.e., applies a reverberation to) the reverberation times of the sound effects 103a to 103d, corresponding to the reverberation times 109a to 109d, by means of the reverberation control units 13a to 13d.

[0116] Fig. Figure 14 is a flowchart showing the operation of the sound signal control device 1 in the sixth embodiment. The respective processes from step ST1 to step ST4 are the same as those described in Figure 14. Fig. 1 are shown in the first embodiment, so an explanation is omitted.

[0117] In step ST4A, the gain calculation unit 10 calculates the plurality of gains 108, which represent the volume of the plurality of sound effects 103, according to the position represented by the sound image position 106. Specifically, it calculates the gains of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as gains 108a to 108d (step ST4A).

[0118] In step ST4B, the reverberation time calculation unit 12 calculates, according to the position represented by the sound image position 106, the plurality of reverberation times 109, which represent the times during which the reverberation of the plurality of sound effects 103 continues. Specifically, it calculates the reverberation times of the sound effects 103a to 103d, which are output by the filters 9a to 9d, and outputs these as reverberation times 109a to 109d (step ST4B).

[0119] In step ST5, the sound signal control unit 5 generates a plurality of sound effects 103 by delaying the simulation engine noise 102 according to the plurality of delay times 107 (step ST5).

[0120] In step ST6A, the sound signal control unit 5 controls the volume of the majority of sound effects 103 according to the majority of amplifications 108. More specifically, the sound signal control unit 5 controls the volume of the sound effects 103a to 103d according to the amplifications 108a to 108d by means of the amplification control units 11a to 11d (step ST6A).

[0121] In step ST6B, the sound signal control unit 5 controls the reverberation times of the majority of sound effects 103 according to the majority of reverberation times 109. More specifically, the sound signal control unit 5 controls the reverberation times of the sound effects 103a to 103d according to the reverberation times 109a to 109d by means of the reverberation control units 13a to 13d (step ST6B).

[0122] As described above, the sound signal control device of the present embodiment generates a plurality of sound effects by means of a simulated motor noise that reproduces a motor noise generated by the mobile body, and controls the delay times, volume, and reverberation times of the plurality of sound effects based on the motor noise and velocity information, thus controlling the position of the sound image, which represents the position where the sound image generated by means of the plurality of sound effects is located.The sound signal control device of the present embodiment can audibly compensate for the difference between the actual acceleration of the mobile body and the acceleration physically perceived by the driver when hearing the engine noise by moving the position at which the sound image of the simulated engine noise is located, so that the feeling that something is wrong can be reduced for a driver sitting in and driving the mobile body.

[0123] Because the sound signal control device of the present embodiment combines the control of delay times, volume, and reverberation times when controlling the sound image position using a plurality of sound effects, the weaknesses of the respective controls can be compensated for, and the sound image position can be controlled precisely.

[0124] In the sixth embodiment, the implementation of control via delay times, volume control, and reverberation time control was explained. Based on the sound signal control device of the sixth embodiment, the control of the delay times can also be omitted, with the aforementioned effects being achieved in the same way.

[0125] The characteristics of the respective embodiments described above can be combined with each other in a suitable manner. [Industrial applicability]

[0126] The sound signal control device according to the present disclosure can be applied to various mobile bodies, e.g., motor vehicles, railways, ships, or aircraft, or to simulators of mobile bodies. The sound signal control device according to the present disclosure is particularly suitable for application to a mobile body in which a driver sits and drives it, or to a driving simulator of a mobile body that simulates the driving state of the driver. [Explanation of reference symbols] 1 Sound signal control device 2 Sound effect generation unit 3 Sound image position control unit 4 Sound signal generation unit 5 Sound signal control unit 6. Auditory Acceleration Assessment Unit 7 Sound image position calculation unit 8 Delay time calculation unit 9a, 9b, 9c, 9d Filter 10 Gain Calculation Unit 11a, 11b, 11c, 11d Amplification control unit 12 Reverberation time calculation unit 13a, 13b, 13c, 13d Reverberation control unit 20 moving bodies 21 engine 22 ECU 23a, 23b, 23c, 23d Loudspeakers 24 drivers 25 passengers 26, 26a, 26b Sound image 27 D / A 28 amplifiers 30 processor 31 storage 32 Storage device 33 Interface 34 Signal path QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP 2007-10810 A

[0003] < / betrieb> < / hardware> < / aufbau>

Claims

[1] Sound signal control device comprising a sound effect generation unit that generates a plurality of sound effects by means of a simulation engine noise as a sound signal, which reproduces an engine noise generated in a mobile body or a simulator simulating the operation of the mobile body, and a sound image position control unit which, based on the acceleration of the mobile body or simulator and an estimated value of the auditory acceleration as acceleration physically perceived by an occupant of the mobile body or simulator when hearing the engine noise, controls the sound image position as the position where the sound image of the majority of sound effects is localized. [2] Sound signal control device according to claim 1, characterized by , that It also includes a delay time calculation unit, The delay time calculation unit, based on the acceleration of the mobile body or simulator and the estimated value of the auditory acceleration, calculates delay times for the majority of sound effects. and the sound image position control unit controls the sound image position according to the delay times. [3] Sound signal control device according to claim 1, characterized by , that It also includes an amplification calculation unit, The amplification calculation unit, based on the acceleration of the mobile body or simulator and the estimated value of the auditory acceleration, calculates amplifications that represent the volume of the majority of sound effects. and the sound image position control unit controls the sound image position according to the gains. [4] Sound signal control device according to claim 1, characterized by , that It also includes a reverberation time calculation unit, The reverberation time calculation unit, based on the acceleration of the mobile body or simulator and the estimated value of the auditory acceleration, calculates reverberation times of the majority of sound effects. and the sound image position control unit controls the sound image position according to the reverberation times. [5] Sound signal control device according to claim 1, characterized by , that It also includes a delay time calculation unit and a gain calculation unit. The delay time calculation unit, based on the acceleration of the mobile body or simulator and the estimated value of the auditory acceleration, calculates delay times for the majority of sound effects, and The amplification calculation unit, based on the acceleration of the mobile body or simulator and the estimated value of the auditory acceleration, calculates amplifications that represent the volume of the majority of sound effects. and the sound image position control unit controls the sound image position according to the delay times and the gains. [6] Sound signal control device according to claim 5, characterized by , that the sound image position control unit controls the sound image position by controlling the delay times of the low-frequency components of the majority of sound effects, and by controlling the gains representing the volume of the high-frequency components of the majority of sound effects. [7] Sound signal control device according to claim 5, characterized by , that The sound image position control unit controls the sound image position according to the delay times when the delay times are below a predetermined threshold. and it controls the sound image position according to the gains when the delay times are greater than or equal to the threshold. [8] Sound signal control device according to claim 5, characterized by , that the sound image position control unit controls the sound image position by increasing the proportion of control through amplification with increasing frequency of the majority of sound effects. [9] Sound signal control device according to claim 5, characterized by , that the sound image position control unit controls the sound image position by increasing the proportion of control through amplification with increasing delay times of the majority of sound effects. [10] Sound signal control method in which A plurality of sound effects can be generated by a sound effect generation unit using a simulation engine noise as a sound signal that reproduces an engine noise generated by a mobile body or a simulator simulating the operation of the mobile body. and the sound image position, as the position where the sound image of the majority of sound effects is localized, is controlled by a sound image position control unit based on the acceleration of the mobile body or simulator and an estimated value of the auditory acceleration as acceleration that is physically perceived by an occupant of the mobile body or simulator when hearing the engine noise.

Images