Sensory-based in-vehicle attention-calling method, system, and equipment

Abstract

The present invention provides a bodily sensation type in-vehicle attention method, system and equipment applied to an automobile. The in-vehicle attention method includes the steps of: acquiring an audio signal from an in-vehicle audio bus by a control unit; performing an acoustic characteristic analysis on the audio signal to extract an acoustic waveform on a time domain waveform of the audio signal; performing amplitude adjustment on a sine wave signal of the acoustic waveform to obtain a modulated sine wave signal after amplitude modulation; acquiring a control signal representing operation behavior information from an in-vehicle control bus by the control unit, the control signal matching the modulated sine wave signal according to a pre-set rule to generate a vibration signal, and the vibration signal is transmitted to the vibrator to perform a vibration attention. The bodily sensation type in-vehicle attention method of the present invention combines vibration attention with auditory attention to improve safety, and when there are multiple vibrators, it can cooperate with the control signal of the in-vehicle control bus to provide a vibration attention tailored to the user's operation behavior, thereby providing a better user experience.

Description

[Technical field]

[0001] The present invention relates to the technical field of automobiles, and in particular to a sensory in-vehicle attention warning method, a sensory in-vehicle attention warning system, an electronic device, and a computer-readable storage medium. [Background technology]

[0002] With the rapid development of automotive electronics technology, the technological advances in smart cockpits have greatly improved the user experience. Among them, the audio system, an important part of the smart cockpit, has made great progress, especially in terms of multimedia audio-visual entertainment. However, there has been little progress in terms of attention-grabbing functions such as in-vehicle notification sounds and system warnings.

[0003] In the prior art, most products still use traditional simple sound warnings, which cannot adapt to modern multi-functional and intelligent cockpits.

[0004] The prior art does not provide good warning effects, poor control effects, and poor user experience.

[0005] Therefore, there is a need to provide a new sensory in-vehicle attention warning method, system, and equipment to solve the above technical problems. Summary of the Invention [Problem to be solved by the invention]

[0006] The object of the present invention is to provide a sensory in-vehicle attention warning method, a sensory in-vehicle attention warning system, an electronic device, and a computer-readable storage medium, which are highly safe and provide an excellent user experience, in order to solve the above-mentioned technical shortcomings. [Means for solving the problem]

[0007] In order to achieve the above object, the following means for solving the problems are provided.

[0008] (First viewpoint) An embodiment of the present invention provides a haptic in-vehicle attention drawing method applied to an automobile, in which a vibrator is installed in advance and fixed to a seat of the automobile, the in-vehicle attention drawing method including the steps of: acquiring an audio signal from an in-vehicle audio bus by a control unit; performing an acoustic characteristic analysis on the audio signal to extract an acoustic waveform on a time-domain waveform of the audio signal; performing amplitude adjustment on a sine wave signal of the acoustic waveform to obtain a modulated sine wave signal after amplitude modulation; and acquiring a control signal representing operational behavior information from an in-vehicle control bus by the control unit, the control signal matching the modulated sine wave signal according to a predetermined rule to generate a vibration signal, and the vibration signal being transmitted to the vibrator to perform a vibration attention drawing.

[0009] Preferably, in the step of acquiring an audio signal from an in-vehicle audio bus by the control unit, the audio signal includes a vehicle presenting sound and a system presenting sound in the vehicle.

[0010] Preferably, the vehicle sound and the system sound include a notification sound, a system keystroke sound, and a safety warning sound.

[0011] Preferably, the step of performing acoustic characteristic analysis on the audio signal and extracting an acoustic waveform on a time domain waveform of the audio signal includes the steps of performing a speech envelope analysis on the audio signal and extracting an envelope waveform on the time domain waveform of the audio signal.

[0012] Preferably, in the step of performing an acoustic characteristic analysis on the audio signal and extracting an acoustic waveform on a time domain waveform of the audio signal, the extraction method satisfies the condition shown in the following relational expression: JPEG2025503346000002.jpg45134

[0013] Preferably, in the step of adjusting the amplitude of the sine wave signal of the acoustic waveform to obtain an amplitude-modulated sine wave signal, the method of the amplitude adjustment satisfies the condition shown in the following relational expression. JPEG2025503346000003.jpg13119Here, Signal mod (f,t) is the modulated sinusoidal signal after amplitude modulation, f is the operating frequency band of the transducer, and Signal sin (f,t) is the sinusoidal signal before amplitude modulation, and MAX [] means to perform a maximum value operation.

[0014] Preferably, the vibrator comprises a first vibrator and a second vibrator, the first vibrator being fixed to one side of the bottom of the seat and the second vibrator being fixed to the other side of the bottom of the seat, the first vibrator and the second vibrator being each electrically connected to an independent output channel of the control unit.

[0015] Preferably, the vibrator is one or more of a moving coil type vibrator, a moving iron vibrator, or a piezoelectric ceramic vibrator.

[0016] Preferably, the vibration alert includes a single-area vibration and a multi-area vibration, the single-area vibration being a vibration excited by a single or multiple of the oscillators, and the multi-area vibration being a vibration excited by transmitting different vibration signals to multiple of the oscillators.

[0017] (Second viewpoint) An embodiment of the present invention further provides a tactile in-vehicle attention system applied to an automobile, in which a vibrator is pre-installed and fixed to a seat of the automobile, the in-vehicle attention system including an acquisition module, an extraction module, a debug module, and a control module, the acquisition module is used by a control unit to acquire an audio signal from an in-vehicle audio bus, the extraction module is used to perform acoustic characteristic analysis on the audio signal and extract an acoustic waveform on a time-domain waveform of the audio signal, the debug module is used to perform amplitude adjustment on a sine wave signal of the acoustic waveform to obtain a modulated sine wave signal after amplitude modulation, the control module obtains a control signal representing operating behavior information from an in-vehicle control bus by the control unit, the control signal matches the modulated sine wave signal according to a pre-set rule to generate a vibration signal, and the vibration signal is sent to the vibrator to perform vibration attention.

[0018] (Third viewpoint) An embodiment of the present invention further provides an electronic device comprising a processing unit and a memory unit, wherein the memory unit stores a computer program executable by the processing unit, and the processing unit reads the computer program stored in the memory unit and executes the steps included in the above-mentioned sensory in-vehicle attention warning method.

[0019] (Fourth viewpoint) An embodiment of the present invention further provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processing unit, the computer-readable storage medium executes the steps included in the above-mentioned sensory in-vehicle attention warning method. Effect of the Invention

[0020] Compared with the prior art, the in-vehicle sensory attention method, system, electronic device and computer-readable storage medium of the present invention can obtain an audio signal from an in-vehicle audio bus by a control unit, perform an acoustic characteristic analysis on the audio signal, extract an acoustic waveform on a time domain waveform of the audio signal, perform amplitude adjustment on a sine wave signal of the acoustic waveform, obtain a modulated sine wave signal after amplitude modulation, obtain a control signal representing operation behavior information from an in-vehicle control bus by the control unit, and the control signal matches the modulated sine wave signal according to a pre-set rule to generate a vibration signal, and the vibration signal is sent to the vibrator to perform vibration attention. Combining such vibration attention with auditory attention not only improves safety, but also provides a better user experience by cooperating with the control signal of the in-vehicle control bus when there are multiple vibrators, thereby providing vibration attention tailored to the user's operation behavior. [Brief description of the drawings]

[0021] In order to more clearly describe the technical solutions in the embodiments of the present invention, the following briefly describes the drawings that need to be used in the description of the embodiments. The drawings in the following description are only some embodiments of the present invention. Those skilled in the art can obtain other drawings based on these drawings without creative work. [Figure 1] FIG. 2 is a flowchart of a sensory in-vehicle attention attracting method provided by an embodiment of the present invention. [Diagram 2] FIG. 1 is a schematic diagram of an interior layout and connections of a motor vehicle provided by an embodiment of the present invention. [Diagram 3] FIG. 2 is a structural block diagram of a control system for independent voice coils in a vehicle provided by an embodiment of the present invention. [Figure 4] 1 is a structural conceptual diagram of an electronic device provided according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, the technical solutions of the embodiments of the present invention will be described clearly and in detail with reference to the drawings related to the embodiments of the present invention. It should be noted that the embodiments described in the following content are only some embodiments of the present invention, and are not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are included in the scope of the claims of the present invention.

[0023] The present invention provides a sensory in-vehicle attention drawing method, which is applied to an automobile.

[0024] A vibrator is provided in advance and fixed to the seat of the vehicle. Preferably, a main driver's seat is provided in the vehicle, and the vibrator is attached to the main driver's seat. The vibrator is provided inside the seat 3, at the bottom position, or at the backrest position, but is not limited thereto.

[0025] Please refer to Figures 1 and 2. Figure 1 is a flow chart diagram of a sensory in-vehicle attention method provided by an embodiment of the present invention. Figure 2 is a schematic diagram of the in-vehicle layout and connections of an automobile provided by an embodiment of the present invention.

[0026] The sensory in-vehicle attention drawing method includes the following steps.

[0027] S1: The control unit 4 acquires an audio signal from the in-vehicle audio bus 5.

[0028] S2: Perform an acoustic feature analysis on the audio signal to extract an acoustic waveform of the audio signal on a time domain waveform.

[0029] S3: The sine wave signal of the acoustic waveform is subjected to amplitude adjustment to obtain an amplitude-modulated sine wave signal.

[0030] S4: A control signal representing operational behavior information is obtained from the in-vehicle control bus 6 via the control unit 4, and the control signal matches the modulated sine wave signal according to a pre-set rule to generate a vibration signal, and the vibration signal is sent to the vibrator to perform a vibration warning.

[0031] Here, the vibration signal is a sinusoidal signal within the operating range of the vibrator. According to need, the sinusoidal signal may be a single frequency signal or a multi-frequency signal, because signals of different frequencies can be adapted to various devices.

[0032] Specifically, the control unit 4 obtains an audio signal from the in-vehicle audio bus 5. The audio signal is subjected to an acoustic characteristic analysis to extract an acoustic waveform of the audio signal on a time domain waveform. The sine wave signal of the acoustic waveform is subjected to amplitude adjustment to obtain a modulated sine wave signal after amplitude modulation. The control unit 4 obtains a control signal representing operational behavior information from the in-vehicle control bus 6, and the control signal matches the modulated sine wave signal according to a pre-set rule to generate a vibration signal, which is then transmitted to the vibrator to perform a vibration alert. Combining such a vibration alert with an auditory alert not only improves safety, but also provides a better user experience when there are multiple vibrators, by cooperating with the control signal of the in-vehicle control bus 6 to provide a vibration alert tailored to the user's operating behavior.

[0033] In this embodiment, in step S1, the audio signal includes a vehicle sound and a system sound in the interior of the automobile.

[0034] In this embodiment, the vehicle sound and the system sound include notification sound, system keystroke sound, and safety warning sound. The vehicle sound and the system sound include, but are not limited to, notification sound, system keystroke sound, and various safety warning sounds, and may be any sound as long as it can form a presentation effect.

[0035] In this embodiment, step S2 includes the following sub-steps.

[0036] A voice envelope analysis is performed on the audio signal.

[0037] In acoustics, the voice envelope represents the change in the amplitude (energy) of the sound. Like data packets transmitted on the Internet according to the network protocol, the sound waves are transmitted one after another, and the transmission effect of the audio signal is good.

[0038] An envelope waveform of the audio signal is extracted on the time domain waveform.

[0039] The envelope of an acoustic waveform is the amplitude at the first and last moment of a single sound when it is produced by each sound, which is also called the envelope of the waveform. For example, with some instruments, the amplitude reaches a maximum value immediately when the instrument is plucked, blown, pulled, or snapped, and then the amplitude gradually decays, while with other instruments the amplitude is relatively small at the first moment, then gradually increases and then decays. These changes in the waveform envelope can affect the timbre of the instrument, distorting the natural envelope of the timbre.

[0040] In this way, a good envelope waveform of the audio signal can be obtained, which is convenient for processing the signal of the envelope waveform.

[0041] In this embodiment, the generated vibration signal refers to modulating the amplitude of the vibration signal according to the envelope amplitude of the time-domain waveform of an audio signal such as a vehicle sound and a system sound.

[0042] In the present embodiment, when extracting the envelope waveform of the audio signal on the time domain waveform, the extraction method satisfies the relationship shown in the following formula. JPEG2025503346000004.jpg46135

[0043] According to the above formulas (1) and (2), the control unit 4 can obtain the audio signal and the envelope waveform on the time domain waveform of the audio signal from the in-vehicle audio bus 5. This allows the amplitude adjustment of the sine wave signal of the envelope waveform to obtain a modulated sine wave signal after amplitude modulation. In addition, the control unit obtains a control signal representing operational behavior information from the in-vehicle control bus, and the control signal is matched with the modulated sine wave signal according to a rule set in advance to form a vibration signal, and the vibration signal is transmitted to the vibrator to execute vibration alerting.

[0044] In this embodiment, the amplitude adjustment method in step S3 satisfies the relationship shown in the following formula. JPEG2025503346000005.jpg14129Here, Signal mod (f,t) is the modulated sinusoidal signal after amplitude modulation, f is the operating frequency band of the transducer, and Signal sin (f,t) is the sinusoidal signal before amplitude modulation, and MAX [] means to perform a maximum value operation.

[0045] Performing the amplitude modulation according to the above equation (3) can obtain a better modulated sine wave signal, which is convenient to adapt to the operating frequency bands of various transducers.

[0046] In this embodiment, a plurality of the vibrators are provided, and the plurality of vibrators are each fixed to the seat 3. Specifically, the plurality of vibrators are fixed to the inside, bottom position, backrest position, or the like of the seat 3. By arranging the plurality of vibrators at different positions, it is possible to adapt to different movements.

[0047] In this embodiment, the vibrator comprises a first vibrator 1 and a second vibrator 2, the first vibrator 1 is fixed to one side of the bottom of the seat 3, and the second vibrator 2 is fixed to the other side of the bottom of the seat 3, and the first vibrator 1 and the second vibrator 2 are each electrically connected to independent output channels of the control unit 4.

[0048] Preferably, the plurality of transducers is not specifically limited to the above-mentioned first transducer 1 and second transducer 2, and may include three, four, five, etc. according to actual needs.

[0049] The control signal representing the operation behavior information obtained from the vehicle control bus 6 by the control unit 4 judges whether it is marching with the user's behavior, and sends different vibration signals to different vibrators to operate the vibrators. The logical algorithm for matching the vibration signal with the user's operation behavior is not limited here and can be defined according to the audio design of the vehicle product.

[0050] For example, in a case where the device is adapted for a user to operate the left and right turn signals, when the user operates the left turn signal, the vibration signal is transmitted only to the first transducer 1 on the left side, and when the user operates the right turn signal, the vibration signal is transmitted only to the second transducer 2 on the right side.

[0051] In this embodiment, the vibrator is one or more of a moving coil type vibrator, a moving iron vibrator, and a piezoelectric ceramic vibrator. Note that the vibrator is not limited to a moving coil type vibrator, a moving iron vibrator, and a piezoelectric ceramic vibrator, and any vibrator that performs a vibration function can be used.

[0052] In this embodiment, the vibration alert includes single-area vibration and multi-area vibration.

[0053] The single-domain vibration is a vibration excited by one or more of the oscillators.

[0054] The multi-area vibration is a vibration excited by transmitting different vibration signals to a plurality of the transducers.

[0055] The different vibration signals refer to vibration signals adapted according to the acquired operation behaviors of different users.

[0056] The acquired different user operation actions can be acquired, for example, by the control unit 4 of the vibrator reading the user operation information signal from the in-vehicle control bus 6, or the control unit 4 can transmit the user operation information signal directly to the vibrator.

[0057] In this embodiment, the control unit 4 is, but is not limited to, an independent external amplifier shared with the audio system, an independent amplifier that independently controls only the transducer, or an amplifier integrated into the vehicle host.

[0058] For the second embodiment, please refer to Fig. 3. Fig. 3 is a structural block diagram of a control system for an independent voice coil in a vehicle provided by an embodiment of the present invention.

[0059] The embodiment of the present invention further provides a sensory in-vehicle attention drawing system 20 for use in an automobile. The sensory in-vehicle attention drawing system 20 is provided with a vibrator in advance, and the vibrator is fixed to a seat 3 of the automobile. The in-vehicle attention drawing system 20 includes an acquisition module 22, an extraction module 23, a debug module 24, and a control module 21.

[0060] The acquisition module 22 is used by the control unit 4 to acquire the audio signal from the vehicle audio bus 5 .

[0061] The extraction module 23 is used to perform an acoustic feature analysis on the audio signal and extract the acoustic waveform of the audio signal on a time domain waveform.

[0062] The debug module 24 is used to perform amplitude adjustment on the sine wave signal of the acoustic waveform to obtain an amplitude-adjusted modulated sine wave signal.

[0063] The control module 21 acquires a control signal representing operational behavior information from the in-vehicle control bus 6 via the control unit 4, and the control signal is matched with the modulated sine wave signal according to a predetermined rule to generate a vibration signal, and the vibration signal is transmitted to the vibrator to perform a vibration warning.

[0064] Combining such vibration warnings with auditory warnings improves safety, while in the case of multiple vibrators, they can work in conjunction with control signals on the vehicle control bus 6 to provide vibration warnings that adapt to the user's operating behavior, providing a better user experience.

[0065] For the third embodiment, please refer to Fig. 4. Fig. 4 is a structural schematic diagram of an electronic device provided by an embodiment of the present invention.

[0066] An embodiment of the present invention further provides an electronic device 30. The electronic device includes a processing unit 31 and a storage unit 32. The storage unit 32 stores a computer program executable by the processing unit 31, and the processing unit 31 reads the computer program stored in the storage unit 32 and executes any one of the steps of the above-mentioned in-vehicle attention attracting method.

[0067] Specifically, the processing unit executes the following steps.

[0068] S1: The control unit acquires an audio signal from the in-vehicle audio bus.

[0069] S2: Perform an acoustic feature analysis on the audio signal to extract an acoustic waveform of the audio signal on a time domain waveform.

[0070] S3: The sine wave signal of the acoustic waveform is subjected to amplitude adjustment to obtain an amplitude-modulated sine wave signal.

[0071] S4: A control signal representing operational behavior information is obtained from the in-vehicle control bus via the control unit, and the control signal matches the modulated sine wave signal according to a pre-set rule to stop the vibration signal, and the vibration signal is sent to the vibrator to perform a vibration warning.

[0072] The electronic device provided by the embodiments of the present invention can realize various implementation modes and corresponding beneficial effects in the method-related embodiments, the details of which are omitted.

[0073] For the fourth embodiment, the present invention further provides a computer-readable storage medium, in which a computer program is stored, and the computer program is executed by a processing unit to execute the steps of the above-mentioned in-vehicle attention-attracting method and achieve the same technical effects. Details thereof are omitted.

[0074] A person skilled in the art of the present invention can understand all or part of the method of the electronic device in the embodiment, and can complete it by instructing the relevant hardware through a computer program. The program can be stored in a computer-readable storage medium, and when the program is executed, the process of each method listed in the embodiment can be executed. In addition, the storage medium can be, for example, a magnetic disk, an optical disk, a read-only storage medium (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

[0075] The above contents are merely embodiments of the present invention and do not limit the scope of the claims of the present invention. Various modifications and changes made based on the description of the present invention and the contents of the accompanying drawings, or direct / indirect use in other related technical fields, are all included in the scope of the claims of the present invention.

Claims

1. A sensory in-vehicle attention drawing method applied to a vehicle, comprising: a vibrator that is installed in advance and fixed to a seat of the vehicle; The in-vehicle attention calling method includes: acquiring an audio signal from an in-vehicle audio bus by a control unit; performing an acoustic feature analysis on the audio signal to extract an acoustic waveform on a time domain waveform of the audio signal; performing amplitude adjustment on the sine wave signal of the acoustic waveform to obtain an amplitude-modulated modulated sine wave signal; a step of acquiring a control signal representing operational behavior information from an in-vehicle control bus by the control unit, matching the modulated sine wave signal with the control signal according to a predetermined rule to generate a vibration signal, and transmitting the vibration signal to the vibrator to perform a vibration warning.

2. The sensory in-vehicle attention drawing method according to claim 1, characterized in that in the step of acquiring an audio signal from an in-vehicle audio bus by the control unit, the audio signal includes a vehicle sound and a system sound in the interior of the automobile.

3. 3. The sensory in-vehicle attention attracting method according to claim 2, wherein the vehicle sound and the system sound include a notification sound, a system keystroke sound, and a safety warning sound.

4. performing an acoustic characteristic analysis on the audio signal and extracting an acoustic waveform on a time domain waveform of the audio signal; performing a speech envelope analysis on said audio signal; 2. The sensory in-vehicle attention attracting method according to claim 1, further comprising a step of extracting an envelope waveform of the audio signal on the time domain waveform.

5. 5. The in-vehicle attention drawing method according to claim 4, wherein in the step of performing an acoustic characteristic analysis on the audio signal and extracting an acoustic waveform on a time domain waveform of the audio signal, the extraction method satisfies the condition shown in the following relational expression.

6. 6. The in-vehicle attention drawing method according to claim 5, wherein in the step of adjusting the amplitude of the sine wave signal of the acoustic waveform to obtain an amplitude-modulated sine wave signal, the method of adjusting the amplitude satisfies the condition shown in the following relational expression: Here, Signal ｍｏｄ (f,t) is the modulated sinusoidal signal after amplitude modulation, f is the operating frequency band of the transducer, and Signal ｓｉｎ (f, t) is the sinusoidal signal before amplitude modulation, and MAX [ ] means to perform a maximum value operation.

7. 2. The sensory in-vehicle attention drawing method according to claim 1, characterized in that the vibrator comprises a first vibrator and a second vibrator, the first vibrator is fixed to one side of the bottom of the seat, and the second vibrator is fixed to the other side of the bottom of the seat, and the first vibrator and the second vibrator are each electrically connected to independent output channels of the control unit.

8. 2. The sensory in-vehicle attention drawing method according to claim 1, wherein the vibrator is one or more of a moving coil type vibrator, a moving iron vibrator, and a piezoelectric ceramic vibrator.

9. The vibration alert includes a single-area vibration and a multi-area vibration, The single-domain vibration is a vibration excited by a single or multiple oscillators, 9. The in-vehicle attention drawing method according to claim 8, wherein the multi-area vibration is excited by transmitting different vibration signals to a plurality of the vibrators.

10. A sensory in-vehicle attention-attracting system for use in a vehicle, the sensory in-vehicle attention-attracting system including a vibrator pre-installed and fixed to a seat of the vehicle, the vibrator comprising: an acquisition module; an extraction module; a debug module; and a control module; The acquisition module is used by a control unit to acquire an audio signal from an in-vehicle audio bus; the extraction module is used to perform an acoustic feature analysis on the audio signal and extract an acoustic waveform on a time-domain waveform of the audio signal; The debug module is used to perform amplitude adjustment on the sine wave signal of the acoustic waveform to obtain an amplitude-modulated modulated sine wave signal; The control module obtains a control signal representing operational behavior information from an in-vehicle control bus by the control unit, the control signal matches the modulated sine wave signal according to a predetermined rule to generate a vibration signal, and the vibration signal is transmitted to the vibrator to perform a vibration warning.

11. An electronic device comprising a processing unit and a memory unit, wherein the memory unit stores a computer program executable by the processing unit, and the processing unit reads the computer program stored in the memory unit and executes steps included in the sensory in-vehicle attention warning method described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processing unit, the computer-readable storage medium executes steps included in the sensory in-vehicle attention warning method described in any one of claims 1 to 9.

Images