Navigation audio playing method, electronic equipment and readable medium

Abstract

The invention relates to the technical field of navigation, in particular to a navigation audio playing method, electronic equipment and a readable medium. The method comprises the following steps: detecting a navigation instruction input by a user; the navigation audio is played corresponding to the navigation instruction, in the process of playing the navigation audio, first audio equipment is adopted to play the first navigation audio, and when the first navigation audio is played, a first sound source direction relative to a user corresponds to a first navigation direction of the first navigation audio, for example, the first navigation direction is leftward; the first navigation audio is located on the left side of the user during playing; or a second audio device is adopted to play a second navigation audio, and when the second audio device plays the first navigation audio, a second sound source direction relative to the user corresponds to a second navigation direction of the second navigation audio. According to the scheme, the audio with the spatial direction can be generated, the navigation information is transmitted to the user by utilizing the spatial direction, and the response time of the user can be shortened.

Description

Technical Field

[0001] The present application relates to the field of navigation technology, and in particular to a navigation audio playback method, an electronic device and a readable medium. Background Art

[0002] With the continuous development of science and technology, navigation has become an indispensable tool for people to drive. When users need to drive to their destination, the navigation system can plan a route for them and generate corresponding navigation instructions, including navigation text and navigation voice, so that users can smoothly reach the preset destination.

[0003] The current navigation audio playback method usually takes the form of simply playing the navigation audio to provide the user with a verbal description of the navigation instructions. For example, after generating a navigation voice that is consistent with the navigation text, it is played directly through the terminal device or the car speaker. However, since the navigation audio usually has a certain length, it takes a certain amount of time for the user to finish listening to the navigation audio; and the user also needs to spend time to understand the voice content of the navigation audio, and this process often requires a certain amount of reaction time. In the event of complex road traffic conditions, the navigation text may become longer, and the navigation audio may also become longer, and the user may need to spend more time to understand the navigation information, so that the user does not have time to react to the navigation audio and fails to perform the corresponding driving operation in time, or before the navigation information is played, the user has missed the best time to operate, resulting in driving into an area that is not planned for the navigation route. Summary of the invention

[0004] The purpose of the present application is to provide a navigation audio playback method, an electronic device and a readable medium.

[0005] In a first aspect, the present application provides a navigation audio playing method, the method comprising: detecting a navigation instruction; playing the navigation audio in response to the navigation instruction, wherein, in the process of playing the navigation audio: using a first audio device to play the first navigation audio, wherein the first audio device plays the first navigation audio in a direction relative to a first sound source of a user, corresponding to a first navigation direction of the first navigation audio; using a second audio device to play the second navigation audio, wherein the second audio device plays the second navigation audio in a direction relative to a second sound source of the user, corresponding to a second navigation direction of the second navigation audio.

[0006] That is, in an embodiment of the present application, the method can be used for a navigation device, and the navigation device can include a terminal or a vehicle, and the user can be a driver in the vehicle. The navigation instruction is generated based on the user's operation, and the navigation instruction includes destination information. The first sound source direction and the second sound source direction can be the spatial audio sound source direction, that is, the direction of the virtual sound source generated when the spatial audio is played relative to the user. The spatial audio sound source direction can be represented by a directional angle and a pitch angle, that is, (directional angle, pitch angle), wherein the directional angle and the pitch angle are coordinate parameters based on spherical coordinates, and the origin of the coordinate system can be the user, and optionally, it can be the center of the user's head.

[0007] That is, in an embodiment of the present application, the first navigation direction and the second navigation direction may be different directions. Optionally, the first sound source direction corresponding to the first navigation direction and the second sound source direction corresponding to the second navigation direction may also be different directions. The first audio device and the second audio device may be different devices determined according to the first sound source direction and the second sound source direction, respectively. For example, if the first sound source direction is to the left, the first audio device may be a left speaker, or three speakers arranged in front of, in front of, and on the left side of the user, so that the angle of the played first navigation audio is 45° to the left relative to the user; if the second sound source direction is to the right, the second audio device may be a right speaker, or three speakers arranged in front of, in front of, and on the right side of the user, so that the angle of the played second navigation audio is 45° to the right relative to the user.

[0008] Through the navigation audio playback method provided by the present application, the direction of the spatial audio sound source can be determined according to the navigation text, and the navigation audio can be rendered and processed according to the direction of the spatial audio sound source to spatialize the navigation audio. For example: according to the navigation text instructing the user to turn left, the direction of the spatial audio sound source is determined to be left, and the direction of the spatial audio sound source is also left accordingly, and the navigation audio is further rendered into spatial audio with the direction of the spatial audio sound source to the left, and then the audio device is controlled to play the spatial audio, thereby making full use of the spatial audio capability of the audio device to provide the user with spatial audio with a virtual sound source direction, so as to more directly assist the user in driving according to the navigation and ensure that the user responds to the navigation instructions in a timely manner.

[0009] In a possible implementation of the first aspect, the method further includes: determining a first navigation audio and a first audio device based on a first navigation text and an alternative audio device corresponding to the navigation instruction, the first navigation text and the first navigation audio corresponding to each other. Determining a second navigation audio and a second audio device based on a second navigation text and an alternative audio device corresponding to the navigation instruction, the second navigation text and the second navigation audio corresponding to each other.

[0010] That is, in the embodiment of the present application, the alternative audio device may be an amplifier or headphones, and the amplifier may include multiple speakers arranged at different positions in the vehicle. The first navigation audio may be an audio generated based on the first navigation text, and the first navigation text may be generated based on the navigation instruction, that is, the destination information input by the user and the real-time location information of the navigation device acquired by the GPS positioning system in real time.

[0011] In a possible implementation of the first aspect above, the alternative audio device includes multiple speakers. The first navigation audio and the first audio device are determined based on the first navigation text corresponding to the navigation instruction and the alternative audio device; including: based on the first navigation direction corresponding to the first navigation text and the position information of the multiple speakers relative to the user, the target speaker is determined from the multiple speakers, and the sound intensity information of the target speaker is determined; based on the sound intensity information of the target speaker, the mono audio corresponding to the first navigation text is processed to obtain the first navigation audio; the first navigation audio includes the playback audio of each target speaker. The second navigation audio and the second audio device are determined based on the second navigation text corresponding to the navigation instruction and the alternative audio device; including: based on the second navigation direction corresponding to the second navigation text and the position information of the multiple speakers relative to the user, the target speaker is determined from the multiple speakers, and the sound intensity information of the target speaker is determined; based on the sound intensity information of the target speaker, the mono audio corresponding to the second navigation text is processed to obtain the second navigation audio; the second navigation audio includes the playback audio of each target speaker.

[0012] That is, in the embodiment of the present application, the position information of the plurality of speakers relative to the user may include placement position information and placement angle information. For example, the placement position information may include but is not limited to the left side of the user, the right side of the user, the front of the user, the back of the user, etc.; the placement angle information may include but is not limited to facing the user, at a 45° angle to the user, etc.

[0013] In a possible implementation of the first aspect above, the alternative audio device includes a wearable device, and the wearable device includes a first channel and a second channel. Determining the first navigation audio and the first audio device based on the first navigation text corresponding to the navigation instruction and the alternative audio device includes: determining the wearable device as the first audio device; performing spatial audio rendering processing on the mono audio corresponding to the first navigation text based on the first navigation direction corresponding to the first navigation text to obtain the first navigation audio; the first navigation audio includes the playback audio of the first channel and the playback audio of the second channel. Determining the wearable device as the second audio device; performing spatial audio rendering processing on the mono audio corresponding to the second navigation text based on the second navigation direction corresponding to the second navigation text to obtain the second navigation audio; the second navigation audio includes the playback audio of the second channel and the playback audio of the second channel.

[0014] That is, in an embodiment of the present application, the wearable device may be a headset supporting a spatial audio function, and the spatial audio rendering process may be a head-related transfer function (HRTF) rendering process.

[0015] In a possible implementation of the first aspect, the content of the first navigation audio includes at least one target keyword; and the first audio device is used to play the first navigation audio, including: corresponding to the at least one target keyword, indicating a first navigation direction, and using the first audio device to play the first navigation audio. The content of the second navigation audio includes at least one target keyword; and the second audio device is used to play the second navigation audio, including: corresponding to the at least one target keyword, indicating a second navigation direction, and using the second audio device to play the second navigation audio.

[0016] That is, in the embodiment of the present application, the at least one target keyword here may include a turn keyword, a distance keyword, and other keywords closely related to navigation instructions. Determining the spatial audio source direction based on these target keywords can make the spatial direction of the spatial audio correspond to the navigation purpose, thereby facilitating the user to understand the navigation intention through the spatial sound source direction.

[0017] In a possible implementation of the first aspect, at least one target keyword includes a turn keyword, and the turn keyword includes a horizontal turn keyword, a vertical turn keyword, and a straight keyword. The horizontal turn keyword includes left turn and right turn, and the vertical turn keyword includes uphill and downhill.

[0018] In a possible implementation of the first aspect, the at least one target keyword includes a distance keyword, and the distance keyword represents distance information between the navigation device and an intersection that the navigation device will arrive at.

[0019] That is, in the embodiment of the present application, the unit of the distance keyword here can be a distance measurement unit such as meter or kilometer, and the distance keyword can indicate the distance information between the navigation device and the target intersection where the navigation text indicates to turn. For example, the distance keyword can be 50 meters, 100 meters, and so on.

[0020] In a possible implementation of the first aspect, corresponding to at least one target keyword indicating a first navigation direction, a first audio device is used to play the first navigation audio, including: when a horizontal steering keyword and a distance keyword in at least one keyword correspond to the direction angle of the first sound source direction, and a vertical steering keyword and a distance keyword in at least one keyword correspond to the pitch angle of the first sound source direction, the first audio device is used to play the first navigation audio. Corresponding to at least one target keyword indicating a second navigation direction, a second audio device is used to play the second navigation audio, including: when a horizontal steering keyword and a distance keyword in at least one keyword correspond to the direction angle of the second sound source direction, and a vertical steering keyword and a distance keyword in at least one keyword correspond to the pitch angle of the second sound source direction, the second audio device is used to play the second navigation audio.

[0021] That is, in the embodiment of the present application, the direction angle may be the horizontal component of the direction, and the pitch angle may be the component of the direction. It can be understood that the first navigation direction corresponds to the first sound source direction, that is, the horizontal steering keyword and the distance keyword corresponding to the first navigation direction correspond to the direction angle of the first sound source direction, and the vertical steering keyword and the distance keyword corresponding to the first navigation direction correspond to the pitch angle of the first sound source direction.

[0022] For example, based on the horizontal steering keyword - turn left, the first navigation direction is determined to be left, and the corresponding direction angle of the first sound source direction, that is, the spatial audio direction angle, can be negative; based on the distance keyword -50 meters, since 50 meters is less than the preset distance of 100 meters, the size of the direction angle corresponding to the first sound source direction is the first preset angle, such as 30°; the above-mentioned horizontal steering keyword, distance keyword and the direction angle of the first sound source direction -30° correspond. Based on the vertical steering keyword - downhill, the direction angle of the first sound source direction is determined to be negative; based on the distance keyword -50 meters, since 50 meters is less than the preset distance of 100 meters, the size of the pitch angle of the first sound source direction is determined to be the third preset angle, such as 15°; the above-mentioned horizontal steering keyword, distance keyword and the direction angle of the first sound source direction -30° and the pitch angle of the first sound source direction -15° correspond. In the above example, the spatial direction of the played first navigation audio relative to the user is (-30°, -15°).

[0023] In a second aspect, an embodiment of the present application provides an electronic device, comprising: a memory for storing instructions executed by one or more processors of the electronic device, and a processor for executing instructions of the navigation audio playback method of the first aspect.

[0024] In a third aspect, an embodiment of the present application provides a readable medium having instructions stored thereon, and when the instructions are executed on an electronic device, the electronic device executes the navigation audio playback method of the first aspect.

[0025] In a fourth aspect, an embodiment of the present application provides a computer program product, including: a non-volatile computer-readable storage medium, the non-volatile computer-readable storage medium containing a computer program code for executing the navigation audio playback method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0027] Figure 1 According to the present application, a schematic diagram of a navigation audio playback scenario is shown;

[0028] Figure 2 According to an embodiment of the present application, a structural schematic diagram of a vehicle 102 is shown;

[0029] Figure 3 According to an embodiment of the present application, a schematic diagram of the position of a vehicle-mounted speaker is shown;

[0030] Figure 4 According to an embodiment of the present application, a schematic diagram of a hardware framework of a terminal 101 is shown;

[0031] Figure 5 According to an embodiment of the present application, a schematic diagram of the structure of a mobile phone-earphone is shown;

[0032] Figure 6 According to an embodiment of the present application, a flowchart of a navigation audio playback method is shown;

[0033] Figure 7 According to an embodiment of the present application, a schematic diagram of a process for generating spatial audio is shown;

[0034] Figure 8 According to an embodiment of the present application, a flowchart of a navigation audio playback method is shown;

[0035] Fig. 9 According to an embodiment of the present application, a software structure block diagram of a terminal 101 is shown. DETAILED DESCRIPTION

[0036] The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings.

[0037] Please refer to Figure 1 , Figure 1According to the present application, a schematic diagram of a navigation audio playback scenario is shown.

[0038] according to Figure 1 As shown in the figure, a navigation audio playback scenario includes a terminal 101 and a vehicle 102. Optionally, the terminal 101 and the vehicle 102 may be connected via a wireless link or a wired link, which is not limited in the present disclosure.

[0039] It is understood that the terminal 101 can be a mobile phone, tablet computer, desktop, laptop, handheld computer, netbook, augmented reality (AR) / virtual reality (VR) device, smart TV, car computer, etc., and other electronic devices in which one or more processors are embedded or coupled, without limitation. The operating system running on the terminal 101 may include but is not limited to Android system, IOS system, Linux, Windows, etc. Optionally, the terminal 101 may include a global positioning system (GPS) module and navigation software. The GPS module can perform data collection tasks such as search tracking and positioning through GPS satellites, and the navigation software can continuously refresh the electronic map based on the information collected by the GPS module, so that the positioning on the map changes continuously.

[0040] It is understood that the vehicle 102 may include several sensor systems for sensing information about the vehicle's location. For example, the sensor system may include a positioning system, an inertial measurement unit, a radar, and a laser rangefinder. Among them, the positioning system may be a global positioning GPS system, or it may be a Beidou system or other positioning systems. The positioning system can be used to estimate the geographic location of the vehicle, such as the latitude and longitude information of the vehicle's location. The inertial measurement unit can sense the position and orientation changes of the vehicle based on the inertial acceleration rate. In one embodiment, the inertial measurement unit may be a combination of an accelerometer and a gyroscope. Radar can use radio signals to sense objects in the surrounding environment of the vehicle, and specific types may include laser radar, millimeter wave radar, and the like. In addition to sensing objects, radar can also be used to sense the speed, direction of travel, and the like of objects. The vehicle may also include a speaker system for playing in-vehicle audio.

[0041] In an optional embodiment, the navigation software in the terminal 101 can perform navigation operations and make navigation voice announcements through the speaker system of the vehicle 102. In another optional embodiment, the vehicle 102 can perform navigation operations based on the data provided by the above-mentioned sensor system through the navigation software, and make navigation voice announcements through the speaker system of the vehicle 102.

[0042] However, if the user is assisted in driving by simply playing the navigation audio, the user needs to spend time to understand the voice content of the navigation audio, and this process often requires a certain amount of reaction time. Moreover, in case of complex road traffic conditions, the navigation text may become longer, and the navigation audio may also become longer, so that the user needs to spend more time to understand the navigation information, so that the user does not react in time and fails to perform the corresponding driving operation in time, or after the navigation information is played, the user has missed the best operation time, resulting in driving into an area not planned by the navigation route. For example, the navigation text is "Turn left at the xx intersection 100 meters ahead to enter the xx road". When the user hears the xx intersection in the navigation audio, that is, before the navigation is played, the user has already driven the vehicle through the xx intersection, resulting in a failure to turn left in time, or the user has not had time to react to the navigation direction indicated by the navigation audio after listening to the navigation audio, and has already driven the vehicle through the xx intersection, resulting in a failure to turn left in time, resulting in driving into an area not planned by the navigation route.

[0043] In order to avoid the problem of users not reacting to navigation audio in a timely manner, the embodiment provided by the present application provides a navigation audio playback method, which can determine the playback mode of the navigation audio based on the navigation direction indicated by the navigation text, so that when the navigation audio is played, the sound source direction of the navigation audio heard by the user corresponds to the navigation direction indicated by the navigation content text, so that the user can judge the driving operation based on the sound source direction of the navigation audio and the navigation content to shorten the user's reaction time. For example, before the navigation audio is played, the user has already perceived the navigation direction based on the sound source direction of the navigation audio, and can prepare for the driving operation in advance to avoid driving into areas where the navigation route is not planned. For example, if the navigation text indicates that the navigation direction is to turn left ahead, it can be determined that when the navigation audio is played, the sound source direction of the navigation audio heard by the user needs to be 45° to the left.

[0044] Among them, the playback method of the navigation audio can be determined specifically by determining the audio device used to play the audio and the audio information of each audio device (such as sound intensity information) through the setting information of the audio device (such as the position setting information of multiple speakers configured in the vehicle) and the above-mentioned sound source direction to be achieved; the corresponding multi-channel audio is obtained according to the audio information of each audio device and the navigation audio, and then the multi-channel audio is distributed to each audio device.

[0045] For example, when the navigation text indicates that the navigation direction is to turn left ahead, and the audio device is a vehicle-mounted multi-speaker system including multiple speakers, based on the above method, it can be determined to select the speaker in front of the user and facing the user and the speaker on the left side of the user and facing the user for audio playback, and it can be determined that the sound intensity of the speaker in front of the user and facing the user needs to account for 50% of the total sound intensity, and the sound intensity of the speaker set on the left side of the user and facing the user needs to account for 50% of the total sound intensity, so that the sound source direction of the navigation audio heard by the user can be 45° to the left. At this time, two-way audio with a sound intensity of 50% of the total sound intensity can be generated based on the navigation audio (i.e., the mono audio corresponding to the navigation text), and distributed to the speaker in front of the user and facing the user and the speaker on the left side of the user and facing the user for audio playback.

[0046] In some embodiments, when the audio device is a headset with head tracking, that is, when the setting information of the audio device is an earphone located on the left side of the user and an earphone located on the right side of the user, the binaural impulse response function corresponding to the sound source direction can be determined based on the above-mentioned sound source direction to be achieved, and the navigation audio and the binaural impulse response function can be convolved to obtain two-way navigation audio containing left ear audio and right ear audio, and distributed to the left earphone and the right earphone for playback.

[0047] It should be noted that the above is only an example, and in other optional implementations, the audio device may also be other devices, or, when the audio device is a multi-speaker system, the multiple speakers may also be arranged in other ways.

[0048] In some embodiments, the navigation device may be a terminal 101 or a vehicle 102 . Specifically, a navigation audio playback method provided in an embodiment of the present application may be executed by the terminal 101 or the vehicle 102 .

[0049] In other embodiments, the terminal 101 or the vehicle 102 may also be connected to the server, specifically, via a wireless link or a wired link, which is not limited in the present disclosure. The server may execute a navigation audio playback method provided in an embodiment of the present application to generate spatial audio according to the navigation text and navigation audio sent by the terminal 101 or the vehicle 102, and send the spatial audio to the audio device for broadcasting.

[0050] Combine the following Figure 2 The structure of the vehicle 102 will be described.

[0051] Please refer to Figure 2 , Figure 2 According to an embodiment of the present application, a schematic structural diagram of a vehicle 102 is shown.

[0052] In some embodiments, the vehicle 102 may include a vehicle computer and a power amplifier, wherein the power amplifier may include at least two speakers. The vehicle computer may be connected to the power amplifier via a high definition multimedia interface (HDMI).

[0053] The car computer can be used to send a play instruction to the power amplifier via HDMI. The play instruction includes the rendered spatial audio, and the play instruction is used to instruct the power amplifier to play the spatial audio. Optionally, the number of multiple speakers included in the power amplifier can be greater than or equal to 2. Specifically, the multiple speakers can include at least a speaker arranged on the left side of the driver's seat and a speaker arranged on the right side of the driver's seat; optionally, the multiple speakers can also include speakers arranged in front of and behind the driver's seat, or include speakers arranged above and below the user.

[0054] Please refer to Figure 3 , Figure 3 According to an embodiment of the present application, a schematic diagram of the position of a vehicle-mounted speaker is shown. For example, the speaker can be set at a position as follows: Figure 3 As shown in the figure, specifically, the speakers may include speakers 01 and 02 arranged on both sides of the rear seat, speakers 03 and 04 arranged on both sides of the front seat of the vehicle, and speakers 05 and 06 arranged on both sides of the windshield. As an example, when the navigation text and navigation voice instruct the vehicle to go straight, the direction of the spatial audio sound source is forward, then speakers 05 and 06 make sounds, and other speakers do not make voice broadcasts. When the navigation voice instructs turning, the six speakers create different virtual sound source positions by emitting different sound intensities, so as to navigate the user through the changing virtual sound source positions. It should be understood that Figure 3 This is only an optional implementation, and the present application does not limit the number of speakers or the speaker configuration method.

[0055] In addition, it should be noted that Figure 2 The illustrated example is merely an exemplary architecture of the vehicle 102 provided by the present disclosure, and in actual applications, may include Figure 2 The one or more modules shown in the figure are not limited in this embodiment.

[0056] Figure 4 According to an embodiment of the present application, a schematic diagram of a hardware framework of a terminal 101 is shown. The terminal 101 may be a smart home device that supports a Wi-Fi network, such as a mobile phone, a car computer, a tablet computer, a personal digital assistant (PDA), a Wi-Fi router, a smart speaker, a smart socket, a smart switch, etc. The embodiment of the present application does not impose any restrictions on the specific type of the terminal 101.

[0057] like Figure 4 As shown, the terminal 101 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0058] Among them, the above-mentioned sensor module 180 may include sensors such as a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor and an ambient light sensor.

[0059] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The processor can be used to execute a navigation audio playback method provided in an embodiment of the present application.

[0060] A memory may also be provided in the processor 110 for storing instructions and data corresponding to a navigation audio playback method provided in an embodiment of the present application. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0061] In one embodiment, the processor 110 of the terminal 101 calls the program instructions stored in the memory to execute the navigation audio playback method mentioned in the present application according to the obtained program instructions: obtaining navigation text and navigation audio; determining the direction of the spatial audio sound source based on the navigation text; performing spatial audio rendering processing on the navigation audio according to the direction of the spatial audio sound source and information of the audio device to obtain spatial audio; and sending a playback instruction to the audio device.

[0062] In some embodiments, the processor 110 may include one or more interfaces. Among them, USB130 is an interface that complies with the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, or may be used to transfer data between the electronic device 100 and a peripheral device. It may also be used to connect headphones to play audio through the headphones. The interface may also be used to connect other electronic devices, such as a car computer, etc.

[0063] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module.

[0064] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing audio through a Bluetooth headset.

[0065] refer to Figure 5 , Figure 5 According to an embodiment of the present application, a schematic diagram of the structure of a mobile phone-earphone is shown. In some embodiments, Figure 5 As shown in the figure, taking the terminal 101 as a mobile phone as an example, the mobile phone can be connected to an external headset via a UART interface and a Bluetooth module in the wireless communication module 160. Specifically, sending a play instruction to the audio may include: the mobile phone sends a play instruction to the headset via Bluetooth. The play instruction includes the rendered spatial audio, and the play instruction is used to instruct the power amplifier to play the spatial audio. Optionally, the headset can be a headset with a spatial audio function.

[0066] The terminal 101 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

[0067] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0068] The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface. For example, if the terminal 101 is a mobile phone, the earphone interface 170D may be used to connect an earphone with a spatial audio function.

[0069] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, Figure 4 The audio module 170 shown can transmit audio signals to the wireless communication module 160 through the I2S interface, thereby realizing the function of playing audio through a Bluetooth headset.

[0070] The terminal 101 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0071] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel.

[0072] The terminal 101 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor. The ISP is used to process the data fed back by the camera 193. The camera 193 is used to capture a static image or a video. In some embodiments, the terminal 101 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0073] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal 101. In other embodiments of the present application, the terminal 101 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0074] Combine the following Figure 6 An exemplary process of a navigation audio playback method provided by an embodiment of the present application is introduced. This specification provides method or process operation steps as shown in the embodiment or flowchart, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps listed in the embodiment is only one of many execution orders and does not represent the only execution order. In actual execution, the method or process shown in the embodiment or the accompanying drawings may be executed sequentially or in parallel (for example, a parallel controller or a multi-threaded processing environment).

[0075] Figure 6 According to an embodiment of the present application, a flowchart of a navigation audio playback method is shown. According to some embodiments, the method can be executed by a vehicle computer in a vehicle, that is, the vehicle computer generates spatial audio corresponding to the navigation route, and the spatial audio is played by a speaker in the vehicle. Figure 6 As shown in the figure, a navigation audio playback method provided by an embodiment of the present application includes:

[0076] S101: Obtain navigation text and navigation audio.

[0077] Exemplarily, navigation text and navigation audio can be obtained in response to a user's navigation operation and based on the navigation route corresponding to the user's navigation operation, wherein the user's navigation operation can launch a map application for the user and perform interactive operations according to the application interface of the map application. For example, the interactive operations can include one or more of text input operations, navigation control click operations, voice input operations, and the like.

[0078] In step S101, the navigation text may correspond to the navigation audio, that is, the text content of the navigation text is consistent with the voice content of the navigation audio.

[0079] Optionally, the navigation text may be text generated based on the destination information and the real-time location information of the navigation device, and the navigation audio may be audio generated based on the navigation text. As an example, obtaining the navigation text and navigation audio may also include: receiving navigation instructions; the navigation instructions are generated based on the user's operation, and the navigation instructions include the destination information; generating a navigation route based on the destination information and the real-time location information of the navigation device; generating navigation text and navigation audio based on the navigation route. Among them, the user can operate the navigation device to input the destination information and click to confirm to start the navigation process; the navigation software (or navigation application) can plan the navigation route according to the user's input information, and output the navigation text and navigation voice according to the navigation route. Among them, the navigation text may include multiple paragraphs of navigation text, corresponding to multiple paths in the navigation route, and accordingly, the navigation voice may also include multiple navigation voices. The navigation voice and the navigation text are in a one-to-one correspondence, that is, the content of each paragraph of navigation text and each navigation voice is consistent.

[0080] S102: Determine a spatial audio sound source direction based on the navigation text.

[0081] It is understandable that in step S102, the spatial audio sound source direction (i.e., the first sound source direction or the second sound source direction mentioned above) can be determined according to the specific content of the navigation text. The spatial audio sound source direction represents the direction of the virtual sound source formed when playing the spatial audio relative to the listener (i.e., the user).

[0082] In an optional embodiment, the navigation text may be input into the matching model, and the spatial direction corresponding to the navigation text may be output according to the matching model as the spatial audio source direction. The matching model may include but is not limited to text recognition

[0083] In an embodiment where the matching model includes a text recognition model, determining the spatial audio sound source direction based on the navigation text includes: performing keyword recognition on the navigation text based on the text recognition model to obtain at least one target keyword included in the navigation text; and determining the spatial audio sound source direction based on the at least one target keyword. Optionally, the at least one target keyword includes at least one of turn left, turn right, uphill, downhill, and straight ahead.

[0084] For example, if the navigation text is "Turn left 100 meters ahead and enter xx Road", the at least one target keyword identified may include turn left and 100 meters; if the navigation text is "50 meters ahead downhill", the at least one target keyword identified may include downhill and 50 meters; if the navigation text is "50 meters ahead turn left and then downhill", the at least one target keyword identified may include turn left, downhill and 50 meters; if the navigation text is "go straight ahead 500 meters", the at least one target keyword identified may include go straight and 500 meters. It can be understood that the above is an example of indicating navigation text and target keywords. In other optional embodiments, the navigation text may also be other text content, and the target keywords may also include other keywords or other keyword combinations.

[0085] After determining at least one target keyword, the direction of the spatial audio sound source can be further determined based on the at least one target keyword. Optionally, when the at least one target keyword includes a first keyword, a distance keyword can be determined based on the at least one target keyword; and the direction of the spatial audio sound source can be determined based on the distance keyword and the first keyword of the at least one target keyword. The distance keyword represents the distance information between the navigation device and the target intersection where the navigation text indicates the turn. The first keyword represents that the vehicle is about to turn, and the turn can be a turn in the horizontal direction or a turn in the vertical direction.

[0086] It can be understood that the first keyword includes a horizontal steering keyword and a vertical steering keyword. In an optional embodiment, the first keyword may include left turn, right turn, uphill and downhill. Determine the direction of the spatial audio sound source based on the distance keyword and the first keyword of at least one target keyword, including: when the first keyword of at least one target keyword includes a horizontal steering keyword, determine the spatial audio direction angle based on the distance keyword and the horizontal steering keyword included in the at least one target keyword; when the first keyword of at least one target keyword includes a vertical steering keyword, determine the spatial audio pitch angle based on the distance keyword and the vertical steering keyword included in the at least one target keyword; determine the spatial audio sound source direction based on the spatial audio direction angle and / or the spatial audio pitch angle.

[0087] As an example, the size of the spatial audio direction angle can be determined based on the distance keyword, and the positive or negative of the spatial audio direction angle can be determined based on the horizontal steering keyword; the size of the spatial audio pitch angle can be determined based on the distance keyword, and the positive or negative of the spatial audio pitch angle can be determined based on the vertical steering keyword. Specifically, when the distance is less than the preset distance determined based on the distance keyword, the first preset angle can be determined as the spatial audio direction angle; when the distance is greater than or equal to the preset distance determined based on the distance keyword, the second preset angle can be determined as the spatial audio direction angle; when the horizontal steering keyword is a left turn, the spatial audio direction angle is negative, otherwise it is positive; when the distance is less than the preset distance determined based on the distance keyword, the third preset angle can be determined as the spatial audio pitch angle; when the distance is greater than or equal to the preset distance determined based on the distance keyword, the fourth preset angle can be determined as the spatial audio pitch angle; when the vertical steering keyword is downhill, the spatial audio pitch angle is negative, otherwise it is positive.

[0088] In an optional embodiment, the first preset angle, the second preset angle, the third preset angle, and the fourth preset angle may be 30°, 60°, 15°, and 30°, respectively, and the preset distance may be 100 meters. As an example, the navigation text is "turn left 50 meters ahead and then go downhill", and at least one target keyword identified is turn left, downhill, and 50 meters, including the horizontal steering keyword-turn left, the vertical steering keyword-downhill, and the distance keyword-50 meters. Optionally, based on the horizontal steering keyword-turn left, the spatial audio direction angle is determined to be negative; based on the distance keyword-50 meters, since 50 meters is less than the preset distance of 100 meters, the size of the spatial audio direction angle is determined to be the first preset angle, such as 30°; therefore, the spatial audio direction angle is -30°. Based on the vertical steering keyword-downhill, the spatial audio pitch angle is determined to be negative; based on the distance keyword-50 meters, since 50 meters is less than the preset distance of 100 meters, the size of the spatial audio direction angle is determined to be the third preset angle, such as 15°; therefore, the spatial audio pitch angle is -15°. Then, based on the spatial audio direction angle and the spatial audio pitch angle, the spatial audio sound source direction may be determined to be (-30°, -15°).

[0089] In other optional embodiments, at least one keyword may include only one of a horizontal steering keyword or a vertical steering keyword. In these embodiments, the spatial audio direction angle can be determined based on the distance keyword and the horizontal steering keyword included in at least one target keyword; or; the spatial audio pitch angle can be determined based on the distance keyword and the vertical steering keyword included in at least one target keyword; the spatial audio sound source direction can be determined based on the spatial audio direction angle or the spatial audio pitch angle.

[0090] Optionally, when at least one target keyword includes the second keyword, the sound source direction corresponding to the second keyword may be determined as the spatial audio sound source direction. In one embodiment, the second keyword may be straight ahead, and the sound source direction corresponding to the second keyword may be forward, that is, (0°, 0°).

[0091] In an embodiment where the matching model includes a text classification model, determining the spatial audio sound source direction based on the navigation text includes: performing text classification on the navigation text based on the text classification model to obtain a navigation category corresponding to the navigation text; and determining the spatial audio sound source direction based on the navigation category. Each navigation category and each spatial audio sound source direction may be in a one-to-one correspondence. For example, the navigation category may include a short-distance left turn, a long-distance left turn, a short-distance right turn, a long-distance right turn, a short-distance downhill, a short-distance uphill, etc. Each of the above navigation categories may correspond to a spatial audio sound source direction. For example, a short-distance left turn may correspond to (-60°, 0), a long-distance left turn may correspond to (-30°, 0), and so on.

[0092] In other embodiments, the matching model may also include other natural language processing models, such as chatGPT, and the like.

[0093] S103: Performing spatial audio rendering processing on the navigation audio according to the direction of the spatial audio sound source to obtain spatial audio.

[0094] It can be understood that in step S103, the sound source direction of the spatial audio relative to the user is consistent with the sound source direction of the spatial audio.

[0095] In some embodiments, the audio device may be a speaker device. Performing spatial audio rendering processing on the navigation audio according to the direction of the spatial audio sound source to obtain the spatial audio may include: when the audio device includes multiple speaker devices, performing spatial audio rendering processing on the navigation audio according to the direction of the spatial audio sound source, the setting information of the multiple speakers, and the user's position information to obtain the spatial audio. The setting information of the multiple speakers includes the placement position information and placement angle information of each speaker in the multiple speakers. The user's position information may refer to the position information of the center of the user's head.

[0096] As an example, a spatial audio rendering algorithm can be used to perform spatial audio rendering processing on the navigation audio according to the direction of the spatial audio sound source and the information of the audio device, using an amplitude shift method to obtain spatial audio. The spatial audio rendering algorithm can be determined according to different vehicle models, that is, the spatial audio rendering algorithm corresponds to the vehicle model.

[0097] Exemplarily, the spatial audio may be multi-channel audio, specifically including audio corresponding to each speaker of the plurality of speakers, and the sound intensity information of the audio corresponding to each speaker may be determined in step S103. According to the direction of the spatial audio sound source, the setting information of the plurality of speakers, and the position information of the user, the navigation audio is subjected to spatial audio rendering processing to obtain the spatial audio, which may include: according to the direction of the spatial audio sound source, the setting information of the plurality of speakers, and the position information of the user, the navigation audio is subjected to spatial audio rendering processing to obtain the sound intensity information of the selected plurality of speakers and each of the plurality of speakers; and the spatial audio is obtained according to the sound intensity information of each speaker and the navigation audio.

[0098] In a specific implementation, the spatial audio source direction and the desired sound intensity can be input into the spatial sound rendering algorithm model, and the positions of a preset number of speakers closest to the spatial audio source direction can be input, and the spatial sound rendering algorithm model can output the amplitude intensity of each speaker in the preset number of speakers. Wherein, close to the audio source direction refers to the angle close to the spatial audio source direction relative to the user. Specifically, if (pitch angle, azimuth) is used to represent the angle of the speaker relative to the user, then the preset number of speakers with the smallest difference in pitch angle and azimuth with the spatial audio source direction can be determined among multiple speakers, and they are the preset number of speakers closest to the spatial audio source direction. Optionally, the preset number can be 2, 3, 4, etc., and this application is not limited to this.

[0099] It can be understood that in the same speaker system, for each spatial audio sound source direction, the ratio between the amplitude intensities of a preset number of speakers output by the spatial sound rendering algorithm model remains unchanged. In other words, the spatial sound rendering algorithm can be used to determine the sound intensity ratio of each speaker corresponding to the spatial audio sound source direction.

[0100] For example, when there are speakers in front, behind, left and right of the user, if the direction of the spatial audio sound source is (-60°, 0), it can be determined that only the front and left speakers are emitting sound among the four speakers, and the sound intensities of the left and front speakers can be determined through spatial audio rendering processing, respectively, to obtain the front speaker audio with a first sound intensity and the left speaker audio with a second sound intensity. The front speaker audio and the left speaker audio constitute spatial audio, so that the virtual sound source of the spatial audio is 60° to the left of the user.

[0101] Combine the following Figure 7 An exemplary process of steps S101-S103 is further introduced. Figure 7 According to an embodiment of the present application, a schematic diagram of a process for generating spatial audio is shown.

[0102] refer to Figure 7 , the user can input guidance information to obtain navigation text and navigation audio. Among them, the user can input guidance information based on the map application, and the guidance information may include current location information, destination information, etc. Then, according to the navigation text output in step S101 and the spatial matching rule, the spatial audio source direction is obtained. Exemplarily, the spatial audio source direction includes a pitch angle and a directional angle. In one embodiment, the directional angle may be 30°, and the pitch angle may be 20°, indicating that the spatial audio source direction is to the upper right of the user. Finally, according to the spatial audio rendering algorithm and the output spatial audio source direction, the navigation audio is subjected to spatial audio rendering processing, and a guiding voice with a spatial direction is output, that is, spatial audio is output.

[0103] S104: Play the spatial audio based on the audio device.

[0104] Exemplarily, in step S104, a play instruction may be sent to the audio device, where the play instruction includes spatial audio, and the play instruction is used to instruct the audio device to play the spatial audio.

[0105] In some embodiments, the audio device is an amplifier device. For example, in the embodiment described above where the direction of the spatial audio sound source is 60° to the left, the sound intensity information of each speaker obtained by rendering may include that the sound intensity of the speaker set in front of the user and facing the user accounts for 37% of the total sound intensity, and the sound intensity of the speaker set on the left side of the user and facing the user accounts for 63% of the total sound intensity, and the total sound intensity is determined according to the user setting. After the audio device receives the play instruction, it can control the sound intensity of the two speakers to be 37% and 63% of the total sound intensity based on the information contained in the play instruction that the sound intensity of the speaker set in front of the user and facing the user accounts for 37% of the total sound intensity and the sound intensity of the speaker set on the left side of the user and facing the user accounts for 63% of the total sound intensity. It should be noted that the above is only an exemplary process. In other optional embodiments, the sound emission mode of the audio device can also be changed according to different speaker arrangements and different spatial audio sound source directions.

[0106] According to some other embodiments, the method is executed by a mobile phone, that is, the subject of execution of steps S101 to S104 is the mobile phone. The mobile phone is connected to the vehicle, the mobile phone generates spatial audio, and then sends the spatial audio to the audio device in the vehicle for playback. Figure 2 As explained above, for example, an audio device in a vehicle may include multiple speakers.

[0107] In the above embodiment of connecting a mobile phone to a vehicle, in step S104, the mobile phone sends a play instruction to an audio device in the vehicle, wherein the play instruction includes spatial audio, and the play instruction is used to instruct the audio device in the vehicle to play the spatial audio.

[0108] In some embodiments, the mobile phone can be connected to the vehicle computer in the vehicle, the mobile phone generates spatial audio, and then sends the spatial audio to the vehicle computer, which controls the audio device in the vehicle to play. In some embodiments, the mobile phone can send navigation text to the vehicle computer, and the vehicle computer performs the above-mentioned S102-104 operations.

[0109] According to some other embodiments, the method is executed by a mobile phone, that is, the subject of execution of steps S101 to S104 is the mobile phone. The mobile phone is connected to the wearable device, the mobile phone generates spatial audio, and then sends the spatial audio to the headset for playback. Figure 5 For example, the wearable device may be a headset, and the mobile phone and the headset may be connected via Bluetooth.

[0110] In the embodiment of the connection between the mobile phone and the wearable device, the difference from the above step S103 is that, according to the direction of the spatial audio source and the information of the audio device, the navigation audio is subjected to spatial audio rendering processing to obtain the spatial audio, which may include: when the audio device includes a wearable device, according to the direction of the spatial audio source and the information of the wearable device, the navigation audio is subjected to spatial audio rendering processing to obtain the spatial audio. Optionally, the navigation audio may be subjected to spatial audio rendering processing using a rendering method of a head related transfer function (HRTF) to obtain the spatial audio.

[0111] Exemplarily, in step S103, a binaural impulse response function corresponding to the spatial audio sound source direction can be determined in the rendering data set by using the HRTF rendering method, and the navigation audio is convolved according to the binaural impulse response function to obtain the spatial audio. The rendering data set can include binaural impulse response functions corresponding to multiple spatial directions, and each spatial direction corresponds to a binaural impulse response function one-to-one.

[0112] In one embodiment, the binaural impulse response function may include a left ear impulse response function and a right ear impulse response function. Convolution processing is performed on the navigation audio according to the binaural impulse response function to obtain spatial audio, including: convolution processing is performed on the navigation audio according to the left ear impulse response function to obtain left ear audio; convolution processing is performed on the navigation audio according to the right ear impulse response function to obtain right ear audio; and the left ear audio and the right ear audio are combined into spatial audio.

[0113] For example, if the direction of the spatial audio sound source is 30° to the left front, the binaural impulse response function corresponding to 30° can be found in the rendering data set, and the navigation audio and the binaural impulse response function are convolved to obtain spatial audio containing left ear audio and right ear audio. The left ear audio can be played by the left earphone in the headset, and the right ear audio can be played by the right earphone in the headset, so that when the user hears the spatial audio, he can perceive that the virtual sound source is located at 30° to the left front.

[0114] In the above embodiment of connecting a mobile phone and a wearable device, in step S104, the mobile phone may send a play instruction to the wearable device, wherein the play instruction includes spatial audio, and the play instruction is used to instruct the wearable device to play the spatial audio.

[0115] Exemplarily, the wearable device is a headset, and the spatial audio function of the headset can be enabled. After receiving the play instruction, the headset can directly play the spatial audio contained in the play instruction, so that the user can directly perceive the direction of the spatial audio sound source through the headset.

[0116] refer to Figure 8 , Figure 8 According to an embodiment of the present application, a flowchart of a navigation audio playback method is shown.

[0117] like Figure 8 As shown in the figure, during the navigation process, the navigation algorithm can output navigation text (also called navigation text), and the navigation voice can be generated according to the navigation text voice synthesis. For example, the content of the navigation text or navigation voice may include: turn left, turn right, execute, uphill, etc.

[0118] Then, the spatial direction can be generated by matching the navigation text based on the matching rule. The matching rule defines the mapping rule between the preset text in the navigation text and the preset spatial direction. As an example, the matching rule can be a matching rule in the matching model, and the process of matching based on the matching rule can refer to the above description of the embodiment of inputting the navigation text into the matching model.

[0119] The spatial direction and the navigation voice can together constitute a sound object. Through the spatial audio rendering algorithm, the navigation voice in the sound object can be rendered into a spatial audio with spatial characteristics, and played through a multi-channel playback device or headphones. Among them, the spatial characteristic characterizes that the sound source direction of the spatial audio is the spatial direction in the sound object. As an example, the multi-channel playback device can be the speaker system mentioned above.

[0120] In some embodiments, the voice of the voice assistant, or other audio such as mobile phone ringtones, prompt sounds, music, etc. can also be rendered through a spatial audio rendering algorithm to obtain audio with a spatial direction. Among them, the spatial audio generated based on other audio can have the same spatial direction as the spatial audio generated based on the navigation audio, so that the user can also make driving operation judgments based on the spatial sound source direction of other audio when playing other audio.

[0121] Through a navigation audio playback method of an embodiment of the present application, the spatial audio capability of a vehicle or headset can be utilized, spatial audio can be generated based on navigation text, and navigation information can be transmitted to the user by playing spatial audio, thereby avoiding the situation in which users spend a lot of time to understand the voice content of the navigation audio and then drive straight, so that users can make driving decisions based on the direction of the spatial audio sound source and the spatial audio voice content, greatly reducing the reaction time required for users to receive navigation information. In this way, not only an ecological application is provided for the spatial audio function carried by the vehicle or headset, but also the probability of error of the driver driving according to the navigation is reduced, and the safety and timeliness of navigation are improved.

[0122] Fig. 9 According to an embodiment of the present application, a software structure block diagram of a terminal 101 is shown.

[0123] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0124] The application layer can include a series of application packages.

[0125] like Fig. 9 As shown, the application layer may include navigation applications, videos, settings, and other applications.

[0126] The application framework layer may include: a window system, a layout system and a view system, wherein the window system may be used to manage the windows opened by the terminal 101; the layout system and the view system may be used to manage the operation mode of the user interface in the window.

[0127] In some embodiments of the present application, the user can set the application, and the terminal 101 generates an event through the application package in response to the user's setting. For example, the user can turn on the GPS switch in the settings, and the terminal 101 can generate a positioning event in response to this setting.

[0128] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0129] As used herein, the term "module" may refer to, be part of, or include: a memory (shared, dedicated, or group) for running one or more software or firmware programs, an application-specific integrated circuit (ASIC), an electronic circuit and / or processor (shared, dedicated, or group), a combinational logic circuit, and / or other suitable components that provide the described functionality.

[0130] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order is not required. Instead, in some embodiments, these features may be described in a manner and / or order different from that shown in the illustrative drawings. In addition, the structural or method features included in a specific figure do not mean that all embodiments need to include such features. In some embodiments, these features may not be included, or these features may be combined with other features.

[0131] The embodiments of the present application are described in detail above in conjunction with the accompanying drawings, but the use of the technical solution of the present application is not limited to the various applications mentioned in the embodiments of the present patent. Various structures and variations can be easily implemented with reference to the technical solution of the present application to achieve the various beneficial effects mentioned herein. Various changes made within the knowledge of ordinary technicians in the field without departing from the purpose of the present application should all fall within the scope of the patent application.

Claims

1. A navigation audio playback method, characterized in that: The method comprises: Navigation instructions detected; Playing a navigation audio in response to the navigation instruction, wherein, during the playing of the navigation audio: Using a first audio device to play a first navigation audio, wherein a first sound source direction of a user when the first audio device plays the first navigation audio corresponds to a first navigation direction of the first navigation audio; A second audio device is used to play the second navigation audio, wherein a second sound source direction relative to the user when the second audio device plays the second navigation audio corresponds to a second navigation direction of the second navigation audio.

2. The method according to claim 1, characterized in that The method further comprises: A first navigation audio and a first audio device are determined based on a first navigation text and an alternative audio device corresponding to the navigation instruction, wherein the first navigation text and the first navigation audio correspond to each other.

3. The method according to claim 2, characterized in that The alternative audio device includes a plurality of speakers, The determining the first navigation audio and the first audio device based on the first navigation text and the candidate audio device corresponding to the navigation instruction includes: Based on the first navigation direction corresponding to the first navigation text and the position information of the multiple speakers relative to the user, determining a target speaker from the multiple speakers, and determining the sound intensity information of the target speaker; The mono audio corresponding to the first navigation text is processed based on the sound intensity information of the target speaker to obtain the first navigation audio; the first navigation audio includes the playback audio of each of the target speakers.

4. The method according to claim 3, characterized in that The alternative audio device includes a wearable device, and the wearable device includes a first sound channel and a second sound channel. The determining the first navigation audio and the first audio device based on the first navigation text and the candidate audio device corresponding to the navigation instruction includes: Determine the wearable device as the first audio device; Based on the first navigation direction corresponding to the first navigation text, spatial audio rendering processing is performed on the mono audio corresponding to the first navigation text to obtain the first navigation audio; the first navigation audio includes the playback audio of the first channel and the playback audio of the second channel.

5. The method according to any one of claims 1 to 4, characterized in that: The content of the first navigation audio includes at least one target keyword; The using a first audio device to play the first navigation audio includes: Corresponding to the at least one target keyword indicating the first navigation direction, the first navigation audio is played using the first audio device.

6. The method according to claim 5, characterized in that The at least one target keyword includes a turn keyword, and the turn keyword includes a horizontal turn keyword, a vertical turn keyword, and a straight keyword; The horizontal turning keywords include left turn and right turn, and the vertical turning keywords include uphill and downhill.

7. The method according to claim 6, characterized in that The at least one target keyword includes a distance keyword, and the distance keyword represents distance information between the navigation device and an intersection that the navigation device will arrive at.

8. The method according to claim 7, characterized in that The step of indicating the first navigation direction corresponding to the at least one target keyword and using the first audio device to play the first navigation audio includes: When the horizontal steering keyword and the distance keyword in the at least one keyword correspond to the direction angle of the first sound source direction, and the vertical steering keyword and the distance keyword in the at least one keyword correspond to the pitch angle of the first sound source direction, the first audio device is used to play the first navigation audio.

9. An electronic device, characterized in that: include: a memory for storing instructions to be executed by one or more processors of the electronic device, and A processor, used to execute instructions of the navigation audio playback method according to any one of claims 1-8.

10. A readable medium, characterized in that: The readable medium stores instructions, and when the instructions are executed on the electronic device, the electronic device executes the navigation audio playback method according to any one of claims 1-8.

Images