Information generation method and apparatus

Abstract

A data generation method and device are provided, which are applicable to the field of intelligent terminal technology and provide a more intuitive and efficient way of presenting spatial objects. The data generation device acquires spatial object information, generates content information and azimuth angle information based on the spatial object information, where the azimuth angle information is azimuth angle information of the spatial object indicated in the spatial object information relative to the data generation device, and generates spatial sound data based on the azimuth angle information and the content information, where the spatial sound data is used to play spatial sound, and the position of the sound source of the spatial sound corresponds to the azimuth angle information.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of intelligent terminal technology, particularly to data generation methods and devices.

[0002] With the development of mobile Internet technology, intelligent electronic devices with navigation functions, such as mobile phones, have brought great convenience to people's lives. When providing navigation services, intelligent electronic devices usually execute a route plan based on the start point and destination input by the user, and output the route plan result by playing audio.

[0003] However, this method of sending prompts by playing audio is not intuitive enough. As a result, when the user is not familiar with the local environment, the user cannot accurately match the route on the map with the user's position. Additionally, the navigation system is limited by positioning accuracy, and can only detect a route deviation and send a route deviation prompt after the user has traveled incorrectly for a period of time. Particularly, when using relatively complex navigation data of the planned route, the user needs to frequently open the map to confirm whether the user's traveling direction is correct. The operation is complex and the user experience is greatly reduced.

[0004] In addition to the navigation scenario, in another application scenario, there is also a technical problem that information is not intuitively shown.

Summary of the Invention

[0005] To solve the above technical problems, embodiments of the present application provide a data generation method and device, so that when spatial object information is shown to the user, the user can more intuitively and efficiently know the azimuth angle information of the spatial object, and greatly improve the user experience.

[0006] According to a first aspect, one embodiment of the present application provides a data generation method applicable to the field of intelligent terminal technology. The data generation device acquires spatial object information. The spatial object information is used to acquire azimuth information of spatial objects relative to the data generation device. For example, the spatial object information may be in text format and include navigation data used to navigate from the data generation device to a navigation destination, or in audio stream format and include navigation data used to navigate from the data generation device to a navigation destination, or it may include object content and absolute coordinates of spatial objects surrounding the data generation device, or it may include object content and relative coordinates of spatial objects surrounding the data generation device. Based on the spatial object information, the data generation device generates content information and azimuth information. The azimuth information is used to indicate the azimuth of the spatial objects shown in the spatial object information relative to the data generation device. The content information is used to describe the spatial object. The azimuth information includes at least one of position information and direction information. The spatial object includes, but is not limited to, a navigation destination, an event occurring in space, or a person, animal, or object existing in space. When the spatial object is a navigation destination, the content information is used to describe the route plan used to proceed from the data generation device to the navigation destination. When the spatial object is a spatial event, or a person, animal, or spatially existing object, the content information is used to describe the orientation of the spatial object relative to the data generation device and the object content of the spatial object. The data generation device generates spatial sound data based on the azimuth information and content information. The spatial sound data is used to reproduce spatial sound, and the position of the spatial sound source corresponds to the azimuth information. When this embodiment of the application is applied to a navigation scenario, the spatial sound data is generated based on the azimuth information and content information of the navigation destination relative to the data generation device.Spatial sound data is used to reproduce spatial sound, the azimuth angle of the sound source corresponding to the spatial sound matches the azimuth angle of the navigation destination relative to the data generation device, and the audio content corresponding to the spatial sound matches the route plan used to travel from the data generation device to the navigation destination. The user determines the azimuth angle of the spatial object based on the azimuth angle of the sound source of the spatial sound heard. In this way, spatial object information is presented to the user more intuitively, thereby improving the user experience.

[0007] In possible implementations, the spatial sound data includes azimuth information and content information, or the spatial sound data includes at least two monophonic signals generated based on the azimuth information and content information, the at least two monophonic signals being simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals in order to generate spatial sound.

[0008] In possible implementations, the generation of azimuth information by a data generator based on spatial object information includes generating azimuth information based on spatial object information and at least one of the position or orientation of the data generator. The azimuth information includes at least one of position information and orientation information. Specifically, when the spatial object information includes the spatial position and object content of spatial objects surrounding the data generator, the data generator may generate orientation information of the spatial objects relative to the data generator based on the spatial position of the data generator and the spatial positions of the spatial objects surrounding the data generator. The data generator may measure its orientation by using a gyroscope, inertial sensor, or other elements. For example, when the data generation device is a vehicle, the orientation is the direction of the vehicle's head; when the data generation device is a mobile phone or navigator, the orientation is the orientation of the mobile phone or navigator's screen; when the data generation device is a dual-channel headset, the orientation is the orientation of the user's face wearing the dual-channel headset; when the data generation device is a separate device including both a vehicle and a mobile phone located inside the vehicle, the orientation is the direction of the vehicle's head or the orientation of the mobile phone's screen located inside the vehicle; or when the data generation device is a separate device including both a vehicle and a dual-channel headset located inside the vehicle, the orientation is the direction of the vehicle's head or the orientation of the user's face inside the vehicle wearing the dual-channel headset. The data generation device generates azimuth information of spatial objects relative to the data generation device based on the orientation of the data generation device and the spatial positions of spatial objects surrounding the data generation device. In this embodiment of the present application, the orientation information is generated based on the orientation information and spatial object information, so that the position of the sound source of the spatial sound ultimately heard by the user matches the azimuth information of the spatial object relative to the data generation device, improving the accuracy of the user's intuitive perception.

[0009] In possible implementations, the acquisition of spatial object information by a data generation device includes receiving spatial object information or collecting spatial object information by using sensors. Reception methods include at least one of the following: receiving information by using cellular communication, wireless local area networks, global interoperability for microwave access, Bluetooth communication technology, ZigBee communication technology, optical communication, satellite communication, infrared communication, transmission line communication, hardware interfaces, or traces on a hardware circuit board; acquiring information from a software module; or reading information from a storage device. Sensors include at least one of the following: photosensitive sensors, sound sensors, image sensors, infrared sensors, thermal sensors, pressure sensors, or inertial sensors. The data generation device may generate spatial sound data based on received spatial object information, or based on spatial object information collected by using sensors. In other words, the data presentation methods provided in this solution are applicable to multiple application scenarios, and the application scenarios of this solution are expandable. This improves the flexibility of the implementation of this solution.

[0010] In possible implementations, the data generator receiving spatial object information includes receiving spatial object information in at least one of the following three ways: The data generator receives audio stream data generated by an application program and determines the audio stream data as the received spatial object information. The audio stream data may be navigation data in audio stream format. In this case, speech recognition is performed on the navigation data in audio stream format to obtain azimuth and content information. Alternatively, the data generator receives interface data generated by an application program and determines the interface data as the received spatial object information. The interface data may be navigation data in text format. In this case, the data generator generates azimuth and content information in text format based on the field values ​​of the content field and the field values ​​of the location field included in the navigation data. Alternatively, the data generator receives map data stored on the network side or terminal side. map The data is determined as received spatial object information. The map data includes the object content and coordinates of the spatial objects surrounding the data generation device, and the coordinates can be absolute or relative. In this case, the data generation device generates azimuth information based on the coordinates of the spatial objects surrounding the data generation device, and generates content information based on the azimuth information and object content of the spatial objects surrounding the data generation device.

[0011] In a possible implementation, the sensor includes at least one of the following: a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

[0012] In possible implementations, the generation of content information and azimuth information based on spatial object information by the data generation device includes generating content information and azimuth information based on spatial object information when the data generation device determines that the spatial object information satisfies pre-set conditions. Specifically, the data generation device determines whether the spatial position indicated in the azimuth information is located in a pre-set spatial position region, or whether the spatial position indicated in the azimuth information is located in a pre-set spatial direction, or whether the object content indicated in the content information is pre-set object content. The data generation device determines that the spatial object information satisfies pre-set conditions when the result of one or more of the above cases is "yes". In this embodiment of the present application, it is determined whether the spatial object information satisfies pre-set conditions before the spatial sound data is generated, and spatial sound data is generated based on the spatial object information, i.e., the spatial object information is filtered, only when the determination result is that the pre-set conditions are satisfied. In this way, the waste of computer resources caused by spatial object information that does not meet pre-set conditions is avoided, excessive interference to the user is avoided, and thereby the user engagement of this solution is improved.

[0013] In possible implementations, the method further includes generating volume-up instruction information when a data generation device determines that spatial object information satisfies pre-set conditions. The volume-up instruction information is used to increase the volume of spatial sound corresponding to spatial object information that satisfies pre-set conditions, and the volume-up instruction information may carry the volume value to which the volume needs to be increased. In this embodiment of the application, the playback volume is increased for spatial objects having pre-set object content to attract the user's attention and prevent the user from losing sight of the spatial object having pre-set object content. In this way, security in the navigation process is improved and the user can be prevented from losing sight of spatial objects of interest, thereby improving the user viscosity of the solution.

[0014] In possible implementations, this method involves a data generation device that satisfies the conditions under which spatial object information is pre-set. Don't The process further includes generating volume reduction instruction information when it is determined to be spatial object information. The volume reduction instruction information is used to reduce the volume of spatial sound corresponding to spatial object information that satisfies pre-set conditions, and the volume reduction instruction information reduces the volume lower It can transport the necessary volume values.

[0015] In possible implementations, spatial object information that satisfies pre-set conditions includes spatial object information containing a pre-set spatial location region, a pre-set spatial direction, or a pre-set object content. The pre-set spatial location region is the spatial location region relative to the spatial location of the data generation device or audio playback device, and the pre-set spatial direction may be the direction relative to the data generation device or audio playback device. For example, when the audio playback device is a dual-channel headset, the pre-set spatial direction may be the orientation of the user's face wearing the dual-channel headset; when the data generation device is a mobile phone or navigator, the pre-set spatial direction may be the direction of movement of the mobile phone or navigator; when the data generation device is a vehicle, the pre-set spatial direction may be the orientation of the vehicle's head; or the pre-set spatial direction may be the absolute spatial location direction. The pre-set object content may be pre-input by the user or may be determined independently by the data generation device.

[0016] In possible implementations, when the audio playback device is a dual-channel headset, the preset spatial orientation is the orientation of the user's face while wearing the dual-channel headset, and the orientation of the user's face while wearing the dual-channel headset may be measured based on a gyroscope, inertial sensor, or other element installed in the dual-channel headset.

[0017] In possible implementations, the generation of spatial sound data by a data generator based on azimuth information and content information includes either the data generator performing a rendering operation on audio stream data corresponding to the content information based on azimuth information, content information, and the orientation of the data generator to generate spatial sound data, or the data generator performing a rendering operation on audio stream data corresponding to the content information based on azimuth information, content information, and the orientation of the audio playback device to generate spatial sound data. The spatial sound data includes at least two monophonic signals generated based on azimuth information and content information. The rendering operation specifically involves incorporating spatial azimuth information into audio stream data using a specific algorithm or data processing operation to ultimately generate at least two monophonic signals. The at least two monophonic signals are simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals to generate spatial sound.

[0018] According to a second aspect, one embodiment of the present application provides an electronic device. The device includes an acquisition module and a generation module. The acquisition module is configured to acquire spatial object information. The spatial object information is used to acquire azimuth information of spatial objects relative to a data generation device. The generation module is configured to generate content information and azimuth information based on the spatial object information. The azimuth information is used to indicate the azimuth of the spatial objects shown in the spatial object information relative to the data generation device. The content information is used to describe the spatial objects. The generation module is further configured to generate spatial sound data based on the azimuth information and content information. The spatial sound data is used to reproduce spatial sound, and the position of the sound source of the spatial sound corresponds to the azimuth information.

[0019] In the implementation, the spatial sound data includes azimuth information and content information, or the spatial sound data includes at least two monophonic signals generated based on the azimuth information and content information, and the at least two monophonic signals are simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals in order to generate spatial sound.

[0020] In possible implementations, the generation module is configured to generate azimuth information based on at least one of spatial object information and the position or orientation of the data generation device.

[0021] In possible implementations, the acquisition module is configured to either receive spatial object information or collect spatial object information by using sensors.

[0022] In possible implementations, the acquisition module is configured to receive spatial object information in at least one of three ways: by receiving audio stream data generated by an application program, by receiving interface data generated by an application program, or by receiving map data stored on the network side or terminal side.

[0023] In a possible implementation, the sensor includes at least one of the following: a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

[0024] In possible implementations, the generation module is configured to generate content information and azimuth information based on spatial object information when it is determined that the spatial object information satisfies pre-set conditions.

[0025] In a possible implementation, the generation module is further configured to generate volume increase instruction information when it is determined that the spatial object information is spatial object information that satisfies a preset condition. The volume increase instruction information is used to indicate increasing the volume of the spatial sound corresponding to the spatial object information that satisfies the preset condition.

[0026] In a possible implementation, the generation module satisfies a preset condition for the spatial object information Don't When it is determined that it is the spatial object information, it is further configured to generate volume decrease instruction information. The volume decrease instruction information is used to indicate decreasing the volume of the spatial sound corresponding to the spatial object information that satisfies the preset condition.

[0027] In a possible implementation, the spatial object information that satisfies the preset condition is spatial object information including a preset spatial position area, a preset spatial direction, or a preset object content.

[0028] In a possible implementation, specifically, the generation module is configured to perform a rendering operation on the audio stream data corresponding to the content information based on the azimuth information, the content information, and the posture of the audio playback device to generate spatial sound data. The spatial sound data includes at least two monophonic signals generated based on the azimuth information and the content information.

[0029] In a possible implementation, the data generation device includes at least one of a headset, a mobile phone, a portable computer, a navigator, or a vehicle. The data generation device may be an integrated device including one device operating independently, or an individual device including a plurality of different devices operating in cooperation.

[0030] In a possible implementation, when the audio playback device is a dual-channel headset, the preset spatial direction is the orientation of the user's face while wearing the dual-channel headset, and the audio playback device is configured to reproduce spatial sound.

[0031] For specific implementation steps for carrying out the second aspect and possible implementations of the second aspect using the component modules of the data generation device provided in the second aspect of the embodiments of this application, refer to the description in the first aspect and possible implementations of the first aspect. Further details are not described herein.

[0032] According to a third aspect, one embodiment of the present application provides a data generation device including a memory and a processor. The memory stores computer program instructions, and the processor operates the computer program instructions to generate data according to the first aspect. Ta Execute the method.

[0033] In possible implementations, the data generator further includes a transceiver configured to receive spatial object information.

[0034] In possible implementations, the data generation device further includes sensors configured to collect spatial object information.

[0035] In possible implementations, the data generation device includes at least one of the following: a headset, a mobile phone, a portable computer, a navigator, or a vehicle.

[0036] In a third embodiment of the present application, the processor may be further configured to perform steps performed by the data generation device in a possible implementation of the first embodiment. See the first embodiment for further details; further details are not described herein.

[0037] According to a fourth aspect, one embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is run on the computer, the computer stores the data according to the first aspect. Ta This makes it possible to execute the method.

[0038] According to a fifth aspect, one embodiment of the present application provides a computer program. When the computer program is run on a computer, the computer provides data according to the first aspect. Ta This makes it possible to execute the method.

[0039] According to a sixth aspect, one embodiment of the present application provides a chip system. The chip system provides the functions of the above aspects, for example, the data in the above method. Send When implementing the transmission or processing of data, the server or data Ta It includes a processor configured to support the device. In possible designs, the chip system further includes memory. The memory is configured to store program instructions and data required by the server or communication device. The chip system may include a chip, or it may include a chip and other separate devices.

[0040] For the beneficial effects of the fourth to sixth embodiments of this application, please refer to the first embodiment. [Brief explanation of the drawing]

[0041] Embodiment of the present invention In a state To more clearly describe the technical solutions, the implementation details are as follows: attitude The accompanying drawings necessary for this description are briefly explained below. The accompanying drawings in the following description merely illustrate some embodiments of the present invention, and it will be apparent to those skilled in the art that other drawings can still be derived from these accompanying drawings without creative effort.

[0042] [Figure 1] This is a schematic diagram of the data generation method according to Embodiment 1 of this application.

[0043] [Figure 2] This is a schematic diagram of the data generation method according to Embodiment 2 of this application.

[0044] [Figure 3] This is a schematic diagram of the data generation method according to Embodiment 3 of this application.

[0045] [Figure 4] This is a schematic diagram of yet another implementation of a data generation method according to one embodiment of this application.

[0046] [Figure 5] This is a schematic diagram of yet another implementation of a data generation method according to one embodiment of this application.

[0047] [Figure 6] This is a schematic diagram of yet another implementation of a data generation method according to one embodiment of this application.

[0048] [Figure 7] This is a schematic diagram of yet another implementation of a data generation method according to one embodiment of this application.

[0049] [Figure 8] This is a schematic diagram illustrating the implementation of a data generation method according to one embodiment of this application.

[0050] [Figure 9] This is a schematic diagram of another implementation of a data generation method according to one embodiment of this application.

[0051] [Figure 10] This is a schematic diagram of the structure of a data generation device according to one embodiment of this application.

[0052] [Figure 11]This is another schematic diagram showing the structure of a data generation device according to one embodiment of this application. [Modes for carrying out the invention]

[0053] Embodiments of this application provide a data generation method and related device for reproducing spatial sound corresponding to azimuth information in navigation data, enabling the user to determine the correct direction of travel based on the playback position of the sound source of the audible spatial sound. In this way, a more intuitive and prompting method is provided, improving the efficiency of the navigation process. If the spatial object is of a different type of object, a more intuitive and efficient data presentation method is provided.

[0054] In the specification, claims, and accompanying drawings of embodiments of this application, terms such as “first” and “second” are intended to distinguish similar objects and do not necessarily indicate a specific order or sequence. Terms used in this manner should be understood to be interchangeable where appropriate. This is merely a distinguishing term used when objects having the same attributes are described in embodiments of this application. Additionally, the terms “includes,” “having,” and other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, system, product, or device including a set of units may include other units not explicitly enumerated or inherent in such a process, method, product, or device, rather than being limited to those units.

[0055] Embodiments of this application are described below with reference to the attached drawings. Those skilled in the art will know that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0056] Embodiments of this application can be applied to various scenarios in which spatial object information is reproduced. Spatial object information includes descriptive information of spatial objects. Spatial objects are objects located in three-dimensional (3D) space, corresponding to spatial positions in three-dimensional space, and may include physical and non-physical objects in three-dimensional space. Spatial objects include, but are not limited to, navigation destinations, events occurring in space, people present in space, animals present in space, or static objects present in space. Specifically, application scenarios of embodiments of this application include, but are not limited to, pedestrian navigation, in-vehicle navigation, scenarios in which surrounding spatial objects are described by using map data stored on the network side or terminal side, or scenarios in which surrounding spatial objects are detected and described by using sensors (actual situations are not limited to the four typical application scenarios). Each of the four typical application scenarios is described below.

[0057] Three implementations of the data generation method provided in the embodiments of this application are first described by using a walking navigation scenario as an example.

[0058] First Implementation: Figure 1 is a schematic diagram of a data generation method according to Embodiment 1 of this application. The data generation method is performed by the data generation device 10 shown in Figure 1. Figure 1 shows the headset configuration of the data generation device 10. It should be understood that using a headset as the data generation device 10 is merely one example, and the data generation device 10 may further include other types of devices. The specific implementation process in this application scenario is described in detail below.

[0059] A navigation application program can be installed in the headset. The headset obtains the navigation start point and navigation destination and transmits the navigation start point and navigation destination to the navigation server 11 using the navigation application program. The navigation server 11 determines the navigation data to be used for the journey from the navigation start point to the navigation destination by using the map data stored in the navigation server 11. The headset receives the navigation data transmitted by the navigation server 11 using the navigation application program. After obtaining the navigation data, the headset generates content information and azimuth information based on the navigation data. The azimuth information is the azimuth information of the navigation destination relative to the headset. Optionally, the headset may further obtain the attitude of the headset and generate azimuth information based on the attitude of the headset and the navigation data.

[0060] After generating azimuth information and content information, the headset generates spatial sound data. Optionally, before generating spatial sound data, the headset may further determine whether the object content indicated in the content information is a pre-set object content. When the content indicated in the content information is a pre-set object content, the headset generates volume up instruction information, and the headset may generate spatial sound data based on the azimuth information, content information, and volume up instruction information. The spatial sound data includes azimuth information and content information. Alternatively, the spatial sound data includes two monophonic signals generated based on the azimuth information and content information, and the two monophonic signals are simultaneously reproduced by the sound-electrical energy conversion module corresponding to the two monophonic signals to generate spatial sound. Optionally, when the content indicated in the content information is not a pre-set object content, the headset generates volume down instruction information, and the headset may generate spatial sound data based on the azimuth information, content information, and volume down instruction information.

[0061] Optionally, during the process of playing spatial sound, the headset may further adjust the volume of the spatial sound based on the spatial sound data. Specifically, if the headset generates volume up instruction information, the spatial sound playback volume is increased, and if the headset generates volume down instruction information, the spatial sound playback volume is decreased.

[0062] Optionally, before generating two monophonic signals based on spatial sound data, the headset may further acquire the headset's real-time orientation, then re-render the content information in the form of an audio stream based on the headset's real-time orientation, and transmit the two monophonic signals acquired after re-rendering to two sound-electrical energy conversion modules within the headset, thereby reproducing spatial sound using the sound-electrical energy conversion modules, so that the position of the sound source of the spatial sound heard by the user matches the real-time azimuth information of the spatial object relative to the headset.

[0063] In Embodiment 1 of this application, spatial sound data is generated based on azimuth information and content information of the navigation destination. The spatial sound data is used to play spatial sound, the azimuth of the spatial sound source matches the azimuth of the navigation destination relative to the headset, and the spatial sound playback content matches the route plan used to travel from the data generation device to the navigation destination, so that the user can determine the correct direction of travel based on the azimuth of the spatial sound source heard. In this way, a more intuitive information presentation method is provided, and the user does not need to frequently open the map to check whether the user's direction of travel is correct. Operation is simple, and therefore the convenience, security, and user experience of navigation are improved.

[0064] It should be noted that the data generation device 10 in Figure 1 is specifically represented as a headset, but this is merely an example. In actual applications, the data generation device 10 could alternatively be a vehicle, mobile phone, portable computer, navigator, or another portable terminal device.

[0065] Second Implementation: Specifically, Figure 2 is a schematic diagram of a data generation method according to Embodiment 2 of this application. The data generation method is performed by the data generation device 20 in Figure 2. In Figure 2, the data generation device 20 is a mobile phone, and the audio playback device 21 is a headset; the mobile phone and the headset are independent devices. Figure 2 should be understood as merely an example. The specific implementation process in this application scenario is described in detail below.

[0066] A mobile phone (i.e., an example of a data generation device 20) receives navigation data transmitted by the navigation server 22. After receiving the navigation data, the mobile phone generates content information and azimuth information based on spatial object information and generates spatial sound data. The specific implementation is similar to the specific implementation in the embodiment corresponding to Figure 1, in which the data generation device 10 performs the steps described above. Details are not described here.

[0067] Optionally, the spatial sound data in this embodiment includes azimuth information and content information. After generating the spatial sound data, the mobile phone transmits the spatial sound data to the headset (i.e., the audio playback device). 21 The data is sent to an example of the following: The headset performs a rendering operation based on the spatial sound data to generate two monophonic signals, transmits the two monophonic signals to an acoustic-electric energy conversion module, and reproduces the spatial sound using the two acoustic-electric energy conversion modules within the headset. Optionally, in the process of generating the two monophonic signals, the headset may further adjust the spatial sound playback volume based on the spatial sound data. Specifically, if volume up instruction information is generated, the spatial sound playback volume is increased, and if volume down instruction information is generated, the spatial sound playback volume is decreased.

[0068] Optionally, before generating two monophonic signals based on spatial sound data, the headset may further acquire its orientation, then re-render the content information in the form of an audio stream based on the headset's orientation, and transmit the two monophonic signals acquired after the re-rendering operation to two sound-electrical energy conversion modules within the headset, which can then use the sound-electrical energy conversion modules to reproduce spatial sound, ensuring that the location of the sound source of the spatial sound heard by the user matches the azimuth information of the spatial object.

[0069] It should be noted that the data generation device 20 in Figure 2 is specifically represented as a mobile phone, but this is merely an example. In actual applications, the data generation device 20 may alternatively be represented as a portable computer, navigator, or another portable terminal device.

[0070] Third Implementation: Specifically, Figure 3 is a schematic diagram of an implementation of a data generation method according to one embodiment of this application. In Figure 3, the data generation device 30 is a mobile phone, and the audio playback device 31 is a headset, with the mobile phone and headset being independent devices. Figure 3 should be understood as merely an example. The specific implementation process in this application scenario is described in detail below.

[0071] A mobile phone (i.e., an example of a data generation device 30) receives navigation data transmitted by the navigation server 32. After receiving spatial object information, the mobile phone generates content information and azimuth information based on the spatial object information, and then performs a rendering operation based on the content information and azimuth information to generate spatial sound data. In this embodiment, the spatial sound data refers to at least two monophonic signals. The specific implementation is similar to the specific implementation in the embodiment corresponding to Figure 1 in which the data generation device 10 performs the steps described above. Details are not described here.

[0072] Optionally, the mobile phone transmits two monophonic signals to a headset (i.e., an example of an audio playback device 31), and the headset inputs the two monophonic signals into a sound-electrical energy conversion module to reproduce spatial sound. Optionally, the headset may acquire its orientation and transmit it to the mobile phone. Based on the headset's orientation, the mobile phone re-renders content information in the form of an audio stream, and transmits the two monophonic signals acquired after the re-rendering operation is performed to the headset. The headset inputs the two monophonic signals into a sound-electrical energy conversion module to reproduce spatial sound.

[0073] It should be noted that the data generation device 30 in Figure 3 is specifically represented as a mobile phone, but this is merely an example. In actual applications, the data generation device 30 may alternatively be represented as a portable computer, navigator, or another portable terminal device.

[0074] Three implementations of the data generation method provided in the embodiments of this application are described by using an in-vehicle navigation scenario as an example. The three implementations in the in-vehicle navigation scenario are similar to the three implementations in the pedestrian navigation scenario. For specific implementations of the data generation device, audio playback device, and navigation server in the in-vehicle navigation scenario, refer to the embodiments described above. Details are not described here. Compared to pedestrian navigation, when the data generation device and audio playback device are integrated into the same terminal device, in addition to the example in the embodiment corresponding to Figure 1, a specific display format of the data generation device may be a vehicle, and the audio playback device refers to the sound-electric energy conversion module in the aforementioned data generation devices. When the data generation device and audio playback device are two independent devices, in addition to the example in the embodiment corresponding to Figure 1, a specific display format of the data generation device may be a vehicle. When the terminal device or a specific display format of the data generation device is a vehicle, the attitude may specifically be the attitude of the vehicle's head, the attitude of the vehicle's wheels, the attitude of another element, etc.

[0075] Refer to Figure 4 for further understanding of this solution. Figure 4 is a schematic diagram of an implementation of a data generation method according to one embodiment of this application. In the in-car navigation scenario, Figure 4 shows a person driving a vehicle wearing a headset, and an example is used in which the data generation device is a mobile phone, the audio playback device is a headset, and the data generation device and the audio playback device are independent devices. The specific implementation of the data generation device 40, audio playback device 41, and navigation server 42 in Figure 4 is similar to the implementation of the data generation device 20, audio playback device 21, and navigation server 22 in the embodiment corresponding to Figure 2. Details are not described here. The example in Figure 4 is used solely to facilitate understanding of this solution and is not used to limit this solution.

[0076] Four implementations of the data generation method provided in the embodiments of this application are described below, using an example in which surrounding spatial objects are described by using map data stored on the network side or terminal side.

[0077] First Implementation: Figure 5 is a schematic diagram of an implementation of a data generation method according to one embodiment of the present application. The data generation method is performed by the data generation device 50 in Figure 5. Figure 5 shows the headset configuration of the data generation device 50. Figure 5 should be understood as merely an example. The specific implementation process in this application scenario is described in detail below by using an example in which the data generation device 50 is specifically represented as a headset.

[0078] The headset obtains absolute coordinates (also known as longitude and latitude coordinates) corresponding to its spatial position, transmits these absolute coordinates to the data server 51, and receives spatial object information transmitted by the data server 51. The spatial object information includes the object content of the spatial objects surrounding the headset and the spatial position of the spatial objects surrounding the headset. The spatial position of the spatial objects surrounding the headset may be the absolute coordinates of the spatial objects or the relative coordinates of the spatial objects with respect to the headset.

[0079] After receiving spatial object information, the headset generates azimuth information based on the spatial positions of the spatial objects surrounding the headset. Optionally, the headset may further acquire orientation and generate azimuth information for the spatial objects relative to the data generation device 50 based on the orientation and spatial object information. The headset generates content information based on the azimuth information and object content of the spatial objects surrounding the headset.

[0080] The headset needs to generate spatial sound data after acquiring azimuth information and content information. The specific implementation is similar to the specific implementation in the embodiment corresponding to Figure 1, in which the data generation device 10 performs the steps described above. Details are not described here. Optionally, before generating spatial sound data, the headset may further determine whether the spatial position indicated in the azimuth information is located in a pre-set spatial position region, whether the spatial position indicated in the azimuth information is located in a pre-set spatial direction, or whether the object content indicated in the content information is a pre-set object content, and if the result of any one or more of the above cases is "yes", it may determine whether the spatial object information satisfies the pre-set conditions.

[0081] In some cases, when spatial object information satisfies pre-set conditions, the headset generates spatial sound data based on azimuth information and content information. If the spatial object information does not satisfy the pre-set conditions, the headset no longer generates spatial sound data based on the spatial object information and can then process the next spatial object information. The headset does not play spatial object information that does not satisfy the pre-set conditions; in other words, it pre-filters spatial object information to reduce interference to the user and improve the user experience of this solution.

[0082] In another case, when the spatial object information satisfies pre-set conditions, the headset generates volume-up instruction information and generates spatial sound data based on the azimuth information, content information, and volume-up instruction information. If the spatial object information does not satisfy the pre-set conditions, the headset no longer generates spatial sound data based on the spatial object information and may then process the next spatial object information.

[0083] In another case, when the spatial object information satisfies pre-set conditions, the headset generates volume-up instruction information and generates spatial sound data based on azimuth information, content information, and volume-up instruction information. When the spatial object information does not satisfy pre-set conditions, the headset generates spatial sound data based on azimuth information and content information.

[0084] In another case, when the spatial object information satisfies pre-set conditions, the headset generates volume-up instruction information and generates spatial sound data based on azimuth information, content information, and volume-up instruction information. When the spatial object information does not satisfy pre-set conditions, the headset generates volume-down instruction information and generates spatial sound data based on azimuth information, content information, and volume-down instruction information.

[0085] Optionally, the headset generates spatial sound data, then generates spatial sound based on that data, and plays the spatial sound. For specific implementations, refer to the process by which the data generation device 10 performs the aforementioned steps in the embodiment corresponding to Figure 1. Details are not described here.

[0086] It should be noted that the data generation device 50 in Figure 5 is specifically represented as a headset, but this is merely an example. In actual applications, the data generation device 50 may be represented as a mobile phone, portable computer, navigator, or vehicle, among other forms.

[0087] Second implementation: This implementation provides an explanation by using an example in which the data generation device is a mobile phone, the audio playback device is a headset, and the mobile phone and headset are independent devices.

[0088] The mobile phone transmits absolute coordinates corresponding to its spatial position to a data server, receives spatial object information transmitted by the data server, and generates content information and azimuth information based on the spatial object information. For specific implementations, refer to the specific implementation in the embodiment corresponding to Figure 5 in which the data generation device 50 performs the steps described above. Optionally, the mobile phone may further acquire the orientation of the headset and generate azimuth information based on the headset orientation and spatial object information. Specifically, the headset measures its orientation and transmits the headset orientation to the mobile phone.

[0089] The mobile phone generates spatial sound data after acquiring content information and azimuth information. In this embodiment, the spatial sound data includes azimuth information and content information. The specific implementation is similar to the specific implementation in the embodiment corresponding to Figure 5, in which the data generation device 50 performs the steps described above. Details are not described here.

[0090] Optionally, the mobile phone generates spatial sound data and then transmits it to the headset. The headset performs a rendering operation based on the spatial sound data to obtain at least two monophonic signals, transmits at least two monophonic signals to an acoustic-electrical energy conversion module, and reproduces the spatial sound using the acoustic-electrical energy conversion module. For a specific implementation of the steps described above, refer to the specific implementation in the embodiment corresponding to Figure 2 in which the data generation device 20 and the audio playback device 21 perform the steps described above. Details are not described here.

[0091] Third implementation: This implementation provides an explanation by using an example in which the data generation device is a mobile phone, the audio playback device is a headset, and the mobile phone and headset are independent devices.

[0092] The mobile phone transmits absolute coordinates corresponding to its spatial location to a data server, receives spatial object information transmitted by the data server, and generates content information and azimuth information based on the spatial object information. For a specific implementation of the steps described above, refer to the explanation in the second implementation scenario, which describes surrounding spatial objects using map data stored on the network side or terminal side. Details are not described here.

[0093] The rendering operation is performed based on azimuth information and content information to generate spatial sound data. In this embodiment, spatial sound data refers to at least two monophonic signals generated based on azimuth information and content information. At least two monophonic signals are transmitted to the headset. The headset transmits the at least two monophonic signals to the sound-electrical energy conversion module to reproduce spatial sound. For a specific implementation of the steps described above, refer to the specific implementation in the embodiment corresponding to Figure 3 in which the data generation device 30 and the audio playback device 31 perform the steps described above. Details are not described here.

[0094] In the second and third implementations of scenarios in which surrounding spatial objects are described by using map data stored on the network side or the terminal side, it should be noted that the data generating device may alternatively be represented in the form of a mobile phone, portable computer, or navigator, and the terminal-side electronic device in which the sensor is configured may alternatively be represented as another terminal-side device such as a headset, portable computer, navigator, or smart home appliance.

[0095] Fourth Implementation: This implementation is similar to the first implementation in a scenario where surrounding spatial objects are described by using map data stored on the network side or the terminal side. The difference is that the data server 51 in the first implementation in a scenario where surrounding spatial objects are described by using map data stored on the network side or the terminal side is replaced by an electronic device on the terminal side, and the terminal-side electronic device and terminal device, which integrate the data generation device and audio playback device, are different devices. In this implementation, the specific steps performed by the data generation device and audio playback device are the same as the specific steps performed by the data generation device 50 and audio playback device in the embodiment corresponding to Figure 5, and the specific steps performed by the terminal-side electronic device are the same as the specific steps performed by the data server 51 in the embodiment corresponding to Figure 5. Further details are not described here.

[0096] Six implementations of the data generation method provided in the embodiments of this application are described below by using examples in which surrounding spatial objects are detected and described using sensors.

[0097] First Implementation: Figure 6 is a schematic diagram of an implementation of a data generation method according to one embodiment of the present application. The data generation method is performed by the data generation device 60 in Figure 6. Figure 6 shows the headset configuration of the data generation device 60. Figure 6 should be understood as merely an example. The specific implementation process in this application scenario will be described in detail below by using an example in which the data generation device 60 is specifically represented as a headset and a photosensitive sensor is disposed in the headset.

[0098] The headset collects spatial object information by using photosensitive sensors. Specifically, at least two photosensitive sensors are deployed within the headset, and the headset uses the data collected by the photosensitive sensors to determine the spatial position of a light source (i.e., the spatial object surrounding the headset in Figure 6), generate the relative coordinates of the light source to the headset, and determine the type of light source based on the data collected by the photosensitive sensors. To further understand this solution, in another example, at least two image sensors may be deployed within the headset, and the headset may use a binocular vision algorithm to identify the spatial object surrounding the headset, generate the relative coordinates of the spatial object surrounding the headset to the headset, and after acquiring an image of the spatial object surrounding the headset using the image sensors, recognize the image of the spatial object and obtain the object content of the spatial object. The examples herein are used solely to demonstrate the implementability of this solution and are not used to limit it.

[0099] The headset generates azimuth information based on the relative coordinates of the spatial objects surrounding the headset. Optionally, the headset may further acquire the headset's orientation and generate azimuth information for the spatial objects relative to the headset based on the headset's orientation and spatial object information. The headset generates content information based on the azimuth information and type of the spatial objects surrounding the headset. After acquiring the azimuth information and content information, the headset generates spatial sound data and plays spatial sound based on the spatial sound data. For a specific implementation of how the headset performs the above steps, refer to the description of how the data generation device 50 performs the above steps in the embodiment corresponding to Figure 5. Details are not described here.

[0100] It should be noted that the data generation device 60 in Figure 6 is specifically represented as a headset, but this is merely an example. In actual applications, the data generation device 60 may be represented as a mobile phone, portable computer, navigator, or vehicle, among other forms.

[0101] Second Implementation: Figure 7 is a schematic diagram of an implementation of a data generation method according to one embodiment of the present application. The specific implementation process in this application scenario will be described in detail below using an example in which the data generation device 70 is specifically represented as a mobile phone, the audio playback device 71 is specifically represented as a headset, and a sound sensor is provided in the mobile phone. Figure 7 should be understood as merely an example.

[0102] A mobile phone (i.e., an example of a data generation device 70) uses a sound sensor to: mobile phone This involves collecting spatial object information corresponding to the surrounding spatial objects. Specifically, the mobile phone is equipped with at least two sound sensors, and the spatial position in Figure 7 is determined by using a delayed estimation positioning method based on the data collected by the sensors, thereby obtaining the relative coordinates of the spatial objects surrounding the mobile phone. In this application scenario, the relative coordinates may include height information. Additionally, the type of spatial object, e.g., bat, bird, or cat, is determined based on the data collected by the sensors. Different types of spatial objects emit sounds at different frequencies.

[0103] The mobile phone generates azimuth information based on the relative coordinates of the spatial objects surrounding the mobile phone. Optionally, the mobile phone may further acquire the orientation of the headset and generate azimuth information of the spatial objects relative to the mobile phone based on the orientation of the headset and the spatial object information. The mobile phone generates content information based on the azimuth information of the spatial objects surrounding the mobile phone and the object content. After acquiring the content information and azimuth information, the mobile phone generates spatial sound data. In this embodiment, the spatial sound data includes azimuth information and content information. For specific implementations in which the mobile phone performs the steps described above, see the description of how the data generation device 20 and audio playback device 21 perform the steps described above in the embodiment corresponding to Figure 2. Details are not described here.

[0104] Optionally, the mobile phone generates spatial sound data and then transmits it to a headset (i.e., an example of an audio playback device 71), and the headset plays spatial sound based on the spatial sound data by using an acoustic-electrical energy conversion module. For a specific implementation of how the headset plays spatial sound based on spatial sound data, see the embodiment corresponding to Figure 2. In this process, the data generation device 20 and the audio playback device 21 perform the steps described above. Please refer to the specific implementation details. Further details are not provided here.

[0105] Third implementation: This implementation provides an explanation using an example where the electronic device integrating the data generation device and sensor is a mobile phone, and the audio playback device is a headset.

[0106] The mobile phone collects spatial object information corresponding to the spatial objects surrounding the mobile phone by using sensors, and generates content information and azimuth information based on the spatial object information. The specific implementation of the steps described above is the same as the specific implementation of the data generation device 70 in the embodiment corresponding to Figure 7. Details are not described here.

[0107] Optionally, the data generation device performs a rendering operation based on content information and azimuth information to acquire spatial sound data. In this embodiment, the spatial sound data includes at least two monophonic signals. At least two monophonic signals are transmitted to the audio playback device. The audio playback device transmits at least two monophonic signals to the sound-electrical energy conversion module to reproduce the spatial sound. For a specific implementation of the steps described above, refer to the specific implementation of the data generation device 30 and audio playback device 31 in the embodiment corresponding to Figure 3. Details are not described here.

[0108] In the second and third implementations of scenarios in which sensors are used to detect and describe surrounding spatial objects, it should be noted that the data generation device being specifically represented as a mobile phone is merely an example. In actual applications, the data generation device may be represented as a portable computer, navigator, or vehicle, among other forms.

[0109] Fourth Implementation: This implementation provides an explanation using an example in which the terminal device integrating the data generation device and the audio playback device is a headset, and the terminal-side electronic device comprising the sensors is a vehicle. In this implementation, the data generation device may be considered as an independent device, i.e., a headset, or as separate devices including both the vehicle and a dual-channel headset located within the vehicle.

[0110] The headset surrounds the sensors inside the vehicle by using sensors. spatial objectsSpatial object information is acquired. Spatial object information includes the relative coordinates of spatial objects to the sensor and the object content of spatial objects surrounding the sensor. Specifically, in one case, the vehicle collects data corresponding to surrounding spatial objects by using sensors, the headset receives the data collected by the sensors and transmitted by the vehicle, and generates spatial object information based on the data collected by the sensors. In another case, the vehicle collects data corresponding to surrounding spatial objects by using sensors, generates spatial object information based on the data collected by the sensors, and the headset receives the spatial object information transmitted by the vehicle.

[0111] The headset generates azimuth information based on the relative coordinates of the spatial objects surrounding the sensor. Optionally, the headset may further acquire the headset's orientation and generate azimuth information of the spatial objects relative to the headset based on the headset's orientation and spatial object information. The headset generates content information based on the azimuth information and type of the spatial objects surrounding the headset. After generating the content information and azimuth information, the headset generates spatial sound data and plays the spatial sound. The specific implementation of the headset performing the steps described above is similar to the specific implementation of the data generation device 60 in the embodiment corresponding to Figure 6. Details are not described here.

[0112] It should be noted that the headset may be replaced by alternative forms such as a mobile phone, portable computer, or navigator, and the terminal electronic device in which the sensor is configured may be represented by alternative terminal devices such as a headset, portable computer, navigator, or smart home appliance.

[0113] Fifth implementation: This implementation provides an explanation by using an example in which the data generation device is a mobile phone, the audio playback device is a headset, the terminal electronic device in which the sensor is configured is a vehicle, and the mobile phone and headset are independent devices of each other.

[0114] Mobile phones surround sensors within the vehicle by using their sensors. spatial objects Spatial object information is acquired, and based on the spatial object information, azimuth information and content information are generated to produce spatial sound data. In this embodiment, the spatial sound data includes azimuth information and content information. A specific implementation in which a mobile phone performs the steps described above is similar to the fourth implementation in a scenario in which surrounding spatial objects are detected and described by using sensors. Details are not described here.

[0115] Optionally, the mobile phone may generate spatial sound data and then transmit it to the headset. The headset performs a rendering operation based on the spatial sound data to obtain at least two monophonic signals, transmits at least two monophonic signals to an acoustic-electric energy conversion module, and reproduces the spatial sound using the acoustic-electric energy conversion module. For a specific implementation of the steps described above, see the specific implementation in the embodiment corresponding to Figure 2 in which the data generation device 20 and the audio playback device 21 perform the steps described above. Details are not described here.

[0116] Sixth Implementation: This implementation provides an explanation by using an example in which the data generation device is a mobile phone, the audio playback device is a headset, the terminal electronic device in which the sensor is configured is a vehicle, and the mobile phone and headset are independent devices of each other.

[0117] Mobile phones surround sensors within the vehicle by using their sensors. spatial objectsThe system acquires spatial object information and generates azimuth information and content information based on that spatial object information. The specific implementation in which a mobile phone performs the aforementioned steps is similar to the fourth implementation in a scenario where sensors are used to detect and describe surrounding spatial objects. Further details are not provided here.

[0118] The mobile phone generates azimuth information and content information, then performs a rendering operation to acquire spatial sound data. In this embodiment, the spatial sound data includes at least two monophonic signals. At least two monophonic signals are transmitted to the headset. The headset transmits the at least two monophonic signals to an electroacoustic energy conversion module to reproduce the spatial sound. For a specific implementation of the steps described above, refer to the specific implementation of the data generation device 30 and headset 31 in the embodiment corresponding to Figure 3. Details are not described here.

[0119] In the fifth and sixth embodiments of scenarios in which surrounding spatial objects are detected and described by using sensors, it should be noted that the data generating device may be considered an independent device, i.e., a mobile phone, or a separate device including both a vehicle and a mobile phone located inside the vehicle. Additionally, it should be noted that the mobile phone may be replaced by a portable computer or navigator, and the terminal-side electronic device in which the sensor is configured may be represented by another terminal-side device such as a headset, portable computer, navigator, or smart home appliance.

[0120] One embodiment of the present invention provides a data generation method, which is performed by a data generation device (including, but not limited to, the data generation device in each of the embodiments corresponding to Figures 1 to 7). The data generation device may, after receiving spatial object information, directly generate spatial object data based on the received spatial object information without filtering the received spatial object information, or it may filter the received spatial object information and generate spatial object data based only on spatial object information that satisfies pre-set conditions. There are different specific implementation procedures in the two implementations, and therefore the implementation procedures are described separately.

[0121] (1) Spatial object information is not filtered.

[0122] In one embodiment of this application, Figure 8 is a schematic flowchart of the data generation method according to this embodiment of the application. The data generation method provided in this embodiment of the application may include the following steps.

[0123] Step 801: The data generation device acquires spatial object information.

[0124] In this embodiment of the present application, the data generation device generates spatial objects in the following manner information This can be obtained. That is, the data generation device receives spatial object information, or the data generation device collects spatial object information by using a sensor. The data generation device may generate spatial sound data based on the received spatial object information, or it may generate spatial sound data based on spatial object information collected by using a sensor. In other words, the data presentation method provided in this solution is applicable to multiple application scenarios, and the application scenarios of this solution are expandable. This improves the flexibility of the implementation of this solution.

[0125] Spatial object information is descriptive information of a spatial object, used to obtain azimuth information of the spatial object relative to the data generation device, and includes at least descriptive information of the azimuth of the spatial object. A spatial object is an object located in three-dimensional space. For example, spatial object information may be in text format and include navigation data used to navigate from the data generation device to a navigation destination, or in audio stream format and include navigation data used to navigate from the data generation device to a navigation destination, or it may include object content and absolute coordinates of spatial objects surrounding the data generation device, or it may include object content and relative coordinates of spatial objects surrounding the data generation device. The receiving method in this embodiment of the application includes, but is not limited to, methods of receiving information by using cellular communication, Wireless Fidelity (Wi-Fi), Worldwide Interoperability for Microwave Access (WiMAX), Bluetooth communication technology (Bluetooth), ZigBee communication technology (ZigBee), optical communication, satellite communication, infrared communication, transmission line communication, hardware interface, or traces on a hardware circuit board, or methods of obtaining information from a software module or reading information from a storage device. The sensor includes at least one of a photosensitive sensor, sound sensor, image sensor, infrared sensor, thermal sensor, pressure sensor, or inertial sensor. In the aforementioned methods, multiple specific implementations of the sensor are provided to improve the flexibility of implementation of the solution.

[0126] In the three implementations in the pedestrian navigation scenario and the three implementations in the in-vehicle navigation scenario, the data generator receiving spatial object information may include the navigation application program being set in the data generator to acquire the navigation start point and navigation destination, the data generator using the navigation application program to transmit the navigation start point and navigation destination to the navigation server, and receiving spatial object information in text format transmitted by the navigation server; in other words, the data generator using the navigation application program to receive interface data. The spatial object information in text format carries the navigation data used to navigate from the navigation start point to the navigation destination.

[0127] The data generation device may transmit to the navigation server the names of the navigation start point and navigation destination, the longitude and latitude coordinates of the navigation start point and navigation destination, or other information used to indicate the spatial location of the navigation start point and navigation destination. Spatial objects corresponding to spatial object information may include navigation destinations with spatial locations, traffic sign posts, monitors, and other navigation-related spatial objects. Navigation data used to travel from the navigation start point to the navigation destination may include at least one road segment, and spatial object information in text format may include descriptive information for at least one road segment. The descriptive information for each road segment includes multiple fields and field values ​​for each field. Multiple fields may include field values ​​for content fields. For example, a content field may be a road segment description (instruction) field. Multiple fields may further include location fields. For example, a location field may specifically be a distance field and a turn field. A location field may further include other fields. Alternatively, multiple fields may include only content fields and not location fields, etc. This is not limited herein. Here, an example is used where spatial object information is displayed in a table format. See Figure 1. [Table 1]

[0128] Refer to Figure 1. Table 1 shows the descriptive information for road segments in spatial object information. The examples in Table 1 are used solely to facilitate understanding of this solution and are not intended to limit it.

[0129] Specifically, regarding the method for acquiring the navigation starting point, in one case, a positioning system, such as the Global Positioning System (GPS), may be further configured in the data generation device, and the data generation device acquires its spatial position by using the positioning system and determines the spatial position as the navigation starting point. In another case, the data generation device receives the navigation starting point entered by the user. More specifically, when the data generation device is, for example, a device that includes a display interface and has projection capabilities, such as a headset, mobile phone, portable computer, navigator, or vehicle, the data generation device may receive the navigation starting point entered by the user by using the display interface of a navigation application program. When the data generation device is a headset without projection capabilities or another device without a display interface, a microphone may be further configured in the data generation device, and the data generation device receives the navigation starting point in voice format and entered by the user by using the microphone. Optionally, when the data generator includes a display interface, a microphone may be further configured within the data generator, which, by using the microphone, receives the navigation start point entered by the user in voice format. For the method of obtaining the navigation destination, the data generator receives the navigation destination entered by the user. For specific implementations, refer to the method by which the data generator receives the navigation start point entered by the user. Details are not described here.

[0130] Optionally, after a data generator receives spatial object information in text format transmitted by a navigation server by using a navigation application program, the navigation application program within the data generator may convert the spatial object information in text format into spatial object information in audio stream format, and the data generator obtains the spatial object information in audio stream format from the navigation application program. In other words, the data generator receives spatial object information (which may also be called audio stream data) in audio stream format by using the navigation application program. For example, the audio stream data may be pulse code modulation (PCM) audio stream data or audio stream data in another format. Specifically, the operating system of the data generator may obtain spatial object information in audio stream format output by the navigation application program by using the function AudioPolicyManagerBase::getOutput (i.e., a function of the audio policy implementation layer).

[0131] In the first three implementations of a scenario describing surrounding spatial objects by using map data stored on the network or terminal side, the data generator receiving spatial object information may include the data generator obtaining a first coordinate corresponding to the spatial position of the data generator, transmitting the first coordinate corresponding to the spatial position of the data generator to the data server, and receiving spatial object information transmitted by the data server. The spatial object information includes the object content and second coordinates of the spatial objects surrounding the data generator. The first coordinate may be the longitude and latitude coordinates (also called absolute coordinates) of the data generator. The second coordinate may be the absolute coordinate corresponding to the spatial position of the spatial object, or it may be the relative coordinate of the spatial position of the spatial object with respect to the spatial position of the data generator. When the second coordinate is the absolute coordinate of the spatial object, the spatial object information refers to map data corresponding to the spatial object; in other words, the data generator receives map data stored on the network side. The spatial objects included in the spatial object information may be a library, a pizzeria, or a structural site in Figure 5, or another physical object located in three-dimensional space.

[0132] Specifically, the positioning system is configured in the data generation device, and the data generation device can use the positioning system to obtain a first coordinate corresponding to the spatial position of the data generation device and transmit the first coordinate corresponding to the spatial position of the data generation device to the data server. The data server surrounds the data generation device. spatial objectsMap data can be stored in advance. The map data includes the object content of spatial objects surrounding the data generation device, and absolute coordinates corresponding to the spatial positions of the spatial objects surrounding the data generation device. After receiving a first coordinate corresponding to the spatial position of the data generation device, the data server obtains the object content of the spatial objects surrounding the first coordinate and a second coordinate, generates spatial object information, and transmits the spatial object information, including the object content of the spatial objects surrounding the first coordinate and the second coordinate, to the data generation device. In response, the data generation device receives the spatial object information transmitted by the data server.

[0133] Specifically, the data server receives a first coordinate corresponding to the spatial position of the data generation device, then obtains the object content and absolute coordinates of the spatial objects surrounding the first coordinate, and generates spatial object information. The second coordinate carried in the spatial object information is an absolute coordinate. Optionally, after receiving the first coordinate and obtaining the absolute coordinates of the spatial objects surrounding the first coordinate, the data server may further generate relative coordinates of the spatial objects surrounding the first coordinate by using the first coordinate as the origin, and based on the first coordinate and the absolute coordinates of the spatial objects surrounding the first coordinate, determine the relative coordinate as the second coordinate, and generate spatial object information based on the object content of the spatial objects surrounding the first coordinate and the second coordinate. The second coordinate carried in the spatial object information is an absolute coordinate.

[0134] In a fourth implementation of a scenario describing surrounding spatial objects using map data stored on the network or terminal side, the data generator receiving spatial object information may include the data generator obtaining a first coordinate corresponding to the spatial location of the data generator, transmitting the first coordinate corresponding to the spatial location of the data generator to a terminal-side electronic device, and receiving spatial object information transmitted by the terminal-side electronic device. The spatial object information includes the object content and second coordinates of the spatial objects surrounding the data generator. In this embodiment, for specific steps performed by the data generator, refer to the specific implementation descriptions in the first three implementations of the scenario describing surrounding spatial objects using map data stored on the network or terminal side in the embodiments described above. The difference is that the data server in the embodiments described above is replaced by a terminal-side electronic device. Details are not described here.

[0135] In the first three implementations of a scenario in which surrounding spatial objects are detected and described by using sensors, the data generator collects spatial object information by using sensors, the data generator sends a signal acquisition command to the sensor by using an internal interface, the sensor collects data, the data generator receives the data collected by the sensor, and generates spatial object information based on the data collected by the sensor. Specifically, the data generator identifies the spatial objects surrounding the data generator based on the collected data, generates the relative coordinates of the spatial objects surrounding the data generator, and determines the object content of the spatial objects surrounding the data generator based on the data collected by the sensor. For specific embodiments, see the description in the embodiments corresponding to Figures 6 and 7.

[0136] In the latter three implementations of a scenario in which a sensor is used to detect and describe surrounding spatial objects, the data generation device's collection of spatial object information by using the sensor may, in one case, include the terminal electronic device on which the sensor is configured collecting data corresponding to surrounding spatial objects by using the sensor, the data generation device receiving the data collected by the sensor and transmitted by the terminal electronic device on which the sensor is configured, and generating spatial object information based on the data collected by the sensor. In another case, the terminal electronic device on which the sensor is configured collects data corresponding to surrounding spatial objects by using the sensor, generates spatial object information based on the data collected by the sensor, and the data generation device receiving the spatial object information transmitted by the terminal electronic device on which the sensor is configured.

[0137] Specifically, in one case, the data generation device sends a sensor data acquisition request to the terminal electronic device on which the sensor is configured. In response to the sensor data acquisition request, the terminal electronic device on which the sensor is configured collects data corresponding to surrounding spatial objects by using the sensor, and then transmits the data or spatial object information collected by the sensor to the data generation device. In another case, the terminal electronic device on which the sensor is configured may actively transmit the data or spatial object information collected by the sensor to the data generation device. More specifically, the transmission method may be real-time transmission, transmission at intervals of a predetermined duration, transmission at a fixed point in time, or another transmission method. This is not limited to the foregoing.

[0138] Regarding the time at which spatial object information is received, in pedestrian navigation scenarios and in-vehicle navigation scenarios, the data generator receives spatial object information when the user performs the navigation function by using the navigation application program in the data generator. In scenarios that describe surrounding spatial objects by using map data stored on the network side or terminal side, and in scenarios that detect and describe surrounding spatial objects by using sensors, specifically in the implementation, the data generator can always be in a state to receive spatial object information, and the received spatial object information is converted into spatial sound data in a timely manner, and spatial sound is played back in a timely manner. Optionally, a switch button for receiving enable and disable operations from the user may be provided on the data generator. When the user inputs an enable operation by using the switch button, the data generator is in a state to receive spatial object information. When the user inputs a disable operation by using the switch button, the data generator disables the function of receiving spatial object information and no longer receives spatial object information. Specifically, in one case, the data generation device is an electronic device that can provide a display interface for the user, and therefore can display the switch control to the user by using the display interface in order to receive the switch control, enable operation, or disable operation input by the user. In another case, when the data generation device is an electronic device that cannot provide a display interface, the switch buttons are located outside the data generation device so that the enable and disable operations are input by using the switch buttons.

[0139] Step 802: The data generation device generates content information and azimuth information based on spatial object information.

[0140] In this embodiment of the present application, the data generation device may generate content information and azimuth information based on spatial object information. The content information is used to determine the content to be played for spatial sound, and the content information includes azimuth information. When the spatial object is a navigation destination, the content information is used to describe a route plan used to travel from the data generation device to the navigation destination. When the spatial object is a spatial event, or a person, animal, or spatial object, the content information is used to describe the orientation of the spatial object to the data generation device and the object content of the spatial object. For example, the content information may be "go straight for 100m, then turn right" or "there is a coffee shop on the left 50m ahead." The examples herein are used solely to facilitate understanding of the present solution and are not intended to limit the present solution. The azimuth information may include position information and direction information and is used to indicate the azimuth of the spatial object relative to the terminal device. The azimuth information may or may not carry height information, and may be specifically expressed as Cartesian coordinates or in another form of azimuth information. The terminal device may be a data generation device, an audio playback device, or a terminal-side electronic device comprising a sensor. Furthermore, a terminal-side electronic device comprising a sensor and a data generation device may be the same terminal-side electronic device, a terminal-side electronic device comprising a sensor and possibly having the same audio playback device, or a terminal-side electronic device comprising a sensor may be a device independent of the data generation device and the audio playback device.

[0141] In pedestrian navigation and in-vehicle navigation scenarios, spatial object information may include navigation data in text format, and this text-format navigation data may include field values ​​of content fields. In this case, step 802 may include the data generator generating azimuth information and content information based on the field values ​​of content fields included in the spatial object information. Optionally, if the navigation data in text format includes field values ​​of content fields and field values ​​of position fields, step 802 may include the following: The data generator generates content information based on the field values ​​of content fields and generates azimuth information based on the field values ​​of position fields. For example, refer to Table 1 for an example. The azimuth information is the relative coordinates of the spatial object. Here, an example is used in which the azimuth information can carry height information. In this case, explanation needs to be provided by using the x, y, and z axes. Based on the right / left turn fields in Table 1, it is obtained that the spatial object is on the right side of the terminal device. The azimuth "right" does not have a specific distance value, and therefore the distance value may be set to a default value, for example, 10 meters by default, and the value on the X axis is 10. Based on the distance field, the spatial object is located 100m away from the terminal device, and its value on the y-axis is 100. Since there is no height information, the value on the z-axis may be set to 0. In this way, the azimuth information of the spatial object (10, 100, 0) is obtained. Based on the command field, the content information is obtained as "move straight for 100m, then turn right". It should be understood that the value on the x-axis could alternatively be -10, another value, etc. This example is used solely to facilitate understanding of this solution and not to limit it.

[0142] Optionally, spatial object information includes navigation data in the form of an audio stream, navigation data in the form of an audio stream includes content information, and content information includes azimuth information. In this case, step 802 may include the data generator performing speech recognition on the navigation data in the form of an audio stream to obtain azimuth information and content information. For example, the example shown in Table 1 is used. The azimuth information is the relative coordinates of the spatial object. Here, an example is used in which the azimuth information can carry height information. In this case, explanation needs to be provided by using the x, y, and z axes. The navigation data in the form of an audio stream is "Go straight for 100 meters, then turn right," and after speech recognition is performed on the navigation data in the form of an audio stream, the keyword "right" is extracted. There is no specific distance value for the azimuth "right" in the navigation data, and therefore the distance value may be set to a default value, for example, set to 10 meters by default, and the value on the X axis is 10. The keywords "straight ahead" and "100 meters" are extracted, and therefore the azimuth distance for going straight ahead is 100 meters, in other words, the value on the y-axis is 100. There is no height information, and therefore the value on the z-axis can be set to 0. In this way, the azimuth information of the spatial object (10,100,0) is obtained. By performing speech recognition on navigation data in audio stream format, the content information "go straight ahead for 100m, then turn right" is obtained. This example is used merely to facilitate understanding of this solution and should not be used to limit it.

[0143] Map data stored on the network side or the terminal side By using it, you can describe the surrounding spatial objects. In the scenario, spatial object information includes data GenerateThis includes the object content and absolute coordinates of spatial objects surrounding the device. In this case, step 802 may include the data generation device generating azimuth information based on the spatial position of the data generation device and spatial object information. Specifically, the data generation device uses a first coordinate corresponding to the spatial position of the data generation device (i.e., the absolute coordinate of the spatial position of the data generation device) as the coordinate origin, determines the user's direction of travel using a gyroscope or a positioning system in the data generation device, establishes a coordinate system by using the user's direction of travel as the positive direction of the y-axis, determines the position of the spatial object in the coordinate system based on the absolute coordinates of the spatial object surrounding the spatial position of the data generation device and included in the spatial object information (i.e., an example of a second coordinate), generates azimuth information, and generates content information based on the azimuth information and the object content included in the spatial object information. The content information includes a description of the azimuth and the type of spatial object. For example, if the type of spatial object is a bookstore, and azimuth information (0,50,0) is obtained based on the absolute coordinates of the spatial position of the data generation device and the absolute coordinates of the bookstore, then the content information would be that the bookstore is 50m away to the right. In another case, the spatial object information includes the object content and relative coordinates of the spatial object. In this case, the data generation device may extract the relative coordinates from the spatial object information to obtain azimuth information, and generate content information based on the azimuth information and the object content contained in the spatial object information. In yet another case, the spatial object information includes the object content of the spatial object and the relative coordinates of the spatial object with respect to the data generation device. In this case, step 802 may include the data generation device generating azimuth information based on the relative coordinates of the spatial object contained in the spatial object information, and generating content information based on the azimuth information and the object content contained in the spatial object information.

[0144] In a scenario where a sensor is used to detect and describe surrounding spatial objects, the spatial object information includes the object content and relative coordinates of the spatial objects surrounding the terminal electronic device on which the sensor is configured. In this case, step 802 may include the data generation device generating azimuth information based on the relative coordinates of the spatial objects, and generating content information based on the azimuth information and the object content contained in the spatial object information.

[0145] Optionally, the data generation device is: Data generation device Azimuth information is generated based on the orientation and spatial object information. For example, the orientation is a 30-degree rotation to the right, a 20-degree rotation to the left, a 15-degree rise, or another orientation. Furthermore, for example, when the data generation device is a vehicle, the orientation is the direction of the vehicle's head; when the data generation device is a mobile phone or navigator, the orientation is the orientation of the mobile phone or navigator screen; when the data generation device is a dual-channel headset, the orientation is the orientation of the face of the user wearing the dual-channel headset; when the data generation device is a separate device including both a vehicle and a mobile phone located inside the vehicle, the orientation is the direction of the vehicle's head or the orientation of the screen of the mobile phone located inside the vehicle; or when the data generation device is a separate device including both a vehicle and a dual-channel headset located inside the vehicle, the orientation is the direction of the vehicle's head or the orientation of the face of the user inside the vehicle wearing the dual-channel headset.

[0146] Specifically, the first implementation in pedestrian navigation scenarios and in-vehicle navigation scenarios uses map data stored on the network side or the terminal side. This describes the surrounding spatial objects. In the first and fourth implementations in the scenario, and in the first and fourth implementations in the scenario where surrounding spatial objects are detected and described by using sensors, a data generation device and audio are used. reproduction The devices are configured within the same terminal device, therefore Data generation deviceAfter measuring the orientation, the data generation device generates azimuth angle information based on the orientation and spatial object information, and finally improves the accuracy of the spatial sound by ensuring that the position of the sound source of the spatial sound heard by the user matches the azimuth angle information of the spatial object relative to the terminal device.

[0147] The second and third implementations in pedestrian navigation and in-vehicle navigation scenarios use map data stored on the network side or the terminal side. By doing so, the surrounding spatial objects can be described. In the second and third implementations of the scenario, and in the second, third, fifth, and sixth implementations of the scenario in which surrounding spatial objects are detected and described by using sensors, the data generation device and the audio processing device are two independent devices, and therefore the data generation device receives the attitude transmitted by the audio playback device and generates azimuth information based on the attitude and spatial object information. More specifically, the audio playback device may transmit the attitude of the audio playback device to the data generation device in real time, or it may transmit the attitude of the audio playback device to the data generation device at intervals of a preset duration. For example, the preset duration may be 2 seconds, 5 seconds, 10 seconds, or other durations.

[0148] More specifically, in the scenario described above, when the data generation device or audio playback device is a headset, mobile phone, portable computer, or navigator, a gyroscope or another element with attitude measurement capabilities is provided in the data generation device or audio playback device, and the data generation device or audio playback device uses the gyroscope or other element with attitude measurement capabilities to perform the following actions: Data generation deviceThe attitude of the device is obtained. The attitude may be that of a headset, mobile phone, portable computer, or navigator. When the data generating device or audio playback device is a vehicle, the data generating device or audio playback device may measure its attitude by using a gyroscope, the direction of rotation of the steering wheel, or another element configured in the vehicle. The attitude of the vehicle may be that of the vehicle's head, wheels, body, or another. The vehicle may be an automobile, truck, motorcycle, bus, boat, aircraft, helicopter, lawnmower, recreational vehicle, playground vehicle, construction device, trolley, golf cart, train, wheelbarrow, etc. This is not specifically limited to the embodiments of this application.

[0149] Optionally, this embodiment of the present invention may include step 803. That is, the data generation device determines whether the spatial object information satisfies pre-set conditions. If the spatial object information satisfies the pre-set conditions, step 804 is executed. If the spatial object information does not satisfy the pre-set conditions, step 805 is executed.

[0150] In this embodiment of the present application, the data generation device determines whether spatial object information satisfies pre-set conditions. Spatial object information that satisfies pre-set conditions is spatial object information including a pre-set spatial location region, a pre-set spatial direction, or a pre-set object content. The pre-set spatial location region is a pre-set spatial location region relative to the spatial location of the data generation device or audio processing device. For example, the pre-set spatial location region may be the area to the right of the spatial location of the data generation device or audio processing device, 10 meters away. In another example, the pre-set spatial location region may be an area with a radius of 10 meters, where the spatial location of the data generation device or audio processing device is used as the origin. This is not limited to the present specification. The pre-set spatial direction may be the positional direction relative to the spatial location of the data generation device or audio processing device. For example, when the audio playback device is a dual-channel headset, the pre-set spatial direction may be the orientation of the face of the user wearing the dual-channel headset. The orientation of a user's face while wearing a dual-channel headset may be measured based on a gyroscope, inertial sensor, or other element configured within the dual-channel headset. The user typically views objects that they expect to see. The orientation of a user's face while wearing a dual-channel headset is set to a preset spatial direction. This helps improve the accuracy of the process of determining spatial objects of interest. When the data generating device is a mobile phone or navigator, the preset spatial direction may be the direction of movement on the mobile phone or navigator. When the data generating device is a vehicle, the preset spatial direction may be the orientation of the vehicle's head. Furthermore, the preset spatial direction may be forward, backward, left, right, or another direction of the data generating device or audio processing device, or it may be the absolute spatial position direction. For example, the preset spatial direction may be east, west, south, or north. This is not limited to the foregoing.Pre-set object content can be pre-entered by the user. For example, the user may pre-enter a coffee shop, bookstore, or other type of spatial object as an object of interest. Alternatively, the data generation device may independently determine the pre-set object content. For example, object content with a relatively high risk factor, such as a construction site, may be pre-set. Another example is object content that needs to be highlighted, such as a right or left turn point or intersection, which may be pre-set. This example should be understood as being used merely to facilitate understanding of the solution. Specifically, the concrete meaning of pre-set spatial location areas, pre-set spatial directions, and / or pre-set object content can be determined by those skilled in the art by referring to the actual product form. This is not limited to what is stated herein. 。

[0151] Specifically, in pedestrian navigation and in-vehicle navigation scenarios, step 803 may include the data generation device determining whether the object content shown in the content information is a pre-set object content. If the determination result is "yes," the data generation device determines that the spatial object information satisfies the conditions for being pre-set. Map data stored on the network side or terminal side is used. This describes the surrounding spatial objects.In scenarios where spatial objects in the surroundings are detected and described using sensors, step 803 includes one or more of the following cases: the data generator determines whether the spatial position indicated in the azimuth information is located in a pre-set spatial position region; the data generator determines whether the spatial position indicated in the azimuth information is located in a pre-set spatial direction; or the data generator determines whether the object content indicated in the content information is a pre-set object content. The data generator determines that the spatial object information satisfies the pre-set conditions when the result of one or more of the above cases is "yes".

[0152] Optionally, this embodiment of the present invention may include step 804. That is, the data generation device generates volume up instruction information.

[0153] In some embodiments of this invention, the data generation device generates volume-up instruction information after determining that the spatial object information satisfies pre-set conditions. The volume-up instruction information is used to indicate that the volume of the spatial sound corresponding to the spatial object information should be increased. The volume-up instruction information may carry a volume value that needs to be increased, and the volume value carried in the volume-up instruction information may be a positive value, for example, 3dB, 8dB, 10dB, or 15dB. Alternatively, the volume-up instruction information may not carry a volume value that needs to be increased. This is not limited to the foregoing.

[0154] Optionally, this embodiment of the present invention may include step 805, namely, the data generation device generates volume reduction instruction information.

[0155] In some embodiments of this application, the data generation device generates volume reduction instruction information after determining that the spatial object information does not meet pre-set conditions. The volume reduction instruction information is used to indicate that the volume of the spatial sound corresponding to the spatial object information should be reduced. The volume reduction instruction information may carry a volume value that needs to be reduced, and the volume value carried in the volume reduction instruction information may be a negative value, for example, -3 dB, -8 dB, -10 dB, or -15 dB. Alternatively, the volume reduction instruction information may not carry a volume value that needs to be reduced. This is not limited to the foregoing.

[0156] Step 806: The data generation device generates spatial sound data.

[0157] In this embodiment of the present application, the data generation device generates spatial sound data after acquiring azimuth information and content information. The spatial sound data is used to instruct the generation of spatial sound. Specifically, the spatial sound data includes azimuth information and content information, or the spatial sound data includes at least two monophonic signals generated based on the azimuth information and content information, the at least two monophonic signals being simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals in order to generate spatial sound.

[0158] When spatial audio data includes azimuth information and content information, it may further include volume information, etc. In the ETSI TS 103 223 standard, spatial audio data is specifically represented as a spatial audio object, and the various types of information contained within the spatial audio object are specifically represented as array fields. Furthermore, the ETSI TS 103 223 standard provides a standard for "object-based audio immersive sound metadata and bitstreams." This standard supports the following cases: immersive sound metadata and bitstreams, as well as azimuth, that can reflect the distance between the sound source and the listening user, are calculated based on the user's position coordinates and the sound source's position coordinates. It should be noted that the ETSI TS 103 223 standard is merely a reference standard for spatial audio data. Actual implementations may refer to other standards or modify the ETSI TS 103 223 standard. In this embodiment of the present application, the ETSI TS 103 223 standard is used merely as an illustrative example. Referring to the ETSI TS 103 223 standard, positional information in spatial sound data is specifically represented as a position field, content information as a contentkind field, and volume information as a volume-gain field. Examples are not exhaustively listed herein.

[0159] In this embodiment of the present application, steps 803 to 805 are optional steps. If none of steps 803 to 805 are performed, or if steps 803 and 804 are performed but step 805 is not, the result of step 803 is that the spatial object information does not satisfy the pre-set conditions, or if steps 803 and 805 are performed but step 804 is not, the result of step 803 is that the spatial object information satisfies the pre-set conditions, and step 806 may include the data generation device generating spatial data based on azimuth information and content information. Specifically, in the ETSI TS 103 223 standard, the data generation device may, after acquiring azimuth information and content information in coordinate form, determine the azimuth information as a field value for the position field, determine the content information as a field value for the content field, and acquire a spatial audio object using default values ​​for other fields in the spatial audio object.

[0160] If all steps 803 to 805 are performed and the result of step 803 satisfies the pre-set conditions for spatial object information, or if steps 803 to 804 are performed but step 805 is not performed and the result of step 803 satisfies the pre-set conditions for spatial object information, then step 806 includes the data generation device generating spatial sound data based on azimuth information, content information, and volume up instruction information. Specifically, according to the ETSI TS 103 223 standard, the data generation device may, after acquiring azimuth information and content information in coordinate form, determine the azimuth information as the field value of the position field and the content information as the field value of the content field. If the volume up instruction information carries a volume value that needs to be increased, the volume value that needs to be increased may be determined as the field value of the volume gain field. If the volume up instruction information does not carry a volume value that needs to be increased, the field value of the volume gain field may be increased by a pre-set value. For example, the field value of the volume gain field may be 3dB, 8dB, 10dB, or 15dB. In this embodiment of the present application, when spatial object information is spatial object information that satisfies a preset condition, volume up instruction information is generated, and the volume up instruction information indicates that the volume of the spatial sound corresponding to the spatial object information is increased, in other words, the playback volume is increased for spatial objects having preset object content to attract the user's attention and prevent the user from losing sight of the spatial objects having preset object content. In this way, security in the navigation process is improved and the user can be prevented from losing sight of spatial objects of interest, thereby improving the user viscosity of this solution.

[0161] If steps 803 to 805 are all performed and the result of step 803 satisfies the pre-set conditions for spatial object information, or if steps 803 to 805 are performed but step 804 is not performed and the result of step 803 does not satisfy the pre-set conditions for spatial object information, step 806 includes the data generation device generating spatial sound data based on azimuth information, content information, and volume down instruction information. Specifically, in the ETSI TS 103 223 standard, the headset may determine the azimuth information as the field value of the position field and the content information as the field value of the content field after acquiring azimuth information and content information in coordinate form. If the volume down instruction information carries a volume value that needs to be reduced, the field value of the volume gain field may be determined based on the volume value that needs to be reduced, and the field value of the volume gain field is a negative value. If the volume down instruction information does not carry a volume value that needs to be reduced, the field value of the volume gain field may be reduced by a pre-set value. For example, the field value of the volume gain field could be -3dB, -8dB, -10dB, or -15dB.

[0162] Furthermore, in the three cases mentioned above, if the spatial sound data is at least two monophonic signals generated based on azimuth information and content information, a third implementation in the pedestrian navigation scenario and the in-vehicle navigation scenario uses map data stored on the network side or the terminal side. This describes the surrounding spatial objects. A third implementation in the scenario, and third and sixth implementations in the scenario that use sensors to detect and describe surrounding spatial objects, or a first implementation in the pedestrian navigation scenario and in-vehicle navigation scenario, using map data stored on the network side or terminal side. This describes the surrounding spatial objects.In the first and fourth implementations of the scenario, and in the first and fourth implementations of the scenario in which sensors are used to detect and describe surrounding spatial objects, after azimuth information and content information have been generated, step 806 may further include a data generation device performing a rendering operation based on the content information and azimuth information to generate at least two monophonic signals. The at least two monophonic signals are simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals to generate spatial sound.

[0163] Specifically, in the process of performing a rendering operation based on spatial sound data, the rendering operation specifically involves incorporating spatial azimuth information into audio stream data using a specific algorithm or data processing operation to ultimately generate at least two monophonic signals. The at least two monophonic signals are simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals to generate spatial sound. The rendering function library may be pre-configured in the data generation device or audio playback device. After spatial sound data is acquired, left-ear rendering and right-ear rendering functions corresponding to the azimuth information in the spatial sound data are acquired, audio stream data corresponding to the content information in the spatial sound data is acquired, and by using the left-ear rendering function, the audio stream data corresponding to the content information is rendered to obtain the left channel signal, and by using the right-ear rendering function, the audio stream data corresponding to the content information is rendered to obtain the right channel signal. The left channel signal and right channel signal are two monophonic signals. More specifically, if spatial object information includes navigation data in audio stream format, content information in audio stream format can be extracted from the spatial object information. If spatial object information includes navigation data in text format, content information in spatial sound data needs to be converted to content information in audio stream format.

[0164] Furthermore, a specific implementation of generating spatial sound based on spatial sound data is described in detail herein by using an example in which the audio playback device is a headset. In the implementation, the left ear rendering function and the right ear rendering function are head-related impulse response (HRIR) functions, respectively. In this case, PCM data corresponding to the content information in the spatial sound data is acquired, the left ear HRIR function and the right ear HRIR function corresponding to the position information in the spatial sound data are acquired, convolution is performed on the PCM data and each of the left ear HRIR function and the right ear HRIR function to acquire the left channel signal and the right channel signal, and then the left channel signal and the right channel signal can be reproduced by using the left and right sound electrical energy conversion modules in the audio playback device. In another implementation, the left ear rendering function and the right ear rendering function are each head-related transfer function (HRTF) functions. In this case, PCM data corresponding to content information in spatial sound data must be acquired, the left ear HRTF function and the right ear HRTF function corresponding to position information in spatial data are acquired, the PCM data is converted to the frequency domain to acquire converted audio stream data, the converted audio stream data is multiplied by the left ear HRTF function and the right ear HRTF function respectively, the signal acquired after multiplication is converted to the time domain to acquire the left channel signal and the right channel signal, the left channel signal and the right channel signal can be reproduced by using left and right sound-electrical energy conversion modules in the audio playback device. In this specification, the example in which the audio playback device is a sound-electrical energy conversion module in a headset is used only to demonstrate the implementability of this solution. It can be seen by analogy that this solution is applicable when the audio playback device is in a different form. The method of generating spatial sound is not limited in this specification.

[0165] Optionally, this embodiment of the present invention may include step 807, that is, the data generation device or audio playback device reproduces spatial sound based on spatial sound data.

[0166] In this embodiment of the present application, the data generation device can generate spatial sound data and then reproduce spatial sound based on the spatial sound data. Spatial sound is sound. The position of the sound source of the spatial sound corresponds to azimuth angle information, and the playback content for the spatial sound is content information.

[0167] If spatial sound data includes content information and azimuth information, a second implementation scenario in pedestrian navigation and in-vehicle navigation scenarios uses map data stored on the network side or terminal side. This describes the surrounding spatial objects.In the second implementation scenario in the scenario, and in the second and fifth implementations in the scenario in which surrounding spatial objects are detected and described by using sensors, the data generation device and the audio playback device are located in different independent devices, and so the data generation device generates spatial sound data including content information and azimuth information, then transmits the spatial sound data including content information and azimuth information to the audio playback device, the audio playback device performs a rendering operation based on the content information and azimuth information to generate at least two monophonic signals, transmits the at least two monophonic signals to a sound-electrical energy conversion module, and plays spatial sound using the sound-electrical energy conversion module. Optionally, the audio playback device may, after generating at least two monophonic signals based on the spatial sound data, further acquire the orientation of the audio playback device in real time, acquire converted spatial azimuth information based on the orientation of the audio playback device and the spatial sound data, re-render the content information in audio stream format, and transmit the at least two monophonic signals acquired after the re-rendering operation is performed to a sound-electrical energy conversion module, and play spatial sound using the sound-electrical energy conversion module. Re-rendering means incorporating the transformed spatial azimuthal information into the audio stream data using a specific algorithm or data processing operation to ultimately generate at least two monophonic signals. In this embodiment of the present application, the number of monophonic signals included in the at least two monophonic signals corresponds to the number of sound-electrical energy conversion modules included in the audio playback device.

[0168] Alternatively, the first implementation in pedestrian navigation and in-vehicle navigation scenarios uses map data stored on the network side or the terminal side. This describes the surrounding spatial objects.In the first and fourth implementations in the scenario, and in the first and fourth implementations in the scenario in which spatial objects in the surroundings are detected and described by using sensors, the data generation device and the audio playback device are integrated into the same device, and if the spatial sound data includes content information and azimuth information, the data generation device must first generate at least two monophonic signals based on the content information and azimuth information, and transmit at least two monophonic signals to the sound-electrical energy conversion module by using an internal interface to reproduce the spatial sound. Specifically, the internal interface may be represented as a trace on a hardware circuit board. Optionally, the data generation device and the audio playback device are integrated into the same device, and therefore the data generation device can directly acquire the attitude of the audio playback device by using an attitude measuring element such as a vehicle gyroscope or steering wheel, re-render the content information in the form of an audio stream based on the attitude of the audio playback device, acquire at least two monophonic signals acquired after the re-rendering operation is performed, and then transmit at least two monophonic signals to the audio playback device by using an internal interface to reproduce the spatial sound.

[0169] If the spatial sound data includes at least two monophonic signals generated based on content information and azimuth information, a third implementation in pedestrian navigation scenarios and in-vehicle navigation scenarios uses map data stored on the network side or terminal side. This describes the surrounding spatial objects.In the third implementation of the scenario, and in the third and sixth implementations of the scenario in which sensors are used to detect and describe surrounding spatial objects, the data generation device transmits at least two monophonic signals to the audio playback device, and the audio playback device inputs at least two monophonic signals to the sound-electrical energy conversion module to reproduce spatial sound. Optionally, the audio playback device may acquire the orientation of the audio playback device and transmit the orientation of the audio playback device to the data generation device, and the data generation device re-renders the content information in audio stream format based on the orientation of the audio playback device, and the data generation device re-renders, and transmits at least two monophonic signals acquired after the re-rendering operation is performed to the audio playback device, and the audio playback device inputs at least two monophonic signals acquired after the re-rendering operation is performed to the sound-electrical energy conversion module to reproduce spatial sound.

[0170] Alternatively, the first implementation in pedestrian navigation and in-vehicle navigation scenarios uses map data stored on the network side or the terminal side. This describes the surrounding spatial objects. In the first and fourth implementations in the scenario, and in the first and fourth implementations in the scenario in which surrounding spatial objects are detected and described by using sensors, if the spatial sound data includes at least two monophonic signals, the data generation device transmits at least two monophonic signals to the sound-electrical energy conversion module by using an internal interface, and reproduces the spatial sound by using the sound-electrical energy conversion module.

[0171] Optionally, in the process of performing rendering operations based on spatial sound data, the playback volumes of the left and right channel signals may be further adjusted based on volume information within the spatial sound data in order to reproduce the spatial sound. Specifically, if the data generator generates volume up instruction information, the playback volumes of the left and right channel signals are increased. Alternatively, if the data generator generates volume down instruction information, the playback volumes of the left and right channel signals are decreased.

[0172] In this embodiment of the present application, when navigation data is played back, spatial sound data is generated based on the azimuth information and content information of the navigation destination. The generated spatial sound data indicates that spatial sound is being played back, and the playback position of the sound source corresponding to the spatial sound matches the azimuth information of the navigation destination. In other words, the user can determine the correct direction of travel based on the playback position of the sound source of the spatial sound being heard. In this way, a more intuitive playback method is provided, and the user does not need to frequently open the map to confirm whether the user's direction of travel is correct. Operation is simple, and therefore the efficiency of the navigation process is improved. A more intuitive and efficient data presentation method is provided when the spatial object is a different type of object.

[0173] (2) Spatial object information is filtered.

[0174] In one embodiment of this application, Figure 9 is a schematic flowchart of the data generation method according to this embodiment of the application. The data generation method provided in this embodiment of the application may include the following steps.

[0175] Step 901: The data generation device acquires spatial object information.

[0176] Step 902: The data generation device generates content information and azimuth information based on spatial object information.

[0177] Optionally, this embodiment of the present invention may include step 903. That is, the data generation device determines whether the spatial object information satisfies pre-set conditions. If the spatial object information satisfies the pre-set conditions, step 904 is executed. If the spatial object information does not match the pre-set conditions, execution terminates.

[0178] In some embodiments of this invention, the data generation device determines whether the spatial object information satisfies pre-set conditions. If the spatial object information satisfies pre-set conditions, step 904 may be performed. If the spatial object information does not satisfy pre-set conditions, spatial sound data is no longer generated based on the spatial object information, and step 901 may be performed again to process the next spatial object information.

[0179] Optionally, this embodiment of the present invention may include step 904. That is, the data generation device generates volume up instruction information.

[0180] In this embodiment of the present application, the specific implementation of the data generation device performing steps 901 to 904 is the same as the specific implementation of steps 801 to 804 in the embodiment corresponding to Figure 8. Details are not described herein.

[0181] Step 905: The data generation device generates spatial sound data.

[0182] In some embodiments of this application, steps 903 to 904 are optional steps. If neither step 903 nor step 904 is performed, or if step 903 is performed and step 904 is not performed, and the result of step 903 is that the spatial object information satisfies pre-set conditions, step 905 includes the data generation device generating spatial sound data based on azimuth information and content information.

[0183] If both steps 903 and 904 are performed, and the result of step 903 is that the spatial object information satisfies the pre-set conditions, then step 905 This includes the data generation device generating spatial sound data based on azimuth information, content information, and volume increase instruction information.

[0184] In this embodiment of the present application, before spatial sound data is generated, it is determined whether the spatial object information satisfies pre-set conditions, and only when the determination result is that the pre-set conditions are met, spatial sound data is generated based on the spatial object information; in other words, the spatial object information is filtered. In this way, the waste of computer resources caused by spatial object information that does not satisfy the pre-set conditions is avoided, excessive interference to the user is avoided, and thereby the user viscosity of this solution is improved.

[0185] Optionally, this embodiment of the present invention may include step 906: an audio playback device or data generation device plays back spatial sound based on spatial sound data.

[0186] In this embodiment of the application, for a specific implementation of the data generation device performing steps 905 and 906, please refer to the description of the specific implementation of steps 806 and 807 in the embodiment corresponding to Figure 8. Further details are not described here.

[0187] Based on embodiments corresponding to Figures 1 to 9, related devices for implementing the solution are further provided below to better implement the solution in the embodiments of this application. Specifically, Figure 10 is another schematic diagram of the structure of a data generation device according to one embodiment of this application. The data generation device 100 includes an acquisition module 1001 and a generation module 1002. The acquisition module 1001 is configured to acquire spatial object information. The spatial object information is used to acquire azimuth information of the spatial object relative to the data generation device. For a specific implementation, see the description of step 801 in the embodiment corresponding to Figure 8. The generation module 1002 is configured to generate content information and azimuth information based on the spatial object information. The azimuth information is used to indicate the azimuth of the spatial object shown in the spatial object information relative to the data generation device. The content information is used to describe the spatial object. For a specific implementation, see the description of step 802 in the embodiment corresponding to Figure 8. The generation module 1002 is further configured to generate spatial sound data based on the azimuth information and content information. Spatial sound data is used to reproduce spatial sound, and the position of the spatial sound source corresponds to azimuth information. For specific implementations, refer to the description of step 802 in the embodiment corresponding to Figure 8 and step 905 in the embodiment corresponding to Figure 9. For specific content, refer to the description of the embodiments of the aforementioned method shown in the embodiments of this application. Details are not described here.

[0188] In this embodiment of the present application, when navigation data is played back, the generation module 1002 generates spatial sound data based on the azimuth information and content information of the navigation destination. The generated spatial sound data indicates that spatial sound is being played back, and the playback position of the sound source corresponding to the spatial sound matches the azimuth information of the navigation destination. In other words, the user can determine the correct direction of travel based on the playback position of the sound source of the spatial sound being heard. In this way, a more intuitive playback method is provided, and the user does not need to frequently open the map to check whether the user's direction of travel is correct. Operation is simple, and therefore the efficiency of the navigation process is improved. Additionally, if the spatial object is a different type of object, a more intuitive and efficient data presentation method is provided.

[0189] In the implementation, the spatial sound data includes azimuth information and content information, or the spatial sound data includes at least two monophonic signals generated based on the azimuth information and content information, and the at least two monophonic signals are simultaneously reproduced by sound-electrical energy conversion modules corresponding to the two monophonic signals in order to generate spatial sound.

[0190] In a possible design, the generation module 1002 is specifically configured to generate azimuth information based on at least one of spatial object information and the position or orientation of the data generation device. For a specific implementation, see the description of step 802 in the embodiment corresponding to Figure 8.

[0191] In this embodiment of the present application, the generation module 1002 generates azimuth information based on orientation and spatial object information, so that the position of the sound source of the spatial sound heard by the user matches the azimuth information of the spatial object relative to the terminal device, thereby improving the accuracy of the spatial sound.

[0192] In possible designs, the acquisition module 1001 is configured to specifically receive spatial object information. For specific embodiments, see the description of step 801 in the embodiment corresponding to Figure 8, or the description of pedestrian navigation scenarios, in-vehicle navigation scenarios, and scenarios describing surrounding spatial objects by using map data stored on the network side or terminal side. Alternatively, the acquisition module 1001 is configured to specifically collect spatial object information by using sensors. For specific implementations, see the description of step 801 in the embodiment corresponding to Figure 8, or the description of scenarios that detect and describe surrounding spatial objects by using sensors.

[0193] In this embodiment of the present application, the generation module 1002 can apply the data presentation method provided in the solution to multiple application scenarios, thereby extending the application scenarios of the solution. This improves the flexibility of the implementation of the solution.

[0194] In a possible design, the acquisition module 1001 is configured to receive spatial object information in at least one of three ways: by receiving audio stream data generated by an application program, by receiving interface data generated by an application program, or by receiving map data stored on the network side or terminal side. For a specific implementation, see the description of step 801 in the embodiment corresponding to Figure 8.

[0195] In a possible design, the sensor includes at least one of the following: a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

[0196] In a possible design, the generation module 1002 is specifically configured to generate content information and azimuth information based on spatial object information when it is determined that the spatial object information satisfies pre-set conditions. For a specific implementation, see the steps in the embodiment corresponding to Figure 8. 8 03~ 8 See explanation 05.

[0197] In this embodiment of the present application, before the generation module 1002 generates spatial sound data, it is determined whether the spatial object information satisfies pre-set conditions, and only when the determination result is that the pre-set conditions are met, spatial sound data is generated based on the spatial object information; in other words, the spatial object information is filtered. In this way, the waste of computer resources caused by spatial object information that does not satisfy the pre-set conditions is avoided, excessive interference to the user is avoided, and thereby the user viscosity of this solution is improved.

[0198] In a possible design, the generation module 1002 is further configured to generate volume-up instruction information when it is determined that the spatial object information satisfies pre-set conditions. The volume-up instruction information is used to indicate that the volume of the spatial sound corresponding to the spatial object information that satisfies the pre-set conditions should be increased. For specific implementations, see the description of steps 803 and 804 in the embodiment corresponding to Figure 8.

[0199] In this embodiment of the present application, the generation module 1002 can increase the playback volume for spatial objects having pre-set object content to attract the user's attention and prevent the user from losing sight of the spatial objects having pre-set object content. In this way, security in the navigation process is improved and the user can be prevented from losing sight of spatial objects of interest, thereby improving the user viscosity of the solution.

[0200] In a possible design, the generation module 1002 satisfies the conditions for which spatial object information is pre-set. Don't When it is determined that the information is spatial object information, it is further configured to generate volume reduction instruction information. The volume reduction instruction information is used to indicate that the volume of the spatial sound corresponding to spatial object information that satisfies pre-set conditions should be reduced. For specific implementations, see the description of steps 803 and 805 in the embodiment corresponding to Figure 8.

[0201] In a possible design, spatial object information that satisfies pre-set conditions includes a pre-set spatial location region, a pre-set spatial orientation, or spatial object information that includes pre-set object content.

[0202] In a possible design, the generation module 1002 is configured to generate spatial sound data by performing a rendering operation on audio stream data corresponding to the content information, based on azimuth information, content information, and the orientation of the audio playback device. The spatial sound data includes at least two monophonic signals generated based on the azimuth information and content information. For a specific implementation, see the description of step 806 in the embodiment corresponding to Figure 8.

[0203] In a possible design, the data generation device 100 includes at least one of a headset, a mobile phone, a portable computer, a navigator, or a vehicle.

[0204] In a possible design, when the audio playback device is a dual-channel headset, the preset spatial direction is the orientation of the user's face while wearing the dual-channel headset, and the audio playback device is configured to reproduce spatial sound.

[0205] In this embodiment of the present application, the data generation device 100 may specifically be a terminal device in the embodiment corresponding to Figure 1, Figure 5, or Figure 6, or a data generation device in Figures 2 to 4 and Figure 7, etc. This is not limited to the present specification. Note that the content, such as information exchange between modules / units within the data generation device 100 and the execution process, is based on the same concepts as the embodiment of the method corresponding to Figures 1 to 9 in the embodiment of the present application. For specific content, refer to the description of the embodiment of the method shown in the embodiment of the present application. Details are not described here. The data generation device 100 may be one device or two different devices. The step of generating content information and azimuth information is performed by one device, and the step of generating spatial sound data based on the content information and azimuth information is performed by the other device.

[0206] The data generation device provided in the embodiments of this application is described below. Figure 11 is another schematic diagram of the structure of the data generation device according to one embodiment of this application. The data generation device 1100 may specifically be represented as a virtual reality VR device, a mobile phone, a tablet, a notebook computer, an intelligent wearable device, a monitoring data processing device, a radar data processing device, etc., but is not limited to this specification. The data generation device 100 described in the embodiment corresponding to Figure 10 may be deployed on the data generation device 1100 to implement the functions of the data generation device in the embodiments corresponding to Figures 1 to 9. Specifically, the data generation device 1100 includes a receiver 1101, a transmitter 1102, a processor 1103, and a memory 1104 (the data generation device 1100 may include one or more processors 1103, one processor being used as an example in Figure 11). The processor 1103 may include an application processor 11031 and a communication processor 11032. In some embodiments of this application, the receiver 1101, transmitter 1102, processor 1103, and memory 1104 may be connected by using a bus or by other means.

[0207] Memory 1104 includes read-only memory and random-access memory, and can provide instructions and data to processor 1103. A portion of memory 1104 may further include non-volatile random-access memory (NVRAM). Memory 1104 stores the processor and operation instructions, executable modules, data structures, subsets thereof, or extensions thereof. The operation instructions may include various operation instructions for implementing various operations.

[0208] The processor 1103 controls the operations performed by the data generator. In certain applications, the components of the data generator are coupled to each other by using a bus system. The bus system includes a data bus, as well as a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the various types of buses shown in the diagram are referred to as the bus system.

[0209] The methods disclosed in the embodiments described herein may be applied to or implemented by the processor 1103. The processor 1103 may be an integrated circuit chip having signal processing capabilities. In the implementation process, each step of the aforementioned methods may be completed by using instructions in the form of hardware integrated logic circuits or software within the processor 1103. The processor 1103 may be a general-purpose processor, a digital signal processing (DSP), a microprocessor, or a microcontroller, and may further include an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or another programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The processor 1103 may implement or perform the methods, steps, and logic block diagrams disclosed in the embodiments described herein. The general-purpose processor may be a microprocessor, and the processor may be any conventional processor, etc. The steps of the method disclosed with reference to embodiments of this application may be performed and completed directly by using a hardware decoding processor, or by using a combination of hardware and software modules within the decoding processor. The software modules may reside in a mature storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. The storage medium is located in memory 1104, and the processor 1103 reads information from memory 1104 and, in combination with the processor's hardware, completes the steps of the method described above.

[0210] The receiver 1101 may be configured to receive input digital or character information and generate signal inputs related to relational settings and function control of the data generation device. The transmitter 1102 may be configured to output digital or character information by using the first interface. The transmitter 1102 may be further configured to send commands to a disk group by using the first interface to modify data in the disk group. The transmitter 1102 may further include a display device such as a display.

[0211] In this embodiment of the present application, in a certain case, the processor 1103 is configured to perform a data generation method performed by a data generation device in an embodiment corresponding to Figures 1 to 9. Specifically, the application processor 11031 is configured to acquire spatial object information, the spatial object information being used to acquire azimuth angle information of the spatial object relative to the data generation device, generate content information and azimuth angle information based on the spatial object information, the azimuth angle information being used to indicate the azimuth angle of the spatial object information shown in the spatial object information relative to the data generation device, and the content information being used to describe the spatial object, and generate spatial sound data based on the azimuth angle information and content information, the spatial sound data being used to reproduce spatial sound, and the position of the sound source of the spatial sound corresponding to the azimuth angle information.

[0212] In a possible design, the application processor 11031 specifically generates spatial object information and data. Place It is configured to generate azimuth information based on at least one of position or orientation.

[0213] In possible designs, the application processor 11031 is configured to specifically receive spatial object information or to collect spatial object information by using sensors.

[0214] In a possible design, the application processor 11031 is configured to receive spatial object information in at least one of three ways: by receiving audio stream data generated by an application program, by receiving interface data generated by an application program, or by receiving map data stored on the network side or terminal side.

[0215] In a possible design, the sensor includes at least one of the following: a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

[0216] In a possible design, the application processor 11031 is configured to generate content information and azimuth information based on spatial object information when it is determined that the spatial object information satisfies pre-set conditions.

[0217] In a possible design, the application processor 11031 is further configured to generate volume-up instruction information when it is determined that the spatial object information satisfies pre-set conditions. The volume-up instruction information is used to indicate that the volume of the spatial sound corresponding to the spatial object information that satisfies the pre-set conditions should be increased.

[0218] In a possible design, spatial object information that satisfies pre-set conditions includes a pre-set spatial location region, a pre-set spatial orientation, or spatial object information that includes pre-set object content.

[0219] In a possible design, when the audio playback device is a dual-channel headset, the preset spatial direction is the orientation of the user's face while wearing the dual-channel headset, and the audio playback device is configured to reproduce spatial sound.

[0220] The specific manner in which the application processor 11031 performs the tactical steps is based on the same concept as the embodiment of the method corresponding to Figures 1 to 9 in the embodiments of this application, and it should be noted that the technical effects brought about by this embodiment of this application are the same as the technical effects in the embodiment of the method corresponding to Figures 1 to 9 in the embodiments of this application. For specific content, refer to the description of the embodiment of the method shown above in the embodiments of this application. Details are not described here. The data generation device 1100 may be one device or two different devices. The step of generating content information and azimuth information is performed by one device, and the step of generating spatial sound data based on the content information and azimuth information is performed by the other device.

[0221] One embodiment of this application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program runs on a computer, the computer is able to perform steps performed by a data generation device in the embodiment shown in Figures 1 to 9.

[0222] One embodiment of this application further provides a computer program product. When the computer program product runs on a computer, the computer is able to perform steps performed by a data generation device in the method described in the embodiments shown in Figures 1 to 9.

[0223] One embodiment of this application further provides a chip system. The chip system includes a processor configured to support a network device to implement the functions in the aforementioned embodiments, such as, for example, data and / or data transmission or processing in the aforementioned methods. In possible designs, the chip system further includes memory. The memory is configured to store program instructions and data required by the network device. The chip system may further include a chip, or it may include a chip and another separate device.

[0224] For the sake of a convenient and simple explanation, the detailed working processes of the aforementioned systems, apparatus, and units will be clearly understood by those skilled in the art, with reference to the corresponding processes in the embodiments of the methods described above, and the details will not be described again here.

[0225] In some embodiments provided in this application, it should be understood that the disclosed systems, apparatus, and methods may be implemented in other ways. For example, the embodiments of the described apparatus are merely examples. For example, the division into units is merely a logical functional division, and other divisions may be used in actual implementations. For example, multiple units or components may be combined or integrated into another system, and some features may be ignored or not performed. In addition, the mutual coupling, direct coupling, or communication connection indicated or discussed may be implemented through some interfaces. Indirect coupling or communication connection between apparatus or units may be implemented electronically, mechanically, or in other forms.

[0226] Units described as separate parts may or may not be physically separated, and parts shown as units may or may not be physical units, that is, they may be located in one location or distributed across multiple network units. Some or all of the units may be selected based on the actual requirements to achieve the objectives of the solution in the embodiment.

[0227] Additionally, the functional units in the embodiments of this application may be integrated into a single processing unit, each unit may exist physically independently, or two or more units may be integrated into a single unit. The integrated unit may be implemented in hardware form or in the form of a software functional unit.

[0228] When an integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application may be implemented in the form of a software product, or the portion contributing to the prior art may be implemented in the form of a software product, or a portion of the technical solution may be implemented in the form of a software product. The software product is stored in a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, server, or network device) to perform all or part of the steps of the method described in the embodiments of this application. The aforementioned storage medium includes any medium capable of storing program code, such as a USB flash drive, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0229] Finally, it should be noted that the embodiments described above are not intended to limit this application, but merely to describe the technical solutions of this application. This application is described in detail with reference to the embodiments described above, but those skilled in the art will know the technical solutions of the embodiments of this application. range It should be understood that modifications to the technical solutions described in the embodiments described above, or the replacement of some of their technical features with equivalents, may still be made without departing from the scope.

Claims

1. A data generation method, wherein the method is applied to a data generation device, and the method is The acquisition of spatial object information, wherein the spatial object information is used to acquire azimuth angle information of the spatial object relative to the data generation device, The process involves generating content information and azimuth information based on the spatial object information, wherein the azimuth information is used to indicate the azimuth angle of the spatial object shown in the spatial object information relative to the data generation device, the content information is used to describe the spatial object, and the spatial object is a spatial event, or a person, animal, or spatial object, and the content information is used to describe the orientation of the spatial object relative to the data generation device and the object content of the spatial object. The process includes generating spatial sound data based on the azimuth angle information and the content information, wherein the spatial sound data is used to reproduce spatial sound, the position of the sound source of the spatial sound corresponds to the azimuth angle information, and the content for the spatial sound to be reproduced is the content information, Generating content information and azimuth information based on the spatial object information is: When it is determined that the spatial object information satisfies pre-set conditions, the system includes generating the content information and the azimuth angle information based on the spatial object information. The spatial object information that satisfies the aforementioned pre-set conditions is spatial object information including a pre-set spatial location region, a pre-set spatial direction, or a pre-set object content. A method in which, when the audio playback device is a dual-channel headset, the preset spatial direction is the orientation of the face of the user wearing the dual-channel headset, and the audio playback device is configured to reproduce the spatial sound.

2. Generating the azimuth angle information based on the spatial object information is: The method according to claim 1, comprising generating azimuth angle information based on at least one of the spatial object information and the position or orientation of the data generation device.

3. Obtaining the aforementioned spatial object information means The method according to claim 1 or 2, comprising receiving the spatial object information or collecting the spatial object information by using a sensor.

4. Receiving the aforementioned spatial object information means Receiving audio stream data generated by an application program, Receiving interface data generated by an application program, or The method according to claim 3, comprising receiving spatial object information by at least one of three methods, including receiving map data stored on the network side or the terminal side.

5. The method according to claim 3, wherein the sensor includes at least one of a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

6. The aforementioned method, The method according to any one of claims 1 to 5, further comprising generating volume-up instruction information when it is determined that the spatial object information is spatial object information that satisfies the preset conditions, wherein the volume-up instruction information is used to increase the volume of the spatial sound corresponding to the spatial object information that satisfies the preset conditions.

7. A data generation device, An acquisition module configured to acquire spatial object information, wherein the spatial object information is used to acquire azimuth angle information of the spatial object relative to the data generation device, A generation module configured to generate content information and azimuth information based on the spatial object information, wherein the azimuth information is used to indicate the azimuth angle of the spatial object shown in the spatial object information with respect to the data generation device, the content information is used to describe the spatial object, the spatial object being a spatial event, or a person, animal, or spatial object, and the content information is used to describe the orientation of the spatial object with respect to the data generation device and the object content of the spatial object, the generation module includes The generation module is further configured to generate spatial sound data based on the azimuth information and the content information, the spatial sound data being used to play spatial sound, the position of the sound source of the spatial sound corresponding to the azimuth information, and the content of the spatial sound being played back being the content information. The generation module is configured to generate content information and azimuth information based on the spatial object information when it is determined that the spatial object information satisfies pre-set conditions. The spatial object information that satisfies the aforementioned pre-set conditions is spatial object information including a pre-set spatial location region, a pre-set spatial direction, or a pre-set object content. An audio playback device, in which the pre-set spatial direction is the orientation of the face of the user wearing the dual-channel headset, and the audio playback device is configured to reproduce the spatial sound.

8. The apparatus according to claim 7, wherein the generation module is configured to generate the azimuth angle information based on at least one of the spatial object information and the position or orientation of the data generation device.

9. The apparatus according to claim 7 or 8, wherein the acquisition module is configured to receive the spatial object information or to collect the spatial object information by using a sensor.

10. The acquisition module described above is Receiving audio stream data generated by an application program, Receiving interface data generated by an application program, or The apparatus according to claim 9, configured to receive spatial object information by at least one of three methods, including receiving map data stored on the network side or the terminal side.

11. The apparatus according to claim 9, wherein the sensor includes at least one of a photosensitive sensor, a sound sensor, an image sensor, an infrared sensor, a thermal sensor, a pressure sensor, or an inertial sensor.

12. The apparatus according to any one of claims 7 to 11, wherein the generation module is configured to generate volume-up instruction information when it is determined that the spatial object information is spatial object information that satisfies the preset conditions, the volume-up instruction information being used to increase the volume of the spatial sound corresponding to the spatial object information that satisfies the preset conditions.

13. A data generating device comprising a memory and a processor, wherein the memory stores computer program instructions and the processor operates the computer program instructions to perform the method according to any one of claims 1 to 6.

14. The apparatus according to claim 13, further comprising a transceiver configured to receive spatial object information.

15. The apparatus according to claim 13, further comprising a sensor configured to collect spatial object information.

16. The data generation device according to any one of claims 13 to 15, wherein the data generation device includes at least one of a headset, a mobile phone, a portable computer, a navigator, or a vehicle.

17. A computer-readable storage medium for storing computer instructions, wherein when the computer instructions are executed by a processor, a data generation device can perform the method according to any one of claims 1 to 6.

Images