Spatial audio playing method and device, electronic equipment and medium

Abstract

The application discloses a spatial audio playing method and device, electronic equipment and medium, and belongs to the technical field of spatial audio processing. The method comprises the following steps: playing virtual reality spatial audio according to a virtual direction of the virtual reality spatial audio; and in a target case, adjusting a playing mode of the virtual reality spatial audio, so that a user can distinguish the virtual reality spatial audio from real environment spatial audio.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of spatial audio processing, and particularly relates to a spatial audio playing method and device, an electronic device and a medium. BACKGROUND

[0002] The development of spatial audio technology greatly improves the auditory experience of users. For example, the application of spatial audio technology in virtual reality technology makes the virtual reality scene more realistic, greatly improving the user experience in virtual reality.

[0003] However, while the spatial audio technology makes the virtual reality realistic, it can cause the user to be unable to distinguish whether the heard sound is a sound in a real environment or a sound in a virtual reality. In the related technology, the user often needs to take off the earphone device to identify whether the sound is a sound in a real environment or a sound in a virtual reality, which greatly reduces the user experience, and the user cannot timely distinguish the sound in the real environment from the sound in the virtual reality. If an emergency or dangerous situation occurs in the real environment, for example, there is a person calling for help or an object falling, explosion, or other critical situations in the real environment, since the user cannot timely distinguish the sound in the real environment from the sound in the virtual reality, it can cause a dangerous situation to occur. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide a spatial audio playing method and device, an electronic device and a medium, which can enable the user to quickly distinguish the sound in the real environment from the sound in the virtual reality, and avoid the situation that a dangerous situation occurs due to the inability to timely distinguish the sound in the real environment from the sound in the virtual reality.

[0005] In a first aspect, the embodiments of the present application provide a spatial audio playing method, comprising: playing virtual reality spatial audio according to a virtual position of the virtual reality spatial audio; and adjusting a playing mode of the virtual reality spatial audio in a target situation to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio.

[0006] In a second aspect, the embodiments of the present application provide a spatial audio playing device, comprising: a playing module configured to play virtual reality spatial audio according to a virtual position of the virtual reality spatial audio; and an adjusting module configured to adjust a playing mode of the virtual reality spatial audio in a target situation to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio.

[0007] In a third aspect, the embodiments of the present application provide an electronic device, which comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, and the program or instruction is executed by the processor to implement the steps of the method according to the first aspect.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, wherein a program or instruction is stored on the readable storage medium, and the program or instruction is executed by a processor to implement steps of the method in the first aspect.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, wherein the chip comprises a processor and a communication interface, the communication interface is coupled with the processor, and the processor is configured to run a program or instruction to implement the method in the first aspect.

[0010] In the embodiment of the present application, the virtual reality space audio is played according to a virtual direction of the virtual reality space audio; and in a target case, a playing mode of the virtual reality space audio is adjusted to distinguish the virtual reality space audio from a real environment space audio, so that a user can quickly distinguish a sound in the real environment from a sound in the virtual reality, and a dangerous situation caused by the failure to timely distinguish the sound in the real environment from the sound in the virtual reality is avoided. BRIEF DESCRIPTION OF DRAWINGS

[0011] Figure 1 FIG. 1 is a flowchart of a space audio playing method according to an embodiment of the present application;

[0012] Figure 2 FIG. 2 is a schematic diagram of a first playing mode of space audio playing according to an embodiment of the present application;

[0013] Figure 3 FIG. 3 is a flowchart of a space audio playing method according to another embodiment of the present application;

[0014] Figure 4a FIG. 4 is a schematic diagram of a second playing mode of space audio playing according to an embodiment of the present application;

[0015] Figure 4b FIG. 5 is a schematic diagram of a third playing mode of space audio playing according to an embodiment of the present application;

[0016] Figure 5 FIG. 6 is a flowchart of a space audio playing method according to another embodiment of the present application;

[0017] Figure 6 FIG. 7 is a schematic diagram of a fourth playing mode of space audio playing according to an embodiment of the present application;

[0018] Figure 7 FIG. 8 is a structural schematic diagram of a space audio playing device according to an embodiment of the present application;

[0019] Figure 8 FIG. 9 is a structural schematic diagram of an electronic device according to an embodiment of the present application;

[0020] Figure 9 Fig. 1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0022] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually a category and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / ", generally represents a "or" relationship between the front and rear associated objects.

[0023] The spatial audio playing method provided by the embodiments of the present application will be described in detail below with reference to the drawings and specific embodiments and their application scenarios.

[0024] As shown in Figure 1 An embodiment of the present application provides a spatial audio playing method, which can be executed by an electronic device, in other words, the method can be executed by software or hardware installed in the electronic device, and the method comprises the following steps:

[0025] Step 110: playing the virtual reality spatial audio according to the virtual position of the virtual reality spatial audio.

[0026] For example, through a virtual reality (VR) device supporting spatial audio technology, the virtual reality spatial audio is played according to the virtual position of the virtual reality spatial audio, wherein the virtual position of the virtual reality spatial audio is distributed according to the sound scene of the virtual reality, thereby enabling the user to immerse in the spatial effect of the virtual reality spatial audio. For example Figure 2 As shown in

[0027] Step 120: in the target case, adjust the playing manner of the virtual reality spatial audio, so that the user distinguishes the virtual reality spatial audio from the real environment spatial audio.

[0028] In an implementation manner, the adjusting the playing manner of the virtual reality spatial audio can include: reducing the playing volume of the virtual reality spatial audio.

[0029] For example, when the user is immersed in the spatial effect of the virtual reality spatial audio, the playing volume of the virtual reality spatial audio is reduced from the initial 60% to 30%, at this time, the user can quickly identify the audio with the changed volume as the virtual reality spatial audio based on the change of the audio playing volume, so as to distinguish the virtual reality spatial audio from the real environment spatial audio.

[0030] Therefore, the user can quickly identify the audio with the changed playing manner, such as the changed volume, as the virtual reality spatial audio based on the change of the audio playing manner, so as to distinguish the virtual reality spatial audio from the real environment spatial audio.

[0031] In an implementation manner, the adjusting the playing manner of the virtual reality spatial audio can include: changing the audio playing orientation of the virtual reality spatial audio.

[0032] When the virtual reality spatial audio is played according to the virtual orientation of the virtual reality spatial audio, the user is immersed in the spatial effect of the virtual reality spatial audio, at this time, the audio playing orientation of the virtual reality spatial audio is changed, for example, the virtual reality spatial audio is played at a preset orientation, thereby changing the spatial effect of the virtual reality spatial audio. The preset orientation can be preset by the user, and the preset orientation can be the front, the back, etc., at this time, the user can quickly identify the audio with the changed audio playing orientation as the virtual reality spatial audio based on the change of the audio playing orientation, so as to distinguish the virtual reality spatial audio from the real environment spatial audio.

[0033] Therefore, the user can quickly identify the audio with the changed playing manner, such as the changed audio playing orientation, as the virtual reality spatial audio based on the change of the audio playing manner, so as to distinguish the virtual reality spatial audio from the real environment spatial audio.

[0034] In an implementation manner, before step 120, the method further includes: collecting the real environment spatial audio from the real environment. For example, the sound in the real environment is collected through the microphone of the VR device.

[0035] The target case includes at least one of the following: the volume of the collected real environment spatial audio is greater than a target threshold, and the collected real environment spatial audio includes a target audio.

[0036] The target threshold value can be set by the user. For example, the target threshold value is set to 85 decibels. If the volume of the collected real environment spatial audio is greater than 85 decibels, it is considered that there is an abnormal sound in the real environment, and there may be a danger. At this time, the playing mode of the virtual reality spatial audio is adjusted, so that the user can distinguish the virtual reality spatial audio from the real environment spatial audio in time, pay attention to the sound in the real environment in time, and avoid danger.

[0037] The target audio is audio containing a wake-up word. For example, the wake-up word is "help" or "be careful". If the wake-up word is detected, it is considered that there may be a danger in the real environment. At this time, the playing mode of the virtual reality spatial audio is adjusted, so that the user can distinguish the virtual reality spatial audio from the real environment spatial audio in time, pay attention to the sound in the real environment in time, and avoid danger.

[0038] In this way, whether to trigger adjustment of the playing mode of the virtual reality spatial audio can be determined according to the actually collected real environment spatial audio. When the real environment spatial audio meets a preset condition, the playing mode of the virtual reality spatial audio is automatically adjusted, so that the user can identify the audio whose playing mode is changed as the virtual reality spatial audio, and distinguish the virtual reality spatial audio from the real environment spatial audio.

[0039] In an implementation manner, before step 120, the method further includes: receiving a target input of the user. The target condition includes that the target input of the user is received.

[0040] The target input is used to trigger adjustment of the playing mode of the virtual reality spatial audio. The target input can be a key input, a touch input, a gesture input, a voice input, or the like. For example, a gesture action of the user is detected by a camera of the VR device. The gesture action is, for example, a gesture of keeping silent, a fist, a wave, or the like. For another example, the VR device is provided with a physical key or a touch point, which is used to receive a key input or a touch input of the user. The target input can be set by the user, and embodiments of the present application do not make a specific limitation in this regard.

[0041] In this way, the user can actively trigger adjustment of the playing mode of the virtual reality spatial audio, and then the user can distinguish the virtual reality spatial audio from the real environment spatial audio according to the change of the audio playing mode.

[0042] Therefore, the space audio playing method provided by the embodiment of the present application can play the virtual reality space audio according to the virtual direction of the virtual reality space audio, and adjust the playing mode of the virtual reality space audio in a target case to enable the user to distinguish the virtual reality space audio from the real environment space audio. The user can quickly identify the virtual reality space audio based on the change of the audio playing mode, thereby distinguishing the sound in the real environment from the sound in the virtual reality, and avoiding the occurrence of dangerous situations due to the failure to timely distinguish the sound in the real environment from the sound in the virtual reality.

[0043] As shown in Figure 3 , the embodiment of the present application provides a space audio playing method, which can be executed by an electronic device, in other words, the method can be executed by software or hardware installed in the electronic device. The method comprises the following steps:

[0044] Step 210: playing the virtual reality space audio according to the virtual direction of the virtual reality space audio.

[0045] Step 210 can adopt Figure 1 The description of step 110 in the embodiment is not repeated here.

[0046] Step 220: playing the virtual reality space audio at a first direction in a target case, the first direction being opposite to the real direction of the collected real environment space audio.

[0047] The target case can adopt Figure 1 The description of the target case in the embodiment is not repeated here.

[0048] It can be understood that the space audio playing method provided by the embodiment of the present application further comprises: collecting the real environment space audio from the real environment. In the embodiment of the present application, adjusting the playing mode of the virtual reality space audio in the target case comprises: adjusting the playing mode of the virtual reality space audio according to the real direction of the collected real environment space audio in the target case, and further changing the spatial effect of the virtual reality space audio.

[0049] Specifically, the first direction opposite to the real direction of the collected real environment space audio is determined according to the real direction of the collected real environment space audio, and the virtual reality space audio is played at the first direction.

[0050] For example, if the real direction of the collected real environment space audio is the left rear direction, the first direction is determined as the right front direction, and the virtual reality space audio is played at the right front direction, as shown in Figure 4a .

[0051] Thus, by playing the virtual reality spatial audio in the first position opposite to the real position of the collected real environment spatial audio, the virtual reality spatial audio can be made as far as possible from the real environment spatial audio in terms of spatial effect, thereby highlighting the real environment spatial audio, making it easier for the user to pay attention to the real environment spatial audio, avoiding the user from being immersed in the spatial effect of the virtual reality spatial audio and failing to timely distinguish the sound in the real environment from the sound in the virtual reality, thereby causing dangerous situations.

[0052] In an implementation manner, the virtual reality spatial audio is played in the first position, and no spatial position distinction is made on the virtual reality spatial audio, that is, the audio positions of the virtual reality spatial audio are all overlapped in the same position.

[0053] In combination Figure 4a It is illustrated that the first position is the right front, and the virtual reality spatial audio is played in the right front, that is, the audio positions of the virtual reality spatial audio are all overlapped in the right front, and no detailed distinction is made on the spatial positions of the virtual reality spatial audio.

[0054] In another implementation manner, the virtual reality spatial audio is played in the first position, including playing the virtual reality spatial audio in a sub-position of the first position according to the virtual position of the virtual reality spatial audio.

[0055] It can be understood that in the embodiments of the present application, the first position includes a sub-position, and the virtual reality spatial audio includes a sub-audio, where the sub-audio has a corresponding sub-position. The sub-audio in the virtual reality spatial audio is played in the sub-position of the first position, that is, on the basis of playing the virtual reality spatial audio in the first position, the sub-position of the first position corresponding to the sub-audio in the virtual reality spatial audio is determined according to the virtual position of the virtual reality spatial audio, thereby making a detailed distinction on the spatial positions of the virtual reality spatial audio in the first position.

[0056] In combination Figure 4b It is illustrated that the first position is the right front, and the virtual reality spatial audio includes three sub-positions, namely a first sub-position, a second sub-position, and a third sub-position, and the virtual reality spatial audio includes three sub-positions, which correspond to the three sub-positions, respectively. The three sub-positions of the first position play the three sub-positions in the virtual reality spatial audio, thereby making a preset degree of distinction on the positions of the virtual reality spatial audio in the first position, and retaining a certain spatial effect of the virtual reality spatial audio, such as Figure 4b .

[0057] Specifically, the audio positions of the sub-audios of the virtual reality spatial audio can be completely non-overlapping or partially non-overlapping, so that the virtual reality spatial audio has a certain degree of spatial position distinction. For example, the sub-audios of the virtual reality spatial audio that interact with the user can be kept in independent positions, and the positions of other sub-audios are overlapped; or the audio position of the sub-audio of the virtual reality spatial audio closest to the user or the sub-audio with the largest volume in the virtual reality spatial audio is not overlapped with the positions of other sub-audios; or the audio positions of some sub-audios can be determined to be overlapped according to user habits and preferences learned by artificial intelligence or according to a manner set by the user, and the embodiments of the present application do not make specific limitations in this regard.

[0058] In this way, the virtual reality spatial audio can be made as far as possible from the real environment spatial audio in terms of spatial effect, while still retaining certain spatial effects of the virtual reality spatial audio, thereby optimizing the playing effect of the virtual reality spatial audio.

[0059] In an implementation manner, the virtual reality spatial audio is played at the first position, including playing a key audio in the virtual reality spatial audio at the first position.

[0060] The key audio, for example, a sub-audio of the virtual reality spatial audio that interacts with the user, or a sub-audio of the virtual reality spatial audio closest to the user, or a sub-audio of the virtual reality spatial audio with the largest volume, or the key audio can be determined according to user habits and preferences learned by artificial intelligence or according to a manner set by the user, and the embodiments of the present application do not make specific limitations in this regard.

[0061] In this way, the playing effect of the virtual reality spatial audio can be optimized by playing the key audio in the virtual reality spatial audio.

[0062] In this way, the spatial audio playing method provided by the embodiments of the present application can play the virtual reality spatial audio according to the virtual position of the virtual reality spatial audio, and adjust the playing manner of the virtual reality spatial audio in a target case to enable the user to distinguish the virtual reality spatial audio from the real environment spatial audio. The present application can enable the user to quickly identify the virtual reality spatial audio based on the change of the audio playing manner, so as to distinguish the sound in the real environment from the sound in the virtual reality, thereby avoiding the occurrence of dangerous situations due to the inability to timely distinguish the sound in the real environment from the sound in the virtual reality.

[0063] Therefore, the method for playing spatial audio provided by the embodiment of the present application can change the spatial effect of the virtual reality spatial audio by playing the virtual reality spatial audio at the first orientation opposite to the real orientation of the collected real environment spatial audio, so that the user can distinguish the virtual reality spatial audio from the real environment spatial audio, and make the virtual reality spatial audio as far as possible from the real environment spatial audio in the spatial effect, thereby highlighting the real environment spatial audio, making the user more easily notice the real environment spatial audio, avoiding the user from being immersed in the spatial effect of the virtual reality spatial audio, and failing to distinguish the sound in the real environment from the sound in the virtual reality in time, thereby preventing the dangerous situation from occurring.

[0064] As shown in the figure, one embodiment of the present application provides a method for playing spatial audio, which can be executed by an electronic device, in other words, the method can be executed by software or hardware installed in the electronic device, and the method comprises the following steps: Figure 5

[0065] Step 310: playing the virtual reality spatial audio according to the virtual orientation of the virtual reality spatial audio.

[0066] Step 310 can adopt the description of embodiment step 110, which will not be repeated here. Figure 1 After step 310, steps 321 and 322 are executed.

[0067] Step 321: adjusting the playing mode of the virtual reality spatial audio under the target condition, so as to make the user distinguish the virtual reality spatial audio from the real environment spatial audio.

[0068] Step 321 can adopt the description of embodiment step 120, which can also adopt the description of embodiment step 220, which will not be repeated here.

[0069] Figure 1 Step 322: playing the real environment spatial audio at a second orientation, the second orientation being the same as the real orientation of the collected real environment spatial audio. Figure 3 It can be understood that, before step 322, the method further comprises: collecting the real environment spatial audio from the real environment.

[0070] By collecting the real environment spatial audio from the real environment, determining the real orientation of the real environment spatial audio, and playing the virtual reality spatial audio at the second orientation same as the real orientation of the collected real environment spatial audio, the real environment spatial audio can be further highlighted, and the user can more easily notice the real environment spatial audio.

[0071]

[0072] ​​​​

[0073] In one implementation, after the real environment spatial audio is collected from the real environment, the real environment spatial audio is played at a second position, the second position being the same as the real position of the collected real environment spatial audio.

[0074] It can be understood that, after the real environment spatial audio is collected, the real environment spatial audio can be played at a second position which is the same as the real position of the collected real environment spatial audio, so as to highlight the real environment spatial audio and make it easier for the user to pay attention to the real environment spatial audio.

[0075] In another implementation, in the target case, the real environment spatial audio is played at a second position, the second position being the same as the real position of the collected real environment spatial audio.

[0076] Only in the target case, the real environment spatial audio is played to highlight the real environment spatial audio in the target case and make it easier for the user to pay attention to the real environment spatial audio.

[0077] For example, if the real position of the collected real environment spatial audio is the left rear, the real environment spatial audio is played at the left rear and the virtual reality spatial audio is played at the right front, as shown in Figure 6 .

[0078] In one implementation, in any of the above embodiments, the method can further include: collecting real environment spatial audio from the real environment, determining whether an emergency situation occurs in the real environment according to the collected real environment spatial audio, and playing an alarm audio in the case that an emergency situation occurs in the real environment according to the collected real environment spatial audio.

[0079] For example, the real environment spatial audio includes a distress class and a harsh sound, and it is considered that an emergency situation occurs in the real environment, at which time the alarm audio is played to make the user pay attention to the emergency situation in the real environment in time and avoid danger.

[0080] In this way, it can be automatically determined whether an emergency situation occurs in the real environment according to the collected real environment spatial audio, and in the case that an emergency situation occurs in the real environment, the alarm audio is played to remind the user that there may be danger in the real environment, so as to avoid the situation that the user is immersed in the spatial effect of the virtual reality spatial audio and causes danger.

[0081] According to the space audio playing method provided in the embodiments of the present application, the virtual reality space audio is played according to the virtual position of the virtual reality space audio; and in a target case, the playing mode of the virtual reality space audio is adjusted, so that the user can distinguish the virtual reality space audio from the real environment space audio. The user can quickly identify the virtual reality space audio based on the change of the audio playing mode, so as to distinguish the sound in the real environment from the sound in the virtual reality, and avoid the dangerous situation caused by the failure to distinguish the sound in the real environment from the sound in the virtual reality in time.

[0082] According to the space audio playing method provided in the embodiments of the present application, the real environment space audio is collected from the real environment; and in the case that it is determined that an emergency situation occurs in the real environment according to the collected real environment space audio, an alarm audio is played. The emergency situation in the real environment can be automatically judged according to the collected real environment space audio, and in the case that it is determined that an emergency situation occurs in the real environment, the user is reminded of the possible danger in the real environment through the alarm audio, so as to avoid the dangerous situation caused by the user's immersion in the space effect of the virtual reality space audio.

[0083] It should be noted that the execution subject of the space audio playing method provided in the embodiments of the present application can be a space audio playing device, or a module for executing the space audio playing method in the space audio playing device. The space audio playing device provided in the embodiments of the present application is described by taking the space audio playing device executing the space audio playing method as an example.

[0084] Figure 7 is a structural schematic diagram of the space audio playing device according to the embodiments of the present application. As shown in Figure 7 the space audio playing device 400 includes a playing module 410 and an adjusting module 420.

[0085] The playing module 410 is configured to play the virtual reality space audio according to the virtual position of the virtual reality space audio; and the adjusting module 420 is configured to adjust the playing mode of the virtual reality space audio in a target case, so that the user can distinguish the virtual reality space audio from the real environment space audio.

[0086] In an implementation manner, the device further includes a collecting module configured to collect the real environment space audio from the real environment; and the target case includes at least one of the following:

[0087] The volume of the collected real environment space audio is greater than a target threshold value;

[0088] The collected real environment space audio includes a target audio.

[0089] In an implementation manner, the apparatus further comprises a collecting module configured to collect real environment spatial audio from a real environment; and the adjusting module is further configured to play the virtual reality spatial audio at a first orientation, the first orientation being opposite to a real orientation of the collected real environment spatial audio.

[0090] In an implementation manner, the adjusting module is further configured to play key audio in the virtual reality spatial audio at the first orientation.

[0091] In an implementation manner, the first orientation comprises a sub-orientation, and the adjusting module is further configured to play the virtual reality spatial audio at the sub-orientation of the first orientation according to a virtual orientation of the virtual reality spatial audio.

[0092] In an implementation manner, the adjusting module is further configured to play the real environment spatial audio at a second orientation, the second orientation being the same as the real orientation of the collected real environment spatial audio.

[0093] In an implementation manner, the adjusting module is further configured to reduce a playing volume of the virtual reality spatial audio.

[0094] In an implementation manner, the apparatus further comprises a collecting module configured to collect real environment spatial audio from a real environment; and the playing module is further configured to play alarm audio in a case that an emergency situation occurs in the real environment according to the collected real environment spatial audio.

[0095] Therefore, the spatial audio playing apparatus provided by the embodiments of the present application plays the virtual reality spatial audio according to a virtual orientation of the virtual reality spatial audio, and adjusts a playing manner of the virtual reality spatial audio in a target case to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio. The embodiments of the present application enable the user to quickly identify the virtual reality spatial audio based on a change of the audio playing manner, thereby distinguishing a sound in the real environment from a sound in the virtual reality, and avoiding a dangerous situation caused by an inability to timely distinguish the sound in the real environment from the sound in the virtual reality.

[0096] The spatial audio playback device in this application embodiment can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc., while non-mobile electronic devices can be servers, network-attached storage (NAS), personal computers (PCs), televisions (TVs), ATMs, or self-service machines, etc. This application embodiment does not impose specific limitations.

[0097] The spatial audio playback device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0098] The spatial audio playback device provided in this application embodiment can achieve... Figure 1 , 3 The various processes implemented in the method embodiment of 5 will not be described again here to avoid repetition.

[0099] Optionally, such as Figure 8 As shown, this application embodiment also provides an electronic device 500, including a processor 501, a memory 502, and a program or instructions stored in the memory 502 and executable on the processor 501. When the program or instructions are executed by the processor 501, they implement the various processes of the above-described spatial audio playback method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0100] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0101] Figure 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0102] The electronic device 600 includes, but is not limited to, components such as: radio frequency unit 601, network module 602, audio output unit 603, input unit 604, sensor 605, display unit 606, user input unit 607, interface unit 608, memory 609, and processor 610.

[0103] Those skilled in the art can understand that the electronic device 600 can further include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 610 through a power management system, so that the power management system can realize functions such as management of charging, discharging, and power consumption management. Figure 9 The electronic device structure shown in the foregoing embodiments does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than those shown, or combine certain components, or arrange different components, which will not be described here.

[0104] The processor 610 is configured to play the virtual reality spatial audio according to a virtual position of the virtual reality spatial audio, and adjust a playing manner of the virtual reality spatial audio in a target case to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio.

[0105] In an implementation manner, the processor 610 is further configured to collect real environment spatial audio from a real environment, and the target case includes at least one of the following:

[0106] The volume of the collected real environment spatial audio is greater than a target threshold value;

[0107] The collected real environment spatial audio includes target audio.

[0108] In an implementation manner, the processor 610 is further configured to collect real environment spatial audio from a real environment, and play the virtual reality spatial audio in a first position, the first position being opposite to a real position of the collected real environment spatial audio.

[0109] In an implementation manner, the processor 610 is further configured to play key audio in the virtual reality spatial audio in the first position.

[0110] In an implementation manner, the first position includes a sub-position, and the processor 610 is further configured to play the virtual reality spatial audio in the sub-position of the first position according to the virtual position of the virtual reality spatial audio.

[0111] In an implementation manner, the processor 610 is further configured to play the real environment spatial audio in a second position, the second position being the same as the real position of the collected real environment spatial audio.

[0112] In an implementation manner, the processor 610 is further configured to reduce a playing volume of the virtual reality spatial audio.

[0113] In an implementation manner, the processor 610 is further configured to collect real environment spatial audio from the real environment; and play the alarm audio in a case that the emergency situation in the real environment is determined according to the collected real environment spatial audio.

[0114] It should be understood that in the embodiments of the present application, the input unit 604 can include a graphics processing unit (GPU) 6041 and a microphone 6042. The graphics processing unit 6041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 606 can include a display panel 6061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 607 includes a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 can include a touch detection device and a touch controller. The other input devices 6072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, etc., which will not be described here. The memory 609 can be used to store software programs and various data, including but not limited to application programs and operating systems. The processor 610 can integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 610.

[0115] The embodiments of the present application also provide a readable storage medium, which stores programs or instructions, and the programs or instructions are executed by a processor to realize the processes of the above-mentioned spatial audio playing method embodiments and achieve the same technical effects. To avoid repetition, details will not be described here.

[0116] The processor is the processor in the electronic device described in the above-mentioned embodiments. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0117] The embodiments of the present application further provide a chip, which includes a processor and a communication interface. The communication interface is coupled with the processor. The processor is configured to run programs or instructions to realize the processes of the above-mentioned spatial audio playing method embodiments and achieve the same technical effects. To avoid repetition, details will not be described here.

[0118] It should be understood that the chip mentioned in the embodiments of the present application can also be referred to as a system-level chip, a system chip, a chip system, or a system-on-chip chip, etc.

[0119] It should be noted that in this document, the terms "comprise", "comprising", or any other variant thereof are intended to cover non-exclusive inclusions, so that processes, methods, articles, or devices that comprise a list of elements not only include those elements, but also include other elements not explicitly listed, or further include elements inherent in such processes, methods, articles, or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, but can also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted, or combined. In addition, the features described with reference to certain examples can be combined in other examples.

[0120] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and the necessary general hardware platform, of course, they can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disc, optical disc), and includes a plurality of instructions for making a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) execute the methods described in various embodiments of the present application.

[0121] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above specific embodiments, and the above specific embodiments are only illustrative, not limiting, and those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. A spatial audio playback method, characterized by, The method comprises: playing virtual reality spatial audio according to a virtual direction of the virtual reality spatial audio; in a target case, adjusting a playing manner of the virtual reality spatial audio to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio; The method further comprises: collecting real environment spatial audio from a real environment; The adjustment of the playing manner of the virtual reality spatial audio comprises: playing the virtual reality spatial audio at a first direction, the first direction being opposite to a real direction of the collected real environment spatial audio.

2. The method of claim 1, wherein, Before the adjustment of the playing manner of the virtual reality spatial audio in the target case, the method further comprises: collecting real environment spatial audio from a real environment; The target case comprises at least one of: a volume of the collected real environment spatial audio being greater than a target threshold; the collected real environment spatial audio comprising target audio.

3. The method of claim 1, wherein, The playing of the virtual reality spatial audio at the first direction comprises: playing key audio in the virtual reality spatial audio at the first direction.

4. The method of claim 1, wherein, The first direction comprises a sub-direction, and the playing of the virtual reality spatial audio at the first direction comprises: playing the virtual reality spatial audio at the sub-direction of the first direction according to a virtual direction of the virtual reality spatial audio.

5. The method of claim 1, wherein, After the collection of the real environment spatial audio from the real environment, the method further comprises: playing the real environment spatial audio at a second direction, the second direction being the same as a real direction of the collected real environment spatial audio.

6. The method according to any one of claims 1 to 5, characterized in that, The adjustment of the playing manner of the virtual reality spatial audio comprises: reducing a playing volume of the virtual reality spatial audio.

7. The method of claim 1, wherein, The method further comprises: collecting real environment spatial audio from a real environment; in a case where it is determined according to the collected real environment spatial audio that an emergency situation occurs in the real environment, playing alarm audio.

8. A spatial audio playback apparatus, characterized by, The apparatus comprises: a playing module configured to play virtual reality spatial audio according to a virtual direction of the virtual reality spatial audio; an adjusting module configured to, in a target case, adjust a playing manner of the virtual reality spatial audio to enable a user to distinguish the virtual reality spatial audio from real environment spatial audio; The apparatus further comprises: a collecting module configured to collect real environment spatial audio from a real environment; The adjusting module is further configured to: play the virtual reality spatial audio at a first direction, the first direction being opposite to a real direction of the collected real environment spatial audio.

9. The apparatus of claim 8, wherein, The apparatus further comprises: a collecting module configured to collect real environment spatial audio from a real environment; The target case comprises at least one of: a volume of the collected real environment spatial audio being greater than a target threshold; the collected real environment spatial audio comprising target audio.

10. The apparatus of claim 8, wherein, The adjusting module is further configured to: play key audio in the virtual reality spatial audio at the first direction.

11. The apparatus of claim 8, wherein, The first direction comprises a sub-direction, and the adjusting module is further configured to: play the virtual reality spatial audio at the sub-direction of the first direction according to a virtual direction of the virtual reality spatial audio.

12. The apparatus of claim 8, wherein, The adjusting module is further configured to: playing the real environment spatial audio in a second orientation, the second orientation being the same as a real orientation of the real environment spatial audio captured.

13. The device of any one of claims 8-12, wherein, The adjusting module is further configured to: decrease a playing volume of the virtual reality spatial audio.

14. The apparatus of claim 8, wherein, The apparatus further comprises: a capturing module configured to capture real environment spatial audio from a real environment; The playing module is further configured to: in a case that it is determined from the captured real environment spatial audio that an emergency situation occurs in the real environment, play an alarm audio.

15. An electronic device, comprising: a processor, a memory, and a program or instructions stored in the memory and executable on the processor, the program or instructions, when executed by the processor, implement steps of the method according to any one of claims 1-7.

16. A readable storage medium, characterized by, a program or instructions stored in the memory and executable on the processor, the program or instructions, when executed by the processor, implement steps of the method according to any one of claims 1-7.

Images