Method, device, vehicle, storage medium and program product for voice interaction

Abstract

The present disclosure relates to a method, apparatus, vehicle, storage medium and program product for voice interaction, the method comprising: in response to receiving a voice wake-up instruction of a user, determining a seat state of a seat in a vehicle; in response to the seat state satisfying a preset state condition, receiving a voice interaction message of the user based on a target sound zone, the target sound zone being obtained by combining a plurality of sound zones of the vehicle. In this way, the plurality of sound zones of the vehicle are combined according to the seat state of the seat in the vehicle, and voice interaction is performed with the user through the combined sound zone, which can improve the sound pickup accuracy and sound source positioning accuracy during voice interaction, thereby improving the voice interaction experience of the user.

Description

Technical Field

[0001] This disclosure relates to the field of audio technology, and more particularly to a method, apparatus, vehicle, storage medium, and program product for voice interaction. Background Technology

[0002] With the development of intelligent cockpits, in-vehicle voice interaction has gradually become one of the core methods of human-computer interaction.

[0003] However, due to the widespread use of features such as reclining seats, users often use a lying posture when resting. In this lying posture, the misjudgment rate of sound source localization in related technologies for voice interaction is relatively high, which affects the user experience. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a method, apparatus, vehicle, storage medium, and program product for voice interaction.

[0005] According to a first aspect of the present disclosure, a method for voice interaction is provided, comprising: In response to receiving a user's voice wake-up command, determine the seat status in the vehicle; In response to the seat state meeting preset state conditions, the system receives the user's voice interaction message based on a target voice zone; the target voice zone is a combination of multiple voice zones of the vehicle.

[0006] By using the above method, multiple sound zones of the vehicle are combined according to the seat status, and voice interaction with the user is conducted through the combined sound zones. This can improve the sound pickup accuracy and sound source localization accuracy during voice interaction, thereby enhancing the user's voice interaction experience.

[0007] In some possible implementations, the seat state includes the tilt angle of the seat back; the preset state condition includes: the tilt angle is within a first preset angle range; and / or, the seat state includes a seat mode; the preset state condition includes: the seat mode is in a first mode.

[0008] By adopting this implementation method, the seat status is determined by the tilt angle of the seat back and the seat mode to determine whether the seat status meets the preset status conditions, and then it is determined whether to combine multiple sound zones of the vehicle. This can accurately determine the timing of combining multiple sound zones and improve the sound pickup accuracy and sound source localization accuracy during voice interaction.

[0009] In some possible implementations, the seat includes a first seat, which is the seat where the user is located; the target sound region includes a first target sound region, and receiving the user's voice interaction message based on the target sound region in response to the seat state satisfying a preset state condition includes: receiving the voice interaction message based on the first target sound region in response to the seat state of the first seat satisfying a preset state condition, wherein the first target sound region is obtained by combining a first sound region and a second sound region, the first sound region is the sound region where the sound source of the voice wake-up command is located, and the second sound region is determined according to the seat state of the first seat and the first sound region.

[0010] By adopting this implementation method, when the user's seat meets the preset state conditions, the corresponding sound zones of the user's seat are combined, thereby improving the sound pickup accuracy and sound source localization accuracy of the user's subsequent voice interaction in the combined sound zones. At the same time, when combining sound zones, the first sound zone where the voice wake-up command sound source is located can be combined with the second sound zone determined according to the seat state, thereby improving the intelligence of the sound zone combination.

[0011] In some possible implementations, the second sound zone is determined based on the seat state of the first seat and the first sound zone in the following ways: if the first sound zone is different from the sound zone corresponding to the seating area of ​​the first seat, the sound zone corresponding to the seating area of ​​the first seat is taken as the second sound zone; or, if the first sound zone is the same as the sound zone corresponding to the seating area of ​​the first seat, the adjacent sound zone in the tilt direction of the first seat is taken as the second sound zone.

[0012] This implementation method can dynamically determine the second sound zone to be combined based on the user's voice position in the seat, whether the voice position and the seat area are the same or different, according to the first sound zone and the seat state, thereby improving the intelligence and accuracy of sound zone combination.

[0013] In some possible implementations, the seat further includes a second seat, which is at least one seat in the vehicle adjacent to the first seat; the target sound zone further includes a second target sound zone, and receiving the user's voice interaction message based on the target sound zone in response to the seat state satisfying a preset state condition includes: receiving the voice interaction message based on the second target sound zone in response to both the seat state of the first seat and the seat state of the second seat satisfying the preset state condition; the second target sound zone is a combination of the first target sound zone and a third target sound zone, and the third target sound zone is a combination of the sound zone corresponding to the seating area of ​​the second seat and the adjacent sound zone in the tilt direction of the second seat.

[0014] By adopting this implementation method, when the sound zones corresponding to the user's seat are combined according to the preset state conditions of the user's seat, the sound zones of adjacent seats that are in the preset state conditions can be combined at the same time, thereby realizing the flexibility of combining multiple sound zones in the vehicle.

[0015] In some possible implementations, in response to multiple seats in the vehicle satisfying the preset state conditions, the voice interaction message is received based on the fourth target sound zone; the fourth target sound zone is a combination of at least three sound zones of the vehicle.

[0016] This implementation method also enables the entire vehicle to be combined into a unified voice zone when multiple seats in the vehicle meet preset state conditions, thereby meeting the user's unified voice interaction needs across multiple voice zones in the vehicle and improving the user's voice interaction experience.

[0017] In some possible implementations, the method further includes: in response to the tilt angle being within a second preset angle range, acquiring a first voice signal of the user based on the first voice zone; the maximum value of the second preset angle range is less than the minimum value of the first preset angle range; acquiring a second voice signal of the user based on a third voice zone, the third voice zone being an adjacent voice zone in the tilt direction of the first seat; and weightedly fusing the first voice signal and the second voice signal to obtain the voice interaction message.

[0018] By adopting this implementation method, when the voice signal emitted by the user's seat position determined based on the seat tilt angle may be collected by multiple different voice zones, the user's voice signal can be collected separately by each voice zone, and the voice signals collected by different voice zones can be weighted and fused to obtain the user's voice interaction message. This can ensure the accuracy and continuity of the voice interaction message and improve the user's voice interaction experience.

[0019] In some possible implementations, the method further includes: adjusting a first playback parameter of the voice response message to be played according to a preset parameter adjustment strategy to obtain a second playback parameter; the voice response message is a response message corresponding to the voice interaction message; and playing the voice response message according to the second playback parameter.

[0020] By adopting this implementation method, when interacting with the user via voice using the combined sound range, the playback parameters of the voice response message for the voice interaction message are adjusted, thereby making the voice interaction adaptable to the user's lying scenario and improving the user's voice signal reception experience.

[0021] In some possible implementations, the preset parameter adjustment strategy includes at least one of the following: increasing the detection sensitivity of the voice wake-up command; reducing noise suppression intensity; reducing playback volume; appropriately extending the wake-up response delay; and increasing the audio acquisition priority corresponding to the target sound region.

[0022] By adopting this implementation method, when interacting with the user via voice using the combined audio range, playback parameters such as command detection sensitivity, noise suppression strength, playback volume, wake-up response latency, and audio acquisition priority can be adjusted to ensure that the user is not disturbed by sharp audio playback in resting scenarios such as lying down, thereby improving the user's comfort.

[0023] In some possible implementations, receiving the user's voice interaction message based on the target audio region includes: controlling multiple audio acquisition devices in the target audio region to enter a pickup state; and receiving the user's voice interaction message acquired by the target audio acquisition device based on the multiple audio acquisition devices being in the pickup state, wherein the target audio acquisition device is one of the multiple audio acquisition devices.

[0024] This implementation method, by controlling multiple audio acquisition devices in the target audio region to enter the sound pickup state during voice interaction with the user in the combined target audio region, improves the accuracy of sound source localization, thereby enhancing the accuracy of subsequent speech recognition. Simultaneously, having the target audio acquisition device among these multiple audio acquisition devices receive the voice interaction messages avoids interaction conflicts between multiple devices, further improving sound pickup accuracy.

[0025] According to a second aspect of the present disclosure, a voice interaction apparatus is provided, comprising: The voice wake-up module is configured to determine the seat status in the vehicle in response to receiving a user's voice wake-up command. The voice interaction module is configured to receive the user's voice interaction message based on a target voice zone in response to the seat state meeting a preset state condition; the target voice zone is a combination of multiple voice zones of the vehicle.

[0026] Optionally, the seat state includes the tilt angle of the seat back; the preset state condition includes: the tilt angle is within a first preset angle range; and / or, the seat state includes a seat mode; the preset state condition includes: the seat mode is in a first mode.

[0027] Optionally, the seat includes a first seat, which is the seat where the user is located; the target sound zone includes a first target sound zone; the voice interaction module is further configured to receive the voice interaction message based on the first target sound zone in response to the seat state of the first seat meeting a preset state condition, wherein the first target sound zone is obtained by combining a first sound zone and a second sound zone, the first sound zone is the sound zone where the sound source of the voice wake-up command is located, and the second sound zone is determined according to the seat state of the first seat and the first sound zone.

[0028] Optionally, the device further includes: a parameter adjustment module configured to adjust a first playback parameter of the voice response message to be played according to a preset parameter adjustment strategy to obtain a second playback parameter; the voice response message is a response message corresponding to the voice interaction message; the voice interaction module is further configured to play the voice response message according to the second playback parameter.

[0029] According to a third aspect of the present disclosure, a vehicle is provided, comprising: processor; Memory used to store processor-executable instructions; The processor is configured to perform the steps of the voice interaction method provided in the first aspect of this disclosure.

[0030] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the steps of the voice interaction method provided in the first aspect of the present disclosure.

[0031] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the voice interaction method provided in the first aspect of the present disclosure.

[0032] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: in response to receiving a user's voice wake-up command, the seat state of the seat in the vehicle is determined, and in response to the seat state meeting preset state conditions, the user's voice interaction message is received based on the target sound zone obtained by combining multiple sound zones of the vehicle. This enables the combination of multiple sound zones of the vehicle according to the seat state of the seat in the vehicle, and voice interaction with the user is performed through the combined sound zone, thereby improving the sound pickup accuracy and sound source localization accuracy during voice interaction and enhancing the user's voice interaction experience.

[0033] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0034] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0035] Figure 1 This is a flowchart illustrating a voice interaction method according to an exemplary embodiment.

[0036] Figure 2 This is a schematic diagram of a scene representing a target audio region according to an exemplary embodiment.

[0037] Figure 3 This is a flowchart illustrating another method of voice interaction according to an exemplary embodiment.

[0038] Figure 4 This is a block diagram illustrating a voice interaction device according to an exemplary embodiment.

[0039] Figure 5 This is a block diagram illustrating another voice interaction device according to an exemplary embodiment.

[0040] Figure 6 This is a schematic diagram illustrating the structure of a voice interaction system according to an exemplary embodiment.

[0041] Figure 7 This is a block diagram illustrating a vehicle according to an exemplary embodiment. Detailed Implementation

[0042] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0043] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the location is situated, and with authorization from the owner of the relevant device.

[0044] Before detailing the embodiments of this disclosure, the application scenarios of this disclosure are first introduced. This disclosure can be applied to in-vehicle voice interaction scenarios in intelligent cockpits, belonging to the intersection of audio signal processing and seat electronic control technology. It can also be extended to scenarios such as in-vehicle rear-seat entertainment, RV voice control, aviation seat voice interaction, and home intelligent reclining chair voice control. With the development of intelligent cockpits, in-vehicle voice interaction has gradually become one of the core methods of human-computer interaction. Current intelligent cockpits typically divide the vehicle into multiple fixed sound zones. For example, a four-seat vehicle can be divided into a driver's sound zone, a passenger's sound zone, a rear left sound zone, and a rear right sound zone. The boundaries of each sound zone are set according to fixed geometric positions, and each sound zone is equipped with independent audio acquisition devices such as microphone arrays, and uses independent audio wake-up mechanisms such as establishing independent TTS (Text-to-Speech) channels.

[0045] In related technologies, due to the widespread use of features such as reclining seats, users often adopt a lying posture in scenarios such as in-car camping, long-distance rest, lunch breaks, and in-car work / rest. When conducting voice interaction based on this reclining posture, methods such as message splicing and interaction position correction are typically employed. In message splicing, when a user wakes up the voice assistant in area A (e.g., by entering the voice message "Hello Car"), the voice assistant continuously monitors area A and its adjacent areas. After the user enters the first voice message "Play" in area A and then enters the second voice message "Song X" in the adjacent area B, the two voice messages can be spliced ​​together to obtain the complete voice message "Play Song X". In interaction position correction, the location of the sound source is corrected by monitoring seat pressure, in-car cameras, and seat angle. For example, if a user enters a voice message in the front seat, reclines the front seat to the back, and lies down, then when a voice message is entered in the back seat, the smart cockpit continues to receive the user's voice message through the rear audio zone.

[0046] However, the voice interaction methods in related technologies still rely on fixed static sound zone divisions, which present the following problems: First, smart cockpits lack the ability to perceive changes in seat status. The boundaries of static sound zone divisions are rigid and cannot adapt to seat status. Specifically, when a user is lying down, their head position shifts significantly, deviating from the fixed coverage area of ​​the original sound zone, leading to sound zone wake-up failures or false wake-ups in other sound zones. Second, because changes in seat status can cause sound source dispersion, the microphone arrays in each sound zone of related technologies operate independently. After a change in seat status, the wake-up voice and command sound sources become dispersed, resulting in low accuracy in sound source localization and insufficient sound pickup. Third, voice interaction parameters are not adapted to seat status. Related technologies use fixed AEC (Acoustic Echo Cancellation) algorithms, noise reduction thresholds, and wake-up sensitivity. In resting scenarios such as when the user is lying down, using fixed parameters for interaction results in wake-up difficulties, harsh announcements, and frequent false wake-ups, contradicting the user's needs for low-voice wake-up, gentle announcements, low-noise sound pickup, and slow response to prevent false wake-ups.

[0047] In summary, the voice interaction methods in the relevant technologies are not adapted to the user's seat position in terms of sound zone division, sound localization and pickup, and interaction parameters. The sound source localization misjudgment rate is high when the user is in a reclining position, which affects the user experience.

[0048] To address the aforementioned problems, this disclosure provides a method, apparatus, vehicle, storage medium, and program product for voice interaction. The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0049] Figure 1 This is a flowchart illustrating a voice interaction method according to an exemplary embodiment, such as... Figure 1 As shown, the method may include the following steps: In step S101, in response to receiving the user's voice wake-up command, the seat status of the seat in the vehicle is determined.

[0050] The seat state can include seat mode and seat back tilt angle. The seat mode can include a first mode and a second mode. The first mode can be a bed mode, where adjusting the seat back tilt angle creates a flat space between the seat back and cushion for the user to lie down and rest. Correspondingly, the second mode can be a baseline mode, where adjusting the seat back tilt angle keeps the user in a seated position. The user's posture can be determined based on the seat back tilt angle. For example, if the tilt angle is within a first preset angle range (e.g., [150°, 180°)), the user is determined to be in a lying position; if the tilt angle is within a second preset angle range (e.g., [110°, 150°)), the user is determined to be in a semi-reclining position; and if the tilt angle is within a third preset angle range (e.g., [90°, 110°)), the user is determined to be in a normal sitting position. The seat status can be obtained through multiple sensors located in the seat. These sensors may include one or more of an angle sensor, a pressure sensor, and a backrest folding detection sensor. The angle sensor can be used to collect the tilt angle of the seat back. The backrest folding detection sensor can be used to confirm whether the seat has entered the first mode. The pressure sensor can be used to confirm whether there is a user on the seat.

[0051] In one possible implementation, the user's seat and its status can be determined based on the voice wake-up command.

[0052] For example, multiple sensors located in the seat can continuously collect the seat state of each seat. In response to the user's voice wake-up command received by the audio acquisition device in the vehicle, the user's location information is determined based on the received voice wake-up command, and the seat the user is in is determined based on the user's location information. Thus, the seat state of the user's seat is determined based on the data collected by the sensors. It should be noted that this disclosure does not specifically limit the method for determining the user's location information based on the voice wake-up command and the method for determining the user's seat based on the location information. For example, the user's location information can be determined based on the DOA (Direction of Arrival Estimation) estimation method, and the user's seat can be determined based on the location information from multiple cameras in the vehicle.

[0053] In step S102, in response to the seat state meeting the preset state conditions, the user's voice interaction message is received based on the target voice zone, which is a combination of multiple voice zones of the vehicle.

[0054] In this step, the seat state may include the tilt angle of the seat back, and the preset state condition may include: the tilt angle is within a first preset angle range; and / or, the seat state may include the seat mode, and the preset state condition may include: the seat mode is in a first mode.

[0055] The first preset angle range can be obtained through experimental calibration. For example, the first preset angle range can be determined by collecting the lying angles of multiple users when they are resting. The first preset angle range can be [150°, 180°].

[0056] For example, when the user's seat is in the first preset angle range and / or the user's seat is in the first mode, the user's seat has exceeded the boundary range of the original sound zone and entered the boundary range of other sound zones. At this time, the other sound zone can be combined with the original sound zone as an extended sound zone to obtain the target sound zone.

[0057] In one possible implementation, receiving the user's voice interaction messages based on the target audio region may include: controlling multiple audio acquisition devices in the target audio region to enter the sound pickup state, and receiving the user's voice interaction messages acquired by the target audio acquisition device based on the multiple audio acquisition devices being in the sound pickup state.

[0058] The target audio acquisition device is one of the multiple audio acquisition devices, which may include multiple microphone arrays.

[0059] For example, taking a four-seater vehicle as an example, if the driver's voice zone, passenger's voice zone, rear left voice zone, and rear right voice zone are combined to obtain the target voice zone, the microphone arrays in the front and rear rows of the vehicle can be controlled to work collaboratively. That is, all microphones are simultaneously turned on and enter the sound pickup state, forming a distributed array throughout the vehicle. When any of the multiple audio acquisition devices picks up the user's voice interaction message, the direction of the sound source can be determined based on the adaptive beamforming algorithm, and the pickup direction can be dynamically adjusted based on the direction of the sound source to determine the target audio acquisition device from among the multiple audio acquisition devices. The user's voice interaction message is then received through the dynamically determined target audio acquisition device. At the same time, the sound source position can be tracked in real time and beam tracking can be driven based on a sound source localization module, such as DOA estimation.

[0060] The above technical solution, in response to receiving a user's voice wake-up command, determines the seat status in the vehicle, and in response to the seat status meeting preset conditions, receives the user's voice interaction message based on the target sound zone obtained by combining multiple sound zones of the vehicle. This allows the system to combine multiple sound zones of the vehicle according to the seat status and interact with the user through the combined sound zone, thereby improving the sound pickup accuracy and sound source localization accuracy during voice interaction and enhancing the user's voice interaction experience.

[0061] In some embodiments, the seat may include a first seat, the target sound zone may include a first target sound zone, and the above step S102 may include: in response to the seat state of the first seat satisfying a preset state condition, receiving the voice interaction message based on the first target sound zone.

[0062] Wherein, the first seat is the seat where the user is sitting, the first target sound zone is obtained by combining the first sound zone and the second sound zone, the first sound zone is the sound zone where the sound source of the voice wake-up command is located, and the second sound zone is determined according to the seat status of the first seat and the first sound zone.

[0063] For example, after determining the first and second sound zones, the first and second sound zones can be combined to obtain a first target sound zone. Multiple audio acquisition devices in the first target sound zone can be controlled to enter the sound pickup state to collect the user's voice interaction messages and simultaneously adjust the voice interaction language of the smart cockpit. Taking a four-seater vehicle as an example, if the first sound zone is the driver's sound zone where the user is located and the second sound zone is the rear left sound zone, the driver's sound zone and the rear left sound zone can be combined to form a left rest area. When conducting voice interaction based on the left rest area, the TTS response phrase "Driver, please speak" can be updated to "Left bed, please speak". In addition, the passenger sound zone on the right side of the vehicle and the rear right sound zone can maintain independent voice interaction.

[0064] The above technical solution combines the corresponding sound zones of the user's seat when the seat meets the preset state conditions. This improves the sound pickup accuracy and sound source localization accuracy when the user performs voice interaction in the combined sound zones. At the same time, the sound zone combination can combine the first sound zone where the voice wake-up command sound source is located with the second sound zone determined according to the seat state, which can improve the intelligence of the sound zone combination.

[0065] In some embodiments, the second sound zone can be specifically determined based on the seating state of the first seat and the first sound zone in the following ways: Method 1: If the first sound zone is different from the sound zone corresponding to the seating area of ​​the first seat, the sound zone corresponding to the seating area of ​​the first seat shall be used as the second sound zone.

[0066] The seating area of ​​the first seat can be the seat cushion of the first seat.

[0067] For example, taking a four-seater vehicle as an example, such as... Figure 2 As shown, in this scenario, the user issues a voice wake-up command in the driver's seat area of ​​the vehicle. The driver's seat is the first seat. The seat state of the first seat meets the preset state conditions, exceeding the boundary range of the driver's seat area and entering the boundary range of the rear left seat area. If the user is in a reclining position and the sound source (which can be defined as the user's head for precise tracking) is within the boundary range of the rear left seat area, then the sound area where the voice wake-up command is located is determined as the rear left seat area, and this rear left seat area is taken as the first sound area. At this time, the sound area corresponding to the seating area of ​​the first seat is still the driver's seat area. The first sound area and the sound area corresponding to the seating area of ​​the first seat are different sound areas. The sound area corresponding to the seating area of ​​the first seat, i.e., the driver's seat area, can be taken as the second sound area.

[0068] Method 2: If the first sound zone and the sound zone corresponding to the seating area of ​​the first seat are the same sound zone, the adjacent sound zone in the tilt direction of the first seat shall be used as the second sound zone.

[0069] The tilt direction can include tilting forward or tilting backward.

[0070] For example, still taking a four-seater vehicle as an example, in this scenario, the user issues a voice wake-up command in the driver's seat area, the driver's seat is the first seat, the first seat is tilted back, the seat position meets the preset state conditions, exceeds the boundary range of the driver's seat area and enters the boundary range of the rear left area area. If the user maintains a normal sitting posture, the sound source is still within the boundary range of the driver's seat area, then the area where the voice wake-up command is located is determined to be the driver's seat area, and the driver's seat area is designated as the first area. At this time, the area corresponding to the seating area of ​​the first seat is also the driver's seat area. The first area and the area corresponding to the seating area of ​​the first seat are the same area, and since the first seat is tilted back, the adjacent area in the tilting direction of the first seat, i.e., the rear left area area, can be designated as the second area.

[0071] The above technical solution can dynamically determine the second sound zone to be combined based on the user's voice position in the seat, whether the voice position and the seat area are the same or different, according to the first sound zone and the seat status, thereby improving the intelligence and accuracy of sound zone combination.

[0072] In some embodiments, the seat may further include a second seat, which is at least one seat in the vehicle that is adjacent to the first seat. The target sound zone may further include a second target sound zone. Step S102 may further include: receiving the voice interaction message based on the second target sound zone in response to the seat state of the first seat and the seat state of the second seat both satisfying the preset state condition.

[0073] The second target sound zone is obtained by combining the first target sound zone and the third target sound zone, and the third target sound zone is obtained by combining the sound zone corresponding to the second seat seating area and the adjacent sound zone in the tilt direction of the second seat.

[0074] For example, taking a three-row, six-seat vehicle as an example, this vehicle includes a driver's voice area, a front passenger voice area, a second-row left voice area, a second-row right voice area, a third-row left voice area, and a third-row right voice area. In this scenario, the user issues a voice wake-up command in the second-row left voice area. The second-row left seat is the first seat, and its seat state meets preset state conditions. If the user is in a reclining position and the voice output point is within the boundary range of the third-row left voice area, then the second-row left voice area is taken as the first voice area, and the third-row left voice area is taken as the second voice area, resulting in the first target voice area. At this time, the seat state of the second seat adjacent to the first seat, i.e., the second-row right seat, can be obtained. If the second-row right seat also meets preset state conditions, then the voice area corresponding to the seating area of ​​the second-row right seat (i.e., the second-row right voice area) and the adjacent voice area in the rearward tilt direction of the second seat (i.e., the third-row right voice area) are combined to obtain the third target voice area. Subsequently, the first target voice area and the third target voice area can be combined to obtain the second target voice area. When the user performs voice interaction based on the second target voice zone, the TTS response phrase "Please speak from the second row left" can be updated to "Please speak from the rear row". In addition, the driver's voice zone and the passenger's voice zone in the first row of the vehicle can maintain independent voice interaction.

[0075] The above technical solution can combine the sound zones corresponding to the user's seat according to the preset state conditions, and simultaneously combine the sound zones of adjacent seats that are in the preset state conditions, thereby realizing the flexibility of combining multiple sound zones in the vehicle.

[0076] In some embodiments, the target sound zone may further include a fourth target sound zone, and the above method may further include: receiving the voice interaction message based on the fourth target sound zone in response to the fact that multiple seats in the vehicle meet the preset state conditions.

[0077] The fourth target sound zone is obtained by combining at least three sound zones of the vehicle, and the at least three sound zones may include all sound zones of the vehicle.

[0078] For example, still using a three-row, six-seat vehicle as an example, this vehicle includes a driver's seat, a front passenger seat, a second-row left seat, a second-row right seat, a third-row left seat, and a third-row right seat. When all seats in the vehicle meet the preset state conditions, all the vehicle's audio zones can be combined to obtain the fourth target audio zone. When the user performs voice interaction based on this fourth target audio zone, the entire vehicle functions as a single virtual audio zone for voice interaction. The TTS response can be directly set to "Please speak," without mentioning the user's location in the TTS response.

[0079] The above technical solutions can also combine the entire vehicle into a unified voice zone when multiple seats in the vehicle meet preset state conditions, thereby meeting the user's unified voice interaction needs in multiple voice zones of the vehicle and improving the user's voice interaction experience.

[0080] In other embodiments, the method may further include: in response to the tilt angle being within a second preset angle range, acquiring the user's first voice signal based on the first voice zone, acquiring the user's second voice signal based on the third voice zone, and weightedly fusing the first voice signal and the second voice signal to obtain the voice interaction message.

[0081] The maximum value of the second preset angle range is less than the minimum value of the first preset angle range. The second preset angle range can be obtained through experimental calibration, for example, by collecting the seat angles of multiple users in a semi-reclined position to determine the second preset angle range. The first preset angle range can be [110°, 150°]. The third audio region is the adjacent audio region in the tilt direction of the first seat. The first voice signal is the voice signal corresponding to the voice interaction message collected by the audio acquisition device in the first audio region, and the second voice signal is the voice signal corresponding to the voice interaction message collected by the audio acquisition device in the third audio region.

[0082] For example, taking a four-seater vehicle as an example, in this scenario, the user issues a voice wake-up command in the driver's seat (the first seat), which is tilted at a second preset angle. The user is in a semi-reclined position, and while the voice is still emitted from the driver's seat, the voice signal emitted in this position may be captured by an audio acquisition device in the rear left-side audio zone directly behind the driver's seat. This rear left-side audio zone can be designated as the third audio zone. The user's voice signal in this position is then acquired based on both the first and third audio zones. Finally, the first and second voice signals are weighted and fused to obtain the voice interaction message. It should be noted that the specific implementation steps of the weighted fusion of voice signals can be found in related technologies and will not be elaborated here.

[0083] By adopting this implementation method, when the voice signal emitted by the user's seat position determined based on the seat tilt angle may be collected by multiple different voice zones, the user's voice signal can be collected separately by each voice zone, and the voice signals collected by different voice zones can be weighted and fused to obtain the user's voice interaction message. This can ensure the accuracy and continuity of the voice interaction message and improve the user's voice interaction experience.

[0084] In some embodiments, Figure 3 This is a flowchart illustrating another method of voice interaction according to an exemplary embodiment, such as... Figure 3 As shown, the method may include the following steps: S301. According to the preset parameter adjustment strategy, adjust the first playback parameter of the voice response message to be played to obtain the second playback parameter.

[0085] The voice response message is the response message corresponding to the voice interaction message.

[0086] In one possible implementation, the preset parameter adjustment strategy may include at least one of the following: increasing the detection sensitivity of the voice wake-up command; reducing the noise suppression intensity; reducing the playback volume; appropriately extending the wake-up response delay; and increasing the audio acquisition priority corresponding to the target sound region.

[0087] For example, to adapt to low-volume voice interaction when users are lying down or in a resting state, the detection threshold of wake-up words can be lowered to improve the detection sensitivity of voice wake-up commands; playback noise can be separated based on noise reduction algorithms, such as weakening strong noise reduction and retaining low-volume components, to reduce noise suppression intensity while avoiding excessive noise reduction that could lead to wake-up failure; the playback volume can be reduced based on a preset volume drop value to ensure that the voice is soft and not harsh, to adapt to the user's lying-down resting environment, and this preset volume drop value can be calibrated experimentally and adjusted according to actual conditions; the wake-up response delay can be appropriately extended based on a preset delay adjustment value, which can be calibrated experimentally and adjusted according to actual conditions; and audio acquisition corresponding to the target sound zone can be prioritized, for example, prioritizing the response to interaction commands in the sound zone of a lying-down chair, to improve the accuracy of voice interaction.

[0088] S302. Play the voice response message according to the second playback parameter.

[0089] The above technical solution, by adjusting the playback parameters of the voice response message in response to the voice interaction message when interacting with the user in the combined sound zone, makes the voice interaction adaptable to the user's lying scenario and improves the user's voice signal reception experience.

[0090] Figure 4 This is a block diagram illustrating a voice interaction device according to an exemplary embodiment, with reference to... Figure 4 The voice interaction device 400 may include: The voice wake-up module 401 is configured to determine the seat status of the vehicle in response to receiving a user's voice wake-up command. The voice interaction module 402 is configured to receive the user's voice interaction message based on a target voice zone in response to the seat state meeting preset state conditions; the target voice zone is a combination of multiple voice zones of the vehicle.

[0091] Optionally, the seat state includes the tilt angle of the seat back; the preset state condition includes: the tilt angle is within a first preset angle range; and / or, the seat state includes a seat mode; the preset state condition includes: the seat mode is in a first mode.

[0092] Optionally, the seat includes a first seat, which is the seat where the user is located; the target sound zone includes a first target sound zone; the voice interaction module 402 is further configured to receive the voice interaction message based on the first target sound zone in response to the seat state of the first seat meeting preset state conditions. The first target sound zone is obtained by combining a first sound zone and a second sound zone. The first sound zone is the sound zone where the sound source of the voice wake-up command is located, and the second sound zone is determined according to the seat state of the first seat and the first sound zone.

[0093] Optionally, the voice interaction module 402 is further configured to, when the first voice zone is different from the voice zone corresponding to the seating area of ​​the first seat, use the voice zone corresponding to the seating area of ​​the first seat as the second voice zone; or, when the first voice zone is the same as the voice zone corresponding to the seating area of ​​the first seat, use the adjacent voice zone in the tilt direction of the first seat as the second voice zone.

[0094] Optionally, the seat further includes a second seat, which is at least one seat in the vehicle that is adjacent to the first seat; the target sound zone further includes a second target sound zone, and the voice interaction module 402 is further configured to receive the voice interaction message based on the second target sound zone in response to both the seat state of the first seat and the seat state of the second seat satisfying the preset state condition; the second target sound zone is obtained by combining the first target sound zone and the third target sound zone, and the third target sound zone is obtained by combining the sound zone corresponding to the seating area of ​​the second seat and the adjacent sound zone in the tilt direction of the second seat.

[0095] Optionally, the target sound zone also includes a fourth target sound zone, and the voice interaction module 402 is further configured to receive the voice interaction message based on the fourth target sound zone in response to multiple seats in the vehicle meeting the preset state conditions; the fourth target sound zone is obtained by combining at least three sound zones of the vehicle.

[0096] Optionally, the voice interaction module 402 is further configured to, in response to the tilt angle being within a second preset angle range, acquire the user's first voice signal based on the first voice zone; the maximum value of the second preset angle range is less than the minimum value of the first preset angle range; acquire the user's second voice signal based on a third voice zone, the third voice zone being an adjacent voice zone in the tilt direction of the first seat; and perform weighted fusion of the first voice signal and the second voice signal to obtain the voice interaction message.

[0097] Optionally, such as Figure 5 As shown, the device further includes: a parameter adjustment module 403, configured to adjust the first playback parameters of the voice response message to be played according to a preset parameter adjustment strategy to obtain a second playback parameter; the voice response message is the response message corresponding to the voice interaction message; the voice interaction module 402 is also configured to play the voice response message according to the second playback parameter.

[0098] Optionally, the preset parameter adjustment strategy includes at least one of the following: increasing the detection sensitivity of the voice wake-up command; reducing the noise suppression intensity; reducing the playback volume; appropriately extending the wake-up response delay; and increasing the audio acquisition priority corresponding to the target sound region.

[0099] Optionally, the voice interaction module 402 is further configured to control multiple audio acquisition devices in the target audio region to enter the sound pickup state; based on the multiple audio acquisition devices being in the sound pickup state, it receives the user's voice interaction messages acquired by the target audio acquisition device, wherein the target audio acquisition device is one of the multiple audio acquisition devices.

[0100] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0101] Figure 6 This is a schematic diagram illustrating the structure of a voice interaction system according to an exemplary embodiment, with reference to... Figure 6 The voice interaction system 600 may include: a seat posture perception layer 601, an intelligent decision control layer 602, and an audio execution layer 603. The seat posture perception layer 601 can determine the seat state of the vehicle based on angle sensors, pressure sensors, and backrest folding detection sensors. The intelligent decision control layer 602 can determine the combination strategy of multiple sound zones in the vehicle through a seat state recognition algorithm based on the trigger signal of the seat posture perception layer 601. The audio execution layer 603 can execute strategies such as microphone array reorganization, sound zone boundary division, and parameter adaptive adjustment based on the control commands of the intelligent decision control layer 602.

[0102] Regarding the system in the above embodiments, the specific manner in which each layer performs operations has been described in detail in the embodiments related to the method, and will not be elaborated here.

[0103] This disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the voice interaction method provided in this disclosure.

[0104] Figure 7 This is a block diagram illustrating a vehicle 700 according to an exemplary embodiment. For example, vehicle 700 can be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicle. Vehicle 700 can be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0105] Reference Figure 7 The vehicle 700 may include various subsystems, such as an infotainment system 710, a perception system 720, a decision control system 730, a drive system 740, and a computing platform 750. The vehicle 700 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the vehicle 700 can be interconnected via wired or wireless means.

[0106] In some embodiments, the infotainment system 710 may include a communication system, an entertainment system, and a navigation system, etc.

[0107] The perception system 720 may include several sensors for sensing information about the environment surrounding the vehicle 700. For example, the perception system 720 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0108] The decision control system 730 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0109] The drive system 740 may include components that provide powered motion to the vehicle 700. In one embodiment, the drive system 740 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0110] Some or all of the functions of vehicle 700 are controlled by computing platform 750. Computing platform 750 may include at least one processor 751 and memory 752, and processor 751 may execute instructions 753 stored in memory 752.

[0111] Processor 751 can be any conventional processor, such as a commercially available CPU. Processors may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems-on-chips (SoCs), application-specific integrated circuits (ASICs), or combinations thereof.

[0112] The memory 752 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0113] In addition to instruction 753, memory 752 can also store data, such as road maps, route information, vehicle position, direction, speed, and other data. The data stored in memory 752 can be used by computing platform 750.

[0114] In this embodiment of the disclosure, processor 751 may execute instruction 753 to complete all or part of the steps of the above-described voice interaction method.

[0115] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the above-described voice interaction method when executed by the programmable device.

[0116] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.

[0117] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”

[0118] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the accompanying drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”

[0119] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

[0120] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

[0121] In the above detailed description, reference has been made to the accompanying drawings, which illustrate specific aspects of this disclosure by way of illustration. In this regard, terms indicating direction or positional relationship, such as “center,” “longitudinal,” “lateral,” “length,” “width,” “thickness,” “upper,” “lower,” “front,” “rear,” “left,” “right,” “vertical,” “horizontal,” “top,” “bottom,” “inner,” “outer,” “clockwise,” “counterclockwise,” “axial,” “radial,” and “circumferential,” are used with reference to the orientation of the described figures. Since components of the described device can be positioned in multiple different orientations, directional terms are used for illustrative purposes and not for limitation. It should be understood that other aspects can be utilized and structural or logical changes can be made without departing from the concept of this disclosure. Therefore, the following detailed description should not be considered limiting.

[0122] It should be understood that, unless otherwise specifically indicated, features of various embodiments of this disclosure described herein can be combined with each other. As used herein, the term “and / or” includes any one of the relevant listed items and any combination of any two or more; similarly, “at least one of…” includes any one of the relevant listed items and any combination of any two or more.

[0123] It should be understood that, unless otherwise expressly specified and limited, the terms "joining," "attaching," "installing," "connecting," "linking," "fixing," etc., used in the embodiments of this disclosure should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection, an electrical connection, or a connection that allows communication between them; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise expressly limited. Those skilled in the art can understand the specific meaning of the above terms herein based on the specific circumstances.

[0124] Furthermore, the term "above" as used herein with respect to components, elements, or material layers formed or located "above" a surface may be used to indicate that the component, element, or material layer is "indirectly" positioned (e.g., placed, formed, deposited, etc.) on the surface such that one or more additional components, elements, or layers are arranged between the surface and the component, element, or material layer. However, the term "above" as used with respect to components, elements, or material layers formed or located "above" a surface may also optionally have a specific meaning: that the component, element, or material layer is "directly" positioned (e.g., placed, formed, deposited, etc.) on the surface, for example, in direct contact with the surface.

[0125] Although terms such as “first,” “second,” and “third” may be used herein to describe various components, parts, regions, layers, or sections, these components, parts, regions, layers, or sections are not limited to these terms. Rather, these terms are used only to distinguish one component, part, region, layer, or section from another. Therefore, without departing from the teachings of the examples described herein, the first component, part, region, layer, or section mentioned in the examples may also be referred to as the second component, part, region, layer, or section. Furthermore, the terms “first” and “second” are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as “first” or “second” may explicitly or implicitly include at least one of that feature. In the description herein, “a plurality” means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0126] It should be understood that spatial relative terms, such as “above,” “upper,” “below,” and “lower,” are used herein to describe the relationship between one element and another shown in the figures. In addition to the orientation depicted in the figures, these spatial relative terms are also intended to encompass different orientations of the device in use or operation. For example, if the device in the figures is flipped, an element described as “above” or “upper” relative to another element would be “below” or “lower” relative to that other element. Thus, depending on the spatial orientation of the device, the term “above” encompasses both above and below orientations. Devices may have other orientations (e.g., rotated 90 degrees or in other orientations), and the spatial relative terms used herein should be interpreted accordingly.

Claims

1. A method for voice interaction, characterized in that, include: In response to receiving a user's voice wake-up command, determine the seat status in the vehicle; In response to the seat state meeting preset state conditions, the user's voice interaction message is received based on the target voice zone; The target sound zone is obtained by combining multiple sound zones of the vehicle.

2. The method according to claim 1, characterized in that, The seat state includes the tilt angle of the seat back; the preset state conditions include: the tilt angle is within a first preset angle range; and / or, The seat state includes a seat mode; the preset state conditions include: the seat mode is in a first mode.

3. The method according to claim 2, characterized in that, The seat includes a first seat, which is the seat where the user is located; the target sound zone includes a first target sound zone, and the step of receiving the user's voice interaction message based on the target sound zone in response to the seat state satisfying a preset state condition includes: In response to the first seat's seat state meeting a preset state condition, the voice interaction message is received based on the first target voice region. The first target voice region is obtained by combining a first voice region and a second voice region. The first voice region is the voice region where the sound source of the voice wake-up command is located, and the second voice region is determined according to the first seat's seat state and the first voice region.

4. The method according to claim 3, characterized in that, The second sound zone is determined based on the seating position of the first seat and the first sound zone in the following manner: If the first sound range and the sound range corresponding to the seating area of ​​the first seat are different sound ranges, then the sound range corresponding to the seating area of ​​the first seat shall be used as the second sound range; or, If the first sound zone and the sound zone corresponding to the seating area of ​​the first seat are the same sound zone, the adjacent sound zone in the tilt direction of the first seat shall be used as the second sound zone.

5. The method according to claim 3, characterized in that, The seat further includes a second seat, which is at least one seat in the vehicle adjacent to the first seat; the target sound zone further includes a second target sound zone, and the step of receiving the user's voice interaction message based on the target sound zone in response to the seat state satisfying a preset state condition includes: In response to the fact that the seat states of the first seat and the second seat both meet the preset state conditions, the voice interaction message is received based on the second target sound zone; the second target sound zone is obtained by combining the first target sound zone and the third target sound zone, and the third target sound zone is obtained by combining the sound zone corresponding to the seating area of ​​the second seat and the adjacent sound zone in the tilt direction of the second seat.

6. The method according to claim 3, characterized in that, The target pitch region further includes a fourth target pitch region, and the method further includes: In response to the fact that multiple seats in the vehicle meet the preset state conditions, the voice interaction message is received based on the fourth target sound zone; the fourth target sound zone is a combination of at least three sound zones of the vehicle.

7. The method according to claim 3, characterized in that, The method further includes: In response to the tilt angle being within a second preset angle range, the user's first voice signal is acquired based on the first voice region; the maximum value of the second preset angle range is less than the minimum value of the first preset angle range; The user's second voice signal is collected based on the third voice zone, which is the adjacent voice zone in the tilt direction of the first seat; The first voice signal and the second voice signal are weighted and fused to obtain the voice interaction message.

8. The method according to claim 1, characterized in that, The method further includes: According to the preset parameter adjustment strategy, the first playback parameter of the voice response message to be played is adjusted to obtain the second playback parameter; the voice response message is the response message corresponding to the voice interaction message; The voice response message is played according to the second playback parameters.

9. The method according to claim 8, characterized in that, The preset parameter adjustment strategy includes at least one of the following: Improve the detection sensitivity of the voice wake-up command; Reduce noise suppression intensity; Lower the playback volume; Appropriately extend the wake-up response delay; Increase the audio acquisition priority corresponding to the target audio region.

10. The method according to any one of claims 1 to 9, characterized in that, The process of receiving the user's voice interaction messages based on the target voice region includes: Control multiple audio acquisition devices in the target sound region to enter the sound pickup state; Based on the fact that the plurality of audio acquisition devices are in the sound pickup state, the voice interaction messages of the user collected by the target audio acquisition device are received. The target audio acquisition device is one of the plurality of audio acquisition devices.

11. A voice interaction device, characterized in that, include: The voice wake-up module is configured to determine the seat status in the vehicle in response to receiving a user's voice wake-up command. The voice interaction module is configured to receive the user's voice interaction message based on the target voice zone in response to the seat state meeting preset state conditions; The target sound zone is obtained by combining multiple sound zones of the vehicle.

12. The apparatus according to claim 11, characterized in that, The seat state includes the tilt angle of the seat back; the preset state conditions include: the tilt angle is within a first preset angle range; and / or, The seat state includes a seat mode; the preset state conditions include: the seat mode is in a first mode.

13. The apparatus according to claim 12, characterized in that, The seat includes a first seat, which is the seat where the user is located; the target sound zone includes a first target sound zone; The voice interaction module is further configured to receive the voice interaction message based on the first target voice region in response to the first seat's seat state meeting a preset state condition. The first target voice region is obtained by combining a first voice region and a second voice region. The first voice region is the voice region where the sound source of the voice wake-up command is located, and the second voice region is determined according to the seat state of the first seat and the first voice region.

14. The apparatus according to claim 11, characterized in that, The device further includes: The parameter adjustment module is configured to adjust the first playback parameter of the voice response message to be played according to a preset parameter adjustment strategy to obtain the second playback parameter; the voice response message is the response message corresponding to the voice interaction message. The voice interaction module is also configured to play the voice response message according to the second playback parameters.

15. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to perform the steps of the method according to any one of claims 1-10.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the steps of the method according to any one of claims 1-10.

17. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the steps of the method described in any one of claims 1-10.

Images