Article interaction method and device, equipment, medium and product

Abstract

The invention provides an article interaction method and device, equipment, a medium and a product. The method is applied to an article interaction scene. The method comprises the following steps: in response to an article interaction request of an interaction object in an article interaction scene, performing first identity recognition processing on the interaction object through first identity recognition equipment, and obtaining target article storage equipment to which a target article of the article interaction request belongs based on first identity information; acquiring a first spatial position of the interaction object, and acquiring a second spatial position of the target article storage device; outputting a first indication audio based on the first spatial position and the second spatial position; and in response to the interaction object reaching the second spatial position, performing second identity recognition processing on the interaction object through second identity recognition equipment, and outputting a second indication audio based on the storage position. According to the method, multiple times of identity recognition are performed on the user, the user is guided to obtain the article through the audio, and the convenience and accuracy of the article taking process can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, device, medium and product for interacting with objects, specifically to a method for interacting with objects, a device for interacting with objects, a computer device, a computer-readable storage medium and a computer program product. Background Technology

[0002] In today's society, to improve the convenience of people's lives, a large number of self-service devices have been introduced, such as vending machines, parcel lockers, and fast food lockers. These devices greatly facilitate daily life; however, because they operate unmanned and self-service, users need to perform numerous operations (such as locating the device, scanning a code, and activating the device) before obtaining the desired items. Therefore, in the aforementioned scenarios involving vending machines, parcel lockers, and fast food lockers, the process of retrieving items is not always convenient for users. Summary of the Invention

[0003] This application provides a method, apparatus, device, medium, and product for item interaction, which can perform multiple identity verifications on users in item interaction scenarios and guide interactive objects to obtain items through audio, thereby improving the convenience and accuracy of interactive objects obtaining items.

[0004] On one hand, embodiments of this application provide an item interaction method applied to an item interaction scenario. The item interaction scenario includes a first identification device and at least one item storage device. The item storage device is used to store items, and each item storage device is equipped with a second identification device. The method includes:

[0005] In response to an item interaction request from an interactive object in an item interaction scenario, the interactive object is subjected to first identity recognition processing by a first identity recognition device to obtain the first identity information of the interactive object;

[0006] The target item storage device to which the target item in the item interaction request belongs is determined based on the first identity information;

[0007] Obtain the first spatial position of the interactive object in the item interaction scene, and obtain the second spatial position of the target item storage device in the item interaction scene;

[0008] Based on the first spatial location and the second spatial location, a first instruction audio is output; the first instruction audio is used to instruct the interactive object to reach the second spatial location to perform an operation to acquire the target item;

[0009] In response to the arrival of the interactive object at the second spatial location, the second identity recognition device in the target item storage device performs second identity recognition processing on the interactive object to verify the second identity information of the interactive object, and determines the storage location of the target item in the target item storage device based on the successfully verified second identity information;

[0010] A second instruction audio is output based on the storage location. The second instruction audio is used to instruct the interactive object to retrieve the target item from the storage location.

[0011] On one hand, embodiments of this application provide an item interaction device applied to an item interaction scenario. The item interaction scenario includes a first identification device and at least one item storage device. The item storage device is used to store items, and each item storage device is equipped with a second identification device. The device includes:

[0012] The processing unit is used to respond to the item interaction request of the interaction object in the item interaction scenario, and to perform first identity recognition processing on the interaction object through the first identity recognition device to obtain the first identity information of the interaction object;

[0013] The processing unit is also used to determine the target item storage device to which the target item of the item interaction request belongs based on the first identity information;

[0014] The acquisition unit is used to acquire the first spatial position of the interactive object in the item interaction scene and to acquire the second spatial position of the target item storage device in the item interaction scene;

[0015] The processing unit is further configured to output a first instruction audio based on the first spatial location and the second spatial location; the first instruction audio is used to instruct the interactive object to perform an acquisition operation on the target item when it reaches the second spatial location;

[0016] The processing unit is also configured to, in response to the interaction object arriving at the second spatial location, perform second identity recognition processing on the interaction object through the second identity recognition device in the target item storage device to verify the second identity information of the interaction object, and determine the storage location of the target item in the target item storage device based on the successfully verified second identity information;

[0017] The processing unit is also configured to output a second instruction audio based on the storage location, the second instruction audio being used to instruct the interactive object to retrieve the target item from the storage location.

[0018] In one possible implementation, the first identification device is equipped with a first ultrasonic array, which generates a first vibration area based on ultrasonic tactile technology for the interactive object to perceive through touch; the processing unit performs first identification processing on the interactive object in the object interaction scenario through the first identification device, for the following operations:

[0019] Within the first vibration area generated by the first identity recognition device, the first identity information of the interactive object is collected by the first identity recognition device.

[0020] The interaction object is processed for first identity recognition based on the first identity information to obtain the first recognition result of the interaction object; wherein, the first recognition result includes whether the first identity information of the interaction object is successfully recognized or not.

[0021] In one possible implementation, the processing unit performs a first identity recognition process on the interactive object based on the first identity information to obtain a first recognition result of the interactive object, which is then used to perform the following operations:

[0022] The first identity information is processed by feature extraction to obtain the biometric features of the interactive object;

[0023] Obtain the registration data of the interactive object. The registration data is generated after the interactive object successfully registers its identity in the item interaction scenario. The registration data includes the registration characteristics of the interactive object.

[0024] The biometric features and registration features of the interactive object are compared. If they are the same, the first identification result is used to indicate that the first identity information of the interactive object has been successfully identified.

[0025] In one possible implementation, when the first identification result is successful, the first identification result also includes the identity type of the interactive object; the processing unit is further configured to perform the following operations:

[0026] If the first identification result is used to indicate that the identity type of the interactive object is a preset type, then the target item storage device to which the target item to be obtained by the interactive object belongs is determined based on the first identity information;

[0027] If the first identification result indicates that the type of the interactive object is not a preset type, then the storage location of the target item to be obtained by the interactive object is determined based on the first identity information.

[0028] In one possible implementation, the first identity recognition device is a palm-scanning device equipped with a first ultrasonic array, and the first identity information includes the palm data of the interactive object; the processing unit performs feature extraction processing on the first identity information to obtain the biometric features of the interactive object, which are used to perform the following operations:

[0029] Palm vein extraction was performed on the palm data to obtain the palm vein features of the interactive object; and,

[0030] Palmprint extraction is performed on the palm data to obtain the palmprint features of the interactive object;

[0031] Feature fusion processing is performed on palm vein features and palm print features to obtain the biometric features of the interactive object;

[0032] The feature fusion processing includes at least one of the following: feature weighting processing, feature alignment processing, and feature operation processing.

[0033] In one possible implementation, an ultrasonic device array is deployed in the object interaction scenario. The ultrasonic device array includes N transmitting units and N receiving units. The transmitting units are used to emit ultrasonic signals in the object interaction scenario, and the receiving units are used to receive the ultrasonic signals emitted by the transmitting units. N is a positive integer. The acquisition unit acquires the first spatial position of the interactive object in the object interaction scenario and performs the following operations:

[0034] When an interactive object is detected in an object interaction scenario, the target emission unit associated with the interactive object is determined; the association includes: the distance between the target emission unit and the interactive object is less than a preset distance threshold.

[0035] Using a target transmitting unit, ultrasonic signals are sent in the object interaction scenario at preset time intervals;

[0036] Obtain K reception times for ultrasonic signals from K receiving units, where one receiving unit corresponds to one reception time, and K is a positive integer and K≤N;

[0037] Based on K reception times, the first spatial position of the interactive object in the item interaction scenario is calculated.

[0038] In one possible implementation, the processing unit outputs a first indicative audio based on a first spatial position and a second spatial position, for performing the following operations:

[0039] If the first spatial position is the same as the second spatial position, or if the distance between the first spatial position and the second spatial position is less than or equal to a preset threshold, then the first instruction audio is used to prompt the interactive object that it does not need to perform a movement operation, and triggers the execution of the second identity recognition processing of the interactive object through the second identity recognition device in the target item storage device;

[0040] If the distance between the first spatial position and the second spatial position is greater than a preset threshold, the movement path of the interactive object is determined based on the first spatial position and the second spatial position; and based on the movement path, an ultrasonic device array is used to output a first instruction audio around the interactive object; the first instruction audio is used to instruct the interactive object to move from the first spatial position to the second spatial position.

[0041] In one possible implementation, the processing unit, based on the movement path, uses an array of ultrasonic devices to output a first indicative audio signal around the interactive object for performing the following operations:

[0042] Based on the movement path, determine the movement instruction information of the interactive object;

[0043] Based on the movement indication information, the directional beamforming technology of the ultrasonic device array is used to output a first indication audio that matches the movement indication information within the auditory perception area of ​​the interactive object;

[0044] Among them, directional beamforming technology is used to indicate: during the movement of an interactive object, spatial audio in a specified direction is generated to instruct the interactive object to move its position in the specified direction.

[0045] In one possible implementation, the processing unit performs second identity recognition processing on the interactive object through a second identity recognition device in the target item storage device, for the purpose of performing the following operations:

[0046] The system receives the first identity information of the interactive object sent by the first identity recognition device, and based on the first identity information, performs second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device to obtain a second recognition result; or,

[0047] Within the second vibration area generated by the second identity recognition device, the second identity information of the interactive object is collected by the second identity recognition device, and based on the collected second identity information, the second identity recognition device performs second identity recognition processing on the interactive object to obtain the second recognition result;

[0048] The second identity recognition device is equipped with a second ultrasonic array, which generates a second vibration area based on ultrasonic tactile technology for the interactive object to perceive touch.

[0049] In one possible implementation, the second identity recognition device is a voiceprint recognition device, and the second recognition result is used to indicate whether the verification of the identity information of the interactive object was successful or failed; the processing unit performs second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device, and is also used to perform the following operations:

[0050] Based on voiceprint recognition equipment, voiceprint data generated by interactive objects is collected;

[0051] Feature extraction is performed on the voiceprint data to obtain the first voiceprint feature of the interactive object;

[0052] Obtain the registration data of the interactive object, which includes the second voiceprint feature that the interactive object has registered in the item interaction scenario;

[0053] If the first voiceprint feature is the same as the second voiceprint feature, then the identity information of the interactive object is successfully verified.

[0054] In one possible implementation, an array of ultrasonic devices is deployed in the object interaction scenario; the processing unit outputs a second instruction audio based on the storage location to perform the following operations:

[0055] If the second identification result is used to indicate that the identity information of the interactive object has been successfully verified, then the operation instructions of the interactive object are determined based on the storage location and the second spatial location of the interactive object.

[0056] According to the operation instructions, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation instructions within the auditory perception area of ​​the interactive object.

[0057] In one possible implementation, the processing unit is also used to perform the following operations:

[0058] Obtain the attribute information of the interactive object, which includes one or more of the following: the interactive object's height and age;

[0059] Based on attribute information, determine the auditory perception area of ​​the interactive object;

[0060] According to the operation instructions, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation instructions within the auditory perception area of ​​the interactive object.

[0061] On one hand, embodiments of this application provide a computer device, which includes a processor and a memory; the memory stores a computer program; when the computer program is executed by the processor, it performs the above-mentioned item interaction method.

[0062] On one hand, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the aforementioned item interaction method.

[0063] On the one hand, embodiments of this application provide a computer program product, which includes a computer program. When the computer program is executed by a processor, it performs the above-mentioned item interaction method.

[0064] In this embodiment, a first identity recognition device and at least one item storage device are provided in the item interaction scenario. The item storage device is used to store items, and each item storage device is equipped with a second identity recognition device. During the item acquisition process, in response to the item interaction request from the exchange object in the item interaction scenario, the first identity recognition device performs a first identity recognition process on the interaction object. This first identity recognition process is used to identify the first identity information of the interaction object and determine the target item storage device to which the target item of the item interaction request belongs based on the first identity information. The first spatial position of the interaction object in the item interaction scenario is obtained, and the second spatial position of the target item storage device in the item interaction scenario is obtained. Based on the first and second spatial positions, a first instruction audio is output, which is used to instruct the interaction object to go to the second spatial position to perform the acquisition operation of the target item. Further, in response to the interaction object going to the second spatial position, the second identity recognition device in the target item storage device performs a second identity recognition process on the interaction object to verify the second identity information of the interaction object, and determines the storage position of the target item in the target item storage device based on the successfully verified second identity information. Based on the storage position, a second instruction audio is output, which is used to instruct the interaction object to acquire the target item from the storage position. As can be seen above, during the process of an interactive object acquiring an item, the interactive object can undergo an initial identification process via a first identification device. When the interactive object reaches the location of the target item storage device, a second identification process can be performed to re-verify the interactive object's identity information. This method of performing multiple identification processes on the interactive object can improve the accuracy and reliability of identity verification. In addition, during the process of an interactive object acquiring an item, the movement of the interactive object can be guided by instruction audio (such as the first instruction audio and the second instruction audio). This method helps the interactive object to acquire the required target item more accurately and conveniently, thereby improving the convenience and accuracy of the interactive object acquiring the item. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1 This is a schematic diagram illustrating the principle of an item interaction scheme provided in an embodiment of this application;

[0067] Figure 2 This is a schematic diagram of an item interaction scenario provided in an embodiment of this application;

[0068] Figure 3 This is a schematic diagram of the architecture of an item interaction system provided in an embodiment of this application;

[0069] Figure 4 This is a flowchart illustrating an item interaction method provided in an embodiment of this application;

[0070] Figure 5 This is a schematic diagram of a palm-swiping device provided in an embodiment of this application;

[0071] Figure 6 This is a schematic diagram of a movement path provided in an embodiment of this application;

[0072] Figure 7 This is a flowchart illustrating another item interaction method provided in an embodiment of this application;

[0073] Figure 8a This is a flowchart illustrating an ultrasonic positioning technology provided in an embodiment of this application;

[0074] Figure 8b This is a schematic diagram illustrating the design principle of a piezoelectric ultrasonic transducer provided in an embodiment of this application;

[0075] Figure 8c This is a schematic diagram illustrating the working principle of a piezoelectric ultrasonic transducer provided in an embodiment of this application;

[0076] Figure 9a This is a schematic diagram of a directional sound field for indicating audio provided in an embodiment of this application;

[0077] Figure 9b This is a schematic diagram of a directional spatial audio provided in an embodiment of this application;

[0078] Figure 10 This is a schematic diagram of a palm recognition process provided in an embodiment of this application;

[0079] Figure 11 This is a schematic diagram of a process for obtaining a target item provided in an embodiment of this application;

[0080] Figure 12 This is a schematic diagram of the structure of an item interaction device provided in an embodiment of this application;

[0081] Figure 13 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0082] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0083] This application provides an item interaction solution, mainly involving a convenient and accurate method for obtaining (or storing) items in item interaction scenarios (such as parcel locker pickup, food delivery locker pickup, or vending machine purchase). This item interaction scenario includes a first identification device and at least one item storage device. Each item storage device is equipped with a second identification device. This solution can perform multiple identifications of the user (interaction object) in the item interaction scenario and guide the user's location movement through audio prompts during item retrieval, enabling the user to obtain the desired item more conveniently and accurately. For details, please refer to [link to relevant documentation]. Figure 1 , Figure 1 This is a schematic diagram illustrating the principle of an item interaction scheme provided in an embodiment of this application. The following is in conjunction with... Figure 1 The principle of the item interaction scheme provided in this application is briefly explained as follows:

[0084] (1) When an interactive object is detected in an item interaction scenario (e.g., the interactive object enters the room where the express delivery locker is located in a parcel locker pickup scenario), in response to the interactive object's item interaction request, a first identity recognition device can be used to perform first identity recognition processing on the interactive object in the item interaction scenario. Here, the first identity recognition processing is used to identify the first identity information of the interactive object and determine the target item storage device to which the target item to be obtained by the interactive object belongs based on the first identity information. For example, the first identity recognition device can be a palm recognition device, then the first identity recognition device can perform first identity recognition processing on the interactive object through a palm recognition method (e.g., an air haptic guided palm recognition method); if the identity recognition of the interactive object is successful, the target item storage device to which the target item to be obtained by the current interactive object belongs can be determined from at least one item storage device based on the successfully identified first identity information.

[0085] (2) Obtain the first spatial position of the interactive object in the item interaction scene, and obtain the second spatial position of the target item storage device in the item interaction scene. Optionally, the positions of the interactive object and the target item storage device can be detected separately by an ultrasonic device array deployed in the item interaction scene.

[0086] (3) In the object interaction scenario, the ultrasonic guidance system is activated, and based on the first spatial position and the second spatial position, the first instruction audio is output around the interactive object. The first instruction audio is used to instruct the interactive object to perform the acquisition operation of the target object when it reaches the second spatial position. For example, the first instruction audio can be used to instruct the interactive object to move from the first spatial position to the second spatial position, that is, to guide the user to move the position through directional audio.

[0087] (4) In response to the interactive object arriving at the second spatial location, the interactive object is subjected to second identity recognition processing by the second identity recognition device in the target item storage device. The second identity recognition processing here is used to verify the second identity information of the interactive object and determine the storage location of the target item in the target item storage device based on the successfully verified second identity information. For example, the second identity recognition device can also be a palm recognition device. Similarly, the second identity recognition device can perform second identity recognition processing on the interactive object by palm recognition method (e.g., air tactile guided palm recognition method). If the identity verification of the interactive object is successful, the cabinet door (the cabinet door located at the storage location) in the target item storage device for storing the target item is opened.

[0088] (5) Based on the storage location, a second instruction audio can be output around the interactive object, that is, the interactive object can be guided to obtain the target item from the storage location through directional audio.

[0089] Based on this, in the above-mentioned item interaction scheme, on the one hand, this application supports first identity recognition processing of the user through a first identity recognition device, and when the user arrives at the location of the target item storage device to be retrieved, the user is again recognized through a second identity recognition device in the target item storage device. Since the user is recognized twice during the above-mentioned item retrieval process, the accuracy and reliability of identity recognition can be improved. On the other hand, during the process of the interactive object retrieving the item, the interactive object can be guided to move its position through directional audio (such as first instruction audio and second instruction audio). This method helps the interactive object to obtain the required target item more accurately and conveniently, thereby improving the convenience and accuracy of the interactive object in retrieving the item.

[0090] The key technical terms involved in the embodiments of this application are explained below.

[0091] I. Item Interaction Scenarios.

[0092] Item interaction scenarios, as the name suggests, refer to scenarios where interactive objects interact with items. This interaction can include acquisition, storage, exchange, and other interaction methods. Item interaction scenarios can also be self-service interaction scenarios, where the interactive object autonomously performs item interaction processing, such as autonomously acquiring or storing items. For example, item interaction scenarios can include, but are not limited to, scenarios such as retrieving packages from parcel lockers, retrieving food from delivery lockers, or purchasing items from vending machines. Different types of item interaction scenarios involve different items; for example, parcel locker retrieval scenarios mainly involve interacting with parcels, food delivery locker retrieval scenarios mainly involve interacting with food items, and vending machine scenarios mainly involve interacting with merchandise.

[0093] Please see Figure 2 , Figure 2 This is a schematic diagram of an item interaction scenario provided in an embodiment of this application. For example... Figure 2 As shown, this item interaction scenario includes a first identity recognition device and at least one item storage device (such as item storage device 1 and item storage device 2). Each item storage device is used to store items, and each item storage device is equipped with a second identity recognition device. The types of the item storage devices in the item interaction scenario can be the same or different. For example, item storage device 1 can be a parcel locker, and item storage device 2 can be a food pickup locker; or both item storage devices 1 and 2 can be parcel lockers. Furthermore, the first identity recognition device is used to perform first identity recognition processing on the interactive object, and the second identity recognition device is used to perform second identity recognition processing on the interactive object. The device types of the first and second identity recognition devices can be the same or different. For example, both the first and second identity recognition devices can be palm recognition devices, or the first identity recognition device can be a palm recognition device, and the second identity recognition device can be a voiceprint recognition device, etc. Optionally, the first identification device is usually set in a designated location in the object interaction scenario (such as the doorway of a room, such as the right side of the door) so that it can be easily recognized by the general public; the specific location of the second identification device in each object storage device can be any location or a designated location (such as the center location, top location, bottom location, etc.).

[0094] II. First identity recognition processing and second identity recognition processing.

[0095] The first identity recognition process refers to the identity recognition process performed on the interactive object by a first identity recognition device. This first identity recognition process is used to identify the first identity information of the interactive object. The result of the first identity recognition process (i.e., the first recognition result) can be recognition success or recognition failure. If the identity information of the interactive object is successfully recognized, it means that the current interactive object has items stored in the item interaction scenario; if the identity information of the interactive object fails to be recognized, it means that the current interactive object does not have items stored in the item interaction scenario. Optionally, the first identity recognition process is also used to identify the identity type of the interactive object. The identity type here includes: preset type and non-preset type. For example, the preset type is visually impaired type, where a visually impaired interactive object refers to an interactive object with a visual impairment, and a non-preset type interactive object refers to an interactive object without a visual impairment.

[0096] Second identity recognition processing refers to the identity recognition processing performed on the interactive object through a second identity recognition device. The second identity recognition processing here is used to verify the second identity information of the interactive object. The result of the second identity recognition processing (i.e., the second recognition result) can also be recognition success or recognition failure. If the second identity information of the interactive object is successfully recognized, it means that the second identity information of the current interactive object has been verified. If the second identity information of the interactive object fails to be recognized, it means that the second identity information of the current interactive object has not been verified.

[0097] Based on this, both the first and second identity recognition processes aim to identify the user's identity information. However, the functions of the first and second identity recognition processes differ: the first identity recognition process primarily aims to identify whether the interactive object already contains a stored item in the current item interaction scenario, and whether the current interactive object is a preset type of interactive object (such as a visually impaired interactive object); the second identity recognition process primarily aims to re-identify (i.e., authenticate) the currently interacting object that has successfully undergone the first identity recognition, in order to determine the storage location of the target item to be retrieved by the interactive object from the target item storage device. Therefore, this application employs two identity recognition processes, which can improve the reliability of identity recognition.

[0098] III. First instruction audio, second instruction audio.

[0099] The first instruction audio signal is an audio signal used to instruct the interactive object to move from a first spatial position to a second spatial position. The first spatial position refers to the current position of the interactive object in the item interaction scenario, typically the area surrounding the first identification device. The second spatial position refers to the location of the target item storage device, to which the interactive object belongs, within the item interaction scenario. The first instruction audio signal guides the interactive object from its surrounding area (first spatial position) to the target item storage device, facilitating the subsequent retrieval of the target item from the storage device. For example, the first instruction audio signal could be: "Turn left xx steps -> Go straight xx steps -> Turn right xx steps."

[0100] The second instruction audio refers to the audio signal used to instruct the interactive object to retrieve the target item from the storage location. In other words, the second instruction audio guides the interactive object to retrieve the target item from the target item storage device. Typically, during the process from the interactive object reaching the second spatial location until retrieving the target item, since it has already reached the vicinity of the target item's storage device, the interactive object does not need to move much. Therefore, the corpus (specific instruction information) of the second instruction audio may differ from that of the first instruction audio. For example, the second instruction audio could be located at the top of the head or the left hand position, etc.

[0101] IV. Directional Spatial Audio.

[0102] In this application, both the first and second instruction audio can be directional spatial audio, which refers to spatial audio with directionality. In item interaction scenarios (especially for visually impaired users retrieving items), directional spatial audio can precisely control the direction of sound propagation, allowing users to perceive sound from a target location (such as the storage location of the target item) and guiding them to the correct retrieval location. This directionality of sound not only improves navigation accuracy but also reduces noise interference from the surrounding environment, accurately guiding users to the designated location to retrieve the target item. Specifically, the first and second instruction audio, when used as directional spatial audio, mainly involve the following technologies:

[0103] 1. Ultrasonic directional acoustic technology:

[0104] Principle: Ultrasonic waves have a short wavelength and are highly directional. By modulating high-frequency ultrasonic waves to carry low-frequency audible sound, ultrasonic directional sound technology allows sound to propagate like a "beam," making the sound audible only in a specific direction. This technology allows sound to propagate along a specific path or area, guiding the interacting object (such as a visually impaired user) to move along the direction of the sound and ultimately reach the target location.

[0105] Application scenario: When retrieving items, visually impaired users can perceive the direction of sounds (such as the first and second instruction audio signals) through hearing and move accordingly. Because sound is highly directional, it can only be heard in a specific direction, thus enabling precise navigation.

[0106] 2.3D audio rendering and spatial sound effects:

[0107] Principle: Through 3D audio rendering technology, virtual sound sources can be created in different spatial locations to simulate sounds in a real environment. Utilizing the principles of stereo or surround sound, the phase, loudness, and direction of the sound can be adjusted according to the user's spatial location, making the user feel that the sound is coming from a specific location.

[0108] Application scenario: When guiding visually impaired users to retrieve target items, a virtual sound source (such as the location of a parcel locker) can be created in the direction the visually impaired user is moving. The user can perceive this location in the item interaction scenario by hearing the sound and move to the target location to retrieve the item by following the sound.

[0109] 3. Acoustic arrays and beamforming:

[0110] Principle: Beamforming uses multiple speakers to emit precisely controlled sound waves, causing them to interfere and superimpose in a specific direction to form a sound "beam," thus focusing the sound in a particular direction. By adjusting the beamforming direction, the sound can be directed to different areas within the object interaction scene, rather than spreading across the entire space.

[0111] Application scenario: During the process of visually impaired users retrieving items, beamforming technology can be used to direct the direction of sound propagation towards the target location, allowing users to perceive direction and navigate accurately based on the direction of the sound.

[0112] In addition, the following two points should be specifically noted regarding the item interaction scheme provided in this application:

[0113] 1. This application involves relevant data during item interaction (such as the primary and secondary identity information of the interacting object, and the storage location of the target item, etc.). When the above embodiments of this application are applied to specific products or technologies, permission or consent from the interacting object is required, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the region, conforming to the principles of legality, legitimacy, and necessity, and not involving the acquisition of data types prohibited or restricted by laws and regulations. In some optional embodiments, the relevant data involved in the embodiments of this application is obtained after separate authorization from the interacting object. In addition, when obtaining separate authorization from the interacting object, the purpose of the relevant data is explained to the interacting object.

[0114] 2. In this application, the term "at least one" refers to one or more items, and "multiple" means two or more items; for example, "at least one item storage device" refers to one, two, or more item storage devices. The terms "first," "second," etc., are used to distinguish identical or similar items with substantially the same function, and there is no logical or temporal dependency between "first," "second," or "nth," nor is there any limitation on quantity or execution order.

[0115] The following is a detailed description of the item interaction system provided in this application.

[0116] Please see Figure 3 , Figure 3 This is a schematic diagram of the architecture of an item interaction system provided in an embodiment of this application. Figure 3 As shown, the item interaction system refers to the backend processing system for item interaction scenarios (such as parcel locker pickup, food delivery locker pickup, or vending machine scenarios). The architecture diagram of this item interaction system may include at least: server 304, first identity recognition device 301, second identity recognition device 302, and second identity recognition device 303. The number of second identity recognition devices is not specifically limited and can be flexibly changed according to different item interaction scenarios. The first identity recognition device and at least one second identity recognition device 302 can be directly or indirectly connected to server 304 via a network. The network may include, but is not limited to, wired networks and wireless networks. The wired network includes local area networks (LANs), metropolitan area networks (MANs), and wide area networks (WANs). The wireless network includes Bluetooth, Wi-Fi (Wireless Fidelity, a standard wireless LAN), and other networks that enable wireless communication.

[0117] The first identity recognition device 301 and the second identity recognition device 302 can be terminal devices with identity recognition functions. For example, a terminal device can be: a palm recognition device, a fingerprint recognition device, a voiceprint recognition device, a mobile phone, a tablet computer, a laptop computer, a desktop computer, a gaming device, an in-vehicle device, an aircraft, a wearable device (such as a smartwatch, smart bracelet, pedometer, etc.), a virtual reality device (such as a VR (Virtual Reality) device, an AR (Augmented Reality) device), etc., any type of device with identity recognition functions. It is understood that the first identity recognition device 301 and the second identity recognition device 302 may be of the same or different device types. For example, the first identity recognition device 301 can be a palm recognition device, and the second identity recognition device 302 can be a voiceprint recognition device; or both the first identity recognition device 301 and the second identity recognition device 302 can be palm recognition devices. This application does not limit the number or type of identity recognition devices.

[0118] Server 304 can be a standalone physical server; server 304 can also be a server cluster or distributed system composed of multiple physical servers; server 304 can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0119] Next, we will illustrate the data interaction process between devices in an object interaction scenario with an example:

[0120] ① In an item interaction scenario (such as a parcel locker pickup scenario, assuming the parcel locker scenario includes two parcel lockers: parcel locker 1 and parcel locker 2), environmental detection can be performed on the item interaction scenario. When the interaction object is detected to have entered the room area where the parcel locker is located, the interaction object can be processed by the first identity recognition device 301 (such as a palm-swiping device). The first identity recognition process is used to identify the identity information of the interaction object and determine the target item storage device (such as parcel locker 1) to which the target item to be retrieved belongs based on the identity information.

[0121] ② Server 304 may be equipped with an ultrasonic device array, and the ultrasonic device array can be used to perform environmental detection on the object interaction scene in order to obtain the first spatial position of the interactive object in the object interaction scene and the second spatial position of the target object storage device (such as express cabinet 1) in the object interaction scene.

[0122] ③ Server 304 outputs a first instruction audio based on the first spatial position and the second spatial position. The first instruction audio is used to instruct the interactive object to move from the first spatial position to the second spatial position.

[0123] ④ When the server 304 detects that the interactive object has arrived at the second spatial location, it performs second identity recognition processing on the current interactive object through the second identity recognition device in the target item storage device; the second identity recognition processing here is used to verify the identity information of the interactive object and determine the storage location of the target item in the target item storage device based on the verified identity information (such as the specific cabinet door location of the target item in the express cabinet 1).

[0124] ⑤ Server 304 outputs a second instruction audio based on the storage location. This second instruction audio is used to instruct the interactive object to retrieve the target item from the storage location.

[0125] It should be noted that the number of devices may vary depending on the specific item interaction scenario. For example, in a parcel locker pickup scenario, there are two item storage devices, so the number of second identification devices is 2. Conversely, in a food delivery locker pickup scenario, there is one item storage device, so the number of second identification devices is 1. Therefore, the above item interaction process is for illustrative purposes only and does not limit the specific execution process between devices. Optionally, a separate location detection device can acquire the first and second spatial locations, and then send these locations to the server. The server then executes the process of outputting a first instruction audio based on the first and second spatial locations. Alternatively, the complete item interaction process described above can be executed solely by the server.

[0126] In one possible implementation, the item interaction system provided in this application embodiment can be deployed on blockchain node devices. For example, the first identity recognition device 301, the second identity recognition device 302, and the server 304 in the above system can all be treated as blockchain node devices, jointly forming a blockchain network. Therefore, the item interaction process executed in this application embodiment can be executed on the blockchain, which can ensure the fairness and impartiality of the item interaction process, make the above item process traceable, and ensure data security during the item interaction process, thereby improving the security and reliability of the entire item interaction process.

[0127] Based on the item interaction system provided in this application embodiment, a convenient and accurate solution for interactive objects to obtain items in item interaction scenarios can be provided. On the one hand, this application embodiment supports first identity recognition processing of users through a first identity recognition device, and when the user arrives at the location of the target item storage device to be retrieved, the user is again identified through a second identity recognition device in the target item storage device. Since the user is identified twice during the above item acquisition process, the accuracy and reliability of identity recognition can be improved. On the other hand, during the process of interactive objects obtaining items, directional audio (such as first instruction audio and second instruction audio) can guide the interactive objects to move their positions. This method helps interactive objects to obtain the required target items more accurately and conveniently, thereby improving the convenience and accuracy of interactive objects obtaining items.

[0128] It is understood that the item interaction system described in the embodiments of this application is for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and does not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0129] The specific embodiments of the item interaction scheme of this application will be described in detail below with reference to the accompanying drawings.

[0130] Please see Figure 4 , Figure 4 This is a flowchart illustrating an item interaction method provided in an embodiment of this application. This item interaction method can be implemented using a computer device (such as...). Figure 3 The method is executed by any terminal device or server shown, and is applied to item interaction scenarios (such as parcel locker pickup, food delivery locker pickup, or large self-service equipment scenarios like vending machines). These item interaction scenarios include a first identification device and at least one item storage device. The item storage device stores items, and each item storage device is equipped with a second identification device. Figure 4 As shown, the item interaction method includes, but is not limited to, the following steps S401-S406:

[0131] S401: In response to an item interaction request from an interactive object in an item interaction scenario, the first identity recognition device performs first identity recognition processing on the interactive object to obtain the first identity information of the interactive object.

[0132] Among them, an item interaction request refers to a request made by an interaction object to indicate the acquisition of a target item. For example, the item interaction request may contain an identifier of the target item that the interaction object requests to acquire, or the item interaction request may include request information of the target item that the interaction object requests to acquire.

[0133] In specific implementation, the first identity recognition device is used to identify the first identity information of the interaction object. Here, the interaction object refers to an object (such as a user) used to perform interactive operations on an item. These interactive operations include: retrieval operations or storage operations. A retrieval operation refers to the user retrieving an item from an item storage device (e.g., picking up a package), and a storage operation refers to the user storing an item in a storage device (e.g., storing a package). Specifically, the item interaction scenario may include at least one interaction object (such as a user). The interaction object identified by the first identity recognition device can be any one of the at least one interaction objects (i.e., any user) or a specified interaction object (a specified user). The specified interaction object can be an interaction object located at a specified spatial location, such as the spatial location where the first identity recognition device is located. Optionally, in this embodiment, the first identity recognition device can be set at any location or a specified location (such as a doorway) in the item interaction scenario to ensure it is easily recognized by many users.

[0134] The process of first identity recognition is explained in detail below.

[0135] Specifically, the first identity recognition device is used to identify the identity information of the interactive object. For example, the first identity recognition device can identify the interactive object based on visual perception methods (such as facial recognition, iris recognition, etc.) or based on non-visual perception methods (such as palm recognition, fingerprint recognition, voiceprint recognition, etc.). In this embodiment of the application, the first identity recognition device mainly involves identifying the interactive object using non-visual perception methods. The non-visual perception method identity recognition process mainly includes any type of palm recognition process or voiceprint recognition process. The following is a detailed description of several different recognition processes using non-visual perception methods.

[0136] I. Palm recognition processing.

[0137] In one possible implementation, the first identification device incorporates a first ultrasonic array that generates a first vibration area based on ultrasonic tactile technology for tactile perception by the interacting object. See also... Figure 5 , Figure 5 This is a schematic diagram illustrating the principle of a palm-swiping device provided in an embodiment of this application. Figure 5 As shown, the first identity recognition device can be Figure 5 The palm-scanning device shown in Figure (a) can be, for example, a palm print and palm vein acquisition device; such as... Figure 5 As shown in Figure (b), the palm-swiping device is equipped with a first ultrasonic array, which consists of multiple transmitters and multiple receivers. The transmitters are used to emit ultrasonic signals, and the receivers are used to receive the ultrasonic signals emitted by the transmitters. The ultrasonic signals are as follows: Figure 5 As shown in Figure (c); further, as Figure 5 As shown in Figure (d), the palm brush device can generate a first vibration area in the object interaction scenario by emitting ultrasonic signals through the first ultrasonic array. The first vibration area is used for the interactive object to perform tactile perception. That is, when the interactive object puts its palm into the first vibration area, it can perceive the tactile sensation generated by the sound wave pressure.

[0138] Specifically, the computer device performs first identity recognition processing on the interactive objects in the object interaction scenario through the first identity recognition device, mainly including the following steps (1)-(2):

[0139] (1) Within the first vibration area generated by the first identity recognition device, the first identity information of the interactive object is collected by the first identity recognition device. For example, the first identity recognition device can be any one of: a palm recognition device, a fingerprint recognition device, or a voiceprint recognition device. Wherein, if the first identity recognition device is a palm recognition device, the collected first identity information includes the palm data of the interactive object; if the first identity recognition device is a fingerprint recognition device, the collected first identity information includes the fingerprint data of the interactive object; if the first identity recognition device is a voiceprint recognition device, the collected first identity information includes the voiceprint data of the interactive object.

[0140] (2) Perform first identity recognition processing on the interactive object based on the first identity information to obtain the first recognition result of the interactive object; the first recognition result includes whether the first identity information of the interactive object is successfully recognized or not.

[0141] Optionally, the first identity recognition processing of the interactive object based on the first identity information can specifically include the following two methods: Method 1: Directly perform first identity recognition processing on the interactive object based on the collected first identity information; Method 2: Preprocess the collected first identity information and then perform first identity recognition processing on the preprocessed first identity information. The preprocessing here includes data cleaning, data completion, data correction, data optimization, and other processing methods, aiming to optimize the first identity information to improve the accuracy and effectiveness of identity recognition. For example, if the first identity information is palm data, and the palm data includes at least one collected palm image, then the preprocessing performed on the palm data includes any one or more of the following: image grayscale processing, image denoising processing, image enhancement processing, image size transformation processing, etc.

[0142] In specific implementation, the computer device performs first identity recognition processing on the interactive object based on the first identity information to obtain the first recognition result of the interactive object, including the following steps ①-③:

[0143] ① The first identity information is processed by feature extraction to obtain the biometric features of the interactive object. For example, if the first identity recognition device is a palm-scanning device equipped with a first ultrasonic array, the feature extraction process for the first identity information is as follows: palm vein extraction is performed on the palm data to obtain the palm vein features of the interactive object; and palmprint extraction is performed on the palm data to obtain the palmprint features of the interactive object. Specifically, a first feature extraction model can be used to extract the palmprint features of the interactive object, and a second feature extraction model can be used to extract the palm vein features of the interactive object. The first and second feature extraction models can be the same or different. For example, the first or second feature extraction model can be a neural network model. The neural network model can include, but is not limited to, CNN (Convolutional Neural Networks), RNN (Recurrent Neural Networks), LSTM (Long Short Term Memory), GRU (Gated Recurrent Units), etc. This application does not specifically limit the model structure of the neural network model. Furthermore, feature fusion processing is performed on the palm vein and palm print features to obtain the biometric features of the interacting object. These biometric features include, but are not limited to, any one or more of the following: primary texture features, secondary texture features, texture bifurcation features, and texture width. The feature fusion processing includes at least one of the following: feature weighting, feature alignment, and feature operation (such as feature alignment, summation, averaging, etc.). In this palm recognition process, fusing the user's palm print and palm vein features improves the comprehensiveness and accuracy of the extracted biometric features.

[0144] ② Obtain the registration data of the interactive object. This registration data is generated after the interactive object successfully registers its identity in the item interaction scenario. The registration data includes the registration characteristics of the interactive object. These registration characteristics may include one or more of the following: user-registered palm features, fingerprint features, voiceprint features, etc.

[0145] ③ Compare the biometric features and registration features of the interactive object. If they are the same, the first identification result indicates that the first identity information of the interactive object has been successfully identified. Optionally, during the comparison of the user's biometric features and registration features, a similarity algorithm (such as cosine similarity algorithm, Euclidean distance algorithm, Pearson correlation coefficient, etc.) can be used to calculate the feature similarity between the biometric features and registration features. If the feature similarity is greater than or equal to the similarity threshold, it indicates that the two features are the same, that is, the first identification result is successful identification; conversely, if the feature similarity is less than the similarity threshold, it indicates that the two features are different, that is, the first identification result is unsuccessful identification.

[0146] In the first identity recognition process shown in steps (1)-(2) above, this application can provide a vibration area for the user to perceive through touch, and obtain the recognition result by recognizing the user through touch perception. This tactile perception-based identity recognition method is convenient to operate and is beneficial for convenient and effective identity recognition processing for special groups (such as visually impaired users).

[0147] II. Voiceprint Recognition Process.

[0148] In one possible implementation, the first identity recognition device is a voiceprint recognition device that supports voiceprint recognition according to preset instructions. Specifically, the computer device performs first identity recognition processing on the interactive object in the object interaction scenario through the first identity recognition device, including steps (1)-(3):

[0149] (1) Collect voiceprint data of interactive objects through voiceprint recognition devices.

[0150] (2) Preprocess the voiceprint data to obtain preprocessed voiceprint data; the preprocessing here includes, but is not limited to: audio alignment, audio correction, audio optimization and other processing methods.

[0151] (3) Extract features from the preprocessed voiceprint data to obtain the voiceprint features of the interactive object, and perform first identity recognition processing on the interactive object based on the voiceprint features to obtain the first recognition result of the interactive object; the first recognition result includes whether the first identity information of the interactive object is successfully recognized or not.

[0152] In the first identity recognition process shown in steps (1)-(3) above, this application can recognize users through audio perception, allowing users to speak preset voiceprint commands, and perform voice recognition processing on interactive objects by comparing the voiceprint features at the time of user registration with the voiceprint features extracted in real time. This audio perception-based identity recognition method is convenient to operate and is also beneficial for convenient and effective identity recognition processing for special groups (such as visually impaired users).

[0153] In one possible implementation, when the result of the first identity recognition process (i.e., the first recognition result) is successful, the first recognition result also includes the identity type of the interactive object. The computer device can determine the subsequent execution steps (1)-(2) for the interactive object based on the identity type:

[0154] (1) If the first identification result indicates that the identity type of the interactive object is a preset type (such as visual impairment type), the target item storage device to which the target item to be retrieved belongs can be determined based on the first identity information. That is, the current interactive object is identified as a visually impaired interactive object through the first identity recognition device. Since the visually impaired interactive object cannot clearly know how to retrieve the item, the target item storage device to be retrieved can be determined based on the specific identity information (such as identity identifier) ​​of the current interactive object, so as to guide the interactive object to retrieve the item.

[0155] (2) If the first identification result indicates that the type of the interactive object is not a preset type, then the storage location of the target item to be obtained by the interactive object is determined based on the first identity information. For example, if the current interactive object is a non-visually impaired interactive object, since the interactive object can easily pick up the item on its own, then the interactive object can directly obtain the target item from the target item storage device.

[0156] In the implementation of steps (1)-(2) above, the first identity recognition process can also be used to identify the identity type of the interactive object, thereby triggering the execution of the subsequent process of guiding the visually impaired user on how to pick up the package for the preset type of interactive object (such as a visually impaired interactive object or a visually impaired user), which is conducive to the convenient pickup of the package by the visually impaired user.

[0157] S402: Determine the target item storage device to which the target item of the item interaction request belongs based on the first identity information.

[0158] Specifically, if the first identification result performed on the interactive object by the first identity recognition device is successful, the step of determining the target item storage device to which the target item of the item interaction request belongs based on the first identity information of the interactive object can be triggered.

[0159] In one possible implementation, determining the target item storage device to which the target item in the item interaction request belongs based on the first identity information can include the following two methods: Method 1: Directly determine the target item storage device based on the first identity information of the interaction object (such as ID, name, etc.); Method 2: Determine the target item storage device based on at least one piece of associated information of the interaction object. Associated information refers to information related to the interaction object, such as: purchase details of the target item purchased by the interaction object on the item interaction platform (item name, purchase time, purchase link, etc.), logistics information of the target item (such as tracking number), etc. In practical applications, different methods can be selected to determine the target item storage device to which the target item belongs, depending on the requirements.

[0160] For example, the process by which a computer device determines the target item storage device to which an interactive object belongs based on its identity information is as follows: It retrieves the storage database corresponding to the item interaction scenario and determines the target item storage device based on the interactive object's identity information (such as first identity information) from the storage database. The storage database records at least one storage interactive object and one or more items stored in the item storage device for each storage interactive object. Optionally, each storage interactive object in the storage database has an association relationship with its stored items. This association relationship can be expressed using a K (Key)-V (Value) data pair format, for example, the identifier (ID, name, etc.) of the storage interactive object is used as the key, and the location of the item stored by the storage interactive object is used as the value. For example, the storage format of the storage database corresponding to the item interaction scenario is shown in Table 1 below:

[0161] Table 1. Storage Databases Corresponding to Item Interaction Scenarios

[0162]

[0163] As shown in Table 1 above, the storage database pre-records the specific location of each storage object and at least one item stored therein. For example, the specific location includes: the item storage device to which the item belongs, and the item's specific location within that storage device (e.g., location x1 or location x2). Therefore, after successfully performing the first identity verification on the aforementioned interactive object, the target item storage device to which the target item (e.g., item 1_1) belongs can be obtained from the storage database shown in Table 1, based on the interactive object's identity information (e.g., ID1).

[0164] S403: Obtain the first spatial position of the interactive object in the item interaction scene, and obtain the second spatial position of the target item storage device in the item interaction scene.

[0165] In one possible implementation, an ultrasonic device array is deployed in the object interaction scenario. The ultrasonic positioning technology of the array allows for environmental detection of the object interaction scenario, yielding a first spatial position and a second spatial position. Specifically, the ultrasonic device array includes N transmitting units and N receiving units. The transmitting units emit ultrasonic signals within the object interaction scenario, and the receiving units receive the ultrasonic signals emitted by the transmitting units. N is a positive integer. The specific process of the ultrasonic device array detecting the first and second spatial positions is described in detail below.

[0166] (1) The ultrasonic device array detects the first spatial position of the interactive object.

[0167] In specific implementation, the process of obtaining the first spatial position is as follows: ① When an interactive object is detected in the object interaction scene, a target transmitting unit associated with the interactive object is determined. This association includes the distance between the transmitting unit and the interactive object being less than a preset distance threshold. For example, the transmitting unit with the smallest distance from the interactive object can be selected from N transmitting units as the target transmitting unit for distance detection. Alternatively, a transmitting unit can be randomly selected from N transmitting units as the target transmitting unit and placed at the location of the detected interactive object. ② Using the target transmitting unit, ultrasonic signals are sent in the object interaction scene at preset time intervals (e.g., 10 seconds). ③ K receiving times for the ultrasonic signals are obtained from K receiving units. Each receiving unit corresponds to one receiving time, where K is a positive integer and K≤N. Each receiving unit can be used to receive the ultrasonic signals emitted by the transmitting unit to obtain the corresponding receiving time. For example, here K=3. Then, the spatial morphology information of the interactive object (such as the first spatial position of the interactive object) can be obtained through triangulation of the echo (the echo signal after reflecting the ultrasonic signal). ④ Based on K reception times, calculate the first spatial position of the interactive object in the item interaction scene; for example, by comparing the order in which the three receiving units receive the ultrasonic signals, the specific position of the target transmitting unit can be deduced (i.e. calculated). This position is the spatial position (i.e., the first spatial position) of the located target (interactive object) in the item interaction scene. For example, the first spatial position can be represented as the three-dimensional spatial coordinates (x1, y1, z1) of the interactive object in the item interaction scene.

[0168] (2) The second spatial location of the target item storage device is detected by an ultrasonic device array.

[0169] In specific implementation, the process of obtaining the second spatial position is as follows: ① Determine the target transmitting unit from N transmitting units. The target transmitting unit can be the transmitting unit that is closest to the target item storage device. ② Using the target transmitting unit, send ultrasonic signals in the item interaction scenario at preset time intervals (e.g., 10s). ③ Obtain K receiving times for the ultrasonic signals from K receiving units. One receiving unit corresponds to one receiving time, where K is a positive integer and K≤N. ④ Based on the K receiving times, calculate the second spatial position of the target item storage device in the item interaction scenario. For example, the second spatial position can be represented as the three-dimensional spatial coordinates (x2, y2, z2) of the target item storage device in the item interaction scenario. It should be noted that the detailed process of detecting the second spatial position can be referred to the specific process of detecting the first spatial position in step (1) above, and will not be repeated here.

[0170] Based on this, the embodiments of this application allow for environmental detection of the object interaction scene using ultrasonic positioning technology of ultrasonic device array, thereby accurately and efficiently obtaining the first spatial location of the interactive object and the second spatial location of the target object storage device, so as to guide the interactive object to move its position based on the first and second spatial locations.

[0171] S404: Output the first instruction audio based on the first spatial position and the second spatial position.

[0172] The first instruction audio is used to instruct the interactive object to reach the second spatial location to perform an operation to acquire the target item. There are two conditions for the interactive object to reach the second spatial location: 1. The interactive object is currently already at the second spatial location (i.e., the first spatial location and the second spatial location are the same); 2. The interactive object needs to move from the first spatial location to the second spatial location. Optionally, the output method of the first instruction audio can include any of the following: outputting the first instruction audio around the interactive object (such as within the interactive object's perception area); or, outputting the first instruction audio in the item interaction scenario; or, outputting the first instruction audio around the target item storage device.

[0173] In one possible implementation, the output of the first instruction audio includes the following two cases: Case 1: If the first spatial position and the second spatial position are the same, or the distance between the first spatial position and the second spatial position is less than or equal to a preset threshold, the first instruction audio is used to prompt the interactive object that it does not need to perform a movement operation (i.e., the interactive object can perform an item acquisition operation at its current position), and triggers the execution of a second identity recognition process for the interactive object through a second identity recognition device in the target item storage device. Case 2: If the distance between the first spatial position and the second spatial position is greater than a preset threshold, the first instruction audio is used to instruct the object to move from the first spatial position to the second spatial position. The specific implementation process of Case 2 is explained in detail below:

[0174] In specific implementation, the first instruction audio can be generated and output by a computer device in real time based on a first spatial position and a second spatial position. In this case, an array of ultrasonic devices is deployed in the object interaction scenario; the process of the computer device outputting the first instruction audio based on the first spatial position and the second spatial position can include the following steps (1)-(2):

[0175] (1) Determine the movement path of the interactive object based on the first spatial location and the second spatial location. Assuming there is at least one path for moving from the first spatial location to the second spatial location, the movement path here includes any of the following: any of the at least one path mentioned above; the shortest path among the at least one paths; or a specified path among the at least one paths. Please refer to [link to relevant documentation]. Figure 6 , Figure 6 This is a schematic diagram of a movement path provided in an embodiment of this application. For example... Figure 6 As shown, assuming the first spatial position of the interactive object in the item interaction scenario is represented by S1, and the second spatial position of the target item storage device in the item interaction scenario is represented by S2, then the path from the first spatial position S1 to the second spatial position S2 can include the following three paths: path 1, path 2, and path 3. In this case, any one of path 1, path 2, and path 3 (such as path 1) can be used as the movement path of the interactive object; alternatively, the shortest path (such as path 2) can also be used as the movement path of the interactive object. In practical applications, the movement path of the interactive object can be flexibly selected according to the specific scenario requirements, and this embodiment does not impose specific limitations on this.

[0176] (2) Based on the movement path, an ultrasonic device array is used to output a first instruction audio around the interactive object. Here, "around the interactive object" includes any of the following: the interactive object's auditory perception area (e.g., near the interactive object's ears), or the interactive object's visual perception area; optionally, if the current interactive object's identity type is a preset type (visually impaired type), the first instruction audio can be output within the interactive object's auditory perception area. Specifically, the output process of the first instruction audio includes the following steps: ① Based on the movement path, determine the interactive object's movement instruction information; this movement instruction information is used to indicate the interactive object's movement. This movement instruction information can be, for example, the distance or number of steps the interactive object moves in a certain direction. For example, the movement instruction information could be: 10 steps straight, 5 steps right turn; or it could be: 1 meter straight, 0.5 meters right turn. ② Based on the movement indication information, directional beamforming technology using an ultrasonic device array is employed to output a first indication audio signal matching the movement indication information within the auditory perception area of ​​the interactive object (e.g., near the interactive object's ears). The directional beamforming technology is used to indicate that during the movement of the interactive object, spatial audio in a specified direction is generated to instruct the interactive object to move in that direction. Therefore, by using directional spatial audio to provide directional guidance for the user's movement, the accuracy of the user's positional movement can be guaranteed.

[0177] In the above steps (1)-(2), directional spatial audio is formed near the user's left and right ears through the directional beamforming technology of the ultrasonic device array. This stereo spatial audio guides the user to adjust their position during movement. Since the sound field is directional, the first instruction audio has strong directionality. It can guide the user to move conveniently and accurately without interfering with other users.

[0178] Optionally, the first instruction audio can also be directly selected and output from an audio database. The specific process is as follows: Obtain an audio database containing at least one instruction audio, any one of which is used to indicate movement from one spatial location to another; based on a first spatial location and a second spatial location, select the instruction audio from the audio database indicating movement from the first spatial location to the second spatial location as the first instruction audio here; output the first instruction audio around the interactive object.

[0179] S405: In response to the interaction object arriving at the second spatial location, the interaction object is processed by the second identity recognition device in the target item storage device to verify the second identity information of the interaction object, and the storage location of the target item in the target item storage device is determined based on the successfully verified second identity information.

[0180] The interactive object can move from a first spatial location to a second spatial location based on the instruction of the first audio signal, that is, to the location of the target item storage device. Furthermore, the interactive object can be re-identified by a second identification device within the target item storage device, which can be located at any or a designated location within the target item storage device (such as the center of the device).

[0181] Specifically, the second identity recognition device is used to verify the identity information of the interactive object. For example, the second identity recognition device can identify the interactive object based on visual perception methods (such as facial recognition, iris recognition, etc.) or based on non-visual perception methods (such as palm recognition, fingerprint recognition, voiceprint recognition, etc.). In this embodiment of the application, the second identity recognition device mainly involves identifying the interactive object using non-visual perception methods. The non-visual perception method identity recognition process here mainly includes any type of palm recognition process or voiceprint recognition process.

[0182] In one possible implementation, the computer device performs second identity verification processing on the interactive object through a second identity verification device in the target item storage device, which can include the following two methods:

[0183] Method 1: The system receives the first identity information of the interactive object sent by a first identity recognition device, and based on this first identity information, performs a second identity recognition process on the interactive object through a second identity recognition device in the target item storage device to obtain a second recognition result. In this method, the first and second identity recognition devices are associated, allowing them to interact on the same interactive object (e.g., interacting on the identity information of the same interactive object). Therefore, the second identity recognition device can directly receive the first identity information of the interactive object collected by the first identity recognition device, and then directly perform a second identity recognition on the current interactive object based on this first identity information. This recognition method avoids the need for repeated data collection, thereby improving the efficiency of identity recognition.

[0184] Method Two: Within the second vibration area generated by the second identity recognition device, the second identity information of the interactive object is collected by the second identity recognition device. Based on the collected second identity information, the second identity recognition device performs second identity recognition processing on the interactive object to obtain a second recognition result. The second identity recognition device is equipped with a second ultrasonic array, which generates a second vibration area based on ultrasonic tactile technology for the interactive object to perceive through touch. For example, the second identity recognition device could be a palm-swiping device. In this method, the second identity recognition device can re-collect the identity information of the interactive object, and then perform secondary identity recognition on the current interactive object based on the newly collected second identity information. This recognition method can perform secondary verification of the result of the first identity recognition, thereby improving the accuracy of user identity recognition.

[0185] In both Method 1 and Method 2, the second identification result indicates whether the verification of the interactive object's identity information was successful or failed. If the second identification of the interactive object is successful, it means the verification of the interactive object's identity information was successful; if the second identification of the interactive object fails, it means the verification of the interactive object's identity information failed. It should be noted that the detailed process of the second identification of the interactive object by the second identification device (such as the palm recognition process) can be found in the relevant process (i.e., the first identification process) in step S401 of the embodiments of this application, and will not be repeated here.

[0186] In one possible implementation, the second identity recognition device can be a voiceprint recognition device, and the second recognition result is used to indicate whether the identity information of the interactive object has been successfully verified or not. The computer device performs second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device, and further includes the following steps (1)-(4):

[0187] (1) Collect voiceprint data generated by the interactive object based on the voiceprint recognition device. For example, the interactive object can speak a specified voiceprint command (such as: I love China) based on the instructions of the voiceprint recognition device, thereby generating voiceprint data. Optionally, the collected voiceprint data can be preprocessed, including but not limited to: speech denoising processing, speech alignment processing, etc., to improve the effectiveness and accuracy of the voiceprint data.

[0188] (2) Feature extraction is performed on the voiceprint data to obtain the first voiceprint feature of the interactive object. The first voiceprint feature may include features such as MFCC (Melch Cepstral Coefficient) and LPC (Linear Prediction Coefficient Feature Vector); and an AI model can be used to extract features from the voiceprint data. The AI ​​model can be any neural network model with voiceprint extraction function (such as the X-vector model), and this application does not make any specific limitation on it.

[0189] (3) Obtain the registration data of the interactive object, which includes the second voiceprint feature that the interactive object has registered in the item interaction scenario. The second voiceprint feature is the voiceprint feature recorded by the interactive object during registration.

[0190] (4) If the first voiceprint feature is the same as the second voiceprint feature, the identity verification of the interactive object is successful; otherwise, if the first voiceprint feature is different from the second voiceprint feature, the identity verification of the interactive object fails. In the process of comparing the first and second voiceprint features, a similarity algorithm (such as cosine similarity algorithm, Euclidean distance algorithm, Pearson correlation coefficient, etc.) can be used to calculate the feature similarity between the two. If the feature similarity is greater than or equal to the similarity threshold, it indicates that the two features are the same, meaning the second recognition result is successful; conversely, if the feature similarity is less than the similarity threshold, it indicates that the two features are different, meaning the second recognition result is unsuccessful.

[0191] In the second identity recognition process (voiceprint recognition) shown in steps (1)-(4) above, it supports user identity recognition using non-visual perception methods (such as voiceprint recognition). Users speak the system's preset voiceprint commands, and the voiceprint features at the time of user registration are compared with the voiceprint features extracted in real time to perform voice recognition processing on the interactive object. This audio perception-based identity recognition method is convenient to operate and is also beneficial for convenient and effective identity recognition processing for special groups (such as visually impaired users).

[0192] Furthermore, the computer device determines the storage location of the target item in the target item storage device based on verified identity information (such as secondary identity information), including the following process: obtaining the storage database corresponding to the item interaction scenario, and determining the storage location of the target item stored in the target item storage device based on the identity information of the interaction object (such as identifier ID) from the storage database. For example, as shown in Table 1 above, the storage database can determine the storage location of the target item (such as item 1_1) in the target item storage device, i.e., location x1, based on the ID of the interaction object (such as ID1). Optionally, the target item storage device is divided into K1×K2 modules (such as a parcel locker including multiple compartments), with one module used to store one item, and K1 and K2 being positive integers; then the storage location here can be represented as x*y, where x and y are both positive integers and x≤K1, y≤K2. For example, the storage location of the target item is 2*3, that is, the storage location is the compartment in the third column of the second layer. Optionally, the storage location can also be presented using arrays, text, or other representation methods. This application embodiment does not specifically limit the representation of the storage location.

[0193] Based on this, in the process of performing secondary identity recognition on interactive objects, it is supported to perform secondary identity verification on the interactive object through a secondary identity recognition device, avoiding misjudgment that may occur in the first identity recognition process, thereby improving the accuracy of identity recognition of interactive objects and improving the reliability of the item interaction process.

[0194] S406: Output a second instruction audio based on the storage location, which is used to instruct the interactive object to retrieve the target item from the storage location.

[0195] The output method of the second instruction audio may include any of the following: outputting the second instruction audio around the interactive object (such as within the perception area of ​​the interactive object); outputting the second instruction audio in the object interaction scenario; or outputting the second instruction audio around the target object storage device.

[0196] In one possible implementation, an array of ultrasonic devices is deployed in the object interaction scenario; the process of the computer device outputting a second instruction audio based on the storage location includes the following steps (1)-(2):

[0197] (1) If the second identification result indicates that the identity information of the interactive object has been successfully verified, then the operation instruction of the interactive object is determined based on the storage location and the second spatial location of the interactive object. This operation instruction is an instruction used to guide the interactive object to obtain the target item. Since the interactive object has already arrived near the storage device of the target item, the interactive object does not need to move a large area. Instead, it can retrieve the target item from its original location (i.e., near or around the second spatial location). Therefore, the operation instruction at this time can be the approximate location of the storage location relative to the interactive object, such as above, left, right, west, etc.

[0198] (2) Following the operation instructions, directional beamforming technology using an ultrasonic device array is employed to output a second instruction audio matching the operation instructions within the auditory perception area of ​​the interactive object (e.g., near the interactive object's ears). Similarly, during the interactive object's item retrieval process, spatial audio in a specified direction is generated based on directional beamforming technology to instruct the interactive object to retrieve the target item from the storage location along the specified direction. Therefore, by providing directional spatial audio guidance to the user during the item retrieval process, the interactive object can be assisted in retrieving the target item conveniently and quickly.

[0199] In the steps (1)-(2) above, directional spatial audio can be formed near the user's left and right ears through the directional beamforming technology of the ultrasonic device array. This stereo spatial audio guides the user to retrieve the item conveniently, thereby improving the efficiency and accuracy of the interactive object in obtaining the target item.

[0200] In this embodiment, a first identity recognition device can be used to perform first identity recognition processing on interactive objects in an item interaction scenario. This first identity recognition processing is used to identify the identity information of the interactive object and determine the target item storage device to which the target item to be acquired belongs based on the identity information. A first spatial position of the interactive object in the item interaction scenario and a second spatial position of the target item storage device in the item interaction scenario are obtained. Based on the first and second spatial positions, a first instruction audio is output, which instructs the interactive object to move from the first spatial position to the second spatial position. Further, when the interactive object reaches the second spatial position, a second identity recognition device in the target item storage device performs second identity recognition processing on the interactive object. This second identity recognition processing is used to verify the identity information of the interactive object and determine the storage location of the target item in the target item storage device based on the verified identity information. A second instruction audio is output based on the storage location, which instructs the interactive object to acquire the target item from the storage location. As can be seen above, during the process of an interactive object acquiring an item, the interactive object can undergo an initial identification process via a first identification device. When the interactive object reaches the location of the target item storage device, a second identification process can be performed to re-verify the interactive object's identity information. This method of performing multiple identification processes on the interactive object can improve the accuracy and reliability of identity verification. In addition, during the process of an interactive object acquiring an item, the movement of the interactive object can be guided by instruction audio (such as the first instruction audio and the second instruction audio). This method helps the interactive object to acquire the required target item more accurately and conveniently, thereby improving the convenience and accuracy of the interactive object acquiring the item.

[0201] Please see Figure 7 , Figure 7 This is a flowchart illustrating another item interaction method provided in an embodiment of this application. This item interaction method can be implemented using a computer device (such as...). Figure 3 The method is executed by any terminal device or server shown, and is applied to item interaction scenarios (such as parcel locker pickup, food delivery locker pickup, or large self-service equipment scenarios like vending machines). These item interaction scenarios include a first identification device and at least one item storage device. The item storage device stores items, and each item storage device is equipped with a second identification device. Figure 7 As shown, the item interaction method includes, but is not limited to, the following steps S701-S7061:

[0202] S701: In response to an item interaction request from an interactive object in an item interaction scenario, the interactive object is processed by a first identity recognition device.

[0203] In this context, the item interaction scenario includes at least one interaction object (such as a user). Therefore, the interaction object undergoing the first identity recognition process can be any interaction object or a specific interaction object, without specific limitations. Furthermore, this first identity recognition process is used to identify the first identity information of the interaction object to obtain its first recognition result. It should be noted that the detailed process of the first identity recognition can be found in [reference needed]. Figure 4 The relevant processes in step S401 of the embodiments will not be repeated here.

[0204] In one possible implementation, the first identity recognition device can be any type of device with identity recognition functionality. For example, the first identity recognition device can include any of the following: a palm recognition device, a fingerprint recognition device, a voiceprint recognition device, a face recognition device, etc. For instance, the first identity recognition device can identify the interactive object based on visual perception methods (such as face recognition, iris recognition, etc.) or non-visual perception methods (such as palm recognition, fingerprint recognition, voiceprint recognition, etc.). Optionally, the first identity recognition device in this application can be a palm recognition device, which can then perform first identity recognition processing on the interactive object based on palm recognition to obtain a first recognition result for the interactive object. The first recognition result indicates whether the recognition of the interactive object's identity information (such as first identity information) was successful or failed. If the first recognition result is successful, subsequent steps S7021 or S7022 are triggered; if the first recognition result is unsuccessful, a prompt message can be output, indicating that the interactive object cannot obtain the item in the current item interaction scenario.

[0205] Furthermore, the aforementioned first identification result also includes the identity type of the interactive object, triggering different subsequent processing flows based on different identity types. For example, if the identity type of the interactive object is a preset type (such as visual impairment), then step S7021 is triggered; if the identity type of the interactive object is not a preset type (i.e., non-preset type), then step S7022 is triggered. The following is a detailed description of the object retrieval process for interactive objects with different identity types.

[0206] I. Item retrieval process for preset type interactive objects (S7021-S7061).

[0207] S7021: If the identity type of the interactive object is a preset type, then the target item storage device to which the target item to be obtained by the interactive object belongs is determined based on the first identity information.

[0208] Here, the preset type can be a visual impairment type (i.e., a visually impaired type). The target item storage device to which the target item to be acquired belongs can be determined based on the identity information of the interaction object (such as primary identity information). The determination process is as follows: Obtain the storage database corresponding to the item interaction scenario; based on the primary identity information of the interaction object, determine the target item storage device to which the target item to be acquired belongs from the storage database. For example, the storage database records at least one storage interaction object, and one or more items that each storage interaction object has stored in the item storage device. Then, based on the identifier (such as ID) of the interaction object, the target item storage device to which the target item stored by the interaction object belongs can be obtained from the data recorded in the storage database.

[0209] S7031: Obtain the first spatial position of the interactive object in the item interaction scene, and obtain the second spatial position of the target item storage device in the item interaction scene.

[0210] In one possible implementation, an array of ultrasonic devices is deployed in the object interaction scenario. The ultrasonic positioning technology of the array can be used to detect the environment of the object interaction scenario and obtain a first spatial position and a second spatial position. Here, ultrasonic positioning technology refers to using the spatial propagation characteristics of ultrasonic signals to determine the specific location of the target.

[0211] Please see Figure 8a , Figure 8a This is a schematic flowchart of an ultrasonic positioning technology provided in an embodiment of this application. Figure 8a As shown, assuming the ultrasonic device array includes N transmitting units (also called ultrasonic transmitters) and N receiving units (also called ultrasonic receivers), where N is a positive integer; any ultrasonic transmitter can be placed on the target (such as an interactive object) and send ultrasonic signals to the surroundings at certain time intervals. The ultrasonic signals emitted by the transmitter are received at K (e.g., 3) fixed locations around the transmitter, and the reception times of the 3 receiving units (i.e., ultrasonic receivers) can be obtained, for example: 1.4us, 2.6us, and 3.9us. Since the transmission speed of ultrasonic signals in space is relatively slow, by comparing the order in which the 3 receiving units receive the ultrasonic signals, the specific location of the ultrasonic transmitter can be calculated, which is the location of the target (i.e., the first spatial location of the interactive object). Similarly, the positioning process for the second spatial location of the target item storage device in the item interaction scenario can refer to the positioning process for the first spatial location described above, and will not be repeated here.

[0212] In one possible implementation, the aforementioned ultrasonic device array is an array structure composed of multiple ultrasonic devices. Optionally, these ultrasonic devices can be ultrasonic transducers. An ultrasonic transducer is a transducer that converts acoustic energy into electrical energy within the ultrasonic frequency range. Ultrasonic transducers are mainly divided into three categories: transmitters, receivers, and transceiver transducers. A transducer used to transmit ultrasonic signals is called a transmitter. When the transducer is in the transmitting state, it converts electrical energy into mechanical energy, and then into acoustic energy. A transducer used to receive ultrasonic signals is called a receiver. When the transducer is in the receiving state, it converts acoustic energy into mechanical energy, and then into electrical energy. In some cases, a transducer can function as both a transmitter and a receiver, and is called a transceiver transducer. Ultrasonic transducers are one of the core components and key technologies of ultrasonic technology, and are widely used in fields such as non-destructive testing, medical imaging, ultrasonic microscopy, fingerprint recognition, and the Internet of Things. In practical applications, ultrasonic transducers are often used in systems that utilize echo signals to evaluate target objects. By measuring the time interval between the transmission and reception of ultrasonic signals (i.e., the time interval between the reception and transmission of ultrasonic information), the distance between the target object (such as an interactive object) and the ultrasonic transducer can be determined. Optionally, based on the different physical effects that enable the electromechanical conversion of ultrasonic transducers, they can be classified into the following types: electrodynamic, electromagnetic, magnetostrictive, piezoelectric, and electrostrictive, etc. In this application embodiment, the main focus is on using piezoelectric ultrasonic transducers to construct an ultrasonic device array for position detection. The following is a combination of... Figure 8a and Figure 8b The design principle and specific structure of the piezoelectric ultrasonic transducer are explained in detail.

[0213] Please see Figure 8b , Figure 8b This is a schematic diagram illustrating the design principle of a piezoelectric ultrasonic transducer provided in an embodiment of this application. Figure 8b As shown, the piezoelectric ultrasonic transducer can be, for example, an open-type ultrasonic transducer (MA40S), such as... Figure 8b As shown in Figure (1), the internal structure of the open-type ultrasonic transducer MA40S roughly includes the following modules: resin shell, resonator, metal plate, terminals, and piezoelectric ceramic. The relationship between the metal plate and the piezoelectric ceramic is as follows: Figure 8b As shown in Figure (2), the metal plate is located above the piezoelectric ceramic, and the two are connected; the relationship between the resonator, the metal plate, and the piezoelectric ceramic is as follows. Figure 8b As shown in Figure (3), the metal plate is located above the piezoelectric ceramic, the resonator is located above the metal plate, and the metal plate is connected to the piezoelectric ceramic and the resonator respectively.

[0214] Please see Figure 8c , Figure 8cThis is a schematic diagram illustrating the working principle of a piezoelectric ultrasonic transducer provided in an embodiment of this application. Figure 8c As shown, the working principle of a piezoelectric ultrasonic transducer can be broadly categorized into longitudinal piezoelectric effect and transverse piezoelectric effect. For example, as... Figure 8c As shown in Figure (1), the principle of the longitudinal piezoelectric effect is as follows: a longitudinal pressure F is applied to the upper and lower plates respectively, and a galvanometer is added between the upper and lower plates; for example, as Figure 8c As shown in Figure (2), the principle of the transverse piezoelectric effect is: applying a transverse pressure F to the left and right plates respectively, and adding a galvanometer between the left and right plates; and so on, as Figure 8c As shown in Figure (3), an external electric field is applied to the piezoelectric ultrasonic transducer so that the piezoelectric ultrasonic transducer polarizes the direction of the external electric field as the polarization direction.

[0215] S7041: Output the first instruction audio based on the first spatial position and the second spatial position.

[0216] The first instruction audio is used to instruct the interactive object to move from a first spatial location to a second spatial location. Optionally, the output method of the first instruction audio may include any of the following: outputting the first instruction audio around the interactive object (such as within the perception area of ​​the interactive object); or outputting the first instruction audio in an item interaction scenario; or outputting the first instruction audio around the target item storage device. For details on how to output the first instruction audio based on the first and second spatial locations in this embodiment, please refer to [link to relevant documentation]. Figure 4 The relevant processes in step S403 of the embodiment will not be described again here.

[0217] In one possible implementation, an ultrasonic device array is deployed in the object interaction scenario. The directional beamforming technology of the ultrasonic device array can be used to output a first instruction audio around the interactive object (e.g., near the interactive object's ears). The directional beamforming technology is used to indicate that during the movement of the interactive object, spatial audio in a specified direction is generated to instruct the interactive object to move its position in the specified direction.

[0218] Please see Figure 9a , Figure 9a This is a schematic diagram of a directional sound field for indicating audio provided in an embodiment of this application. For example... Figure 9a As shown, if the item interaction scenario includes three interaction objects: interaction object 1, interaction object 2, and interaction object 3; then... Figure 9a As shown in Figure (1), when ordinary audio is output in the object interaction scenario, all three interaction objects—interaction object 1, interaction object 2, and interaction object 3—can hear the played ordinary audio without any difference; Figure 9aAs shown in Figure (2), this application allows the generation of a first instruction audio through the directional beamforming technology of an ultrasonic device array. The first instruction audio is a spatial audio of a directional sound field. The so-called directional sound field refers to having a clear audio directionality, such as pointing towards the interactive object 2, thereby forming directional spatial audio (such as the first instruction audio) near the left and right ears of the interactive object 2. Through this stereo first instruction audio, the interactive object 2 is guided to adjust its position during movement. Since the sound field of the first instruction audio is directional, the first instruction audio has a strong directionality, which can guide the user to move conveniently and accurately without interfering with other users.

[0219] Please see Figure 9b , Figure 9b This is a schematic diagram of a directional spatial audio provided in an embodiment of this application. For example... Figure 9b As shown, this application utilizes directional beamforming technology of ultrasonic device arrays to enable users (such as...) to... Figure 9a The first indicative audio is generated near the left and right ears of the interactive object 2). This first indicative audio is a directional spatial audio, which is an audio generated based on ultrasonic directional sound propagation technology. Directional sound propagation technology is a new sound source technology that allows sound to propagate in a beam in a certain direction. Its basic principle is to modulate audible sound signals onto ultrasonic signals, which are then emitted into the air by an ultrasonic transducer. During the propagation of ultrasonic signals of different frequencies in the air, due to the nonlinear acoustic effect of air, these signals interact and self-demodulate, thereby generating a new ultrasonic wave with a frequency equal to the sum of the original ultrasonic frequencies (sum frequency) and the difference frequency (difference frequency). If the ultrasonic wave is appropriately selected, the difference frequency sound wave can fall within the user's audible range. In this way, by utilizing the high directivity of ultrasonic waves, the directional propagation of sound can be achieved, facilitating convenient retrieval of items by the interactive object in the object interaction scenario. Based on this, using directional spatial audio to provide directional guidance for the user's movement process can ensure the accuracy of the user's positional movement.

[0220] S7051: When the interactive object arrives at the second spatial location, the interactive object is subjected to second identity recognition processing through the second identity recognition device in the target item storage device.

[0221] The second identity verification process verifies the identity information of the interacting object and determines the storage location of the target item in the target item storage device based on the verified identity information. Optionally, the second identity verification device may be the same type as or different from the first identity verification device, and the second identity verification device may be set at any location or a specified location (such as the center) in the target item storage device.

[0222] In one possible implementation, the second identity recognition process includes the following two methods: 1. Receiving the first identity information of the interactive object sent by the first identity recognition device, and based on the first identity information, performing second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device to obtain a second recognition result. 2. Within the second vibration area generated by the second identity recognition device, collecting the second identity information of the interactive object through the second identity recognition device, and based on the collected second identity information, performing second identity recognition processing on the interactive object through the second identity recognition device to obtain a second recognition result.

[0223] The second identification result indicates whether the verification of the interactive object's identity information was successful or failed. If the second identity verification of the interactive object is successful, it means the verification of the interactive object's identity information was successful; if the second identity verification of the interactive object fails, it means the verification of the interactive object's identity information failed. It should be noted that the process of the second identity verification device for verifying the second identity of the interactive object can be found in the relevant process in step S404 of the above embodiment, and will not be repeated here.

[0224] Furthermore, if the second identification result is used to indicate that the identity information of the interactive object has been successfully verified, the storage location of the target item in the target item storage device is determined based on the verified identity information.

[0225] S7061: Output a second instruction audio based on the storage location.

[0226] The second instruction audio is used to instruct the interactive object to retrieve the target item from the storage location. The output method of the second instruction audio can include any of the following: outputting the second instruction audio around the interactive object (such as within the object's perception area); outputting the second instruction audio in the item interaction scenario; or outputting the second instruction audio around the target item storage device. Furthermore, the second instruction audio is also a type of spatial audio with a directional sound field, as described above. Figure 9a and Figure 9b As shown, it can output a second instruction audio around the user's ears, thereby effectively and accurately guiding the user to obtain items.

[0227] In one possible implementation, attribute information of the interactive object can be obtained, including one or more of the interactive object's height and age. Based on the attribute information, the auditory perception area of ​​the interactive object is determined. Following the operation command, directional beamforming technology using an ultrasonic device array is employed to output a second instruction audio matching the operation command within the auditory perception area of ​​the interactive object. In this case, the approximate height of the interactive object currently retrieving the object can be accurately determined based on its attributes, facilitating precise determination of the specific location of the interactive object's ears and improving the effectiveness of outputting the second instruction audio.

[0228] In the item retrieval process for the preset type of interactive object shown in steps S7021-S7061, the user's item retrieval process can be guided by the first instruction audio and the second instruction audio. Specifically, directional spatial audio can be formed near the user's head or ears through directional sound propagation technology. The highly directional guidance audio can accurately guide the user to the storage area of ​​the target item to be retrieved, so as to effectively guide users of special groups (such as visually impaired users) to retrieve their items conveniently.

[0229] II. Item retrieval process for non-preset type interactive objects (S7022-S7042).

[0230] S7022: If the identity type of the interactive object is not a preset type, the storage location of the target item to be acquired by the interactive object is determined based on the first identity information.

[0231] Specifically, "the identity type of the interactive object is not a preset type" means that the identity type of the interactive object is not a preset type, such as the identity type of the interactive object being non-visually impaired. Since the current interactive object does not have a visual impairment, it can complete the item retrieval process independently without audio guidance. Therefore, after the first identity recognition device successfully recognizes the identity of the interactive object, it can directly determine the storage location of the target item to be retrieved based on the first identity information of the current interactive object (such as ID or other identifiers), so that the user can directly move to the storage location to retrieve the item. Optionally, the storage location here includes: the target item storage device to which the target item belongs; and the storage location of the target item within the target item storage device.

[0232] S7032: When the interactive object arrives at the storage location, the interactive object is subjected to second identity recognition processing through a second identity recognition device.

[0233] In one possible implementation, the target item is stored in a target item storage device. Therefore, the second identity verification device here refers to the second identity verification device within the target item storage device. The second identity verification device is used to verify the identity information of the interactive object. For example, the second identity verification device can identify the interactive object based on visual perception methods (such as facial recognition, iris recognition, etc.) or non-visual perception methods (such as palm recognition, fingerprint recognition, voiceprint recognition, etc.). In this embodiment, the second identity verification device mainly involves identifying the interactive object using non-visual perception methods. The non-visual perception method identity verification process mainly includes either palm recognition processing or voiceprint recognition processing.

[0234] Please see Figure 10 , Figure 10 This is a schematic diagram of a palm recognition process provided in an embodiment of this application. Figure 10 As shown, the second identity recognition device can be a palm-scanning device. During the second identity recognition process, the interactive object places its palm on the upper operating area of ​​the palm-scanning device, and the palm-scanning device can collect the palm data of the interactive object (such as palm print data, palm vein data), and perform second identity recognition processing on the interactive object based on the collected palm data to obtain the second recognition result; wherein, the upper operating area here includes any of the following: the area that the palm-scanning device can detect, or the vibration area generated by the palm-scanning device (in this case, the palm-scanning device is equipped with an ultrasonic array to provide a vibration area for the user to perceive touch).

[0235] The second identification result indicates whether the verification of the interactive object's identity information was successful or failed. If the second identity verification of the interactive object is successful, it means the verification of the interactive object's identity information was successful; if the second identity verification of the interactive object fails, it means the verification of the interactive object's identity information failed. It should be noted that the process of the second identity verification device for verifying the second identity of the interactive object can be found in the relevant process in step S404 of the above embodiment, and will not be repeated here.

[0236] S7042: If the identity of the interactive object is successfully identified, prompt the interactive object to obtain the target item.

[0237] Please see Figure 11 , Figure 11 This is a schematic diagram illustrating a process for obtaining a target item according to an embodiment of this application. For example... Figure 11As shown, once the second identity recognition device in the target item storage device (such as item storage device 1) successfully recognizes the identity of the current interactive object, it can open the cabinet door where the target item is located to prompt the interactive object to retrieve the target item from the storage location.

[0238] In the item retrieval process for non-preset type interactive objects shown in steps S7022-S7042, this application supports two identity recognitions of the interactive object, thereby improving the security and reliability of the item retrieval process; in addition, the palm recognition method can improve the identity recognition efficiency without performing too many cumbersome operations, thereby improving the efficiency and convenience of the item retrieval process.

[0239] In this application embodiment, the aim is to provide different retrieval solutions for interactive objects with different identity types. On the one hand, for users of a preset type (such as visually impaired), by deploying an ultrasonic device array in the object interaction scenario, the user's spatial location can be accurately determined by using ultrasonic echo detection, and the voice information can be accurately generated into spatial sound effects in the binaural area of ​​the interactive object, allowing visually impaired users to approach the operation area based on hearing. In addition, by using the ultrasonic device array to form energy focusing, visually impaired users can perceive the vibration area through touch and locate the identity recognition area through the vibration area, combined with the palm-swiping device for identity recognition. Through spatial audio voice orientation guidance, the user is guided to the correct retrieval location, conveniently completing the entire self-service retrieval process. On the other hand, for non-visually impaired users, the conventional self-service retrieval process can be performed. The accuracy and reliability of identity recognition are improved through secondary identity recognition, and convenient identity recognition is achieved through the palm-swiping device, improving the user's retrieval efficiency.

[0240] The following describes the relevant devices of the item interaction scheme provided in the embodiments of this application.

[0241] It should be noted that, in the embodiments of this application, the terms "module" or "unit" refer to a computer program or part of a computer program with a predetermined function, which works together with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0242] Please see Figure 12 , Figure 12This is a schematic diagram of the structure of an item interaction device provided in an embodiment of this application. The item interaction device 1200 can be used to execute corresponding steps in the item interaction method provided in this embodiment. Specifically, the item interaction device 1200 is applied to an item interaction scenario, which includes a first identification device and at least one item storage device. The item storage device is used to store items, and each item storage device is equipped with a second identification device; specifically, it may include:

[0243] Processing unit 1201 is used to respond to the item interaction request of the interaction object in the item interaction scenario, and to perform first identity recognition processing on the interaction object through the first identity recognition device to obtain the first identity information of the interaction object;

[0244] The processing unit 1201 is also used to determine the target item storage device to which the target item of the item interaction request belongs based on the first identity information;

[0245] The acquisition unit 1202 is used to acquire the first spatial position of the interactive object in the item interaction scene and to acquire the second spatial position of the target item storage device in the item interaction scene.

[0246] The processing unit 1201 is further configured to output a first instruction audio based on the first spatial location and the second spatial location; the first instruction audio is used to instruct the interactive object to perform an acquisition operation on the target item when it reaches the second spatial location;

[0247] The processing unit 1201 is also configured to, in response to the interaction object arriving at the second spatial location, perform second identity recognition processing on the interaction object through the second identity recognition device in the target item storage device to verify the second identity information of the interaction object, and determine the storage location of the target item in the target item storage device based on the successfully verified second identity information;

[0248] The processing unit 1201 is also configured to output a second instruction audio based on the storage location, the second instruction audio being used to instruct the interactive object to retrieve the target item from the storage location.

[0249] In one possible implementation, the first identification device is equipped with a first ultrasonic array, which generates a first vibration area based on ultrasonic tactile technology for the interactive object to perceive touch; the processing unit 1201 performs first identification processing on the interactive object in the object interaction scenario through the first identification device, for the following operations:

[0250] Within the first vibration area generated by the first identity recognition device, the first identity information of the interactive object is collected by the first identity recognition device.

[0251] The interaction object is processed for first identity recognition based on the first identity information to obtain the first recognition result of the interaction object; wherein, the first recognition result includes whether the first identity information of the interaction object is successfully recognized or not.

[0252] In one possible implementation, the processing unit 1201 performs a first identity recognition process on the interactive object based on the first identity information to obtain a first recognition result of the interactive object, which is used to perform the following operations:

[0253] The first identity information is processed by feature extraction to obtain the biometric features of the interactive object;

[0254] Obtain the registration data of the interactive object. The registration data is generated after the interactive object successfully registers its identity in the item interaction scenario. The registration data includes the registration characteristics of the interactive object.

[0255] The biometric features and registration features of the interactive object are compared. If they are the same, the first identification result is used to indicate that the first identity information of the interactive object has been successfully identified.

[0256] In one possible implementation, when the first identification result is successful, the first identification result also includes the identity type of the interactive object; the processing unit 1201 is further configured to perform the following operations:

[0257] If the first identification result is used to indicate that the identity type of the interactive object is a preset type, then the target item storage device to which the target item to be obtained by the interactive object belongs is determined based on the first identity information;

[0258] If the first identification result indicates that the type of the interactive object is not a preset type, then the storage location of the target item to be obtained by the interactive object is determined based on the first identity information.

[0259] In one possible implementation, the first identity recognition device is a palm-scanning device equipped with a first ultrasonic array, and the first identity information includes the palm data of the interactive object; the processing unit 1201 performs feature extraction processing on the first identity information to obtain the biometric features of the interactive object, for use in performing the following operations:

[0260] Palm vein extraction was performed on the palm data to obtain the palm vein features of the interactive object; and,

[0261] Palmprint extraction is performed on the palm data to obtain the palmprint features of the interactive object;

[0262] Feature fusion processing is performed on palm vein features and palm print features to obtain the biometric features of the interactive object;

[0263] The feature fusion processing includes at least one of the following: feature weighting processing, feature alignment processing, and feature operation processing.

[0264] In one possible implementation, an ultrasonic device array is deployed in the object interaction scenario. The ultrasonic device array includes N transmitting units and N receiving units. The transmitting units are used to transmit ultrasonic signals in the object interaction scenario, and the receiving units are used to receive the ultrasonic signals transmitted by the transmitting units. N is a positive integer. The acquisition unit 1202 acquires the first spatial position of the interactive object in the object interaction scenario and performs the following operations:

[0265] When an interactive object is detected in an object interaction scenario, the target emission unit associated with the interactive object is determined; the association includes: the distance between the target emission unit and the interactive object is less than a preset distance threshold.

[0266] Using a target transmitting unit, ultrasonic signals are sent in the object interaction scenario at preset time intervals;

[0267] Obtain K reception times for ultrasonic signals from K receiving units, where one receiving unit corresponds to one reception time, and K is a positive integer and K≤N;

[0268] Based on K reception times, the first spatial position of the interactive object in the item interaction scenario is calculated.

[0269] In one possible implementation, the processing unit 1201 outputs a first indication audio based on a first spatial position and a second spatial position, for performing the following operations:

[0270] If the first spatial position is the same as the second spatial position, or if the distance between the first spatial position and the second spatial position is less than or equal to a preset threshold, then the first instruction audio is used to prompt the interactive object that it does not need to perform a movement operation, and triggers the execution of the second identity recognition processing of the interactive object through the second identity recognition device in the target item storage device;

[0271] If the distance between the first spatial position and the second spatial position is greater than a preset threshold, then the movement path of the interactive object is determined based on the first spatial position and the second spatial position; and based on the movement path, an ultrasonic device array is used to output a first instruction audio around the interactive object; the first instruction audio is used to instruct the interactive object to move from the first spatial position to the second spatial position.

[0272] In one possible implementation, processing unit 1201, based on the movement path, uses an ultrasonic device array to output a first indicative audio around the interactive object for performing the following operations:

[0273] Based on the movement path, determine the movement instruction information of the interactive object;

[0274] Based on the movement indication information, the directional beamforming technology of the ultrasonic device array is used to output a first indication audio that matches the movement indication information within the auditory perception area of ​​the interactive object;

[0275] Among them, directional beamforming technology is used to indicate: during the movement of an interactive object, spatial audio in a specified direction is generated to instruct the interactive object to move its position in the specified direction.

[0276] In one possible implementation, the processing unit 1201 performs second identity recognition processing on the interactive object through a second identity recognition device in the target item storage device, for the purpose of performing the following operations:

[0277] The system receives the first identity information of the interactive object sent by the first identity recognition device, and based on the first identity information, performs second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device to obtain a second recognition result; or,

[0278] Within the second vibration area generated by the second identity recognition device, the second identity information of the interactive object is collected by the second identity recognition device, and based on the collected second identity information, the second identity recognition device performs second identity recognition processing on the interactive object to obtain the second recognition result;

[0279] The second identity recognition device is equipped with a second ultrasonic array, which generates a second vibration area based on ultrasonic tactile technology for the interactive object to perceive touch.

[0280] In one possible implementation, the second identity recognition device is a voiceprint recognition device, and the second recognition result is used to indicate whether the verification of the identity information of the interactive object was successful or failed; the processing unit 1201 performs second identity recognition processing on the interactive object through the second identity recognition device in the target item storage device, and is also used to perform the following operations:

[0281] Based on voiceprint recognition equipment, voiceprint data generated by interactive objects is collected;

[0282] Feature extraction is performed on the voiceprint data to obtain the first voiceprint feature of the interactive object;

[0283] Obtain the registration data of the interactive object, which includes the second voiceprint feature that the interactive object has registered in the item interaction scenario;

[0284] If the first voiceprint feature is the same as the second voiceprint feature, then the identity information of the interactive object is successfully verified.

[0285] In one possible implementation, an array of ultrasonic devices is deployed in the object interaction scenario; the processing unit 1201 outputs a second instruction audio based on the storage location for performing the following operations:

[0286] If the second identification result is used to indicate that the identity information of the interactive object has been successfully verified, then the operation instructions of the interactive object are determined based on the storage location and the second spatial location of the interactive object.

[0287] According to the operation instructions, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation instructions within the auditory perception area of ​​the interactive object.

[0288] In one possible implementation, the processing unit 1201 is further configured to perform the following operations:

[0289] Obtain the attribute information of the interactive object, which includes one or more of the following: the interactive object's height and age;

[0290] Based on attribute information, determine the auditory perception area of ​​the interactive object;

[0291] According to the operation instructions, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation instructions within the auditory perception area of ​​the interactive object.

[0292] In this embodiment, during the process of an interactive object acquiring an item, the interactive object can undergo an initial identification process via a first identification device. When the interactive object reaches the location of the target item storage device, a second identification process can be performed to re-verify the interactive object's identity information. This method of performing multiple identification processes on the interactive object can improve the accuracy and reliability of identity verification. In addition, during the process of the interactive object acquiring an item, the interactive object's position movement can be guided by instruction audio (such as a first instruction audio and a second instruction audio). This method helps the interactive object acquire the desired target item more accurately and conveniently, thereby improving the convenience and accuracy of the interactive object acquiring the item.

[0293] Please see Figure 13 , Figure 13This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. The computer device 1300 is used to execute the steps performed by the computer device in the aforementioned method embodiments. The computer device 1300 may include one or more devices (such as servers, nodes, terminal devices, etc.) or internal components (such as chips, software modules, or hardware modules). The computer device may include at least one processor 1301 and a communication interface 1302. Further optionally, the computer device may also include at least one memory 1303 and a bus 1304. Additionally, the processor 1301, communication interface 1302, and memory 1303 are connected via the bus 1304.

[0294] (1) The processor 1301 is a module that performs arithmetic and / or logical operations. Specifically, it may be one or a combination of processing modules such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor unit (MPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), a coprocessor (to assist the central processing unit in completing corresponding processing and applications), and a micro controller unit (MCU).

[0295] (2) The communication interface 1302 can be used to provide information input or output to at least one processor 1301. And / or, the communication interface 1302 can be used to receive data sent externally and / or send data externally, and can be a wired link interface including such as an Ethernet cable, or a wireless link interface (Wi-Fi, Bluetooth, general wireless transmission, vehicle short-range communication technology, and other short-range wireless communication technologies, etc.). The communication interface 1302 can serve as a network interface.

[0296] (3) The memory 1303 is used to provide storage space, in which data such as the operating system and computer programs (including program instructions) can be stored. The memory 1303 can be one or a combination of random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM), etc.

[0297] In specific implementation, the processor 1301 runs the computer program stored in the memory 1303 to cause the computer device to execute the method steps in the foregoing embodiments of this application; in addition, the effects achieved by the computer device after executing the method steps in the various embodiments by the processor can be referred to the description of the foregoing embodiments, and will not be repeated here.

[0298] According to one aspect of this application, embodiments of this application also provide a computer-readable storage medium storing a computer program. When a processor executes the computer program, it can perform the methods described in the preceding embodiments; therefore, further details will not be repeated here. For technical details not disclosed in the embodiments of the computer-readable storage medium involved in this application, please refer to the description of the method embodiments of this application. As an example, the computer program can be deployed on a computer device, or executed on multiple computer devices located in one location, or executed on multiple computer devices distributed in multiple locations and interconnected through a communication network.

[0299] According to one aspect of this application, embodiments of this application also provide a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, enabling the computer device to perform the methods described in the foregoing embodiments; therefore, further details will not be repeated here. For technical details not disclosed in the embodiments of the computer program product involved in this application, please refer to the description of the method embodiments of this application.

[0300] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product, which includes one or more computer programs. When the computer program is loaded and executed on a computer device, it generates, in whole or in part, the processes or functions described in the embodiments of this application; the computer device can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program can be stored in or transmitted through a computer-readable storage medium; the computer program can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium accessible to the computer device or a data processing device such as a server or data center that integrates one or more available media; wherein, the available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0301] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A method for interacting with objects, characterized in that, The method is applied to an item interaction scenario, wherein the item interaction scenario includes a first identification device and at least one item storage device, the item storage device being used to store items, and each item storage device being equipped with a second identification device; the method includes: In response to an item interaction request from an interactive object in the item interaction scenario, the first identity recognition device performs a first identity recognition process on the interactive object to obtain the first identity information of the interactive object; Based on the first identity information, determine the target item storage device to which the target item in the item interaction request belongs; Obtain the first spatial position of the interactive object in the item interaction scenario, and obtain the second spatial position of the target item storage device in the item interaction scenario; Based on the first spatial location and the second spatial location, a first instruction audio is output; the first instruction audio is used to instruct the interactive object to reach the second spatial location to perform an operation to acquire the target item; In response to the interaction object arriving at the second spatial location, the interaction object is subjected to second identity recognition processing by the second identity recognition device in the target item storage device to verify the second identity information of the interaction object, and the storage location of the target item in the target item storage device is determined based on the successfully verified second identity information. A second instruction audio is output based on the storage location, and the second instruction audio is used to instruct the interactive object to retrieve the target item from the storage location.

2. The method as described in claim 1, characterized in that, The first identity recognition device is equipped with a first ultrasonic array, which generates a first vibration area based on ultrasonic tactile technology for the interactive object to perceive through touch; the first identity recognition process performed on the interactive object by the first identity recognition device includes: Within the first vibration area generated by the first identity recognition device, the first identity information of the interactive object is collected by the first identity recognition device. Based on the first identity information, the interaction object is subjected to a first identity recognition process to obtain a first recognition result of the interaction object; wherein, the first recognition result includes whether the first identity information of the interaction object is successfully recognized or not.

3. The method as described in claim 2, characterized in that, The first identity recognition process performed on the interactive object based on the first identity information to obtain the first recognition result of the interactive object includes: The first identity information is subjected to feature extraction processing to obtain the biometric features of the interactive object; Obtain the registration data of the interactive object, which is generated after the interactive object successfully registers its identity in the item interaction scenario, and the registration data includes the registration characteristics of the interactive object; If the biometric features of the interactive object are compared with the registration features, and they are the same, then the first identification result is used to indicate that the first identity information of the interactive object has been successfully identified.

4. The method as described in claim 3, characterized in that, When the first identification result is successful, the first identification result also includes the identity type of the interactive object; the method further includes: If the first identification result is used to indicate that the identity type of the interactive object is a preset type, then the target item storage device to which the target item to be acquired by the interactive object belongs is determined based on the first identity information; If the first identification result indicates that the type of the interactive object is not a preset type, then the storage location of the target item to be acquired by the interactive object is determined based on the first identity information.

5. The method as described in claim 3, characterized in that, The first identity recognition device is a palm-swiping device equipped with the first ultrasonic array, and the first identity information includes the palm data of the interactive object; the step of performing feature extraction processing on the first identity information to obtain the biometric features of the interactive object includes: The palm data is processed to extract palm veins, thereby obtaining the palm vein features of the interactive object; and, The palm data is processed to extract palm print features of the interactive object. The palm vein features and the palm print features are fused to obtain the biometric features of the interactive object; The feature fusion process includes at least one of the following: feature weighting, feature alignment, and feature operation.

6. The method as described in claim 1, characterized in that, An ultrasonic device array is deployed in the object interaction scenario. The ultrasonic device array includes N transmitting units and N receiving units. The transmitting units are used to transmit ultrasonic signals in the object interaction scenario, and the receiving units are used to receive the ultrasonic signals transmitted by the transmitting units. N is a positive integer. Obtaining the first spatial position of the interactive object in the item interaction scenario includes: When the interactive object is detected in the object interaction scenario, a target transmitting unit associated with the interactive object is determined; the association includes: the distance between the target transmitting unit and the interactive object is less than a preset distance threshold. Using the target transmitting unit, ultrasonic signals are transmitted in the object interaction scenario at preset time intervals; Obtain K reception times for the ultrasonic signal from K receiving units, where one receiving unit corresponds to one reception time, and K is a positive integer and K≤N; Based on the K reception times, the first spatial position of the interactive object in the item interaction scenario is calculated.

7. The method as described in claim 6, characterized in that, The step of outputting a first indication audio based on the first spatial position and the second spatial position includes: If the first spatial location is the same as the second spatial location, or if the distance between the first spatial location and the second spatial location is less than or equal to a preset threshold, then the first instruction audio is used to prompt the interactive object that it does not need to perform a movement operation, and triggers the execution of the second identity recognition processing of the interactive object through the second identity recognition device in the target item storage device; If the distance between the first spatial location and the second spatial location is greater than a preset threshold, then the movement path of the interactive object is determined based on the first spatial location and the second spatial location; and based on the movement path, the ultrasonic device array outputs a first instruction audio around the interactive object; the first instruction audio is used to instruct the interactive object to move from the first spatial location to the second spatial location.

8. The method as described in claim 7, characterized in that, The step of outputting a first indicative audio signal around the interactive object using the ultrasonic device array based on the movement path includes: Based on the movement path, determine the movement indication information of the interactive object; According to the movement indication information, the directional beamforming technology of the ultrasonic device array is used to output a first indication audio that matches the movement indication information within the auditory perception area of ​​the interactive object; The directional beamforming technology is used to indicate that, during the movement of the interactive object, spatial audio in a specified direction is generated to indicate that the interactive object moves in the specified direction.

9. The method according to any one of claims 1-8, characterized in that, The second identity recognition process for the interactive object via the second identity recognition device in the target item storage device includes: The system receives the first identity information of the interactive object sent by the first identity recognition device, and based on the first identity information, performs a second identity recognition process on the interactive object through a second identity recognition device in the target item storage device to obtain a second recognition result; or, Within the second vibration area generated by the second identity recognition device, the second identity information of the interactive object is collected by the second identity recognition device, and based on the collected second identity information, the interactive object is processed by the second identity recognition device to obtain a second recognition result; The second identity recognition device is equipped with a second ultrasonic array, which generates a second vibration area based on ultrasonic tactile technology for the interactive object to perceive touch.

10. The method as described in claim 9, characterized in that, The second identity recognition device is a voiceprint recognition device, and the second recognition result is used to indicate whether the identity information of the interactive object was successfully verified or not. The second identity recognition process for the interactive object via the second identity recognition device in the target item storage device further includes: Based on the voiceprint recognition device, voiceprint data generated by the interactive object is collected; Feature extraction is performed on the voiceprint data to obtain the first voiceprint feature of the interactive object; Obtain the registration data of the interactive object, the registration data including the second voiceprint feature that the interactive object has registered in the item interaction scenario; If the first voiceprint feature is the same as the second voiceprint feature, then the identity information of the interactive object is successfully verified.

11. The method as described in claim 10, characterized in that, An array of ultrasonic devices is deployed in the object interaction scenario; the output of the second instruction audio based on the storage location includes: If the second identification result is used to indicate that the identity information of the interactive object has been successfully verified, then the operation instructions of the interactive object are determined based on the storage location and the second spatial location of the interactive object. According to the operation command, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation command within the auditory perception area of ​​the interactive object.

12. The method as described in claim 11, characterized in that, The method further includes: Obtain the attribute information of the interactive object, the attribute information including: any one or more of the interactive object's height and age; Based on the attribute information, the auditory perception area of ​​the interactive object is determined; According to the operation command, the directional beamforming technology of the ultrasonic device array is used to output a second instruction audio that matches the operation command within the auditory perception area of ​​the interactive object.

13. An object interaction device, characterized in that, An application for item interaction scenarios, wherein the item interaction scenario includes a first identification device and at least one item storage device, the item storage device being used to store items, and each item storage device being equipped with a second identification device; the device includes: The processing unit is configured to respond to the item interaction request of the interaction object in the item interaction scenario, and perform first identity recognition processing on the interaction object through the first identity recognition device to obtain the first identity information of the interaction object; The processing unit is further configured to determine, based on the first identity information, the target item storage device to which the target item of the item interaction request belongs; The acquisition unit is used to acquire the first spatial position of the interactive object in the item interaction scenario and to acquire the second spatial position of the target item storage device in the item interaction scenario. The processing unit is further configured to output a first instruction audio based on the first spatial location and the second spatial location; the first instruction audio is used to instruct the interactive object to perform an acquisition operation on the target item when it reaches the second spatial location; The processing unit is further configured to, in response to the interaction object arriving at the second spatial location, perform second identity recognition processing on the interaction object through the second identity recognition device in the target item storage device to verify the second identity information of the interaction object, and determine the storage location of the target item in the target item storage device based on the successfully verified second identity information; The processing unit is further configured to output a second instruction audio based on the storage location, the second instruction audio being used to instruct the interactive object to retrieve the target item from the storage location.

14. A computer device, characterized in that, include: Memory and processor; The memory stores one or more computer programs; A processor for loading one or more computer programs to implement the method as described in any one of claims 1-12.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the method as described in any one of claims 1-12.

16. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, performs the method as described in any one of claims 1-12.

Images