Equipment management method and device, electronic equipment, computer readable storage medium and computer program product

Abstract

The invention provides an equipment management method and device, electronic equipment, a computer readable storage medium and a computer program product. The method is applied to a collection terminal, the collection terminal is connected with a plurality of controlled devices, and the plurality of controlled devices are located at different positions of the collection terminal. The method comprises the steps of obtaining feature data of at least one dimension of a target object; target controlled equipment is determined from the multiple pieces of controlled equipment on the basis of the feature data of the at least one dimension, and the target controlled equipment is the controlled equipment expected to be used by the target object; and controlling the target controlled equipment to execute the corresponding service. According to the invention, a plurality of controlled devices can share one collection terminal, the number of collection terminals is effectively reduced, the device laying cost is reduced, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent control, and in particular to a device management method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] Taking the shared power bank scenario as an example, in some scenarios, there may be multiple shared power bank machines (i.e., shared power bank rental warehouses). If a payment terminal is deployed for each shared power bank machine, the cost will be too high, and too many devices will easily cause user confusion, which will lead to a poor user experience. Summary of the Invention

[0003] The embodiments of the present application provide a device management method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can enable multiple controlled devices to share one payment terminal, effectively reducing the number of payment terminals and lowering equipment deployment costs.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] An embodiment of the present application provides a device management method, characterized in that it is applied to a payment terminal, the payment terminal is connected to multiple controlled devices, and the multiple controlled devices are located at different positions of the payment terminal;

[0006] The method comprises:

[0007] Acquire feature data of at least one dimension of the target object;

[0008] determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension, wherein the target controlled device is a controlled device that the target object desires to use;

[0009] Control the target controlled device to execute corresponding services.

[0010] An embodiment of the present application provides a device management apparatus, characterized in that it is applied to a payment terminal, the payment terminal is connected to multiple controlled devices, and the multiple controlled devices are located at different positions of the payment terminal;

[0011] The device comprises:

[0012] An acquisition module, configured to acquire feature data of at least one dimension of a target object;

[0013] a determination module, configured to determine a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension, wherein the target controlled device is a controlled device that the target object desires to use;

[0014] The control module is used to control the target controlled device to execute corresponding services.

[0015] In the above solution, the feature data of at least one dimension includes the movement direction corresponding to the target part of the target object, wherein the target part is the part of the target object bound to the biometric payment function; the acquisition module is further used to acquire image data, wherein the image data is obtained by capturing an image of the target object;

[0016] The determination module is further configured to perform detection processing on the target part of the image in the image data; and in response to detecting the target part from a plurality of continuously acquired images, determine the corresponding moving direction of the target part in the plurality of images.

[0017] In the above solution, the determining module is further configured to determine the controlled device corresponding to the moving direction among the multiple controlled devices as the target controlled device that the target object desires to use.

[0018] In the above scheme, the moving direction includes a horizontal moving direction component and a vertical moving direction component; the determination module is further used to, in response to the situation where the multiple controlled devices are stacked in the same position, determine the controlled device corresponding to the horizontal moving direction component and the vertical moving direction component among the multiple controlled devices as the target controlled device that the target object expects to use.

[0019] In the above solution, the payment terminal includes a face-scanning payment terminal, and the feature data of at least one dimension includes the sight direction of the target object; the acquisition module is further used to capture an image of the target object to obtain image data;

[0020] The determination module is further configured to perform face detection processing on the image in the image data; and determine the sight direction of the target object in response to detecting the face of the target object from the collected image.

[0021] In the above solution, the determining module is further configured to determine a controlled device corresponding to the sight line direction of the target object among the multiple controlled devices as the target controlled device that the target object desires to use.

[0022] In the above scheme, the payment terminal is associated with a microphone, and the feature data of at least one dimension includes the voice emitted by the target object; the acquisition module is also used to collect the voice of the target object through the microphone to obtain the voice emitted by the target object, wherein the type and number of the microphones are related to the environment in which the payment terminal is located.

[0023] In the above solution, the determination module is further used to parse the voice uttered by the target object to obtain keywords carried by the voice; and determine the controlled device matching the keywords among the multiple controlled devices as the target controlled device that the target object expects to use.

[0024] In the above scheme, the characteristic data of at least one dimension includes the frequency of use of the target object for the multiple controlled devices; the determination module is also used to determine the controlled device with the highest frequency of use by the target object among the multiple controlled devices as the target controlled device that the target object expects to use.

[0025] In the above solution, the acquisition module is further configured to scan the multiple controlled devices to obtain location information of the multiple controlled devices; and store the location information of the multiple controlled devices in the payment terminal.

[0026] In the above solution, the control module is further used to control the mobile power supply compartment to eject the mobile power supply when the target controlled device is a mobile power supply compartment; and to control the vending machine to drop corresponding items when the target controlled device is a vending machine.

[0027] In the above scheme, the characteristic data of at least one dimension includes at least one of the following: the moving direction corresponding to the target part of the target object, the voice emitted by the target object, and the frequency of use of the target object for the multiple controlled devices; the determination module is also used to obtain the priority order set for the characteristic data of at least one dimension; based on the characteristic data of at least one dimension and the priority order, determine the target controlled device from the multiple controlled devices.

[0028] An embodiment of the present application provides an electronic device, including:

[0029] a memory for storing computer-executable instructions;

[0030] The processor is used to implement the device management method provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0031] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions for implementing the device management method provided in the embodiment of the present application when executed by a processor.

[0032] An embodiment of the present application provides a computer program product, including a computer program or computer executable instructions, which is used to implement the device management method provided in the embodiment of the present application when executed by a processor.

[0033] The embodiments of the present application have the following beneficial effects:

[0034] The payment terminal is connected to multiple controlled devices, and the multiple controlled devices are deployed at different locations of the payment terminal. Then, the characteristic data of at least one dimension of the target object is obtained through the payment terminal. Based on the characteristic data of at least one dimension, the target controlled device that the target object expects to use is determined from the multiple controlled devices. Finally, the target controlled device is controlled to implement the corresponding service. In this way, multiple controlled devices can share one payment terminal, saving the equipment deployment cost and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 1 is a schematic diagram of the architecture of the device management system 100 provided in an embodiment of the present application;

[0036] Figure 2 is a structural diagram of an electronic device 500 provided in an embodiment of the present application;

[0037] Figure 3 This is a flow chart of the device management method provided in the embodiment of the present application;

[0038] Figure 4A This is a flow chart of the device management method provided in the embodiment of the present application;

[0039] Figure 4B This is a flow chart of the device management method provided in the embodiment of the present application;

[0040] Figure 5 This is a flow chart of the device management method provided in the embodiment of the present application;

[0041] Figure 6 Schematic diagram of a palm-swipe payment terminal provided in an embodiment of the present application;

[0042] Figure 7 This is a schematic diagram of stacking shared power banks of different brands provided in an embodiment of the present application;

[0043] Figure 8 This is a schematic diagram of the correspondence between different brands of shared power banks and location information provided by an embodiment of the present application;

[0044] Figure 9 This is a schematic diagram of determining the corresponding brand of shared power bank based on the palm swiping direction provided by an embodiment of the present application;

[0045] Figure 10 This is a schematic diagram of determining a shared power bank of a corresponding brand based on voice recognition provided by an embodiment of the present application;

[0046] Figure 11 This is a schematic diagram of the MaxPay payment transaction timing provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0048] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0049] It is understandable that in the embodiments of the present application, when user information and other related data (such as the frequency of use of user devices) are involved, when the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0050] In the following description, the terms "first\second\..." are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first\second\..." can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0051] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0053] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0054] 1) Biometric payment: Biometric payment is the use of human biological characteristics such as fingerprints, faces, irises, palm prints, voiceprints, etc. to replace the traditional password payment mode and realize application in payment scenarios.

[0055] 2) Keywords: These are words or phrases that are important in a text and can express the theme of the text, helping users quickly find target information or products.

[0056] 3) Palmprint recognition: A technology that uses multimedia information on the palm of your hand to exchange for a person’s identity information.

[0057] 4) Depth camera: A depth camera, also known as a three-dimensional (3D) camera, is similar to a traditional camera and adds living-related hardware and software, including a depth camera and an infrared camera, to ensure information security.

[0058] 5) SQLite database: It is a lightweight database and a relational database management system that complies with ACID (including Atomicity, Consistency, Isolation, and Durability).

[0059] 6) MaxPay: MaxPay is an international payment system provider specializing in merchant account services, fraud prevention and distributing multiple merchant account dashboards. It provides everything you need to accept online payments, including card processing and fraud protection, and can accept all major credit cards, debit cards and other payment methods.

[0060] 7) Power Bank: Also known as a power bank, this device is a portable charger that can be carried around and stores electricity. It is primarily used to charge handheld mobile devices and other consumer electronics (e.g., mobile phones, computers, etc.), especially when no external power supply is available. Its main components include a battery for storing energy and a circuit for stabilizing the output voltage.

[0061] Taking the application scenario of shared power banks as an example, the applicant discovered during the implementation of the embodiments of this application that the solutions provided by the related technologies have the following problems:

[0062] In the application scenarios of shared power banks, there are multiple shared power bank machines in some application scenarios. If a payment terminal is installed for each shared power bank machine in the scenario, the installation cost will be too high, and too many payment terminals will easily cause confusion for users.

[0063] In view of this, the embodiments of the present application provide a device management method, apparatus, electronic device, computer-readable storage medium and computer program product, which can enable multiple controlled devices to share one payment terminal, effectively reduce the number of payment terminals, and reduce equipment deployment costs.

[0064] The following describes an exemplary application of an electronic device for implementing device management provided in an embodiment of the present application. The electronic device in the embodiment of the present application can be implemented as a payment terminal. The payment terminal here can be a commonly used mobile payment terminal (such as a POS machine, a barcode scanner, etc.), or other payment terminals with biometric payment functions (such as a face-scanning payment terminal, a palm-scanning payment terminal, etc.), which is not specifically limited here.

[0065] The following explanation is given by taking the payment terminal as a palm payment terminal and the controlled device as a shared power bank device as an example.

[0066] For example, see Figure 1 , Figure 1 This is a schematic diagram of the architecture of the device management system 100 provided in the embodiment of the present application, which is used to support a device management application, such as Figure 1 As shown, the payment terminal 200 (e.g., a palm-swipe payment terminal) is connected to multiple controlled devices, such as a controlled device 300-1 (e.g., a shared power bank device of brand A), a controlled device 300-2 (e.g., a shared power bank device of brand B), and a controlled device 300-3 (e.g., a shared power bank device of brand C), and the multiple controlled devices are located at different positions of the payment terminal 200, for example, the controlled device 300-1 is located on the left side of the payment terminal 200, the controlled device 300-2 is located in front of the payment terminal 200, and the controlled device 300-3 is located on the right side of the payment terminal 200. In addition, the payment terminal 200 can be connected to the server 400 and can send the acquired feature data of at least one dimension of the target object (e.g., user 1) to the server 400. The server 400 determines the target controlled device from the multiple controlled devices based on the feature data of at least one dimension. Of course, the payment terminal 200 can also determine the target controlled device through its own computing power, which is not specifically limited in this embodiment of the present application.

[0067] For example, the payment terminal 200 can be used to display a feature data collection interface to the user, and obtain feature data of at least one dimension of the user from the interface. The payment terminal 200 uploads the collected feature data of at least one dimension to the server 400 via the network. Based on the feature data of at least one dimension, the server 400 determines a target controlled device from multiple controlled devices, where the target controlled device is the controlled device that the user desires to use. Finally, the server 400 transmits the information of the target controlled device to the payment terminal 200 via the network, and the payment terminal 200 controls the target controlled device among the multiple controlled devices to perform the corresponding service. For example, assuming that the server 400 determines that the target controlled device is controlled device 300-1 based on the direction of the user's palm swipe (for example, assuming that the user moves his palm to the left), that is, the user currently desires to use a shared power bank provided by brand A, the payment terminal 200 can control the controlled device 300-1 to pop up the shared power bank.

[0068] In other embodiments, the device management method provided in the embodiments of the present application can also be implemented with the help of cloud technology (Cloud Technology) and artificial intelligence technology.

[0069] Cloud technology refers to a managed technology that unifies hardware, software, and network resources within a wide or local area network (WAN) to enable data computing, storage, processing, and sharing. Cloud technology encompasses network, information technology, integration technology, management platform technology, and application technology, all based on the cloud computing business model. It forms a resource pool that provides on-demand, flexible, and convenient access. Cloud computing technology will become a crucial support. The backend services of technical network systems require substantial computing and storage resources.

[0070] For example, Figure 1 The server 400 shown in the figure can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The payment terminal 200 and the server 400 can be connected directly or indirectly via wired or wireless communication, which is not limited in the embodiments of the present application.

[0071] It should be noted that the device management method provided in the embodiment of the present application can be applied to various device management scenarios such as shared power banks and vending machines, and can also be applied to smart home scenarios for intelligent control.

[0072] In some embodiments, the payment terminal can also implement the device management method provided in the embodiment of the present application by running various computer executable instructions or computer programs. For example, computer executable instructions can be microprogram-level commands, machine instructions or software instructions. The computer program can be a native program or software module in the operating system; it can be a local (Native) application (APP, APPlication), that is, a program that needs to be installed in the operating system to run, such as a device management APP; it can also be a small program that can be embedded in any APP, that is, a program that can be run only by downloading it to a browser environment. In short, the above-mentioned computer executable instructions can be instructions in any form, and the above-mentioned computer program can be an application, module or plug-in in any form.

[0073] The following continues to describe the structure of the electronic device provided in the embodiment of the present application. Take the electronic device as a payment terminal as an example, see Figure 2 , Figure 2 is a structural diagram of an electronic device 500 provided in an embodiment of the present application, Figure 2 The electronic device 500 shown includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to achieve connection and communication between these components. In addition to including a data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 540 is not shown in FIG. Figure 2 Various buses are labeled as bus system 540 .

[0074] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0075] The user interface 530 includes one or more output devices 531 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0076] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical drives, etc. The memory 550 may optionally include one or more storage devices that are physically remote from the processor 510.

[0077] The memory 550 includes volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.

[0078] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplified below.

[0079] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0080] A network communication module 552 for reaching other computing devices via one or more (wired or wireless) network interfaces 520 , exemplary network interfaces 520 including Bluetooth, WiFi, and USB;

[0081] a presentation module 553 for enabling presentation of information via one or more output devices 531 (e.g., a display screen, a speaker, etc.) associated with the user interface 530 (e.g., a user interface for operating peripheral devices and displaying content and information);

[0082] The input processing module 554 is configured to detect one or more user inputs or interactions from one of the one or more input devices 532 and to translate the detected inputs or interactions.

[0083] In some embodiments, the apparatus provided in the embodiments of the present application may be implemented in software. Figure 2 A device management device 555 stored in the memory 550 is shown, which can be software in the form of programs and plug-ins, including the following software modules: an acquisition module 5551, a determination module 5552 and a control module 5553. These modules are logical, so they can be arbitrarily combined or further split according to the functions implemented. The functions of each module will be explained below.

[0084] In other embodiments, the apparatus provided in the embodiments of the present application may be implemented in hardware. As an example, the apparatus provided in the embodiments of the present application may be a processor in the form of a hardware decoding processor, which is programmed to execute the device management method provided in the embodiments of the present application. For example, the processor in the form of a hardware decoding processor may be one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0085] The device management method provided in the embodiment of the present application will be specifically described below in conjunction with the exemplary application and implementation of the payment terminal provided in the embodiment of the present application.

[0086] It should be noted that in the embodiment of the present application, the payment terminal (for example, a palm payment terminal, a face payment terminal, etc.) can be connected to multiple controlled devices (for example, a shared power bank machine, a vending machine, etc.), and the multiple controlled devices can be located at different positions of the payment terminal.

[0087] See also Figure 3 , Figure 3 This is a flow chart of the device management method provided by the embodiment of the present application, which will be combined with Figure 3 The steps shown are explained.

[0088] It should be noted that Figure 3 The device management method illustrated can be executed by various computer programs running on a payment terminal, not limited to a client. For example, it can also be executed by the operating system, software module, script, and applet described above. Therefore, the following example using a client should not be construed as limiting the embodiments of this application. Furthermore, for ease of presentation, the following description does not specifically distinguish between a payment terminal and a client running on the payment terminal.

[0089] In step 101 , feature data of at least one dimension of a target object is obtained.

[0090] In some embodiments, before acquiring feature data of at least one dimension of the target object, the following processing may be performed: scanning multiple controlled devices to obtain location information of the multiple controlled devices; and storing the location information of the multiple controlled devices in the payment terminal.

[0091] It should be noted here that during the device scanning process, the location information of the controlled device can be obtained in a variety of ways, such as using wireless communication technology (such as Wi-Fi, Bluetooth, etc.) to detect nearby devices. During the scanning process, the payment terminal can attempt to establish a connection with each detected controlled device and obtain its device identification, model, status and other information; the location information of the controlled device is crucial for subsequent control operations. For example, in a smart home scenario, knowing the location of the light can help the system adjust the light more accurately. In an automated warehouse, knowing the location of the shelf can ensure that items are placed correctly. When obtaining the location information of the controlled device, the global positioning system (GPS) or other positioning technology can be used, or a radio frequency identification (RFID) tag, QR code or other identifier can be used to manually mark the location of the device. For example, in a store, each vending machine can be equipped with a unique QR code, and the staff can enter the device's location information into the system by scanning this QR code. Visual recognition technology can also be used, such as using a camera to recognize the characteristics of the device to automatically determine its location, which is not specifically limited here.

[0092] For example, taking the case where the multiple controlled devices are three vending machines (assuming they are vending machine 1, vending machine 2 and vending machine 3), in the technical solution provided in the embodiment of the present application, the three vending machines can be controlled by a payment terminal. At this time, the three vending machines can be scanned separately. It is assumed that the corresponding placement positions of the three vending machines near the payment terminal are left, front and right respectively (for example, it is assumed that vending machine 1 is detected to be on the left side of the payment terminal, vending machine 2 is detected to be in front of the payment terminal, and vending machine 3 is detected to be on the right side of the payment terminal), and then the location information of the three vending machines is stored in the payment terminal.

[0093] In some embodiments, the feature data of the at least one dimension may include the movement direction corresponding to the target part (e.g., palm, finger, wrist, etc.) of the target object, wherein the target part is the part of the target object that is bound to the biometric payment function. Figure 4A , Figure 4A This is a flow chart of the device management method provided in the embodiment of the present application. Figure 4A As shown, Figure 3Step 101 shown can be performed by Figure 4A Steps 1011A to 1013A shown are implemented by combining Figure 4A The steps shown are explained.

[0094] In step 1011A, image data is acquired, wherein the image data is obtained by capturing an image of the target object.

[0095] It should be noted here that the image data can be obtained by photographing the target object through an image acquisition device (such as a camera) in the payment terminal; in addition, the format of the image data can be portable network graphics (PNG), scalable vector graphics (SVG), graphics interchange format (GIF), or the position, value and other information of the pixel points in the image can be represented in the form of a matrix. The storage format of the image data is not specifically limited here.

[0096] In step 1012A, target part detection processing is performed on the image in the image data.

[0097] In some embodiments, the target part can be a pre-set part. For example, if only the palm is specified as the target part, then only the palm part of the image in the image data is detected and processed to determine information such as the position of the palm in the image; the target part can also be multiple pre-set parts. For example, if the palm, fingers and wrist are specified as the target parts, then when the target part detection is performed on the image in the image data, the palm, fingers and wrist will all be detected and processed to obtain information such as the position of the corresponding parts.

[0098] In some embodiments, the target part of the image in the image data is detected and processed. First, the image can be preprocessed and an image denoising method can be used to further improve the accuracy of the target part detection. Then, an image enhancement method is used to enhance the image features of the target part in the image to make it easier to identify. The image enhancement method includes contrast enhancement, brightness adjustment, color balance, etc. Then, an image segmentation method is used to divide the image into multiple regions or objects for processing so as to facilitate further processing. Finally, a preprocessed image is obtained. Thereafter, feature extraction can be performed on the image, including edge detection, texture analysis, shape recognition, etc., to obtain feature data of the image. Finally, the target part in the image is located according to the extracted feature data. Common positioning methods include locating the target part based on feature data and identifying the target part based on machine learning methods.

[0099] In step 1013A, in response to detecting the target part from a plurality of continuously acquired images, the corresponding moving directions of the target part in the plurality of images are determined.

[0100] In some embodiments, target part detection processing is performed on multiple continuously collected images, and based on the size and position changes of the target part in different images, the position change information of the target part is determined. Based on the position change information of the target part, the corresponding movement direction of the target part in multiple images is determined.

[0101] For example, taking the target part as the palm, assuming that the horizontal direction of the image is the x direction, the vertical direction is the y direction, and the direction perpendicular to the image plane is the z direction, the palm part detection and processing are performed on multiple continuously collected images. According to the change in the size of the palm between different images, the coordinate transformation of the palm in the z direction is determined. Based on the position movement of the palm between different images, the coordinate transformation of the palm in the x direction and the y direction is determined. According to the coordinate transformation of the palm in the x, y and z directions, the corresponding movement direction of the palm in multiple images is determined.

[0102] In other embodiments, the feature data of at least one dimension may further include an indication direction corresponding to a target part of the target object. The acquisition of feature data of at least one dimension of the target object may be achieved in the following manner: performing image acquisition on the target object to obtain image data of the target object; performing target part recognition processing on the image in the image data; and determining the indication direction corresponding to the target part in response to the target part recognized in the image.

[0103] For example, taking the target part as a finger, the image of the target object is captured, the finger in the image data is identified and processed, and the direction of the finger is determined as the indication direction corresponding to the target part based on the identified finger. For example, if the direction of the finger is the lower left, then the indication direction corresponding to the target part is determined to be the lower left. If multiple fingers are identified in the image, the indication direction of the longest finger can be used as the indication direction of the target part. It can also be set according to user needs, and the direction of the finger set by the user can be used as the indication direction of the target part. For example, the direction of the index finger is set as the indication direction of the target part, or the indication direction of the shortest finger identified in the image is set as the indication direction of the target part.

[0104] In some embodiments, when the payment terminal is a face-scanning payment terminal, the feature data of the at least one dimension mentioned above may also include the sight direction of the target object. Figure 4B , Figure 4B This is a flow chart of the device management method provided in the embodiment of the present application. Figure 4B As shown, Figure 3 Step 101 shown can be performed by Figure 4B Steps 1011B to 1013B shown are implemented by combining Figure 4B The steps shown are explained.

[0105] In step 1011B, an image of the target object is captured to obtain image data.

[0106] As mentioned above, there is no specific limitation on the specific method for obtaining image data and the storage format, and no detailed description is given here.

[0107] In step 1012B, face detection processing is performed on the image in the image data.

[0108] In some embodiments, the above-mentioned face detection processing of images in the image data can be achieved by: preprocessing the images in the image data, wherein the preprocessing includes grayscale, noise filtering, image enhancement and other operations, which can effectively improve the quality of the image and reduce the difficulty of subsequent image processing; using a computer vision algorithm to extract facial features from the processed image, where the facial features are mainly based on feature information related to color, texture, shape, etc., and Haar features (Haar, Haar-like features) and local binary patterns (LBP, Local Binary Pattern) can be used for feature extraction, or a deep learning model (such as a convolutional neural network (CNN)) can be used to automatically extract features; and performing face detection processing on the image based on the facial feature information.

[0109] It should be noted here that corresponding algorithms or models are usually used to perform face detection processing on images. For example, by sliding a window in the image, feature matching or classification is performed on the area within each window to determine whether the area contains facial information. Common face detection algorithms can be used for detection processing, such as the reference template method, face rule method, sample learning method, feature sub-face method, etc., or face detection algorithms based on deep learning can be used for detection processing, such as the multi-task convolutional neural network (MTCNN).

[0110] In step 1013B, in response to detecting the face of the target object from the captured image, the sight direction of the target object is determined.

[0111] In some embodiments, the above-mentioned determination of the target object's line of sight direction in response to detecting the target object's face from the captured image can be achieved in the following manner: in response to detecting the target object's face from the captured image, determining the key point positions of the eyes in the face, calculating the vectors of the two eyes based on the key point positions of the eyes, and determining the target object's line of sight direction based on the calculated vectors of the two eyes.

[0112] In some embodiments, the eyes can be located based on the face of the target object detected in the captured image using a facial landmark detection algorithm. For example, the shape_predictor model in the dlib library can be used to determine the location and orientation of the eye landmarks. The eye's gaze direction can then be inferred based on the location and orientation of the eye landmarks. For example, if the captured image data detects that the user's gaze is to the left, i.e., the user is looking left, then the controlled device located to the left of the payment terminal is designated as the target controlled device.

[0113] In some embodiments, when the payment terminal is associated with a microphone, the feature data of at least one dimension mentioned above may also include the sound emitted by the target object. Then, the above-mentioned acquisition of feature data of at least one dimension of the target object may be achieved in the following manner: voice of the target object is collected through a microphone to obtain the voice emitted by the target object, wherein the type and number of microphones are related to the environment in which the payment terminal is located. For example, in a large supermarket environment, there are a large number of associated microphones, and a microphone type with a more significant noise reduction effect is selected for deployment.

[0114] For example, in a noisy shopping mall environment, the checkout terminal can often be associated with multiple microphones. The types of microphones deployed at the same time have a more significant noise reduction effect to ensure that the microphone can more accurately capture the voice of the target object.

[0115] In some embodiments, the geometric layout of the microphone array can also be determined to maximize the directionality and sensitivity of the microphone array, thereby more accurately identifying the source of speech, effectively improving the quality of audio data acquisition, and thereby improving the accuracy of audio recognition.

[0116] For example, in scenarios with almost no interference, a linear microphone array layout can be used. This layout is simple and convenient to design, and the output audio is the weighted sum of the audio of each microphone; in scenarios with a large number of microphones, a planar microphone array layout can be used, which will be more detailed in the division of space, thereby achieving the purpose of enhancing voice quality and reducing noise, and can be applied to scenarios with low noise interference; when in scenarios with severe noise interference, a stereo microphone array can be used to achieve 360° output in space, effectively solving the problem of untimely signal response caused by the height of various angles.

[0117] In some embodiments, beamforming technology can also be used to suppress noise and enhance human voices, or to identify only sounds from a certain angle and reduce interference from sounds from other angles. This can more accurately obtain the audio signal of the target object and improve the recognition accuracy of the target object audio.

[0118] In step 102 , a target controlled device is determined from a plurality of controlled devices based on feature data of at least one dimension, wherein the target controlled device is a controlled device that a target object desires to use.

[0119] In some embodiments, the feature data of at least one dimension includes at least one of the following: the moving direction corresponding to the target part of the target object, the sound emitted by the target object, and the frequency of use of the target object for multiple controlled devices. Figure 5 , Figure 5 This is a flow chart of the device management method provided in the embodiment of the present application. Figure 3 Step 102 shown may be performed by Figure 5 Steps 1021 to 1022 shown are implemented by combining Figure 5 The steps shown are explained.

[0120] In step 1021 , the priority order of feature data settings of at least one dimension is obtained.

[0121] It should be noted here that the priority order of the feature data of at least one dimension is pre-set. For example, the frequency of use of the target object for multiple controlled devices has a higher priority than the movement direction corresponding to the target part of the target object, and the movement direction corresponding to the target part of the target object has a higher priority than the sound emitted by the target object.

[0122] In step 1022 , a target controlled device is determined from a plurality of controlled devices based on the feature data of at least one dimension and the priority order.

[0123] For example, the target controlled device determined by the moving direction corresponding to the target part of the target object is the controlled device corresponding to brand A, the target controlled device determined by the sound emitted by the target object is the controlled device corresponding to brand B, and the target controlled device determined by the usage frequency of the target object for multiple controlled devices is the controlled device corresponding to brand C. The first priority of the characteristic data is the usage frequency of the target object for multiple controlled devices, the second priority is the sound emitted by the target object, and the third priority is the moving direction corresponding to the target part of the target object. According to the priority order, the target controlled device is determined to be the controlled device corresponding to brand C.

[0124] In some embodiments, when the feature data of at least one dimension includes the moving direction corresponding to the target part of the target object, the above-mentioned determination of the target controlled device from multiple controlled devices based on the feature data of at least one dimension can be achieved in the following way: the controlled device corresponding to the moving direction among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

[0125] For example, take multiple controlled devices as shared power banks of three different brands, namely brand A, brand B and brand C. Assume that the shared power bank of brand A is located on the left side of the payment terminal, the shared power bank of brand B is located on the right side of the payment terminal, and the shared power bank of brand C is located in front of the payment terminal. By detecting the moving direction corresponding to the target part of the target object, it is obtained that the moving direction of the target part is to the left, then the shared power bank of brand A located on the left side of the payment terminal is determined as the target shared power bank machine, that is, the target controlled device.

[0126] In some embodiments, the moving direction includes a horizontal moving direction component and a vertical moving direction component. The above-mentioned determination of the controlled device corresponding to the moving direction among multiple controlled devices as the target controlled device that the target object expects to use can be achieved in the following way: in response to the situation where multiple controlled devices are stacked in the same position, the controlled device corresponding to the horizontal moving direction component and the vertical moving direction component among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

[0127] For example, take multiple controlled devices as shared power banks of four different brands, namely brand A, brand B, brand C and brand D. Assume that the shared power banks of brand A and brand B are stacked on the left side of the payment terminal, for example, assume that the shared power bank of brand A is located above the shared power bank of brand B, and the shared power banks of brand C and brand D are stacked on the right side of the payment terminal, for example, assume that the shared power bank of brand C is located above the shared power bank of brand D. By detecting the moving direction of the target part of the target object, the corresponding moving direction is obtained to be to the upper left. According to the moving direction component of the moving direction in the horizontal direction, the corresponding target shared power bank is determined to be the shared power bank of brand A and brand B. Then, according to the moving direction component of the moving direction in the vertical direction, the shared power bank of brand A is determined to be the target shared power bank, that is, the target controlled device.

[0128] In some embodiments, when the feature data of at least one dimension includes an indicated direction corresponding to a target part of a target object, the above-mentioned determination of a target controlled device from a plurality of controlled devices based on the feature data of at least one dimension can be achieved in the following manner: determining the controlled device corresponding to the indicated direction among the plurality of controlled devices as the target controlled device that the target object expects to use.

[0129] For example, take multiple controlled devices as shared power banks of two different brands, namely brand A and brand B. The shared power bank of brand A is located on the left side of the payment terminal, and the shared power bank of brand B is located on the right side of the payment terminal. By detecting the indication direction corresponding to the target part of the target object, the indication direction of the target part is obtained to the left, and the shared power bank of brand A located on the left side of the payment terminal is determined as the target shared power bank, that is, the target controlled device.

[0130] In some embodiments, the indication direction includes a horizontal indication direction component and a vertical indication direction component. The above-mentioned determination of the controlled device corresponding to the indication direction among multiple controlled devices as the target controlled device that the target object expects to use can be achieved in the following way: in response to the situation where multiple controlled devices are stacked in the same position, the controlled device corresponding to the horizontal indication direction component and the vertical indication direction component among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

[0131] For example, take multiple controlled devices as shared power banks of four different brands, namely brand A, brand B, brand C and brand D. Assume that the shared power banks of brand A and brand B are stacked on the left side of the payment terminal, for example, assume that the shared power bank of brand A is located above the shared power bank of brand B, and the shared power banks of brand C and brand D are stacked on the right side of the payment terminal, for example, assume that the shared power bank of brand C is located above the shared power bank of brand D. By detecting the indication direction of the target part of the target object, the corresponding indication direction is obtained as the lower right. According to the indication direction component of the indication direction in the horizontal direction, the corresponding target shared power bank machines are determined to be the shared power bank machines of brand C and brand D. Then, according to the indication direction component of the indication direction in the vertical direction, the shared power bank of brand D is determined to be the target shared power bank machine, that is, the target controlled device.

[0132] In some embodiments, when the payment terminal is a face-scanning payment terminal, the feature data of at least one dimension includes the line of sight direction of the target object. Then, the above-mentioned determination of the target controlled device from multiple controlled devices based on the feature data of at least one dimension can be achieved in the following way: the controlled device corresponding to the line of sight direction of the target object among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

[0133] For example, take multiple controlled devices as vending machines of two different brands, namely brand A, brand B and brand C. The vending machine of brand A is placed on the left side of the face-scanning payment terminal, the vending machine of brand B is placed in front of the face-scanning payment terminal, and the vending machine of brand C is placed on the right side of the face-scanning payment terminal. According to the face-scanning payment terminal's facial detection and processing of the target object, it is determined that the target object's line of sight is to the right, that is, the user is looking to the right, then the vending machine corresponding to brand C is determined as the target vending machine that the user wants to use, that is, the target controlled device.

[0134] In some embodiments, the payment terminal can be associated with a microphone, and the feature data of at least one dimension includes the sound emitted by the target object. Then, the above-mentioned determination of the target controlled device from multiple controlled devices based on the feature data of at least one dimension can be achieved in the following way: parsing the voice emitted by the target object to obtain the keywords carried by the voice; and determining the controlled device that matches the keywords among the multiple controlled devices as the target controlled device that the target object expects to use.

[0135] It should be noted that the keyword here can be the identifier of the controlled device, such as the brand name of the controlled device, or the location information of the controlled device. For example, assuming that the keyword obtained by parsing is "left", the controlled device located on the left side of the payment terminal can be used as the target controlled device.

[0136] For example, taking MFCC-based speech keyword recognition as an example, after collecting the audio data of the target object, the audio signal can be preprocessed to enhance the audio signal characteristics and reduce noise interference to obtain preprocessed audio; then, each frame of the audio is converted from the time domain to the frequency domain through Fast Fourier Transform (FFT), and then a set of Mel filters are used to simulate the auditory characteristics of the human ear to map the spectrum to Mel frequencies. Then, the logarithm of each Mel frequency output by the Mel filter is taken to further enhance the low-frequency part of the audio, and the signal after logarithm processing is discrete cosine transformed to obtain MFCC coefficients, and the MFCC features of the audio are extracted; then, the MFCC features are normalized to reduce the influence of environmental factors, and a keyword model is established. Here, the keyword model can be trained on a large amount of annotated speech data using a machine learning algorithm (such as a hidden Markov model, deep learning, etc.), and the MFCC features of the input audio signal are matched with the keyword model, and the best matching keyword is selected as the recognition result. In order to exclude erroneous recognition, a threshold may be set when matching keywords. Only when the matching score exceeds the threshold is the keyword determined to be correctly recognized, thereby enhancing the accuracy of keyword recognition.

[0137] In some embodiments, the feature data of at least one dimension includes the frequency of use of the target object for multiple controlled devices. The above-mentioned determination of the target controlled device from multiple controlled devices based on the feature data of at least one dimension can be achieved in the following way: the controlled device with the highest frequency of use by the target object among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

[0138] For example, taking the smart home scenario as an example, the scenario contains multiple controlled devices, such as TV, audio, air conditioner, etc. These controlled devices are finally controlled through a mobile terminal. The background of the mobile terminal collects the frequency of use of each controlled device by the user in the past period of time. For example, in the past month, the average daily usage time of the user's TV is 5 hours, the average daily usage time of the audio is 2 hours, and the average daily usage time of the air conditioner is 1 hour. Through background data statistics, it is determined that the controlled device with the highest frequency of use by the user in recent times is the TV. When the user uses the mobile terminal to control, the TV is used as the target controlled device that the user expects to use.

[0139] For example, take multiple controlled devices as shared power banks of three different brands, namely Brand A, Brand B and Brand C. After the user passes the authentication through the payment terminal, the background statistics show that the shared power bank with the highest rental frequency in recent times is Brand A. After the user authentication is completed, the shared power bank of Brand A will be used as the target shared power bank that the user expects to use.

[0140] In step 103, the target controlled device is controlled to execute corresponding services.

[0141] In some embodiments, the above-mentioned control of the target controlled device to perform the corresponding service can be achieved in the following ways: when the target controlled device is a mobile power supply compartment, control the mobile power supply compartment to pop out the mobile power supply; when the target controlled device is a vending machine, control the vending machine to drop the corresponding items.

[0142] For different controlled devices, the control execution services will also be different; when the target controlled device is a mobile power warehouse (such as a shared power bank machine), controlling the power warehouse to pop out the mobile power can be achieved through wireless communication technology (such as WiFi, Bluetooth or near-field communication (NFC)), or through wired data transmission. The user can send instructions to the mobile power warehouse through the payment terminal. When the mobile power warehouse receives the pop-up instruction, the mechanical system inside the mobile power warehouse will be activated, pushing the mobile power out of the warehouse body; when the target controlled device is a vending machine, controlling the vending machine to drop the corresponding items usually involves steps such as item identification, payment verification and item distribution. The user can select the target vending machine through the payment terminal, and then further select the target item for the target vending machine. The target vending machine will trigger the corresponding operation based on the selected target item, and control the vending machine to drop the corresponding target item.

[0143] In some embodiments, when the above-mentioned target controlled device is unable to perform the corresponding service, that is, when there is no available mobile power supply in the target mobile power supply compartment, or there is no corresponding item in the target vending machine, a corresponding prompt message can be displayed on the payment terminal, prompting the target object to select other controlled devices to perform the corresponding service.

[0144] Below, we will explain an exemplary application of the embodiment of the present application in a practical application scenario. This exemplary application describes the specific implementation process of the device management method in a shared power bank scenario.

[0145] In some embodiments, see Figure 6 , Figure 6 This is a schematic diagram of the palm-swipe payment terminal provided in an embodiment of the present application. By setting the palm-swipe payment terminal to central control mode, that is, all shared power bank devices are associated and controlled by one palm-swipe payment terminal, and different shared power bank devices are placed in different positions around the palm-swipe payment terminal, a central control is formed in a multimodal form, which supports multiple auxiliary judgment methods, such as palm-swipe direction, voice, and user frequent use, to further confirm the shared power bank that the user wishes to rent, so that shared power bank devices of multiple brands can share one palm-swipe payment terminal, which can effectively reduce deployment costs.

[0146] In some embodiments, see Figure 7 , Figure 7 This is a schematic diagram of the stacking of shared power banks of different brands provided in the embodiment of the present application. When merchants lay out shared power banks, the location information of the current shared power banks can be entered into the settings of the palm-swiping payment terminal. In addition to being placed horizontally, shared power banks can also be stacked so that the location information of shared power banks is not limited to the horizontal dimension. For example, see Figure 8 , Figure 8 This is a schematic diagram of the correspondence between different brands of shared power banks and location information provided by the embodiment of the present application. Figure 8 For example, the shared power bank machine of brand A corresponds to position A. The machine placement position corresponding to position A is the upper left. The corresponding position information of the shared power bank machine of brand A is the upper left. Similarly, the corresponding position information of the shared power bank machine of brand B is the middle, and the corresponding position information of the shared power bank machine of brand C is the upper right.

[0147] In some embodiments, the brand information can be input by the user and the association can be made using several default directional positions provided by the system. For example, the position can be the upper left, the middle, and the upper right. When a merchant launches a new shared power bank device, the merchant can place the current shared power bank device on the camera of the palm-swipe payment terminal to scan and identify the brand, and move the device to the corresponding area to form a track, so that the device can identify and confirm the actual location of the current shared power bank device through the track. After the location is confirmed, it cannot be moved again. After the configuration is completed, the brand of the shared power bank that the current user wishes to rent can be confirmed by the direction of the user's palm swiping.

[0148] In some embodiments, see Figure 9 , Figure 9 This is a schematic diagram of an embodiment of the present application for determining the corresponding brand of shared power bank based on the palm swiping direction. The collected user palm data can be used for feature extraction. The extracted features are mainly information such as the shape of the palm. Then, a classification model is trained on the features through a machine learning algorithm or a deep learning model, and the palm directions are divided into different categories. Commonly used classification algorithms include support vector machines, decision trees, convolutional neural networks, etc.

[0149] It should be noted here that if multiple brand shared power bank devices are only placed horizontally, only the one-dimensional direction of the palm needs to be judged, that is, the palm direction is left, right or middle; if multiple brand shared power bank devices are placed horizontally and vertically stacked in addition, in addition to judging the horizontal direction of the palm, the angle between the palm direction and the vertical direction also needs to be judged, increasing the judgment dimension to ensure that the number of judgment dimensions is the same as the number of brands of shared power banks.

[0150] In some embodiments, in order to be able to more quickly and提前识别到用户的租借品牌共享充电宝意图,引入了语音识别技术来辅助判断,参见 Figure 10 , Figure 10 FIG. is a schematic diagram of determining a shared power bank corresponding to a brand according to voice recognition provided by an embodiment of the present application. It mainly runs a voice recognition engine locally, and at the same time collects user voice data in front of the palm brushing payment terminal through an array microphone. Because the first user in the front is likely to be the current rental user, and voice recognition only occurs locally on the device and will not store the user's voice in any form and will be immediately destroyed; in addition, voice recognition only confirms through matching information of brand keywords, such as X Power, X Power, X Group, etc. When the user is approaching, if the voice includes keywords such as "X Group shared power bank", then this keyword is likely to represent that the user is a user renting a shared power bank of X Group.

[0151] In some embodiments, in the process of confirming the voice direction through an array microphone, by selecting the type and number of microphones and determining the shape and layout of the microphone array, the directivity and sensitivity of the microphone array can be maximally improved; and digital signal processing technology will also be used to preprocess the microphone signal, such as filtering, gain control, delay correction, etc., which can effectively improve the signal-to-noise ratio and accuracy; then voice signal processing technology, such as short-time Fourier transform (STFT, Short-Time Fourier Transform), Mel-frequency cepstral coefficients (MFCC, Mel-Frequency Cepstral Coefficients), etc., is used to extract voice features from the microphone signal, and then pattern recognition technology, such as support vector machine (SVM, Support Vector Machine), Gaussian mixture model (GMM, Gaussian Mixture Model), etc., is used to compare the extracted voice features with a pre-trained model to determine the estimated value of the voice direction.

[0152] It should be noted that in the original text of item , there is an unclear expression "提前识别到". It is tentatively translated as "more quickly and提前识别到", and you can adjust it according to the actual situation.In some embodiments, in the process of implementing voice recognition to confirm whether a keyword is hit, the audio signal can be preprocessed first, such as noise reduction, gain control, voice segmentation and other methods to improve the signal-to-noise ratio and voice quality. Then, the audio signal is converted into a feature vector, usually using MFCC or its variants to extract features such as the spectrum, energy and tone of the voice. Finally, keyword detection technology is used, such as threshold-based detection, probability-based detection and other methods, to detect specific keywords or phrases to determine whether brand keywords appear in the voice.

[0153] In some embodiments, the coexistence of multiple brands of shared power banks can be solved by users making relevant common settings on the client front end, or by pre-authorizing on the mobile phone to allow the instant messaging platform to obtain the shared power bank information that the user has recently used. This allows for user-defined brand priority decisions and will prioritize the user's common configuration as the highest priority when multiple brands of shared power banks coexist. Figure 11 , Figure 11 This is a schematic diagram of the MaxPay payment transaction timing provided by the embodiment of the present application, such as Figure 11 As shown, after multiple shared power bank devices have been deployed and updated, when a user approaches a palm-swipe payment terminal, the terminal initializes and starts the local voice and palm direction analysis engine. The analysis engine then sends a palm-swipe recognition request to the client backend service. The client backend service returns the user's commonly used shared power bank information based on the user's identity and dispatches the corresponding shared power bank device based on the decision priority. The server then synchronizes the user's rental status with the third-party platform service and provides feedback to the user. Palm direction recognition, voice recognition, and the user's commonly used configuration are the core components of the engine that analyzes multiple brands of shared power banks. In terms of priority, the user's commonly used configuration is used first, followed by palm direction, and finally voice recognition. In addition, the user's commonly used configuration can also take into account whether the brand information configured by the current user is available in the current environment. For example, it can determine whether there is a shared power bank of a certain brand or whether the shared power bank brand that the user frequently uses is used normally. If the user's commonly used configuration conditions are not met, the palm direction will be taken as the first priority. After confirming the user's palm swiping recognition corresponding to the user's identity information, it will further determine the current user's intention to rent a shared power bank brand. Finally, the user's identity information is obtained and returned to the corresponding brand of shared power bank equipment in the form of Bluetooth. After receiving the user information, the shared power bank equipment of each brand will use the user's current identity to perform related applications such as rental contract signing and deduction. Finally, the shared power bank will pop up to complete the shared power bank rental service.

[0154] By setting the palm-swipe payment terminal to central control mode, the convenience and efficiency of renting shared power banks can be greatly improved. In this mode, a single palm-swipe payment terminal can centrally control and manage all connected shared power banks, eliminating the need for a separate palm-swipe payment terminal for each shared power bank. The implementation of this central control mode relies on the communication and coordination mechanism between the palm-swipe payment terminal and the shared power bank. It also introduces other auxiliary judgment methods. For example, voice recognition technology can be used to allow users to select the shared power bank they wish to rent through voice commands. Alternatively, based on the user's historical usage records and behavioral habits, intelligent recommendations can be made for the shared power bank that the user is most likely to rent, further improving the system's accuracy and user experience. These auxiliary judgment methods can complement palm-swipe recognition technology to jointly enhance the system's intelligence.

[0155] The following continues to describe the exemplary structure of the device management device 555 provided in the embodiment of the present application as a software module. In some embodiments, such as Figure 2 As shown, the software modules stored in the device management device 555 of the memory 550 may include: an acquisition module 5551, used to obtain feature data of at least one dimension of the target object; a determination module 5552, used to determine a target controlled device from multiple controlled devices based on the feature data of at least one dimension, wherein the target controlled device is a controlled device that the target object expects to use; and a control module 5553, used to control the target controlled device to perform corresponding services.

[0156] In some embodiments, the feature data of at least one dimension includes the moving direction corresponding to the target part of the target object, wherein the target part is the part of the target object bound to the biological payment function. The acquisition module 5551 is also used to obtain image data, wherein the image data is obtained by capturing an image of the target object; performing target part detection processing on the image in the image data; and determining the moving direction corresponding to the target part in the multiple images in response to detecting the target part from multiple images captured continuously.

[0157] In some embodiments, the payment terminal includes a face-scanning payment terminal, and the feature data of at least one dimension includes the line of sight direction of the target object. The acquisition module 5551 is also used to capture an image of the target object to obtain image data; perform face detection processing on the image in the image data; and determine the line of sight direction of the target object in response to detecting the face of the target object from the captured image.

[0158] In some embodiments, the payment terminal is associated with a microphone, and the feature data of at least one dimension includes the voice emitted by the target object. The acquisition module 5551 is also used to collect the voice of the target object through the microphone to obtain the voice emitted by the target object, wherein the type and number of microphones are related to the environment in which the payment terminal is located.

[0159] In some embodiments, the determination module 5552 is further configured to determine a controlled device corresponding to the moving direction among the multiple controlled devices as a target controlled device that the target object desires to use.

[0160] In some embodiments, the moving direction includes a horizontal moving direction component and a vertical moving direction component. The determination module 5552 is also used to, in response to the situation where multiple controlled devices are stacked in the same position, determine the controlled device corresponding to the horizontal moving direction component and the vertical moving direction component among the multiple controlled devices as the target controlled device that the target object expects to use.

[0161] In some embodiments, the determination module 5552 is further configured to determine a controlled device corresponding to the sight line direction of the target object among the multiple controlled devices as the target controlled device that the target object desires to use.

[0162] In some embodiments, the determination module 5552 is further configured to parse the speech uttered by the target object to obtain keywords carried in the speech; and determine the controlled device matching the keywords among the multiple controlled devices as the target controlled device that the target object desires to use.

[0163] In some embodiments, the feature data of at least one dimension includes the frequency of use of the target object for multiple controlled devices. The determination module 5552 is further used to determine the controlled device with the highest frequency of use by the target object among the multiple controlled devices as the target controlled device that the target object expects to use.

[0164] In some embodiments, the characteristic data of at least one dimension includes at least one of the following: the moving direction corresponding to the target part of the target object, the voice emitted by the target object, and the frequency of use of the target object for multiple controlled devices. The determination module 5552 is also used to obtain the priority order set for the characteristic data of at least one dimension; based on the characteristic data of at least one dimension and the priority order, determine the target controlled device from multiple controlled devices.

[0165] In some embodiments, before acquiring feature data of at least one dimension of the target object, the storage module is used to scan multiple controlled devices to obtain location information of the multiple controlled devices; and store the location information of the multiple controlled devices in the payment terminal.

[0166] In some embodiments, the control module 5553 is further used to control the mobile power supply compartment to pop out the mobile power supply when the target controlled device is a mobile power supply compartment; and to control the vending machine to drop corresponding items when the target controlled device is a vending machine.

[0167] It should be noted that the description of the device in the embodiment of the present application is similar to the description of the method embodiment above, and has similar beneficial effects as the method embodiment, so it will not be repeated. Figure 3 、 Figure 4A 、 Figure 4B or Figure 5 The present invention should be understood by referring to the description of any one of the accompanying drawings.

[0168] The present invention provides a computer program product comprising a computer program or computer-executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or computer-executable instructions from the computer-readable storage medium and executes the computer program or computer-executable instructions, causing the computer device to perform the device management method described in the present invention.

[0169] The embodiment of the present application provides a computer-readable storage medium in which computer-executable instructions or computer programs are stored. When the computer-executable instructions or computer programs are executed by a processor, the processor will execute the device management method provided by the embodiment of the present application, for example, Figure 3 、 Figure 4A 、 Figure 4B or Figure 5 The device management method shown.

[0170] In some embodiments, the computer-readable storage medium may be a ferroelectric random access memory (FRAM), ROM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic surface memory, optical disk, or compact disc read-only memory (CD-ROM); it may also be various devices including one or any combination of the above memories.

[0171] In some embodiments, executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0172] As an example, executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed across multiple sites and interconnected by a communication network.

[0173] To sum up, in the embodiment of the present application, multiple controlled devices are connected to the payment terminal, and the multiple controlled devices are located at different positions of the payment terminal. The target controlled device is determined based on the acquired characteristic data of at least one dimension, and the target controlled device is controlled to perform the corresponding service. In this way, multiple controlled devices can share one payment terminal, thereby effectively reducing the number of payment terminals, reducing the equipment deployment cost, and improving the user experience.

[0174] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the scope of protection of the present application.

Claims

1. A device management method, characterized in that: Applied to a payment terminal, the payment terminal is connected to multiple controlled devices, and the multiple controlled devices are located at different positions of the payment terminal; The method comprises: Acquire feature data of at least one dimension of the target object; determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension, wherein the target controlled device is a controlled device that the target object desires to use; Control the target controlled device to execute corresponding services.

2. The method according to claim 1, characterized in that The feature data of at least one dimension includes a moving direction corresponding to a target part of the target object, wherein the target part is a part of the target object bound to a biometric payment function; The acquiring feature data of at least one dimension of the target object includes: Acquiring image data, wherein the image data is obtained by capturing an image of the target object; performing detection processing of the target part on the image in the image data; In response to detecting the target part from the plurality of images acquired continuously, a corresponding moving direction of the target part in the plurality of images is determined.

3. The method according to claim 1, characterized in that The determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension includes: A controlled device corresponding to the moving direction among the multiple controlled devices is determined as a target controlled device that the target object desires to use.

4. The method according to claim 3, characterized in that The moving direction includes a horizontal moving direction component and a vertical moving direction component; The step of determining the controlled device corresponding to the moving direction among the plurality of controlled devices as the target controlled device that the target object desires to use includes: In response to the multiple controlled devices being stacked at the same position, the controlled device corresponding to the horizontal movement direction component and the vertical movement direction component among the multiple controlled devices is determined as the target controlled device that the target object expects to use.

5. The method according to claim 1, wherein The payment terminal includes a face-scanning payment terminal, and the feature data of at least one dimension includes the sight direction of the target object; The acquiring feature data of at least one dimension of the target object includes: Capturing an image of the target object to obtain image data; Performing face detection processing on the image in the image data; In response to detecting the face of the target object from the captured image, determining a gaze direction of the target object; The determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension includes: A controlled device corresponding to the sight line direction of the target object among the multiple controlled devices is determined as a target controlled device that the target object desires to use.

6. The method according to claim 1, characterized in that The payment terminal is associated with a microphone, and the feature data of at least one dimension includes a voice emitted by the target object; The acquiring feature data of at least one dimension of the target object includes: The target object's voice is collected by the microphone to obtain the voice uttered by the target object, wherein the type and number of the microphones are related to the environment in which the payment terminal is located.

7. The method according to claim 6, characterized in that The determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension includes: Parsing the speech of the target object to obtain keywords carried in the speech; A controlled device that matches the keyword among the multiple controlled devices is determined as a target controlled device that the target object desires to use.

8. The method according to claim 1, characterized in that The feature data of the at least one dimension includes the usage frequency of the target object for the multiple controlled devices; The determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension includes: A controlled device that is most frequently used by the target object among the multiple controlled devices is determined as a target controlled device that the target object desires to use.

9. The method according to claim 1, characterized in that Before acquiring feature data of at least one dimension of the target object, the method further includes: Scanning the multiple controlled devices to obtain location information of the multiple controlled devices; The location information of the multiple controlled devices is stored in the payment terminal.

10. The method according to claim 1, characterized in that The controlling the target controlled device to execute the corresponding service includes: When the target controlled device is a mobile power supply compartment, controlling the mobile power supply compartment to eject the mobile power supply; When the target controlled device is a vending machine, the vending machine is controlled to drop corresponding items.

11. The method according to claim 1, characterized in that The feature data of at least one dimension includes at least one of the following: a moving direction corresponding to a target part of the target object, a voice emitted by the target object, and a usage frequency of the target object for the multiple controlled devices; The determining a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension includes: Obtaining a priority order set for the feature data of the at least one dimension; Based on the feature data of the at least one dimension and the priority order, a target controlled device is determined from the multiple controlled devices.

12. A device management device, characterized in that: Applied to a payment terminal, the payment terminal is connected to multiple controlled devices, and the multiple controlled devices are located at different positions of the payment terminal; The device comprises: An acquisition module, configured to acquire feature data of at least one dimension of a target object; a determination module, configured to determine a target controlled device from the plurality of controlled devices based on the feature data of the at least one dimension, wherein the target controlled device is a controlled device that the target object desires to use; The control module is used to control the target controlled device to execute corresponding services.

13. An electronic device, characterized in that: include: a memory for storing computer-executable instructions; The processor is configured to implement the device management method according to any one of claims 1 to 11 when executing the computer-executable instructions stored in the memory.

14. A computer-readable storage medium, characterized in that Computer executable instructions are stored, and when executed by a processor, the device management method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program or computer executable instructions, characterized in that When the computer program or computer executable instructions are executed by a processor, the device management method according to any one of claims 1 to 11 is implemented.

Images