Millimeter wave radar detection of physical actions coupled with access point offload control center

Abstract

A system includes a millimeter (MM) wave radar detector, where the MM wave radar detector generates signal data associated with a person of interest (POI) within a field of view of the MM wave radar detector. The system also includes an access point (AP) coupled with the MM wave radar detector. The AP includes a computing device to receive and analyze the signal data provided by the MM wave radar detector to determine a movement or action of the POI within the field of view and to facilitate generation of a feedback response in response to the determined movement or action of the POI.

Description

[0001] Cross Reference to Related Applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 016,534, filed April 28, 2020, entitled “Adapting MMWave Detection of Physical Actions to an Access point Off-Load ControlCenter,” which is incorporated herein by reference in its entirety for all purposes. Technical Field

[0003] This disclosure relates to using MM wave technology to detect human physical movements. Background Technology

[0004] Following human movements and then determining a response involves numerous technologies and diverse applications. A problem associated with systems achieving such characteristics is the limited wattage dissipated in the equipment that will be installed in a room (e.g., suspended from the ceiling or otherwise connected to the room). Radar and image processing associated with detecting and identifying the physical actions or movements of people of interest require considerable power and significant power dissipation. Therefore, it is difficult to effectively deploy such detection systems in areas of interest, particularly in networked systems capable of analyzing signal data from such detection systems efficiently and promptly. Attached Figure Description

[0005] Figure 1 An embodiment of a detection system is described, which includes multiple millimeter (MM) wave radar detectors coupled to access points (APs) in a mesh network system for detecting and monitoring the actions / movements of people of interest (POIs) and providing feedback information based on or in response to such actions / movements.

[0006] Figure 2 Describing for Figure 1 An example embodiment of the MM-wave radar detector system is shown, illustrating the detection field of view associated with the detector.

[0007] Figure 3 Depicting Figure 1 The characteristics of the system's access point (AP).

[0008] Figure 4 It describes the use of Figure 1 The flowchart describes the process by which a system detects, identifies, and monitors the actions / movements of a person of interest (POI) and provides feedback responses based on or in response to such detected actions / movements.

[0009] Figure 5 Describes the realization Figure 1 Example implementation of a system in a business environment, the system is used to detect and monitor customer actions / movements and provide feedback information (including product information) to the customer based on or in response to such actions / movements.

[0010] Figure 6 It shows the use of Figure 5 The flowchart illustrates an example embodiment of a process for detecting, identifying, and monitoring customer actions / movements and providing feedback responses based on or in response to such detected actions / movements. Detailed Implementation

[0011] Overview

[0012] Various aspects of the invention are set forth in the independent claims, and preferred features are set forth in the dependent claims. A feature of one aspect may be applied to any aspect alone or in combination with other aspects.

[0013] In one embodiment, the system includes a millimeter (MM) wave radar detector that generates signal data associated with a person of interest (POI) within the field of view of the MM wave radar detector. The system also includes an access point (AP) coupled to the MM wave radar detector, the AP including a computing device for receiving and analyzing the signal data provided by the MM wave radar detector to determine movement or action of the POI within the field of view, and facilitating the generation of a feedback response in response to the determined movement or action of the POI.

[0014] In another embodiment, a method includes: scanning a detection area where a person of interest (POI) is located using a plurality of millimeter (MM) wave radar detectors to generate signal data associated with the detection area; analyzing the signal data via a computing device to determine movement or action of the POI; and facilitating the generation of a feedback response by an external device near the detection area via the computing device, wherein the feedback response is in response to the determined movement or action of the POI.

[0015] In another embodiment, one or more computer-readable storage media are provided, the computer-readable storage media being encoded with software including computer-executable instructions that, when executed, are operable to control a plurality of millimeter (MM) wave radar detectors to scan a detection area where a person of interest (POI) is located in order to generate signal data associated with the detection area; analyze the signal data to determine movement or action of the POI; and facilitate feedback response generated by an external device approaching the detection area, wherein the feedback response is responsive to the determined movement or action of the POI.

[0016] Example Implementation

[0017] This disclosure relates to a system comprising an access point (AP) connecting a millimeter-wave (MM-wave) radar component to a network, such as in a mesh network system (where the AP provides one of multiple access points for the mesh network), for offloading signal data within the network from the MM-wave radar component to one or more computing devices (e.g., the computing devices may be integrated with the AP, or decoupled from the AP but coupled to or communicating with it), for detecting human movement or actions in a specific environment. The computing device includes one or more suitable software applications that include instructions operable to enable system operation by the computing device in the manner described herein. Based on MM-wave radar detection, certain actions can also be taken via other devices in the network coupled to the AP (and controlled by the computing device). Specifically, computing devices associated with the mesh AP network system (via AP) receive signal data from one or more MM-wave radar detectors, analyze the signal data to determine the movement or action of a person within the field of view of one or more MM-wave radar detectors, and generate feedback information for the person based on or in response to the determined movement or action (wherein the feedback information may be in the form of information provided in visual and / or audio formats via any one or more devices controlled by the system and located in close proximity to the person).

[0018] refer to Figures 1-3 An example embodiment of system 10 is described, in which one or more MM-wave radar detectors 20 are connected to a mesh access point (AP) 100. Each MM-wave radar detector 20 includes MM stripes or arrays that transmit RF (radio frequency) signals at a corresponding wavelength in a defined frequency range (e.g., approximately 30 GHz to approximately 300 GHz) (e.g., within 1 mm) and in a range of 1–10 mm (e.g., approximately 1 mm). Each detector 20 is configured as a transceiver to transmit RF signals (via a Tx antenna) to a target area to cover or encompass approximately 120° of the detector's detection field (where the optimal coverage may be a 90° window within the detector array). Each detector 20 further scans for reflected RF signals reflected from objects (e.g., persons of interest (also referred to herein as POIs)) located within the detection range. The reflected signals captured by each detector 20 (via an Rx antenna) can be combined and used to form an image representing the POI by “plotting” the detected POI from which the signal is reflected. Therefore, it is possible to identify POIs within the field of view of detector 20, as well as the precise movement or action of the POI, such as arm movement towards an object, head movement indicating that the POI may be looking at an object or area at a certain moment, and identification of the current direction in which the POI is currently moving.

[0019] Any selected number of MM-wave radar detectors 20 can be arranged for system 10 and oriented relative to each other and over the desired detection area to provide sufficient detection coverage for the detection area in which physical movement or physical action of a person within the detection area is desired. For example, a single detector 20 may be implemented in some cases. Alternatively, any selected number (e.g., two, three, four or more) of detectors 20 may be provided for specific situations in which more signal data may be desired to accurately identify and detect the movement and / or action of a person of interest (e.g., in...). Figures 1-3 The system 10 depicts three detectors 20). Detectors 20 can each be directly connected to AP 100 (e.g., Figure 1 (As shown). Alternatively, detector 20 can be connected to master detector 20, which in turn is connected to AP 100. The connection between the detector and AP 100 can be made via any suitable connection, such as a Universal Serial Bus (USB) connection, which facilitates the transmission of signal data and also facilitates power supply from the AP to each detector.

[0020] Radio frequency signal data is provided from MM-wave radar detector 20 (individually or via a main detector) to AP 100 for processing to identify and detect physical movement or physical actions of a person of interest (POI). As previously described, AP 100 may provide bidirectional signal communication with detector 20 and power via a suitable connection (e.g., one or more USB connectors 116 forming part of AP's network interface 112). AP 100 may also provide additional connections to detector 20 and other components of the network, such as Power over Ethernet (PoE) connections and / or other types of cable and / or system network connections (which provide high-speed data and higher power connections over a greater range than typical PoE connections), to communicate with and control these components, and to provide power to these components for certain system embodiments as described herein. Furthermore, for certain embodiments described herein, AP 100, detector 20, and other components of the system may be configured with suitable hardware and software to send and receive wireless communications (e.g., via Bluetooth wireless technology) with AP and / or other components associated with the system.

[0021] refer to Figure 3AP 100 includes one or more computing devices, which include one or more processors (e.g., depicted as processor 110), one or more memory structures (depicted as memory 120), a network interface 112, and any number of input / output (I / O) devices 140 (e.g., keyboard, display, speaker, microphone, camera, mouse, or other suitable cursor controller, etc.) that facilitate user interaction with one or more of the computing devices associated with the system 10. The network interface 112 includes any suitable hardware that facilitates hard-wired and / or wireless connectivity with one or more other computing devices associated with the system 10 (e.g., Ethernet interface card or switch, router, one or more USB connectors 116, one or more suitable hard-wired connectors 118 (e.g., PoE or other suitable cable connections that facilitate data transfer and provide power over short and / or longer lengths), Bluetooth hardware 115, etc.). AP 100 may be integrated as a single unit or may include multiple separate computing devices coupled to each other for communicating and exchanging information (via network interface 112). Each computing device and / or other component of the AP 100 can utilize any suitable operating system (e.g., Android, Microsoft Windows, Apple macOS, Apple iOS, Linux, etc.) to facilitate the interaction, communication, and exchange of data, operating instructions, and / or any other type of content with other computing devices associated with the system.

[0022] The memory 120 of AP 100 may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical / tangible memory storage devices, and any combination thereof. The memory 120 may be provided on a single computing device or multiple computing devices of AP 100. Processor 110 may include at least one microprocessor that executes control processing logic instructions 122 stored within the memory 120, including operational instructions and software applications stored in such memory. Typically, the memory 120 may include one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions that, when executed by processor 110, are operable to perform the system operations described herein for the identification and detection of POIs and their physical actions and / or physical movements (via analysis of signal data received by detector 20), and to provide feedback information to the POIs for the embodiments described herein.

[0023] Specifically, memory 120 includes application module 124, which includes one or more software applications that, when executed via processor 110, analyze and process signal data received from detector 20 and control one or more external device components of system 10 to provide feedback information to the POI in response to the processed and analyzed signal data. Memory 120 also includes application module 126, which includes one or more software driver applications that, when executed via processor 110, facilitate the control and operation of external device components providing feedback to the POI.

[0024] External device components (also referred to herein as external devices) that can communicate with and be controlled by AP 100 to facilitate the provision of feedback information to the POI will depend on the specific circumstances under which system 10 is integrated. Some non-limiting examples of external devices that can be coupled to AP 100 (e.g., via hard-wiring and / or wireless connection) include remotely controlled lighting devices (e.g., LEDs, LCDs, etc.), remotely controlled displays (e.g., LCD or LED displays), remotely controlled (e.g., electromechanical) servo motors coupled to an object, remotely controlled audio speaker devices, and remotely controlled portable computing devices (e.g., mobile phones or PDAs, etc.), wherein such devices can be accessed and / or controlled via AP to provide some form of feedback output to the POI in response to a detected physical action or movement of the POI.

[0025] Depending on the number and / or type of external device components to be coupled to the AP 100, at least a portion of the AP 100's network interface can be integrated into, for example, Figure 3 The network switching platform 180 shown is located within the AP 100. The network switching platform 180 may be integrated with the AP 100 or may comprise separate components including the same or similar hardware components (i.e., processor, memory, network interface, one or more I / O components, etc.) previously described herein with respect to the AP 100. An example embodiment of a suitable network switching platform used in System 10 is the Cisco Catalyst 9000 Series switching platform (Cisco Technologies).

[0026] Network switching platform 180 ensures fast and reliable communication with various external devices coupled to the AP, for example in an Internet of Things (IoT) environment, and can also provide appropriate power to such external devices via PoE or other suitable cable connections. Specifically, external (e.g., IoT) devices on the system network, as well as any other type of device (including any component of AP 100), can have their data connectivity and power requirements met by a single combined-function cable. Conventional examples of technologies providing this functionality are USB (Universal Serial Bus) and PoE (Power over Ethernet). In a typical PoE system, power is transmitted over a range of a few meters to approximately one hundred meters via the cable used for data transmission. When greater distances are required or fiber optic cables are used, or depending on power requirements based on the type and / or number of network devices to be powered, power can be supplied via a local power source such as a wall socket, where the cable can be modified to provide increased power and higher data speeds over greater distances. Example embodiments that provide combined power, data, and cooling from a central network device to multiple devices via cable and can be implemented as part of network switching platform 180 and / or network system 10 are described in U.S. Patent Application Publication No. 2019 / 0272011. Other non-limiting examples of system types that provide high power and data transmission and fault protection on a network in a secure manner and can be implemented as part of a network switching platform 180 and / or a network system 10 are described in U.S. Patent Application Publication No. 2019 / 0342011 and U.S. Patent No. 10,541,758.

[0027] Although Figures 1-3 Not shown, but an offloading device may also be provided, comprising one or more components directly attached to one or more MM-wave radar detectors and / or the AP, wherein the offloading device provides MM-wave image processing based on signals generated by the detectors. Alternatively, the AP 100 may receive raw signal data from the detectors and provide MM-wave image processing directly at the AP (e.g., using application module 124).

[0028] refer to Figure 4The flowchart below illustrates an example method utilizing system 10. An MM-wave radar detector 20 is positioned at a specific detection location or area (e.g., in a shop or other building) where it is desired to detect human movement or actions for a specific scenario or implementation of system 10. At 210, detector 20 scans the location within a defined time period (e.g., a period of seconds or minutes) by transmitting RF signals at an appropriate frequency and capturing reflected RF signals within the range of each detector. At 220, the reflected signal data within the defined time period is provided to AP 100 via detector 20 (e.g., via a USB connection between the detector and the AP).

[0029] At 230, (via application module 124) the signal data received by AP 100 is processed to identify whether the POI is in a specific location or area being detected, and also to identify (e.g., by generating an MM-wave radar image of the POI and further analyzing the image) whether the POI is involved in a specific physical movement or physical action. Physical movement or physical action is detected based on analysis of signal data provided to the AP by these detectors within a defined time period, wherein the signal data can be analyzed to define or “map” an image of the POI (based on the location of reflected RF signal data points in three-dimensional space covered by the detection range associated with the detectors). The image of the POI includes body parts of the POI (e.g., head and limbs) and indications of how these body parts are oriented and / or moving, and whether the POI is moving within the detection location and the defined detection time period, and in what direction it is moving within the detection location and the defined detection time period.

[0030] In response to the analysis and detection / determination of a specific physical movement and / or physical action by the POI, at 240, AP 100 directs (via application module 126) one or more physical devices to output a feedback response (e.g., in the form of a visual response, an audio response, and / or some form of information). In some embodiments, the feedback response may be provided directly to the POI. In other embodiments, the feedback response may be provided to another person who may be monitoring the movement or action of the POI. In yet another embodiment, the feedback response may be provided to both the POI and the other person. The type of response output may depend on the specific circumstances or environment in which system 10 is implemented and the type of external device coupled to the AP. Some non-limiting examples of output responses from external devices controlled by the AP include physical movement of an object at or near the detection area (e.g., to draw the POI's attention to the object), light emission at or near the detection area (e.g., turning on one or more LEDs or LCD lights), video images at the detection area (e.g., displaying information about purchasing available products or services or something associated with the detection area), audio warning signals or messages (e.g., live or recorded audio content or audio warning signals), and any combination of these responses.

[0031] After providing feedback to the POI, at 250 it is determined whether further detection of physical movement and / or actions within the detection area is needed based on specific circumstances. For example, system 10 can be configured for a single detection and feedback response (in which case, the method ends at 260 after the system has provided a single feedback response) or for continuous detection and feedback responses provided by the system to the POI. If system 10 is configured to continuously detect and identify POI movement and / or actions, the method is repeated again at 210.

[0032] System 10 can continuously detect / identify specific physical movements or actions and provide feedback responses specific to such detected / identified physical movements or actions. For example, the type of feedback response can be changed based on the type of movement or action detected at the POI and / or based on whether a specific feedback response has already been provided. For example, after a first time period of RF signal analysis and detection, the system can be configured to provide a specific response based on the detected specific POI physical movement or action (e.g., turning on an LED or LCD light at or near the detection area). In subsequent time periods of RF signal analysis and detection, the system can be configured to provide different physical responses based on the same or different specific POI physical movement or action detected for the first time period of analysis and detection (e.g., effective movement of an object at or near the detection area). In some cases, this can facilitate modification of the feedback response type (e.g., escalation). The system can also be configured to continuously repeat this process only within a set number of detection cycle loops.

[0033] Therefore, the content described in this article and Figures 1-3 The system shown can be implemented in various environments involving physical actions and / or movements of POIs, and optionally utilizes system actions based on such POI actions and / or user movements. Specifically, the system can be configured to detect a specific image of the POI, or changes within an image of the POI, or physical responses or actions associated with the POI within the detection area or field of view of one or more MM-wave radar detectors (based on processing signal data provided by the detectors), and the system can further generate visual and / or audio responses (or some other sensory notifications) as feedback information to the POI. The system can then wait for further physical changes in the POI detected based on signal data from the MM-wave radar detectors.

[0034] Now for reference Figure 5 and Figure 6 An example embodiment of system 10 is described in a specific environment. (See references) Figure 5 System 10 is implemented in a commercial or retail environment where the POI is a potential customer, and the detection area includes locations within a store that include publicly displayed and available-for-purchase products (e.g., groceries, electronics, textiles / fabrics / clothing items, etc.). Specifically, products can be arranged on a series of shelves 310, each shelf 310 including an electronically controlled servo motor (in... Figure 5 (Generally represented by element 315), the servo motor is hardwired to the network switching platform 180 via a suitable hardwired connection (to receive power from it) and wirelessly (e.g., via Bluetooth) and / or hardwired (via the network switching platform 180) coupled to the AP 100 (to receive control signals from the AP). Each servo motor (controlled by the AP 100) can be operated to achieve movement (e.g., vibratory movement, linear and / or rotational movement) to the corresponding shelf 310 to which the servo motor is connected, in order to provide selective feedback response. One or more lighting elements (e.g., such as...) Figure 5The illustrated lighting element 330 can be positioned at any one or more suitable locations along each shelf 310 (e.g., at or near one or more products located on a particular shelf). Each lighting element 330 is also hardwired to the network switching platform 180 (to receive power from the network switching platform 180) and wirelessly (e.g., via Bluetooth) and / or hardwired (via the network switching platform 180) coupled to the AP 100 (to receive control signals from the AP). Each lighting element 330 (e.g., an LCD or LED light) can be selectively controlled by the AP 100 to turn on or off as a selective feedback response. Furthermore, a display panel 320 (e.g., an LCD or LED display panel) is provided, which is hardwired to the network switching platform 180 (to receive power from it) and wirelessly coupled (e.g., via Bluetooth) and / or hardwired (via the network switching platform 180) coupled to the AP 100 to enable selective operation of the display panel 320 by the AP to provide selective content as a feedback response (by controlling the output of such content by the display).

[0035] refer to Figure 6 To describe using a flowchart Figure 5 System 10 operates in a commercial or retail environment. At 510, detector 20 scans (by sending RF radar waves to the detection area and capturing reflected waves) a detection area defined at a location adjacent to or very close to multiple shelves 310 within a defined time period. At 520, RF signal data from detector 20 is provided to AP 100. At 530, the signal data is analyzed by AP 100 (using application module 124). The AP's analysis of the signal data may include processing the signal data to identify and form an image of POIs 400 in the detection area (wherein the signal data is processed to "draw" an image of the POIs). The analysis may also include detecting physical movement or action of POI 400 relative to shelves 310 and / or specific products on shelves 310. For example, the detection analysis performed by the AP may include determining the physical movement of a limb or body part of POI 400 (e.g., the POI's arm or hand) toward a specific shelf and / or a specific product on shelf 310 (e.g., the POI may point at a product or reach or even pick up a product from the shelf). The detection analysis may also include, for example, determining what the POI might be looking at based on the specific directional movement of the POI's head in a direction toward a particular shelf or a particular product on the shelf. In this case, AP 100 already has information about the products on the shelves 310 in the detection area stored in its memory 120 (including the specific location of these products on each shelf 310), or has access to that information (e.g., via a product inventory database of the store or building integrated with system 10).

[0036] At 540, if the identification / detection process at 530 is the initial (i.e., first) identification of the POI and the detection of initial physical movement or motion (based on the analysis of signal data provided by the AP 100 to the detector 20), then the process proceeds to 550. At 550, an initial feedback response is provided to the POI via any external device controlled by the AP 100. For example, the AP may provide information about a product pointed to or held by the POI based on or in response to the detection of movement or motion of the POI, or alternatively via a controlled output of the display panel 320 to provide information about multiple products located on a particular shelf 310. The AP may also change the lighting associated with the shelf and / or the products on the shelf by turning on one or more lighting elements 330 controlled by the AP, or alternatively by turning on and / or turning off or controlling the intensity of one or more lights associated with one or more shelves or one or more products on the shelf. Alternatively, the AP may control the movement of the shelf 310 (e.g., vibrating the shelf) via the operation of one or more servo motors coupled to the AP.

[0037] For example, if the physical movement of a POI detected during a detection period indicates that the POI has picked up a specific product and placed it back on shelf 310, then vibration of the shelf can be initiated by the AP controlling the operation of a servo motor coupled to the shelf. Alternatively (or in conjunction with the vibration movement of the shelf), the AP 100 can control the display panel 320 to output information about the product visible to the POI (e.g., product price, product description such as product specifications and / or product contents, any current sales or discounts associated with the product, information about another product related to the product, etc.). In cases where the POI is pointing to or reaching (or looking at) a location on shelf 310 where the product space is empty (the AP 100 can determine whether a specific product is not in stock on shelf 310, for example, via product inventory information of a store accessible to the AP), the AP 100 can control the display panel 320 to output information related to other locations within the store where the product is available (e.g., other products located in the store's backup storage area) or other stores that offer the product. Alternatively, AP 100 can control display panel 320 to output information about one or more alternative and related products (available in stores and / or elsewhere) identified as having the same or similar attributes as the specific product of interest determined to be of interest to the POI. For example, AP 100 can access a database listing alternative products considered to be related to the product of interest that is not currently available in the store (e.g., as part of the product inventory in the store). Furthermore, AP 100 can control one or more lighting elements 330 to turn on or off (or control / change the intensity of such light) to refocus the POI's attention back on the product previously picked up from shelf 310.

[0038] After 540, repeat the operation, returning to 510, to further monitor the POI and see how it responds to the feedback provided.

[0039] Returning to 540 (after further physical movement or motion recognition / detection of scan signal data for the POI), and proceeding to 560 while the AP performs subsequent recognition / detection, in which the AP controlling the external device can provide further feedback to the POI. This further feedback response can be of the same type (e.g., via the same external device controlled by the AP) or of a different type (e.g., via a different external device controlled by the AP). After providing further feedback, the operation is repeated (returning to 510) for an appropriate number of further iterations. Subsequent recognition and detection of the POI's movement or motion can be used to determine how the POI reacts to each previous feedback response. This allows the system 10 to learn and gain a deeper understanding of the POI's intent regarding its movement or motion. This, in turn, can help provide modified feedback responses to the POI, potentially leading to enhanced decisions regarding the POI's purchase of specific products. For example, an initial feedback response provided by the POI based on or in response to the physical movement or action of the identified POI relative to a specific or particular product on shelf 310 could be the movement of shelf 310 (e.g., vibration) and / or control of one or more lighting elements 330 associated with the product or shelf (e.g., directly above the product on the shelf) to turn on and / or off (or change the intensity of one or more such lights). Such feedback responses (one or more) can be provided to help further attract the POI's attention or maintain the POI's interest in the product. Subsequent feedback responses (e.g., based on or in response to the detection of subsequent POI movement or action indicating a decrease in the POI's level of interest in the product) could be providing information about the product on display panel 320, such as the product's price, the availability of store discounts, coupons, or other cost savings associated with the product and / or any other related products.

[0040] Figure 5Embodiments may also implement other external devices to provide feedback to the user, including audio devices (e.g., speakers) to direct the POI's attention to products or shelves where the POI's prior interest is identified / detected. Additionally, in cases where the POI 400 carries a personal and portable electronic device 410 (e.g., a mobile phone / smartphone or any other type of personal digital assistant (PDA) device), the AP can access such a portable electronic device to send information associated with products deemed potentially of interest to the POI. For example, in cases where the POI's electronic device has access to a system network associated with the AP 100 (e.g., a store or building may provide WiFi access to customers), the AP 100 can identify the POI 400 based on a unique identifier associated with the POI's electronic device, which may be communicating with the system network in some form (e.g., via Bluetooth or other wireless communications). AP 100 can provide feedback (e.g., via Bluetooth or other wireless communication) to the portable electronic device 410 of POI 400 regarding product information (e.g., product pricing, product discounts such as coupons directly provided to the electronic device of POI, product location in the store where the POI is located, and other store locations). Furthermore, AP 100 can learn personalized product information associated with the POI by identifying the POI based on the unique identifier of the electronic device of the POI and by using a customer database that displays purchase preferences and / or purchase history of products associated with the POI. Based on this learned personalized product information associated with the POI, AP 100 can focus on or customize specific product information valuable to the POI when making purchase decisions about products in the store.

[0041] exist Figure 5In another example of the environment, one or more shelves 310 may include representations or labels for products rather than the actual products. For example, product labels may include slips of paper or tickets for the product, or empty boxes or containers displaying a representation of the product but not including the product itself. This situation may exist in some retail environments where the product is too large and / or too heavy for the customer / POI to carry to the checkout / sales counter. In other retail environments, the actual product may be particularly expensive (e.g., a computer or other electronic product), making control of the product carefully controlled before it is sold to the customer (e.g., for security purposes / theft prevention). When one or more identification / detection processing steps 530 have occurred in system 10 (detecting that the POI picks up the product label, holds the product label, and / or carries the product label away from the shelf 310 where the product label was removed), the feedback response generated by the system (e.g., in step 540 or 560) may include providing a warning message to the store employee via AP 100 (e.g., via a display accessible to the store employee, to a portable electronic device carried by the store employee, etc.). The alert message provided to store employees could be to retrieve a product (i.e., a product associated with a product tag carried or held by a customer / POI) from a storage location within the store (e.g., in a back room area or inventory / stock area accessible only to store employees) to the store checkout or purchase location where the customer / POI will make the purchase. Furthermore, AP 100 can be implemented with access to the store inventory of products, allowing AP 100 to confirm whether a product of interest is available (e.g., located within an inventory location and / or in another location within the store). Inventory information about the product can be provided to store employees as part of the alert message (to help facilitate product retrieval and transfer to the purchase location within the store). Additionally, if AP 100 (when accessing inventory) determines that a product is unavailable in the store (e.g., out of stock), AP 100 can provide feedback to the customer / POI, such as identifying an alternative product with similar quality, functionality, or attributes to the unavailable product. Products deemed relevant can be identified by AP 100, for example, through store inventory information accessible to AP 100 (e.g., for each product in inventory, the store inventory may include one or more alternative products considered relevant to that product). This can enhance the customer's buying experience by reducing potential wait times at the checkout location, as the product to be purchased can be moved from its inventory location in the store to the checkout location before or around the time the customer / POI carrying the product tag arrives and / or completes their purchase. Furthermore, for unavailable (e.g., out-of-stock) products, alternative products can be presented to the customer / POI, which also enhances the customer's in-store experience.

[0042] Therefore, implementing this system in a commercial or retail environment can enhance the customer's shopping or purchasing experience, as well as increase the quantity and / or type of business / retail.

[0043] The system embodiments described herein can also be implemented in other environments, where the physical actions or movements of a person of interest (POI) can be detected, and information can be provided to the POI based on such actions / movements and also based on the context of the environment.

[0044] For example, the system described herein can be implemented for emergency or other security applications, wherein the identification and detection of physical movement or motion of a POI in a detection area or region of interest via a combination of MM-wave radar detectors and APs can detect human responses during an emergency to achieve the following: directing people to the correct direction to leave in a fire (e.g., by flashing lights or redirecting people if they are moving in the wrong way as detected by the MM-wave radar detector); guiding firefighters to the fire source using messages, sounds, or vibrations in response to visual reactions detected by the MM-wave radar detector; guiding medical teams to appropriate areas within a building based on MM-wave radar detection, etc.

[0045] In a specific example scenario implemented in a building structure for emergency applications, system 10 may be implemented in which multiple MM-wave radar detectors 20, along with external devices (e.g., audio and / or visual warning elements), are placed at various locations within the building structure. These external devices are automatically controlled by AP 100 in response to feedback from POI movement or action detected in one or more detection areas within the building structure. External devices, such as lights and / or speakers, may be arranged, for example, along one or more lobbies within the building structure. External devices may be selectively activated and deactivated based on detected POI movement, such as movement along corridors within the building structure. For example, lights and / or audio alarms or broadcasts (indicating recommended movement directions) may be activated along lobbies and corridors to direct the POI toward emergency exits and / or away from emergencies within the building structure (e.g., detected fires or other detected emergencies within the building structure).

[0046] In other example embodiments, the system 10 described herein can be implemented to track missing children or other points of interest (POIs) in shops, schools, hospitals, or other public or private building structures (e.g., children wandering and / or behaving erratically, fearfully, etc., in a shop, where security personnel warn these children). Furthermore, children can be tracked using MM-wave radar detectors at detection areas such as entrances and exits (or other locations) of shops or other building structures and AP 100 providing feedback output for security purposes. In this environment, system 10 can be used to identify one or more persons entering and / or leaving a building with a child (who is a POI). The MM-wave radar detector can be configured to provide sufficiently detailed images of a specific POI and others with that POI at such detection areas to identify the specific POI and others with that POI. Feedback responses can be provided by AP 100, such as information sent to store employees (e.g., security personnel) via an external device associated with such employee in cases where one or more other persons detected with a child / POI in one detection area (e.g., store exit) do not match one or more other persons previously detected with a child / POI in another detection area (e.g., store entrance).

[0047] Therefore, the embodiments described herein provide systems and methods for integrating MM-wave radar technology into mesh access point (AP) systems for the purpose of providing feedback responses based on or in response to the detection of physical movement or physical action of a Point of Interest (POI) at one or more detection areas covered by MM-wave radar detectors (e.g., to the POI and / or another POI). Such feedback information can be beneficial to the POI (e.g., in enhancing the purchasing experience, or the security of the POI in a particular environment) and other information associated with the detection area (e.g., store owners, firefighters, security personnel, and / or other security personnel, etc.).

[0048] Therefore, an example embodiment of the system includes: a millimeter (MM) wave radar detector, wherein the MM wave radar detector generates signal data associated with a person of interest (POI) within the field of view of the MM wave radar detector; and an access point (AP) coupled to the MM wave radar detector, the AP including computing devices to receive and analyze the signal data provided by the MM wave radar detector to determine the movement or action of the POI within the field of view, and to facilitate the generation of a feedback response in response to the determined movement or action of the POI.

[0049] The system may include multiple MM-wave radar detectors that generate signal data associated with the POI within a detection area that includes multiple fields of view of the MM-wave radar detectors, and wherein the computing device of the AP generates an image of the POI based on the signal data provided by the MM-wave radar detectors.

[0050] The system may also include external devices controlled by the AP and providing feedback responses.

[0051] External devices for the system may include electric motors that are connected to respond to the movement of objects. In response, the motors may be connected to store shelves to move products on the shelves.

[0052] The system's external devices may also include a display that provides content to the POI as a feedback response. The content provided by the display may include information about products identified as of interest to the POI in response to movement or action of the identified POI within its field of view. Furthermore, the display may include the POI's personal electronic device.

[0053] In addition, the external devices of the system may include a speaker or a light-emitting element, the speaker providing an audio response as a feedback response, and the light-emitting element turning on or off or changing its intensity as a feedback response.

[0054] In another example embodiment, a method includes: scanning a detection area where a person of interest (POI) is located with a plurality of millimeter (MM) wave radar detectors to generate signal data associated with the detection area; analyzing the signal data via a computing device to determine movement or action of the POI; and facilitating the generation of a feedback response by an external device near the detection area via the computing device, wherein the feedback response is based on or in response to the determined movement or action of the POI.

[0055] The external device of the method may include an electric motor connected to a shelf in the store, and facilitating the generation of a feedback response may further include: controlling the operation of the electric motor via a computing device to move the shelf in response to the movement or action of a determined POI associated with an object on the shelf.

[0056] The method may also include an external device for a display, and facilitating the generation of a feedback response further includes controlling the operation of the display via a computing device to provide information about the object in response to movement or action of the identified POI. The POI may be a customer, the detection area may include an area within a store, and the object may include a product or a representation of a product available for purchase in the store. The information provided about the object may include product information selected from the group consisting of: the product's purchase price, one or more locations of the product within the store, discounts on the purchase price associated with the product, product contents or product specifications, and information about one or more other alternative products associated with the product. The identified customer's movement or action may include an indication that the customer is holding a representation of the product, and the information provided about the object may further include alerting store employees that the customer is purchasing the product, wherein the method may further include facilitating the transfer of the product associated with the representation of the product held by the customer from a storage location within the store to the purchase location within the store where the customer is purchasing the product. Furthermore, the information provided about the object may include information about alternative locations of the product in the store or product information identified as an alternative product associated with the product. In addition, the display may include a personal electronic device for the POI, and the control operation of the display may include controlling the personal electronic device for the POI via a computing device to provide information about the object.

[0057] The external device of the method may also include a speaker and / or a light-emitting element, and facilitating the generation of a feedback response may include: controlling the audio response emitted by the speaker and / or turning the light-emitting element on or off or changing the intensity of the light-emitting element via a computing device.

[0058] The method may further include: further scanning the detection area where the POI is located with an MM-wave radar detector to generate additional signal data associated with the detection area; further analyzing the additional signal data via a computing device to determine additional movement or action of the POI; and facilitating the generation of additional feedback response by a second external device near the detection area via the computing device. The additional feedback response may be based on or in response to the determined additional movement or action of the POI, and the second external device may be different from the original external device.

[0059] In another example embodiment, one or more computer-readable storage media may be provided, coded with software including computer-executable instructions, which, when executed, are operable to: control a plurality of millimeter (MM) wave radar detectors to scan a detection area where a person of interest (POI) is located in order to generate signal data associated with the detection area; analyze the signal data to determine movement or action of the POI; and facilitate the generation of a feedback response by an external device near the detection area, wherein the feedback response is based on or in response to the determined movement or action of the POI.

[0060] An external device that generates a feedback response via a computer-readable storage medium may include an electric motor connected to a shelf in a store, and facilitating the generation of a feedback response via a computer-readable storage medium may include controlling the operation of the electric motor to move the shelf based on or in response to movement or action associated with an object on the shelf at a determined point of interest (POI).

[0061] An external device that generates a feedback response via a computer-readable storage medium may also include a display, and facilitating the generation of a feedback response may further include controlling the operation of the display to provide information about the object based on or in response to movement or action of the identified point of interest (POI).

[0062] The instructions of the computer-readable storage medium are also operable to: control the MM-wave radar detector to further scan the detection area where the POI is located in order to generate additional signal data associated with the detection area, further analyze the additional signal data to determine additional movement or action of the POI, and facilitate the generation of additional feedback response by a second external device near the detection area, wherein the additional feedback response may be based on or in response to the determined additional movement or action of the POI, and the second external device may be different from the external device.

[0063] Data related to the operations described herein can be stored in any conventional or other data structure (e.g., file, array, list, stack, queue, record, etc.) and in any desired storage unit (e.g., database, data or other repository, queue, etc.). Data transferred between entities can include any desired format and arrangement and can include any number of fields of any type and size for storing data. The definition and data model of any dataset can indicate the overall structure in any desired manner (e.g., computer-related language, graphical representation, list, etc.).

[0064] This embodiment can employ any number and type of user interface (e.g., graphical user interface (GUI), command line, prompts, etc.) to obtain or provide information (e.g., data related to a scraping website), wherein the interface can include any information arranged in any manner. The interface can include any number and type of input or actuation mechanisms (e.g., buttons, icons, fields, boxes, links, etc.) arranged in any location to input / display information and initiate desired actions via any suitable input device (e.g., mouse, keyboard, etc.). The interface screen can include any suitable actuators (e.g., links, labels, etc.) that navigate between screens in any manner.

[0065] The environment of the current embodiment of the access point (AP) and other components of the network system may include any number of computers or other processing systems (e.g., client or end-user systems, server systems, etc.) and databases or other repositories arranged in any desired manner, wherein the current embodiment can be applied to any desired type of computing environment (e.g., cloud computing, client-server, network computing, mainframe, standalone systems, etc.). The computers or other processing systems employed in this embodiment may be implemented by any number of any personal or other type of computers or processing systems (e.g., desktop computers, laptop computers, PDAs, mobile devices, etc.) and may include any combination of any commercially available operating system and commercially available custom software (e.g., machine learning software, etc.). These systems may include any type of monitor and input device (e.g., keyboard, mouse, voice recognition, etc.) for inputting and / or viewing information.

[0066] It should be understood that the software of this embodiment can be implemented in any desired computer language and can be developed by those skilled in the art based on the functional descriptions contained in the specification and the flowcharts shown in the accompanying drawings. Furthermore, any reference herein to software performing various functions generally refers to a computer system or processor performing these functions under software control. Alternatively, the computer system of this embodiment can be implemented by any type of hardware and / or other processing circuitry.

[0067] Each component of the AP described herein and / or other parts of the system network may be coupled to and / or interact with each other through an interface and / or any other suitable connection (wired or wireless) that provides a feasible path for communication. The interconnects, interfaces, and variations thereof discussed herein can be used to provide connectivity between elements in a system and / or to provide communication, interaction, operation, etc., between elements in a system that can be directly or indirectly connected. Any combination of interfaces may be provided for the elements described herein to facilitate the operation discussed in the various embodiments described herein.

[0068] The various functions of a computer or other processing system can be distributed in any manner across any number of software and / or hardware modules or units, processing or computer systems and / or circuits, wherein the computers or processing systems can be arranged locally or remotely to each other and communicate via any suitable communication medium (e.g., LAN, intranet, Internet, hardwired, modem connection, wireless, etc.). For example, the functions of this embodiment can be distributed in any manner among various computer devices and / or any other intermediate processing devices. The software and / or algorithms shown above and in the flowcharts can be modified in any way to implement the functions described herein. Furthermore, the functions in the flowcharts or descriptions can be executed in any order to achieve the desired operations.

[0069] The software of this embodiment can be obtained on a fixed or portable program product device or a non-transitory computer-usable medium (e.g., magnetic or optical medium, magneto-optical medium, floppy disk, CD-ROM, DVD, memory device, etc.) for use as a standalone system or a system connected via a network or other communication medium.

[0070] The AP and other components of the system network can be implemented by any number and type of communication networks (e.g., LAN, Internet, intranet, VPN, etc.). The computer or other processing system in this embodiment may include any conventional or other communication device that communicates over the network via any conventional or other protocol. The computer or other processing system may access the network using any type of connection (e.g., wired, wireless, etc.). The local communication medium can be implemented by any suitable communication medium (e.g., local area network (LAN), hardwired, wireless link, intranet, etc.).

[0071] The system can employ any number of any conventional or other databases, data storage or storage structures (e.g., files, databases, data structures, data or other repositories, etc.) to store information (e.g., data related to contact center interaction routing). The database system can be implemented using any number of any conventional or other databases, data storage or storage structures (e.g., files, databases, data structures, data or other repositories, etc.) to store information (e.g., data related to contact center interaction routing). The database system can be included within or coupled to the system network. The database system and / or storage structures can be located remotely or locally within the APs and / or other computing devices in the system network and can store any desired data (e.g., data related to contact center interaction routing).

[0072] The presented embodiments can take various forms, such as systems, methods, and / or computer program products of any possible technical detail or level of integration. A computer program product may include a computer-readable storage medium (or media) having computer-readable program instructions thereon for causing a processor to perform the aspects presented herein.

[0073] Computer-readable storage media can be tangible devices capable of retaining and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example, but not limited to, electronic storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer-readable storage media includes: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable optical disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanically encoded devices, perforated cards or raised structures such as those with instructions recorded thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein should not be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0074] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to a suitable computing / processing device, or downloaded via a network (e.g., the Internet, a local area network, a wide area network, and / or a wireless network) to an external computer or external storage device. The network may include copper cables, optical fibers, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to a computer-readable storage medium within the suitable computing / processing device.

[0075] The computer-readable program instructions used to perform the operations of this embodiment may be assembly instructions, instruction set-architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, configuration data for integrated circuits, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and procedural programming languages ​​such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on one or more computing devices of the AP, partially on one or more computing devices of the AP, or as a separate software package, partially on one or more computing devices of the AP and partially on a remote computer, or entirely on a remote computer or another server. In the latter case, the remote computer may be connected to one or more computing devices of the AP via any type of network, including a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet provided by an Internet service provider). In some embodiments, electronic circuits including, for example, programmable logic circuits, field-programmable gate arrays (FPGAs) or programmable logic arrays (PLAs) can execute computer-readable program instructions by using state information of computer-readable program instructions to personalize the electronic circuits in order to perform the aspects presented herein.

[0076] In summary, a system includes a millimeter (MM) wave radar detector, wherein the MM wave radar detector generates signal data associated with a person of interest (POI) within the field of view of the MM wave radar detector. The system also includes an access point (AP) coupled to the MM wave radar detector. The AP includes computing devices to receive and analyze the signal data provided by the MM wave radar detector to determine movement or motion of the POI within the field of view, and to facilitate the generation of a feedback response in response to the determined movement or motion of the POI.

[0077] This embodiment is described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0078] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / actions specified in one or more boxes of a flowchart and / or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium that can instruct a computer, programmable data processing apparatus, and / or other apparatus to function in a particular manner, such that the computer-readable storage medium in which the instructions are stored includes an article of writing comprising instructions for implementing aspects of the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0079] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus or other apparatus to cause a series of operational steps to be performed on the computer, other programmable apparatus or other apparatus to produce a computer-implemented process, such that the instructions that execute on the computer, other programmable apparatus or other apparatus implement the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0080] The flowcharts and / or block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments. In this regard, each box in a flowchart or block diagram may represent a module, segment, or portion of instructions, including one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions indicated in the boxes may not occur in the order shown in the figures. For example, depending on the function involved, two boxes shown consecutively may actually be executed substantially simultaneously, or these boxes may sometimes be executed in reverse order. It will also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or action or executes a combination of dedicated hardware and computer instructions.

[0081] Various embodiments have been described for illustrative purposes, but are not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles of the embodiments, their practical application, or technical improvements to existing technologies in the market, or to enable those skilled in the art to understand the embodiments disclosed herein.

Claims

1. A system for detection, comprising: a plurality of millimeter (MM) wave radar detectors, wherein the millimeter (MM) wave radar detectors generate signal data associated with a person of interest (POI) within a detection area based on movement of the person of interest (POI) relative to a physical object, wherein the millimeter (MM) wave radar detectors are separate from the object; and an access point (AP) separate from the millimeter (MM) wave radar detectors and the object, the access point (AP) comprising a computing device configured to: receive and analyze the signal data provided by the millimeter (MM) wave radar detectors, wherein the analysis comprises defining an image of the person of interest (POI) in three-dimensional space to determine movement or action of the person of interest (POI) relative to the object within the detection area, and facilitate generation of a feedback response responsive to the determined movement or action of the person of interest (POI); wherein the system is operable within a store such that the millimeter (MM) wave radar detectors generate signal data associated with the person of interest (POI) within a field of view in an area of the store, the object comprises a product for sale within the store, and the computing device of the access point (AP) further: analyzes the signal data provided by the millimeter (MM) wave radar detectors to determine whether the person of interest (POI) is holding an indication of a representation of the product; and provides a message to an employee of the store to transfer the product from a storage location of the object within the store to a purchase location of the person of interest (POI) within the store to purchase the product responsive to determining, based on the analyzed signal data provided by the millimeter (MM) wave radar detectors, that the person of interest (POI) is holding the representation of the product.

2. The system of claim 1, further comprising: an external device controlled by the access point (AP) to provide the feedback response.

3. The system of claim 2, wherein, the external device comprises a motor connected to move the object as the feedback response.

4. The system of claim 3, wherein, the motor is connected to a store shelf to move a product on the shelf as the feedback response.

5. The system of any one of claims 2 to 4, wherein, the external device comprises a display to provide content to the person of interest (POI) as the feedback response.

6. The system of claim 5, wherein, the content provided by the display comprises information about a product determined to be of interest to the person of interest (POI) responsive to the determined movement or action of the person of interest (POI) within the field of view.

7. The system of claim 6, wherein, the display comprises a personal electronic device of the person of interest (POI).

8. The system of any one of claims 2 to 4, wherein, the external device comprises a speaker to provide an audio response as the feedback response or a light emitting element to turn on or off or change intensity as the feedback response.

9. A method for detection, comprising: scanning a detection area within a store in which a person of interest (POI) is located with a plurality of millimeter (MM) wave radar detectors to generate signal data associated with the detection area; analyzing, via the computing device, the signal data to determine movement or action of the person of interest POI, wherein analyzing the signal data comprises providing an indication of whether the person of interest POI is holding a representation of the product; facilitating, via the computing device, generation of a feedback response by an external device in proximity to the detection area, wherein the feedback response is responsive to the determined movement or action of the person of interest POI, the external device comprises a display, and the generation of the feedback response comprises controlling, via the computing device, operation of the display to provide information about the product responsive to the determined movement or action of the person of interest POI; and responsive to the indication that the person of interest POI is holding the representation of the product, providing a message to an employee of the store to transfer the product from a storage location of the product within the store to a purchase location within the store at which the person of interest POI is to purchase the product.

10. The method of claim 9, wherein, the external device comprises a motor connected to a shelf in a store, and facilitating generation of the feedback response further comprises: controlling, via the computing device, operation of the motor to move the shelf responsive to the determined movement or action of the person of interest POI being associated with a product on the shelf.

11. The method of claim 9, wherein, the provided information about the product comprises product information selected from the group consisting of: a purchase price of the product, one or more locations of the product within the store, a discount associated with the purchase price of the product, product content or product specifications, and information about one or more other alternative products related to the product.

12. The method of any one of claims 9-11, wherein, the provided information about the product comprises product information about an alternative location of the product in the store or an alternative product identified as being related to the product.

13. The method of any one of claims 9 to 11, wherein, the display comprises a personal electronic device of the person of interest POI, and controlling the display comprises controlling, via the computing device, the personal electronic device of the person of interest POI to provide the information about the product.

14. The method of any one of claims 9-11, wherein, the external device comprises a speaker and / or a light emitting element, and facilitating generation of the feedback response comprises controlling, via the computing device, an audio response emitted by the speaker and / or turning on or off the light emitting element or changing an intensity of the light emitting element.

15. The method of any one of claims 9 to 11, further comprising: further scanning, with the MM-wave radar detector, a detection area in which the person of interest POI is located to generate further signal data associated with the detection area; further analyzing, via the computing device, the further signal data to determine further movement or action of the person of interest POI; and facilitating, via the computing device, generation of a further feedback response by a second external device in proximity to the detection area, wherein the further feedback response is responsive to the determined further movement or action of the person of interest POI, and the second external device is different from the external device.

16. One or more computer-readable storage media encoded with software comprising computer-executable instructions and when executed operable to: control a plurality of millimeter (MM) wave radar detectors to scan a detection area within a store in which a person of interest (POI) is located to generate signal data associated with the detection area; analyze the signal data to determine a movement or action of the POI relative to a product within the store, wherein, the analysis comprises determining whether the POI is holding a representation of the product; and facilitate generation of a feedback response by an external device proximate to the detection area, wherein the feedback response is responsive to the determined movement or action of the POI relative to the product, wherein the external device comprises a display and the generation of the feedback response comprises controlling operation of the display via a computing device to provide information about the product responsive to the determined movement or action of the POI; and in response to a determination that the POI is holding the representation of the product, provide a message to an employee of the store to transfer the product from a storage location of the product within the store to a purchase location within the store at which the POI is purchasing the product. the external device comprises a motor connected to a shelf in the store, and the instructions are further operable to facilitate generation of the feedback response by controlling operation of the motor to move the shelf responsive to the determined movement or action of the POI being associated with a product on the shelf. the external device comprises a display, and the instructions are further operable to facilitate generation of the feedback response by controlling operation of the display to provide information about the product responsive to the determined movement or action of the POI.

17. The one or more computer-readable storage media of claim 16, wherein, the instructions are further operable to:

18. The one or more computer-readable storage media of claim 16 or 17, wherein, control the MM wave radar detectors to further scan the detection area in which the POI is located to generate further signal data associated with the detection area; 19. The one or more computer-readable storage media of claim 16 or 17, wherein, further analyze the further signal data to determine a further movement or action of the POI; and facilitate generation of a further feedback response by a second external device proximate to the detection area, wherein the further feedback response is responsive to the determined further movement or action of the POI, and the second external device is different than the external device.

20. An apparatus for detecting, comprising: means for scanning a detection area within a store in which a person of interest (POI) is located with a plurality of millimeter (MM) wave radar detectors to generate signal data associated with the detection area; means for analyzing the signal data via a computing device to determine a movement or action of the POI, wherein analyzing the signal data comprises providing an indication of whether the POI is holding a representation of a product; and ​ ​ means for facilitating, via the computing device, generation of a feedback response by an external device in proximity to the detection area, wherein the feedback response is responsive to the determined movement or action of the person of interest POI relative to the product, the external device includes a display, and the generation of the feedback response includes controlling operation of the display via the computing device to provide information about the product responsive to the determined movement or action of the person of interest POI; and means for providing a message to an employee of the store in response to an indication that the person of interest POI is holding a representation of the product, for use in transporting the product from a storage location of the product within the store to a purchase location within the store at which the person of interest POI is to purchase the product.

21. The apparatus of claim 20, further comprising means for implementing the method of any of claims 10 to 15.

22. A computer program product comprising instructions which, when executed by a computer, cause the computer to carry out the steps of the method of any of claims 9 to 15.

Images