A method and apparatus for big data customer profile analysis and data display

Abstract

This invention discloses a method and apparatus for big data customer profile analysis and data display. The method includes: recognizing an image to be identified currently collected by smart glasses to obtain a first recognition result, the first recognition result including recognition results corresponding to one or more analyzable objects, the analyzable objects including analyzable products and / or analyzable customers; determining customer profile analysis data of the objects to be analyzed based on the first recognition result; generating a corresponding customer profile visualization result based on the customer profile analysis data; and displaying the customer profile visualization result on the displayable lens of the smart glasses. Therefore, implementing this invention enables the recognition of images to be identified by smart glasses to obtain customer profile visualization results of products or customers, and displays them through the displayable lens of the smart glasses, improving the convenience of customer profile analysis data application and diversifying the practical application scenarios of customer profile analysis data.

Description

Technical Field

[0001] This invention relates to the field of user profiling analysis technology, and in particular to a method and apparatus for displaying big data customer profiling analysis data. Background Technology

[0002] With the advent of the big data era, businesses can extract commercially valuable information from data to build customer profiles, thereby analyzing and predicting customer behavior and preferences for more precise marketing and promotion. A customer profile refers to the labeling of customer information, that is, collecting various customer data and behaviors to derive basic customer information and typical characteristics, ultimately forming a customer persona.

[0003] However, in practice, it has been found that existing customer profiling data is usually presented in the form of analytical reports. Enterprises need to further analyze the analytical reports before they can apply the customer profiling data to their subsequent marketing and promotion. This results in low convenience of applying customer profiling data, and customer profiling data can usually only be applied to online marketing and promotion, resulting in a relatively limited actual application scenario for customer profiling data. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a method and apparatus for displaying big data customer profile analysis data, which can improve the convenience of applying customer profile analysis data and diversify the actual application scenarios of customer profile analysis data.

[0005] To address the aforementioned technical problems, the first aspect of this invention discloses a method for displaying big data customer profile analysis data, the method comprising:

[0006] The image to be identified is currently collected by the smart glasses to obtain a first identification result of the image to be identified. The first identification result includes the identification result corresponding to one or more analyzable objects in the image to be identified. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses.

[0007] Based on the first identification result, customer profile analysis data of the object to be analyzed among all the analyzable objects are determined;

[0008] Based on the customer profile analysis data, generate a visual result of a customer profile that matches the object to be analyzed;

[0009] The customer profile visualization results are displayed in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, wherein the displayable lens includes a lens with display function.

[0010] As an optional implementation, in the first aspect of the present invention, before determining the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result, the method further includes:

[0011] When the first recognition result indicates that the image to be recognized contains multiple analyzable objects, the eye image of the wearer of the smart glasses currently collected by the smart glasses is recognized to obtain a second recognition result of the eye image;

[0012] Based on the second recognition result, determine the wearer's current gaze direction;

[0013] Based on the direction of gaze and the distribution position of each analyzable object in the image to be identified, the analyzable object actually observed by the wearer is determined from all the objects to be analyzed, and is taken as the object to be analyzed for customer profile analysis.

[0014] As an optional implementation, in the first aspect of the present invention, before determining the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result, the method further includes:

[0015] Based on the second identification result, the wearer's role type is determined;

[0016] Based on the role type, determine whether the wearer meets the data viewing permission conditions of the object to be analyzed;

[0017] When it is determined that the wearer does not meet the data viewing permission conditions of the object to be analyzed, a target remaining analyzable object that makes the wearer meet the corresponding data viewing permission conditions is determined from all remaining analyzable objects, and is taken as a new object to be analyzed. The operation of determining the customer profile analysis data of the object to be analyzed from all the analyzable objects based on the first identification result is triggered. The remaining analyzable objects include all the other analyzable objects besides the object to be analyzed.

[0018] As an optional implementation, in the first aspect of the invention, determining a target remaining analyzable object from all remaining analyzable objects that satisfies the wearer's corresponding data viewing permission conditions, as a new object to be analyzed, includes:

[0019] The analysis priority of each remaining analyzable object is determined based on the pre-determined distance between each remaining analyzable object and the object to be analyzed in the image to be identified and / or the actual distance between each remaining analyzable object and the smart glasses;

[0020] Arrange all remaining analyzable objects in descending order of analysis priority to obtain the analyzable object sequence;

[0021] From the sequence of analyzable objects, identify the remaining target analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, and use them as new objects to be analyzed.

[0022] As an optional implementation, in the first aspect of the present invention, before determining the customer profile analysis data of the object to be analyzed based on the first identification result, the method further includes:

[0023] Based on the first identification result, determine the actual distance between the object to be analyzed and the smart glasses;

[0024] Determine whether the actual interval distance exceeds the preset interval distance threshold corresponding to the object to be analyzed. When it is determined that the actual interval distance does not exceed the preset interval distance threshold, trigger the operation of determining the customer profile analysis data of the object to be analyzed based on the first identification result.

[0025] The step of determining the actual distance between the object to be analyzed and the smart glasses based on the first recognition result includes:

[0026] Based on the first identification result, the object type to which the object to be analyzed belongs is determined;

[0027] Based on the object type, determine the actual size of the object to be analyzed;

[0028] The actual distance between the object to be analyzed and the smart glasses is calculated based on the actual size of the object to be analyzed and the display size of the object to be analyzed in the image to be identified.

[0029] As an optional implementation, in the first aspect of the present invention, the customer profile analysis data includes at least one data tag matching the object to be analyzed and tag information corresponding to each data tag, wherein the data tag matching the analyzable product includes at least customer attributes of associated customers associated with the analyzable product, and the data tag matching the analyzable customer includes at least product attributes of associated products associated with the analyzable customer.

[0030] As an optional implementation, in the first aspect of the present invention, the method further includes:

[0031] The real-time images captured by the smart glasses are identified to obtain a third identification result of the real-time images;

[0032] Based on the third identification result, the projection information of the object to be analyzed in the display lens of the smart glasses is tracked in real time. The projection information includes the projection size and / or projection position of the object to be analyzed in the display lens.

[0033] The step of generating a customer profile visualization result matching the object to be analyzed based on the customer profile analysis data includes:

[0034] Based on the projection information, at least one target data label to be displayed in the customer profile analysis data, a visualization component template adapted to each target data label, and a component attribute adapted to each target data label are determined. The component attribute includes one or more of component size, component color, and component brightness.

[0035] Based on the tag information corresponding to each target data tag, the visualization component template adapted to each target data tag, and the component size adapted to each target data tag, a visualization component corresponding to each target data tag is generated as the customer profile visualization result matching the object to be analyzed.

[0036] As an optional implementation, in the first aspect of the present invention, the method further includes:

[0037] When all the data tags include the remaining data tags other than the target data tag, determine whether there is a target display surface around the smart glasses;

[0038] When it is determined that the target display surface exists around the smart glasses, a visualization component corresponding to each of the remaining data tags is generated.

[0039] Based on the smart glasses, the visualization component corresponding to each of the remaining data tags is displayed on the target display surface;

[0040] The step of determining whether a target display surface exists around the smart glasses includes:

[0041] Based on the third recognition result, it is determined whether there is a target object surface within the optical projection range of the smart glasses that can accept optical projection. When it is determined that there is a target object surface within the optical projection range, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the target object surface; and / or,

[0042] Based on the positioning information of the smart glasses, it is determined whether there is a target display terminal matching the smart glasses within a circular area with the smart glasses as the center and a preset length as the radius. When it is determined that there is a target display terminal within the circular area, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the display screen of the target display terminal.

[0043] As an optional implementation, in a first aspect of the invention, displaying the customer profile visualization result in a displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization result through the displayable lens, includes:

[0044] Based on the projection information, determine the display coordinates of the visualization component corresponding to each target data label in the displayable lens;

[0045] Based on the matching coordinates of the visualization component corresponding to each target data label in the displayable lens, the visualization component corresponding to each target data label is displayed in the displayable lens, so that the wearer of the smart glasses can view the visualization results of the customer profile through the displayable lens.

[0046] A second aspect of the present invention discloses a big data customer profile analysis and data display device, the device comprising:

[0047] The recognition module is used to recognize the image to be recognized currently collected by the smart glasses and obtain a first recognition result of the image to be recognized. The first recognition result includes the recognition result corresponding to one or more analyzable objects in the image to be recognized. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses.

[0048] The determining module is used to determine the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result;

[0049] The generation module is used to generate a visual result of a customer profile that matches the object to be analyzed, based on the customer profile analysis data.

[0050] A display module is used to display the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, wherein the displayable lens includes a lens with display function.

[0051] As an optional implementation, in a second aspect of the present invention, the identification module is further configured to, before the determining module determines the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result, identify the eye image of the wearer of the smart glasses currently collected by the smart glasses to obtain a second identification result of the eye image when the first identification result indicates that the image to be identified contains multiple analyzable objects;

[0052] The determining module is further configured to determine the wearer’s current gaze direction based on the second recognition result; and to determine the analyzable object actually observed by the wearer from all the objects to be analyzed based on the gaze direction and the distribution position of each analyzable object in the image to be identified, as the object to be analyzed for the current customer profile analysis.

[0053] As an optional implementation, in a second aspect of the invention, the determining module is further configured to determine the wearer's role type based on the second identification result before determining the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result;

[0054] The device further includes:

[0055] The first judgment module is used to determine whether the wearer meets the data viewing permission conditions of the object to be analyzed based on the role type.

[0056] The determining module is further configured to, when the first determining module determines that the wearer does not meet the data viewing permission conditions of the object to be analyzed, determine from all remaining analyzable objects a target remaining analyzable object that makes the wearer meet the corresponding data viewing permission conditions, as a new object to be analyzed, and trigger the execution of the operation of determining the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result, wherein the remaining analyzable objects include all the other analyzable objects besides the object to be analyzed.

[0057] As an optional implementation, in a second aspect of the invention, the determining module determines from all remaining analyzable objects a target remaining analyzable object that satisfies the wearer's corresponding data viewing permission conditions, as a specific way to identify a new object to be analyzed, including:

[0058] The analysis priority of each remaining analyzable object is determined based on the pre-determined distance between each remaining analyzable object and the object to be analyzed in the image to be identified and / or the actual distance between each remaining analyzable object and the smart glasses;

[0059] Arrange all remaining analyzable objects in descending order of analysis priority to obtain the analyzable object sequence;

[0060] From the sequence of analyzable objects, identify the remaining target analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, and use them as new objects to be analyzed.

[0061] As an optional implementation, in a second aspect of the present invention, the determining module is further configured to determine, based on the first identification result, the actual distance between the object to be analyzed and the smart glasses before determining the customer profile analysis data of the object to be analyzed based on the first identification result;

[0062] The device further includes:

[0063] The second judgment module is used to determine whether the actual interval distance exceeds the preset interval distance threshold corresponding to the object to be analyzed. When it is determined that the actual interval distance does not exceed the preset interval distance threshold, the determination module is triggered to perform the operation of determining the customer profile analysis data of the object to be analyzed based on the first identification result.

[0064] The method by which the determining module determines the actual distance between the object to be analyzed and the smart glasses based on the first recognition result includes:

[0065] Based on the first identification result, the object type to which the object to be analyzed belongs is determined;

[0066] Based on the object type, determine the actual size of the object to be analyzed;

[0067] The actual distance between the object to be analyzed and the smart glasses is calculated based on the actual size of the object to be analyzed and the display size of the object to be analyzed in the image to be identified.

[0068] As an optional implementation, in a second aspect of the present invention, the customer profile analysis data includes at least one data tag matching the object to be analyzed and tag information corresponding to each data tag, wherein the data tag matching the analyzable product includes at least customer attributes of associated customers associated with the analyzable product, and the data tag matching the analyzable customer includes at least product attributes of associated products associated with the analyzable customer.

[0069] As an optional implementation, in a second aspect of the present invention, the recognition module is further configured to recognize the real-time image acquired by the smart glasses in real time, and obtain a third recognition result of the real-time image;

[0070] The device further includes:

[0071] The tracking module is used to track the projection information of the object to be analyzed in the display lens of the smart glasses in real time based on the third recognition result. The projection information includes the projection size and / or projection position of the object to be analyzed in the display lens.

[0072] The specific method by which the generation module generates a customer profile visualization result matching the object to be analyzed based on the customer profile analysis data includes:

[0073] Based on the projection information, at least one target data label to be displayed in the customer profile analysis data, a visualization component template adapted to each target data label, and a component attribute adapted to each target data label are determined. The component attribute includes one or more of component size, component color, and component brightness.

[0074] Based on the tag information corresponding to each target data tag, the visualization component template adapted to each target data tag, and the component size adapted to each target data tag, a visualization component corresponding to each target data tag is generated as the customer profile visualization result matching the object to be analyzed.

[0075] As an optional implementation, in a second aspect of the invention, the apparatus further includes:

[0076] The third judgment module is used to determine whether there is a target display surface around the smart glasses when all the data tags include the remaining data tags other than the target data tag;

[0077] The generation module is further configured to generate a visualization component corresponding to each of the remaining data tags when the third judgment module determines that the target display surface exists around the smart glasses;

[0078] The display module is also used to display the visualization component corresponding to each of the remaining data tags on the target display surface;

[0079] The specific method by which the third judgment module determines whether a target display surface exists around the smart glasses includes:

[0080] Based on the third recognition result, it is determined whether there is a target object surface within the optical projection range of the smart glasses that can accept optical projection. When it is determined that there is a target object surface within the optical projection range, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the target object surface; and / or,

[0081] Based on the positioning information of the smart glasses, it is determined whether there is a target display terminal matching the smart glasses within a circular area with the smart glasses as the center and a preset length as the radius. When it is determined that there is a target display terminal within the circular area, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the display screen of the target display terminal.

[0082] As an optional implementation, in a second aspect of the invention, the display module displays the customer profile visualization result in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization result through the displayable lens in the following specific manner:

[0083] Based on the projection information, determine the display coordinates of the visualization component corresponding to each target data label in the displayable lens;

[0084] Based on the matching coordinates of the visualization component corresponding to each target data label in the displayable lens, the visualization component corresponding to each target data label is displayed in the displayable lens, so that the wearer of the smart glasses can view the visualization results of the customer profile through the displayable lens.

[0085] A third aspect of the present invention discloses another big data customer profile analysis and data display device, the device comprising:

[0086] Memory containing executable program code;

[0087] A processor coupled to the memory;

[0088] The processor calls the executable program code stored in the memory to execute the big data customer profile analysis and data display method disclosed in the first aspect of the present invention.

[0089] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute the big data customer profile analysis and data display method disclosed in the first aspect of the present invention.

[0090] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0091] In this embodiment of the invention, the image to be identified currently collected by the smart glasses is identified to obtain a first identification result of the image to be identified. The first identification result includes the identification result corresponding to one or more analyzable objects in the image to be identified. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses. Based on the first identification result, customer profile analysis data of the object to be analyzed among all analyzable objects is determined. Based on the customer profile analysis data, a customer profile visualization result matching the object to be analyzed is generated. The customer profile visualization result is displayed in the displayable lens of the smart glasses so that the wearer of the smart glasses can view the customer profile visualization result through the displayable lens, wherein the displayable lens includes a lens with display function. It can be seen that implementing the present invention can identify the image to be identified collected by the smart glasses to obtain customer profile analysis data of products or customers in the image to be identified, and display the generated customer profile visualization result through the displayable lens of the smart glasses, so that the user can view the customer profile analysis data of the product or customer in front of him in real time after wearing the smart glasses, which improves the convenience of customer profile analysis data application and can be directly applied to offline scenarios, realizing the diversification of practical application scenarios of customer profile analysis data. Attached Figure Description

[0092] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0093] Figure 1 This is a flowchart illustrating a big data customer profile analysis and data display method disclosed in an embodiment of the present invention;

[0094] Figure 2 This is a flowchart illustrating another big data customer profile analysis and data display method disclosed in an embodiment of the present invention;

[0095] Figure 3 This is a schematic diagram of the structure of a big data customer profile analysis and data display device disclosed in an embodiment of the present invention;

[0096] Figure 4 This is a schematic diagram of another big data customer profile analysis and data display device disclosed in an embodiment of the present invention;

[0097] Figure 5 This is a schematic diagram of the structure of another big data customer profile analysis and data display device disclosed in an embodiment of the present invention. Detailed Implementation

[0098] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0099] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0100] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0101] This invention discloses a method and apparatus for big data customer profile analysis and data display. It can identify images collected by smart glasses to obtain customer profile analysis data for products or customers within the images, and display the generated customer profile visualization results through the display lenses of the smart glasses. This allows users to view the customer profile analysis data of products or customers in front of them in real time while wearing the smart glasses, improving the convenience of customer profile analysis data applications and enabling direct application in offline scenarios, thus diversifying the practical application scenarios of customer profile analysis data. Detailed descriptions follow.

[0102] Example 1

[0103] Please see Figure 1 , Figure 1 This is a flowchart illustrating a big data customer profile analysis and data display method disclosed in an embodiment of the present invention. Figure 1The described big data customer profiling analysis and data display method can be applied to smart glasses, local devices or cloud servers that control smart glasses, and can also be ported to other mobile terminals (such as tablets, mobile phones, etc.) with image acquisition and display functions, or local devices or cloud servers that control such mobile terminals. This invention does not limit the scope of the application. Figure 1 As shown, this big data customer profiling analysis and data display method may include the following operations:

[0104] 101. Recognize the image to be recognized currently collected by the smart glasses to obtain the first recognition result of the image to be recognized.

[0105] In this embodiment of the invention, optionally, the smart glasses have image acquisition and display functions. That is, the smart glasses include an image acquisition device (such as a camera) and at least one displayable lens, which includes a lens with display function. Optionally, the image acquisition device includes at least a first image acquisition device for acquiring corresponding images within the wearer's field of vision. Further optionally, the image acquisition device may also include a second image acquisition device for acquiring images of the wearer's eyes. In this embodiment of the invention, the image to be identified currently acquired by the smart glasses is the corresponding image within the wearer's field of vision acquired by the first image acquisition device.

[0106] In this embodiment of the invention, the smart glasses may optionally include a first type of smart glasses applied to real-world scenarios and / or a second type of smart glasses (e.g., AR glasses) applied to scenarios combining real and virtual worlds. This can further diversify the practical application scenarios of customer profile analysis data.

[0107] In this embodiment of the invention, the first recognition result includes the recognition result corresponding to one or more analyzable objects in the image to be recognized. Optionally, the analyzable objects may include analyzable products and / or analyzable customers in the smart glasses application scenario. For example, sales staff in offline stores can collect images of customers entering the store or products in the store by wearing smart glasses as images to be recognized. Similarly, customers in offline products can collect images of products in the store, such as a book, by wearing smart glasses provided by the store as images to be recognized.

[0108] 102. Based on the first identification result, determine the customer profile analysis data of the object to be analyzed among all analyzable objects.

[0109] In this embodiment of the invention, optionally, the customer profile analysis data may include at least one data tag matching the object to be analyzed and tag information corresponding to each data tag; further optionally, the data tag matching the analyzable product may at least include customer attributes of associated customers related to the analyzable product, and the data tag matching the analyzable customer may at least include product attributes of associated products related to the analyzable customer; further optionally, associated customers related to the analyzable product may include customers who have engaged in consumption-related behaviors related to the analyzable product, and associated products related to the analyzable customer may include products for which the analyzable customer has engaged in consumption-related behaviors, and consumption-related behaviors may include one or more combinations of product browsing behavior, product collection behavior, product consultation behavior, product add-to-cart behavior, product purchase behavior, etc. Optionally, data tags can include a parent data tag and corresponding sub-data tags. For example, the parent data tag matching a laptop might include "customer gender," and the corresponding sub-data tags might include "male customer" and "female customer." The tag information for "customer gender" could include the percentage of "male customers" and the percentage of "female customers." Similarly, the parent data tag matching a customer might include the customer's "purchased electronic products," and the corresponding sub-data tags for "purchased electronic products" might include "laptop," "mobile phone," and "tablet." The tag information for "purchased electronic products" could include the purchase quantity of each of the three. Optionally, the data tags matching an analyzable product can also include the product attributes of the analyzable product itself, and the data tags matching an analyzable customer can also include the customer attributes of the analyzable customer. For example, the data tags matching a laptop might also include the laptop's internal parameters. This demonstrates how this approach can improve the diversity of customer profile analysis data.

[0110] As an optional implementation, determining the customer profile analysis data of the object to be analyzed among all analyzable objects based on the first identification result may include:

[0111] Based on the object type of the object to be analyzed determined by the first identification result, it is determined whether there is target customer profile analysis data in the customer profile database that matches the object type. The object type of the product to be analyzed includes the product type of the product to be analyzed, and the object type of the customer to be analyzed includes the customer type of the customer to be analyzed.

[0112] When the judgment result is yes, the target customer profile analysis data that matches the object type is determined as the customer profile analysis data of the object to be analyzed.

[0113] Optionally, the method may further include:

[0114] When it is determined that there is no target customer profile analysis data with a matching object type in the customer profile database, the similar object types are identified.

[0115] Determine whether there is target customer profile analysis data in the customer profile database that matches similar object types;

[0116] When it is determined that there is target customer profile analysis data with similar object types in the customer profile database, the target customer profile analysis data with similar object types is identified as the customer profile analysis data of the object to be analyzed.

[0117] As can be seen, implementing this optional implementation method can directly search for the corresponding customer profile analysis data in the database according to the object type to which the object to be analyzed belongs, thereby improving the efficiency and accuracy of customer profile analysis data acquisition. Furthermore, when the search fails, it can search for customer profile analysis data of similar object types and provide it to the user for reference, thereby improving the flexibility of customer profile analysis data retrieval.

[0118] 103. Based on the customer profile analysis data, generate a visual result of the customer profile that matches the object to be analyzed.

[0119] In this embodiment of the invention, all customer profile analysis data can be converted into customer profile visualization results, or only some customer profile analysis data can be converted into customer profile visualization results. This embodiment of the invention does not impose any limitations.

[0120] 104. Display the customer profile visualization results in the displayable lens of the smart glasses so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens.

[0121] In this embodiment of the invention, optionally, if the smart glasses include two displayable lenses, the wearer can select the displayable lens used to display the visualization results of the customer profile.

[0122] In this embodiment of the invention, optionally, the number of objects to be analyzed can be 1 or greater than 1. This embodiment of the invention does not limit the number of objects to be analyzed. This makes it easier to view the customer profile visualization results of multiple products or customers at the same time. Further optionally, a maximum number threshold for the number of objects to be analyzed can be set to improve the visibility of the customer profile visualization results and reduce the occurrence of obstruction of the wearer's vision due to too much information.

[0123] As can be seen, implementing the embodiments of the present invention can identify the image to be identified by smart glasses to obtain customer profile analysis data of products or customers in the image to be identified, and display the generated customer profile visualization results through the display lens of the smart glasses. This allows users to view the customer profile analysis data of the products or customers in front of them in real time after wearing smart glasses, which improves the convenience of customer profile analysis data application and can be directly applied to offline scenarios, realizing the diversification of practical application scenarios of customer profile analysis data.

[0124] In an optional embodiment, before determining the customer profile analysis data of the object to be analyzed based on the first identification result, the method may further include:

[0125] Based on the first identification result, determine the actual distance between the object to be analyzed and the smart glasses;

[0126] Determine whether the actual interval distance exceeds the preset interval distance threshold corresponding to the object to be analyzed. When it is determined that the actual interval distance does not exceed the preset interval distance threshold, trigger the above-mentioned operation of determining the customer profile analysis data of the object to be analyzed based on the first identification result.

[0127] For example, when sales staff wear smart glasses to analyze customer profiles of customers entering the store, if the preset interval distance is 1 meter, there is no need to analyze customer profiles of customers entering the store who are more than 1 meter away.

[0128] As can be seen, implementing this optional embodiment can analyze only customers and products that are close to the wearer of the smart glasses, without having to perform unnecessary customer profiling analysis on distant products or customers that the wearer cannot see clearly, thereby reducing obstruction to the wearer's line of sight and the display of customer profiling analysis data for nearby products or customers.

[0129] In this optional embodiment, as an optional implementation, determining the actual distance between the object to be analyzed and the smart glasses based on the first identification result may include:

[0130] Based on the first identification result, determine the object type to which the object to be analyzed belongs;

[0131] Determine the actual size of the object to be analyzed based on the object type;

[0132] Calculate the actual distance between the object to be analyzed and the smart glasses based on the actual size of the object to be analyzed and the display size of the object to be analyzed in the image to be recognized.

[0133] Optionally, the actual distance between the object to be analyzed and the smart glasses can be calculated based on the actual size of the object and its display size in the image to be recognized. This can include:

[0134] The actual size of the object to be analyzed and its display size in the image to be identified are imported into a preset distance calculation algorithm to obtain the actual distance between the object to be analyzed and the smart glasses. The distance calculation algorithm is associated with the parameters of the first image acquisition device of the smart glasses.

[0135] For example, if the first recognition result identifies the object to be analyzed as a table of a certain brand and model, and the actual length of the table is 120cm, while the display length of the table in the image to be recognized is 50 pixels, then the actual distance between the table and the smart glasses can be obtained by calculating the actual length of 120cm and the display length of 50 pixels through a preset distance calculation algorithm.

[0136] As can be seen, implementing this optional implementation method can calculate the actual distance between the product or customer and the smart glasses based on the actual size of the product or customer and its size in the image to be recognized, thereby improving the accuracy and reliability of the calculation of the actual distance between the product or customer and the smart glasses.

[0137] In another alternative embodiment, the method may further include:

[0138] The real-time images captured by the smart glasses are identified to obtain a third recognition result of the real-time images;

[0139] Based on the third recognition result, the projection information of the object to be analyzed in the display lens of the smart glasses is tracked in real time. The projection information may include the projection size and / or projection position of the object to be analyzed in the display lens.

[0140] Optionally, based on the customer profile analysis data, a customer profile visualization result matching the object to be analyzed can be generated, which may include:

[0141] Based on the projection information, determine at least one target data label to be displayed in the customer profile analysis data, the visualization component template adapted to each target data label, and the component attributes adapted to each target data label. The component attributes include one or more of the following: component size, component color, and component brightness.

[0142] Based on the tag information corresponding to each target data tag, the visualization component template adapted to each target data tag, and the component size adapted to each target data tag, a visualization component corresponding to each target data tag is generated as a customer profile visualization result that matches the object to be analyzed.

[0143] As can be seen, implementing this optional implementation method can also track the projection size and projection position of the object to be analyzed in real time, and generate a visualization component for each data label to be displayed based on this. This allows the visualization component to change as the object to be analyzed changes, thereby improving the matching degree between the component type, component size and other attributes of the customer profile visualization results and the real-time status of the object to be analyzed, and thus improving the flexibility of the customer profile visualization results display.

[0144] In this optional embodiment, the real-time image is the real-time image within the wearer's field of vision captured by the first image acquisition device; optionally, in other embodiments, the image to be identified can be used instead of the real-time image. In this case, there is no need to re-identify the image to be identified, and the first identification result can be directly used as the third identification result.

[0145] In this optional embodiment, the visualization component template may optionally include a pattern component template and / or a text component template. Optionally, the visualization component template adapted to each target data label and the component attributes adapted to each template data label can also be determined by combining projection information and the priority or weight corresponding to each target data label. For example, a target data label with high priority or weight can be set to have a visualization component template that includes both pattern and text component templates, while a target data label with low priority or weight can have a visualization component template that only includes a text component template. Higher priority or weight results in larger component sizes, darker component colors, and higher component brightness, etc.

[0146] In this optional embodiment, as an optional implementation, displaying the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, may include:

[0147] Based on the projection information, determine the display coordinates of the visualization component corresponding to each target data label in the displayable lens;

[0148] Based on the matching coordinates of the visualization component corresponding to each target data label in the displayable lens, the visualization component corresponding to each target data label is displayed in the displayable lens, so that the wearer of the smart glasses can view the visualization results of the customer profile through the displayable lens.

[0149] Optionally, the visualization component corresponding to each target data label can be displayed around the projection position of the object to be analyzed in the displayable lens.

[0150] As can be seen, implementing this optional implementation method can display the customer profile visualization results in the displayable lens according to the real-time projection position of the object to be analyzed, so that the visualization component moves with the object to be analyzed, further improving the flexibility of the customer profile visualization results display.

[0151] In this optional embodiment, as another optional implementation, the method may further include:

[0152] When all data tags include the remaining data tags excluding the target data tag, determine whether there is a target display surface around the smart glasses;

[0153] When it is determined that there is a target display surface around the smart glasses, a visualization component corresponding to each remaining data label is generated.

[0154] Display the visualization component corresponding to each remaining data label on the target display surface;

[0155] Determining whether a target display surface exists around smart glasses can include:

[0156] Based on the third identification result, it is determined whether there is a target object surface within the optical projection range of the smart glasses that can accept optical projection. When it is determined that there is a target object surface within the optical projection range, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the target object surface; and / or,

[0157] Based on the positioning information of the smart glasses, it is determined whether there is a target display terminal matching the smart glasses within a circular area with the smart glasses as the center and a preset length as the radius. When it is determined that there is a target display terminal within the circular area, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the display screen of the target display terminal.

[0158] In this optional implementation, preferably, the target object surface is a smooth object surface, such as a wall, tabletop, or paper surface.

[0159] As can be seen, implementing this optional implementation method can display the remaining data labels on the display surface around the wearer when there is a large amount of customer profile visualization analysis data to be displayed, thereby improving the comprehensiveness of the customer profile visualization analysis data display and reducing the situation where the wearer's vision is obstructed due to a large amount of customer profile analysis data displayed on the display lens of the smart glasses. In addition, customer profile analysis data can be projected onto the surface of an object or displayed on the display screen, thereby improving the diversity of customer profile analysis data display.

[0160] In this optional implementation, the specific method for generating the visualization component corresponding to each remaining data label may include:

[0161] Based on the size of the target display surface, determine the visualization component template and component attributes that each remaining data label should be adapted to;

[0162] Based on the tag information corresponding to each remaining data tag, the visualization component template adapted to each remaining data tag, and the component size adapted to each remaining data tag, generate the visualization component corresponding to each remaining data tag.

[0163] As can be seen, implementing this optional implementation method can also determine the component attributes of the visualization components of each data tag based on the size of the display screen of the display terminal or the surface of the object that can be optically projected, thereby improving the matching degree between the component attributes and the display surface size, which is conducive to improving the comprehensiveness and visibility of customer profile analysis data.

[0164] In this optional implementation, optionally displaying the visualization component corresponding to each remaining data label on the target display surface may include:

[0165] When the target display surface includes the target object surface, the projection device based on smart glasses projects the visualization component corresponding to each remaining data tag onto the target object surface;

[0166] When the target display surface includes the display screen of the target display terminal, the visualization component data corresponding to each remaining data label is transmitted to the target display terminal so that the target display terminal can display the visualization component corresponding to each remaining data label.

[0167] As can be seen, this can improve the accuracy and reliability of displaying the visualization components corresponding to the remaining data labels on the target display surface.

[0168] Example 2

[0169] Please see Figure 2 , Figure 2 This is a flowchart illustrating another big data customer profile analysis and data display method disclosed in an embodiment of the present invention. Figure 2 The described big data customer profiling analysis and data display method can be applied to smart glasses, local devices or cloud servers that control smart glasses, and can also be ported to other mobile terminals (such as tablets, mobile phones, etc.) with image acquisition and display functions, or local devices or cloud servers that control such mobile terminals. This invention does not limit the scope of the application. Figure 2 As shown, this big data customer profiling analysis and data display method may include the following operations:

[0170] 201. Recognize the image to be recognized currently collected by the smart glasses to obtain the first recognition result of the image to be recognized.

[0171] 202. When the first recognition result indicates that the image to be recognized contains multiple analyzable objects, the eye image of the wearer of the smart glasses currently collected by the smart glasses is recognized to obtain the second recognition result of the eye image.

[0172] In this embodiment of the invention, optionally, the second image acquisition device described above can acquire images of the wearer's eyes.

[0173] As an optional implementation, identifying the eye image of the wearer currently captured by the smart glasses to obtain a second identification result of the eye image may include:

[0174] Based on the eye images of the wearer currently captured by the smart glasses, the eye movement state of the wearer is tracked as a second recognition result of the eye image; and / or,

[0175] Based on the eye images of the wearer captured by the smart glasses, the wearer's iris is identified to obtain the wearer's identity information, which serves as the second recognition result of the eye image.

[0176] As can be seen, implementing this optional implementation method can determine the wearer's eye movement state and the wearer's identity based on the wearer's eye image, thereby improving the accuracy and comprehensiveness of eye image recognition.

[0177] 203. Based on the second recognition result, determine the wearer's current gaze direction.

[0178] In this embodiment of the invention, optionally, the wearer's current gaze direction can be determined based on the wearer's eye movement state in the second recognition result described above.

[0179] 204. Based on the direction of gaze and the distribution position of each analyzable object in the image to be identified, determine the analyzable objects actually observed by the wearer from all the objects to be analyzed, and use them as the objects to be analyzed for the current customer profile analysis.

[0180] In this embodiment of the invention, optionally, determining the analyzable objects actually observed by the wearer from all objects to be analyzed, based on the direction of gaze and the distribution position of each analyzable object in the image to be identified, as the objects to be analyzed for the current customer profile analysis, may include:

[0181] When the eye image is a single eye image of the wearer, aiming points are established in the image to be identified based on the direction of gaze, resulting in the first aiming point result. Based on the first aiming point result and the distribution position of each analyzable object in the image to be identified, the analyzable objects actually observed by the wearer are determined from all the objects to be analyzed, and these are the objects to be analyzed for the current customer profile analysis; or...

[0182] When the eye image consists of the wearer's two eye images, determine the intersection of the gaze directions of the two eyes; determine the projection point of this intersection point in the image to be identified, as the second aiming point result; based on the second aiming point result and the distribution position of each analyzable object in the image to be identified, determine the analyzable objects actually observed by the wearer from all the objects to be analyzed, as the objects to be analyzed for the current customer profile analysis.

[0183] As can be seen, implementing this optional implementation method can use different methods to aim at points in the image to be identified when acquiring monocular and binocular images, thereby determining the object to be analyzed, thus improving the accuracy and reliability of the determination of the object to be analyzed.

[0184] 205. Based on the first identification result, determine the customer profile analysis data of the object to be analyzed among all analyzable objects.

[0185] 206. Based on the customer profile analysis data, generate a visual result of the customer profile that matches the object to be analyzed.

[0186] 207. Display the customer profile visualization results in the displayable lens of the smart glasses so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens.

[0187] In this embodiment of the invention, for other descriptions of steps 201, 205, 206, and 207, please refer to the detailed description of steps 101-104 in Embodiment 1. These descriptions will not be repeated in this embodiment of the invention.

[0188] As can be seen, implementing this optional implementation method enables the identification of images to be recognized by smart glasses to obtain customer profile analysis data of products or customers in the images. The generated customer profile visualization results are then displayed through the display lenses of the smart glasses, allowing users to view the customer profile analysis data of products or customers in front of them in real time after wearing the smart glasses. This improves the convenience of applying customer profile analysis data and can be directly applied to offline scenarios, diversifying the practical application scenarios of customer profile analysis data. In addition, it can determine the wearer's gaze direction based on the wearer's eye image, thereby determining the object to be analyzed that the wearer is currently observing. This improves the matching degree between the displayed product or customer profile visualization results and the content observed by the wearer, reducing the occurrence of misattribution during the display of customer profile analysis data and further improving the accuracy and reliability of customer profile analysis data display.

[0189] In an optional embodiment, before determining the customer profile analysis data of the object to be analyzed among all analyzable objects based on the first identification result, the method may further include:

[0190] Based on the second identification result, determine the wearer's role type;

[0191] Based on the role type, determine whether the wearer meets the data viewing permission conditions of the object to be analyzed;

[0192] When it is determined that the wearer does not meet the data viewing permission conditions of the object to be analyzed, the target remaining analyzable object that makes the wearer meet the corresponding data viewing permission conditions is determined from all remaining analyzable objects, and is taken as the new object to be analyzed. The above-mentioned operation of determining the customer profile analysis data of the object to be analyzed from all analyzable objects based on the first identification result is triggered. The remaining analyzable objects include other analyzable objects besides the object to be analyzed.

[0193] Optionally, the wearer's role type can be determined based on the wearer's identity information in the second identification result mentioned above.

[0194] For example, if the wearer's role type indicates that the wearer is a customer, then the wearer may not meet the data viewing permission conditions for any analyzable customer. That is, a customer wearing smart glasses does not have permission to view the customer profile visualization results of other customers. If the wearer's role type indicates that the wearer is a salesperson, then the wearer meets the data viewing permissions for some analyzable products and some analyzable customers. That is, a salesperson wearing smart glasses can view the customer profile visualization results for some products and some customers. For example, they can view the customer profile visualization results for laptops, but cannot view the customer profile visualization results for chip products. They can view the customer profile visualization results for customers with lower privacy requirements, but cannot view the customer profile visualization results for customers with higher privacy requirements.

[0195] As can be seen, implementing this optional embodiment can also restrict the wearer's access to view customer profile analysis data of the corresponding product or customer based on the wearer's role type, thereby helping to protect the privacy of relevant customers and products, and displaying customer profile analysis data of other products or customers when the wearer cannot view the current product or customer's customer profile analysis data.

[0196] In this optional embodiment, as an optional implementation, determining the target remaining analyzable object from all remaining analyzable objects that satisfies the wearer's corresponding data viewing permission conditions, as a new object to be analyzed, may include:

[0197] The analysis priority of each remaining analyzable object is determined based on the pre-determined distance between each remaining analyzable object and the object to be analyzed in the image to be identified and / or the actual distance between each remaining analyzable object and the smart glasses.

[0198] Arrange all remaining analyzable objects in descending order of analysis priority to obtain the sequence of analyzable objects;

[0199] From the sequence of analyzable objects, identify the remaining target analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, and use them as new objects to be analyzed.

[0200] As can be seen, implementing this optional implementation method can determine the analysis priority of other products or customers based on the distance between the wearer and other products or customers, or the distance between other products or customers and the current product or customer, when the wearer cannot view the customer profile analysis data of the current product or customer. Based on this, the data is sorted, and the products or customers that actually need to be displayed for customer profile analysis data are determined according to the sorting results. This prioritizes displaying the customer profile analysis data of products or customers that are closer to the wearer or match the wearer's viewing direction, improving the fit between the customer profile analysis data display results and the wearer's wishes, and further improving the accuracy and reliability of the customer profile analysis data display.

[0201] In this optional implementation, optionally, determining the remaining target analyzable objects from the sequence of analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, as new objects to be analyzed, may include:

[0202] The remaining analyte that is first in the sequence of analytes is identified as the optimal remaining analyte.

[0203] Based on the role type, determine whether the wearer meets the data viewing permission conditions for the optimal remaining analyzable objects;

[0204] When it is determined that the wearer does not meet the data viewing permission conditions of the optimal remaining analyzable object, the next adjacent remaining analyzable object in the object sequence is determined as the new optimal remaining analyzable object, and the above operation of determining whether the wearer meets the data viewing permission conditions of the optimal remaining analyzable object based on the role type is re-executed.

[0205] When it is determined that the wearer meets the data viewing permission conditions of the optimal remaining analyzable object, the optimal remaining analyzable object is identified as the target remaining analyzable object that enables the wearer to meet the corresponding data viewing permission conditions, and is used as a new object to be analyzed.

[0206] As can be seen, implementing this optional implementation method can select the wearer with the right to view customer profile analysis data and with a high analysis priority from the remaining analyzable objects according to the sequence of analyzable objects determined based on analysis priority, thereby improving the accuracy and reliability of selecting the remaining analyzable objects from the sequence of analyzable objects.

[0207] Example 3

[0208] Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of a big data customer profile analysis and data display device disclosed in an embodiment of the present invention. Figure 3The described big data customer profiling analysis and data display device can be applied to smart glasses, local devices or cloud servers that control smart glasses, and can also be ported to other mobile terminals (such as tablets, mobile phones, etc.) with image acquisition and display functions, or local devices or cloud servers that control such mobile terminals. This invention does not limit the application of this method. Figure 3 As shown, the big data customer profile analysis and data display device may include:

[0209] The recognition module 301 is used to recognize the image to be recognized currently collected by the smart glasses and obtain the first recognition result of the image to be recognized. The first recognition result includes the recognition result corresponding to one or more analyzable objects in the image to be recognized. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses.

[0210] The determination module 302 is used to determine the customer profile analysis data of the object to be analyzed among all analyzable objects based on the first identification result;

[0211] The generation module 303 is used to generate a visual result of a customer profile that matches the object to be analyzed based on the customer profile analysis data.

[0212] Display module 304 is used to display the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, wherein the displayable lens includes a lens with display function.

[0213] It is evident that implementation Figure 3 The described device can identify images captured by smart glasses to obtain customer profile analysis data of products or customers in the images, and display the generated customer profile visualization results through the display lens of the smart glasses. This allows users to view the customer profile analysis data of the products or customers in front of them in real time after wearing smart glasses, improving the convenience of customer profile analysis data application and enabling direct application to offline scenarios, thus realizing the diversification of practical application scenarios for customer profile analysis data.

[0214] In an optional embodiment, such as Figure 3 As shown, the recognition module 301 is further configured to, before the determination module 302 determines the customer profile analysis data of the object to be analyzed among all analyzable objects based on the first recognition result, when the first recognition result indicates that the image to be identified contains multiple analyzable objects, recognize the eye image of the wearer of the smart glasses currently collected by the smart glasses, and obtain a second recognition result of the eye image;

[0215] The determining module 302 is also used to determine the wearer's current gaze direction based on the second recognition result; and based on the gaze direction and the distribution position of each analyzable object in the image to be recognized, to determine the analyzable object actually observed by the wearer from all the objects to be analyzed, as the object to be analyzed for the current customer profile analysis.

[0216] It is evident that implementation Figure 3 The described device can also determine the wearer's gaze direction based on the wearer's eye image, thereby determining the object to be analyzed that the wearer is currently observing. This improves the matching degree between the displayed product or customer profile visualization results and the content observed by the wearer, which helps to reduce misattribution of customer profile analysis data during the display process, and further improves the accuracy and reliability of customer profile analysis data display.

[0217] In another alternative embodiment, such as Figure 4 As shown, the determining module 302 is further configured to determine the wearer's role type based on the second identification result before determining the customer profile analysis data of the object to be analyzed among all analyzable objects based on the first identification result;

[0218] The device may also include:

[0219] The first judgment module 305 is used to determine whether the wearer meets the data viewing permission conditions of the object to be analyzed based on the role type.

[0220] The determining module 302 is further configured to, when the first determining module 305 determines that the wearer does not meet the data viewing permission conditions of the object to be analyzed, determine the target remaining analyzable object from all remaining analyzable objects that would allow the wearer to meet the corresponding data viewing permission conditions, as the new object to be analyzed, and trigger the execution of the above-mentioned operation of determining the customer profile analysis data of the object to be analyzed from all analyzable objects based on the first identification result, wherein the remaining analyzable objects include other analyzable objects besides the object to be analyzed from all analyzable objects.

[0221] It is evident that implementation Figure 4 The described device can restrict the wearer's access to view customer profile analysis data of the corresponding product or customer based on the wearer's role type, thereby helping to protect the privacy of the relevant customers and products, and displaying customer profile analysis data of other products or customers when the wearer cannot view the current product or customer's customer profile analysis data.

[0222] In yet another alternative embodiment, such as Figure 4 As shown, the determining module 302 identifies target remaining analyzable objects from all remaining analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, as new objects to be analyzed. Specific methods for this identification may include:

[0223] The analysis priority of each remaining analyzable object is determined based on the pre-determined distance between each remaining analyzable object and the object to be analyzed in the image to be identified and / or the actual distance between each remaining analyzable object and the smart glasses.

[0224] Arrange all remaining analyzable objects in descending order of analysis priority to obtain the sequence of analyzable objects;

[0225] From the sequence of analyzable objects, identify the remaining target analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, and use them as new objects to be analyzed.

[0226] It is evident that implementation Figure 4 The described device can also determine the analysis priority of other products or customers based on their distance from the wearer or the distance between the wearer and the current product or customer when the wearer cannot view the customer profile analysis data of the current product or customer. Based on this priority, the device sorts the products or customers that actually need to be displayed in the customer profile analysis data according to the sorting results. This prioritizes displaying the customer profile analysis data of products or customers that are closer to the wearer or match the wearer's viewing direction, thereby improving the fit between the customer profile analysis data display results and the wearer's wishes and further improving the accuracy and reliability of the customer profile analysis data display.

[0227] In yet another alternative embodiment, such as Figure 4 As shown, the determining module 302 is further configured to determine the actual distance between the object to be analyzed and the smart glasses based on the first identification result before determining the customer profile analysis data of the object to be analyzed based on the first identification result;

[0228] The device may also include:

[0229] The second judgment module 306 is used to determine whether the actual interval distance exceeds the preset interval distance threshold corresponding to the object to be analyzed. When it is determined that the actual interval distance does not exceed the preset interval distance threshold, the determination module 302 is triggered to perform the above-mentioned operation of determining the customer profile analysis data of the object to be analyzed based on the first identification result.

[0230] The specific method by which the determining module 302 determines the actual distance between the object to be analyzed and the smart glasses based on the first recognition result may include:

[0231] Based on the first identification result, determine the object type to which the object to be analyzed belongs;

[0232] Determine the actual size of the object to be analyzed based on the object type;

[0233] The actual distance between the object to be analyzed and the smart glasses is calculated based on the actual size of the object and its display size in the image to be recognized.

[0234] It is evident that implementation Figure 4 The described device can also analyze only customers and products that are close to the wearer of the smart glasses, eliminating the need for unnecessary customer profiling analysis of distant products or customers that the wearer cannot see clearly. This reduces obstruction to the wearer's line of sight and the display of customer profiling data for nearby products or customers. Furthermore, it can calculate the actual distance between the product or customer and the smart glasses based on the actual size of the product or customer and its size in the image to be identified, improving the accuracy and reliability of the calculation of the actual distance between the product or customer and the smart glasses.

[0235] In yet another alternative embodiment, such as Figure 4 As shown, customer profile analysis data includes at least one data tag matching the object to be analyzed, as well as tag information corresponding to each data tag. Data tags matching the analyzable product at least include customer attributes of associated customers related to the analyzable product, and data tags matching the analyzable customer at least include product attributes of associated products related to the analyzable customer. This demonstrates that it improves the diversity of customer profile analysis data.

[0236] In yet another alternative embodiment, such as Figure 4 As shown, the recognition module 301 is also used to recognize the real-time images collected by the smart glasses in real time, and obtain a third recognition result of the real-time images;

[0237] The device may also include:

[0238] The tracking module 307 is used to track the projection information of the object to be analyzed in the display lens of the smart glasses in real time based on the third recognition result. The projection information includes the projection size and / or projection position of the object to be analyzed in the display lens.

[0239] The specific methods by which the generation module 303 generates a customer profile visualization result matching the object to be analyzed based on the customer profile analysis data may include:

[0240] Based on the projection information, determine at least one target data label to be displayed in the customer profile analysis data, the visualization component template adapted to each target data label, and the component attributes adapted to each target data label. The component attributes include one or more of the following: component size, component color, and component brightness.

[0241] Based on the tag information corresponding to each target data tag, the visualization component template adapted to each target data tag, and the component size adapted to each target data tag, a visualization component corresponding to each target data tag is generated as a customer profile visualization result that matches the object to be analyzed.

[0242] It is evident that implementation Figure 4 The described device can also track the projection size and position of the object to be analyzed in real time, and generate a visualization component for each data label to be displayed based on this. This allows the visualization component to change as the object to be analyzed changes, thereby improving the matching degree between the component type, component size and other attributes of the customer profile visualization results and the real-time state of the object to be analyzed, and thus improving the flexibility of the display of customer profile visualization results.

[0243] In yet another alternative embodiment, such as Figure 4 As shown, the display module 304 displays the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens. The specific methods may include:

[0244] Based on the projection information, determine the display coordinates of the visualization component corresponding to each target data label in the displayable lens;

[0245] Based on the matching coordinates of the visualization component corresponding to each target data label in the displayable lens, the visualization component corresponding to each target data label is displayed in the displayable lens, so that the wearer of the smart glasses can view the visualization results of the customer profile through the displayable lens.

[0246] It is evident that implementation Figure 4 The described device can also display customer profile visualization results in a displayable lens based on the real-time projection position of the object to be analyzed, so that the visualization components move with the object to be analyzed, further improving the flexibility of displaying customer profile visualization results.

[0247] In yet another alternative embodiment, such as Figure 4 As shown, the device may further include:

[0248] The third judgment module 308 is used to determine whether there is a target display surface around the smart glasses when all data tags include the remaining data tags other than the target data tag;

[0249] The generation module 303 is also used to generate a visualization component corresponding to each remaining data label when the third judgment module 308 determines that there is a target display surface around the smart glasses;

[0250] Display module 304 is also used to display the visualization component corresponding to each remaining data label on the target display surface;

[0251] Optionally, the specific method by which the third judgment module 308 judges whether there is a target display surface around the smart glasses may include:

[0252] Based on the third identification result, it is determined whether there is a target object surface within the optical projection range of the smart glasses that can accept optical projection. When it is determined that there is a target object surface within the optical projection range, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the target object surface; and / or,

[0253] Based on the positioning information of the smart glasses, it is determined whether there is a target display terminal matching the smart glasses within a circular area with the smart glasses as the center and a preset length as the radius. When it is determined that there is a target display terminal within the circular area, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the display screen of the target display terminal.

[0254] It is evident that implementation Figure 4 The described device can also display the remaining data labels on the display surface around the wearer when there is a lot of customer profile visualization analysis data to be displayed, thereby improving the comprehensiveness of the customer profile visualization analysis data display and reducing the situation where the wearer's vision is blocked due to a lot of customer profile analysis data displayed on the display lenses of smart glasses. It can also project customer profile analysis data onto the surface of an object or display customer profile analysis data on a display screen, thereby improving the diversity of customer profile analysis data display.

[0255] Example 4

[0256] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of another big data customer profile analysis and data display device disclosed in an embodiment of the present invention. For example... Figure 5 As shown, the big data customer profile analysis and data display device may include:

[0257] Memory 401 storing executable program code;

[0258] Processor 402 coupled to memory 401;

[0259] The processor 402 calls the executable program code stored in the memory 401 to execute the steps in the big data customer profile analysis and data display method described in Embodiment 1 or Embodiment 2 of the present invention.

[0260] Example 5

[0261] This invention discloses a computer storage medium storing computer instructions. When these computer instructions are invoked, they are used to execute the steps in the big data customer profile analysis and data display method described in Embodiment 1 or Embodiment 2 of this invention.

[0262] Example 6

[0263] This invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform the steps in the big data customer profile analysis and data display method described in Embodiment 1 or Embodiment 2.

[0264] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0265] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0266] Finally, it should be noted that the big data customer profile analysis and data display method and apparatus disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for displaying big data customer profile analysis data, characterized in that, The method includes: The image to be identified is currently collected by the smart glasses to obtain a first identification result of the image to be identified. The first identification result includes the identification result corresponding to one or more analyzable objects in the image to be identified. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses. Based on the first identification result, customer profile analysis data of the object to be analyzed among all the analyzable objects are determined; Based on the customer profile analysis data, generate a visual result of a customer profile that matches the object to be analyzed; The customer profile visualization results are displayed in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, wherein the displayable lens includes a lens with display function; The method further includes, before determining the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result: When the first recognition result indicates that the image to be recognized contains multiple analyzable objects, the eye image of the wearer of the smart glasses currently collected by the smart glasses is recognized to obtain a second recognition result of the eye image; Based on the second recognition result, determine the wearer's current gaze direction; Based on the direction of gaze and the distribution position of each analyzable object in the image to be identified, the analyzable object actually observed by the wearer is determined from all the objects to be analyzed, and is taken as the object to be analyzed for customer profile analysis. Based on the second identification result, the wearer's role type is determined; Based on the role type, determine whether the wearer meets the data viewing permission conditions of the object to be analyzed; When it is determined that the wearer does not meet the data viewing permission conditions of the object to be analyzed, a target remaining analyzable object that makes the wearer meet the corresponding data viewing permission conditions is determined from all remaining analyzable objects, and is taken as a new object to be analyzed. The operation of determining the customer profile analysis data of the object to be analyzed from all the analyzable objects based on the first identification result is triggered. The remaining analyzable objects include all the other analyzable objects besides the object to be analyzed. The step of determining the target remaining analyzable object from all remaining analyzable objects that satisfies the wearer's corresponding data viewing permission conditions, as a new object to be analyzed, includes: The analysis priority of each remaining analyzable object is determined based on the pre-determined distance between each remaining analyzable object and the object to be analyzed in the image to be identified and / or the actual distance between each remaining analyzable object and the smart glasses; Arrange all remaining analyzable objects in descending order of analysis priority to obtain the analyzable object sequence; From the sequence of analyzable objects, identify the remaining target analyzable objects that satisfy the wearer's corresponding data viewing permission conditions, and use them as new objects to be analyzed.

2. The big data customer profile analysis and data display method according to claim 1, characterized in that, Before determining the customer profile analysis data of the object to be analyzed based on the first identification result, the method further includes: Based on the first identification result, determine the actual distance between the object to be analyzed and the smart glasses; Determine whether the actual interval distance exceeds the preset interval distance threshold corresponding to the object to be analyzed. When it is determined that the actual interval distance does not exceed the preset interval distance threshold, trigger the operation of determining the customer profile analysis data of the object to be analyzed based on the first identification result. The step of determining the actual distance between the object to be analyzed and the smart glasses based on the first recognition result includes: Based on the first identification result, the object type to which the object to be analyzed belongs is determined; Determine the actual size of the object to be analyzed based on the object type; The actual distance between the object to be analyzed and the smart glasses is calculated based on the actual size of the object to be analyzed and the display size of the object to be analyzed in the image to be identified.

3. The big data customer profile analysis and data display method according to claim 1, characterized in that, The customer profile analysis data includes at least one data tag that matches the object to be analyzed and tag information corresponding to each data tag. The data tags that match the analyzable product include at least the customer attributes of the associated customers associated with the analyzable product, and the data tags that match the analyzable customer include at least the product attributes of the associated products associated with the analyzable customer.

4. The big data customer profile analysis and data display method according to claim 3, characterized in that, The method further includes: The real-time images captured by the smart glasses are identified to obtain a third identification result of the real-time images; Based on the third identification result, the projection information of the object to be analyzed in the display lens of the smart glasses is tracked in real time. The projection information includes the projection size and / or projection position of the object to be analyzed in the display lens. The step of generating a customer profile visualization result matching the object to be analyzed based on the customer profile analysis data includes: Based on the projection information, at least one target data label to be displayed in the customer profile analysis data, a visualization component template adapted to each target data label, and a component attribute adapted to each target data label are determined. The component attribute includes one or more of component size, component color, and component brightness. Based on the tag information corresponding to each target data tag, the visualization component template adapted to each target data tag, and the component size adapted to each target data tag, a visualization component corresponding to each target data tag is generated as the customer profile visualization result matching the object to be analyzed.

5. The big data customer profile analysis and data display method according to claim 4, characterized in that, The method further includes: When all the data tags include the remaining data tags other than the target data tag, determine whether there is a target display surface around the smart glasses; When it is determined that the target display surface exists around the smart glasses, a visualization component corresponding to each of the remaining data tags is generated. Display the visualization component corresponding to each of the remaining data labels on the target display surface; The step of determining whether a target display surface exists around the smart glasses includes: Based on the third recognition result, it is determined whether there is a target object surface within the optical projection range of the smart glasses that can accept optical projection. When it is determined that there is a target object surface within the optical projection range, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the target object surface; and / or, Based on the positioning information of the smart glasses, it is determined whether there is a target display terminal matching the smart glasses within a circular area with the smart glasses as the center and a preset length as the radius. When it is determined that there is a target display terminal within the circular area, it is determined that there is a target display surface around the smart glasses, and the target display surface includes the display screen of the target display terminal.

6. The big data customer profile analysis and data display method according to claim 4 or 5, characterized in that, The step of displaying the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, includes: Based on the projection information, determine the display coordinates of the visualization component corresponding to each target data label in the displayable lens; Based on the matching coordinates of the visualization component corresponding to each target data label in the displayable lens, the visualization component corresponding to each target data label is displayed in the displayable lens, so that the wearer of the smart glasses can view the visualization results of the customer profile through the displayable lens.

7. A big data customer profile analysis and data display device, characterized in that, The apparatus is used to perform the big data customer profile analysis and data display method as described in any one of claims 1-6, and the apparatus comprises: The recognition module is used to recognize the image to be recognized currently collected by the smart glasses and obtain a first recognition result of the image to be recognized. The first recognition result includes the recognition result corresponding to one or more analyzable objects in the image to be recognized. The analyzable objects include analyzable products and / or analyzable customers in the application scenario of the smart glasses. The determining module is used to determine the customer profile analysis data of the object to be analyzed among all the analyzable objects based on the first identification result; The generation module is used to generate a visual result of a customer profile that matches the object to be analyzed, based on the customer profile analysis data. A display module is used to display the customer profile visualization results in the displayable lens of the smart glasses, so that the wearer of the smart glasses can view the customer profile visualization results through the displayable lens, wherein the displayable lens includes a lens with display function.

Images