Information pushing method, device and equipment, and storage medium

By detecting users' facial features on terminal devices and interacting with the server, the problem of inaccurate delivery of multimedia information on offline terminal devices is solved, achieving personalized information delivery.

CN114741610BActive Publication Date: 2026-02-06BOE TECHNOLOGY GROUP CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210553477.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-20
Publication Date
2026-02-06
Estimated Expiration
2042-05-20

AI Technical Summary

Technical Problem

In existing technologies, multimedia information cannot be accurately pushed to different users when pushed to offline terminal devices, and the pushed content is fixed and lacks personalization.

Method used

The system detects the area a user enters through the terminal device, obtains the user's facial feature information, interacts with the server, and retrieves and pushes multimedia information that matches the user.

Benefits of technology

It enables precise multimedia information push based on facial feature information when the user is near the terminal device, improving the personalization of the push and the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114741610B_ABST
    Figure CN114741610B_ABST
Patent Text Reader

Abstract

The application provides an information pushing method and device, equipment and a storage medium. The information pushing method comprises the following steps: detecting whether a user enters a first area near a terminal device; acquiring facial feature information of the user when it is determined that the user enters the first area; sending the facial feature information to a server; and acquiring multimedia information fed back by the server in response to the facial feature information and pushing the multimedia information. The technical solution of the application can accurately push multimedia information to the user.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the processing and transmission of information, and in particular to an information pushing method and device, equipment and a storage medium. BACKGROUND

[0002] Currently, multimedia information (such as advertising information) is usually pushed on online platforms, and there are few cases of pushing on offline self-service vending equipment and other terminal equipment. Moreover, the multimedia information pushed on offline terminal equipment is usually fixed and cannot be accurately pushed to different users. SUMMARY

[0003] The embodiments of the present application provide an information pushing method, device, equipment and storage medium to solve the problems in the related art. The technical solutions are as follows.

[0004] In a first aspect, the embodiments of the present application provide an information pushing method applied to a terminal device, comprising:

[0005] detecting whether a user enters a first area near the terminal device;

[0006] obtaining facial feature information of the user in a case where it is determined that the user enters the first area;

[0007] sending the facial feature information to a server;

[0008] obtaining multimedia information fed back by the server for the facial feature information and pushing the multimedia information.

[0009] In a second aspect, the embodiments of the present application provide an information pushing method applied to a server, comprising:

[0010] obtaining facial feature information of a user provided by a terminal device; the facial feature information is detected by the terminal device in a case where the user enters a first area near the terminal device;

[0011] querying multimedia information matched with the user according to the facial feature information;

[0012] sending the multimedia information to the terminal device.

[0013] In a third aspect, the embodiments of the present application provide an information pushing device applied to a terminal device, comprising:

[0014] a detection module configured to detect whether a user enters a first area near the terminal device;

[0015] a first information obtaining module configured to obtain facial feature information of the user in a case where it is determined that the user enters the first area;

[0016] The first information sending module is configured to send the facial feature information to the server.

[0017] The information pushing module is configured to acquire multimedia information fed back by the server for the facial feature information and push the multimedia information.

[0018] In a fourth aspect, an information pushing apparatus is provided, and applied to a server, and includes:

[0019] The second information acquiring module is configured to acquire facial feature information of a user provided by a terminal device; the facial feature information is detected by the terminal device when the user enters a first area near the terminal device;

[0020] The information querying module is configured to query multimedia information matched with the user according to the facial feature information;

[0021] The second information sending module is configured to send the multimedia information to the terminal device.

[0022] In a fifth aspect, an electronic device is provided as a terminal device, and includes a memory, a processor, a display apparatus and a communication apparatus.

[0023] The memory, the display apparatus and the communication apparatus are electrically connected to the processor.

[0024] The memory stores a computer program, the computer program is loaded and executed by the processor, and the computer program is used to implement the information pushing method applied to the terminal device provided in any of the embodiments of the present application.

[0025] The display apparatus is used to output the multimedia information.

[0026] The communication apparatus is used to communicate with the server.

[0027] In a sixth aspect, an electronic device is provided as a server, and includes:

[0028] The memory, the processor and the communication apparatus.

[0029] The memory and the communication apparatus are electrically connected to the processor.

[0030] The memory stores a computer program, the computer program is loaded and executed by the processor, and the computer program is used to implement the information pushing method applied to the server provided in any of the embodiments of the present application.

[0031] The communication apparatus is used to communicate with the terminal device.

[0032] In a seventh aspect, a computer readable storage medium is provided, and stores a computer program, the computer program is executed by a processor to implement the information pushing method provided in any of the embodiments of the present application.

[0033] The advantages or beneficial effects of the technical solutions described above include at least:

[0034] Through information interaction between the terminal device and the server, the push of multimedia information on the terminal device can be realized, and in the case that the user is close to the terminal device, the multimedia information matched with the user can be pushed based on the facial feature information of the user, so as to realize accurate push for the user.

[0035] The above summary is only for the purpose of the description and is not intended to limit in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will be readily apparent to those skilled in the art by reference to the drawings and the following detailed description. BRIEF DESCRIPTION OF DRAWINGS

[0036] In the drawings, like reference numerals refer to same or similar functionalities throughout the several views. The drawings are not necessarily to scale. It is to be understood that these drawings only depict some embodiments in accordance with the disclosure and should not be considered to be limiting of the scope of the disclosure.

[0037] Figure 1 A flowchart of an information push method applied to a terminal device according to an embodiment of the disclosure;

[0038] Figure 2 A partial flowchart of another information push method applied to a terminal device according to an embodiment of the disclosure;

[0039] Figure 3 A partial flowchart of another information push method applied to a terminal device according to an embodiment of the disclosure;

[0040] Figure 4 A flowchart of an information push method applied to a server according to an embodiment of the disclosure;

[0041] Figure 5 A partial flowchart of another information push method applied to a server according to an embodiment of the disclosure;

[0042] Figure 6 A partial flowchart of another information push method applied to a server according to an embodiment of the disclosure;

[0043] Figure 7 A partial flowchart of another information push method applied to a server according to an embodiment of the disclosure;

[0044] Figure 8 A structural framework diagram of an information push device according to an embodiment of the disclosure;

[0045] Figure 9 Another structural framework diagram of an information pushing device provided by an embodiment of the present application is shown in the figure.

[0046] Figure 10 A structural framework diagram of a terminal device provided by an embodiment of the present application is shown in the figure.

[0047] Figure 11 A structural framework diagram of a server provided by an embodiment of the present application is shown in the figure.

[0048] Figure 12 A communication principle diagram of the server and the terminal device in an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0049] In the following, only some exemplary embodiments are simply described. As can be realized by those skilled in the art, the described embodiments can be modified in various different ways without departing from the spirit or scope of the present application. Therefore, the drawings and the description are considered to be exemplary in nature rather than limiting.

[0050] First, several terms related to the embodiments of the present application are introduced:

[0051] Self-service vending device: a device that can be used by a user to purchase goods, which can integrate a display device and a smart terminal.

[0052] Message queue: can be used to solve application coupling, asynchronous message, traffic clipping, etc., to realize high-performance, high-availability, scalable and eventually consistent architecture middleware.

[0053] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems are described in detail in the following specific embodiments.

[0054] An information pushing method provided by an embodiment of the present application can be applied to a terminal device, such as a smart refrigerator, a self-service vending device, etc. Figure 1 As shown in the figure, the method comprises:

[0055] S101, detecting whether a user enters a first area near the terminal device.

[0056] The terminal device can be any one of a smart refrigerator, a self-service vending device, etc.

[0057] The range of the first area can be set according to actual needs, which is not limited by the embodiments of the present application.

[0058] S102, acquiring facial feature information of the user in a case where it is determined that the user enters the first area.

[0059] In a case where it is determined that no user enters the first area, the detection in S101 can be continuously performed.

[0060] In S103, the facial feature information is sent to the server.

[0061] In S104, multimedia information fed back by the server for the facial feature information is acquired and pushed.

[0062] The multimedia information can be at least one of an advertisement (at least one of an audio advertisement, a video advertisement, a picture advertisement, etc.), a video of a movie or a TV series, a short video, and the like, and can also be other types of multimedia information that can be pushed, which is not limited in the embodiments of the present application.

[0063] The information pushing method provided by the embodiments of the present application can realize pushing of multimedia information on a terminal device through information interaction between the terminal device and the server, and can push multimedia information matched with a user based on facial feature information of the user in a case where the user approaches the terminal device, so as to realize accurate pushing for the user.

[0064] In the above step S101, whether a user enters the first area can be detected by a detection device in the terminal device. The detection device can be an infrared sensor.

[0065] In the above step S102, the facial feature information of the user can include: acquiring a facial image of the user collected by a camera in the terminal device, and identifying the facial image to obtain the facial feature information. The identification of the facial image can be realized by a pre-trained image recognition model, which can be a neural network model.

[0066] Optionally, when the facial image is identified, the facial shape feature, the gender feature and the age feature of the facial image can be identified to obtain high-quality facial feature information including facial shape feature parameters, gender feature parameters and age feature parameters, which is beneficial to subsequent accurate comparison with the facial feature information of the server.

[0067] In an optional embodiment, the information pushing method applied to the terminal device provided by the embodiments of the present application can further include:

[0068] The multimedia information provided by the server for a geographical range to which the terminal device belongs (referred to as first multimedia information) is acquired, and the first multimedia information is pushed before the multimedia information fed back by the server for the facial feature information (referred to as second multimedia information) is acquired. In a case where the second multimedia information is acquired, the pushing content can be switched from the first multimedia information to the second multimedia information.

[0069] The first multimedia information can include multimedia material information to be pushed and an information list of the multimedia material information, and the information list can be made by the server based on the multimedia material information.

[0070] Based on this manner, the terminal device of the embodiment of the present application can push the default first multimedia information when there is no user nearby, and can acquire and accurately push the second multimedia information for the user when the user is nearby, so as to realize the diversity of information pushing in different stages.

[0071] The information pushing method applied to the terminal device provided by the embodiment of the present application can further detect whether a user enters a third area, and the operation of acquiring the first multimedia information can be executed under the condition that the user enters the third area, and the distance between the third area and the terminal device can be greater than the distance between the first area and the terminal device.

[0072] Based on this manner, while realizing the diversity of information pushing, the default first multimedia information can be further pushed when the user enters the third area, that is, there is user activity near the terminal device, so as to reduce the pushing time of the default first multimedia information, reduce invalid pushing when there is no user activity near the terminal device, and reduce power consumption.

[0073] In an optional embodiment, as shown in Figure 2 The information pushing method applied to the terminal device provided by the embodiment of the present application can further include the following steps S201-S203:

[0074] S201, the terminal device detects whether a user enters a second area; if yes, S202 is executed, and if no, S203 is executed.

[0075] The distance between the second area and the terminal device is less than the distance between the first area and the terminal device. That is, compared with the first area, the second area is an area closer to the terminal device.

[0076] S202, the pushing strength of the multimedia information is reduced, or the pushing of the multimedia information is stopped.

[0077] When the user enters the second area closer to the terminal device, the user can perform some operations on the terminal device, for example, for a smart refrigerator and a self-service vending device, the user can open the door of the smart refrigerator and the self-service vending device to check or take out the goods. In order to avoid the interference of the pushed content on the user, the pushing can be stopped.

[0078] Reducing the pushing strength of the multimedia information can include reducing the display brightness of a transparent display device in the terminal device.

[0079] Stopping the pushing of the multimedia information can include turning off the display function of the transparent display device in the terminal device.

[0080] The transparent display device is a device that can display information and has certain penetration. When the display function is turned on, information can be displayed. When the display function of the transparent display device is turned off, the user can see the background on the other side through the transparent display device. For a smart refrigerator and a self-service vending device, the display brightness of the transparent display device arranged on the cabinet door can be reduced or the transparent display device arranged on the cabinet door can be turned off, so that the user can see the articles in the smart refrigerator and the self-service vending device through the transparent display device.

[0081] S203, the terminal device keeps the current state.

[0082] The current state can be to push the default first multimedia information or not to push any information.

[0083] In the step S202, the specific manner of reducing the push strength of the multimedia information can be adjusting the push strength of the multimedia information according to the change of the distance between the user and the terminal device. When the distance between the user and the terminal device becomes smaller, the push strength of the multimedia information is reduced. With the continuous reduction of the distance between the user and the terminal device, the push strength of the multimedia information can be continuously reduced.

[0084] The push strength can be represented by the display brightness of the display device. The adjustment of the push strength can be realized by adjusting the display brightness of the multimedia information on the display device. For example, in the process of continuously approaching the terminal device, the display brightness of the transparent display device can be continuously reduced. When the distance between the user and the terminal device is reduced to a certain set distance, the display brightness is reduced to a lower brightness value and maintained at the display brightness, or the display brightness is reduced to the display function of the display device is turned off.

[0085] Optionally, the information push method provided by the embodiment of the application can further include detecting whether the user leaves the second area. When it is determined that the user leaves the second area, the push content can be converted from the second multimedia information matched with the user to the default first multimedia information.

[0086] In an optional embodiment, the terminal device can be a self-service vending device, such as a refrigerator. Figure 3 As shown in the figure, the information push method applied to the terminal device provided by the embodiment of the application can further include the following steps S301-S302:

[0087] S301, in response to a consumption start signal triggered by the user, the feature of the goods taken out by the user is recognized through a goods recognition algorithm to obtain the goods feature information of the taken-out goods.

[0088] The user can trigger the consumption start signal in any of the following ways: inputting information such as the type and quantity of the goods to be purchased through an input device, or opening the door of the self-service vending device.

[0089] The goods recognition algorithm can be provided by the server, and the self-service vending device can store the goods recognition algorithm for subsequent goods recognition.

[0090] S302, in response to the consumption end signal triggered by the user, sending the goods feature information of the taken goods to the server.

[0091] The user can trigger the consumption end signal in any of the following ways: completing payment for the purchased goods, or closing the door of the self-service vending device.

[0092] Through steps S301-S302, the server can record the user's consumption behavior in a timely manner, effectively associate the goods and the user, and facilitate analysis of the user's consumption behavior and habits.

[0093] The server can initiate payment to the user before or after receiving the goods feature information uploaded by the self-service vending device, for example, through the display device of the terminal device or the mobile device of the user.

[0094] In the embodiments of the present application, the terminal device can send the face feature information, consumption information, and goods feature information to the server through a message queue.

[0095] In the embodiments of the present application, the goods recognition algorithm can be configured by the server and sent to the terminal device.

[0096] In the embodiments of the present application, the specific way in which the terminal device pushes the multimedia information (for example, the first multimedia information or the second multimedia information) can include: displaying the multimedia information through a display device provided on the terminal device.

[0097] Based on the same inventive concept, the embodiments of the present application also provide an information pushing method, which can be applied to a server, as shown in the method includes: Figure 4

[0098] S401, obtaining the face feature information of the user provided by the terminal device.

[0099] The face feature information is detected by the terminal device when the user enters a first area near the terminal device.

[0100] S402, querying the multimedia information matched with the user according to the face feature information.

[0101] ​S403, send the multimedia information to the terminal device.

[0102] Based on the information pushing method, the server can query the multimedia information matched with the user according to the facial feature information of the user and feed back the terminal device, so that the terminal device can push the multimedia information accurately.

[0103] In the step S402, as shown in the following steps S501-S504, Figure 5

[0104] S501, determine whether the facial feature information provided by the terminal device is stored; if yes, execute S502, if not, execute S504.

[0105] The server can pre-store the facial feature information of multiple users, and when receiving the facial feature information of the current user, query whether the facial feature information of the current user exists in the pre-stored multiple facial feature information. If it exists, it means that the information of the user has been recorded, if it does not exist, it means that the information of the user has not been recorded.

[0106] In one example, the server can pre-store the facial feature information of users A, B and C, and when receiving the current facial feature information, query whether the facial feature information of the current user exists in the facial feature information of users A, B and C. For example, if the similarity of the facial feature information of the current user and the facial feature information of user A is greater than a preset similarity threshold, it can be considered that the facial feature information of the user and the facial feature information of the current user are the facial feature information of the same user, and the user and the current user are the same user, that is, the facial feature information of the current user has been stored.

[0107] S502, query the consumption preference information associated with the facial feature information provided by the terminal device.

[0108] The server can pre-store the historical consumption information of multiple users, statistically analyze the historical consumption information of each user to obtain the consumption preference information reflecting the consumption preference of each user, and establish the association relationship between the consumption preference information and the facial feature information for each user.

[0109] In the case that the facial feature information of the current user is received and confirmed to have been stored, the consumption preference information associated with the facial feature information of the current user can be queried in the pre-stored association relationship between the consumption preference information and the facial feature information.

[0110] ​In one example, the server can pre-store the historical consumption information of users A, B and C, respectively analyze the historical consumption information of the three users, obtain the corresponding consumption preference information, and respectively establish the association between the consumption preference information and the facial feature information of the three users. In the case that the facial feature information of the current user is received and it is confirmed that the current user is user A based on the facial feature information, the consumption preference information of user A can be determined as the consumption preference information associated with the facial feature information of the current user based on the association between the consumption preference information of user A and the facial feature information of user A.

[0111] S503, obtaining multimedia information meeting the consumption preference of the user as the multimedia information matched with the user according to the queried consumption preference information.

[0112] In one example, the server can pre-acquire a plurality of candidate multimedia information from the device of the multimedia information provider and store them, and after determining the consumption preference information associated with the facial feature information of the current user, the multimedia information meeting the consumption preference of the user can be obtained from the stored candidate multimedia information as the multimedia information matched with the user.

[0113] In another example, the server can obtain the multimedia information meeting the consumption preference of the user from the device of the multimedia information provider in real time after querying the consumption preference information.

[0114] S504, storing the facial feature information provided by the terminal device.

[0115] When a new user is encountered, the new facial feature information is stored, which can expand the data amount of the facial feature information in the server as the data basis for querying the facial feature information, consumption preference information, multimedia information and the like next time.

[0116] Through the above steps S501-S504, the server of the embodiment of the application can query the consumption preference information of the user based on the facial feature information of the user, and further obtain the multimedia information based on the consumption preference information of the user, which can make the screened multimedia information meet the consumption preference of the user and improve the pushing effect of the multimedia information.

[0117] In an optional implementation, in the case that the terminal device is a self-service vending device, as shown in FIG. 6, the information pushing method applied to the server provided by the embodiment of the application can further include the following steps S601-S602: Figure 6

[0118] S601, obtaining the historical consumption information of the user provided by the self-service vending device.

[0119] The historical consumption information can include the product feature information recognized in the multiple consumption processes, and can also include the consumption times.​

[0120] The historical consumption information can be sent to the server in multiple times, i.e., the consumption information of each consumption is sent to the server as part of the historical consumption information in response to a consumption end signal after each consumption ends, or the historical consumption information is locally stored and sent to the server in whole or in part upon a request of the server.

[0121] S602, statistical analysis is performed on the historical consumption information of the user to obtain at least one of consumption preference information and consumption trend information of the user.

[0122] The consumption preference information of the user can include a type of goods which is purchased most frequently or in the largest quantity by the user in a set time period. The set time period can be a relatively recent time period before the current time, such as a week, a month, etc., which can be set according to actual needs. The type of goods can include types such as carbonated drinks, fruit juice, etc., or specific brand types.

[0123] The consumption trend information of the user can include a change feature of the consumption preference of the user in different time periods. The different time periods for comparison of the consumption preference can be set according to specific needs, such as a comparison between two months, e.g., May and June, before the current time, in which the user purchases carbonated drinks most frequently in May and purchases fruit juice most frequently in June, and the consumption preference of the user changes from carbonated drinks to fruit juice.

[0124] The consumption preference information of the user can serve as a data basis for feedback of multimedia information to the terminal device to achieve accurate pushing.

[0125] The consumption preference information and the consumption trend information of the user can serve as a data basis for relevant decisions of a multimedia information provider, such as an advertiser, and be provided to the multimedia information provider, which can determine what kind of multimedia information needs to be provided to the self-service vending device according to the data basis. For example, if the consumption preference of the user is carbonated drinks or the consumption preference changes to carbonated drinks, the multimedia information provider can provide more information of carbonated drinks to the server for targeted feedback to the self-service vending device.

[0126] The consumption preference information and the consumption trend information of the user can also serve as a data basis for relevant decisions of an operator of the self-service vending device, such as the operator of the self-service vending device can determine what kind of goods needs to be configured for the self-service vending device and how many goods need to be configured according to the data basis. For example, if the consumption preference of the user is carbonated drinks or the consumption preference changes to carbonated drinks, the operator of the self-service vending device can replenish more carbonated drinks in the self-service vending device to meet the purchase needs of the user.

[0127] In the embodiment, the historical consumption information of the user can be obtained from one self-service vending device or from multiple self-service vending devices.

[0128] In another optional embodiment, in the case that the terminal device is a self-service vending device, as shown in the figure, the information pushing method applied to the terminal device provided by the embodiment of the application can further include the following steps S701-S702: Figure 7

[0129] S701, obtaining the historical consumption information of different types of users provided by the self-service vending device.

[0130] The different types of users can include any of the following cases: users in different geographical ranges, users of different genders, users in different age groups, etc. One geographical range can be a street, a business district, a specific commercial site (such as a shopping mall or an office building), etc.

[0131] The historical consumption information of the different types of users can include the product feature information identified in the multiple consumption processes of each type of user, and can also include the number of consumptions.

[0132] S702, statistically analyzing the historical consumption information of the different types of users to obtain the consumption preference information of each type of user.

[0133] The consumption preference information of the different types of users can include the product type with the most number of purchases or the largest purchase amount of each type of user in a set time period. The set time period can be a relatively recent time period before the current time, such as a week, a month, etc., which can be set according to actual needs. The product type can include carbonated beverages, fruit juice, etc., or can include specific brand types.

[0134] In one example, the historical consumption information of users in different business districts can be statistically analyzed. If the product type with the most number of purchases or the largest purchase amount of users in business district one in a set time period is carbonated beverages, and the product type with the most number of purchases or the largest purchase amount of users in business district two in the same time period is fruit juice, then the consumption preference of the users in business district one is carbonated beverages, and the consumption preference of the users in business district two is fruit juice.

[0135] In another example, the historical consumption information of users in different age groups can be statistically analyzed. If the product type with the most number of purchases or the largest purchase amount of elderly users in a set time period is tea, and the product type with the most number of purchases or the largest purchase amount of young users in the same time period is carbonated beverages, then the consumption preference of the elderly users is tea, and the consumption preference of the young users is carbonated beverages.

[0136] ​The consumption preference information of different types of users can serve as a data basis for relevant decision-making of a multimedia information provider (e.g., an advertiser), and the multimedia information provider can determine what kind of multimedia information needs to be provided to the self-service vending device based on the data basis.

[0137] For example, if the consumption preference of users in a first commercial area is carbonated beverages and the consumption preference of users in a second commercial area is juice, the multimedia information provider can provide the server with information of carbonated beverages and juice, and the server can provide the self-service vending device in the first commercial area with multimedia information of carbonated beverages and the self-service vending device in the second commercial area with multimedia information of juice. For another example, if the consumption preference of elderly users is tea and the consumption preference of young users is carbonated beverages, the multimedia information provider can provide the server with multimedia information related to tea and carbonated beverages to meet the purchase demand of users of different ages.

[0138] The consumption preference information of different types of users can also serve as a data basis for relevant decision-making of a self-service vending device operator, and the self-service vending device operator can determine what kind of goods need to be configured for the self-service vending device and how many goods need to be configured based on the data basis.

[0139] For example, if the consumption preference of users in a first commercial area is carbonated beverages and the consumption preference of users in a second commercial area is juice, the self-service vending device operator can replenish the self-service vending device in the first commercial area with carbonated beverages and replenish the self-service vending device in the second commercial area with juice to meet the purchase demand of users in different commercial areas. For another example, if the consumption preference of elderly users is tea and the consumption preference of young users is carbonated beverages, the self-service vending device operator can replenish the self-service vending device with tea and carbonated beverages to meet the purchase demand of users of different ages.

[0140] For different gender users or users of different ages, after the consumption preference information of users of each gender or the consumption preference information of users of each age is analyzed, the consumption preference information of users of each gender can be compared, or the consumption preference information of users of each age can be compared, to determine a type of goods with a higher purchase frequency or purchase quantity, and multimedia information or replenishment of the type of goods can be provided.

[0141] In the embodiment, when the different types of users are different gender users or users of different ages, the historical consumption information of the different gender users or the users of different ages can be sourced from one self-service vending device or multiple self-service vending devices; when the different types of users are users in different geographical ranges, the historical consumption information of the users in different geographical ranges is sourced from self-service vending devices in the different geographical ranges, and the historical consumption information of users in the same geographical range can be sourced from one or more self-service vending devices in the geographical range.

[0142] The consumption preference information and the consumption trend information in the embodiments of the present application can be visualized information, so as to be visually displayed to the multimedia information provider and the operator of the self-service vending device.

[0143] In an optional embodiment, in the case that the terminal device is a self-service vending device, the information pushing method provided by the embodiments of the present application further comprises:

[0144] The server acquires first time information of historical pushing operations (i.e. operations of pushing historical multimedia information) provided by the self-service vending device and second time information of historical consumption behaviors of the user; and determines whether there is a time-associated historical pushing operation and a historical consumption behavior according to the first time information and the second time information, so as to determine a hit rate of the historical pushing multimedia information.

[0145] The hit rate of the historical pushing multimedia information represents a proportion of a number of the time-associated historical pushing operations to a total number of historical pushing operations.

[0146] The time association includes any one of the following cases: a time range in which the historical consumption behavior occurs overlaps with a time range of the historical pushing operation; or, the time range in which the historical consumption behavior occurs does not overlap with the time range of the historical pushing operation, but a difference between a starting time of the historical consumption behavior and an ending time of the time range of the historical pushing operation is less than a set threshold.

[0147] Taking pushing of advertising information as an example, if the historical pushing operation and the historical consumption behavior are time-associated, it can be considered that the user purchases the goods in the process of pushing of the advertising information or purchases the goods soon after the pushing of the advertising information ends, which is helpful to analyze an advertising hit rate, i.e. a proportion of a number of the time-associated historical advertising playing (a kind of historical pushing operation) to a total number of historical advertising playing, and based on the advertising hit rate, a next advertising putting and pushing strategy can be determined.

[0148] The server can send the multimedia information, the goods recognition algorithm, etc. to the terminal device through a message queue.

[0149] The server can configure or update the goods recognition algorithm according to an association relationship of the goods and the goods feature information provided by the goods supplier.

[0150] Based on the same inventive concept, the embodiments of the present application further provide an information pushing device, which can be applied to a terminal device, such as a self-service vending device. Figure 8 As shown in the figure, the device can include a detection module 801, a first information acquisition module 802, a first information sending module 803 and an information pushing module 804.

[0151] The detection module 801 is configured to detect whether a user enters a first area near the terminal device.

[0152] The first information acquisition module 802 is configured to acquire facial feature information of the user in a case where it is determined that the user enters the first area.

[0153] The first information sending module 803 is configured to send the facial feature information to a server.

[0154] The information pushing module 804 is configured to acquire multimedia information fed back by the server for the facial feature information and push the multimedia information.

[0155] In an optional implementation, the detection module 801 is further configured to detect whether the user enters a second area, the second area being closer to the terminal device than the first area.

[0156] Optionally, the information pushing module 804 is specifically configured to close a display function of a transparent display device in the terminal device, so as to stop pushing the multimedia information fed back by the server for the facial feature information of the current user.

[0157] In an optional implementation, the first information sending module 803 is specifically configured to send the facial feature information to the server through a message queue.

[0158] In an optional implementation, the information pushing device applied to the terminal device provided by the embodiments of the present application further includes a commodity identification module, which is configured to, in a case where the terminal device is a self-service vending device, acquire commodity feature information of a taken commodity through a commodity identification algorithm in response to a consumption start signal triggered by the user, and send the commodity feature information of the taken commodity to the server in response to a consumption end signal triggered by the user.

[0159] Based on the same inventive concept, the embodiments of the present application further provide an information pushing device, which can be applied to a server, as shown in Figure 9 The device includes a second information acquisition module 901, an information query module 902 and a second information sending module 903.

[0160] The second information acquisition module 901 is configured to acquire facial feature information of a user provided by a terminal device, the facial feature information being detected by the terminal device in a case where the user enters a first area near the terminal device.

[0161] The information query module 902 is configured to query multimedia information matched with the user according to the facial feature information.

[0162] The second information sending module 903 is configured to send the multimedia information to the terminal device.

[0163] The information query module 902 can be specifically configured to: determine whether the facial feature information is stored; in a case where it is determined that the facial feature information is stored, query consumption preference information associated with the facial feature information; and obtain multimedia information meeting a consumption preference of the user as the multimedia information matched with the user according to the consumption preference information.

[0164] In an optional implementation, the information push device applied to the server provided by the embodiment of the present application can further include a first analysis module, which can be configured to: in a case where the terminal device is a self-service vending device, obtain historical consumption information of the user provided by the self-service vending device; and statistically analyze the historical consumption information to obtain at least one of consumption preference information and consumption trend information of the user.

[0165] In an optional implementation, the information push device applied to the server provided by the embodiment of the present application can further include a second analysis module, which can be configured to: in a case where the terminal device is a self-service vending device, obtain historical consumption information of different types of users provided by the self-service vending device; and statistically analyze the historical consumption information to obtain respective consumption preference information of the different types of users.

[0166] In an optional implementation, the information push device applied to the server provided by the embodiment of the present application can further include a third analysis module, which can be configured to: in a case where the terminal device is a self-service vending device, obtain first time information of a historical push operation and second time information of a historical consumption behavior of the user provided by the self-service vending device; and determine whether there is a time-associated historical push operation and historical consumption behavior according to the first time information and the second time information, to determine a hit rate of the multimedia information.

[0167] The functions of the modules in the information recommendation device provided by the embodiment of the present application can refer to the corresponding description in the method embodiments, which will not be described herein.

[0168] Based on the same inventive concept, the embodiment of the present application further provides an electronic device, which can be used as a terminal device, as shown in the figure, the device includes a memory 1001, a processor 1002, a display device 1003 and a communication device 1004. The memory 1001, the display device 1003, the communication device 1004 are all electrically connected with the processor 1002. The number of the memory 1001, the processor 1002, the display device 1003 and the communication device 1004 can be one or more. Figure 10 The functions of the modules in the information recommendation device provided by the embodiment of the present application can refer to the corresponding description in the method embodiments, which will not be described herein.

[0169] The memory 1001 stores a computer program which is loaded and executed by the processor 1002 to implement the information pushing method applied to a terminal device as provided in any of the embodiments of the present application; the display device 1003 is configured to output multimedia information; and the communication device is configured to communicate with a server.

[0170] The display device 1003 can be a transparent display device, such as a transparent LED (Light-Emitting Diode) display screen or a transparent LCD (Liquid Crystal Display) display screen, which has a display function and a certain penetration, and can be switched between the display and penetration states. The transparent display device can combine the selling function and the information pushing function together, and fully utilize the device resources.

[0171] The display device 1003 can be configured with output control software to parse the multimedia information and control the output of the multimedia information, so as to achieve the information pushing purpose.

[0172] The terminal device provided in the embodiments of the present application can further include a detection device, which can be used to detect whether a user enters the first area or the second area, and can also be used to detect whether a commodity is taken out or put in. The detection device can include an infrared sensor, and is arranged on the side of the terminal device facing the user and / or the internal space of the terminal device.

[0173] The terminal device provided in the embodiments of the present application can further include an input device, such as a physical keyboard, a mouse or an operating lever, which can be used by a user to input information, and the input device can be electrically connected to the processor 1002. The display device 1003 in the embodiments of the present application can also be configured with an input function, and a user can input information by touching the display device, pressing a function key, etc.

[0174] The terminal device provided in the embodiments of the present application can further include a camera device, which can be electrically connected to the processor 902, and is configured to capture a facial image of a user.

[0175] The communication device 1004 can include a communication interface, which can transmit data to and interact with external devices (such as a server) through a message queue.

[0176] The terminal device in the embodiments of the present application can be a smart refrigerator, a self-service selling device or the like, and can implement various functions such as facial feature recognition and commodity recognition.

[0177] Based on the same inventive concept, the embodiments of the present application further provide an electronic device, which can be used as a server, such as Figure 11As shown, the device can include a memory 1101, a processor 1102 and a communication device 1103; the memory 1101 and the communication device 1103 are electrically connected with the processor 1102. The number of the memory 1101, the processor 1102 and the communication device 1103 can be one or more.

[0178] The memory 1101 has a computer program stored therein, which is loaded and executed by the processor 1102 to implement the information pushing method applied to the server as provided by any embodiment of the present application; the communication device 1103 is configured to communicate with the terminal device.

[0179] The communication device 1103 can include a communication interface, which can interact with external devices (for example, the terminal device) through a message queue to transmit data.

[0180] Referring to Figure 12 , a large number of terminal devices can be accessed by using the message queue, and based on the asynchronous communication feature of the message queue, the server and the terminal device can be decoupled, the user can customize the time and period of content delivery, and the server can effectively obtain the state feedback of the terminal device without maintaining a long-time communication connection with the terminal device.

[0181] The server provided by the embodiments of the present application can realize device management, commodity management, multimedia information management, algorithm configuration update, statistical analysis and other functions. The terminal device provided by the embodiments of the present application can realize face feature recognition, commodity recognition, push control, display device control, distance judgment and other functions.

[0182] In the same device, if the memory, the processor and the communication interface are independently implemented, the memory, the processor and the communication interface can be connected with each other through a bus and complete the communication therebetween. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 10 and Figure 11 only one thick line is used in the figure, but it does not mean that there is only one bus or only one type of bus. Referring to Figure 10 , in the terminal device, the display device can also be connected with other components through a bus and complete the communication therebetween.

[0183] Optionally, in a specific implementation, if the memory, the processor and the communication interface are integrated on a chip, the memory, the processor and the communication interface can complete the communication among each other through an internal interface.

[0184] Based on the same inventive concept, the embodiment of the present application further provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the information pushing method provided by any of the embodiments of the present application.

[0185] Based on the same inventive concept, the embodiment of the present application further provides a chip, which comprises a processor, and the processor is configured to call and run instructions stored in a memory, so that a communication device installed with the chip executes the method provided by the embodiment of the present application.

[0186] Based on the same inventive concept, the embodiment of the present application further provides a chip, which comprises an input interface, an output interface, a processor and a memory, the input interface, the output interface, the processor and the memory are connected through an internal connection path, and the processor is configured to execute code in the memory, and when the code is executed, the processor is configured to execute the method provided by the embodiment of the present application.

[0187] It should be understood that the processor described above can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc. It should be noted that the processor can be a processor supporting an advanced RISC machine (ARM) architecture.

[0188] Further, the aforementioned memory can include a read-only memory, and a random access memory, and can further include a non-volatile random access memory. The memory can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memory. The non-volatile memory can include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can include a random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available. For example, a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct Rambus RAM (DR RAM) can be used.

[0189] In the above-described embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to the present disclosure are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable apparatus. The computer instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium.

[0190] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. Also, the specific features, structures, materials or characteristics described can be combined in any appropriate manner in any one or more embodiments or examples. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the present specification and the features of the different embodiments or examples without contradiction.

[0191] In addition, the terms "first", "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise specifically limited.

[0192] Any process or method descriptions in flow charts or described elsewhere herein can be understood as representing code modules, segments, or portions of code that include one or more executable instructions for performing specific logic functions or steps in the process. And the scope of preferred embodiments of the present application includes additional implementation in which the functions described in the illustrated or discussed order are not necessarily performed in that order. For example, functions described sequentially can be performed at least partially concurrently or in reverse order.

[0193] The logic and / or steps represented in flow charts or described elsewhere herein, for example, can be considered as a list of executable instructions for implementing logic functions, which can be specifically embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus or device, such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, apparatus or device and execute the instructions.

[0194] In addition, each functional unit in each embodiment of the present application can be integrated in one processing module, or each unit can be physically present separately, or two or more units can be integrated in one module. The above integrated module can be realized in the form of hardware or in the form of software functional module. The above integrated module, if realized in the form of software functional module and sold or used as an independent product, can also be stored in a computer readable storage medium. The storage medium can be a read-only memory, a magnetic disk or an optical disk, etc.

[0195] The above merely provides the specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of various changes or replacements within the technical range disclosed by the present application, and these should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An information push method, characterized in that, Applied to terminal devices, including: Detect whether a user has entered a first area near the terminal device; If it is determined that a user has entered the first area, obtain the user's facial feature information; Send the facial feature information to the server; Obtain and push multimedia information fed back by the server in response to the facial feature information; The method further includes: Detect whether a user enters a third area, where the distance between the third area and the terminal device is greater than the distance between the first area and the terminal device; Upon detecting that a user has entered the third area, the server obtains and pushes multimedia information provided by the server for the geographical range of the terminal device. Detect whether the user has entered the second area, where the distance between the second area and the terminal device is less than the distance between the first area and the terminal device; If it is determined that the user has entered the second area, the push intensity of the multimedia information is reduced, or the push of the multimedia information is stopped.

2. The information push method according to claim 1, characterized in that, The step of stopping the push of the multimedia information includes: Turn off the display function of the transparent display device in the terminal device.

3. The information push method according to any one of claims 1-2, characterized in that, Also includes: When the terminal device is a self-service vending machine, in response to the consumption start signal triggered by the user, the product identification algorithm is used to identify the features of the product taken out by the user to obtain the product feature information of the product taken out. In response to the consumption termination signal triggered by the user, the product feature information is sent to the server.

4. The information push method according to any one of claims 1-2, characterized in that, Sending the facial feature information to the server includes: The facial feature information is sent to the server via a message queue.

5. An information push method, characterized in that, Applied to servers, including: The terminal device acquires facial feature information of the user provided by the terminal device; the facial feature information is detected by the terminal device when the user enters a first area near the terminal device; the terminal device is also used to acquire and push multimedia information provided by the server for the geographical range of the terminal device when it detects that a user has entered a third area, wherein the distance between the third area and the terminal device is greater than the distance between the first area and the terminal device; the terminal device is also used to reduce the push intensity of the multimedia information or stop pushing the multimedia information when it is determined that the user has entered a second area, wherein the distance between the second area and the terminal device is less than the distance between the first area and the terminal device; Based on the facial feature information, query multimedia information that matches the user; The multimedia information is sent to the terminal device.

6. The information push method according to claim 5, characterized in that, The step of querying multimedia information matching the user based on the facial feature information includes: Determine whether the facial feature information has been stored; If it is determined that the facial feature information has been stored, query the consumption preference information associated with the facial feature information; Based on the aforementioned consumption preference information, multimedia information that matches the user's consumption preferences is queried and used as the multimedia information matched with the user.

7. The information push method according to claim 5 or 6, characterized in that, The information push method further includes: When the terminal device is a self-service vending machine, the user's historical consumption information provided by the self-service vending machine is obtained; Statistical analysis is performed on the historical consumption information to obtain at least one of the user's consumption preference information and consumption trend information.

8. The information push method according to claim 5 or 6, characterized in that, Also includes: When the terminal device is a self-service vending machine, historical consumption information of different types of users provided by the self-service vending machine is obtained; By performing statistical analysis on the historical consumption information, the consumption preference information of the different types of users can be obtained.

9. The information push method according to claim 5 or 6, characterized in that, Also includes: When the terminal device is a self-service vending machine, the first time information of the historical push operation provided by the self-service vending machine and the second time information of the user's historical consumption behavior are obtained; Based on the first time information and the second time information, determine whether there are time-related historical push operations and historical consumption behaviors, so as to determine the hit rate of historically pushed multimedia information.

10. An information push device, characterized in that, Applied to terminal devices, including: The detection module is used to detect whether a user has entered a first area near the terminal device; The first information acquisition module is used to acquire the facial feature information of the user when it is determined that a user has entered the first area; The first information sending module is used to send the facial feature information to the server; The information push module is used to obtain and push multimedia information fed back by the server in response to the facial feature information; The detection module is also used to detect whether a user enters a third area, wherein the distance between the third area and the terminal device is greater than the distance between the first area and the terminal device; The information push module is also used to obtain and push multimedia information provided by the server for the geographical range of the terminal device when it is detected that a user has entered the third area. The detection module is also used to detect whether the user has entered the second area, the distance between the second area and the terminal device is less than the distance between the first area and the terminal device; The information push module is also used to reduce the push intensity of the multimedia information or stop pushing the multimedia information when it is determined that the user has entered the second area.

11. An information push device, characterized in that, Applied to servers, including: The second information acquisition module is used to acquire facial feature information of the user provided by the terminal device. The facial feature information is detected by the terminal device when the user enters a first area near the terminal device. The terminal device is also used to acquire and push multimedia information provided by the server for the geographical range of the terminal device when it detects that a user has entered a third area. The distance between the third area and the terminal device is greater than the distance between the first area and the terminal device. The terminal device is also used to reduce the push intensity of the multimedia information or stop pushing the multimedia information when it is determined that the user has entered the second area. The distance between the second area and the terminal device is less than the distance between the first area and the terminal device. The information query module is used to query multimedia information that matches the user based on the facial feature information; The second information sending module is used to send the multimedia information to the terminal device.

12. An electronic device, as a terminal device, characterized in that, include: Memory, processor, display device, and communication device; The memory, the display device, and the communication device are all electrically connected to the processor; The memory contains a computer program, which is loaded and executed by a processor to implement the information push method as described in any one of claims 1-4; The display device is used to output multimedia information; The communication device is used to communicate with the server.

13. The electronic device according to claim 12, characterized in that, The display device is a transparent display device.

14. An electronic device, serving as a server, characterized in that, include: Memory, processor, and communication device; Both the memory and the communication device are electrically connected to the processor. The memory contains a computer program, which is loaded and executed by a processor to implement the information push method as described in any one of claims 5-9; The communication device is used to communicate with terminal equipment.

15. A computer-readable storage medium, characterized in that, The system contains a computer program that, when executed by a processor, implements the information push method as described in any one of claims 1-9.

Citation Information

Patent Citations

  • Unmanned vending method and unmanned vending machine

    CN108615296A

  • Multimedia data recommendation method and device

    CN108763249A

  • Information recommendation method and device, server and storage medium

    CN114020997A

  • Novel intelligence sales exhibition terminal

    CN207337530U