Arrival behavior detection method, device and computer equipment based on point of interest information

Abstract

The present application provides a method, device and computer equipment for detecting arrival behavior based on point of interest information, which belongs to the field of computer technology. The method includes: obtaining a multimedia resource uploaded by a user account based on a first point of interest, the multimedia resource carries a first location information, and the first location information is used to indicate the location when the multimedia resource was taken; based on the first location information, determining a plurality of second points of interest; determining a reference point of interest that matches the multimedia resource from the plurality of second points of interest; in response to the first point of interest being different from the reference point of interest, determining the arrival behavior of the user account based on the first point of interest as abnormal. The present application more accurately determines the reference point of interest reached when the multimedia resource was taken based on the location information carried by the multimedia resource, and when the reference point of interest is different from the first point of interest, determines the arrival behavior based on the first point of interest as abnormal, thereby improving the accuracy of arrival behavior detection.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device and computer equipment for detecting arrival behavior based on point of interest information. Background Art

[0002] Currently, information sharing platforms can provide users with local life information sharing and query services. For example, after experiencing the food in a certain store, a user can post a review of the store through the information sharing platform. Before other users go to the store to consume, they can query the store's review information through the information sharing platform, so as to quickly and conveniently understand the store.

[0003] Since the content posted by users after they arrive at the store to experience it is of reference value, the user's store visit behavior can be used as a reference when judging the quality of the posted content. In the related art, users can manually locate a store by performing interactive operations and post review information in the store's review interface. Accordingly, the information sharing platform determines that the user has arrived at the store based on the interactive operations performed by the user, and associates the store with the review information posted in the store's review interface.

[0004] In the above process, the user can manually locate the store by performing interactive operations without arriving at the store to experience it. Accordingly, the information sharing platform determines that the user has arrived at the store, and the accuracy of the store behavior judgment is low. Summary of the invention

[0005] The embodiment of the present application provides a method, device and computer equipment for detecting arrival behavior based on point of interest information, which can improve the accuracy of arrival behavior detection. The technical solution is as follows:

[0006] According to one aspect of an embodiment of the present application, a method for detecting arrival behavior based on point of interest information is provided, the method comprising:

[0007] Acquire a multimedia resource uploaded by a user account based on a first point of interest (POI), where the multimedia resource carries first location information, where the first location information is used to indicate a location when the multimedia resource was photographed;

[0008] Determine, based on the first location information, a plurality of second points of interest, wherein the distance between the second points of interest and the first location information is less than a first distance threshold;

[0009] Determining a reference point of interest matching the multimedia resource from the plurality of second points of interest;

[0010] In response to the first point of interest being different from the reference point of interest, an arrival behavior of the user account based on the first point of interest is determined to be abnormal.

[0011] In an optional implementation manner, determining a reference point of interest matching the multimedia resource from the plurality of second points of interest includes:

[0012] Identify the multimedia resource to obtain a target interest point category corresponding to the multimedia resource, where the target interest point category is a category of the interest point photographed by the multimedia resource;

[0013] comparing the target point of interest category and the point of interest categories respectively corresponding to the plurality of second points of interest;

[0014] A second point of interest whose corresponding point of interest category is consistent with the target point of interest category is determined as the reference point of interest.

[0015] In another optional implementation, determining a reference point of interest matching the multimedia resource from the plurality of second points of interest includes:

[0016] Identify the multimedia resource to obtain a target product category corresponding to the multimedia resource, where the target product category is a category to which a subject in the multimedia resource belongs;

[0017] comparing the target product category and at least one product category corresponding to each of the plurality of second points of interest;

[0018] A second point of interest including the target product category in the corresponding at least one product category is determined as the reference point of interest.

[0019] In another optional implementation, determining a reference point of interest matching the multimedia resource from the plurality of second points of interest includes:

[0020] Determining reference similarities corresponding to the plurality of second points of interest respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the plurality of second points of interest respectively;

[0021] A second interest point whose corresponding reference similarity is greater than a similarity threshold is determined as the reference interest point.

[0022] In another optional implementation, the determining, based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest, reference similarities corresponding to each of the plurality of second points of interest respectively, includes:

[0023] Determining at least one similarity corresponding to each of the plurality of second points of interest based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest;

[0024] The greatest similarity among at least one similarity respectively corresponding to the plurality of second interest points is determined as the reference similarity respectively corresponding to the plurality of second interest points.

[0025] In another optional implementation, determining a reference point of interest matching the multimedia resource from the plurality of second points of interest includes:

[0026] Extracting text information from the multimedia resource;

[0027] comparing the text information and the names respectively corresponding to the plurality of second points of interest;

[0028] A second point of interest whose corresponding name is in the text information is determined as the reference point of interest.

[0029] In another optional implementation, in response to the first point of interest being different from the reference point of interest, after determining that the arrival behavior of the user account based on the first point of interest is abnormal, the method further includes:

[0030] In response to the distance between the first point of interest and the reference point of interest being greater than a second distance threshold, a sorting parameter of the multimedia resource is reduced, the sorting parameter being used to indicate a priority of displaying the multimedia resource in a display interface corresponding to the first point of interest.

[0031] In another optional implementation, in response to the first point of interest being different from the reference point of interest, after determining that the arrival behavior of the user account based on the first point of interest is abnormal, the method further includes:

[0032] In response to the distance between the first point of interest and the reference point of interest being greater than a second distance threshold, positioning calibration information is generated, where the positioning calibration information is used to indicate the accuracy of the verification positioning.

[0033] In another optional implementation, determining a plurality of second points of interest based on the first location information includes:

[0034] Based on the first location information, determining a target area including the first location information;

[0035] The plurality of second interest points whose distances from the first location information are less than the first distance threshold are determined from the plurality of interest points included in the target area.

[0036] According to another aspect of an embodiment of the present application, a device for detecting arrival behavior based on point of interest information is provided, the device comprising:

[0037] A multimedia resource acquisition module, used to acquire multimedia resources uploaded by a user account based on a first point of interest (POI), wherein the multimedia resources carry first location information, and the first location information is used to indicate a location when the multimedia resources are photographed;

[0038] A first interest point determination module, configured to determine a plurality of second interest points based on the first location information, wherein the distance between the second interest points and the first location information is less than a first distance threshold;

[0039] A second interest point determination module, configured to determine a reference interest point matching the multimedia resource from the plurality of second interest points;

[0040] The arrival behavior detection module is used to determine that the arrival behavior of the user account based on the first point of interest is abnormal in response to the first point of interest being different from the reference point of interest.

[0041] In an optional implementation, the second interest point determination module is configured to:

[0042] Identify the multimedia resource to obtain a target interest point category corresponding to the multimedia resource, where the target interest point category is a category of the interest point photographed by the multimedia resource;

[0043] comparing the target point of interest category and the point of interest categories respectively corresponding to the plurality of second points of interest;

[0044] A second point of interest whose corresponding point of interest category is consistent with the target point of interest category is determined as the reference point of interest.

[0045] In another optional implementation, the second interest point determination module is used to:

[0046] Identify the multimedia resource to obtain a target product category corresponding to the multimedia resource, where the target product category is a category to which a subject in the multimedia resource belongs;

[0047] comparing the target product category and at least one product category corresponding to each of the plurality of second points of interest;

[0048] A second point of interest including the target product category in the corresponding at least one product category is determined as the reference point of interest.

[0049] In another optional implementation, the second interest point determination module includes:

[0050] A reference similarity determination unit, configured to determine reference similarities corresponding to the plurality of second interest points respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the plurality of second interest points respectively;

[0051] The reference interest point determination unit is used to determine a second interest point whose corresponding reference similarity is greater than a similarity threshold as the reference interest point.

[0052] In another optional implementation, the reference similarity determination unit is used to:

[0053] Determining at least one similarity corresponding to each of the plurality of second points of interest based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest;

[0054] The greatest similarity among at least one similarity respectively corresponding to the plurality of second interest points is determined as the reference similarity respectively corresponding to the plurality of second interest points.

[0055] In another optional implementation, the second interest point determination module is used to:

[0056] Extracting text information from the multimedia resource;

[0057] comparing the text information and the names respectively corresponding to the plurality of second points of interest;

[0058] A second point of interest whose corresponding name is in the text information is determined as the reference point of interest.

[0059] In another optional implementation, the device further includes:

[0060] A sorting parameter adjustment module is used to reduce the sorting parameter of the multimedia resource in response to the distance between the first point of interest and the reference point of interest being greater than a second distance threshold, wherein the sorting parameter is used to indicate the priority of the multimedia resource in the display interface corresponding to the first point of interest.

[0061] In another optional implementation, the device further includes:

[0062] The positioning calibration module is used to generate positioning calibration information in response to the distance between the first interest point and the reference interest point being greater than a second distance threshold, wherein the positioning calibration information is used to indicate the accuracy of the verification positioning.

[0063] In another optional implementation, the first point of interest determination module is used to:

[0064] Based on the first location information, determining a target area including the first location information;

[0065] The plurality of second interest points whose distances from the first location information are less than the first distance threshold are determined from the plurality of interest points included in the target area.

[0066] According to another aspect of an embodiment of the present application, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the arrival behavior detection method based on point of interest information described in any of the above optional implementation methods.

[0067] According to another aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the arrival behavior detection method based on point of interest information described in any of the above optional implementation methods.

[0068] According to another aspect of an embodiment of the present application, a computer program product or a computer program is provided, which includes a computer program code, and the computer program code is stored in a computer-readable storage medium. A processor of a computer device reads the computer program code from the computer-readable storage medium, and the processor executes the computer program code, so that the computer device executes the arrival behavior detection method based on point of interest information described in any of the above-mentioned optional implementation methods.

[0069] The technical solution provided by the embodiment of the present application determines a reference point of interest based on the location information carried by the multimedia resource for indicating the location when the multimedia resource was taken. The reference point of interest is located near the location where the multimedia resource was taken and matches the multimedia resource. It is the point of interest most likely to be expressed by the multimedia resource. Correspondingly, the multimedia resource is also most likely to be taken by reaching the reference point of interest. If the first point of interest based on which the multimedia resource is uploaded is different from the reference point of interest, it means that the multimedia resource is not taken by reaching the first point of interest, and the arrival behavior of the user account that uploaded the multimedia resource based on the first point of interest is determined to be abnormal. The above technical solution, because the location information carried by the multimedia resource cannot be changed, can indicate the actual location when the multimedia resource is taken. Based on the location information carried by the multimedia resource and the multimedia resource, the reference point of interest that is actually reached when the multimedia resource is taken can be more accurately determined. Then, when the reference point of interest is inconsistent with the first point of interest based on which the user account uploads the multimedia resource, the arrival behavior of the user account based on the first point of interest is determined to be abnormal, thereby improving the accuracy of detecting the arrival behavior based on the point of interest. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0071] Figure 1 It is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0072] Figure 2 is a flow chart of an arrival behavior detection method based on point of interest information provided in an embodiment of the present application;

[0073] Figure 3 is a flow chart of an arrival behavior detection method based on point of interest information provided in an embodiment of the present application;

[0074] Figure 4 is a flow chart of an arrival behavior detection method based on point of interest information provided in an embodiment of the present application;

[0075] Figure 5 is a block diagram of an arrival behavior detection device based on point of interest information provided by an embodiment of the present application;

[0076] Figure 6 is a block diagram of a terminal provided in an embodiment of the present application;

[0077] Figure 7 This is a block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0078] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0079] The terms "first", "second", "third" and "fourth" etc. in the specification, claims and drawings of this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in this application refers to two or more.

[0080] For ease of understanding, the terms involved in the embodiments of the present application are explained below.

[0081] POI (Point Of Interest), also referred to as POI in this application, is a term in geographic information system, which refers to all geographical objects that can be abstracted as points. For example, a store, a tourist attraction, a school, a bank, a gas station, a bus station, a supermarket or a mailbox can be called a POI. In some cases, POI may also be called an information point (Point Of Information). A POI corresponds to POI information, and optionally, the POI information includes location information, name, POI category and product category.

[0082] UGC (User Generated Content) is user-generated content. UGC is a form of content sharing in which users provide their own original content to other users through an Internet platform. The arrival behavior detection method based on point of interest information provided in this application is a technical solution based on UGC.

[0083] Figure 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. Figure 1 , the implementation environment includes a terminal 110 and a server 120 .

[0084] Optionally, the terminal 110 is a smart phone, a tablet computer, a laptop computer or a desktop computer, etc., but is not limited thereto. The terminal 110 is provided with a client, which has the functions of content publishing and content display, supports users to share their original content with other users, and supports users to browse content published by other users. Optionally, the client is a review client, a content sharing client, a social client or a browser, etc.

[0085] Optionally, the server 120 is a server, or a server cluster consisting of several servers, or a cloud computing service center. The server 120 is connected to the terminal 110 via a wireless or wired network. The server 120 provides background services for the content publishing and content display functions of the client.

[0086] In an embodiment of the present application, the computer device may be configured as a server or a terminal. If the computer device is configured as a server, the server is used as the execution subject to implement the arrival behavior detection method based on the point of interest information provided in the embodiment of the present application. If the computer device is configured as a terminal, the terminal is used as the execution subject to implement the arrival behavior detection method based on the point of interest information provided in the embodiment of the present application. Alternatively, the arrival behavior detection method based on the point of interest information provided in the embodiment of the present application is implemented through the interaction between the terminal and the server, and the embodiment of the present application does not limit this.

[0087] Figure 2 is a flow chart of a method for detecting arrival behavior based on point of interest information provided by an embodiment of the present application. Figure 2 This embodiment is briefly described by taking a server as an execution subject as an example. This embodiment includes:

[0088] 201. The server obtains a multimedia resource uploaded by a user account based on a first point of interest, where the multimedia resource carries first location information, and the first location information is used to indicate a location when the multimedia resource was photographed.

[0089] The user uploads a multimedia resource based on the first point of interest, indicating that the multimedia resource is a multimedia resource related to the first point of interest. Since the multimedia resource shot by the user after arriving at the first point of interest has reference value, it is necessary to detect whether the multimedia resource is shot by the user when arriving at the first point of interest, that is, to detect the arrival behavior.

[0090] Optionally, the multimedia resource includes at least one of an image and a video. The multimedia resource is photographed by a user using a terminal with a camera function, and the terminal has the authority to obtain location information when photographing the multimedia resource. Based on the authority to obtain location information, the terminal obtains location information when photographing the multimedia resource, so that the photographed multimedia resource carries the location information. The location information is also used to indicate the location of the terminal when the terminal photographs the multimedia resource. Optionally, the location information includes coordinates formed based on any coordinate system. The embodiment of the present application is described by taking the example that the location information includes geographic coordinates composed of longitude and latitude, and is not limited to this.

[0091] In an optional implementation, the server performs real-time detection of arrival behavior based on the point of interest information. The step of the server obtaining the multimedia resources uploaded by the user account based on the first point of interest includes: the server receives a content publishing request sent by the terminal, the content publishing request carries the user account, the first point of interest and the multimedia resources; the server uses the multimedia resources carried in the content publishing request as the multimedia resources uploaded by the user account based on the first point of interest.

[0092] In another optional implementation, the server periodically detects arrival behavior based on the point of interest information. The step of the server obtaining the multimedia resources uploaded by the user account based on the first point of interest includes: the server responds to the arrival detection period, and obtains the multimedia resources stored in association with the first point of interest and the user account. Among them, the detection period can be configured to any duration, for example, the detection period is 1 hour, 1 day or 3 days, etc., and the embodiment of the present application is not limited to this. It should be noted that before the server obtains the multimedia resources stored in association with the first point of interest and the user account in response to the arrival detection period, it also associates and stores the first point of interest, the user account and the multimedia resources. Among them, the step of the server associating and storing the first point of interest, the user account and the multimedia resources includes: the server receives a content publishing request sent by the terminal, and the content publishing request carries the user account, the first point of interest and the multimedia resources; the server associates and stores the user account, the first point of interest and the multimedia resources carried by the content publishing request.

[0093] 202. The server determines a plurality of second points of interest based on the first location information, wherein a distance between the second points of interest and the first location information is less than a first distance threshold.

[0094] After the server obtains the first location information carried by the multimedia resource, it selects a plurality of second points of interest located near the first location information, that is, selects a plurality of second points of interest whose distance from the first location information is less than a first distance threshold. The first distance threshold can be flexibly configured, for example, the first distance threshold is 800 meters or 1 kilometer.

[0095] 203. The server determines a reference point of interest matching the multimedia resource from the multiple second points of interest.

[0096] The reference point of interest matches the multimedia resource, and the reference point of interest is associated with the content displayed by the multimedia resource, that is, the reference point of interest is most likely to be the subject of the multimedia resource or the subject of the multimedia resource is most likely to be included in the reference point of interest, and the reference point of interest is most likely to be the point of interest truly expressed by the multimedia resource. The multimedia resource is photographed by the user when arriving at the reference point of interest. The server determines the reference point of interest that matches the multimedia resource by identifying the multimedia resource and comparing the point of interest information with the plurality of second points of interest.

[0097] 204. In response to the first point of interest being different from the reference point of interest, the server determines that the arrival behavior of the user account based on the first point of interest is abnormal.

[0098] If the first point of interest based on which the user uploaded the multimedia resource is different from the reference point of interest that the server determines is the real expression of the multimedia resource, it means that the user did not arrive at the first point of interest to photograph the multimedia resource, and the arrival behavior of the user account based on the first point of interest is determined to be abnormal. If the first point of interest is the same as the reference point of interest, it means that the user arrived at the first point of interest to photograph the multimedia resource. Optionally, the server does not process the arrival behavior of the user account based on the first point of interest; or, the server determines the arrival behavior of the user account based on the first point of interest as normal, which is not limited in the embodiments of the present application.

[0099] The technical solution provided by the embodiment of the present application determines a reference point of interest based on the location information carried by the multimedia resource for indicating the location when the multimedia resource was taken. The reference point of interest is located near the location where the multimedia resource was taken and matches the multimedia resource. It is the point of interest most likely to be expressed by the multimedia resource. Correspondingly, the multimedia resource is also most likely to be taken by reaching the reference point of interest. If the first point of interest based on which the multimedia resource is uploaded is different from the reference point of interest, it means that the multimedia resource is not taken by reaching the first point of interest, and the arrival behavior of the user account that uploaded the multimedia resource based on the first point of interest is determined to be abnormal. The above technical solution, because the location information carried by the multimedia resource cannot be changed, can indicate the actual location when the multimedia resource is taken. Based on the location information carried by the multimedia resource and the multimedia resource, the reference point of interest that is actually reached when the multimedia resource is taken can be more accurately determined. Then, when the reference point of interest is inconsistent with the first point of interest based on which the user account uploads the multimedia resource, the arrival behavior of the user account based on the first point of interest is determined to be abnormal, thereby improving the accuracy of detecting the arrival behavior based on the point of interest.

[0100] Figure 3 is a flow chart of a method for detecting arrival behavior based on point of interest information provided by an embodiment of the present application. Figure 3 This embodiment is described by taking the interaction between a terminal and a server as an example. The embodiment includes:

[0101] 301. The terminal obtains a multimedia resource to be published, and sends a content publishing request to a server. The content publishing request carries a user account, a first point of interest, and the multimedia resource. The multimedia resource carries first location information.

[0102] Among them, the terminal is logged in with a user account. In an optional implementation, the user uploads multimedia resources in the content publishing interface of the first point of interest, so that the terminal sends the multimedia resources to the server, and the server provides the multimedia resources to other users. The terminal obtains the multimedia resources to be published, and the steps of sending a content publishing request to the server include: the terminal responds to the display operation of the content publishing interface of the first point of interest, and displays the content publishing interface of the first point of interest; the terminal obtains the multimedia resources added based on the content publishing interface, and the terminal responds to the detection of the publishing operation performed by the user on the content publishing interface, and sends a content publishing request to the server, and the content publishing request carries the first point of interest, the multimedia resource and the user account logged in by the terminal.

[0103] In another optional implementation, the user selects a first point of interest during the process of publishing a multimedia resource, so that the terminal binds the multimedia resource and the first point of interest. The step of the terminal obtaining the multimedia resource to be published and sending a content publishing request to the server includes: the terminal displays the content editing interface in response to a display operation on the content editing interface; the terminal obtains the multimedia resource added based on the content editing interface, obtains the selected first point of interest in response to an interactive operation on the point of interest option in the content editing interface, and sends a content publishing request to the server in response to detecting the publishing operation performed by the user on the content editing interface, the content publishing request carries the first point of interest, the multimedia resource, and the user account logged in by the terminal.

[0104] Another point that needs to be explained is that the terminal supports users to add multimedia resources. Optionally, the terminal supports users to select the multimedia resources to be added from the stored multimedia resources. Optionally, the selected multimedia resources are shot based on the camera function of the terminal; or, the selected multimedia resources are shot based on the camera function of other terminals and then transmitted to the terminal, which is not limited in this application. Optionally, the terminal also supports users to shoot in real time based on the camera function of the terminal to obtain the multimedia resources to be added.

[0105] Another point to be explained is that during the shooting of multimedia resources, the terminal shooting the multimedia resources obtains the location information of the terminal in real time based on the positioning service, so that the shot multimedia resources carry the location information. The location information is used to indicate the location of the terminal, that is, the location when the multimedia resource was shot.

[0106] It should be noted that, optionally, the terminal also supports the user to add text content, and provides the added text content to other users along with the multimedia resources. Accordingly, the terminal also obtains the input text content, and the content publishing request sent by the terminal to the server also carries the text content.

[0107] 302. The server receives a content publishing request from the terminal, and obtains multimedia resources uploaded by the user account based on the first point of interest based on the content publishing request.

[0108] The server receives a content publishing request sent by the terminal, obtains the user account, the first point of interest, and the multimedia resource carried in the content publishing request, and thereby obtains the multimedia resource uploaded by the user account based on the first point of interest.

[0109] One point that needs to be explained is that, in the embodiment of the present application, when the server receives the content publishing request from the terminal, it obtains the multimedia resources carried in the content publishing request, and performs real-time detection of arrival behavior based on the multimedia resources. Optionally, in other embodiments, when the server receives the content publishing request from the terminal, it does not first perform real-time detection of arrival behavior based on the multimedia resources carried in the content publishing request, but instead stores the user account, the first point of interest, and the multimedia resources carried in the content publishing request in an associated manner; then, based on the detection cycle, periodically performs detection of arrival behavior based on the stored multimedia resources. Accordingly, the above step 302 can be replaced by the following steps: the server receives the content publishing request from the terminal, and stores the user account, the first point of interest, and the multimedia resources carried in the content publishing request in an associated manner; in response to the arrival detection cycle, it obtains the multimedia resources stored in association with the first point of interest and the user account, that is, the multimedia resources uploaded by the user account based on the first point of interest.

[0110] 303. The server determines a plurality of second points of interest based on the first location information carried by the multimedia resource, wherein the distance between the second points of interest and the first location information is less than a first distance threshold.

[0111] Each point of interest has corresponding location information, which is used to indicate the location of the point of interest. The server determines the distance between the first location information and each point of interest based on the first location information and the location information corresponding to the multiple points of interest; and determines the point of interest whose distance to the first location information is less than the first distance threshold as the second point of interest.

[0112] In an optional implementation, the server determines a smaller area based on the first location information, and then selects multiple second interest points near the first location information from multiple interest points in the area. Accordingly, the above step 303 includes: the server determines the target area including the first location information based on the first location information; the server determines multiple second interest points whose distance from the first location information is less than the first distance threshold from the multiple interest points included in the target area.

[0113] Optionally, the target area is an area demarcated with the first location information as the center and the target length as the radius, wherein the target length can be flexibly configured to be any length greater than or equal to the first distance threshold, for example, the target length is 2000 meters or 3000 meters, etc. Alternatively, the target area is a more finely divided administrative area. For example, the target area is a third-level administrative area, that is, a county-level administrative area; or, more finely, the target area is a fourth-level administrative area, that is, a township-level administrative area.

[0114] The above technical solution, based on the first position information, first determines a smaller target area containing fewer points of interest, and then through fewer distance calculations, it can determine multiple second points of interest from the multiple points of interest included in the target area. Compared with calculating the distance between a large number of points of interest and the first position information, it reduces the time and computing resources consumed by the distance calculation, improves the efficiency of determining the second points of interest, and improves the utilization of computing resources.

[0115] 304. The server determines a reference point of interest matching the multimedia resource from the plurality of second points of interest.

[0116] In an optional implementation, the server identifies the target interest point category corresponding to the multimedia resource, and by comparing the interest point categories, determines the second interest point whose corresponding interest point category is the same as the target interest point category as the reference interest point matching the multimedia resource. Accordingly, the above step 304 includes the following steps 30401 to 30402.

[0117] 30401. The server identifies the multimedia resource and obtains a target interest point category corresponding to the multimedia resource, wherein the target interest point category is a category of the interest point photographed by the multimedia resource.

[0118] Optionally, the server identifies the multimedia resource through a point of interest category recognition model, and the point of interest category recognition model is used to determine the category of the point of interest photographed by the multimedia resource. The server inputs the multimedia resource into the point of interest category recognition model to obtain the target point of interest category corresponding to the multimedia resource. Optionally, the server uses the multimedia resource marked with the point of interest category as a training sample to train the point of interest category recognition model.

[0119] 30402. The server compares the target point of interest category and the point of interest categories corresponding to the plurality of second points of interest, and determines the second point of interest whose corresponding point of interest category is consistent with the target point of interest category as a reference point of interest.

[0120] Among them, the interest point corresponds to the interest point category. The interest point category is the classification to which the interest point belongs, which is a summary of the interest point attributes in the category dimension.

[0121] In an optional implementation, the POI category is the most detailed classification to which the POI belongs, for example, the POI category of "XX Cinema" is a cinema; the POI category of "XX Noodle House" is a Chinese restaurant; the POI category of "XX Hotel" is a hotel.

[0122] Optionally, the server compares the target point of interest category with the point of interest category corresponding to each second point of interest respectively; and according to the comparison results corresponding to the plurality of second points of interest respectively, determines the second point of interest whose corresponding point of interest category is consistent with the target point of interest category as a reference point of interest.

[0123] Alternatively, the server sequentially compares the target interest point category with the interest point category corresponding to the second interest point in the plurality of second interest points; in response to the interest point category corresponding to the second interest point in this comparison being consistent with the target interest point category, the second interest point in this comparison is determined as the reference interest point, and the interest point category comparison process ends; in response to the interest point category corresponding to the second interest point in this comparison being inconsistent with the target interest point category, the interest point category corresponding to the next second interest point is continuously obtained, and compared with the target interest point category. Optionally, the server sequentially obtains the interest point category corresponding to the second interest point in ascending order of distance from the first location information, and compares with the target interest point category.

[0124] The above technical scheme, by identifying the point of interest category of the point of interest photographed by the multimedia resource, compares it with the point of interest categories corresponding to multiple second points of interest located near the shooting location of the multimedia resource, and determines the second point of interest with the same point of interest category corresponding to the multimedia resource as the reference point of interest matching the multimedia resource, so that the reference point of interest can more accurately represent the actual point of interest reached when the multimedia resource is shot, and then based on the reference point of interest with higher accuracy, the accuracy of detecting arrival behavior based on the point of interest can be further improved.

[0125] In another optional implementation, the interest point categories include categories of different levels, for example, including major categories, medium categories, and minor categories to which the interest points belong. For example, the interest point categories of "XX hot pot" are catering services; Chinese restaurants; hot pot restaurants, where catering services are the major category to which "XX hot pot" belongs, Chinese restaurants are the medium category to which "XX hot pot" belongs, and hot pot restaurants are the minor category to which "XX hot pot" belongs.

[0126] Optionally, the server first selects at least one second interest point that is the same as the major category in the target interest point category from the multiple second interest points based on the major category in the target interest point category and the major category in the interest point category corresponding to the multiple second interest points; then selects at least one second interest point that is the same as the medium category in the target interest point category from the at least one second interest point that is the same as the medium category in the target interest point category based on the medium category in the target interest point category and the medium category in the interest point category corresponding to the at least one selected second interest point; then determines a reference interest point that is the same as the minor category in the target interest point category from the at least one second interest point that is the same as the minor category in the target interest point category based on the minor category in the target interest point category and the minor category in the interest point category corresponding to the at least one second interest point that is the same as the minor category in the target interest point category. If, in the process of determining the reference interest point, the number of the at least one second interest point that is selected is less than or equal to 1, the subsequent selection process is no longer performed.

[0127] The above technical solution performs layer-by-layer screening based on the major, medium and minor categories of the interest point categories in turn to obtain reference interest points whose corresponding interest point categories are consistent with the target interest point categories. Since each screening can reduce the number of interest points on which the next screening is based, the efficiency of determining the reference interest points can be improved.

[0128] In another optional implementation, the server identifies the category to which the subject in the multimedia resource belongs as the target product category corresponding to the multimedia resource, and by comparing the product categories corresponding to the points of interest, determines the second points of interest whose corresponding product categories are the same as the target product category as the reference points of interest that match the multimedia resource. Accordingly, the server determines the reference points of interest that match the multimedia resource from the multiple second points of interest, including the following steps 30411 to 30412.

[0129] 30411. The server identifies the multimedia resource and obtains a target product category corresponding to the multimedia resource. The target product category is the category to which the subject in the multimedia resource belongs.

[0130] Optionally, the server identifies the multimedia resource through a product category recognition model, and the product category recognition model is used to determine the category to which the subject in the multimedia resource belongs. The server inputs the multimedia resource into the product category recognition model to obtain the product category corresponding to the subject in the multimedia resource. Optionally, the server uses the multimedia resource marked with the product category as a training sample to train and obtain the product category recognition model.

[0131] 30412. The server compares the target product category and at least one product category corresponding to each of the plurality of second points of interest, and determines the second point of interest including the target product category in the corresponding at least one product category as a reference point of interest.

[0132] Among them, one point of interest corresponds to at least one product category. The product category is the category of products included in the point of interest. For example, at least one product category of "XX barbecue" includes crayfish, lamb skewers, grilled squid, grilled chicken wings, boiled peanuts, etc. The server compares the target product category and at least one product category corresponding to each second point of interest respectively, and in response to at least one product category corresponding to one of the second points of interest including the target product category, the second point of interest is determined as a reference point of interest.

[0133] The above technical solution, by identifying the product category to which the subject of the shooting in the multimedia resource belongs, compares it with the product categories corresponding to multiple second interest points located near the shooting location of the multimedia resource, and determines the second interest point including the product category corresponding to the multimedia resource as the reference interest point matching the multimedia resource. Through a more detailed comparison in the product category dimension, the reference interest point can more accurately represent the interest point actually reached when shooting the multimedia resource, and then based on the more accurate reference interest point, the accuracy of detecting the arrival behavior based on the interest point can be further improved.

[0134] In another optional implementation, the server determines the reference point of interest that matches the multimedia resource based on the similarity between the multimedia resource and the reference multimedia resource corresponding to the second point of interest. The server determines the reference point of interest that matches the multimedia resource from the plurality of second points of interest including the following steps 30421 to 30422.

[0135] 30421. The server determines reference similarities corresponding to the multiple second points of interest respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the multiple second points of interest respectively.

[0136] There is at least one reference multimedia resource corresponding to the point of interest. Optionally, the reference multimedia resource is an official multimedia resource uploaded by the operator of the point of interest; or, the reference multimedia resource is a multimedia resource included in the content marked with a high-quality label, wherein the content marked with a high-quality label is the content published by the user who arrives at the point of interest for experience and meets the high-quality judgment conditions.

[0137] The server determines at least one similarity corresponding to each of the multiple second points of interest based on the multimedia resources and at least one reference multimedia resource corresponding to each of the multiple second points of interest; and determines the maximum similarity among the at least one similarity corresponding to each of the multiple second points of interest as the reference similarity corresponding to each of the multiple second points of interest.

[0138] A point of interest may have multiple iconic objects, and the subjects in multiple reference multimedia resources are different objects. The subject of the multimedia resource uploaded based on the first point of interest may be one of the objects. In this case, the multimedia resource has a higher similarity to the reference multimedia resource whose subject is the same object, and a lower similarity to other reference multimedia resources. Therefore, the resource with the greatest similarity among at least one reference multimedia resource has a higher reference value for determining the reference point of interest. The greatest similarity is used as the reference similarity to determine the reference point of interest. Compared with using the lower similarity caused by different subjects as the reference similarity to determine the reference point of interest, it can reduce the erroneous judgment of the reference point of interest and further improve the accuracy of determining the reference point of interest.

[0139] Wherein, optionally, the server performs feature extraction on the multimedia resources, and determines the similarity between the multimedia resources based on the obtained feature vector. Accordingly, the step of the server determining at least one similarity corresponding to the multiple second points of interest respectively based on the multimedia resources and at least one reference multimedia resource corresponding to the multiple second points of interest respectively includes: the server performs feature extraction on the multimedia resources to obtain the first feature vector of the multimedia resource; for each of the multiple second points of interest, the server performs feature extraction on at least one reference multimedia resource corresponding to each second point of interest respectively, obtains at least one second feature vector of at least one reference multimedia resource, and determines at least one similarity between the first feature vector and at least one second feature vector, and the at least one similarity is the at least one similarity corresponding to each second point of interest.

[0140] 30422. The server determines the second point of interest whose corresponding reference similarity is greater than the similarity threshold as a reference point of interest.

[0141] Optionally, the similarity threshold can be flexibly configured to any value between 0 and 1. For example, the similarity threshold is 0.8, 0.85 or 0.9, etc., which is not limited in the embodiment of the present application.

[0142] The above technical solution, by determining the similarity between the multimedia resources uploaded based on the first point of interest and the reference multimedia resources, determines the point of interest with a similarity greater than a threshold as the reference point of interest, and focuses more on the similarity between the contents of the multimedia resources to determine the reference point of interest, so that the reference point of interest can more accurately represent the actual point of interest reached when shooting the multimedia resources, and then based on the reference point of interest with higher accuracy, the accuracy of detecting the arrival behavior based on the point of interest can be further improved.

[0143] In another optional implementation, there is text information in the multimedia resources uploaded by the user account, for example, the multimedia resources include a signboard of a point of interest, and the text information included on the signboard is the name of the point of interest. Accordingly, the step of the server determining a reference point of interest matching the multimedia resource from multiple second points of interest includes: the server extracts the text information from the multimedia resource; the server compares the text information and the names corresponding to the multiple second points of interest; the server determines the second point of interest with the corresponding name in the text information as the reference point of interest. Among them, the point of interest corresponds to a name, for example, the name of a certain point of interest is "XX Noodle House".

[0144] In the above technical solution, when there is text information in the multimedia resource, the text information included in the multimedia resource is identified, and if the identified text information includes the name of a certain point of interest, the point of interest is determined as a reference point of interest. Since the name of the point of interest is usually unique, determining the reference point of interest based on the name of the point of interest can make the determined reference point of interest more accurately represent the point of interest actually reached when shooting the multimedia resource, and then based on the more accurate reference point of interest, the accuracy of detecting the arrival behavior based on the point of interest can be further improved.

[0145] One point that needs to be explained is that, optionally, the server determines a reference point of interest that matches the multimedia resource from multiple second points of interest based on any one of the above-mentioned optional implementation methods; or, the server determines a reference point of interest that matches the multimedia resource from multiple second points of interest based on a combination of any one of the above-mentioned optional implementation methods, and this application does not limit this.

[0146] 305. In response to the first point of interest being different from the reference point of interest, the server determines that the arrival behavior of the user account based on the first point of interest is abnormal.

[0147] After the server determines the reference point of interest from the multiple second points of interest through the above step 304, it determines whether the first point of interest is the same as the reference point of interest. Optionally, the server determines whether the first point of interest is the same as the reference point of interest based on one or more aspects of the name, location information, point of interest category, and product category corresponding to the point of interest. For example, the server determines that the first point of interest is the same as the reference point of interest in response to the name of the first point of interest being the same as the name of the reference point of interest, and the location information corresponding to the first point of interest being the same as the location information of the reference point of interest; the server determines that the first point of interest is different from the reference point of interest in response to the name of the first point of interest being different from the name of the reference point of interest, or the location information corresponding to the first point of interest being different from the location information of the reference point of interest.

[0148] If the server determines that the first point of interest is different from the reference point of interest, the arrival behavior of the user account based on the first point of interest is determined to be abnormal; if the server determines that the first point of interest is the same as the reference point of interest, the arrival behavior of the user account based on the first point of interest is not processed, or the arrival behavior of the user account based on the first point of interest is determined to be normal.

[0149] The above technical scheme, since the location information carried by the multimedia resource cannot be changed, can indicate the actual location when the multimedia resource was shot. Based on the location information carried by the multimedia resource and the multimedia resource, it can more accurately determine the reference point of interest that was actually reached when the multimedia resource was shot. Further, when the reference point of interest is inconsistent with the first point of interest based on which the user account uploaded the multimedia resource, the arrival behavior of the user account based on the first point of interest is determined to be abnormal, thereby improving the accuracy of detecting arrival behavior based on points of interest.

[0150] One point that needs to be explained is that, optionally, after the server determines that the arrival behavior of the user account based on the first point of interest is abnormal, the server marks the multimedia resources uploaded by the user account based on the first point of interest as location anomalies to indicate that the multimedia resources do not match the first point of interest, so that the content recommendation service can adjust the recommendation order of the multimedia resources backward based on the location anomaly mark of the multimedia resources, thereby making the multimedia resources that are not marked with the location anomaly mark preferentially displayed in the display interface corresponding to the point of interest, and the multimedia resources marked with the location anomaly are displayed after the multimedia resources that are not marked with the location anomaly or not displayed. Based on the above process, multimedia resources with a high degree of association with the point of interest and with reference significance are preferentially displayed in the display interface corresponding to the point of interest, so that the experience of users who upload multimedia resources that match the point of interest can be expressed, the rights and interests of the point of interest can be protected, and users browsing the display interface can also quickly and effectively understand the point of interest.

[0151] Optionally, after the server determines that the arrival behavior of the user account based on the first point of interest is abnormal, it lowers the sorting parameter of the multimedia resources uploaded by the user account based on the first point of interest. The sorting parameter is used to indicate the priority of the multimedia resources in the display interface corresponding to the first point of interest. When other terminals display the display interface corresponding to the first point of interest, they obtain the sorting parameter corresponding to the first point of interest from the server according to the sorting parameter, and preferentially display multimedia resources with higher sorting parameters to the user, so that the user can preferentially browse the multimedia resources with a higher degree of association with the first point of interest, quickly and effectively understand the first point of interest, thereby improving the efficiency of human-computer interaction.

[0152] Optionally, after the server determines that the arrival behavior of the user account based on the first point of interest is abnormal, it returns a prompt message to the terminal so that the prompt message is displayed. The prompt message is used to prompt that the uploaded multimedia resources do not match the first point of interest, so as to prompt the user to re-upload the multimedia resources that match the first point of interest.

[0153] Optionally, after the server determines that the arrival behavior of the user account based on the first point of interest is abnormal, it does not store the multimedia resources uploaded by the user account based on the first point of interest, so that other terminals will not obtain the multimedia resources from the server when displaying the display interface corresponding to the first point of interest, and will not display the multimedia resources in the display interface corresponding to the first point of interest, thereby improving the degree of association between the multimedia resources displayed in the display interface corresponding to the first point of interest and the first point of interest, making it easier for users to browse multimedia resources with a high degree of association with the first point of interest in the display interface corresponding to the first point of interest, allowing users to quickly and effectively understand the first point of interest and improve human-computer interaction efficiency.

[0154] Another point that needs to be explained is that after the server determines that the first point of interest is different from the reference point of interest, it further determines the distance between the first point of interest and the reference point of interest, and in response to the distance between the first point of interest and the reference point of interest being greater than the second distance threshold, the ranking parameter of the multimedia resource is reduced, and the ranking parameter is used to indicate the priority of the multimedia resource displayed in the display interface corresponding to the first point of interest; in response to the distance between the first point of interest and the reference point of interest being less than or equal to the second distance threshold, the multimedia resource ranking parameter is not processed. The second distance threshold can be configured as any value less than or equal to the first distance threshold, for example, the second distance threshold is 300 meters or 500 meters, etc.

[0155] In the above technical solution, the server reduces the ranking parameter of the multimedia resource only when the distance between the first point of interest and the reference point of interest is greater than the second distance threshold. In the case where the first point of interest is inconsistent with the reference point of interest due to positioning errors, the ranking parameter of the multimedia resource is not reduced. By allowing positioning errors within a certain range, the erroneous operation of reducing the ranking parameter of the multimedia resource is reduced, thereby improving the accuracy of the ranking of the multimedia resources.

[0156] Another point that needs to be explained is that after determining that the first point of interest is different from the reference point of interest, the server also generates positioning calibration information in response to the distance between the first point of interest and the reference point of interest being greater than the second distance threshold, and the positioning calibration information is used to indicate the accuracy of the positioning. Optionally, the server sends the positioning calibration information to the terminal corresponding to the operation and maintenance personnel of the positioning service, so that the positioning personnel of the positioning service can check the accuracy of the positioning service. If the positioning service positioning is inaccurate, the accuracy of the positioning is calibrated. If the distance between the first point of interest and the reference point of interest is greater than the second distance threshold due to inaccurate positioning service, the server will determine the arrival behavior based on the first point of interest as normal.

[0157] To make the process of detecting arrival behavior based on interest points clearer, we combine Figure 4 For illustration, take the point of interest as a store as an example, see Figure 4 , the user uploads a multimedia resource under the point of interest, that is, uploads the multimedia resource in the content publishing interface corresponding to the point of interest; the server determines a list of nearby points of interest according to the location information of the multimedia resource through the above step 303, and the list of points of interest includes multiple second points of interest; the server determines a reference point of interest matching the multimedia resource through the above step 303, that is, by identifying the multimedia resource, it determines which point of interest the multimedia resource is most likely to belong to; the server determines whether the identified point of interest is consistent with the initially bound point of interest, wherein the identified point of interest is the reference point of interest in the above embodiment, and the initially bound point of interest is the first point of interest in the above embodiment; if the identified point of interest is consistent with the initially bound point of interest, the server determines whether the identified point of interest is consistent with the initially bound ..., and the initially bound point of interest is the first point of interest in the above embodiment; if the identified point of interest is consistent with the initially bound point of interest, the server determines whether the identified point of interest is consistent with the initially bound point of interest, and the initially bound point of interest is the first point of interest in the above embodiment; if the identified point of interest is consistent with the initially bound point of interest, the server determines whether the initially bound point of interest is consistent with the initially bound point of interest, the server determines whether the initially bound point of interest is consistent with the initially bound point of interest, the server determines whether the initially bound point of interest is consistent with the initially bound point of interest, the server determines whether the initially bound point of interest is consistent with the initially bound point of interest, the server determines whether the initially bound point of interest is consistent with the initially bound point of If the points of interest identified are inconsistent with the points of interest initially bound, it is determined that the user's store visit behavior is abnormal, that is, the server responds to the fact that the first point of interest is different from the reference point of interest through step 305, and determines that the arrival behavior of the user account based on the first point of interest is abnormal; wherein, the abnormal determination of the store visit behavior has an impact on the content quality determination of the multimedia resources. If the store visit behavior is determined to be abnormal, the content quality of the uploaded multimedia resources is low; after determining that the user's store visit behavior is abnormal, the server also determines whether the distance between the identified point of interest and the initially bound point of interest exceeds 500 meters. If it exceeds 500 meters, the accuracy of the positioning is calibrated; if it does not exceed 500 meters, the process of detecting the arrival behavior based on the points of interest is terminated.

[0158] One point that needs to be explained is that if the multimedia resource uploaded by the user account based on the first point of interest does not carry location information, the server determines whether the first point of interest matches the multimedia resource through the same steps as step 304. For example, the server identifies the multimedia resource and obtains the target point of interest category corresponding to the multimedia resource; if the point of interest category corresponding to the first point of interest is inconsistent with the target point of interest category, the first point of interest does not match the multimedia resource, and the server determines the arrival behavior of the user account based on the first point of interest as abnormal; if the point of interest category corresponding to the first point of interest is consistent with the target point of interest category, the first point of interest matches the multimedia resource, and the server does not process the arrival behavior of the user account based on the first point of interest, or determines the arrival behavior of the user account based on the first point of interest as normal. For another example, the server determines at least one similarity between the multimedia resource and at least one reference multimedia resource corresponding to the first point of interest; if the largest similarity among the at least one similarity determined is less than or equal to the minimum similarity threshold, the arrival behavior of the user account based on the first point of interest is determined to be abnormal; if the largest similarity among the at least one similarity determined is greater than the minimum similarity threshold, the arrival behavior of the user account based on the first point of interest is not processed, or the arrival behavior of the user account based on the first point of interest is determined to be normal. The minimum similarity threshold can be configured as any value between 0 and 1, for example, the minimum similarity threshold is 0.7 or 0.8, etc.

[0159] The above technical solution, even when the multimedia resources uploaded by the user account based on the first point of interest do not carry location information, can determine the degree of matching between the multimedia resources and the first point of interest by identifying the multimedia resources. Therefore, when the degree of matching between the multimedia resources and the first point of interest is low, the user's arrival behavior based on the first point of interest is determined to be abnormal, thereby improving the accuracy of detecting arrival behaviors based on points of interest.

[0160] Another point to be explained is that the above embodiment is described by taking the server detecting the arrival behavior based on the point of interest information as an example. Optionally, the above steps 302 to 305 are performed by the terminal, and the process of the terminal performing steps 302 to 305 is the same as the process of the server performing steps 302 to 305. It should be noted that in step 302, the terminal only needs to locally obtain the multimedia resources uploaded by the user account based on the first point of interest; in step 303, due to the limited storage space of the terminal, a large number of points of interest and corresponding point of interest information cannot be stored. Optionally, the terminal sends a point of interest information acquisition request to the server, and the point of interest information acquisition request carries the first location information to request the point of interest information corresponding to multiple second points of interest returned by the server; in step 304, the terminal determines the reference point of interest matching the multimedia resource from the multiple second points of interest based on the point of interest information corresponding to the multiple second points of interest returned by the server; in step 305, optionally, if the terminal determines that the first point of interest is different from the reference point of interest, the multimedia resource is not sent to the server, and a prompt message is displayed, which is used to prompt that the uploaded multimedia resource does not match the first point of interest, so as to prompt the user to re-upload the multimedia resource that matches the first point of interest.

[0161] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

[0162] Figure 5 is a block diagram of an arrival behavior detection device based on point of interest information provided by an embodiment of the present application. Figure 5 , the device comprises:

[0163] The multimedia resource acquisition module 501 is used to acquire the multimedia resource uploaded by the user account based on the first point of interest POI, where the multimedia resource carries first location information, and the first location information is used to indicate the location when the multimedia resource was shot;

[0164] A first interest point determination module 502, configured to determine a plurality of second interest points based on the first position information, wherein the distance between the second interest points and the first position information is less than a first distance threshold;

[0165] A second interest point determination module 503, configured to determine a reference interest point matching the multimedia resource from a plurality of second interest points;

[0166] The arrival behavior detection module 504 is configured to determine that the arrival behavior of the user account based on the first point of interest is abnormal in response to the first point of interest being different from the reference point of interest.

[0167] The technical solution provided by the embodiment of the present application determines a reference point of interest based on the location information carried by the multimedia resource for indicating the location when the multimedia resource was taken. The reference point of interest is located near the location where the multimedia resource was taken and matches the multimedia resource. It is the point of interest most likely to be expressed by the multimedia resource. Correspondingly, the multimedia resource is also most likely to be taken by reaching the reference point of interest. If the first point of interest based on which the multimedia resource is uploaded is different from the reference point of interest, it means that the multimedia resource is not taken by reaching the first point of interest, and the arrival behavior of the user account that uploaded the multimedia resource based on the first point of interest is determined to be abnormal. The above technical solution, because the location information carried by the multimedia resource cannot be changed, can indicate the actual location when the multimedia resource is taken. Based on the location information carried by the multimedia resource and the multimedia resource, the reference point of interest that is actually reached when the multimedia resource is taken can be more accurately determined. Then, when the reference point of interest is inconsistent with the first point of interest based on which the user account uploads the multimedia resource, the arrival behavior of the user account based on the first point of interest is determined to be abnormal, thereby improving the accuracy of detecting the arrival behavior based on the point of interest.

[0168] In an optional implementation, the second point of interest determination module 503 is configured to:

[0169] Identify the multimedia resource to obtain the target interest point category corresponding to the multimedia resource, where the target interest point category is the category of the interest point photographed by the multimedia resource;

[0170] comparing the target point of interest category and the point of interest categories corresponding to the plurality of second points of interest;

[0171] A second point of interest whose corresponding point of interest category is consistent with the target point of interest category is determined as a reference point of interest.

[0172] In another optional implementation, the second point of interest determination module 503 is configured to:

[0173] Identify the multimedia resource to obtain a target product category corresponding to the multimedia resource, where the target product category is the category to which the subject in the multimedia resource belongs;

[0174] comparing the target product category and at least one product category corresponding to each of the plurality of second points of interest;

[0175] A second point of interest including the target product category in the corresponding at least one product category is determined as a reference point of interest.

[0176] In another optional implementation, the second interest point determination module 503 includes:

[0177] A reference similarity determination unit, configured to determine reference similarities corresponding to the plurality of second interest points respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the plurality of second interest points respectively;

[0178] The reference interest point determination unit is used to determine the second interest point whose corresponding reference similarity is greater than the similarity threshold as the reference interest point.

[0179] In another optional implementation, the reference similarity determination unit is configured to:

[0180] Determining at least one similarity corresponding to each of the plurality of second points of interest based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest;

[0181] The greatest similarity among at least one similarity respectively corresponding to the plurality of second interest points is determined as the reference similarity respectively corresponding to the plurality of second interest points.

[0182] In another optional implementation, the second point of interest determination module 503 is configured to:

[0183] Extract text information from multimedia resources;

[0184] comparing the text information and the names corresponding to the plurality of second points of interest;

[0185] A second point of interest whose name is in the text information is determined as a reference point of interest.

[0186] In another optional implementation, the device further includes:

[0187] The sorting parameter adjustment module is used to reduce the sorting parameter of the multimedia resource in response to the distance between the first interest point and the reference interest point being greater than the second distance threshold, and the sorting parameter is used to indicate the priority of the multimedia resource displayed in the display interface corresponding to the first interest point.

[0188] In another optional implementation, the device further includes:

[0189] The positioning calibration module is used to generate positioning calibration information in response to the distance between the first interest point and the reference interest point being greater than a second distance threshold, wherein the positioning calibration information is used to indicate the accuracy of the verification positioning.

[0190] In another optional implementation, the first point of interest determination module 502 is configured to:

[0191] Based on the first location information, determining a target area including the first location information;

[0192] A plurality of second interest points, the distances between which the second interest points and the first position information are less than a first distance threshold, are determined from the plurality of interest points included in the target area.

[0193] It should be noted that: the arrival behavior detection device based on point of interest information provided in the above embodiment only uses the division of the above functional modules as an example when detecting arrival behavior. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device is divided into different functional modules to complete all or part of the functions described above. In addition, the arrival behavior detection device based on point of interest information provided in the above embodiment and the arrival behavior detection method embodiment based on point of interest information belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0194] If the computer device is configured as a terminal, Figure 6 The structure block diagram of a terminal 600 provided by an exemplary embodiment of the present application is shown. The terminal 600 may be: a smart phone, a tablet computer, a notebook computer or a desktop computer. The terminal 600 may also be called a user equipment, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0195] Typically, the terminal 600 includes a processor 601 and a memory 602 .

[0196] The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0197] The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 602 is used to store at least one program code, which is used to be executed by the processor 601 to implement the arrival behavior detection method based on the point of interest information provided in the method embodiment of the present application.

[0198] In some embodiments, the terminal 600 may further optionally include: a peripheral device interface 603 and at least one peripheral device. The processor 601, the memory 602 and the peripheral device interface 603 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 603 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 604, a display screen 605, a camera assembly 606, an audio circuit 607, a positioning assembly 608 and a power supply 609.

[0199] The peripheral device interface 603 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 601 and the memory 602. In some embodiments, the processor 601, the memory 602, and the peripheral device interface 603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 601, the memory 602, and the peripheral device interface 603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0200] The radio frequency circuit 604 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 604 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 604 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 604 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 604 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0201] The display screen 605 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos and any combination thereof. When the display screen 605 is a touch display screen, the display screen 605 also has the ability to collect touch signals on the surface or above the surface of the display screen 605. The touch signal can be input to the processor 601 as a control signal for processing. At this time, the display screen 605 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 605 can be one, set on the front panel of the terminal 600; in other embodiments, the display screen 605 can be at least two, respectively set on different surfaces of the terminal 600 or in a folding design; in other embodiments, the display screen 605 can be a flexible display screen, set on the curved surface or folding surface of the terminal 600. Even, the display screen 605 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 605 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0202] The camera assembly 606 is used to capture images or videos. Optionally, the camera assembly 606 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 606 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0203] The audio circuit 607 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 601 for processing, or input them into the radio frequency circuit 604 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 600. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 601 or the radio frequency circuit 604 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 607 may also include a headphone jack.

[0204] The positioning component 608 is used to locate the current geographical location of the terminal 600 to implement navigation or LBS (Location Based Service). The positioning component 608 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system or Russia's Galileo system.

[0205] The power supply 609 is used to power various components in the terminal 600. The power supply 609 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 609 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0206] In some embodiments, the terminal 600 further includes one or more sensors 610 , including but not limited to: an acceleration sensor 611 , a gyroscope sensor 612 , a pressure sensor 613 , a fingerprint sensor 614 , an optical sensor 615 , and a proximity sensor 616 .

[0207] Those skilled in the art will understand that Figure 6 The structure shown in the figure does not constitute a limitation on the terminal 600, and the terminal 600 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0208] If the computer device is configured as a server, Figure 7It is a block diagram of a server provided in an embodiment of the present application. The server 700 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 701 and one or more memories 702, wherein at least one program code is stored in the memory 702, and at least one program code is loaded and executed by the processor 701 to implement the arrival behavior detection method based on the point of interest information provided in the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output. The server may also include other components for implementing device functions, which will not be described in detail here.

[0209] In an exemplary embodiment, a computer-readable storage medium is also provided, in which at least one program code is stored, and the at least one program code can be executed by a processor in a server to complete the arrival behavior detection method based on the point of interest information in the above embodiment. For example, the computer-readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0210] The present application also provides a computer program product or a computer program, which includes a computer program code, which is stored in a computer-readable storage medium. A processor of a computer device reads the computer program code from the computer-readable storage medium, and the processor executes the computer program code, so that the computer device executes the arrival behavior detection method based on point of interest information in the above-mentioned various method embodiments.

[0211] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0212] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for detecting arrival behavior based on point of interest information, characterized in that: The method comprises: Acquire a multimedia resource uploaded by a user account based on a first point of interest (POI), wherein the multimedia resource carries first location information, and the first location information is used to indicate a location when the multimedia resource is photographed; Determine, based on the first location information, a plurality of second points of interest, wherein the distance between the second points of interest and the first location information is less than a first distance threshold; Determining a reference point of interest matching the multimedia resource from the plurality of second points of interest; In response to the first point of interest being different from the reference point of interest, determining the arrival behavior of the user account based on the first point of interest as abnormal; The determining a reference point of interest matching the multimedia resource from the plurality of second points of interest comprises: Determining reference similarities corresponding to the plurality of second points of interest respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the plurality of second points of interest respectively; Determine a second interest point whose corresponding reference similarity is greater than a similarity threshold as the reference interest point; The determining, based on the multimedia resource and at least one reference multimedia resource respectively corresponding to the plurality of second interest points, reference similarities respectively corresponding to the plurality of second interest points comprises: Determining at least one similarity corresponding to each of the plurality of second points of interest based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest; The greatest similarity among at least one similarity respectively corresponding to the plurality of second interest points is determined as the reference similarity respectively corresponding to the plurality of second interest points.

2. The method according to claim 1, characterized in that: After determining that the arrival behavior of the user account based on the first point of interest is abnormal in response to the first point of interest being different from the reference point of interest, the method further includes: In response to the distance between the first point of interest and the reference point of interest being greater than a second distance threshold, a sorting parameter of the multimedia resource is reduced, the sorting parameter being used to indicate a priority of displaying the multimedia resource in a display interface corresponding to the first point of interest.

3. The method according to claim 1, characterized in that: After determining that the arrival behavior of the user account based on the first point of interest is abnormal in response to the first point of interest being different from the reference point of interest, the method further includes: In response to the distance between the first point of interest and the reference point of interest being greater than a second distance threshold, positioning calibration information is generated, where the positioning calibration information is used to indicate the accuracy of the verification positioning.

4. The method according to claim 1, characterized in that: The determining a plurality of second points of interest based on the first position information includes: Based on the first location information, determining a target area including the first location information; The plurality of second interest points whose distances from the first location information are less than the first distance threshold are determined from the plurality of interest points included in the target area.

5. An arrival behavior detection device based on point of interest information, characterized in that: The device comprises: A multimedia resource acquisition module, used to acquire multimedia resources uploaded by a user account based on a first point of interest (POI), wherein the multimedia resources carry first location information, and the first location information is used to indicate a location when the multimedia resources are photographed; A first interest point determination module, configured to determine a plurality of second interest points based on the first location information, wherein the distance between the second interest points and the first location information is less than a first distance threshold; A second interest point determination module, configured to determine a reference interest point matching the multimedia resource from the plurality of second interest points; an arrival behavior detection module, configured to determine, in response to the first point of interest being different from the reference point of interest, that the arrival behavior of the user account based on the first point of interest is abnormal; The step of determining a reference point of interest matching the multimedia resource from the plurality of second points of interest includes: Determining reference similarities corresponding to the plurality of second points of interest respectively based on the multimedia resource and at least one reference multimedia resource corresponding to the plurality of second points of interest respectively; Determine a second interest point whose corresponding reference similarity is greater than a similarity threshold as the reference interest point; The determining, based on the multimedia resource and at least one reference multimedia resource respectively corresponding to the plurality of second interest points, reference similarities respectively corresponding to the plurality of second interest points comprises: Determining at least one similarity corresponding to each of the plurality of second points of interest based on the multimedia resource and at least one reference multimedia resource corresponding to each of the plurality of second points of interest; The greatest similarity among at least one similarity respectively corresponding to the plurality of second interest points is determined as the reference similarity respectively corresponding to the plurality of second interest points.

6. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the arrival behavior detection method based on point of interest information as described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the arrival behavior detection method based on point of interest information as described in any one of claims 1-4.

Images