Information pushing method and device, and vehicle
By collecting images and pressure change data before and after vehicle startup, and performing image difference matching and pressure analysis, the problem of low accuracy in detecting items left behind by users in vehicles has been solved, and accurate item tracking has been achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHINA FAW CO LTD
- Filing Date
- 2023-07-25
- Publication Date
- 2026-07-03
AI Technical Summary
After a vehicle is used, existing technologies struggle to accurately determine whether a user has left any items behind, especially in cases involving multiple users or multiple items, where there is a problem of mismatched associations.
By acquiring images and pressure change curves before and after vehicle startup, image difference matching and pressure analysis are performed to establish the association between users and items, and a notification message is pushed when the vehicle stops to confirm the ownership of the items.
It improves the accuracy of determining whether a user has left an item behind, ensures that users can discover such items in a timely manner, reduces false matching, and achieves accurate confirmation of item ownership.
Smart Images

Figure CN116828042B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of information processing, and more specifically, to an information push method, apparatus, and vehicle. Background Technology
[0002] After using a vehicle, users may leave items behind. Currently, image detection is commonly used to determine whether a user has left any items behind and to notify the user via SMS when items are detected. However, when there are multiple users or items in the vehicle, mismatches may occur between the users and items, resulting in low accuracy in determining whether a user has left any items behind after leaving the vehicle.
[0003] There is currently no effective solution to the above problems. Summary of the Invention
[0004] This invention provides an information push method, device, and vehicle to at least solve the technical problem of low accuracy in determining whether a user has left items on the vehicle after detecting that the user has left the vehicle.
[0005] According to one aspect of the present invention, an information push method is provided, the method comprising: in response to detecting vehicle startup, acquiring at least one first image, at least one second image, and a pressure change curve collected within a preset time period, wherein the first image is used to represent an image collected before vehicle startup, the second image is used to represent an image collected after vehicle startup, and the pressure change curve is used to represent pressure changes at different locations on the vehicle; performing image difference matching on the first image and the second image to obtain a difference matching result; determining a target association relationship between a user and an item in the second image based on the difference matching result and the pressure change curve, wherein the target association relationship includes at least whether the item belongs to the user; in response to detecting vehicle stop, pushing a prompt message to the user based on the user's user state and the target item's item state, wherein the target item belongs to the user.
[0006] Optionally, based on the difference matching results and the pressure change curve, the target association between the user and the item in the second image is determined, including: determining the target location of the pressure change on the vehicle and the target time period of the pressure change based on the pressure change curve; determining the first item based on the target location, the target time period, and the difference matching results, wherein the first item is used to represent the item placed on the vehicle by the user; performing image recognition on the first image and the second image to establish an initial association between the user and the first item; updating the initial association based on the feedback information sent by the user to obtain the target association, wherein the feedback information is used to represent the information of the user correcting the initial association.
[0007] Optionally, image recognition is performed on the first image and the second image to establish an initial association between the user and the first item, including: performing image recognition on the first image and the second image to obtain the contact state between the user and the first item; in response to the contact state being that the user and the first item are in contact, obtaining the first contact frequency and the first contact duration between the user and the first item; selecting a target user from the users according to a preset selection method, and obtaining the second contact frequency and the second contact duration of the target user; and determining the initial association based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration.
[0008] Optionally, determining the initial association relationship based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration includes: comparing the first contact frequency and the second contact frequency to obtain a first comparison result; comparing the first contact duration and the second contact duration to obtain a second comparison result; in response to the first comparison result and the second comparison result meeting preset comparison requirements, determining the initial association relationship as the first item belonging to the target user; in response to the first comparison result and the second comparison result not meeting the preset comparison conditions, reselecting the target user from the users and re-determining the initial association relationship.
[0009] Optionally, the method further includes: obtaining the device status of a first display device corresponding to the user's location; in response to the device status being normal, displaying an initial association relationship and a first item on the first display device; receiving feedback from the user regarding adjustments to the initial association relationship and the first item; and updating the initial association relationship based on the feedback information to obtain a target association relationship.
[0010] Optionally, the first image includes at least: a first initial image and a second initial image, wherein the first initial image is used to characterize an image acquired before the user is detected entering the vehicle, and the second initial image is used to characterize an image acquired after the user is detected entering the vehicle. Image difference matching is performed on the first image and the second image to obtain a difference matching result, including: matching the first initial image and the second image to obtain a first matching result; matching the second initial image and the second image to obtain a second matching result; and determining a difference matching result based on the first matching result and the second matching result.
[0011] Optionally, based on the user's user status and the target item's item status, a notification message is pushed to the user, including: in response to the user's status indicating that the user's ride has ended and the item status indicating that the target item is in the vehicle, a notification message is pushed to the user, wherein the notification message is at least used to inform the user that the target item is in the vehicle; in response to the user's status not indicating that the user's ride has ended or the item status not indicating that the target item is in the vehicle, the push notification message to the user is stopped.
[0012] Optionally, the method further includes: obtaining a user profile; in response to the user profile indicating that the user owns a vehicle, pushing a notification message to the user through a first preset method; in response to the user profile indicating that the user does not own a vehicle, pushing a notification message to the user through a second preset method, wherein the information push efficiency of the second preset method is different from that of the first preset method.
[0013] According to one aspect of the present invention, an information push device is also provided, the device comprising: a first acquisition module, configured to acquire at least one first image, at least one second image, and a pressure change curve collected within a preset time period in response to detecting vehicle startup, wherein the first image is used to represent an image collected before vehicle startup, the second image is used to represent an image collected after vehicle startup, and the pressure change curve is used to represent pressure changes at different locations on the vehicle; an image matching module, configured to perform image difference matching on the first image and the second image to obtain a difference matching result; a relationship determination module, configured to determine a target association relationship between a user and an item in the second image based on the difference matching result and the pressure change curve, wherein the target association relationship includes at least whether the item belongs to the user; and an information push module, configured to push a prompt message to the user based on the user's user status and the item status of the target item in response to detecting vehicle stop, wherein the target item belongs to the user.
[0014] Optionally, the relationship determination module includes: a first determination unit, used to determine the target location of the pressure change on the vehicle and the target time period of the pressure change based on the pressure change curve; a second determination unit, used to determine a first item based on the target location, the target time period, and the difference matching result, wherein the first item is used to represent an item placed on the vehicle by the user; a relationship establishment unit, used to perform image recognition on the first image and the second image to establish an initial association relationship between the user and the first item; and a relationship update unit, used to update the initial association relationship based on feedback information sent by the user to obtain a target association relationship, wherein the feedback information is used to represent information from the user that corrects the initial association relationship.
[0015] Optionally, the relationship establishment unit is further configured to: perform image recognition on the first image and the second image to obtain the contact state between the user and the first item; in response to the contact state being that the user and the first item are in contact, obtain the first contact frequency and the first contact duration between the user and the first item; select a target user from the users according to a preset selection method, and obtain the second contact frequency and the second contact duration of the target user; and determine an initial association relationship based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration.
[0016] Optionally, the relationship establishment unit is further configured to: compare the first contact frequency and the second contact frequency to obtain a first comparison result; compare the first contact duration and the second contact duration to obtain a second comparison result; in response to the first comparison result and the second comparison result meeting the preset comparison requirements, determine the initial association relationship as the first item belonging to the target user; in response to the first comparison result and the second comparison result not meeting the preset comparison conditions, reselect the target user from the users and redetermine the initial association relationship.
[0017] Optionally, the device further includes: a second acquisition module, configured to acquire the device status of the first display device corresponding to the user's location; a first display module, configured to display the initial association relationship and the first item on the first display device in response to the device status being normal; an information receiving module, configured to receive feedback information from the user regarding adjustments to the initial association relationship and the first item; and a relationship update module, configured to update the initial association relationship based on the feedback information to obtain the target association relationship.
[0018] Optionally, the first image includes at least: a first initial image and a second initial image, wherein the first initial image is used to characterize an image acquired before the user is detected entering the vehicle, and the second initial image is used to characterize an image acquired after the user is detected entering the vehicle. The image matching module includes: a first matching unit for matching the first initial image and the second image to obtain a first matching result; a second matching unit for matching the second initial image and the second image to obtain a second matching result; and a result determination unit for determining a difference matching result based on the first matching result and the second matching result.
[0019] Optionally, the information push module includes: a first push unit, used to push a prompt message to the user in response to the user's status being "user's ride ended" and the item status being "target item is in the vehicle", wherein the prompt message is at least used to inform the user that the target item is in the vehicle; and a second push unit, used to stop pushing the prompt message to the user in response to the user's status not being "user's ride ended" or the item status not being "target item is in the vehicle".
[0020] Optionally, the device further includes: a third acquisition module for acquiring a user profile; a first push module for pushing a notification message to the user in response to the user profile indicating that the user owns a vehicle, using a first preset method; and a second push module for pushing a notification message to the user in response to the user profile indicating that the user does not own a vehicle, using a second preset method, wherein the information push efficiency of the second preset method is different from that of the first preset method.
[0021] According to another aspect of the present invention, a computer-readable storage medium is also provided, characterized in that the computer-readable storage medium includes a stored program, wherein, when the program is running, it controls the device where the computer-readable storage medium is located to execute the information push method described above.
[0022] According to another aspect of the present invention, a processor is also provided, characterized in that the processor is used to run a program, wherein the program executes the information push method described above during runtime.
[0023] According to another aspect of the present invention, a vehicle is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any of the above-described information push methods.
[0024] In this embodiment of the invention, at least one first image, at least one second image, and a pressure change curve are acquired within a preset time period. Image difference matching is performed on the first and second images to obtain a difference matching result. Based on the difference matching result and the pressure change curve, the target association between the user and the item in the second image is determined. In response to the detection of vehicle stopping, a prompt message is pushed to the user based on the user's status and the status of the target item. By acquiring the first and second images within a preset time period and determining the target association between the user and the item based on the difference matching result of the first and second images, combined with the pressure change curve at different locations on the vehicle, the accuracy of the determined target association is greatly improved. Finally, the prompt message is pushed to the user based on the user's status and the corresponding status of the target item, enabling the user to promptly discover whether an item has been left behind. This achieves the technical effect of accurately determining whether a user has left an item on the vehicle, thus solving the technical problem of low accuracy in determining whether a user has left an item on the vehicle after detecting that the user has left the vehicle in related technologies. Attached Figure Description
[0025] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:
[0026] Figure 1 This is a flowchart illustrating an information push method according to an embodiment of the present invention;
[0027] Figure 2 This is a schematic diagram illustrating an information push process according to an embodiment of the present invention;
[0028] Figure 3 This is a structural block diagram of an information push device according to an embodiment of this application. Detailed Implementation
[0029] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.
[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0031] Example 1
[0032] According to an embodiment of the present invention, an embodiment of an information push method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.
[0033] Figure 1 This is a flowchart illustrating an information push method according to an embodiment of the present invention, such as... Figure 1 As shown, the method includes the following steps:
[0034] Step S102: In response to detecting vehicle startup, acquire at least one first image, at least one second image, and pressure change curve collected within a preset time period.
[0035] The first image represents the image collected before the vehicle starts, the second image represents the image collected after the vehicle starts, and the pressure change curve represents the pressure change at different locations on the vehicle.
[0036] The aforementioned preset time period can refer to the period from the moment the user's intention to use the vehicle is detected to a point some time after the vehicle has started. For example, when a user walks towards and touches the vehicle, it can be determined that the user currently has a vehicle-using intention. The information push system can record this first moment. When the vehicle starts, the information push system can record a second moment some time after starting, such as 10 seconds after starting. The time period corresponding to the first and second moments is then determined as the aforementioned preset time period. It should be noted that the above method of detecting the user's vehicle-using intention is only an example and is not specifically limited.
[0037] In one optional embodiment, in order to accurately detect whether a user leaves items on the vehicle when leaving it, the information push system can establish a correlation between the user intending to use the vehicle and the items the user is carrying. To accurately establish this correlation, after determining that the vehicle has started, the information push system can first acquire images containing the user intending to use the vehicle and the items around the user, namely at least one first image and at least one second image. Considering that the images may also include items that are not carried by the user, or items that the user carries on their person but does not place in the vehicle, such as the user carrying a mobile phone at all times without placing it inside the vehicle, the system can further acquire pressure change curves that reflect pressure changes at different locations on the vehicle while acquiring the images. These different locations on the vehicle may include, but are not limited to, the trunk, seats, and chassis.
[0038] Considering that users intend to use the vehicle before it is started, and that the items carried by users may change, while the users and items in the vehicle will not change much after the vehicle is started, the first image mentioned above can refer to the vehicle interior and exterior images collected before the vehicle is started, and the second image mentioned above can refer to the vehicle interior image collected after the vehicle is started.
[0039] Step S104: Perform image difference matching on the first image and the second image to obtain the difference matching result.
[0040] In one optional embodiment, in order to accurately determine the items related to the user in the image and the items placed by the user on the vehicle, after obtaining the first image and the second image, the information push system can perform image difference matching processing on the first image and the second image to obtain the difference matching result.
[0041] The above difference matching results can reflect the changes in users and items in the vehicle before and after the vehicle is started. For example, if user A did not use the vehicle before the vehicle was started and there were no items on the vehicle seat, but after the vehicle was started, user A sat on the seat and placed item A on the seat, then the above difference matching results can reflect that user A used the vehicle and item A was placed on the vehicle. Item A is not an original item on the vehicle, but belongs to user A or another user. At this time, the information push system can mark item A to determine that item A is an item that the user needs to take away after using the vehicle.
[0042] Step S106: Based on the difference matching results and the pressure change curve, determine the target association between the user and the item in the second image.
[0043] Among these, the target association relationship includes at least whether the item belongs to the user.
[0044] In one optional embodiment, after obtaining the difference matching result, the information push system can further combine the pressure change curves at different locations on the vehicle to establish a target association relationship between items on the vehicle and the user, that is, to determine whether the items on the vehicle belong to the user.
[0045] For example, the information difference system can first mark users and items on the vehicle based on the difference matching results, obtaining a first user mark and a first item mark. Then, based on the position of the first item mark on the vehicle, it can determine the corresponding pressure change curve and identify the third moment of pressure change from the pressure change curve. Next, the information push system can determine the user who had contact with the item corresponding to the first item mark within a certain period before and after the third moment based on the first or second image corresponding to that third moment. Finally, a target association relationship can be established between the item and the user. It should be noted that the above process of establishing a target association relationship is merely an illustrative example for ease of understanding and is not intended to be specific.
[0046] In step S108, in response to detecting that the vehicle has stopped, a prompt message is pushed to the user based on the user's user status and the target item's item status.
[0047] The target item belongs to the user.
[0048] The aforementioned user status can refer to whether the user has finished using the vehicle, the aforementioned item status can refer to whether the target item is in the vehicle, and the aforementioned push notification information can refer to information used to remind the user of the status of the items they are carrying, thereby preventing the user from leaving items in the vehicle.
[0049] In one optional embodiment, after the vehicle stops, the information push system can further obtain the user's status. When the user's status indicates that the user has finished using the vehicle (e.g., the user has left the vehicle for more than a preset time, or the user has sent a command to the information push system to end the vehicle use via a preset method), the information push system can determine the status of the target item belonging to the user based on the aforementioned target association relationship, and push corresponding prompt information to the user based on the item status. For example, if the item status indicates that the target item is still in the vehicle, the system can push information that the target item was left in the vehicle and display the target item to the user, such as displaying an image of the target item; if the item status indicates that the target item was taken away by the user, the system can push information that the target item was not left in the vehicle. When the user's status indicates that the user has not finished using the vehicle (e.g., the user is sitting in the seat, or the user has left the vehicle but the distance between the user and the vehicle is less than a preset distance), the information push system may not push prompt information to the user.
[0050] In this embodiment of the invention, at least one first image, at least one second image, and a pressure change curve are acquired within a preset time period. Image difference matching is performed on the first and second images to obtain a difference matching result. Based on the difference matching result and the pressure change curve, the target association between the user and the item in the second image is determined. In response to the detection of vehicle stopping, a prompt message is pushed to the user based on the user's status and the status of the target item. By acquiring the first and second images within a preset time period and determining the target association between the user and the item based on the difference matching result of the first and second images, combined with the pressure change curve at different locations on the vehicle, the accuracy of the determined target association is greatly improved. Finally, the prompt message is pushed to the user based on the user's status and the corresponding status of the target item, enabling the user to promptly discover whether an item has been left behind. This achieves the technical effect of accurately determining whether a user has left an item on the vehicle, thus solving the technical problem of low accuracy in determining whether a user has left an item on the vehicle after detecting that the user has left the vehicle in related technologies.
[0051] Optionally, based on the difference matching results and the pressure change curve, the target association between the user and the item in the second image is determined, including: determining the target location of the pressure change on the vehicle and the target time period of the pressure change based on the pressure change curve; determining the first item based on the target location, the target time period, and the difference matching results, wherein the first item is used to represent the item placed on the vehicle by the user; performing image recognition on the first image and the second image to establish an initial association between the user and the first item; updating the initial association based on the feedback information sent by the user to obtain the target association, wherein the feedback information is used to represent the information of the user correcting the initial association.
[0052] The aforementioned target location can refer to the location on the vehicle where a pressure change occurs. This could be a pressure change caused by an item placed by the user, or a pressure change caused by the operation of in-vehicle equipment, such as the movement of an in-vehicle screen.
[0053] In one optional embodiment, when determining the target association between a user and an item, the system can first determine the target location and target time period of the pressure change on the vehicle based on the obtained pressure change curve. Then, based on the target location and target time period, combined with the aforementioned difference matching results, the system can determine the first item placed on the vehicle by the user. For example, the information push system can first determine newly appearing items on the vehicle based on the difference matching results, such as a bag placed on the vehicle seat or a mobile phone carried by the user that is not placed on the vehicle. Then, based on the aforementioned target location and target time period, the system can filter out the first item from the newly appearing items on the vehicle, for example, filtering out the bag from the bag and the mobile phone.
[0054] After identifying the first item, the information push system can further perform image recognition on the first and second images to determine the relationship between the user and the first item contained in the images, i.e., establishing the initial association between the user and the first item. Finally, the information push system can display the determined initial association to the user, who can then confirm its accuracy. If the user modifies the initial association, the information push system can receive feedback from the user, such as information indicating a modification to the initial association, and adjust the initial association accordingly to obtain the target association, thereby ensuring the accuracy of the determined target association.
[0055] Optionally, image recognition is performed on the first image and the second image to establish an initial association between the user and the first item, including: performing image recognition on the first image and the second image to obtain the contact state between the user and the first item; in response to the contact state being that the user and the first item are in contact, obtaining the first contact frequency and the first contact duration between the user and the first item; selecting a target user from the users according to a preset selection method, and obtaining the second contact frequency and the second contact duration of the target user; and determining the initial association based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration.
[0056] The aforementioned contact state can refer to whether the user has direct or indirect contact with the first item. For example, if the user carries the bag on their body, it can be considered that the user and the bag have direct contact. If the user pulls a small cart with multiple boxes on it by a rope, it can be considered that the user and the boxes have indirect contact.
[0057] In one optional embodiment, when establishing the initial association, to ensure the comprehensiveness of the initial association, image recognition can be performed on the first and second images to determine the contact state between the user and the first item. Considering that the user in contact with the first item may not be the owner of the first item (e.g., a driver can temporarily help a passenger place their luggage, but the luggage does not belong to the driver), to improve the accuracy of the established initial association between the first item and the user, when the contact state is that the user and the first item are in contact, the information push system can further determine the first contact frequency and first contact duration of the first item and the user based on the recognition results. If there is only one user in contact with the first item, the initial association between the first item and that user can be determined as the first item belonging to that user. If there is more than one user in contact with the first item, the information push system can further select a target user from the users according to a preset selection method and obtain the second contact frequency and second contact duration of the target user. Finally, the information push system can determine the initial association between the first item and the target user based on the first contact frequency, second contact frequency, first contact duration, and second contact duration obtained above.
[0058] The preset selection methods mentioned above may include, but are not limited to: random selection, selection based on user height, selection based on the frequency and duration of the user's first contact with the first item, and polling selection. The specific selection method can be chosen according to the actual situation and is not limited here.
[0059] Optionally, determining the initial association relationship based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration includes: comparing the first contact frequency and the second contact frequency to obtain a first comparison result; comparing the first contact duration and the second contact duration to obtain a second comparison result; in response to the first comparison result and the second comparison result meeting preset comparison requirements, determining the initial association relationship as the first item belonging to the target user; in response to the first comparison result and the second comparison result not meeting the preset comparison conditions, reselecting the target user from the users and re-determining the initial association relationship.
[0060] In one optional embodiment, when determining the initial association between the user and the first item based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration, the first contact frequency and the second contact frequency can be compared first to obtain a first comparison result, for example, the quotient of the second contact frequency and the first frequency can be used as the first quotient value. At the same time, the first contact duration and the second contact duration can be compared to obtain a second comparison result, for example, the quotient of the second contact duration and the first contact duration can be used as the second quotient value. After obtaining the first comparison result and the second comparison result, the information push system can determine whether the first comparison result and the second comparison result meet the preset comparison requirements, such as whether the first quotient is greater than the first preset threshold and whether the second quotient is greater than the second preset threshold. If they are greater, the initial association between the target user and the first item can be directly determined as the first item belonging to the target user, thereby improving the efficiency of determining the initial association. If they are not greater, the association between the target user and the first item can be determined as the first item not belonging to the target user, and the information push system can reselect a new target user from the users according to the preset selection method, and re-determine the initial association between the new target user and the first item according to the above process.
[0061] In one optional embodiment, if neither the first comparison result nor the second comparison result corresponding to each user meets the preset comparison requirements, the information push system can further determine the maximum first comparison result or the maximum second comparison result from the first comparison result and the second comparison result corresponding to each user. For example, the maximum first quotient can be determined from the first quotient corresponding to each user, and the maximum second quotient can be determined from the second quotient corresponding to each user. Then, the target user corresponding to the maximum value of the maximum first quotient or the maximum second quotient can be determined as the user who owns the first item.
[0062] Optionally, the method further includes: obtaining the device status of a first display device corresponding to the user's location; in response to the device status being normal, displaying an initial association relationship and a first item on the first display device; receiving feedback from the user regarding adjustments to the initial association relationship and the first item; and updating the initial association relationship based on the feedback information to obtain a target association relationship.
[0063] The aforementioned first display device may refer to a device on the vehicle used to display the aforementioned initial association relationship to the user.
[0064] In one optional embodiment, after determining the initial association, the information push system can also obtain the device status of the first display device on the vehicle. If the device status is normal, the initial association can be displayed on the first display device, awaiting user adjustment. After receiving feedback from the user regarding adjustments to the initial association and the first item, the information push system can further update the initial association based on the feedback, thereby obtaining a more accurate target association.
[0065] Optionally, the first image includes at least: a first initial image and a second initial image, wherein the first initial image is used to characterize an image acquired before the user is detected entering the vehicle, and the second initial image is used to characterize an image acquired after the user is detected entering the vehicle. Image difference matching is performed on the first image and the second image to obtain a difference matching result, including: matching the first initial image and the second image to obtain a first matching result; matching the second initial image and the second image to obtain a second matching result; and determining a difference matching result based on the first matching result and the second matching result.
[0066] The first initial image mentioned above can refer to the image captured before the user enters the vehicle in the first image, and the second initial image mentioned above can refer to the image captured after the user enters the vehicle in the first image. In an optional solution of this embodiment, in order to accurately determine the above-mentioned difference matching result and thereby improve the accuracy of the determined association between the user and the item, when determining the difference matching result, the first initial image and the second image mentioned above can be matched to obtain the first matching result, and the second initial image and the second image can be matched to obtain the second matching result. Finally, based on the first matching result and the second matching result, the above-mentioned difference matching result can be determined, thereby determining the user's items and the items placed by the user in the vehicle.
[0067] Optionally, based on the user's user status and the target item's item status, a notification message is pushed to the user, including: in response to the user's status indicating that the user's ride has ended and the item status indicating that the target item is in the vehicle, a notification message is pushed to the user, wherein the notification message is at least used to inform the user that the target item is in the vehicle; in response to the user's status not indicating that the user's ride has ended or the item status not indicating that the target item is in the vehicle, the push notification message to the user is stopped.
[0068] In one optional embodiment, when the user's status is "user has finished using the vehicle" and the item's status is "item is in the vehicle", the information push system can determine that the user has left the item in the vehicle. At this time, the information push system can push a notification message to the user that the user has left the item in the vehicle. If the user's status is not "user has finished using the vehicle" or the item's status is not "the target item is in the vehicle", the above-mentioned notification message may not be pushed to the user.
[0069] Optionally, the method further includes: obtaining a user profile; in response to the user profile indicating that the user owns a vehicle, pushing a notification message to the user through a first preset method; in response to the user profile indicating that the user does not own a vehicle, pushing a notification message to the user through a second preset method, wherein the information push efficiency of the second preset method is different from that of the first preset method.
[0070] In one optional embodiment, when pushing a notification message to the user, the information push system can further obtain the user profile of the user who has finished using the vehicle. When the user profile indicates that the user owns the vehicle, the information push system can send the notification message to the pre-bound device according to the first preset method, for example, to quickly notify the user that an item has been left in the vehicle. When the user profile indicates that the user does not own the vehicle, the information push system can send the notification message to the user's mobile phone according to the second preset method, for example, through the user's pre-registered mobile phone number. In comparison, the information push efficiency of the second preset method differs from that of the first preset method.
[0071] To facilitate understanding of the above information push process, Figure 2 This is a schematic diagram illustrating an information push process according to an embodiment of the present invention, such as... Figure 2As shown, the information push system can first use cameras inside and outside the vehicle to collect first and second images within a preset time period, as well as pressure change curves at different locations on the vehicle, i.e., images for a period of time before the vehicle starts and images for a period of time after the vehicle starts, and curves reflecting pressure changes at preset locations on the vehicle. Then, the images are uploaded to a cloud server for the aforementioned image matching and initial association establishment steps. After receiving the initial association returned by the cloud server, the system displays the initial association to the user on a preset first display device and adjusts the initial association based on user feedback to obtain the target association. When the system detects that the user has finished using the vehicle, it can obtain the user's corresponding target item and the item's status based on the target association. If the item status indicates that it was left in the vehicle, the system can further obtain the user's profile. If the user profile indicates that the user is the owner of the vehicle, a notification message can be pushed to the user according to a first preset method; if the user profile indicates that the user is not the owner of the vehicle, a notification message can be pushed to the user according to a second preset method.
[0072] Example 2
[0073] According to another aspect of the embodiments of the present invention, corresponding to the embodiments of the information push method described above, this specification also provides an information push device, please refer to... Figure 3 , Figure 3 This is a structural block diagram of an information push device according to an embodiment of this application. The device includes: a first acquisition module 302, configured to acquire at least one first image, at least one second image, and a pressure change curve collected within a preset time period in response to detecting vehicle startup, wherein the first image represents an image collected before vehicle startup, the second image represents an image collected after vehicle startup, and the pressure change curve represents pressure changes at different locations on the vehicle; an image matching module 304, configured to perform image difference matching on the first image and the second image to obtain a difference matching result; a relationship determination module 306, configured to determine a target association relationship between a user and an item in the second image based on the difference matching result and the pressure change curve, wherein the target association relationship includes at least whether the item belongs to the user; and an information push module 308, configured to push a prompt message to the user based on the user's user status and the target item's item status in response to detecting vehicle stop, wherein the target item belongs to the user.
[0074] Optionally, the relationship determination module 306 includes: a first determination unit, used to determine the target location of the pressure change on the vehicle and the target time period of the pressure change based on the pressure change curve; a second determination unit, used to determine a first item based on the target location, the target time period, and the difference matching result, wherein the first item is used to represent an item placed on the vehicle by the user; a relationship establishment unit, used to perform image recognition on the first image and the second image to establish an initial association relationship between the user and the first item; and a relationship update unit, used to update the initial association relationship based on feedback information sent by the user to obtain a target association relationship, wherein the feedback information is used to represent information from the user that corrects the initial association relationship.
[0075] Optionally, the relationship establishment unit is further configured to: perform image recognition on the first image and the second image to obtain the contact state between the user and the first item; in response to the contact state being that the user and the first item are in contact, obtain the first contact frequency and the first contact duration between the user and the first item; select a target user from the users according to a preset selection method, and obtain the second contact frequency and the second contact duration of the target user; and determine an initial association relationship based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration.
[0076] Optionally, the relationship establishment unit is further configured to: compare the first contact frequency and the second contact frequency to obtain a first comparison result; compare the first contact duration and the second contact duration to obtain a second comparison result; in response to the first comparison result and the second comparison result meeting the preset comparison requirements, determine the initial association relationship as the first item belonging to the target user; in response to the first comparison result and the second comparison result not meeting the preset comparison conditions, reselect the target user from the users and redetermine the initial association relationship.
[0077] Optionally, the device further includes: a second acquisition module, configured to acquire the device status of the first display device corresponding to the user's location; a first display module, configured to display the initial association relationship and the first item on the first display device in response to the device status being normal; an information receiving module, configured to receive feedback information from the user regarding adjustments to the initial association relationship and the first item; and a relationship update module, configured to update the initial association relationship based on the feedback information to obtain the target association relationship.
[0078] Optionally, the first image includes at least: a first initial image and a second initial image, wherein the first initial image is used to characterize an image acquired before the user is detected entering the vehicle, and the second initial image is used to characterize an image acquired after the user is detected entering the vehicle. The image matching module includes: a first matching unit for matching the first initial image and the second image to obtain a first matching result; a second matching unit for matching the second initial image and the second image to obtain a second matching result; and a result determination unit for determining a difference matching result based on the first matching result and the second matching result.
[0079] Optionally, the information push module 308 includes: a first push unit, configured to push a notification message to the user in response to the user's status being "user's ride ended" and the item's status being "target item is in the vehicle," wherein the notification message is at least used to notify the user that the target item is in the vehicle; and a second push unit, configured to stop pushing the notification message to the user in response to the user's status not being "user's ride ended" or the item's status not being "target item is in the vehicle."
[0080] Optionally, the device further includes: a third acquisition module for acquiring a user profile; a first push module for pushing a notification message to the user in response to the user profile indicating that the user owns a vehicle, using a first preset method; and a second push module for pushing a notification message to the user in response to the user profile indicating that the user does not own a vehicle, using a second preset method, wherein the information push efficiency of the second preset method is different from that of the first preset method.
[0081] Example 3
[0082] According to another aspect of the present invention, a computer-readable storage medium is also provided, characterized in that the computer-readable storage medium includes a stored program, wherein, when the program is running, it controls the device where the computer-readable storage medium is located to execute the information push method described above.
[0083] Example 4
[0084] According to another aspect of the present invention, a processor is also provided, characterized in that the processor is used to run a program, wherein the program executes the information push method described above during runtime.
[0085] Example 5
[0086] According to another aspect of the present invention, a vehicle is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any of the above-described information push methods.
[0087] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0088] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0089] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some interfaces; indirect couplings or communication connections between units or modules may be electrical or other forms.
[0090] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0091] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0092] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.
[0093] The above are merely preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.
Claims
1. An information push method characterized by comprising: The method includes: In response to detecting vehicle startup, at least one first image, at least one second image, and a pressure change curve are acquired within a preset time period. The first image is used to represent the image acquired before the vehicle starts, the second image is used to represent the image acquired after the vehicle starts, and the pressure change curve is used to represent the pressure change at different locations on the vehicle. Perform image difference matching on the first image and the second image to obtain the difference matching result; Based on the difference matching results and the pressure change curve, the target association between the user and the item in the second image is determined, wherein the target association includes at least whether the item belongs to the user; In response to detecting that the vehicle has stopped, a notification message is pushed to the user based on the user's user status and the item status of the target item, wherein the target item belongs to the user; The process of determining the target association between the user and the item in the second image based on the difference matching result and the pressure change curve includes: determining the target location and target time period of the pressure change on the vehicle based on the pressure change curve; determining the first item based on the target location, the target time period, and the difference matching result, wherein the first item represents an item placed on the vehicle by the user, and the difference matching result reflects the changes in the user and the item on the vehicle after the vehicle is started compared to before the vehicle is started; performing image recognition on the first image and the second image to establish an initial association between the user and the first item; and updating the initial association based on feedback information sent by the user to obtain the target association, wherein the feedback information represents information from the user correcting the initial association. The method further includes: obtaining the device status of a first display device corresponding to the user's location; in response to the device status being that the first display device is normal, displaying the initial association relationship and the first item on the first display device through an information push system; receiving feedback information from the user regarding adjustments to the initial association relationship and the first item through the information push system; updating the initial association relationship based on the feedback information to obtain the target association relationship.
2. The method of claim 1, wherein, Performing image recognition on the first image and the second image to establish an initial association between the user and the first item includes: Image recognition is performed on the first image and the second image to obtain the contact state between the user and the first item; In response to the contact state being that the user and the first item are in contact, the first contact frequency and the first contact duration between the user and the first item are obtained; Select a target user from the users according to a preset selection method, and obtain the second contact frequency and second contact duration of the target user; The initial association relationship is determined based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration.
3. The method of claim 2, wherein, Determining the initial association relationship based on the first contact frequency, the first contact duration, the second contact frequency, and the second contact duration includes: The first contact frequency and the second contact frequency are compared to obtain the first comparison result; The first contact duration and the second contact duration are compared to obtain a second comparison result; In response to the first comparison result and the second comparison result satisfying the preset comparison requirements, the initial association relationship is determined to be that the first item belongs to the target user; In response to the fact that the first comparison result and the second comparison result do not meet the preset comparison conditions, the target user is reselected from the users and the initial association relationship is redefined.
4. The method of claim 1, wherein, The first image includes at least: a first initial image and a second initial image, wherein the first initial image is used to characterize an image acquired before the user is detected entering the vehicle, and the second initial image is used to characterize an image acquired after the user is detected entering the vehicle. Image difference matching is performed on the first image and the second image to obtain a difference matching result, including: The first initial image and the second image are matched to obtain a first matching result; The second initial image and the second image are matched to obtain a second matching result; Based on the first matching result and the second matching result, the difference matching result is determined.
5. The method of claim 1, wherein, Based on the user's user status and the target item's item status, push notification information to the user, including: In response to the user status indicating that the user has finished using the vehicle and the item status indicating that the target item is in the vehicle, the notification message is pushed to the user, wherein the notification message is at least used to notify the user that the target item is in the vehicle; In response to the user's status not indicating that the user has finished using the vehicle, or the item's status not indicating that the target item is on the vehicle, the push notification message to the user is stopped.
6. The method of claim 1, wherein, The method further includes: Obtain the user profile of the user; In response to the user profile indicating that the user owns the vehicle, the notification information is pushed to the user through a first preset method; In response to the user profile indicating that the user does not own the vehicle, the notification information is pushed to the user through a second preset method, wherein the information push efficiency of the second preset method is different from that of the first preset method.
7. An information push apparatus characterized by comprising: The device includes: The first acquisition module is used to acquire at least one first image, at least one second image, and a pressure change curve collected within a preset time period in response to the detection of vehicle startup. The first image is used to represent the image collected before the vehicle starts, the second image is used to represent the image collected after the vehicle starts, and the pressure change curve is used to represent the pressure change at different locations on the vehicle. The image matching module is used to perform image difference matching between the first image and the second image to obtain the difference matching result; A relationship determination module is used to determine a target association relationship between a user and an item in the second image based on the difference matching result and the pressure change curve, wherein the target association relationship includes at least whether the item belongs to the user; The information push module is used to push a prompt message to the user in response to the detection that the vehicle has stopped, based on the user's user status and the item status of the target item, wherein the target item belongs to the user; The relationship determination module is further configured to: determine the target location of the pressure change on the vehicle and the target time period of the pressure change based on the pressure change curve; determine a first item based on the target location, the target time period, and the difference matching result, wherein the first item represents an item placed on the vehicle by the user, and the difference matching result reflects the changes in the user and the item on the vehicle after the vehicle is started compared to before the vehicle is started; perform image recognition on the first image and the second image to establish an initial association between the user and the first item; update the initial association based on feedback information sent by the user to obtain the target association, wherein the feedback information represents information from the user that corrects the initial association; The relationship determination module is further configured to obtain the device status of the first display device corresponding to the user's location; in response to the device status being that the first display device is normal, display the initial association relationship and the first item on the first display device through the information push system; receive feedback information from the user regarding adjustments to the initial association relationship and the first item through the information push system; update the initial association relationship based on the feedback information to obtain the target association relationship.
8. A vehicle comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the information push method according to any one of claims 1 to 6.