Method and system for storing and accessing items in a vehicle trunk

Abstract

The present invention provides a method and system for storing and retrieving items in a vehicle trunk. First, a user image is captured in real time, and then the image is recognized to determine whether the user is storing or retrieving items. If the user is storing items, the vehicle-mounted system determines the storage area for the items based on the shape and category of the items and provides a prompt. After the items are placed, the system forms a fixed fence in the storage area to limit the items, and updates the item information and the storage area in the vehicle-mounted interface, and sets an anti-forgetting reminder. If the user is retrieving items, a voice prompt is given to the user to select the items in the vehicle-mounted interface. The vehicle-mounted system prompts the corresponding storage area, resets the fixed fence there, and releases the item limit. When the items are taken out, the system updates the item information again in the vehicle-mounted interface. The present invention can achieve classified storage of different items and special-shaped objects, and perform catalog display and anti-forgetting reminders, effectively improving the convenience of storing and retrieving items and improving the user's vehicle experience.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile trunk storage, and in particular to a method and system for storing and accessing items in a vehicle trunk. Background Art

[0002] In the daily use of cars, since the trunk space of the vehicle is relatively wide, users can store various types of items used in daily life in the trunk. However, in current vehicles, the trunk is just a box that provides storage space with a relatively simple function. It is difficult to meet the user's various storage classification needs, which affects the user's car experience.

[0003] To address the need for storage classification, existing car trunks often incorporate a storage box for small and medium-sized items. This can be accomplished by manually creating multiple rectangular compartments using panels based on the size of the items. However, this type of storage box cannot accommodate large, irregularly shaped items and takes up a significant amount of space, requiring manual installation. Some car manufacturers also integrate storage boxes into the trunk, using hydraulic pumps and electric telescopic rods at both ends to move the boxes, allowing them to be hidden and opened. While this integrated storage box increases storage space, it has limited storage capacity and cannot secure irregularly shaped objects. Therefore, current methods of storing items in car trunks still lack a user-friendly experience, and convenience still needs to be improved. Summary of the Invention

[0004] The present invention provides a method and system for storing and accessing items in a vehicle trunk, which does not occupy the space of the existing trunk, can fix and classify items of different sizes and special shapes, and can display the stored items in a catalog and provide anti-forgetting reminders by forming a menu on the vehicle interface, thereby effectively improving the convenience of storing items and enhancing the user's vehicle experience.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] A method for storing and retrieving items from a vehicle trunk comprises the following steps:

[0007] Step S1: The camera in the trunk collects the user's hand image in real time;

[0008] Step S2: The vehicle system uses the object detection model to identify the collected hand image and determine whether there is an object in the user's hand;

[0009] Step S3: If the user has an item in his hand, it is determined that the user needs to deposit the item, and steps X1-X5 are executed; if the user does not have an item in his hand, it is determined that the user needs to retrieve the item, and steps Y1-Y4 are executed;

[0010] The process of depositing items is as follows:

[0011] Step X1: The vehicle system identifies the shape and category of the object through the object detection model;

[0012] Step X2: The vehicle computer system determines the storage area for the item based on the shape and category of the item;

[0013] Step X3: The vehicle system prompts the storage area;

[0014] Step X4: When the camera detects that an item has been placed in the storage area, the vehicle computer system drives multiple telescopic components to extend into the storage area based on the shape of the item to form a fixed fence to limit the current item.

[0015] Step X5: After storage is completed, the vehicle system updates the item information and storage area on the vehicle interface, and sets a reminder date for the item to prevent forgetting. A pop-up window will be displayed on the vehicle interface before the date expires.

[0016] The process of taking objects is as follows:

[0017] Step Y1: The vehicle system prompts the user by voice, asking the user to click on the item to be retrieved from the item list displayed on the vehicle interface in the trunk;

[0018] Step Y2: The vehicle system prompts the storage area of ​​the item to be taken;

[0019] Step Y3: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released;

[0020] Step Y4: When the camera captures that the item has been taken out from the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

[0021] In the present invention, the camera is first used to intelligently identify whether the user is storing items. Then, when storing items, the vehicle system divides and determines the storage area for the items based on the shape and category of the items, and prompts the area, so that the user can quickly place the items in the appropriate place according to the instructions; and the vehicle system re-identifies the shape of the items placed on the storage area, thereby controlling the telescopic components to form a fixed fence to limit and fix the items according to the outline of the items, which can achieve fixed storage for items of different sizes and irregular shapes. There is no fixed division area, and an intelligent placement area is formed according to the shape of the items, which effectively improves the convenience and stability of storage; finally, the information of the items is displayed on the vehicle interface and a reminder is given to prevent forgetting, thereby improving the user experience.

[0022] Similarly, when you need to take something, click on the interface in the trunk to select the item. The car system will prompt the corresponding storage area according to the selected item. At the same time, the car system controls the retractable component to reset, so that the fixed fence on the storage area disappears, removing the limit on the item. The user can then take the item conveniently according to the instructions. After taking the item, the car interface will promptly update the item information and its storage area so that the item can be placed in the area next time.

[0023] The present invention effectively and intelligently identifies user behavior through the combination of a camera and a vehicle-mounted system, and provides prompts and guidance on the storage and access of items, thereby improving the convenience of users in storing and accessing items. At the same time, during storage and access, fixed fences are formed to limit items of different sizes and irregular shapes, thereby enhancing the stability and compatibility of storage. The present invention also updates the storage and access information of items in a timely manner through the vehicle-mounted interface, so that users can see the storage status of items at a glance, thereby improving the user's car-using experience.

[0024] Furthermore, when the user chooses to retrieve an item without using the vehicle interface, the item can be retrieved through the following methods:

[0025] Step Z1: The camera in the trunk captures the user's body movement trajectory when taking something out;

[0026] Step Z2: The vehicle computer system uploads the limb movement trajectory to the prediction model in the cloud for prediction, and obtains the storage area where the user needs to pick up the item;

[0027] Step Z3: The vehicle system prompts the storage area;

[0028] Step Z4: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released;

[0029] Step Z5: When the camera captures that the item has been taken out of the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

[0030] To further enhance user convenience, this invention optimizes item retrieval by adding a method for predicting user behavior by identifying body movement trajectories. This makes retrieval from the vehicle trunk intelligent and flexible. When a user needs to retrieve an item, they no longer need to click on the vehicle interface. Instead, they can simply open the trunk door to trigger the camera, which captures the body movement trajectory. The vehicle system then uploads the prediction model to the cloud to predict the action, thereby determining the final storage area for the item to be retrieved. The system then directly displays a prompt indicating the storage area, guiding the user to retrieve the item, effectively improving the intelligent nature of item retrieval.

[0031] Among them, the above-mentioned prediction model is obtained by training the user's body movement trajectory in advance. The car system captures the historical body movement trajectory of the owner during daily taking things captured by the trunk camera and uploads it to the cloud for training the prediction model. Therefore, when it is used in real time in the future, the storage area where the owner needs to take things can be predicted in advance through body movements.

[0032] Specifically, the process of establishing the prediction model is as follows:

[0033] A three-dimensional coordinate system is established with the point where the camera in the trunk is located as the origin, the vehicle length as the X direction, the vehicle width as the Y direction, and the vehicle height as the Z direction.

[0034] Step 1: Decompose the limb movement trajectory captured by the camera into three-dimensional coordinates. Starting with the user standing in front of the trunk with their arm bent, the user's hand position is recorded at intervals of T until the item is retrieved. This completes the quantitative collection of the coordinate data of the items the user intends to retrieve and the coordinate data of the points along the user's limb movement trajectory.

[0035] Step 2: Using the coordinates of the user's object-grabbing points as the dependent variable and the coordinates of the user's limb movement trajectory as the independent variable, we fit the quantitatively collected data and establish equations for the movement trajectory points in the X, Y, and Z directions to complete the establishment of a preliminary model.

[0036] Step 3: Continue to optimize the established preliminary model through the subsequent reading of coordinate point data, and add time variables and location variables to the model for weighted evaluation to complete the model optimization;

[0037] Step 4: Fit the model to the test coordinate point data collected in real time. When the degree of fitting exceeds the set threshold multiple times, the model is considered valid.

[0038] In the above process, when it is necessary to predict the user's limb movement trajectory, the data can be directly input into the prediction model to identify the storage area of ​​the item the user needs to pick up, effectively improving the intelligent process of picking up items and enhancing the user experience.

[0039] Furthermore, in step Z2, based on the limb movement trajectory, the prediction model predicts the storage area where the user needs to pick up the item as follows;

[0040] The limb movement trajectory is input into the prediction model, which fits and predicts the coordinate point data of the limb movement trajectory to obtain the target coordinates of the item the user needs to pick up, and then identifies the corresponding storage area in the vehicle system based on the target coordinates.

[0041] Furthermore, the object detection model used in step S2 is based on the R-CNN (Regions with CNN features) detection model. The R-CNN algorithm can effectively improve the recognition accuracy of the object detection model so that the user's access action can be quickly determined.

[0042] Furthermore, the vehicle system turns on the ambient light to illuminate the storage area, thereby providing a reminder of the storage area.

[0043] The present invention reminds users of the storage area where they place or take items by lighting up the ambient light, which can clearly guide users to store or retrieve items, improves the convenience of use, and makes users have a better car experience.

[0044] Furthermore, the vehicle computer system drives multiple telescopic components to extend in the storage area according to the placement shape of the item to form a fixed fence to limit the current item. The process is as follows:

[0045] Multiple telescopic components are numbered in the vehicle system. The vehicle system obtains the shape of the items placed in the storage area from the camera, and uses it to identify the outline of the items. Then, the number of the corresponding telescopic component is determined based on the outline. After that, the vehicle system sends the number of the telescopic component to be controlled to the controller. After receiving the signal, the controller synchronously drives the telescopic component with the corresponding number to rise, so that the telescopic component extends above the storage area to form a fixed fence to limit the items.

[0046] When storing or retrieving items, the vehicle's computer system controls the telescopic components in the trunk to secure them in place. After the system determines a storage area, the coordinates of that area are used to determine the corresponding storage area location. This area is then displayed. When the user needs to store or retrieve an item, the telescopic components are controlled to rise and fall around the item's placement contour, forming or releasing a fixed fence. This allows for convenient placement of items of varying sizes and irregular shapes, improving both the convenience of storing and retrieving items and the user experience.

[0047] Furthermore, the weight of the items placed in the storage area is collected and uploaded to the vehicle system. When the weight of the items exceeds the set weight threshold, the vehicle system sends an instruction to the controller, instructing the controller to drive the telescopic parts around the fixed fence to extend synchronously, so as to add a fence outside the fixed fence for additional fixation.

[0048] In order to further improve the stability of placing heavy objects, the gravity changes in the storage area can be monitored. Once the weight of the item is too heavy, in order to further improve the stability of the placement, the vehicle system will raise an additional layer of telescopic components outside the original fixed fence, so that the original one-layer fixed fence becomes a two-layer fixed fence, which strengthens the limit support for the placed items and can effectively prevent the items from leaving the storage area due to the inertia of excessive weight.

[0049] The present invention also provides a vehicle trunk article storage and retrieval system for implementing the above-mentioned vehicle trunk article storage and retrieval method, comprising:

[0050] The camera, installed in the trunk, is responsible for capturing the user's hand image, capturing the real-time location of the item, and capturing the user's body movement trajectory when taking the item;

[0051] The vehicle computer system uses the object detection model to identify the collected hand images, determine whether there is an object in the user's hand, and identify the shape and type of the object, and make a decision on the storage area of ​​the object;

[0052] The cloud communicates with the vehicle computer system and is equipped with a prediction model to predict the movement trajectory of the limbs and obtain the storage area where the user needs to pick up the items;

[0053] The car computer interface is used to display information about items stored in the trunk and to prevent forgetting reminders;

[0054] Ambient lighting: Use lighting to indicate the storage area of ​​items in the trunk, so that objects can be stored in a classified manner;

[0055] The trunk storage device includes multiple telescopic components, which are used to drive the multiple telescopic components to extend in the storage area according to the placement shape of the items to form a fixed fence to limit the current items; when there is no need to limit the position, the multiple telescopic components are driven to reset to keep the storage area flat.

[0056] Furthermore, the trunk storage device includes a controller, a partition, a spring, a weight sensor, and a telescopic component, wherein the telescopic component is an automatic telescopic rod;

[0057] The controller receives a signal from the vehicle computer system and synchronously controls the multiple automatic telescopic rods in the corresponding storage area to extend or retract;

[0058] A partition, the shape of which matches the shape of the trunk, and the partition is provided with a plurality of holes distributed in an array;

[0059] Automatic telescopic rods, the number of which corresponds to the number of holes in the partition, are installed under the holes in the partition and can be freely raised and lowered relative to the holes;

[0060] Springs are distributed at the four corners of the bottom of the partition to support and transfer weight;

[0061] The weight sensors, the number of which corresponds to the number of the springs, are installed on one side of the bottom of the springs to transmit weight information to the vehicle system.

[0062] The beneficial effects of the present invention are as follows:

[0063] The present invention uses a camera to intelligently identify whether a user has stored items, and links the vehicle computer system to identify the shape of the items, so that the vehicle computer system can determine the storage area for storing and accessing items, and provide prompts for the storage area. In this way, the user can quickly store or take out items according to the instructions, realizing classified storage of items. After storing or accessing items, the item information is displayed on the vehicle computer interface and a reminder is given to prevent forgetting, which effectively improves the convenience of storing and accessing items and the user experience.

[0064] At the same time, when storing items in the storage area, the vehicle system controls the telescopic component to extend to form a fixed fence to limit and fix the items according to the outline of the items, so that items of different sizes and irregular shapes can be fixedly stored; and when taking out items, the telescopic component can be reset without affecting the flatness of the storage area, which is convenient for next use; through the above method, the present invention does not need fixed area division, and can form intelligent placement areas according to the shape of the items, rationally utilizes space, and effectively improves the convenience and stability of storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 A schematic flow chart of a method for storing and retrieving items from a vehicle trunk according to the present invention;

[0066] Figure 2 This is a flow chart for selecting and retrieving items without going through the vehicle interface;

[0067] Figure 3 This is a structural block diagram of a vehicle trunk article access system according to the present invention;

[0068] Figure 4 It is a structural diagram of the trunk storage device;

[0069] Figure 5 The diagram is a diagram of an irregular sample plate placed on a partition;

[0070] In the figure: partition 1, hole 101, spring 2, weight sensor 3, automatic telescopic rod 4. DETAILED DESCRIPTION

[0071] The following describes the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art will readily appreciate the other advantages and benefits of the present invention from the disclosure herein. The present invention may also be implemented or applied through various other specific embodiments, and the various details in this specification may be modified or altered based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are intended only to illustrate the present invention and are not intended to limit the scope of protection of the present invention.

[0072] It should be noted that the illustrations provided in the following embodiments are merely schematic illustrations of the basic concept of the present invention. Therefore, the illustrations only show components related to the present invention and are not drawn according to the number, shape, and size of components in actual implementation. In actual implementation, the type, quantity, and proportion of each component may be changed arbitrarily, and the component layout may also be more complex.

[0073] Example 1:

[0074] like Figure 1 As shown, a method for storing and retrieving items in a vehicle trunk comprises the following steps:

[0075] Step S1: The camera in the trunk collects the user's hand image in real time;

[0076] Step S2: The vehicle system uses the object detection model to identify the collected hand image and determine whether there is an object in the user's hand;

[0077] Step S3: If the user has an item in his hand, it is determined that the user needs to deposit the item, and steps X1-X5 are executed; if the user does not have an item in his hand, it is determined that the user needs to retrieve the item, and steps Y1-Y4 are executed;

[0078] The process of depositing items is as follows:

[0079] Step X1: The vehicle system identifies the shape and category of the object through the object detection model;

[0080] Step X2: The vehicle computer system determines the storage area for the item based on the shape and category of the item;

[0081] Step X3: The vehicle system prompts the storage area;

[0082] Step X4: When the camera detects that an item has been placed in the storage area, the vehicle computer system drives multiple telescopic components to extend into the storage area based on the shape of the item to form a fixed fence to limit the current item.

[0083] Step X5: After storage is completed, the vehicle system updates the item information and storage area on the vehicle interface, and sets a reminder date for the item to prevent forgetting. A pop-up window will be displayed on the vehicle interface before the date expires.

[0084] The process of taking objects is as follows:

[0085] Step Y1: The vehicle system prompts the user by voice, asking the user to click on the item to be retrieved from the item list displayed on the vehicle interface in the trunk;

[0086] Step Y2: The vehicle system prompts the storage area of ​​the item to be taken;

[0087] Step Y3: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released;

[0088] Step Y4: When the camera captures that the item has been taken out from the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

[0089] In this embodiment, the object detection model used in step S2 is based on R-CNN (Regions with CNN features). The R-CNN algorithm effectively improves the recognition accuracy of the object detection model, enabling rapid identification of user access actions. The object detection model is a general recognition model. Using transfer learning and fusion models as examples, training and labeling of common objects based on this general model are performed. This object detection model is trained on a variety of pre-prepared training images and can identify and identify a variety of items that users access daily.

[0090] In this embodiment, the vehicle system calculates the shape, size, and category of the objects held by the human body to obtain an adaptive area, and puts items of the same category together according to the classification of the corresponding item attributes, and then matches the area of ​​the area corresponding to the size in the trunk as a storage area, thereby realizing the decision of the storage area and achieving the fixed-point classified storage of items.

[0091] In this embodiment, the vehicle system turns on the ambient light to illuminate the storage area, thereby providing a reminder of the storage area. When storing or retrieving items, the storage area in the trunk is indicated by light according to the category and size of the items, thereby achieving classified storage and retrieval of objects. The ambient light should provide a clear reminder at any time. The present invention reminds users of the storage area where they place or take items by lighting up the ambient light, which can clearly guide users in storing or retrieving items, improves ease of use, and provides users with a better car experience.

[0092] In this embodiment, the item information displayed on the vehicle interface includes category, quantity, placement date, etc., and anti-forgetfulness reminder dates are set for different categories of objects. The anti-forgetfulness reminder date is automatically set according to the storage time of the object, and the time is pre-set in the vehicle system, such as three days for fresh food.

[0093] In this embodiment, multiple vehicle interfaces are displayed simultaneously on multiple screens. The vehicle's central control screen can serve as one in-car interface, while a screen in the trunk serves as another. Both interfaces are displayed simultaneously, allowing users to select or view items. Users can view item information on the central control screen while sitting in the vehicle, select items, and then retrieve them. Alternatively, they can directly open the trunk and select items on the screen inside.

[0094] In the present invention, the camera is first used to intelligently identify whether the user is storing items. Then, when storing items, the vehicle system divides and determines the storage area for the items according to the shape and category of the items, and prompts the area, so that the user can quickly place the items in the appropriate place according to the instructions; and the vehicle system re-identifies the shape of the items placed on the storage area, thereby controlling the telescopic components to form a fixed fence to limit and fix the items according to the outline of the items, which can realize fixed storage for items of different sizes and irregular shapes. There is no fixed division area, and an intelligent placement area is formed according to the shape of the items, which effectively improves the convenience and stability of storage; finally, the information of the items is displayed on the vehicle interface and a reminder is given to prevent forgetting, thereby improving the user experience.

[0095] Similarly, when you need to pick up something, click on the interface to select the item. The car system will prompt the corresponding storage area based on the selected item. At the same time, the car system controls the retractable component to reset, so that the fixed fence on the storage area disappears, removing the limit on the item. The user can then pick up the item conveniently according to the instructions. After the item is picked up, the car interface will promptly update the item information and its storage area so that the item can be placed again in the area next time.

[0096] The present invention effectively and intelligently identifies user behavior through the combination of a camera and a vehicle-mounted system, and provides prompts and guidance on the storage and access of items, thereby improving the convenience of users in storing and accessing items. At the same time, during storage and access, fixed fences are formed to limit items of different sizes and irregular shapes, thereby enhancing the stability and compatibility of storage. The present invention also updates the storage and access information of items in a timely manner through the vehicle-mounted interface, so that users can see the storage status of items at a glance, thereby improving the user's car-using experience.

[0097] like Figure 2As shown, in order to further improve user convenience, this embodiment optimizes the retrieval process by adding a method of identifying body movement trajectories to predict user behavior, making it smart and flexible for users to retrieve items from the vehicle trunk. When retrieving items, users can select items without going through the vehicle computer interface. The camera directly and intelligently identifies the user's destination. The specific implementation process is as follows:

[0098] Step Z1: The camera in the trunk captures the user's body movement trajectory when taking something out;

[0099] Step Z2: The vehicle computer system uploads the limb movement trajectory to the prediction model in the cloud for prediction, and obtains the storage area where the user needs to pick up the item;

[0100] Step Z3: The vehicle system prompts the storage area;

[0101] Step Z4: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released;

[0102] Step Z5: When the camera captures that the item has been taken out of the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

[0103] Among them, the above-mentioned prediction model is obtained by training the user's body movement trajectory in advance. The car system captures the historical body movement trajectory of the owner during daily taking things captured by the trunk camera and uploads it to the cloud for training the prediction model. Therefore, when it is used in real time in the future, the storage area where the owner needs to take things can be predicted in advance through body movements.

[0104] Specifically, the process of establishing the prediction model is as follows:

[0105] A three-dimensional coordinate system is established with the point where the camera in the trunk is located as the origin, the vehicle length as the X direction, the vehicle width as the Y direction, and the vehicle height as the Z direction.

[0106] Step 1: Decompose the limb movement trajectory captured by the camera into three-dimensional coordinates. Starting with the user standing in front of the trunk with their arm bent, the user's hand position is recorded at intervals of T until the item is retrieved. This completes the quantitative collection of the coordinate data of the items the user intends to retrieve and the coordinate data of the points along the user's limb movement trajectory.

[0107] Step 2: Using the coordinates of the user's object-grabbing points as the dependent variable and the coordinates of the user's limb movement trajectory as the independent variable, we fit the quantitatively collected data and establish equations for the movement trajectory points in the X, Y, and Z directions to complete the establishment of a preliminary model.

[0108] Step 3: Continue to optimize the established preliminary model through the subsequent reading of coordinate point data, and add time variables and location variables to the model for weighted evaluation to complete the model optimization;

[0109] Step 4: Fit the model to the test coordinate point data collected in real time. When the degree of fitting exceeds the set threshold multiple times, the model is considered valid.

[0110] In the above process, when it is necessary to predict the user's limb movement trajectory, the data can be directly input into the prediction model to identify the storage area of ​​the item the user needs to pick up, effectively improving the intelligent process of picking up items and enhancing the user experience.

[0111] In step Z2 of this embodiment, the process of the prediction model predicting the storage area of ​​the item that the user needs to pick up based on the limb movement trajectory is as follows:

[0112] The limb movement trajectory is input into the prediction model, which fits and predicts the coordinate point data of the limb movement trajectory to obtain the target coordinates of the item the user needs to pick up, and then identifies the corresponding storage area in the vehicle system based on the target coordinates.

[0113] In this embodiment, when the user needs to pick up something, he or she does not need to click to select on the vehicle interface. Instead, he or she can directly trigger the camera by opening the trunk door. The camera collects the trajectory of limb movement, and the prediction model uploaded to the cloud by the vehicle system predicts the action, so as to obtain the storage area where the user ultimately needs to pick up the item. The storage area is then directly prompted to guide the user to pick up the item, which effectively improves the intelligence of picking up the item.

[0114] The aforementioned methods for retrieving items in steps Z1-Z5 are parallel to those in steps Y1-Y4. Users can access items in either method. The difference lies in that one method uses a camera to intelligently identify the user's body movements and determine the storage area for the item they wish to retrieve, while the other method allows the user to directly select the item they wish to retrieve on the vehicle interface, and the vehicle system directly indicates the storage area based on the item's location. This embodiment provides multiple methods for users to retrieve items, improving convenience.

[0115] like Figure 3 As shown, this embodiment further provides a vehicle trunk item storage and retrieval system, which is used to implement the above-mentioned vehicle trunk item storage and retrieval method, including:

[0116] The camera, installed in the trunk, is responsible for capturing the user's hand image, capturing the real-time location of the item, and capturing the user's body movement trajectory when taking the item;

[0117] The vehicle computer system uses the object detection model to identify the collected hand images, determine whether there is an object in the user's hand, and identify the shape and type of the object, and make a decision on the storage area of ​​the object;

[0118] The cloud communicates with the vehicle computer system and is equipped with a prediction model to predict the movement trajectory of the limbs and obtain the storage area where the user needs to pick up the items;

[0119] The car computer interface is used to display information about items stored in the trunk and to prevent forgetting reminders;

[0120] Ambient lighting: Use lighting to indicate the storage area of ​​items in the trunk, so that objects can be stored in a classified manner;

[0121] The trunk storage device includes multiple telescopic components, which are used to drive the multiple telescopic components to extend in the storage area according to the placement shape of the items to form a fixed fence to limit the current items; when there is no need to limit the position, the multiple telescopic components are driven to reset to keep the storage area flat.

[0122] In this embodiment, the vehicle system is electrically connected to the camera, the vehicle interface, the ambient light, and the trunk storage device, and the vehicle system communicates with the cloud via a wireless network.

[0123] like Figure 4 and Figure 5 As shown, in this embodiment, the trunk storage device includes a controller (not shown in the figure), a partition 1, a spring 2, a weight sensor 3, and a telescopic component, wherein the telescopic component is an automatic telescopic rod 4;

[0124] The controller receives the signal from the vehicle system and synchronously controls the multiple automatic telescopic rods 4 in the corresponding storage area to extend or retract;

[0125] Partition 1, the shape of which matches the shape of the trunk, and is provided with a plurality of holes 101 distributed in an array;

[0126] Automatic telescopic rods 4, the number of which corresponds to the number of holes 101 of the partition 1, are installed under the holes 101 of the partition 1 and can be freely raised and lowered relative to the holes 101;

[0127] Springs 2 are distributed at the four corners of the bottom of the partition 1 to support and transfer weight;

[0128] The weight sensors 3 , the number of which corresponds to the number of the springs 2 , are installed on one side of the bottom of the spring 2 to transmit weight information to the vehicle system.

[0129] In this embodiment, the vehicle system drives multiple telescopic components to extend in the storage area according to the placement shape of the object to form a fixed fence to limit the current object in the following process:

[0130] The automatic telescopic rods 4 corresponding to the multiple hole positions 101 on the partition 1 are numbered in the vehicle system. After the vehicle system obtains the shape of the items placed in the storage area from the camera, it recognizes the outline of the items placed on the partition 1, and then determines the coordinate point of the corresponding hole position 101 according to the outline, and the number of the automatic telescopic rod 4 under the corresponding hole position 101 can be obtained. After that, the vehicle system sends the number of the automatic telescopic rod 4 to be controlled to the controller. After receiving the signal, the controller synchronously drives the automatic telescopic rod 4 with the corresponding number to rise, so that the automatic telescopic rod 4 extends on the partition 1 to form a fixed fence to limit the items.

[0131] When storing or retrieving items, the vehicle system controls the automatic telescopic rod 4 installed in the trunk to secure the items in place. After the vehicle system determines the storage area, the coordinates of the area are used to determine the corresponding storage area on the partition 1. This area is then displayed. When the user needs to store or retrieve items, the automatic telescopic rod 4 is controlled to rise and fall around the item's placement contour, forming or releasing a fixed fence. This allows for convenient placement of items of varying sizes and irregular shapes, improving the convenience of storing and retrieving items and the user experience.

[0132] In this embodiment, the prediction model in the cloud is responsible for fitting and optimizing the model of the limb movement trajectory data collected by the vehicle system, and the OTA (over-the-air) of the vehicle system can be achieved through the cloud.

[0133] In this embodiment, the number of the holes 101 on the partition 1 is a certain value, which is determined by the size of the partition 1 and the effective fixing interval of the automatic telescopic rods 4.

[0134] In this embodiment, the extended height of the automatic telescopic rod 4 exceeds the height of the partition 1 by a certain value. Because the camera recognizes the size parameters of the object when it is placed, including data such as length, width, and height, the vehicle computer system initially determines the required storage space height and then controls the extended height of the automatic telescopic rod 4 through the controller to ensure that the extended height is higher than the placement height of the object.

[0135] In this embodiment, the weight of the items placed on the storage area is collected by the weight sensor 3 and uploaded to the vehicle system. When the weight of the items exceeds the set weight threshold, the vehicle system sends an instruction to the controller, instructing the controller to drive the automatic telescopic rods 4 around the fixed fence to extend synchronously, so as to add a fence outside the fixed fence for additional fixation.

[0136] In this embodiment, in order to further improve the stability of placing heavy objects, the gravity changes in the storage area on the partition 1 are monitored by the weight sensor 3. Once the weight of the item is too heavy, in order to further improve the stability of the placement, the vehicle system raises another layer of automatic telescopic rod 4 outside the original fixed fence, so that the original one-layer fixed fence becomes a two-layer fixed fence, which strengthens the limiting support for the placed items and can effectively prevent the items from leaving the storage area due to the inertia of excessive weight.

[0137] See also Figure 5 Taking the storage of an irregularly shaped item as an example, the process of retrieving the item using the above vehicle trunk item storage and retrieval system is as follows:

[0138] 1. The trunk is opened, and the camera inside the trunk captures the user's hand image;

[0139] 2. The vehicle computer system uses the object detection model to identify the collected hand image and determine whether the current user needs to store items. The vehicle computer system plans and decides the required storage area on the partition 1 based on the shape, size, and category of the items held by the user to achieve classified storage of items;

[0140] 3. The vehicle system turns on the ambient light, illuminating the storage area to remind the user that they need to store items in this area;

[0141] 4. When the camera detects that the object has been placed in the designated storage area, the vehicle computer system recognizes the shape of the object again and obtains an outline. Based on the outline, it obtains the number of the automatic telescopic rod 4 under the corresponding hole 101 and transmits the driving signal to the controller.

[0142] 5. The controller drives the automatic telescopic rods 4 according to the obtained numbers, so that the multiple automatic telescopic rods 4 surrounding the outline of the object are automatically raised to a certain height, forming a fixed fence to limit the current object;

[0143] 6. After storage is completed, the vehicle system will update the information of the item and the storage area in the vehicle interface, and set an anti-forgetting reminder date for the item, and a pop-up reminder will be displayed on the vehicle interface before the date expires.

[0144] When you need to take out an item, you can choose to interactively click on the vehicle interface or use the camera for intelligent recognition. The process of taking out an item is as follows:

[0145] 1. When the user selects the item to be picked up by clicking on the vehicle interface, the vehicle system will obtain the storage area where the item is located; or

[0146] The user opens the trunk directly, and the camera recognizes the user's body movement trajectory and uploads it to the vehicle computer system. The vehicle computer system uses the cloud-based prediction model to predict the storage area where the user needs to take the item.

[0147] 2. The vehicle system activates the ambient light, which illuminates the storage area where the item to be taken is located, to remind the user to place the item in that area;

[0148] 3. The vehicle computer system sends a signal to the controller, which drives the multiple automatic telescopic rods 4 in the storage area to reset, causing the automatic telescopic rods 4 to retract below the partition 1, restoring the flatness of the storage area, causing the fixed fence in the area to disappear, and releasing the restriction on the current items;

[0149] 4. When the camera captures that the item has been taken out of the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

[0150] The present invention uses a camera to intelligently identify whether a user has stored items, and links the vehicle computer system to identify the shape of the items, so that the vehicle computer system can determine the storage area for storing and accessing items, and provide prompts for the storage area. In this way, the user can quickly store or take out items according to the instructions, realizing classified storage of items. After storing or accessing items, the item information is displayed on the vehicle computer interface and a reminder is given to prevent forgetting, which effectively improves the convenience of storing and accessing items and the user experience.

[0151] At the same time, when storing items in the storage area, the vehicle system controls the telescopic component to extend to form a fixed fence to limit and fix the items according to the outline of the items, so that items of different sizes and irregular shapes can be fixedly stored; and when taking out items, the telescopic component can be reset without affecting the flatness of the storage area, which is convenient for next use; through the above method, the present invention does not need fixed area division, and can form intelligent placement areas according to the shape of the items, rationally utilizes space, and effectively improves the convenience and stability of storage.

[0152] The above embodiments are only preferred embodiments for fully illustrating the present invention, and the protection scope of the present invention is not limited thereto. Any equivalent substitution or modification made by those skilled in the art based on the present invention is within the protection scope of the present invention.

Claims

1. A method for storing and retrieving items in a vehicle trunk, characterized in that: The following steps are involved: Step S1: The camera in the trunk collects the user's hand image in real time; Step S2: The vehicle system uses the object detection model to identify the collected hand image and determine whether there is an object in the user's hand; Step S3: If the user has an item in his hand, it is determined that the user needs to deposit the item, and steps X1-X5 are executed; if the user does not have an item in his hand, it is determined that the user needs to retrieve the item, and steps Y1-Y4 are executed; The deposit process is as follows: Step X1: The vehicle system identifies the shape and category of the object through the object detection model; Step X2: The vehicle computer system determines the storage area for the item based on the shape and category of the item; Step X3: The vehicle system prompts the storage area; Step X4: When the camera detects that an item has been placed in the storage area, the vehicle computer system drives multiple telescopic components to extend into the storage area based on the shape of the item to form a fixed fence to limit the current item. Step X5: After storage is completed, the vehicle system updates the item information and storage area on the vehicle interface, and sets a reminder date for the item to prevent forgetting. A pop-up window will be displayed on the vehicle interface before the date expires. The process of taking objects is as follows: Step Y1: The vehicle system prompts the user by voice, asking the user to click on the item to be retrieved from the item list displayed on the vehicle interface in the trunk; Step Y2: The vehicle system prompts the storage area of ​​the item to be taken; Step Y3: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released; Step Y4: When the camera captures that the item has been taken out from the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

2. A method for storing and accessing items in a vehicle trunk according to claim 1, characterized in that: When the user chooses to retrieve an item without using the vehicle interface, the following methods are used to retrieve the item: Step Z1: The camera in the trunk captures the user's body movement trajectory when taking something out; Step Z2: The vehicle computer system uploads the limb movement trajectory to the prediction model in the cloud for prediction, and obtains the storage area where the user needs to pick up the item; Step Z3: The vehicle system prompts the storage area; Step Z4: The vehicle computer system drives the multiple telescopic components to reset so that the fixed fence disappears and the restriction on the object is released; Step Z5: When the camera captures that the item has been taken out of the storage area by the user, the vehicle system updates the item information of the corresponding storage area in the vehicle interface.

3. The method for storing and accessing items in a vehicle trunk according to claim 2, characterized in that: The process of establishing the prediction model is as follows: A three-dimensional coordinate system is established with the point where the camera in the trunk is located as the origin, the vehicle length as the X direction, the vehicle width as the Y direction, and the vehicle height as the Z direction. Step 1: Decompose the limb movement trajectory captured by the camera into three-dimensional coordinates. Starting with the user standing in front of the trunk with their arm bent, the user's hand position is recorded at intervals of T until the item is retrieved. This completes the quantitative collection of the coordinate data of the items the user intends to retrieve and the coordinate data of the points along the user's limb movement trajectory. Step 2: Using the coordinates of the user's object-grabbing points as the dependent variable and the coordinates of the user's limb movement trajectory as the independent variable, we fit the quantitatively collected data and establish equations for the movement trajectory points in the X, Y, and Z directions to complete the establishment of a preliminary model. Step 3: Continue to optimize the established preliminary model through the subsequent reading of coordinate point data, and add time variables and location variables to the model for weighted evaluation to complete the model optimization; Step 4: Fit the model to the test coordinate point data collected in real time. When the degree of fitting exceeds the set threshold multiple times, the model is considered valid.

4. The method for storing and retrieving items from a vehicle trunk according to claim 3, wherein: In step Z2, based on the limb movement trajectory, the prediction model predicts the storage area where the user needs to pick up the item as follows; The limb movement trajectory is input into the prediction model, which fits and predicts the coordinate point data of the limb movement trajectory to obtain the target coordinates of the item the user needs to pick up, and then identifies the corresponding storage area in the vehicle system based on the target coordinates.

5. The method for storing and accessing items in a vehicle trunk according to claim 1, characterized in that: The target detection model used in step S2 is a detection model based on R-CNN.

6. The method for storing and retrieving items from a vehicle trunk according to claim 1, wherein: The vehicle system turns on the ambient light to illuminate the storage area, providing a reminder of the storage area.

7. The method for storing and retrieving items from a vehicle trunk according to claim 1, wherein: The vehicle computer system drives multiple telescopic components to extend into the storage area based on the placement of the item to form a fixed fence to limit the current item. The process is as follows: Multiple telescopic components are numbered in the vehicle system. The vehicle system obtains the shape of the items placed in the storage area from the camera, and uses it to identify the outline of the items. Then, the number of the corresponding telescopic component is determined based on the outline. After that, the vehicle system sends the number of the telescopic component to be controlled to the controller. After receiving the signal, the controller synchronously drives the telescopic component with the corresponding number to rise, so that the telescopic component extends above the storage area to form a fixed fence to limit the items.

8. The method for storing and retrieving items from a vehicle trunk according to claim 1, wherein: The weight of items placed in the storage area is collected and uploaded to the vehicle system. When the weight of the items exceeds the set weight threshold, the vehicle system sends an instruction to the controller, instructing the controller to drive the telescopic parts around the fixed fence to extend synchronously, so as to add a fence outside the fixed fence for additional fixation.

9. A vehicle trunk article storage and retrieval system, used to implement a vehicle trunk article storage and retrieval method according to any one of claims 1 to 8, characterized in that: include: The camera, installed in the trunk, is responsible for capturing the user's hand image, capturing the real-time location of the item, and capturing the user's body movement trajectory when taking the item; The vehicle computer system uses the object detection model to identify the collected hand images, determine whether there is an object in the user's hand, and identify the shape and type of the object, and make a decision on the storage area of ​​the object; The cloud communicates with the vehicle computer system and is equipped with a prediction model to predict the movement trajectory of the limbs and obtain the storage area where the user needs to pick up the items; The car computer interface is used to display information about items stored in the trunk and to prevent forgetting reminders; Ambient lighting: Use lighting to indicate the storage area of ​​items in the trunk, so that objects can be stored in a classified manner; The trunk storage device includes multiple telescopic components, which are used to drive the multiple telescopic components to extend in the storage area according to the placement shape of the items to form a fixed fence to limit the current items; when there is no need to limit the position, the multiple telescopic components are driven to reset to keep the storage area flat.

10. The article storage and retrieval system for a vehicle trunk according to claim 9, characterized in that: The trunk storage device comprises a controller, a partition (1), a spring (2), a weight sensor (3), and a telescopic component, wherein the telescopic component is an automatic telescopic rod (4); The controller receives a signal from the vehicle system and synchronously controls a plurality of automatic telescopic rods (4) in a corresponding storage area to extend or retract; A partition (1), the shape of the partition (1) matches the shape of the trunk, and the partition (1) is provided with a plurality of holes (101) distributed in an array; Automatic telescopic rods (4), the number of which corresponds to the number of the holes (101) of the partition (1), are installed under the holes (101) of the partition (1) and can be freely raised and lowered relative to the holes (101); Springs (2) are distributed at the four corners of the bottom of the partition (1) and play the role of supporting and transmitting weight; The weight sensors (3), the number of which corresponds to the number of the springs (2), are installed on one side of the bottom of the springs (2) and transmit weight information to the vehicle system.

Images