A SYSTEM AND METHOD FOR CARGO MANAGEMENT IN A MOTOR VEHICLE

Abstract

Method for cargo management in a motor vehicle (12), wherein the method comprises: Identifying the motor vehicle (12); Collecting dimensional information from at least one object (28); Collecting internal dimensions of a volume within the motor vehicle (12); Comparing the dimensional information of the at least one object (28) with the internal dimensions of the volume; wherein collecting the internal dimensions of the volume within the motor vehicle further includes determining a number of passengers in the motor vehicle (12); and active adjustment of physical parameters of the volume based on the number of passengers and a configuration of moving components of a motor vehicle interior (12); and Providing feedback to a user, where the feedback to the user is one of: Yes, at least one object (28) will fit, or No, at least one object (28) will not fit.

Description

INTRODUCTION

[0001] The present disclosure relates to motor vehicles and, more particularly, to the management of motor vehicle loads.

[0002] Motor vehicles are frequently used to transport human, animal, and non-living cargo. In order for all of this cargo to fit in a particular motor vehicle, the user must determine the relative sizes of the cargo items and the cargo compartment(s) in which the cargo items will be carried. That is, the cargo items must fit within the cargo compartment of the motor vehicle for the cargo items to be transported in the motor vehicle. Users wishing to transport cargo items often attempt to fit the cargo items into the cargo compartment using a trial-and-error technique, which can be time-consuming and may cause damage to the cargo items, the cargo compartment, or both.To limit some of the potential for damage, some users may choose to physically measure the dimensions of the cargo compartment, including the cargo opening and the dimensions of the cargo items, and determine if the cargo items are smaller than the dimensions of the cargo compartment. Even if the user measures both the cargo compartment and the cargo items, complications can arise when transporting multiple items of cargo in the motor vehicle along with other people and / or pets.

[0003] US 2019 / 0 114 577 A1 describes the use of a series of sensors installed in a cargo container and on a vehicle to measure, monitor, and manage the cargo and the available cargo capacity in the container. A method for measuring the cargo capacity and monitoring the cargo in a cargo container may include reading a plurality of spatial sensors installed in the cargo container by a monitoring system of the cargo container. The plurality of spatial sensors may, for example, comprise one or more light detection and ranging (LiDAR) sensors. The interior of the cargo container may be mapped based on the readout of the plurality of spatial sensors, and the available cargo capacity within the cargo container may be determined based on the mapping of the interior of the cargo container.The determined available loading capacity within the freight container can be transmitted from the monitoring system to a cloud-based freight management system.

[0004] While current cargo management systems and procedures serve their purpose, there is a need for a new and improved system and procedure for automotive cargo management that reduces user effort and frustration while increasing the efficiency with which a user can pack one or more pieces of cargo into the cargo area of ​​a motor vehicle. DESCRIPTION

[0005] According to the invention, a method for cargo management in a motor vehicle comprises identifying the motor vehicle. The method further comprises collecting dimensional information from at least one object and collecting internal dimensions of a volume within the motor vehicle. The method further comprises comparing the dimensions of the at least one object with the internal dimensions of the volume and providing feedback to a user. The feedback is: yes, the at least one object will fit; or no, the at least one object will not fit.

[0006] Another aspect of the present disclosure includes identifying the motor vehicle, collecting motor vehicle owner information, and associating the motor vehicle with the user.

[0007] In another aspect of the present disclosure, assigning the motor vehicle to the user further includes utilizing a ridesharing application to access a ridesharing database having a plurality of reservable motor vehicles. Assigning the motor vehicle to the user further includes determining which of the reservable ridesharing vehicles has a volume capable of accommodating the one or more objects and offering the user a selection of available ridesharing vehicles having a volume capable of inserting the at least one object. Assigning the motor vehicle to the user further includes reserving a ridesharing vehicle based on the volume within the ridesharing vehicle and the dimensions of the one or more objects.

[0008] In another aspect of the present disclosure, providing feedback to a user also includes providing details about the placement of the at least one object within the volume if the feedback is yes.

[0009] In another aspect of the present disclosure, providing feedback also includes providing details about the placement of at least a portion of the at least one object within the volume if the feedback is no.

[0010] In another aspect of the present disclosure, collecting dimensional information of at least one object further comprises collecting dimensions of the at least one object from photo or video data of the one or more objects. The photo or video data is captured by a camera; and a three-dimensional model of the at least one object is created.

[0011] In another aspect of the present disclosure, collecting dimensional information of at least one object comprises comparing photo or video data of the at least one object with photo or video data of a plurality of objects in a database. The at least one object is compared to one of a plurality of objects in the database, and the dimensions of the at least one object are determined from the database.

[0012] In another aspect of the present disclosure, the method further comprises determining a current location of a user by: triangulating the user's current location with cell tower data; locating the user with a global positioning system; and preselecting a subset of the plurality of objects in the database based on the user's current location.

[0013] In another aspect of the present disclosure, collecting dimensional information of at least one object also includes reading coded information for the at least one object. The at least one object is identified based on the coded information. Measurements of the at least one object are then determined. The user is provided with an indication that the at least one object fits into the motor vehicle.

[0014] In another aspect of the present disclosure, comparing the dimensional information of the at least one object with the internal dimensions of the volume further includes generating all possible permutations of configurations of the at least one object. The permutations of configurations are compared with the internal dimensions of the volume; and the user is given instructions regarding the configuration of the at least one object within the volume.

[0015] According to the invention, collecting the interior dimensions of a volume within the motor vehicle comprises determining the number of passengers in the motor vehicle and actively adjusting physical parameters of the volume based on the number of passengers and a configuration of moving components inside the motor vehicle.

[0016] In another aspect of the present disclosure, a system for cargo management in a motor vehicle includes a camera, a controller that communicates with the camera, and a processor configured to execute the computer-executable program code. The computer-executable program code includes: a first computer-executable program code portion for identifying the motor vehicle, a second computer-executable program code portion for collecting dimensional information from at least one object, and a third computer-executable program code portion for collecting interior dimensions of a volume within the motor vehicle.The computer-executable program code further includes a fourth computer-executable program code portion for comparing the dimensional information of the at least one object with the internal dimensions of the volume, and a fifth computer-executable program code portion for providing feedback to a user. The feedback is one of: yes, the at least one object will fit; or no, the at least one object will not fit.

[0017] In another aspect of the present disclosure, the first computer-executable program code portion further includes a computer-executable program code portion for collecting motor vehicle ownership information. The first computer-executable program code portion further includes a computer-executable program code portion for associating the motor vehicle with the user.The computer-executable program code portion for assigning the motor vehicle to the user includes: a computer-executable program code portion for utilizing a ridesharing application to access a ridesharing database having a plurality of reservable motor vehicles; a computer-executable program code portion for determining which of the reservable ridesharing vehicles has a volume capable of accommodating the one or more objects; and a computer-executable program code portion for presenting the user with a selection of available ridesharing vehicles having a volume capable of inserting the at least one object.The first computer-executable program code portion further includes a computer-executable program code portion for selectively reserving a ride-sharing vehicle based on the volume within the ride-sharing vehicle and the dimensions of the one or more objects.

[0018] In another aspect of the present disclosure, the fifth computer-executable program code portion further comprises: a computer-executable program code portion for providing, to the user, details about the placement of the at least one object within the volume if the feedback is yes. The fifth computer-executable program code portion further comprises a computer-executable program code portion for providing, to the user, details about the placement of at least a portion of the at least one object within the volume if the feedback is no.

[0019] In another aspect of the present disclosure, the second computer-executable program code portion further comprises: a computer-executable program code portion for detecting dimensions of the at least one object from photo or video data of the one or more objects. The photo or video data is captured by a camera. The second computer-executable program code portion further includes a computer-executable program code portion that compares photo or video data of the at least one object with photo or video data of a plurality of objects in a database. A computer-executable program code portion associates the at least one object with one of the plurality of objects in the database. A computer-executable program code portion obtains dimensions of the at least one object from the database; and a computer-executable program code portion constructs a three-dimensional model of the at least one object.

[0020] In another aspect of the present disclosure, a system for cargo management in a motor vehicle further includes a computer-executable program code portion for determining a current location of a user by executing a computer-executable program code portion for triangulating the user's current location with cell tower data. The system executes a computer-executable program code portion that locates the user with a global positioning system and executes a computer-executable program code portion for preselecting a subset of the plurality of objects in the database based on the user's current location.

[0021] In another aspect of the present disclosure, the second computer-executable program code portion further includes: a computer-executable program code portion for reading encoded information for the at least one object; and a computer-executable program code portion for identifying the at least one object based on the encoded information. The second computer-executable program code portion further includes a computer-executable program code portion for obtaining measurements of the at least one object; and a computer-executable program code portion for indicating to a user that the at least one object fits within the motor vehicle.

[0022] In another aspect of the present disclosure, the fourth computer-executable program code portion further includes: a computer-executable program code portion for generating all possible permutations of configurations of the at least one object, and a computer-executable program code portion for comparing the permutations of configurations with the internal dimensions of the volume. The fourth computer-executable program code portion further includes a computer-executable program code portion for providing instructions to the user regarding a configuration of the at least one object within the volume.

[0023] In another aspect of the present disclosure, the third computer-executable program code portion further includes: a computer-executable program code portion for determining a number of passengers in the motor vehicle; and a computer-executable program code portion for actively adjusting physical parameters of the volume based on the number of passengers and a configuration of movable components of an interior of the motor vehicle.

[0024] In another aspect of the present disclosure, a method for cargo management in a motor vehicle includes collecting motor vehicle ownership information and associating the motor vehicle with the user based on the motor vehicle ownership information. The method further includes collecting dimensions of the at least one object from photographic data, video data, or coded information for the one or more objects. The photographic or video data is captured by a camera. The method further includes constructing a three-dimensional model of the at least one object and comparing the dimensional information of the at least one object to the interior dimensions of the volume.To compare the dimensional information with the interior dimensions, the method determines a number of passengers in the motor vehicle; and actively adjusts physical parameters of the volume based on the number of passengers and a configuration of movable components of an interior of the motor vehicle. The method further comprises generating all possible permutations of configurations of the at least one object within the volume and comparing the permutations of configurations with the interior dimensions of the volume and providing feedback to a user. The feedback is one of: yes, the at least one object will fit; or no, the at least one object will not fit.The method provides the user with detailed instructions for configuring the at least one object within the volume if the feedback is yes, and provides the user with detailed instructions for configuring at least a portion of the at least one object within the volume if the feedback is no.

[0025] Further areas of applicability will become apparent from the description provided herein. It is to be understood that the description and specific examples are for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. 1 is a schematic diagram of a system and method for cargo management in a motor vehicle according to an exemplary embodiment; Fig. 2 is a schematic representation of a user accessing a portion of the system and method for cargo management in a motor vehicle, according to an exemplary embodiment; Fig. Figure 3A is a perspective view of a part of the motor vehicle indicated by box 3A-D from Fig. 1 for use in the system and method for cargo management, according to an exemplary embodiment; Fig. Figure 3B is a perspective view of a part of the motor vehicle indicated by box 3A-D from Fig. 1 for use in the system and method for cargo management, according to an exemplary embodiment; Fig. Figure 3C is a perspective view of a part of the motor vehicle indicated by box 3A-D from Fig. 1 for use in the system and method for cargo management, according to an exemplary embodiment; Fig. 3D is a perspective view of a part of the motor vehicle designated by box 3A-D from Fig. 1 for use in the system and method for cargo management, according to an exemplary embodiment; Fig. 4 is a flowchart illustrating a method for cargo management in a motor vehicle using augmented reality imaging, according to an exemplary embodiment; Fig. 5 is a flowchart illustrating a second method for cargo management in a motor vehicle, according to another exemplary embodiment; and Fig. 6 is a flowchart illustrating a third method for cargo management in a ride-sharing motor vehicle, according to an exemplary embodiment. DETAILED DESCRIPTION

[0027] The following description is merely exemplary and is not intended to limit the present disclosure, application, or uses.

[0028] With reference to Fig. 1, a system 10 for cargo management in a motor vehicle 12 is shown. The system 10 includes one or more controllers 14. Each controller 14 is a non-generalized, electronic control device having a pre-programmed digital computer or processor 16, a memory or non-transitory computer-readable medium 18 used to store data such as control logic, software applications, instructions, computer code, data, lookup tables, etc., and a transceiver or input / output (I / O) ports 20. Computer-readable media includes any type of media accessible by a computer, such as read-only memory (ROM), random access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of storage.A "non-transitory" computer-readable medium 18 excludes wired, wireless, optical, or other communication connections that carry transient electrical or other signals. A non-transitory computer-readable medium 18 includes media on which data can be permanently stored and media on which data can be stored and later overwritten, such as a rewritable optical disk or an erasable storage device. Computer code includes any type of computer-executable program code or portion of program code, including source code, object code, and executable code. The processor 16 is configured to execute the code or instructions. When the processor 14 is a motor vehicle 12, the controller 14 may be a dedicated Wi-Fi controller or an engine control module, a transmission control module, a body control module, an infotainment control module, etc.The I / O ports 20 are configured to communicate wirelessly with remote computing devices such as tablet computers, mobile phones, home computers, and the like via IEEE 802.11x Wi-Fi protocols and / or via cellular networks and / or via Ethernet or other networked communication systems or protocols.

[0029] The controller 14 also includes one or more applications 22. An application 22 is a software program configured to perform a particular function or set of functions. The application 22 may include one or more computer programs, software components, instruction sets, procedures, functions, objects, classes, instances, related data, or a portion thereof adapted for implementation in suitable computer-readable program code. The applications 22 may be stored within the memory 18 or in additional or separate storage, including, but not limited to, the memory 18 within a mobile device 24, a cloud server or database 26, or the like. Examples of the applications 22 include audio or video streaming services, games, browsers, social media, augmented reality applications 22a, or the like.

[0030] With reference to Fig. 2 and further with reference to Fig. 1, a user of the motor vehicle 12 may wish to use the motor vehicle 12 to transport a plurality of objects 28. In one example, the user purchases one or more objects 28, such as a washing machine 30 or a television (TV) 32, from a store. To transport the washing machine 30, the user must determine whether the washing machine 30, television (TV) 32, or the like will fit into a cargo space 34 having a known volume 36 within the motor vehicle 12. In some examples, the user may wish to transport objects 28 that do not all fit within the cargo space 34 of the motor vehicle 12. To assist the user in determining whether the objects 28 will fit within the cargo space 34, the user accesses an application 22 that determines whether the objects 28 will fit.The application 22 may be accessed in a variety of ways, including, but not limited to: an app or application 22 installed on a user's mobile device 24, a software program on a tablet, desktop, or laptop computer, or on an infotainment system 38 within the motor vehicle 12. Once the user has accessed the application 22 and provided certain inputs, described in more detail below, the processor 16 executes computer-executable program code portions stored in the memory 18 of the controller 14. In one example, the computer-executable program code portions make a determination as to whether the objects 28 fit and notify and / or instruct the user as to whether the objects 28 will fit.It should be appreciated, however, that the computer-executable program code portions may include a variety of other functions without departing from the scope or intent of the present disclosure.

[0031] To determine if the objects 28 fit into a particular motor vehicle 12, the controller 14 first identifies the motor vehicle 12. Identification of the motor vehicle 12 can be achieved in a variety of ways. In one example, the controller 14 collects motor vehicle 12 ownership information. The ownership information is collected from at least one of the following: an electronic connection between a car key, key fob, cellular device, or the like, and an ignition or security control module within the motor vehicle 12. In some aspects, the electronic association between the car key, key fob, or cellular device is achieved via wireless communication between the car key, key fob, or cellular device. The wireless communication can be a variety of different types, such as near field communication (NFC), wireless protocols such as 802.1X, Bluetooth communication, or the like. In another example, the controller 14 collects information about the ownership of the motor vehicle 12 through known user biometric data, such as fingerprint, hand, or wrist print recognition, retinal scanning, facial recognition, or other user biometric data. The user or owner biometric data may be collected through a variety of different means, such as sensors or scanners mounted on or in the motor vehicle, or scanners on a user's or owner's mobile device 24, car keys or key fobs, or other known biometric scanning means. In another example, the user's biometric data is collected by a motor vehicle 12 dealer or motor vehicle 12 manufacturer and stored in a cloud-based computer system or database 26.The motor vehicle 12 then wirelessly accesses or retrieves the biometric information from the cloud-based computer system or database to determine whether the motor vehicle 12 is associated with a particular user or owner.

[0032] The controller 14 also executes a portion of computer-executable program code that collects dimensional information of the at least one object 28. The dimensional information is collected in at least one of several different ways. For example, the user is prompted by the controller 14 to collect or capture photographic data of the at least one object 28 using a camera 40 and an application 22 on the user's mobile device 24. In some aspects, the application 22 is an augmented reality application 22a. The augmented reality application 22a provides the user with a real-time view of the object 28 on the screen while the user captures the photographic data of the object 28.

[0033] The augmented reality application 22a overlays a variety of different gauges, points, lines, or the like over the real-time view of the object 28 on the screen. In an exemplary embodiment, the user is further prompted to capture images of the corners 41 of the at least one object 28. The gauges, points, lines, or the like assist the user in determining the positions of the corners 41, sides, or other such points of interest in the photographic data of the object 28. At least one position sensor, such as a gyroscopic sensor, accelerometer, or the like, detects the movement of the mobile device 24 while the user photographs or videos the at least one object 28.Data from the position sensor and data extracted from the images of the corners 41 of the at least one object 28 are fused to determine the positions of the corners 41 of the at least one object 28 and to construct a three-dimensional model of the at least one object 28. The three-dimensional model may be a wireframe model, a surface model, a solid model, any combination thereof, or any other such model of the three-dimensional shape of the at least one object 28.

[0034] In another example, the dimensions of the at least one object 28 are collected from a database of previously identified objects. Specifically, the controller 14 executes portions of program code that compare the photo or video data collected by the user to the photo or video data of a plurality of objects stored in the database of previously identified objects. The controller 14 executes computer-executable portions of program code that compare the photo or video data collected by the user to at least one object 28 in the database of previously identified objects. The database further includes the dimensions of each of the previously identified objects. The controller 14 then executes a portion of program code that obtains the dimensions of the at least one object 28 based on the object 28 to which the user-photographed object was matched in the database.

[0035] In some cases, dimensional information of the at least one object 28 is accessed from a database of previously identified objects. Specifically, the controller 14 reads encoded information about the at least one object and identifies the object within the database based on this encoded information. In several examples, the encoded information is one or more of the following: a barcode, a Quick Response (QR) code, an alphanumeric code or sequence, a data matrix code, a Universal Product Code (UPC), an International Article Number (EAN) code, a PDF417 code, a nested code, or the like.The encoded information is associated with specific objects 28 within the database, and upon reading the encoded information, the controller 14 determines which of the plurality of previously identified objects in the database corresponds to the object 28 photographed by the user. The dimensions or measurements of the at least one object 28 are then retrieved from the database of previously identified objects, and, as in previous examples, a three-dimensional model is either retrieved from the database of previously identified objects or generated by software executed by the controller 14.

[0036] In one embodiment, the system 10 refines a subset of the database of objects 28 by determining a current location of the user. The system 10 determines the user's current location through a variety of different means, such as: triangulating the current location with cell tower data, using a global positioning system (GPS), and / or using gyroscope and / or accelerometer sensors within the user's mobile device 24. In one example, the controller 14 collects location data from the user's mobile device 24 or the user's motor vehicle 12. In one example, the location data of a particular motor vehicle 12 indicates that the motor vehicle 12 is in close proximity to an appliance store that sells household appliances such as dishwashers, refrigerators, washing machines 30, dryers, televisions 32, and the like.The controller 14 uses the position of the motor vehicle 12 relative to the appliance store and determines that the user is likely to shop at the appliance store.

[0037] The controller 14 accesses the database of objects 28 and preselects or otherwise generates a subset of the database of objects 28 based on the user's current location. The subset of the database of objects 28 contains only items sold by a particular appliance store or appliance store chain. Once the user enters the appliance store, the controller 14 uses the dimensions of an object selected by the user, e.g., a dishwasher, to determine whether or not the object 28 will fit within the volume 36 of the cargo hold 34. By refining or otherwise generating the subset of the database of objects 28 when the user selects an object 28, such as the aforementioned dishwasher, the dimensions of that object 28 are easily accessible.That is, because the search parameters have been predefined by refining or otherwise selecting the subset of objects 28 in the database, searching for objects 28 within the subset of objects 28 is faster than a similar search in the full database.

[0038] While the location of motor vehicle 12 has been described above as being near an appliance store, it should be understood that other locations and types of stores can easily be substituted without departing from the scope or intent of the present disclosure. Furthermore, several databases have been described herein. In each case, it should be understood that the databases may be the entirety of the Internet, the World Wide Web, a public or private cloud storage database 26, a locally stored database, or any other electronically accessible database of this type.In one example, the database of previously identified objects 28 is a locally stored or publicly or privately maintained cloud server 26-hosted data repository of objects 28 previously identified by the user or by other users whose mobile devices 24 or motor vehicles 12 previously transmitted data to the cloud server 26. The previously identified objects 28 may have been identified through prior use of the system 10 or through an upload from the manufacturer of an object 28 or the like.

[0039] With reference now to the Fig. 3A - 3D and with further reference to the Fig. 1 and Fig. 2, the cargo compartments 34 or portions thereof of multiple motor vehicles 12 are shown. In order for the at least one object 28 to be transported within the motor vehicle 12, the dimensions of the at least one object 28 must be smaller than those of the volume 36 of the cargo compartment 34 of the motor vehicle 12. Depending on the type of motor vehicle 12, the interior dimensions of the volume 36 can vary considerably. For example, the volume 36 of the cargo compartment 34 of a truck or lorry is substantially larger than the volume 36 of the cargo compartment 34 in a typical sedan, sport utility vehicle (SUV), or the like. Since the volume 36 varies depending on the application, the interior dimensions of the volume 36 also vary. Accordingly, the controller 14 detects the interior dimensions of the volume 36 of the cargo compartment 34 within the motor vehicle 12.Specifically, the controller 14 retrieves a three-dimensional model of the cargo compartment 34 of the motor vehicle 12 from the cloud server 26 or other such remote data storage. The actual interior dimensions (as indicated by the example measurement lines A, B, C, D, E, F, G, H, I, and J in . Fig. 3A) of the cargo compartment 34 may differ from the dimensions retrieved from the cloud server 26. The interiors of the motor vehicle 12 may be equipped with adjustable panels 42. The adjustable panels 42 may vary considerably depending on the type of motor vehicle 12. In some examples, the adjustable panels 42 include movable seats 44, such as sliding and / or folding front seats 46, folding rear seats 48, folding armrests 50, folding headrests 51, a load floor 52 with an adjustable load floor angle, or the like. Each of the adjustable panels 42 may be manipulated or moved within the motor vehicle 12, resulting in a variety of configurations of the cargo compartment 34. With each different configuration of the adjustable panels 42, the movable seats 44 or the like, the volume 36 and / or the shape of the volume 36 of the cargo space 34 changes.In one example, a set of folding rear seats 48 is folded forward 54 relative to the motor vehicle 12 to form a cargo compartment 34 with a flat load floor 52.

[0040] The controller 14 determines which of the various configurations of the cargo compartment 34 is currently in use. In particular, the controller 14 collects position information for each of the adjustable panels 42, the movable seats 44, and other movable components of the cargo compartment 34 from a variety of optical sensors, position sensors, weight sensors, or the like. In some examples, the controller 14 also determines possible configurations of the cargo compartment 34 based on a number of passengers (not specifically shown) in the motor vehicle 12. The controller 14 then actively adjusts the physical parameters of the volume 36 based on the number of passengers and the configuration of the movable components of the interior of the motor vehicle 12.

[0041] Once the controller 14 has acquired the internal dimensions of the volume 36 of the cargo compartment 34, the controller 14 executes a section of computer-executable program code that compares the dimensional information of the at least one object 28 to the internal dimensions of the volume 36. The internal dimensions of the volume 36 may be irregular. For example, the cargo compartment 34 of a cargo-carrying vehicle type motor vehicle 12 may have a shape approximating a rectangular prism. However, the rectangular, prism-shaped cargo compartment 34 may include a variety of different intrusions or protrusions, such as: one or more rear wheel wells, a protrusion at least partially enclosing a battery pack or fuel tank, a door hinge, a window sill, or the like (not specifically shown).Accordingly, the internal dimensions of the volume 36 include the dimensions of the individual intrusions or protrusions within the respective motor vehicle 12.

[0042] With reference to Fig. 4 and with further reference to Fig. 1-3D, a method 100 for using the augmented reality application 22a is shown in more detail. The method 100 begins at block 102. At block 104, the augmented reality application 22a is accessed via the user's mobile device 24 or other interface. The augmented reality application 22a is hosted or stored in the memory 18 of the user's mobile device 24, the infotainment system 38 in the motor vehicle 12, the user's computer, or a remote computing platform such as a remote server. The user then uses a camera 40 on the mobile device 24 to capture a real-time image of the object or objects 28 to be transported within the cargo compartment 34 at block 106.

[0043] In block 108, the augmented reality application 22a performs video tracking and / or registration of the object 28 within the image. Specifically, the augmented reality application 22a aligns or corrects the orientation of the object(s) 28 within the real-time image to more accurately predict or calculate the dimensions of the object 28. The video tracking and / or registration is performed via computer vision algorithms or the like. In block 110, the augmented reality application 22a uses one or more positioning sensors, such as a global positioning system (GPS) and / or gyroscope and / or accelerometer sensors, in the user's mobile device 24 to calculate the dimensions of the object(s) 28 to be transported.

[0044] In block 112, the augmented reality application 22a accesses a cloud server or database 26 to retrieve a virtual component 114 for a three-dimensional representation. In one example, the virtual component 114 consists of a virtual ruler or other measuring device on the screen. In block 116, the augmented reality application 22a combines the video tracking and / or registration data, the position sensor data, and the image itself to generate the three-dimensional representation of the object or objects 28. The virtual component 114 is then overlaid on the three-dimensional representation of the object or objects 28. More specifically, the orientation of the virtual component 114 relative to the object or objects 28 is corrected to the corresponding real-world object 28 in the visual scene captured in the real-time image.In some examples, the augmented reality application 22a uses artificial intelligence algorithms, computer learning, or the like to enable the system 10 to understand the meaning or presence of objects 28 within the real-time image to further enhance the registration and / or video tracking of the objects 28.

[0045] In block 118, the augmented reality application 22a generates an augmented reality image including the three-dimensional representation and the virtual component 114. In block 120, the augmented reality image with the three-dimensional representation and the virtual component 114 is displayed on the user's mobile device 24 or other such display. At block 122, the method 100 ends. The method 100 may be repeated for each additional object 28 imaged by the user.

[0046] With reference now to Fig. 5 and further reference to the Fig. 1-4, a method 200 for cargo management in a motor vehicle 12 is presented in more detail. The method 200 begins at block 202, where the user accesses the application 22 stored in the memory 18 of the controller 14. At block 204, the application 22 identifies the object 28 to be placed in the motor vehicle 12. The identification procedures have been and will be described in more detail herein. At block 206, the application 22 uses a camera 40 on the user's mobile device 24 to capture an image of the object 28. In some examples, the image of the object 28 may be selected from an online store when the user selects the object 28 for purchase. Accordingly, the image may also be retrieved from an online database. If a camera 40 is used to capture the image of the object 28, the method 200 proceeds to block 208.At block 208, a software application on the mobile device 24 identifies the object 28 and obtains the dimensions of the object 28 as described above. The method 200 then proceeds to block 210, where the application 22 creates a three-dimensional model of the object 28. At block 212, the application 22 manipulates the three-dimensional model of the object 28 to determine whether the object 28 fits within the cargo compartment 34 of the motor vehicle 12. To determine the various configurations of the object 28 within the cargo compartment 34, the application 22 accesses a cloud server 26 or other such remote data storage at block 214. The cloud server 26 hosts the cargo compartment 34, volume 36, and dimensional information for any number of motor vehicles 12.In block 216, the application 22 uses the dimensional information of the object 28 and the information of the cargo compartment 34 volume 36 from the cloud server 26 to generate all possible permutations of configurations of the object 28 within the volume 36 of the cargo compartment 34. In cases where the user intends to transport a plurality of objects 28 within the cargo compartment 34, the application 22 generates all possible permutations of the plurality of objects 28 within the cargo compartment 34. The permutations include all possible orientations of each individual object of the plurality of objects 28 within the volume 36, as well as all possible configurations of the plurality of objects 28 relative to one another and in combination with one another within the volume 36.

[0047] At block 218, the application 22 uses the measurements of the body opening 56 to determine whether the object 28 or objects 28 will fit through one or more of the body openings 56 of the motor vehicle 12 and provides feedback to the user. Depending on the type of motor vehicle 12, the types and sizes of the body openings 56 can vary considerably. In some examples, the body openings 56 include door openings 58, tailgate or trunk openings 60, window openings 62, sunroofs 64, truck beds 66, or the like. The application 22 then provides feedback to the user that the at least one object 28 will or will not fit into the cargo area 34 of the motor vehicle 12. Specifically, at block 220, the application 22 generates a negative message if the object or objects 28 do not fit through the body openings 56 of the motor vehicle 12.The negative notification is displayed on the user's mobile device 24 or other such display through which the application 22 was accessed. In one example, the negative notification is a visually and / or audibly displayed "X," a "NO," a "Do Not Enter" or "STOP" sign, or other such negative indicator. However, if the object or objects 28 fit through the body openings 56, the method 200 proceeds to block 222.

[0048] In a first step, the application 22 informs the user and provides feedback as to whether or not the at least one object 28 fits into the cargo space 34. More specifically, the application 22 determines in field 222 whether the object(s) 28 fit within the volume 36 of the cargo space 34. The application 22 compares the dimensions of each of the objects 28 with the dimensions of the volume 36 of the cargo space 34. If the object(s) 28 fit within the volume 36 of the cargo space 34, the application 22 generates a positive notification in block 224. The notification is displayed on the user's mobile device 24 or other display through which the system 10 was accessed. In one example, the positive notification is a visually and / or audibly represented check mark, a "YES," a plus sign, an "ENTER," or other such positive indicator.

[0049] However, if the object or objects 28 do not fit within the volume 36 of the cargo compartment 34 at block 222, the method 200 proceeds to block 226 where the application 22 compares all possible permutations of the object or objects 28 with the internal dimensions of the volume 36 and provides the user with feedback and / or instructions for at least one configuration of one or more of the objects 28 within the volume 36.

[0050] Regardless of whether the at least one object 28 fits or not, the application 22 provides a second step of feedback, wherein the application 22 provides details regarding the placement of the at least one object within the volume 36 if the feedback is positive or "yes." Likewise, the application 22 provides details regarding the placement of at least a portion of the at least one object 28 within the volume 36 if the feedback is negative or "no." If the object 28 does not fit within the cargo compartment 34, the method 200 proceeds to block 226, where the application 22 executes computer-executable program code portions that try all combinations of reconfigurations of the interior of the motor vehicle 12, including revising the positions of known objects 28 and passengers within the motor vehicle 12.That is, the application 22 attempts to fit the object 28 into the cargo compartment 34 of the motor vehicle 12 by reconfiguring various movable components such as adjustable panels 42, movable seats 44, and the like within the cargo compartment 34. Additionally, the application 22 revises the positions of other known objects and passengers within the motor vehicle 12. If the feedback is negative or "no" and the user intends to transport a plurality of objects 28 within the cargo compartment 34, the application 22 provides the user with at least one configuration in which a subset of a plurality of objects 28 fits within the volume 36 of the cargo compartment 34 and displays a positive notification regarding the subset of objects 28.

[0051] In block 228, the application 22 determines once again whether the object or objects 28 fit within the cargo compartment 34. If the object or objects 28 still do not fit within the cargo compartment 34, the application 22 generates a negative notification as described above in block 230. However, if the object or objects 28 do fit within the cargo compartment 34, the method 200 proceeds to block 232, where the application 22 generates a positive notification as described above.

[0052] Following the positive notification in one of blocks 224 or 232, the method 200 proceeds to block 234. In block 234, the application 22 provides the user with feedback regarding how the object or objects 28 can be loaded into the cargo compartment 34. More specifically, the application 22 presents the user with a series of user-selectable configuration options in which at least some of a plurality of objects 28 fit within the volume 36. That is, if at least one of the objects 28 does not fit within the volume 36, the application 22 categorizes each object 28 and, based on that categorization, determines where the object 28 can be properly transported. For example, flat-panel televisions and other such electronic devices typically do not respond well to water and thermal stress and have weight and / or orientation limitations.Accordingly, the application 22 accesses local weather information and utilizes the object categorization and weather information to determine suitable locations for each of the objects 28 to be transported. In the example of a flat-panel television, the television must be stored within the cargo compartment 34 of the motor vehicle 12 in a vertical orientation without being stacked beneath other objects 28 and should not protrude from the motor vehicle 12 if the weather information indicates that rain, snow, or extreme temperatures are likely.

[0053] In some examples, the application 22 presents the user with a plurality of combinations of objects 28 determined to fit within the cargo compartment 34. The user can then select and / or experiment with each of a plurality of different combinations of objects 28 to see which objects 28 fit within the cargo compartment 34 for each combination. Using the plurality of different combinations, the user selects which of the plurality of objects 28 they wish to transport with the motor vehicle 12.

[0054] In block 236, the application 22 cyclically executes the procedures from blocks 202-234 until all objects 28 that the user wishes to transport have been fitted into the cargo space 34. The user can also use the application 22 to select a combination of objects 28 in which at least some of the objects 28 are transported on an external support of the motor vehicle 12, such as a roof rack, a trailer, or the like. Since the application 22 also identifies the various objects 28 to be transported in the cargo space 34, the application 22 provides a visualization of a sequence of steps that results in all selected objects 28 being accommodated in the cargo space 34 of the motor vehicle 12.In some examples, the sequence of steps is displayed on the user's mobile device 24 or other screen as a stop-motion or animated motion sequence in which each of the selected objects 28 is to be moved. The stop-motion or animated motion sequence shows the user how each of the objects 28 should be moved through a body opening 56 of the motor vehicle 12 into a stowed position within the cargo compartment 34, thereby showing the user how the objects 28 can be most efficiently packed within the cargo compartment 34. That is, with each iteration or repetition, the method 200 optimizes the orientation and / or placement of all objects 28 to be stowed with each newly added object 28.

[0055] The method 200 then proceeds from block 236 to block 238, where the method 200 ends. Similarly, starting from either block 220 or 230, if the object or objects 28 do not fit within the volume 36 of the cargo hold 34, the method 200 proceeds to block 238, where the method 200 ends. For subsequent identification and / or transport of the object 28, the application 22 may be accessed in substantially the same manner as described above, beginning again at block 202.

[0056] With reference now to Fig. 6 and further reference to Fig.1-5, a method 300 for cargo management in a rideshare motor vehicle 12 is shown. Some users of motor vehicles 12 do not have regular access to motor vehicles 12 except through public or private rental vehicles such as buses, limousines, taxis, and motor vehicles 12 operated in conjunction with rideshare companies. In order to transport objects 28 in a rideshare motor vehicle 12, it is helpful for the user to know that the objects 28 will fit in a particular reservable motor vehicle 12. The method 300 begins at block 302, where the user accesses the rideshare application 22b. The rideshare application 22b may be accessed in a variety of ways, including, but not limited to, an application 22 installed in the memory 18 of the user's personal mobile device 24, a personal computer, or the like.Likewise, the ride-sharing application 22b may be accessed via the infotainment system 38 in a motor vehicle 12 or a similar device. In block 304, the ride-sharing application 22b prompts the user to take an image of the objects 28 the user wishes to transport using a camera 40 on the user's mobile device 24, as described above. In block 306, the method 300 uses an augmented reality application 22a to obtain the dimensions of the objects 28 to be transported. In block 308, the controller 14 generates a three-dimensional model of the objects 28. In block 310, the user accesses a ride-sharing database 68 containing a plurality of reservable motor vehicles 12 using the ride-sharing application 22b.The rideshare database 68 is a data repository managed and / or hosted by a rideshare company and containing a plurality of reservable rideshare vehicles. At block 312, the rideshare application 22b, in conjunction with the augmented reality application 22a, attempts all combinations of reconfigurations of the adjustable panels 42 and other movable components of the interiors in each of the nearby reservable rideshare motor vehicles 12. At block 314, the rideshare application 22b and the augmented reality application 22a determine which of the reservable rideshare motor vehicles 12 has a volume 36 with interior dimensions capable of accommodating the object or objects 28.The controller 14 then offers the user a selection of available, reservable motor vehicles 12 that have a volume 36 within which the one or more objects 28 can fit. In block 316, the user selects or reserves one of the available, reservable motor vehicles 12 based on the volume 36 within the motor vehicle 12 and the dimensions of the one or more objects 28. In block 318, the ridesharing application 22b indicates that a successful reservation has been made by displaying a positive notification on the user's mobile device 24 or other interface through which the user accessed the ridesharing application 22b and the augmented reality application 22a.In one example, the positive notification is a visually and / or audibly displayed check mark, a "YES," a plus sign, an "ENTER," or other such positive indicator. At block 320, the method 300 ends. For each new trip the user wishes to take, additional ride reservations may be made for transporting the objects 28. For each of these new trips, the method 300 begins at block 302 and proceeds to block 320 as described above.

[0057] A cargo management system and method of the present disclosure provides several advantages. These include reducing user effort and frustration during packing of a motor vehicle 12 while increasing the efficiency with which the user can pack one or more cargo items or objects 28 into the cargo compartment 34 of the motor vehicle 12.

[0058] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the spirit of the present disclosure are intended to be within the scope of the present disclosure. Such variations should not be considered a departure from the spirit and scope of the present disclosure.

Claims

[1] A method for cargo management in a motor vehicle (12), the method comprising: Identifying the motor vehicle (12); Collecting dimensional information from at least one object (28); Collecting internal dimensions of a volume within the motor vehicle (12); Comparing the dimensional information of the at least one object (28) with the internal dimensions of the volume; wherein collecting the internal dimensions of the volume within the motor vehicle further comprises determining a number of passengers in the motor vehicle (12); and actively adjusting physical parameters of the volume based on the number of passengers and a configuration of movable components of an interior of the motor vehicle (12); and Providing feedback to a user, where the feedback to the user is one of: yes, at least one object (28) will fit, or no, at least one object (28) will not fit. [2] The method of claim 1, wherein identifying the motor vehicle (12) further comprises: Collecting motor vehicle ownership information; and Assigning the motor vehicle (12) to the user. [3] The method of claim 2, wherein associating the motor vehicle (12) with the user further comprises: Using a ride-sharing application (22b) to access a ride-sharing database (68) having a plurality of reservable motor vehicles (12); Determining which of the reservable motor vehicles (12) has a volume that can accommodate the at least one object (28); Offering to the user a selection of available reservable motor vehicles (12) having a volume suitable for the insertion of the at least one object (28); and Reserving a reservable motor vehicle (12) based on the volume within the reservable motor vehicle (12) and the dimensional information of the at least one object (28). [4] The method of claim 1, wherein providing feedback to a user further comprises: Providing, to the user, details about the placement of the at least one object (28) within the volume if the feedback to the user is yes; and Providing, to the user, details about the placement of at least a portion of the at least one object (28) within the volume if the feedback to the user is no. [5] The method of claim 1, wherein collecting dimensional information from at least one object (28) further comprises: Detecting the dimensions of the at least one object (28) from photo or video data of the at least one object (28), wherein the photo or video data is captured by a camera; and Constructing a three-dimensional model of the at least one object (28). [6] The method of claim 1, wherein collecting dimensional information from at least one object (28) further comprises: Comparing photo or video data of the at least one object (28) with photo or video data of a plurality of objects (28) in a database; Matching the at least one object (28) with one of the plurality of objects (28) in the database; and Obtaining dimensions of the at least one object (28) from the database. [7] The method of claim 6, further comprising: Determining a current location of the user by: Triangulating the user's current location with cell tower data; Locating the user using a global positioning system; and Preselecting a subset of the plurality of objects (28) in the database based on the user's current location. [8] The method of claim 1, wherein collecting dimensional information from at least one object further comprises: Reading coded information for the at least one object (28); Identifying the at least one object (28) based on the coded information; Obtaining measurements of the at least one object (28); and Indicating to the user that the at least one object (28) will fit into the motor vehicle (12). [9] The method of claim 1, wherein comparing the dimensional information of the at least one object (28) with the internal dimensions of the volume further comprises: generating all possible permutations of configurations of the at least one object (28); Comparing the permutations of configurations with the internal dimensions of the volume; and Providing, to the user, instructions of a configuration of the at least one object (28) within the volume.

Images