Cargo space management system, vehicle and method for loading and unloading objects
By using the object recognition and positioning mechanism of the movable camera system and control device in the cargo space management system, the problems of complexity and low efficiency of the existing system are solved, more efficient object recognition and position determination are achieved, and transportation is improved efficiency.
Patent Information
- Application Number
- CN202410553761.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-08
- Filing Date
- 2024-05-07
- Publication Date
- 2024-11-08
AI Technical Summary
The existing cargo space management system is complex and time-consuming, requiring multiple rigidly installed cameras to scan cargo space, resulting in high system complexity, high workload and low efficiency.
A movable camera system is adopted, and a control device combining an object recognition mechanism and a positioning mechanism is used to provide object identity and position information through the human-machine interface, reducing the number of cameras required and improving system efficiency.
It significantly improves the efficiency and convenience of the cargo space management system, reduces the need for manual identification and positioning of objects, reduces the complexity of the system, and improves the operation efficiency of the loading and unloading process.
Smart Images

Figure CN118906991A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a cargo space management system for a cargo space, a vehicle, and a method for loading and unloading objects. Background Art
[0002] Drivers of commercial vehicles, especially delivery vehicles, have a wide variety of tasks that they have to perform repeatedly. For example, a delivery vehicle driver has to load parcels into the cargo space, re-sort these parcels several times a day, identify the correct parcel for the next delivery location and remove the correct parcel from the cargo space. Up to now, since these repetitive steps were largely performed manually, they led to inefficiencies in the logistics chain, which was unnecessarily time-consuming and unproductive.
[0003] Semi-automatic cargo space management systems based on image data acquired by rigidly mounted cameras are known from US 2021 / 0319582 A1, GB 2553039 A, JP 2020142891 A and US 10,148,918 B1. Because of this, the cargo space is scanned only to an inadequate degree or a large number of cameras are required, which makes the corresponding systems complex and involves a lot of work.
[0004] Therefore, there is a need to eliminate or at least reduce the disadvantages of known systems. In particular, there is a need to create a cargo space management system that has fewer individual components than known systems and that can reduce the amount of work involved. Summary of the invention
[0005] The object is achieved by the independent claims provided. Advantageous embodiments are given in the dependent claims and in the following description, each of which can represent various aspects of the disclosure individually or in (sub)combination. Individual aspects are explained with respect to the device, other aspects with respect to the method. However, the various aspects are mutually applicable as appropriate.
[0006] According to one aspect, a cargo space management system for a cargo space is provided. The cargo space management system includes at least one camera system, a control device having an object recognition mechanism and a positioning mechanism, and at least one human-machine interface.
[0007] The camera system has at least a plurality of cameras, and at least one camera is configured to obtain depth information of an object in the cargo space.
[0008] The control device is connected with at least the camera system and the human-machine interface.
[0009] The object recognition mechanism of the control device is configured to determine the identity of the object within the cargo space based on at least one property of the object.
[0010] A positioning mechanism of the control device is configured to determine a position of the object within the cargo space.
[0011] The control device is configured to determine an object identifier of the specific object and output the object identifier to the human-machine interface. The object identifier includes at least the identity and location of the specific object.
[0012] At least one camera of the camera system has a mounting device, so that the respective camera can be positioned movably in the cargo space.
[0013] A cargo space management system is thus created which is configured on the one hand to reliably determine the identity of objects and their position within the cargo space and on the other hand to provide a user (e.g. a delivery vehicle driver) with information items about the objects or specific objects on a human-machine interface. This significantly increases the convenience for the driver, who then does not need to manually identify the objects or determine their position independently. This also improves the operating efficiency of the loading or unloading process and improves the overall use of the cargo space.
[0014] The complexity of the cargo space management system is also reduced compared to known systems. In the prior art, rigidly mounted cameras are used, which means that the basic system requires a plurality of different cameras in order to adequately cover the cargo space. In the present case, the number of required cameras can advantageously be reduced. Since at least one camera can be movably positioned, the action space of at least this camera is enlarged. A plurality of different cameras is no longer required to adequately cover the cargo space. Fewer individual components are therefore required. This reduces the amount of work involved and increases the efficiency of the cargo space management system.
[0015] Preferably, the cameras of the camera system can have different capabilities. For example, a first camera can be configured to acquire RGB data, CYMK data or data from another color table, i.e. image data based on different contrasts, color differences or brightness differences. On the other hand, at least one camera is configured to acquire depth information. This means that the camera is configured to indicate the distance of an object from the camera in the output image data or corresponding data. The acquired image data are transmitted from the cameras of the camera system to the control device in each case.
[0016] In the present case, a cargo space may be understood as any suitable space, preferably an enclosed space, suitable for receiving and storing objects. For example, the cargo space may be the cargo space (or storage space) of a delivery vehicle. Alternatively, the cargo space may also be a storage space in a building or a higher-level object, such as a transport container. Other designs of the cargo space are also conceivable.
[0017] In the present case, an object is to be understood as meaning in particular a package, a cargo item or another object which is arranged in the cargo space.
[0018] The object recognition mechanism of the control device recognizes objects in the cargo space based on at least one property of the respective object. For this purpose, the object recognition mechanism uses image data provided by the camera system. For this purpose, image data provided by a camera that can also acquire depth information or image data provided by another type of camera can be used.
[0019] For example, the object recognition mechanism can determine the identity of the object based on its external dimensions. Alternatively, the identity can also be determined based on, for example, a barcode or similar serial markings such as a company logo or other imprints provided on the outer surface of the object. Other properties that can be used to identify an object are shape, color or other geometric features that characterize the object.
[0020] The positioning mechanism of the control device determines the position of the object in the cargo space relative to the relative coordinate system of the cargo space. For this purpose, the positioning mechanism uses at least image data from the camera system. In particular, at least image data from a camera configured to acquire depth information is used. In this way, the position of the object in the cargo space can be determined not only in two dimensions, but actually in three dimensions.
[0021] Alternatively or additionally, a positioning mechanism of the control device determines the position of an object in the cargo space relative to other objects in the cargo space. This means that instead of or in addition to the absolute position of the object in the cargo space (relative to the coordinate system of the cargo space), the relative position of the object relative to other objects can be determined. Here, when referring to the position of an object, this position can include the absolute coordinates and relative coordinates of the object.
[0022] Optionally, the cargo space management system has at least one track device, on which at least one camera can be movably mounted. The track device advantageously defines a specific track along which the camera can be moved. This simplifies the analysis of image data acquired by the camera mounted on the track device.
[0023] In some embodiments, the track arrangement may have a straight trajectory. Thus, the coordinate system determined by the track arrangement becomes particularly simple.
[0024] Alternatively, the rail arrangement can also have a curved path, for example, in order to optimally adapt to the volume of the cargo space.
[0025] Preferably, at least one track arrangement may extend substantially between a first outer wall of the cargo space and a second outer wall of the cargo space opposite the first outer wall. The track arrangement is then configured to ensure that the camera can be moved at least along a transverse length of the cargo space.
[0026] Preferably, the cargo space management system has at least one substantially horizontally arranged track set and at least one substantially vertically arranged track set. This enables the entire cargo space to be scanned by only two track sets and one camera mounted on each track set.
[0027] It is obvious that further rail arrangements can also be provided in order to adapt the cargo space management system to the cargo space as required.
[0028] Optionally, the drive unit of the mounting device assigned to the camera has an electric motor, by which the camera can be moved along the track device. Therefore, the camera can also be automatically moved along the track device by the electric motor.
[0029] Preferably, the control device is configured to implement closed-loop control of the movement of the camera along the track device, for example by means of a drive unit assigned to the mounting device of the camera. This makes it possible to move the camera in an automated manner relative to the track device, for example in order to scan different areas of the cargo space.
[0030] In some embodiments, the object recognition mechanism of the control device has a machine learning algorithm. Based on the algorithm, objects can be recognized. Based on the image data of the camera system, the algorithm is able to distinguish various properties of the object. In particular, these include object properties that have already been explained. The algorithm can be trained accordingly to distinguish and recognize objects based on the properties. The training of the algorithm can also be implemented during operation. A neural network can be used as the basis for the algorithm within the object recognition mechanism of the control device.
[0031] Preferably, the object recognition mechanism of the control device is configured to be at least partially executable as a cloud server mechanism. The control device can be connected to the cloud server. This means that the control device has at least one communication device, via which the control device can communicate with the cloud server. In particular, the basic algorithm of the object recognition mechanism can be executable on the cloud server. The control device then transmits the corresponding image data from the camera system to the cloud server, where the corresponding image data are analyzed in order to identify specific objects in the cargo space. This makes it possible to provide the object recognition mechanism with data acquired by different cargo space management systems from different control devices. Since the amount of data available to the object recognition mechanism is thus greatly increased, the decision process on which the object recognition mechanism is based is improved. In particular, the algorithm can be further trained by machine learning during operation, thereby increasing the confidence level of the individual recognition of objects.
[0032] Optionally, the locating mechanism of the control device is configured to divide the cargo space into a plurality of sections and identify in which particular section the object is located. The control device is configured to assign object identifiers to the particular sections. This allows for an intuitive subdivision of the cargo space, which can be used to communicate the location of objects within the cargo space in a self-explanatory manner. This makes it easier for the driver to find a particular object within the cargo space, thereby improving operational efficiency.
[0033] Alternatively, the part may be associated with an area of a shelf system arranged in the cargo space, such as a shelf compartment. The individual parts may also have an identifier, such as a number that may be assigned to the object identifier. The object identifier including the corresponding identifier for the part of the particular object may then be output via the human-machine interface.
[0034] Preferably, at least one mounting device is implemented in such a way that a camera positioned by means of the at least one mounting device can be rotated. This further increases the variability of the camera arrangement, as a result of which the cargo space can be scanned more effectively by means of the camera. The drive unit assigned to the mounting device can also be configured to pivot the camera relative to the mounting device.
[0035] In some embodiments, the positioning mechanism of the control device is further configured to generate a virtual space model of the cargo space, which can be output through the human-machine interface, in particular, activated by the control device. This enables the driver to more intuitively position objects in the cargo space based on the space model.
[0036] Alternatively, a virtual space model of the cargo space can also be predetermined. The model can then be stored in or used by the positioning mechanism. For example, different vehicles can have similar cargo spaces. Of course, in this case, only one virtual space model of the cargo space needs to be created, which is known to the respective control device or its positioning mechanism. For example, the model can be stored on a storage device connected to the control device, or on a cloud server.
[0037] Alternatively, the camera system can also be used to first create a virtual model of the cargo space in order to then determine the position of the object relative to the virtual model. The spatial model can then be provided to the positioning mechanism.
[0038] Preferably, the human-machine interface includes at least one of an indicator light, a laser pen, a display screen or AR glasses (augmented reality glasses).
[0039] For example, indicator lights can be arranged in the cargo space and optionally assigned to different areas, such as parts of the cargo space. If the driver wishes to identify a specific object at the loading position, its position can be represented, for example, simply by activating the corresponding indicator light.
[0040] In an alternative, for example, a movable laser pointer may be used, and if the driver selects an object to be identified, the control device illuminates the movable laser pointer onto the object to be identified.
[0041] For example, the display screen may show a virtual space model of the cargo space, with objects highlighted within the virtual space model so that the driver can easily find the objects.
[0042] If AR glasses are used, the virtual space model can also be used in a corresponding manner.
[0043] The control device preferably has at least one data processing device.
[0044] Optionally, the control device preferably includes at least one communication interface to allow communication with a server or other device.
[0045] Preferably, at least one memory device is associated with the control device.
[0046] The cargo space management system offers a variety of application possibilities. For example, the cargo space management system can be used during loading or unloading of the cargo space.
[0047] According to another aspect, a method for loading an object into a cargo space by using the cargo space management system as described above is also provided. The method comprises at least the following steps:
[0048] Position specific objects in the cargo space.
[0049] The object recognition mechanism and positioning mechanism of the control device are used to determine the identity and location of specific objects.
[0050] The object identifier of the specific object is determined by the control device. The object identifier at least includes the determined identity and the determined position of the specific object.
[0051] Output the object identifier on the operator panel.
[0052] or:
[0053] The object identifier is stored in a memory device assigned to the control device.
[0054] or:
[0055] The object identifier is output on a communication interface of the control device.
[0056] According to another aspect, a method for unloading an object from a cargo space by using the cargo space management system as described above is also provided. The method comprises the following steps:
[0057] Notification of the specific object to be unloaded and its object identifier is received by the control device.
[0058] The camera system scans the designated location of the specific object to be unloaded in the cargo space, which is determined by the object identifier.
[0059] If a specific object to be unloaded at a designated location is identified based on the object recognition mechanism and positioning mechanism of the control device, an object identifier is output by the control device via the human-machine interface.
[0060] or:
[0061] The entire cargo space is scanned until the specific object to be unloaded at another current position is identified based on the object recognition mechanism and positioning mechanism of the control device. Then the control device outputs an updated object identifier via the human-machine interface. The updated object identifier includes the current position of the specific object to be unloaded.
[0062] or:
[0063] Output error information.
[0064] During the loading process, the cargo space management system can assist in automatically creating a data set of object identifiers that indicate which specific object is located at which specific location within the cargo space. The object identifiers can then be output on a human-machine interface.
[0065] Alternatively or additionally, the object identifier can also be used to create a database, which can be stored, for example, in a memory device assigned to the control device.
[0066] Alternatively or additionally, the object identifier determined in this way can also be provided to further devices or applications by the control device via the communication interface of the control device. For example, the object identifier determined in this way can then be used by a delivery application.
[0067] During further use, the object identifier can then be used as required in order to also achieve advantageous effects in the unloading of the cargo space, in particular in order to enable unloading in a shorter time.
[0068] For this purpose, the control device receives notification about which specific object is to be unloaded at a specific loading position. In principle, the control device only needs to be informed of the identity of the object in this case, but not its specified position. Once the control device knows the identity of the specific object, the control device can then search for known object identifiers of the specific object, for example in a database.
[0069] Alternatively, the notification to the control device may also include the specified location of the object to be unloaded.
[0070] Once the object identifier of the object to be unloaded is found in the database by the control device, the control device basically knows where the object should be located in the cargo space (specified position). This is then checked by the cargo space management system with the help of a positioning mechanism and an object recognition mechanism.
[0071] If the object cannot be found at the specified location, the cargo management system is used to search for the specific object in the entire cargo space. Both the object recognition mechanism and the positioning mechanism of the control device are used for this purpose. If the specific object is recognized and found at a different location within the cargo space, an updated object identifier is determined. The updated object identifier includes the actual location of the specific object. The updated object identifier can then be output by the control device. This makes it possible to detect a change in the position of the object compared to the location specified in the original object identifier and to update the object identifier accordingly.
[0072] If the object cannot be found at the location of the original object identifier or elsewhere in the cargo space, an error message is output to inform the user that the object could not be found.
[0073] The basis of the method is a load management system as described above, which makes it possible to increase the operating efficiency in the loading and unloading of the cargo space.
[0074] The method can be further developed by various optional steps.
[0075] For example, objects may be scanned in advance, for example before loading the cargo space in a distribution center, in order to determine the identity of the individual objects. In this case, the object identifiers may have been determined as described above. Alternatively, for example, a machine learning algorithm may also be used to assess the identity of the objects. In this regard, object identifiers including at least one identity of the individual objects may have been created before loading the cargo space. These object identifiers may be provided to the control device, for example, via a communication interface of the control device.
[0076] Alternatively, a camera system can also be used before loading the cargo space in order to scan the cargo space. For example, a coordinate system can then be determined, which coordinate system accordingly describes the position in the cargo space. Alternatively, a virtual spatial model of the cargo space can be created. Both the coordinate system and the model can also be made known to the control device.
[0077] Obviously, the method for loading objects can also be further developed in such a way that a plurality of objects are processed according to the method. Then, based on the cargo space management system, at least the steps of scanning and identifying the localized object in the cargo space are repeatedly performed. Accordingly, a specific object identifier is output.
[0078] According to another aspect, there is also provided a vehicle having a cargo space and a cargo space management system as described above.
[0079] Here, a vehicle is understood to be a device configured to transport items, goods or people between different destinations. Examples of vehicles include land vehicles such as motor vehicles, electric vehicles, hybrid vehicles, etc., rail vehicles, aircraft or ships. Preferably, in the present context, a vehicle can be considered to be a road vehicle such as a car, truck, bus, etc.
[0080] All features explained in relation to each aspect may be combined alone or in (sub-)combination with other aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0081] The present disclosure and further advantageous embodiments and developments thereof are described and explained more fully below with reference to the examples represented in the accompanying drawings, in which:
[0082] - Figure 1 A simplified schematic diagram showing a vehicle having a cargo space management system according to one embodiment;
[0083] - Figure 2 A simplified schematic diagram showing a method for loading an object in a vehicle according to one embodiment; and
[0084] - Figure 3 A simplified schematic diagram is shown of a method for unloading objects from a vehicle according to one embodiment. DETAILED DESCRIPTION
[0085] The following detailed description together with the accompanying drawings (in which the same elements are represented by the same numerals) is intended as a description of various embodiments of the disclosed subject matter, and is not intended to represent only embodiments. Any embodiment described in this disclosure is only as an example or illustration, and should not be interpreted as being superior to or advantageous over other embodiments. The illustrative examples contained herein are not intended to be exhaustive and do not limit the claimed subject matter to the exact form disclosed. Various modifications of the described embodiments will be apparent to those skilled in the art, and the general principles defined herein can be applied to other embodiments and applications without departing from the spirit and scope of the described embodiments. Therefore, the described embodiments are not limited to the embodiments shown, but have as wide a range of applications as possible that conforms to the principles and features disclosed herein.
[0086] Any features disclosed below with respect to the exemplary embodiments and / or the figures may be combined alone or in any subcombination with the features of the various aspects of the present disclosure including the features of the preferred embodiments, as long as the resulting combination of features makes sense to a person skilled in the art.
[0087] For purposes of this disclosure, for example, the expression "at least one of A, B, and C" means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C), including all other possible combinations when more than three elements are listed. In other words, the term "at least one of A and B" generally means "A and / or B", i.e., only "A", only "B", or "A and B".
[0088] Figure 1 A simplified schematic diagram of a vehicle 12 having a cargo space management system 10 is shown according to one embodiment.
[0089] The cargo space management system 10 is disposed within a cargo space 14 of a vehicle 12 .
[0090] The camera system 16 comprises a plurality of cameras 18, in which case all cameras 18 in the camera system 16 can be positioned in a movable manner. For this purpose, the cameras 18 have mounting devices 20, by which the cameras 18 can be moved along different rail devices 22.
[0091] Furthermore, the cargo space management system 10 comprises a control device 24 having at least one data processing device. Furthermore, the control device 24 comprises an object recognition mechanism and a positioning mechanism.
[0092] The control device 24 is connected to the camera 18 of the camera system 16 .
[0093] The control device 24 also includes a communication device. Through the communication device, the control device 24 is connected to a cloud server 28. A part of the object recognition mechanism and a part of the positioning mechanism, such as a machine learning algorithm, can be stored away from the control device 24, for example in the cloud server 28.
[0094] Furthermore, the control device 24 is connected to a human-machine interface 30 .
[0095] According to this embodiment, the cargo space 14 includes a shelving system 32 by which various objects 34 are positioned within the cargo space 14 .
[0096] The cameras 18 can be positioned in particular by means of the rail arrangement 22 in such a way that they can scan the entire cargo space 14. For this purpose, a first rail arrangement 22 is arranged horizontally and a second rail arrangement 22 is arranged vertically.
[0097] The at least one camera 18 of the camera system 16 is configured to acquire depth information within the cargo space 14 , ie, the distance of the object 34 from the camera 18 .
[0098] The image data acquired by the camera 18 is transmitted to the control device 24. Within the control device 24, or with the aid of an external device such as a cloud server 28 or a storage device 26, the control device 24 is configured to implement an object recognition mechanism and a positioning mechanism.
[0099] Figure 2 A simplified schematic diagram of a method 36 for loading an object in a vehicle 12 is shown according to one embodiment. Optional steps are indicated by dashed lines. The optional steps may be part of the method 36 alone or in combination.
[0100] After start 38 , object 34 is positioned within cargo space 14 in step 40 .
[0101] In step 42 , object 34 is recognized by control device 24 based on the data acquired by camera system 16 on the basis of an object recognition mechanism and a localization mechanism, and the position of object 34 is determined.
[0102] Then, in step 44, an object identifier of the object 34 is determined by the control device 24. The object identifier comprises both the identity of the object 34 and its position.
[0103] In step 46, the identifier thus determined is output by the control device 24. For example, the object identifier can be output on the human-machine interface 30. Alternatively or additionally, the object identifier can also be stored in a storage device 26 assigned to the control device 24. In this way, a database containing determined object identifiers can be created or updated. Alternatively or additionally, the determined object identifier can also be provided by the control device 24 by means of a communication device to other devices or applications, such as a delivery application. For example, the delivery application can then define a driving route for the vehicle 12 so that the object 34 can be delivered to the unloading location as efficiently as possible.
[0104] Finally, method 36 ends at step 48 .
[0105] Optionally, in step 50, the object 34 may also be scanned in advance. This means that the identity of the object 34, for example, outside the cargo space management system 10, may have been determined in step 50. For example, the advance scanning of the object 34 may be implemented in a distribution center. Since the machine learning algorithm may also be stored in the cloud server 28, the algorithm may also be used in the advance scanning in step 52. The advance scanning may correspond to the function of an object recognition mechanism, but is not performed by the control device 24.
[0106] As a result, an object identifier may have been determined in optional step 54. The object identifier is determined in this case in the same way as described above. The object identifier of optional step 54 comprises at least the identity of the object 34, but not the position of the object 34. The object identifier thus determined may have been transmitted to the control device 24 before the vehicle 12 was loaded. For example, it can thus be checked whether the object identifier determined by the control device 24 regarding the identity of the actually loaded object 34 matches the object identifier transmitted to the control device 24 by the external device before the vehicle 12 was loaded. In other words, it can be determined whether the expected object 34 was actually loaded into the vehicle 12.
[0107] In optional step 56 , the cargo space 14 of the vehicle 12 can be scanned. As a result, for example, a virtual spatial model of the cargo space 14 can be created. The cargo space 14 can also be divided into a plurality of sections, which the control device 24 takes into account when evaluating the object identifier of the object 34 .
[0108] In an optional step 58, a query is carried out as to whether a further object 34 has already been loaded into the cargo space 14. If this is the case, the steps 42, 44, 46 are repeated accordingly for each further object 34.
[0109] Figure 3 A simplified schematic diagram of a method 60 for unloading an object from a vehicle 12 is shown according to one embodiment. Optional steps are indicated by dashed lines. Optional steps may be part of the method 60 alone or in combination.
[0110] After the start 62, according to this embodiment, the control device 24 receives a notification about the next object 34 to be unloaded in a step 64. In particular, the notification includes the identity of the object 34 to be unloaded.
[0111] Then, in step 66, the control device 24 reads the designated position of the object 34 to be unloaded. The designated position corresponds to the last determined position of the object 34. For this purpose, the control device 24 searches the storage device 26 for an object identifier having an identity corresponding to the identity of the object 34 to be unloaded.
[0112] Alternatively or additionally, the storage device 26 may also be in communication with a cloud server 28 , where object identifiers from previously implemented methods 36 for object loading may be stored.
[0113] Alternatively or additionally, the notification in step 64 may also include a corresponding object identifier, including the specified position of the object 34 to be unloaded. In this case, the storage device 26 only reads the position of the respective object 34 specified therein from the object identifier.
[0114] In step 68, the designated position of the object 34 to be unloaded in the cargo space 14 is scanned by the camera system 16. The control device 24 uses the object recognition mechanism and the positioning mechanism to check whether the object 34 to be unloaded can be identified and is located at the designated position that has been read.
[0115] If this is the case, a corresponding object identifier is output by control device 24 via human-machine interface 30 in step 70 .
[0116] The method 60 then ends in step 72 .
[0117] Alternatively, the method 60 can be developed in such a way that if the object 34 to be unloaded cannot be identified or is not located at the specified position, the entire cargo space 14 is scanned in step 74. The control device 24 determines the position and identity of all objects 34 arranged in the cargo space 14 until the object 34 to be unloaded is located.
[0118] If it is determined in step 76 that the object 34 to be unloaded has been positioned, step 70 is implemented.
[0119] If it is determined in step 76 that the object 34 to be unloaded cannot be positioned in the entire cargo space 14, an error message is output by the control device 24 in optional step 78. Optionally, in this case, an error message can be output by the control device 24 via the human-machine interface 30.
[0120] The cargo space management system 10 can therefore improve the efficiency with which the vehicle 12 is loaded and unloaded with objects 34 .
[0121] Certain embodiments disclosed herein, particularly the control device 24, the camera system 16, the cloud server 28, and the human-machine interface 30, all use circuits (e.g., one or more circuits) to implement standards, protocols, methods, or techniques disclosed herein to operably connect two or more components, generate information items, process information items, analyze information items, generate signals, encode / decode signals, convert signals, transmit and / or receive signals, control other devices, etc. Any type of circuit can be used.
[0122] In one embodiment, a circuit system such as the control device 24 includes, among other aspects, one or more data processing devices, such as a processor (e.g., a microprocessor), a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a system-on-chip (SoC), etc., or any combination thereof, and may include discrete digital or analog circuit elements or electronic components, or a combination thereof. In one embodiment, the circuit includes a hardware circuit implementation (e.g., an analog circuit implementation, a digital circuit implementation, etc., and a combination thereof).
[0123] In one embodiment, the circuitry includes a combination of circuitry and a computer program product having software or firmware instructions stored on one or more computer readable memories that function to cause the device to perform one or more of the protocols, methods, or techniques described herein. In one embodiment, the circuitry includes circuitry such as a microprocessor or a portion of a microprocessor that requires software, firmware, etc. to operate. In one embodiment, the circuitry includes one or more processors or portions thereof and associated software, firmware, hardware, etc.
[0124] In this application, quantities and numbers may be cited. Unless explicitly stated, such quantities and numbers are not to be considered limiting, but rather as examples of possible quantities or numbers in the context of this application. In this context, the term "plurality" may also be used in this application to reference quantities or numbers. In this context, the term "plurality" means any number greater than one, for example, two, three, four, five, etc. The terms "approximately," "approximately," "close to," etc., mean plus or minus 5% of a specified value.
[0125] Although the disclosure has been illustrated and described with respect to one or more embodiments, equivalent alterations and modifications will occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings.
Claims
1. A cargo space management system (10) for a cargo space (14), the cargo space management system (10) comprising at least one camera system (16), a control device (24) having an object recognition mechanism and a positioning mechanism, and at least one human-machine interface (30), The camera system (16) has at least a plurality of cameras (18), and at least one camera (18) is configured to obtain depth information of an object (34) in the cargo space (14). The control device (24) is connected to at least the camera system (16) and the human-machine interface (30). The object recognition mechanism of the control device (24) is configured to determine the identity of the object (34) within the cargo space (14) based on at least one object property, The positioning mechanism of the control device (24) is configured to determine the position of the object (34) within the cargo space (24), The control device (24) is configured to determine an object identifier of a specific object (34) and output the object identifier to the human-machine interface (30), wherein the object identifier includes at least the identity and the location of the specific object (34). And the at least one camera (18) of the camera system (16) has a mounting device (20) so that the respective camera (18) can be positioned in the cargo space (14) in a movable manner.
2. The cargo space management system (10) according to claim 1, characterized in that: The cargo space management system (10) has at least one track device (22), and the at least one camera (18) is movably mounted on the at least one track device (22).
3. The cargo space management system (10) according to claim 2, characterized in that: The cargo space management system (10) has at least one substantially horizontally disposed track arrangement (22) and at least one substantially vertically disposed track arrangement (22).
4. The cargo space management system (10) according to any one of the preceding claims, characterized in that: The object recognition mechanism of the control device (24) has a machine learning algorithm, based on which the identity of the object (34) can be determined.
5. The cargo space management system (10) according to any one of the preceding claims, characterized in that: The object identification mechanism of the control device (24) is configured to be at least partially executable as a cloud server mechanism, and the control device is connectable to a cloud server (28).
6. The cargo space management system (10) according to any one of the preceding claims, characterized in that: The positioning mechanism of the control device (24) is configured to divide the cargo space (14) into a plurality of sections and determine in which particular section the object (34) is positioned, and the control device (24) is configured to assign the object identifier to the particular section.
7. The cargo space management system (10) according to any one of the preceding claims, characterized in that: The at least one mounting device (20) is implemented in such a way that the camera (18) positioned by the at least one mounting device (20) is rotatable.
8. A vehicle (12) having a cargo space management system (10) and a cargo space (14) according to any one of the preceding claims.
9. A method for loading objects into a cargo space (14) by means of a cargo space management system (10) according to any one of claims 1 to 7, the method comprising the following steps: - positioning a specific object (34) in the cargo space (14), - determining the identity of the specific object (34) based on the object recognition mechanism and based on The positioning mechanism of the control device (24) determines the position of the specific object (34), - determining an object identifier of the specific object (34) by means of the control device (24), The object identifier includes at least the identity of the specific object (34) and the location, and - outputting the object identifier to the human-machine interface (30), or - storing the object identifier in a memory device (26) assigned to the control device (24), or - outputting the object identification on the communication interface of the control device (24) symbol.
10. A method for unloading an object from a cargo space (14) by means of a cargo space management system (10) according to any one of claims 1 to 7, the method comprising the following steps: - receiving, by means of the control device (24), a notification regarding a specific object (34) to be unloaded and its object identifier, - scanning the designated position of the specific object (34) to be unloaded in the cargo space (14) by means of the camera system (16), which position is determined by means of the object identifier, - if the object recognition mechanism based on the control device (24) recognizes the specific object (34) to be unloaded at the designated location, the object identifier is output by the control device (24) via the human-machine interface (30), or - scanning the entire cargo space (14) until the specific object (34) to be unloaded is identified at another current position based on the object recognition mechanism and the positioning mechanism of the control device (24), and outputting an updated object identifier through the control device (24) via the human-machine interface (30), wherein the updated object identifier includes the current position of the specific object (34) to be unloaded, or - Output error information.
