Method for implementation by a device of a vehicle, computer program, device and vehicle

Abstract

Exemplary embodiments of the present invention provide a method for implementation by a vehicle device. The method comprises obtaining interior data indicative of the vehicle's interior and identifying an object within the vehicle's interior. The object is identified based on the interior data. Furthermore, the method comprises comparing the identified object with a predefined object. If the identified object matches the predefined object, the method further comprises generating notification data to inform a user about the identified object in the vehicle and transmitting the notification data to the user's terminal device via a Bluetooth Low Energy communication channel.

Description

[0001] Exemplary embodiments of the present invention relate to a method for implementation by a device of a vehicle, a computer program, a device and a vehicle, in particular but not exclusively to a concept for sending notification data to inform a user about a specific object in a vehicle.

[0002] When using a vehicle, a user might place an item inside, such as a device in a charging cradle or a laptop in the trunk. Before leaving the vehicle, for example, after switching off the engine, the user can be notified about the device in the charging cradle. This can remind the user to take their device with them. However, this method is limited to devices in the vehicle's charging cradle. Furthermore, the user might simply want to perform an action outside the vehicle without intending to leave it. Therefore, notifying the user after switching off the engine could lead to an unwanted message.

[0003] There is therefore a need to provide an improved concept for informing a user about a specific object in the vehicle. The method, the device, the computer program, and the vehicle itself, according to the independent claims, address this need.

[0004] Examples of implementations are based on the core idea that information about a specific object in the vehicle can be made available. This allows a vehicle user, for example, to be informed about an object left behind in the vehicle. The information can be transmitted, in particular, using a frequency band that is used for a digital key according to the CCC (Car Connectivity Consortium), such as Digital Key Release 3 v1.1.

[0005] Exemplary embodiments relate to a method for implementation by a vehicle device. The method comprises obtaining interior data indicative of the vehicle's interior and identifying an object within the vehicle's interior. The object is identified based on the interior data. Furthermore, the method includes comparing the identified object with a predefined object. If the identified object matches the predefined object, the method further includes generating notification data to inform a user about the identified object in the vehicle and sending the notification data to the user's terminal device via a Bluetooth Low Energy communication channel.By sending notification data via the Bluetooth Low Energy communication channel, a vehicle user can be informed about an object in the vehicle within a frequency range typically used for digital keys. This allows the user to be notified about an object, such as a forgotten item, via a Bluetooth Low Energy communication channel used within the CCC (Chaos Computer Club). For example, in addition to receiving a notification about the vehicle being locked, the user can also receive a notification about the object inside the vehicle. This improves user information. The Bluetooth Low Energy communication channel belongs to the 2.4 GHz ISM (Industrial, Scientific, Medical) band, which ranges from 2.400 GHz to 2.4835 GHz.

[0006] In one embodiment, the method can further include obtaining object data for comparison with the specified object. The object data is indicative of the predefined object. By obtaining the object data, a user can define objects of interest to them. That is, the user can provide information about the predefined object. This allows the user to personalize the method. In particular, user-specific object recognition can be achieved. This can improve the user experience.

[0007] In one embodiment, the method can further include receiving a trigger event. The sending of the notification data can be triggered by this event. Receiving a trigger event can prevent false-positive notifications. For example, a user might briefly leave a vehicle without intending to park it. In this case, information about the object in the vehicle could be unintentionally transmitted. The trigger event can prevent such an unwanted notification.

[0008] In one embodiment, the method can further include obtaining user data indicative of a vehicle user. The object data can be indicative of a user-specific, predefined object. The comparison of the specific object can be user-specific, based on the user data. By obtaining the user data, a check can be performed for an individualized object specific to a current vehicle user. This means that a notification about a user-specific, predefined object in the vehicle can only be sent in the case of a specific vehicle user. This prevents false-positive notifications for the wrong user.

[0009] In one embodiment, interior data can be received from a camera and / or an ultra-wideband sensor in the vehicle. This allows for the identification of an object inside the vehicle using sensors already present in the vehicle.

[0010] In one embodiment, the object data can be indicative of a relevant area of ​​the vehicle's interior for the object inside. Notification data is only generated if the specific object is in that relevant area. For example, a handbag might be placed on a rear seat. In this case, the handbag might be easily visible from the outside, potentially increasing the risk of theft. Accordingly, a notification about the handbag on the rear seat could be sent. Alternatively, if the handbag is in the trunk, it might be less visible from the outside, and sending a notification about the handbag might not be necessary. This can improve the user experience.

[0011] In one embodiment, the notification data can be indicative of the object located inside the vehicle. This allows a user to be informed about the object located inside the vehicle.

[0012] Exemplary embodiments also include a computer program for carrying out one of the methods described herein, if the computer program runs on a computer, a processor, or a programmable hardware component.

[0013] Another embodiment is a device for notifying the presence of an object in a vehicle. The device comprises an interface for communication with another device (e.g., an interior camera, an ultra-wideband sensor) and a data processing circuit configured to perform at least one of the methods described herein. Further embodiments include a vehicle equipped with a device as described herein.

[0014] Examples of implementation are explained in more detail below with reference to the accompanying figures. These show: Fig. Figure 1 shows a schematic representation of a method for implementation by a device of a vehicle; and Fig. Figure 2 shows a block diagram of an embodiment of a device for controlling a diagnostic session of a vehicle.

[0015] Several embodiments are now described in more detail with reference to the accompanying drawings, in which some of these embodiments are illustrated. For the sake of clarity, the thickness dimensions of lines, layers, and / or regions may be exaggerated in the figures.

[0016] Fig. Figure 1 shows a schematic representation of a method 100 for implementation by a vehicle device. The method 100 comprises obtaining interior data 110 indicative of the vehicle's interior. The interior data can be obtained by receiving. For example, the interior data can be received from an interior camera or an ultra-wideband sensor. Optionally or alternatively, the interior data can be obtained by determining. For example, the vehicle device can include an interior camera and acquire sensor data using the interior camera. Based on the acquired sensor data, the device can determine an image of the vehicle's interior.

[0017] The interior of a vehicle refers to the area within the vehicle that is accessible to a user. The interior typically includes a passenger compartment designed for transporting a user and a storage area, such as a trunk, not designed for transporting a user. Interior data can be, for example, an image of the interior. Optionally or alternatively, interior data can simply allow the identification of an object within the interior. For example, interior data could be data from an ultra-wideband sensor that allows the identification of a living being inside the vehicle. That is, interior data can include an image of the interior and / or simply information about an object within the interior.

[0018] Furthermore, the procedure includes the identification of an object within the vehicle's interior. The object is identified based on interior data. This identification can be achieved through object recognition, object classification, and / or point segmentation (for example, using data from an ultra-wideband sensor or a LiDAR sensor, Light Detection and Ranging). Object recognition utilizes image processing algorithms, such as object segmentation, pattern recognition, or machine learning. Object classification involves classifying the identified object after detection to determine its type.

[0019] Furthermore, the method comprises 100 comparisons of the identified object with a predefined object. By comparing the identified object with the predefined object, the device can determine whether the identified object is of interest to the vehicle's user. The predefined object can be of interest to the user. For example, the user may have an interest in not leaving the object in the vehicle. The object could be an inanimate object, such as a handbag or laptop, or a living being, such as a dog or a small child. The predefined object may be specified, in particular, by guidelines for vehicle use in a specific region. For example, it may be prohibited to leave a small child in a vehicle.Optionally or alternatively, the predefined object can be defined by a user, as described below. In this case, the user can customize it. Comparison 130 can be performed by comparing it to a specific object, e.g., a specific predefined bag, and / or to an object class, for example, a general handbag or smartphone.

[0020] If the object matches the predefined object, the procedure further includes generating notification data to inform a user about the specific object in the vehicle. That is, if an object of interest to the user is located in the vehicle, notification data can be generated to inform the user. This allows the user to be informed about the object located in the vehicle.

[0021] Furthermore, Method 100 involves sending notification data via a Bluetooth Low Energy communication channel to the user's device. By sending this notification data, the vehicle's user can be informed about an object located in the vehicle. This improves the user experience and, in particular, prevents the object from being accidentally left behind. Method 100 thus allows the user to be notified if an object of interest has been left in the vehicle. For example, the user can receive a notification if a small child, a pet, and / or a valuable item (such as a wallet or laptop) is inside the vehicle.

[0022] The notification data is sent via a Bluetooth Low Energy communication channel, which is also used for communication with a digital key. This allows the user to be informed about an object in the vehicle via a Bluetooth Low Energy communication channel used within the framework of the CCC (Channel Computing Center). The Bluetooth Low Energy communication channel belongs to the 2.4 GHz ISM (Industrial, Scientific, Medical) band, which ranges from 2.400 GHz to 2.4835 GHz. This means that the notification data is sent via a Bluetooth Low Energy communication channel that is also used for exchanging data for the digital key. Accordingly, Method 100 can utilize at least one Bluetooth Low Energy communication channel of the CCC for communication between the vehicle device and the user's terminal device. There are 40 communication channels in the 2.4 GHz ISM band.The width of a communication channel is typically 2 MHz. Communication channels are distributed across the entire 2.4 GHz band to minimize interference and optimize performance. For the CCC standard, which defines the use of Bluetooth Low Energy for digital keys, the exact frequency can vary depending on the specific requirements and regulations in different regions. Notification data can therefore be sent over at least one of the 40 Bluetooth Low Energy communication channels. For example, individual process steps of Procedure 100 can be implemented in the CCC standard. Specifically, sending notification data can be integrated into Passthrough IP data transmission. That is, the notification data can be embedded within an existing message during Passthrough IP communication.Alternatively, the notification data can be implemented in another existing communication or sent separately from existing messages.

[0023] In one embodiment, the method 100 can further include obtaining object data indicative of the predefined object for comparison with the specific object. The object data can be obtained by reading it from memory. For example, the object data can be read from the device's memory. Optionally or alternatively, the object data can be received. For example, a user can select the predefined objects using their user device. The user device can then generate the object data and send it to the device. A predefined object can therefore be, in particular, an object that has been previously defined as being of interest to the user. Obtaining the object data can, in particular, enable the customization of the method 100 for a user. For example, a user can define predefined objects with their smartphone that are used for comparison with the specific object.This allows a user to define a specific object of interest, thereby improving the user experience. Optionally, or as an alternative to user-defined objects, the object data can be indicative of a predefined object that is legally relevant. For example, in some regions it may be prohibited to leave a small child or a pet in a vehicle. The predefined object can then correspond to the legal requirements for that region. In this case, the object data can be read from storage.

[0024] In one embodiment, the method 100 can further include receiving a trigger event. The sending of the notification data can be triggered by the trigger event. The trigger event can improve the sending of the notification data. In particular, the trigger event can prevent the erroneous sending of the notification data. For example, a user may only want to leave a vehicle briefly without turning it off. In this case, sending the notification data can be avoided. This prevents the user from being unnecessarily informed.

[0025] The trigger event could be, for example, locking the vehicle or the user moving away from the vehicle to a distance greater than a certain threshold. In other words, the trigger event could indicate, in particular, the driver's intention to park the vehicle. Accordingly, the notification data can only be sent if the driver's intention to park the vehicle has been determined. This prevents false-positive notifications.

[0026] Receiving the trigger event can be done by receiving it, for example, from a user device. For instance, the user device can send a locking command to the vehicle, for example, to the device. Optionally or alternatively, the trigger event can be received by determining it. For example, the device can determine the user's distance from the vehicle. If the user's distance to the vehicle exceeds a threshold, the vehicle can be locked. The locking of the vehicle by the device can serve as a trigger event for sending notification data. In this case, the trigger event can be determined by the device.

[0027] In one embodiment, the method 100 can further include obtaining user data indicative of a user of the vehicle. The object data can be indicative of a user-specific, predefined object. The comparison of the specified object can be user-specific and based on the user data. The user data can be obtained by receiving it, for example, from a user's terminal device. For instance, the user's terminal device can send a specific identifier for the user to the device. Optionally or alternatively, the user data can be obtained by determining it. For instance, the device can determine the user's identity based on information about a digital key to be used to operate the vehicle. The user data enables a user-specific comparison between the specified object and the predefined object.This allows the process to be adapted to a user, especially to predefined objects for that user. This can improve the user experience.

[0028] In one embodiment, interior data can be received from a camera and / or an ultra-wideband sensor in the vehicle. This allows for the identification of the object inside the vehicle using sensors already present in the vehicle. This simplifies the implementation of Method 100.

[0029] In one embodiment, the object data can be indicative of a relevant area of ​​the vehicle's interior for the object inside. Notification data is only generated if the specific object is located in this relevant area. The vehicle's interior can include visible and non-visible areas. For example, leaving a valuable item in a visible area, such as the passenger compartment, can increase the risk of theft and / or damage to the vehicle. Accordingly, the visible area of ​​the vehicle can be designated as the relevant area of ​​the interior for the valuable object. In this case, notification data is generated when the valuable object is located in the visible area of ​​the interior. This allows notifications about the specific object to be tailored to the current usage scenario.For example, the valuable object might be in the trunk, an area that is not visible. This area could be considered irrelevant. In this case, therefore, no notification data can be sent, even though an object of interest remains inside the vehicle.

[0030] In one embodiment, the notification data can be indicative of the object located inside the vehicle. This means the user can be informed about the specific object inside the vehicle via the notification data. This allows the user to assess whether the object can remain in the vehicle or not. For example, the vehicle's user interface can display information about the object located inside. This enables the user to decide, in a specific situation, whether to take action regarding the object, such as removing it from the vehicle or moving it within the vehicle.

[0031] The user terminal can generally be any device capable of wireless communication. Specifically, the user terminal can be a mobile device, such as one suitable for being carried by a user. The user terminal can be, for example, a User Terminal (UT) or User Equipment (UE) as defined by the respective communication standards used for mobile communication. The user terminal can be, for instance, a mobile phone such as a smartphone, or another type of mobile communication device such as a smartwatch, laptop, tablet computer, autonomous augmented reality glasses, etc. The user terminal can, in particular, store a digital key. That is, the user terminal can enable the use of the vehicle.

[0032] Further details and aspects are mentioned in connection with the exemplary embodiments described below. The in Fig. 1 The embodiment shown may include one or more optional additional features corresponding to one or more aspects related to the proposed concept or one or more embodiments described below (e.g. Fig. 2) were mentioned.

[0033] Fig. Figure 2 shows a block diagram of an embodiment of a device 30 for notification of an object located in a vehicle 40. The device 30 comprises an interface 32 for communication with another device (for example, a user terminal, an interior camera, an ultra-wideband sensor). The device 30 further comprises a data processing circuit 34 configured to carry out at least one of the methods described herein, for example, the method which relates to Fig. 1 is described for the device. Further embodiments include a vehicle 40 with a device 30.

[0034] The in Fig. The interface 32 shown in Figure 2 can, for example, correspond to one or more inputs and / or one or more outputs for receiving and / or transmitting information, such as digital bit values ​​based on a code, within a module, between modules, or between modules of different entities. The interface 32 can, for example, be configured to communicate with other network components via a (radio) network or a local area network.

[0035] In exemplary embodiments, the data processing circuit 34 can correspond to any controller or processor, or to a programmable hardware component. For example, the data processing circuit 34 can also be implemented as software programmed for a corresponding hardware component. In this respect, the data processing circuit 34 can be implemented as programmable hardware with appropriately adapted software. Any processor, such as digital signal processors (DSPs), can be used. These exemplary embodiments are not limited to a specific type of processor. Any processor, or even multiple processors, are conceivable for implementing the data processing circuit 34.

[0036] As in Fig. As shown in Figure 2, the interface 32 can be coupled to the respective data processing circuit 34 of the device 30. In examples, the device 30 can be implemented by one or more processing units, one or more processing devices, or any means of processing, such as a processor, a computer, or a programmable hardware component that can be operated with appropriately adapted software. Likewise, the described functions of the data processing circuit 34 can also be implemented in software, which is then executed on one or more programmable hardware components. Such hardware components can be a general-purpose processor, a digital signal processor (DSP), a microcontroller, etc.The data processing circuit 34 can be able to control the interface 32, so that any data transmission that takes place via the interface 32 and / or any interaction in which the interface 32 may be involved can be controlled by the data processing circuit 34.

[0037] In one embodiment, the device 30 may comprise a memory and at least one data processing circuit 34 which is functionally coupled to the memory and configured to perform one of the methods described above.

[0038] In examples, interface 32 can correspond to any means of receiving, receiving, transmitting, or providing analog or digital signals or information, such as any connector, contact, pin, register, input terminal, output terminal, conductor, track, etc., that enables the provision or receipt of a signal or information. Interface 32 can be wireless or wired and can be configured to communicate with other internal or external components, such as sending or receiving signals or information.

[0039] In at least some embodiments, the vehicle 40 can correspond, for example, to a land vehicle, a watercraft, an aircraft, a rail vehicle, a road vehicle, a car, a bus, a motorcycle, an all-terrain vehicle, a motor vehicle, or a truck. The device 30 can, for example, be a part of or a control unit of the vehicle 40.

[0040] Further details and aspects will be mentioned in connection with the exemplary embodiments described above. The in Fig. The embodiment shown in Figure 2 may include one or more optional additional features corresponding to one or more aspects related to the proposed concept or one or more of the above (e.g. Fig. 1) described embodiments were mentioned.

[0041] Further embodiments include computer programs for carrying out one of the methods described herein, when the computer program runs on a computer, a processor, or a programmable hardware component. Depending on specific implementation requirements, embodiments of the invention can be implemented in hardware or in software. The implementation can be carried out using a digital storage medium, for example, a floppy disk, a DVD, a Blu-ray disc, a CD, a ROM, a PROM, an EPROM, an EEPROM, a FLASH memory, a hard disk, or other magnetic or optical storage media on which electronically readable control signals are stored. These control signals can interact with, or interact with, a programmable hardware component in such a way that the respective method is carried out.

[0042] A programmable hardware component can be a processor, a computer processor (CPU = Central Processing Unit), a graphics processor (GPU = Graphics Processing Unit), a computer, a computer system, an application-specific integrated circuit (ASIC = Application-Specific Integrated Circuit), an integrated circuit (IC = Integrated Circuit), a system-on-a-chip (SOC = System on Chip), a programmable logic element, or a field-programmable gate array with a microprocessor (FPGA = Field Programmable Gate Array).

[0043] The digital storage medium can therefore be machine-readable or computer-readable. Some embodiments thus include a data carrier containing electronically readable control signals capable of interacting with a programmable computer system or programmable hardware component to execute one of the methods described herein. An embodiment is therefore a data carrier (or a digital storage medium or a computer-readable medium) on which the program for performing one of the methods described herein is recorded.

[0044] In general, embodiments of the present invention can be implemented as a program, firmware, computer program, or computer program product with program code or as data, wherein the program code or data is / are effective in carrying out one of the methods when the program runs on a processor or a programmable hardware component. The program code or data can, for example, also be stored on a machine-readable medium or data carrier. The program code or data can be in the form of, among other things, source code, machine code, bytecode, or other intermediate code. Reference symbol list 30 Device 32 interface 34 Data processing circuit 40 vehicles 100 procedures 110 Obtaining indoor data 120 Identifying an object 130 Comparing the specific object 140 Generating notification data 150 Sending the notification data

Claims

[1] A method (100) to be carried out by a device of a vehicle, comprising: obtaining (110) interior data indicative of an interior of the vehicle; determining (120), based on the interior data, an object in the interior of the vehicle; Comparing (130) the specified object with a predefined object; if the specified object matches the predefined object, generate (140) notification data to inform a user about the specified object in the vehicle; and Sending (150) the notification data via a Bluetooth Low Energy communication channel to a user terminal device of the user. [2] The method (100) according to claim 1, further comprising obtaining object data indicative of the predefined object for comparison with the specified object. [3] The method (100) according to any of the preceding claims, further comprising receiving a trigger event; wherein the sending of the notification data is triggered by the trigger event. [4] The method (100) according to one of claims 2 or 3, further comprising obtaining user data indicative of a user of the vehicle, wherein the object data are indicative of a user-specific predefined object, wherein the comparison of the determined object is user-specific based on the user data. [5] The method (100) according to one of the preceding claims, wherein the interior data is received from at least one of a camera and an ultra-wideband sensor of the vehicle. [6] The method (100) according to any one of claims 2-5, wherein the object data are indicative of a relevant area of ​​the interior for the object in the interior of the vehicle, and wherein The notification data will only be generated if the specific object is in the relevant area of ​​the interior. [7] The method (100) according to any of the preceding claims, wherein the notification data are indicative of the object determined in the interior. [8] A computer program for carrying out one of the methods (100) according to any of the preceding claims, wherein the computer program runs on a computer, a processor, or a programmable hardware component. [9] A device (30) for notification of an object located in a vehicle, comprising: an interface (32) for communication with another device; and a data processing circuit (34) configured to carry out at least one of the methods (100) according to one of claims 1-7. [10] A vehicle (40) with a device (30) according to claim 9.

Images