Method and control unit for recognizing a beverage

Abstract

A method for detecting a beverage in a vehicle, wherein a sensor of the vehicle detects a beverage container arranged in a beverage holder of the vehicle and provides a sensor signal corresponding to the detected beverage container. The invention further relates to a control unit for a vehicle and a vehicle.

Description

[0001] The invention relates to a method for detecting a beverage in a vehicle, wherein a sensor of the vehicle detects a beverage container arranged in a beverage holder of the vehicle and provides a sensor signal corresponding to the detected beverage container. The invention further relates to a control unit for a vehicle and a vehicle.

[0002] Methods of the type mentioned above, in various forms, are part of the state of the art and can serve different purposes.

[0003] DE 10 2018 001 549 A1 discloses, for example, a method for detecting a beverage container arranged in a beverage holder of a vehicle. A temperature sensor in the beverage holder detects a change in the temperature of the beverage, and a temperature control unit in the beverage holder heats the beverage if the detected change indicates a decrease in temperature, or cools the beverage if the detected change indicates an increase in temperature.

[0004] The cup holder can be located in the vehicle's center console. Alternatively or additionally, the center console can include a housing with one or more compartments for the secure and, in particular, concealed storage of objects.

[0005] Accordingly, DE 10 2013 225 670 A1 discloses a storage device for a vehicle, comprising a housing with an access opening and a plurality of separate compartments movably mounted within the housing, and configured to selectively move each compartment towards the access opening. A sensor located in the housing of the storage device captures an image of each object arranged in a compartment. A human-machine interface displays the captured images and receives a selection of an object from a vehicle occupant based on the displayed images. The storage device then moves the compartment containing the selected object to the access opening.

[0006] DE 11 2021 005 014 T5 discloses a minibar for a vehicle which includes a camera and, based on an image of the interior of the minibar captured by the camera, recognizes a drink located in the interior or a drink removed from the interior.

[0007] From DE 10 2019 209 625 A1 a method for delivering an object by means of a vehicle is known, in which a camera of the vehicle captures an image of a storage container arranged in a center console of the vehicle and a control unit of the vehicle recognizes an object arranged in the storage container based on the captured image.

[0008] In JP 2019-43 323 A a cup holder for a vehicle is described which has sensors for detecting the size of a cup container as well as the type, weight and / or temperature of a cup contained in the cup container.

[0009] The above solutions improve the enjoyment of the beverage or the storage of the beverage together with other objects.

[0010] One object of the invention is to propose a method for detecting a beverage in a vehicle that allows a vehicle occupant to further digitally utilize the detected beverage. Further objects of the invention are to provide a control unit for a vehicle and a vehicle itself.

[0011] An object of the invention is a method for detecting a beverage in a vehicle, wherein a sensor in the vehicle detects a beverage container arranged in a beverage holder of the vehicle and provides a sensor signal corresponding to the detected beverage container. The beverage holder can be part of a center console of the vehicle located between the driver's seat and the passenger seat, i.e., positioned between the driver's seat and the passenger seat. Alternatively or additionally, the beverage holder can be part of a central armrest of a rear seat of the vehicle, which may be pivotable. An interior trim panel, in particular a door panel, of the vehicle can also include the beverage holder.

[0012] The drink holder usually includes a receptacle for holding the drink container. This receptacle is typically designed to accommodate a cylindrical or truncated cone-shaped drink container, such as a cup or bottle, and to secure it in a removable manner.

[0013] According to the invention, a vehicle control unit recognizes the detected beverage container based on the provided sensor signal and a beverage contained in the detected beverage container based on the detected beverage container itself. The control unit can be a dedicated control unit assigned to the beverage holder. Alternatively, an existing vehicle control unit can be configured as the control unit by means of a software update.

[0014] Ideally, the sensor is a visual sensor, specifically a camera. The sensor signal provided is then a digital photograph or a digital video stream, each depicting the detected beverage cup. The sensor can be an existing interior camera of the vehicle or a dedicated camera integrated into the cup holder.

[0015] The sensor is conveniently activated by a light barrier in the cup holder, which detects when the cup is placed in the cup holder.

[0016] The beverage container may have a visually perceptible code, such as a barcode or a Quick Response (QR) code, that identifies the beverage contained within. Alternatively or additionally, the beverage container may have a shape or, in the form of a print or label, include a color, graphic, and / or text, in particular a trademark, each of which allows for easy identification of the beverage contained within.

[0017] Recognizing the beverage is necessary for further digital use of the recognized beverage.

[0018] An artificial neural network in the control unit can recognize the beverage container. This network is trained with each detected beverage container and automatically and continuously improves its recognition accuracy.

[0019] Similarly, the control unit can connect to the internet via the vehicle's communication system and recognize the beverage container based on information provided by the internet. For example, the internet might assign the name of a beverage to an image of a beverage container. Such assignments can be stored as data records in a dedicated database.

[0020] In one embodiment, the control unit receives a beverage name entered via the vehicle's human-machine interface (HMI). The control unit then recognizes the beverage based on this name if it cannot detect the beverage container using the provided sensor signal. If the control unit cannot detect the beverage container and its contents, either directly or via the internet, it can prompt an occupant to enter a beverage name, for example, manually as digital text or verbally. A central information display (CID) or infotainment system can serve as the HMI. Alternatively or additionally, the HMI can be dedicated to and integrated with the beverage holder.Entering the name can also be part of training the artificial neural network.

[0021] A weight sensor in the cup holder advantageously detects the weight of the beverage inside, and the control unit then calculates the quantity of the beverage based on this weight and the type of beverage. In short, the weight sensor is a scale integrated into the cup holder.

[0022] The weight sensor actually detects a combined weight, the tare weight, of the cup holder and the beverage inside. Only if the weight of the cup holder is known can the control unit determine the weight of the beverage in isolation. However, for many purposes, it is sufficient to determine the weight over time, in particular a gradual decrease in weight as the beverage is gradually emptied.

[0023] The vehicle's infotainment system can display the detected beverage on a central display screen, or a mobile device paired with the vehicle can display the detected beverage on its own screen. This display allows the occupant to verify the detection, i.e., to determine whether the control unit has correctly identified the beverage. Furthermore, the display can encourage the occupant to engage with the detected beverage in a more advanced digital way. For example, the display could include selectable options for further digital use.

[0024] The mobile device can run an application that allows the occupant to immediately make further digital use of the detected beverage.

[0025] In particular, the detected beverage can be displayed as an image and / or a name. The graphic and / or textual display can be easily understood by the occupant, thus minimizing distraction for the occupant, especially the driver.

[0026] Ideally, the control unit recognizes drinks placed in multiple cup holders simultaneously. In other words, the control unit can simultaneously assist several vehicle occupants in the further digital use of their respective recognized drinks.

[0027] Furthermore, according to the invention, the control unit connects to the internet via the vehicle's communication system and transmits a message indicating the detected beverage to a social network server accessible on the internet. The social network allows multiple users to share the beverages they have consumed and can motivate users to enjoy drinks together, i.e., to socialize. Users who share a preference for certain beverages particularly benefit from the social network. If the transmitted message also indicates the vehicle's location, meeting users who are in close proximity to each other becomes especially easy, i.e., whose respective positions are close to one another.

[0028] In addition, the control unit can connect to the internet via the vehicle's communication system and receive information about the detected beverage provided by the internet. The vehicle's infotainment system can then display this information. The information may relate to an ingredient of the beverage, a health aspect of the beverage, and / or include a warning about the beverage.

[0029] Furthermore, the control unit can connect to the internet via the vehicle's communication system and receive the location of a retailer of the detected beverage, provided by the internet. The vehicle's navigation system can then calculate a route from the vehicle's current position to the received location. This allows the occupant to easily and quickly obtain a refill of the detected beverage.

[0030] Another aspect of the invention is a control unit for a vehicle. The control unit can be a dedicated control unit or an existing control unit of the vehicle that has been updated by means of software.

[0031] According to the invention, the control unit is configured to execute a method according to an embodiment of the invention in conjunction with a cup holder and a sensor of the vehicle. The control unit enables further digital use of a detected beverage arranged in the cup holder.

[0032] Another aspect of the invention is a vehicle comprising a cup holder and a sensor. The cup holder serves to hold a beverage container. The sensor serves to detect a beverage container arranged in the cup holder.

[0033] According to the invention, the vehicle comprises a control unit according to one embodiment of the invention. Thanks to the control unit, the vehicle enables the occupant to further digitally utilize a beverage enjoyed in the vehicle, thereby increasing the occupant's satisfaction with the vehicle.

[0034] A significant advantage of the method according to the invention is that it allows a vehicle occupant to make further digital use of the detected beverage. In this way, the vehicle offers the occupant exceptional added value.

[0035] The invention is schematically illustrated in the drawing with reference to one embodiment and is further described with reference to the drawing. It shows: Fig. 1 in a side view a vehicle according to an embodiment of the invention.

[0036] Fig.Figure 1 shows a side view of a vehicle 1 according to an embodiment of the invention. The vehicle 1 comprises a cup holder 11 and a sensor 12. The vehicle can also comprise a plurality of cup holders 11. Each cup holder 11 can include a weight sensor 110.

[0037] The vehicle 1 may also advantageously include a communication system 13, an infotainment system 14, a central display screen 15 and / or a navigation system 16.

[0038] Furthermore, the vehicle 1 comprises a control unit 10 according to an embodiment of the invention. The control unit 10 can include an artificial neural network 100 and is configured to detect a beverage 20 in the vehicle 1 in conjunction with the beverage holder 11 and the sensor 12 of the vehicle 1 by performing a method according to an embodiment of the invention as follows.

[0039] The sensor 12 of the vehicle 1 detects a beverage container 2 arranged in the beverage holder 11 of the vehicle 1 and provides a sensor signal corresponding to the detected beverage container 2.

[0040] The control unit 10 of the vehicle 1 recognizes the detected beverage container 2 based on the provided sensor signal. In particular, the artificial neural network 100 of the control unit 10 recognizes the beverage container 2. Alternatively or additionally, the control unit 10 can connect to the internet 3 via the communication system 13 of the vehicle 1 and recognize the beverage container 2 based on information provided by the internet 3.

[0041] The control unit 10 recognizes a beverage 20 contained in the detected beverage container 2 based on the detected beverage container 2. If the control unit 10 does not recognize the beverage container 2 based on the provided sensor signal, the control unit 10 can receive a name for the beverage 20 entered via a human-machine interface of the vehicle 1 and recognize the beverage 20 based on the received name. The human-machine interface can be configured as the central display screen 15, which includes the infotainment system 14 and / or the cup holder 11.

[0042] The weight sensor 110 of the cup holder 11 advantageously detects the weight of the beverage 20 contained in the cup container 2. Then, depending on the detected weight and the detected beverage 20, the control unit 10 can determine a quantity of the beverage 20 contained in the cup container 2.

[0043] The infotainment system 14 of vehicle 1 can display the detected beverage 20 on a central display screen 15 of vehicle 1. Alternatively or additionally, a mobile device 50 belonging to an occupant 5 of vehicle 1, paired with vehicle 1, can display the detected beverage 20 on a display screen 500 of the mobile device 50. In particular, the detected beverage 20 is displayed as an image and / or a name.

[0044] The control unit 10 connects to the Internet 3 via the vehicle's communication system 1 and transmits a message 300 indicating the detected beverage 20 to a server of a social network 30 accessible in the Internet 3.

[0045] Apart from that, the control unit 10 can connect to the internet 3 via the vehicle 1's communication system 13 and receive information 31 provided by the internet 3 regarding the detected beverage 20. The vehicle 1's infotainment system 14 can then display the received information 31.

[0046] It is also possible that the control unit 10 connects to the internet 3 via a communication system 13 of the vehicle 1 and receives a location 40 of a seller 4 of the detected beverage 20 provided by the internet 3. Then the navigation system 16 of the vehicle 1 can determine a route from a current position 17 of the vehicle 1 to the received location 40.

[0047] Naturally, the control unit 10 can also recognize a plurality of drinks 20 that are arranged in several cup holders 11 at the same time. REFERENCE MARK: 1 vehicle 10 Control unit 100 artificial neural networks 11 cup holders 110 Weight sensor 12 Sensor 13 Communication system 14 Infotainment system 15 central display screen 16 Navigation system 17th position 2 beverage containers 20 drinks 3 Internet 30 social networks 300 messages 31 Information 4 sellers 40 locations 5 occupants 50 mobile devices 500 display screen

Claims

[1] Method for detecting a beverage (20) in a vehicle (1) wherein - a sensor (12) of a vehicle (1) detects a beverage container (2) arranged in a beverage holder (11) of the vehicle (1) and provides a sensor signal corresponding to the detected beverage container (2); - a control unit (10) of the vehicle (1) recognizes the detected beverage container (2) based on the provided sensor signal and recognizes a beverage (20) contained in the detected beverage container (2) based on the detected beverage container (2), characterized by , that - the control unit (10) connects to the Internet (3) via a communication system (13) of the vehicle (1) and transmits a message (300) indicating the detected drink (20) to a server of a social network (30) accessible on the Internet (3). [2] Method according to claim 1, wherein an artificial neural network (100) of the control unit (10) recognizes the beverage container (2) and / or the control unit (10) connects to the Internet (3) via a communication system (13) of the vehicle (1) and recognizes the beverage container (2) based on information provided by the Internet (3) and / or the control unit (10) receives a name of the beverage (20) entered via a human-machine interface of the vehicle (1) and recognizes the beverage (20) based on the received name if the control unit (10) does not recognize the beverage container (2) based on the provided sensor signal. [3] Method according to claim 1 or 2, wherein a sensor (110) of the drink holder (11) detects a weight of the drink (20) contained in the drink container (2) and the control unit (10) determines a quantity of the drink (20) contained in the drink container (2) depending on the detected weight and the detected drink (20). [4] Method according to any one of claims 1 to 3, wherein an infotainment system (14) of the vehicle (1) displays the detected beverage (20) on a central display screen (15) of the vehicle (1) or a mobile terminal device (50) of an occupant (5) of the vehicle (1) coupled to the vehicle (1) displays the detected beverage (20) on a display screen (500) of the mobile terminal device (50) and / or the detected beverage (20) is displayed as an image and / or as a name. [5] Method according to any one of claims 1 to 4, wherein the control unit (10) detects drinks (20) arranged simultaneously in several drink holders (11). [6] Method according to any one of claims 1 to 5, wherein the control unit (10) connects to the Internet (3) via a communication system (13) of the vehicle (1) and receives information (31) provided by the Internet (3) concerning the detected beverage (20) and an infotainment system (14) of the vehicle (1) displays the received information (31). [7] Method according to any one of claims 1 to 6, wherein the control unit (10) connects to the Internet (3) via a communication system (13) of the vehicle (1) and receives a location (40) of a seller (4) of the detected beverage (20) provided by the Internet (3) and a navigation system (16) of the vehicle (1) determines a route from a current position (17) of the vehicle (1) to the received location (40). [8] Control unit (10) for a vehicle (1) which is configured to perform, in conjunction with a cup holder (11) and a sensor (12) of the vehicle (1), a method according to any one of claims 1 to 7. [9] Vehicle (1) comprising a cup holder (11), a sensor (12) and a control unit (10) according to claim 8.

Images