Method for operating an electronic safety system of a vehicle, and electronic safety system and vehicle

Abstract

The invention relates to a method for operating an electronic safety system (5) of a vehicle (2), in which – a user (3) of the vehicle (2) is detected by a detection device (7), – on the basis of the detected user (3), an electronic evaluation unit (8) of the electronic safety system (5) determines whether the user (3) is wearing smart glasses (1), for which purpose the electronic evaluation unit (8) is used to check whether a specific identification feature (11) of the smart glasses (11) with which the smart glasses (11) are identifiable can be detected, – if it is determined that the user (3) is wearing the smart glasses (1), hazard information relating to a hazard arising from wearing the smart glasses (1) is generated by the electronic evaluation unit (8), and – the electronic safety system (5) is operated in this way by virtue of at least one safety function being activated on the basis of the hazard information. The invention also relates to an electronic safety system (5) and to a vehicle (2).

Description

[0001] 24-0390 PIF

[0002] 1

[0003] Method for operating an electronic safety system of a vehicle, as well as electronic safety system and vehicle

[0004] The invention relates to a method for operating an electronic security system of a vehicle.

[0005] Furthermore, the invention relates to an electronic security system with an electronic evaluation unit and a control unit.

[0006] The invention also relates to a vehicle with an electronic safety system.

[0007] Smart glasses are becoming increasingly common. These glasses are essentially wearable computers that overlay information onto the user's field of vision. They feature a display positioned very close to the user's eye. Smart glasses can be used to augment the real world ("mixed reality") or to virtually reproduce the real world ("virtual reality") and augment it with virtual information.

[0008] Depending on the design of the smart glasses and how they are used, the user (the wearer) can easily be distracted by an information overload, especially the virtual information generated from them. Therefore, users should only wear smart glasses when they are not required to perform any other tasks. Specifically, smart glasses should not be used, or even worn, while driving a vehicle, riding a bicycle, operating machinery, or in any other situation where the user's attention is required. If a user does wear smart glasses in one of these situations, this could constitute misuse.

[0009] In vehicles such as passenger cars or trucks, the driver should always be able to intervene in the vehicle's driving behavior. Therefore, the driver's attention is required. This also applies to vehicles that are at least partially autonomous, such as a vehicle according to 24-0390 PIF.

[0010] 2

[0011] At autonomy level 2 or higher, the driver must still monitor the vehicle's movement and be able to intervene if necessary. However, depending on the situation, it may still be necessary for the driver to perform certain driving tasks. Therefore, the driver should not use smart glasses while operating the vehicle.

[0012] For example, DE 10 2022 112 369 A1 discloses a method for operating a display system with smart glasses in a vehicle. The presence of the smart glasses inside the vehicle can be detected. Subsequently, an interior tracking mode can be automatically activated when it is determined that the smart glasses are inside the vehicle, and this interior tracking mode involves performing a tracking procedure based on a vehicle coordinate system.

[0013] Furthermore, DE 102017214296 B3 discloses a method for operating an occupant protection system of a vehicle, in which it is recorded whether a vehicle occupant has put on electronic data glasses, wherein the occupant protection system is operated depending on whether the vehicle occupant has put on electronic data glasses.

[0014] Furthermore, DE 102013 222 580 A1 discloses a method for detecting a driver wearing smart glasses in their own vehicle. If this is detected, a warning signal is generated.

[0015] One object of the present invention is to increase the safety of a vehicle, in particular of the occupants, by carrying out an improved check to see whether a user, in particular the driver of the vehicle, is wearing and / or using smart glasses.

[0016] This task is solved by a method, an electronic safety system, and a vehicle according to the independent patent claims. Meaningful further developments arise from the dependent patent claims.

[0017] One aspect of the invention relates to a method for operating an electronic security system of a vehicle, wherein

[0018] - In particular, if a user of the vehicle is recorded by a detection device, 24-0390 PIF

[0019] 3

[0020] - In particular, based on the recorded user, an electronic evaluation unit of the electronic security system determines whether the user is wearing smart glasses, for which purpose the electronic evaluation unit checks whether a specific identification feature of the smart glasses, with which the smart glasses can be identified, is detectable.

[0021] - In particular, if it is determined that the user is wearing the smart glasses, the electronic evaluation unit will generate a hazard warning regarding a danger posed by wearing the smart glasses, and

[0022] - In particular, the electronic security system is operated in such a way that at least one security function is activated based on the hazard information.

[0023] The proposed method enables safer vehicle operation by monitoring the vehicle's user, particularly the driver, in such a way as to reliably detect smart glasses worn by the user. In other words, the system can determine whether the user is wearing and / or using smart glasses, allowing at least one or more safety functions of the electronic safety system to be activated based on this detection.

[0024] The electronic security system can detect whether there is unauthorized use of data glasses in the vehicle.

[0025] The proposed method allows the system to detect misuse of smart glasses or VR ("Virtual Reality") glasses. This electronic safety system can then prevent the vehicle's safety from being compromised by the use of smart glasses while it is in motion.

[0026] To ensure reliable and, in particular, unambiguous identification of the smart glasses in the vehicle, the recorded user is analyzed to determine whether the specific identifying characteristic, i.e., an individual characteristic, of the smart glasses can be detected. For example, the captured images or recordings of the user can be analyzed to identify them. 24-0390 PIF

[0027] 4. It will be evaluated or analyzed whether such a specific identifying characteristic can be detected.

[0028] The specific identifying feature is a measurable, and therefore detectable, characteristic of the data glasses.

[0029] This specific identification feature allows for the precise identification of the smart glasses and thus their reliable detection. Furthermore, this feature enables the accurate determination of the smart glasses' type. Depending on the type of smart glasses or other electronic eyewear, the specific identification feature can be defined or assigned accordingly. By capturing the user's information, the specific identification feature can first be detected and then, for example, compared against a database. This allows the type, model, and / or function of the smart glasses to be determined.This is advantageous because, when generating hazard information based on the type, model and / or nature of the smart glasses, the hazard emanating from the smart glasses can be analyzed or determined in a situation-appropriate manner.

[0030] In other words, image processing, for example, can be used to analyze the captured user information to determine whether a specific identifying characteristic can be detected. This allows for simple and reliable recognition and, in particular, assignment of the smart glasses.

[0031] For example, the specific identification feature can be displayed on an electronic display unit. This electronic display unit can be attached to the smart glasses. This allows the current state of the smart glasses to be characterized, and in particular displayed, using the specific identification feature. Should the state change, the display of the specific identification feature can be adjusted accordingly.

[0032] The specific identification feature can, for example, be attached to the smart glasses as an optical feature. In particular, the specific identification feature can be designed in such a way that simple recognition with regard to the detection of 24-0390 PIF.

[0033] 5 can be performed without any communication links or other couplings between the data glasses and the vehicle.

[0034] The specific identification feature can be easily and cost-effectively attached to a wide variety of smart glasses, so that this can also be done retroactively, for example.

[0035] With the aid of the detection device, which can be a sensor system, an environmental detection device, an interior camera, or a camera system, the interior and / or exterior of the vehicle can be recorded. Most importantly, the user can be continuously recorded.

[0036] Additionally or alternatively, relevant information regarding the interior of the vehicle, the exterior of the vehicle and / or the user of the electronic evaluation unit can be provided, in particular transmitted.

[0037] The electronic evaluation unit can be a computing unit or an evaluation system.

[0038] The evaluation unit can be provided with a database containing a wide variety of possible specific identification characteristics of smart glasses, enabling it to perform a corresponding analysis. Optionally, the database can be implemented as a backend or in the cloud.

[0039] Based on the generated hazard information, the system can determine or assess whether the risk posed by wearing the smart glasses compromises the safety of the vehicle and, in particular, its occupants. Specifically, it considers whether wearing the smart glasses presents a risk that distracts the driver to such an extent that they can no longer intervene in driving behavior. Crucially, at least one or more safety functions can be automatically activated based on this hazard information.

[0040] In particular, the proposed method may be a computer-implemented method. 24-0390 PIF

[0041] 6

[0042] In one embodiment, the activated safety function enables the system to intervene in the vehicle's driving behavior. This is achieved by providing the electronic safety system with environmental information about the vehicle's surroundings and / or positional information about the vehicle's location. The system intervention is then carried out based on this environmental and / or positional information. Thus, if the system detects that the vehicle's user is wearing and using smart glasses, the system can automatically intervene in the vehicle's driving behavior. As mentioned earlier, when using smart glasses, especially mixed reality glasses, there is a significant risk of excessive user distraction.In this case, depending on the traffic situation or other circumstances affecting the vehicle, the user may not be able to react appropriately or intervene in the vehicle's driving behavior. This is where the activated safety function proves advantageous, as it adjusts the vehicle's driving behavior to such an extent that it can be operated or transported safely. Above all, this system intervention increases safety for the vehicle, its occupants, and other road users in the vicinity.

[0043] For system-level intervention, which can be carried out by control systems, driver assistance systems, vehicle systems, or other systems and must be situation-appropriate, environmental information and / or position information are necessary. In order for a vehicle system, for example, to perform corresponding system-level interventions, it must be provided with appropriate input variables. The vehicle's current position and environmental perception are advantageous in this regard. Environmental perception sensors on the vehicle can capture and provide this information. Position information can then be provided by a positioning system such as a GPS or GNSS system.In particular, traffic information or other information can be taken into account here. For example, information from a digital map, navigation information, or other traffic information can be considered. 24-0390 PIF.

[0044] 7

[0045] In one embodiment, the system intervenes in the driving behavior by reducing the vehicle's speed, adjusting its trajectory, and / or adapting its route guidance. This allows for situation-specific interventions in the driving behavior, particularly depending on the driving or vehicle situation, to ensure safety despite the user's use of smart glasses. With the help of at least one activated safety function, the vehicle's speed can be adjusted. This primarily involves initiating braking. This braking is performed in such a way as to prevent any danger to other road users in the vicinity of the vehicle.Furthermore, the vehicle's trajectory, both current and future, can be adjusted accordingly. For example, the vehicle can be moved to a lane with lower traffic volume. Alternatively, or in addition, the route guidance can be modified to direct the vehicle along less congested and, in particular, less dangerous or critical road sections. A safe state could be achieved by activating an autonomous Level 3 (or higher) function according to SAE standard J3016, which would allow the driver to wear glasses.

[0046] Furthermore, it is conceivable that at least one safety function could send a driver signal into the vehicle's vicinity to warn other road users of the potential danger emanating from the vehicle. This warning signal could also be transmitted to traffic management systems or other traffic control systems.

[0047] Above all, the system intervention enables at least partially automatic or autonomous control of the vehicle, primarily increasing the distance to surrounding road users, thus increasing safety accordingly.

[0048] In one embodiment, for example, it is provided that with the activated at least one safety function, an emergency stop maneuver and / or a low-risk maneuver is performed automatically. Additionally or instead, based on 24-0390 PIF

[0049] Based on environmental and / or positional information, a stopping position can be determined. This allows the vehicle to be automatically brought to a safe state. Depending on the current situation of the vehicle and the generated hazard information, an emergency stop maneuver can be performed as a safety function. In this case, the vehicle can be automatically controlled so that it can navigate or maneuver to the stopping position, i.e., the emergency stop position. In other words, this ensures that the vehicle can be safely parked or stopped in a safe area, as the user is unable to operate the vehicle safely due to the use of the smart glasses. Additionally or instead, the maneuver can be performed with minimal risk (MRM).The goal of such a low-risk maneuver is to move the vehicle safely. This is primarily achieved automatically, for example, through a vehicle guidance system or a driver assistance system. In this process, a corresponding control signal can be transmitted to such a vehicle system via the safety function.

[0050] The primary goal of an emergency stop and / or a low-risk maneuver is to bring the vehicle to a safe state as quickly as possible. The driver can be guided or instructed accordingly. Such a maneuver can be designed to minimize the safety risk for both the vehicle and other road users in its vicinity. Furthermore, the driving maneuver can be dynamically engineered to have a safety-related aspect, thus discouraging the driver from misusing the system. For example, a late, strong, yet still safe deceleration can be performed. The deceleration can also be designed, at least in part, as a "brake jolt," even with repetitions. This means that the deceleration, i.e., the braking, is designed to prevent a following vehicle from colliding with it.The presence of a following vehicle can be detected and, in particular, its plausibility verified via the vehicle's sensors, and the deceleration can be adjusted accordingly.

[0051] For example, the vehicle's environmental sensors or a sensor system can be used to create an environmental model, i.e., a model of the vehicle's surroundings. Furthermore, a digital map and the vehicle's position data can be used to locate a safe stopping position, particularly in the vehicle's vicinity, which can be approached safely with sufficient clearance. If available, it would also be conceivable to utilize information transmitted by other road users. This can be done via vehicle-to-vehicle communication, such as V2X or V2V. This allows a safe trajectory to be retrieved from a backend or cloud and followed accordingly.

[0052] Additionally, the user can be informed about the maneuver, with an audio explanation being provided. This information can be conveyed through various means, such as audio, visual, kinesthetic, and / or haptic input. Specifically, the following information can be communicated to the driver or user via voice output in the vehicle:

[0053] - Maneuver currently being performed,

[0054] - the reason for the execution of the maneuver and

[0055] - the possible aborting of the maneuver.

[0056] An example of a voice output could be: "Maneuver is being executed due to a detected visual impairment caused by smart glasses; please ensure a clear view in order to abort the maneuver."

[0057] This allows the user's behavior to be moderated or trained.

[0058] Additionally, relevant information regarding the maneuver performed can also be displayed on a display unit, such as a screen.

[0059] In one embodiment, the system detects the user upon entering the vehicle. If it is determined that the user is already wearing smart glasses upon entry, the vehicle is rendered inoperable by at least one safety function. This means that, even before entering the vehicle, the user is checked to see if they are wearing or at least have smart glasses with them. This can be done by verifying whether the specific identification feature can be recognized or detected. If this is the case, the vehicle can be set to inoperable as a safety function even before it starts moving or driving. Thus, the 24-0390 PIF can be implemented system-wise.

[0060] 10

[0061] The vehicle can be configured so that driving is currently impossible. This can be communicated to the user via an appropriate output, such as a voice prompt. This gives the user the opportunity to remove the smart glasses. Since user tracking is continuous, the vehicle can be reactivated or switched back to a drive-ready state once the smart glasses have been removed.

[0062] In one embodiment, if it is detected that the user is wearing the smart glasses, a warning is issued to the user in the vehicle – acoustically, visually, kinesthetically, and / or haptically – informing the user that at least one safety function is being activated. This allows the user to be notified that, due to the misuse of the smart glasses in the vehicle, corresponding safety measures, such as the activation of at least one safety function, are imminent and will affect driving behavior. This allows the user to prepare accordingly and avoid being surprised by the activated safety function. The warning can be issued within the vehicle's interior. Output systems such as the vehicle's infotainment system and / or speaker system can be used for this purpose.The warning message can inform the user that the smart glasses must be removed to eliminate the danger posed by wearing them. Thus, the user can be instructed to remove the smart glasses, especially immediately, so that they can once again focus on the road and not be distracted.

[0063] For example, a cascaded warning system can be implemented. Depending on the current hazard, the intensity and / or volume of the warning signal can be adjusted. With a cascaded warning system, the intensity of each subsequent signal can be increased to raise awareness.

[0064] In one embodiment, the user is continuously detected so that the electronic evaluation unit can continuously determine, based on the detected user, whether the user is wearing the smart glasses. If it is determined that the user is no longer wearing the smart glasses, at least one safety function that was already activated is deactivated. This allows the 24-0390 PIF

[0065] 11

[0066] Users are given the option to deactivate, or reverse, a previously activated security function. In other words, the user can deactivate any maneuver that was activated based on at least one security function at any time. This can be achieved by removing the smart glasses. By removing the smart glasses, such as VR glasses, the user can cancel the maneuver.

[0067] In particular, the system can grant the user the option to override the activated security function. Overriding the security function can be logged, for example, for product liability reasons.

[0068] Depending on how advanced the security measures are due to the activated security function, if the user initiates an interruption, the security function can be deactivated in such a way that security is not compromised. For example, if a speed reduction has been implemented as a security measure, the acceleration back up cannot occur too quickly. If the route guidance has been adjusted, the original route guidance can be restored.

[0069] In one embodiment, the detection device identifies the user by capturing a portion of their head. The electronic evaluation unit then verifies whether the specific identification feature, located on the surface of the smart glasses, can be detected within this area. To accurately detect whether the user is wearing the smart glasses, the area of ​​the user's head is of particular importance. The detection device can be controlled to capture this crucial area. Multiple images of the head can be taken for subsequent evaluation and analysis using image processing.This process checks whether the specific identifying characteristic has been detected or recorded.

[0070] In particular, the specific identification feature can be positioned on the surface of the smart glasses in such a way that it can be detected with very high integrity from different directions or perspectives. 24-0390 PIF

[0071] 12

[0072] In one embodiment, it is further provided that the specific identification feature, which is designed as an optoelectronically readable code, in particular a QR code, is detected in the captured area of ​​the user's head based on image processing. Thus, the identification feature can be a uniquely identifiable optical feature. This can be applied to the surface of the smart glasses, in particular printed on them. Using appropriate image processing or image processing software, and in particular taking into account a suitable image processing algorithm, the captured area of ​​the head can be evaluated or analyzed in order to detect the specific identification feature, if present.

[0073] For example, the specific identifying feature can be applied to the surface as a black and white pattern. In particular, the specific identifying feature can be arranged on the surface with a predetermined, especially high, contrast.

[0074] Another aspect of the invention relates to an electronic security system comprising an electronic evaluation unit and a control unit, wherein the electronic security system is configured to execute a method according to the preceding aspect or an advantageous embodiment thereof. In particular, a method of the previously described aspect can be carried out or executed with the electronic security system just described.

[0075] The electronic safety system can, for example, be integrated into or used in a vehicle. The electronic evaluation unit and the control unit can be networked for communication. The electronic evaluation unit, which can generate hazard information, enables the control unit to be operated accordingly. In particular, the control unit can generate an electronic signal, such as a control signal, which can be used in the vehicle to activate at least one safety function of the electronic safety system or another vehicle system, primarily to increase safety when using the smart glasses.

[0076] Another aspect of the invention relates to a vehicle with an electronic safety system according to the previous aspect or an advantageous further development thereof. 24-0390 PIF

[0077] 13

[0078] The vehicle in question can be a motor vehicle, such as a passenger car or a truck. Other types of means of transport are also included.

[0079] In particular, the vehicle is at least partially autonomous.

[0080] Another independent aspect concerns smart glasses equipped with a specific identification feature, which is positioned on the smart glasses in such a way that it is detectable. This specific identification feature uniquely describes or identifies the smart glasses, allowing an external detection system to recognize and generate corresponding information about them.

[0081] Thus, misuse of the data glasses can be detected through simple detection of the specific identifying feature.

[0082] For example, the smart glasses could be augmented reality glasses or mixed reality glasses. In other words, the smart glasses could be designed as "mixed reality glasses," "augmented reality glasses," or "virtual reality glasses."

[0083] Advantageous embodiments of one aspect of the present invention are to be regarded as advantageous embodiments of the other aspects of the invention. The reverse is also true.

[0084] In particular, the electronic security system and / or the vehicle have (technical) means to carry out the method according to the invention.

[0085] Further features of the invention will become apparent from the claims, the figures, and the description of the figures. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown in the figures alone, are not only usable in the combinations specified, but also in other combinations or individually. 24-0390 PIF

[0086] 14

[0087] The invention will now be explained in more detail with reference to a preferred embodiment and the drawings. The drawings show:

[0088] Fig. 1 shows an exemplary finding of misuse, in particular unauthorized use, of data glasses, especially “mixed VR glasses” in a vehicle;

[0089] Fig. 2 shows a schematic representation of a vehicle equipped with an electronic safety system which, depending on the detection of smart glasses in the vehicle, can implement safety measures to increase the vehicle's safety; and

[0090] Fig. 3 shows a schematic representation of data glasses.

[0091] Figure 1 shows a schematic or exemplary sequence of the method according to the invention. It illustrates, for example, how misuse of data glasses 1 (see Figure 3) in a vehicle 2 (see Figure 2) can be detected and, accordingly, safety measures can be initiated, in particular activated.

[0092] With the data glasses 1, which can be augmented reality glasses, mixed reality glasses, or VR glasses, it is important that the data glasses are only used when the current situation allows. If the data glasses 1 are used by a user 3 (see Fig. 2) in vehicle 2, then user 3, who may be the driver, is at least partially, and in particular completely, distracted by the data glasses 1. Therefore, user 3 can no longer perform and / or monitor driving tasks related to the movement 4 (see Fig. 2) of vehicle 2.

[0093] Vehicle 2 can be at least partially autonomous, corresponding to autonomy levels 2 to 4. This means that some driving tasks can be performed automatically by the vehicle systems of Vehicle 2. However, at levels 2 and 3, for example, in certain situations, the driver (i.e., user 3) is required to take control of the vehicle's systems (e.g., the 24-0390 PIF).

[0094] 15

[0095] The vehicle 2 can take over control, at least temporarily. Therefore, when wearing the smart glasses 1, user 3 would be distracted and might no longer be able to perform such driving tasks. For example, in rare cases, a driver might control their vehicle using "mixed VR glasses." However, this is not permitted, particularly for safety reasons. A specially designed electronic security system 5 (see Fig. 2) can be used to detect the presence of the smart glasses 1 and, in particular, to identify them.

[0096] Optionally, a function can be offered with VR glasses for use in vehicles, which would permit its use in this specific case. This can be verified system-side based on a specific identification feature 11 (see Fig. 3) of the data glasses 1.

[0097] This electronic safety system 5 can be a decentralized or a centralized system. For example, the electronic system 5 can be fully integrated into the vehicle 2. It is also conceivable that at least some components of the electronic system 5 are integrated into the vehicle 2, while other parts are located, for example, on a server or in a backend. The components can exchange data with each other via communication links. In particular, the electronic system 5 is networked or coupled with the vehicle 2 in such a way that, upon detection of the data glasses 1 in the vehicle 2, appropriate safety measures can be taken to increase the safety of the vehicle 2, its occupants, and especially other road users in the vicinity 6 (see Fig. 2) of the vehicle 2.

[0098] In step S1, user 3 can first be detected, and in particular monitored, using cameras and / or sensors. This occurs continuously from the moment user 3 enters vehicle 2. Thus, user 3 can be monitored or detected even before entering vehicle 2. User 3 can therefore be detected in vehicle 2 and / or in the immediate vicinity of vehicle 2. A detection device 7 (see Fig. 2) can be used for this purpose. This detection device 7 can be a multi-part detection system. The detection device 7 is designed such that both the interior 24-0390 PIF

[0099] The interior of vehicle 2, as well as the exterior of vehicle 2, can be recorded. In vehicle 2, the user 3 can be recorded, primarily by means of a driver's interior monitoring camera, such as a driver observation camera, by the recording device 7. The recording device 7 can, in turn, be communicatively and, in particular, electronically coupled or networked with the electronic security system 5.

[0100] In a subsequent optional step S2, an electronic evaluation unit 8 can be used to evaluate, and in particular analyze, the electronic security system 5, the detected user 3, a detected interior of the vehicle 2, and / or a detected exterior of the vehicle 2. For example, the recorded information is evaluated based on image processing. The evaluation focuses primarily on whether the smart glasses 1 are detectable or recognizable. With regard to the detected user 3, the focus is on detecting area 9 of the user's head 10, since the smart glasses 1 are worn in this area during normal use.

[0101] To enable reliable, and in particular unambiguous, identification of the smart glasses 1, the detection or determination of whether smart glasses 1 are present in the vehicle 2 and are being worn by the user 3 is based on a specific identification feature 11 (see Fig. 3). This specific identification feature 11 can be located on the surface of the smart glasses 1 at various positions and / or in different areas. Using this specific identification feature, which can be described as a characteristic of the smart glasses 1, identification and, in particular, detection of the smart glasses 1 can be carried out. Above all, the identification feature 11 allows for differentiation between the smart glasses 1; this specific identification feature 11 can, in particular, provide information specific to the smart glasses 1.In addition to identification and detection, feature 11 also serves to provide the electronic security system with information regarding the smart glasses 1. This information can be used to provide details about the model, type, nature, and / or functionality of the smart glasses 1. Thus, by detecting the identification feature 11, it is possible not only to confirm the presence of the smart glasses 1 but also to determine the specific type of smart glasses. For example, it can be determined that the smart glasses 1 are a "mixed VR headset." (Use of a 24-0390 PIF.)

[0102] 17. The use of such a type of smart glasses 1 is particularly dangerous in vehicles. The use of such smart glasses while operating a surface vehicle, aircraft, or watercraft is not permitted unless the vehicle is specifically equipped for the use of smart glasses. Likewise, such smart glasses 1, or any other smart glasses 1, should not be used while operating machinery. Furthermore, smart glasses 1 should not be worn when the user 3 needs to be focused and, in particular, attentive due to a current situation.

[0103] In other words, the electronic security system 5 enables the detection of a "mixed VR headset" via a uniquely identifiable feature, such as the specific identification feature 11. Furthermore, to simplify the application of feature 11 to the smart glasses 1, particularly with regard to detection and evaluation, the specific identification feature 11 can be an optoelectronically readable code, i.e., a QR code. This code can be equipped with relevant information and easily attached to the smart glasses 1 at various locations. Thus, by recording the user 3, it can be verified whether this code was correctly detected in the recorded information, glasses, or data.Thus, the specific identification feature 11 can be designed as a uniquely identifiable optical feature or characteristic. Recognition for this evaluation can be carried out using the electronic evaluation unit 8. The electronic evaluation unit 8 can include appropriate image processing software and, for example, an image processing algorithm. Furthermore, to improve the recognition of feature 11, it is conceivable that artificial intelligence, such as an AI algorithm, could also be used.

[0104] In a subsequent optional step S3, if the smart glasses 1 are detected, and especially if they are "mixed VR glasses," safety measures can be prepared by the electronic safety system 5. Depending on the current situation regarding the vehicle 1 and the type of smart glasses 1, safety measures can be implemented in stages. To enable situation-appropriate measures, the electronic evaluation unit 8 can also determine hazard information regarding a potential danger posed by wearing the smart glasses 1, based on the detected smart glasses 1. For this purpose, 24-0390 PIF can also be used.

[0105] 18

[0106] Environmental information concerning the environment 6, position information regarding a position of the vehicle 2, traffic information and / or information regarding the vehicle 2 are taken into account, so that with the hazard information a situation-appropriate check or assessment can be carried out by wearing the data glasses 1 and in particular by using the data glasses 1 in the vehicle.

[0107] In an optional subsequent step S4, at least one safety function can be activated by the electronic safety system based on the hazard information. This ensures the safety of vehicle 1 and user 3 despite the wearing of the data glasses 1. In other words, the safety function implements safety measures in vehicle 2 to bring vehicle 2 into a safe state even if user 2 is inattentive while wearing the data glasses 1. With the safety function activated, the electronic safety system 5 can transmit corresponding signals to vehicle systems, such as driver assistance systems, vehicle guidance systems, braking systems, and / or occupant restraint systems, enabling the electronic safety system 5 to intervene accordingly.For this purpose, the electronic safety system 5 can include a control unit 12 (see Fig. 2), a control system with which the activated safety function can generate and provide control signals for vehicle systems and / or vehicle components. In particular, based on the activated safety function, at least one or more such activated safety functions, a system-level, i.e., automated, intervention in the driving behavior of the vehicle 2 can be carried out. This is done in such a way that the vehicle 2 can be operated in a safe state despite the current situation. For example, the speed of the vehicle 2 can be reduced and / or the trajectory of the vehicle 2 adjusted and / or the route guidance for a route 13 (see Fig. 2) of the vehicle 2 can be adapted.In this context, the environment 6 can be taken into account in particular, so that the vehicle 2 is adapted in its driving behavior so that the vehicle 2 does not pose a danger to itself and / or to other road users in the environment 6.

[0108] For example, with the safety function activated, an emergency stop maneuver and / or a low-risk maneuver can be performed automatically. In other words, if, for example, a "mixed VR headset" 24-0390 PIF is used, the following can be done automatically:

[0109] Once a fault is detected (19), safety responses are triggered, including emergency stop functions, lateral guidance, longitudinal guidance, driver takeover prompts, or the application of brakes or the suppression of acceleration. In other words, the system can ensure that the vehicle 2 can continue driving safely and, in particular, that it is brought to a safe stop at a corresponding stopping position 14 (see Fig. 2) along the route 13 or in the vicinity 6.

[0110] Furthermore, when the wearer of the smart glasses 1 is detected, the user 3 can be informed accordingly via an electronic output unit 15 (see Fig. 2) in and / or on the vehicle 2, using acoustic, visual, kinesthetic, and / or haptic signals. The user 3 can also be notified that at least one or more safety functions are about to be activated, ensuring that the user 3 is not left uninformed and can understand the vehicle's response. In particular, an acoustic, visual, or haptic warning can be issued in and / or on the vehicle 2. This warning can also include, for example, a voice output instructing the user 3 to remove the smart glasses 1, and that if this is not done, the activation of at least one safety function will occur immediately.

[0111] Furthermore, as a safety feature, it is conceivable that a check for the presence and / or wearing of the smart glasses 1 is performed as soon as user 3 enters vehicle 2. Should this be the case, as a safety feature, vehicle 2 cannot be started by user 3 at all, as the vehicle is placed in a non-drivable state. Each user 3 can then be informed via voice output that vehicle 2 can only be started again once they have removed the smart glasses 1.

[0112] In an optional step S5, continuous monitoring and / or recording of user 3 in and / or on the vehicle can be carried out. This also occurs even if the safety function has already been activated. If, for example, user 3 removes the data glasses 1 due to the issued warnings and thus no longer wears them, this can be detected by the system. Should this be the case, user 3 is then able to resume certain driving tasks and / or observe the vehicle's progress. 4 24-0390 PIF

[0113] 20. This allows for the deactivation of the already activated security function to return vehicle 2 to its initial state. For example, in the event of repeated misuse of the smart glasses 1, vehicle 2 can remain in a secure state for a certain period of time to moderate user 3's actions. This period can also be scaled, so that the secure state is initially maintained for a short time and then for increasingly longer periods.

[0114] -0390 PIF

[0115] 21

[0116] Reference symbol list

[0117] smart glasses

[0118] vehicle

[0119] users

[0120] electronic safety system for vehicle movement

[0121] Vicinity

[0122] Recording device electronic evaluation unit

[0123] Area

[0124] Head-specific identifying feature

[0125] control unit

[0126] route

[0127] Holding position electronic output unit up to S5 steps

Claims

24-0390 PIF 22 Patent claims 1. Method for operating an electronic security system (5) of a vehicle (2), wherein - a user (3) of the vehicle (2) is detected by a detection device (7), - based on the recorded user (3) by an electronic evaluation unit (8) of the electronic security system (5) it is determined whether the user (3) is wearing data glasses (1), for this purpose the electronic evaluation unit (8) checks whether a specific identification feature (11) of the data glasses (1), with which the data glasses (1) can be identified, is detectable, - if it is determined that the user (3) is wearing the data glasses (1), a hazard information regarding a danger emanating from wearing the data glasses (1) is generated by the electronic evaluation unit (8), and - the electronic security system (5) is operated in such a way that at least one security function is activated on the basis of the hazard information.

2. Method according to claim 1, wherein the activated at least one safety function is used to perform a system-side intervention in the driving behavior of the vehicle (2), wherein environmental information relating to an environment (6) of the vehicle (2) and / or position information relating to a position of the vehicle (2) is provided to the electronic safety system (5), wherein the system-side intervention is performed on the basis of the environmental information and / or the position information.

3. Method according to claim 2, wherein the system-side intervention in the driving behavior is carried out by reducing the speed of the vehicle (2) and / or adjusting the trajectory of the vehicle (2) and / or adjusting the route guidance of the vehicle (2). 24-0390 PIF 23 4. Method according to claim 2, wherein with the activated at least one safety function an emergency stop maneuver and / or a maneuver with minimal risk is automatically performed, in particular a stopping position (14) is determined on the basis of the environmental information and / or the position information.

5. Method according to one of the preceding claims, wherein the user (3) is detected when entering the vehicle (2), wherein if it is determined that the user (3) is already wearing the data glasses (1) when entering, then the vehicle (2) is placed in a non-ready-to-drive state by means of at least one safety function.

6. A method according to one of the preceding claims, wherein when it is determined that the user (3) is wearing the data glasses (1), a warning is issued to the user (3) in the vehicle (2) acoustically, visually, kinesthetically and / or haptically, wherein the warning informs the user (3) that at least one safety function is activated, in particular the warning informs the user (3) that the data glasses (1) must be removed in order to minimize the danger emanating from wearing the data glasses (1) and in particular to deactivate the safety function.

7. Method according to one of the preceding claims, wherein the user (3) is continuously detected so that, based on the detected user (3), it can be continuously determined by the electronic evaluation unit (8) whether the user (3) is wearing the data glasses (1), wherein if it is determined that the user (3) is no longer wearing the data glasses (1), the already activated at least one security function is deactivated again.

8. Method according to one of the preceding claims, wherein the user (3) is detected by the detection device (7) in such a way as to detect an area (9) of a head (10) of the user (3), wherein the detected user (3) is checked by the electronic evaluation unit (8) to see whether the specific identification feature (11), which is on a surface of the 24-0390 PIF 24 The data glasses (1) are arranged in the detected area (9) of the head (10) of the user (3) and can be detected.

9. Method according to claim 8, wherein the specific identification feature (11), which is designed as an optoelectronically readable code, in particular as a QR code, is detected on the basis of image processing in the captured area (9) of the head (10) of the user (3).

10. Electronic security system (5) comprising an electronic evaluation unit (8) and a control unit (12), wherein the electronic security system (5) is configured to execute a method according to one of the preceding claims.

11. Vehicle (2) with an electronic safety system (5) according to claim 10.

Images