Vehicle, device, data carrier, computer program and method for a vehicle

Abstract

Embodiments of the present disclosure relate to a vehicle, a device, a data carrier, a computer program and a method for a vehicle. The method comprises acquiring information about at least one object in an environment of the vehicle from sensor data of at least one environmental sensor of the vehicle and providing the information to generate a characteristic sound for the object in an interior of the vehicle.

Description

[0001] The embodiments disclosed herein relate to a vehicle, a device, a data carrier, a computer program, and a method for using a vehicle. Specifically, this disclosure relates to a concept for improving perception of the in-vehicle environment.

[0002] Modern cars are increasingly designed with advanced sound insulation technology to enhance the driving experience. This trend aims to reduce external noise, such as traffic noise, wind noise, and engine noise, thereby creating a quieter and more comfortable cabin environment. However, this enhanced sound insulation can impair the driver's and passengers' perception of their surroundings, leading to several potential problems.

[0003] One concern is that decreased hearing makes it difficult to detect important auditory cues in the environment. For example, the sirens and horns of emergency vehicles, or even the noise of approaching vehicles, can be attenuated or completely blocked. This delays the driver's reaction time in emergency situations, potentially increasing the risk of accidents. Pedestrians, cyclists, and other road users can approach vehicles without the driver's awareness. Especially in modern soundproofed cars, even if these entities emit relevant sounds, they may be inaudible. The reduced awareness of the driver's surroundings due to sound insulation can jeopardize the safety of these vulnerable road users.

[0004] However, reducing vehicle sound insulation will increase noise inside the vehicle cabin, thus affecting the user experience.

[0005] Therefore, there is a need for concepts to improve the perception of the in-vehicle environment.

[0006] This need can be met by the subject matter of the appended independent claims. The following appended dependent claims disclose optional embodiments.

[0007] The basic idea behind the proposed concept is to detect objects in the vehicle environment and play sounds associated with the detected objects inside the vehicle to enhance the vehicle's passengers' (e.g., the driver's) perception of the environment.

[0008] An implementation provides a method for a vehicle. The method includes acquiring information about at least one object in the environment of the vehicle from sensor data of at least one environmental sensor of the vehicle, and providing the information to generate characteristic sounds for the object inside the vehicle.

[0009] In this way, passengers inside can perceive objects in their environment. Thus, the proposed concept provides a very natural and undistracted perception of objects.

[0010] The described concept offers several technological advantages for vehicle systems.

[0011] By generating characteristic sounds of objects inside the vehicle, the method provides an intuitive, non-visual way to alert the driver or passengers. The proposed auditory feedback concept can reduce the driver's cognitive load. Instead of constantly monitoring visual displays, the driver can rely on auditory cues to understand their surroundings, thus focusing more on driving.

[0012] Furthermore, the system can distinguish various objects and generate different sounds for each, which helps to quickly identify the nature of the object, such as whether it is a pedestrian, another vehicle, or an obstacle. This targeted approach allows drivers to react faster and more appropriately, thereby further improving safety.

[0013] In some implementations, the information includes, for example, information about the type, location, and / or movement of the object. Therefore, the generated sound can indicate the type, location, and / or movement of the object.

[0014] For example, different sounds can be applied to different types of objects.

[0015] Alternatively, or additionally, the spatial characteristics of the sound can indicate the position and / or movement of the object. For example, by altering the directionality, volume, and timing of the sound, a 3D sound system can create auditory illusions of object position and movement. This can further improve the perception of the environment. Specifically, the information regarding the type, position, and / or movement of the object provides a more detailed perception of the environment. This provides the driver with more detailed auditory feedback, enabling more informed driving decisions and thus improving safety.

[0016] In some implementations, the method further includes generating an acoustic signal for the characteristic sounds in the interior of the vehicle based on the information.

[0017] In some implementations, generating the sound includes selecting at least one of a plurality of predefined sounds for the object based on the information.

[0018] Using predefined sounds simplifies implementation and reduces computational load. By selecting from a predefined sound library based on object information, the system avoids the need for real-time sound synthesis, which consumes significant resources. Predefined sounds can be stored in a database and quickly retrieved when needed, ensuring fast response times. This also makes auditory cues (sounds) consistent and recognizable, thus improving the user experience.

[0019] Therefore, in some implementations, the information indicates the relative position and / or movement of the object relative to the vehicle, and the sound is a more dimensional or spatial sound, for example, a three-dimensional (3D) sound indicating the relative position and / or movement of the object.

[0020] It should also be noted that the proposed method can be implemented at least in part as a computer program and / or a computer-implemented method. Therefore, the steps and / or features of the described embodiments can be implemented in a computer program that, when executed by a computer or any kind of programmable hardware, causes the computer or hardware to perform one or more steps or portions of the proposed method.

[0021] A further embodiment provides a computer program including instructions that, when executed by a computer, cause the computer to perform the proposed method.

[0022] A further embodiment provides a computer-readable data carrier storing an embodiment of the proposed computer program.

[0023] A further embodiment provides an apparatus for a vehicle. The apparatus includes one or more interfaces for communication, and data processing circuitry configured to perform the proposed method.

[0024] In some embodiments, the device further includes: at least one environmental sensor for acquiring information about at least one object in the environment of the vehicle from sensor data of the environmental sensor; and / or a sound generator for generating sound inside the vehicle.

[0025] A further implementation provides a vehicle that includes the proposed equipment.

[0026] Furthermore, embodiments will now be described with reference to the accompanying drawings. It should be noted that the embodiments shown in the drawings are merely optional embodiments illustrated as examples, and the scope of this disclosure is by no means limited to the presented embodiments: Attached Figure Description

[0027] Figure 1 A flowchart illustrating an embodiment of a method for a vehicle is shown; Figure 2 A block diagram schematically illustrating an embodiment of the apparatus according to the proposed method is shown; and Figure 3 Another implementation of the proposed device is illustrated schematically.

[0028] As mentioned earlier, improving vehicle sound insulation to reduce annoying vehicle noise actually comes at the cost of sacrificing environmental perception.

[0029] The proposed method provides a solution that offers better auditory feedback of the vehicle environment while maintaining sound insulation.

[0030] Figure 1 A flowchart illustrating an embodiment of the method 100 for a vehicle is shown.

[0031] It should be noted that, in the context of this disclosure, the term "vehicle" is interpreted broadly. Therefore, a vehicle according to this disclosure may include any kind of vehicle, including various ground vehicles (e.g., automobiles, trucks, buses, motorcycles and / or similar vehicles), various water vehicles (e.g., boats), various aircraft (e.g., airplanes, helicopters) and / or combinations thereof (e.g., amphibious vehicles).

[0032] The described method may comprise multiple steps, which can be performed in various arrangements. These arrangements may include combinations or splits of certain steps, thus providing flexibility in implementing the method. Depending on specific requirements and conditions, the steps may be performed in different orders or simultaneously. This adaptability ensures that the method can be tailored to various applications and scenarios, thereby providing a comprehensive approach to achieve the desired results.

[0033] As can be seen, method 100 includes obtaining 110 information about at least one object in the environment of the vehicle from sensor data of at least one environmental sensor of the vehicle.

[0034] In some implementations, the object may include, but is not limited to, pedestrians, other vehicles, bicycles / cyclists, animals, and / or any other object present in the traffic environment. The environment may include various locations such as urban areas, highways, rural roads, parking lots, and intersections. Environmental sensors may include, but are not limited to, radar sensors, lidar sensors, ultrasonic sensors, cameras, and infrared sensors. In practice, for example, the information about the object is determined based on advanced driver assistance system (ADAS) object tracking information (lidar, camera, ultrasonic, map data, other sources) that allows for the identification and location of object types.

[0035] The information about the object obtained from the sensor data may include various attributes such as object type, (relative) position, velocity, direction of motion, and / or relative speed. For example, the object type may be identified as a pedestrian, vehicle, or bicycle / cyclist. Information about the position may include information about the distance to a vehicle.

[0036] Position can be determined using coordinates relative to the vehicle, while speed and direction of motion indicate the speed and direction of an object's movement. Distance from the vehicle provides information about how far the object is from the vehicle, while relative speed indicates the speed difference between the object and the vehicle.

[0037] In addition, method 100 includes providing the information 120 to generate characteristic sounds for the objects inside the vehicle.

[0038] To create characteristic sounds for objects, information can be provided to generate appropriate predefined sounds or to select appropriate predefined sounds from a sound library.

[0039] Information can be sent to or made available to a data processing circuit configured to acquire sound based on the information. The data processing circuit may be the same as or separate from the data processing circuit used to acquire and / or provide information about an object.

[0040] To generate sound, a suitable electroacoustic signal can be produced. This electroacoustic signal can then be converted into audible sound inside the vehicle. For this purpose, desired sound characteristics such as frequency, amplitude, and duration can be encoded into the electroacoustic signal. This signal can then be amplified and sent to one or more speakers inside the vehicle, causing the speakers to emit the desired sound.

[0041] In reality, different objects may be associated with different sounds. For example, a pedestrian may be associated with a specific sound that is different from the sound associated with another vehicle, animal, and / or bicycle.

[0042] Then, for each object that approaches or is very close to the car, a “typical” sound is generated and output via 3D sound generation so that the driver can subconsciously hear the object and locate it in space, thereby helping to improve traffic safety, for example, by making the driver aware of objects in blind spots or to roughly detect the presence of children or animals that may approach the vehicle in unpredictable ways.

[0043] Position and motion information can be used to adjust the spatial characteristics of sound, such as directionality and volume, to reflect the position and motion of an object relative to the vehicle. For example, if a pedestrian is detected moving towards the vehicle from the left, sound can be played from the left speaker and increased in volume as the pedestrian approaches. When the pedestrian crosses the vehicle from the left to the right, the right speaker can take over playing the sound.

[0044] Those skilled in the art who benefit from this disclosure will understand that, similarly, various other spatial sound techniques can be applied to reflect spatial properties, such as the position and movement of objects.

[0045] The system can also use additional information, such as the speed of the object, to further refine the characteristic sound. Objects such as trucks may be associated with a lower, deeper sound, while smaller vehicles such as cars may be associated with a higher, more resonant sound.

[0046] Similarly, the speed of an object can affect the rhythm or beat of a sound; a faster-moving object produces a faster, more rapid sound. Furthermore, the Doppler effect can be applied to sound to indicate whether an object is approaching or moving away from a vehicle.

[0047] Information about motion and / or relative position can also be used to consider only objects that are close to or near (e.g., objects that are closer than a predefined distance). For example, sound may only be generated when an object is close to a vehicle and / or within a predefined distance of the vehicle.

[0048] By utilizing detailed information about objects, the system can generate characteristic sounds that provide drivers with intuitive and immediate auditory feedback, thereby enhancing environmental awareness and safety. Efficient processing is achieved using predefined sounds modulated based on object attributes, reducing the computational resources required for real-time sound synthesis. This approach ensures the system can quickly and accurately deliver critical information to the driver, thus improving the overall driving experience.

[0049] The above details can be implemented in combination or individually in the implementation of the proposed concept.

[0050] In a preferred embodiment, for example, for each object approaching the vehicle or closer than a predefined distance, a “typical” sound associated with the object type is generated and output via 3D sound generation so that the driver can subconsciously hear the object and locate it in space, thereby helping to improve traffic safety, for example, enabling the driver to perceive objects in blind spots or to be roughly aware of the presence of children or animals that may approach the vehicle in unpredictable ways.

[0051] A "typical" or characteristic sound can be any sound associated with a corresponding type of object. Typical sounds for different objects can be designed to make them intuitively identifiable. For a cyclist, this might be a bicycle bell or hum, the sound of bicycle gears, a cyclist's shout or groan, or the sound of poorly maintained brakes or drive chain. Pedestrians might be associated with soft tapping sounds, footsteps, and / or sounds similar to human voices (e.g., composed of several phonemes). A group of people can be represented by conversational sounds. A car might emit a moderate engine hum or a deep rumble. A truck could be represented by a deeper, more resonant engine noise or a heavy rumble. Animals might have characteristic sounds, such as a dog barking, a cat meowing, or a bird chirping. These sounds help drivers quickly identify object types and respond appropriately.

[0052] Therefore, the embodiments of this disclosure can reduce the degree to which a driver is isolated from the outside world in a soundproof vehicle. It restores the driver's ability to locate approaching or surrounding objects by enhancing the acoustic environment around the driver, enabling them to hear sounds that objects around the vehicle would normally make, thus allowing the driver to perceive these objects. Even if the object does not make a sound, it can be heard by generating sounds that the object could make.

[0053] Another implementation of the proposed method may include the following steps: 1. Identify objects that are approaching or are moving closer (so that the object becomes closer within a predefined time period, such as 5 seconds). 2. For example, using camera and its sensor data to identify object types.

[0054] 3. Select the sounds that this type of object can produce (e.g., from a sample library or an algorithmic sound generator for each object type).

[0055] 4. This sound is generated in a way that allows the driver to accurately locate its position in space and the noise level of the sound is perceptible to the driver.

[0056] Figure 2 A block diagram schematically illustrating an embodiment of such a device 200 is shown. The device includes one or more interfaces 210 for communication, and data processing circuitry 220 configured to perform the proposed method.

[0057] In the implementation, one or more interfaces 210 may include wired and / or wireless interfaces for transmitting and / or receiving communication signals in conjunction with the execution of the proposed concept. In practice, the interface may include, for example, pins, wires, antennas, and / or the like. Furthermore, the interface may include means for performing (analog and / or digital) signal or data processing in conjunction with communication (e.g., filters, samplers, analog-to-digital converters), signal acquisition and / or reconstruction means, and signal amplifiers, compressors, and / or any encryption / decryption means.

[0058] Data processing circuitry 220 may correspond to or include any type of programmable hardware. Therefore, examples of data processing circuitry 220 include, for example, memory, microcontroller, field-programmable gate array, one or more central processing units and / or graphics processing units. To perform the proposed method, data processing circuitry 220 may be configured to access or retrieve appropriate computer programs for performing the proposed method from its own memory or a separate memory communicatively coupled to it.

[0059] In practice, the proposed device can be installed on a vehicle. Therefore, the implementation scheme can also provide a vehicle that includes the proposed device.

[0060] Figure 3 An alternative embodiment 300 of the proposed device is illustrated schematically.

[0061] For example, device 300 further includes: at least one environmental sensor 310 (see above for more details), the environmental sensor being used to acquire information about at least one object in the vehicle's environment from sensor data of the environmental sensor; and a sound generator 330, the sound generator being used to generate sound inside the vehicle.

[0062] For example, environmental sensor 310 provides sensor data to data processing circuit 320, which is configured to perform an implementation of the proposed method. For instance, the data processing circuit acquires information about an object based on the sensor data and emits sound based on that information (see above for further details). Furthermore, data processing circuit 320 generates an electroacoustic signal to produce sound. The electroacoustic signal is provided to sound generator 330, which converts the electroacoustic signal into sound waves to produce the acquired sound associated with the object.

[0063] As mentioned above, sound or electroacoustic signals can be adjusted based on information about the object's type, relative position, and motion.

[0064] As can be seen in the foregoing description, various features are grouped together in the examples for the purpose of simplification. This approach of the disclosure should not be construed as reflecting an intention that the claimed examples require more features than are expressly recited in each claim. Rather, as reflected in the appended claims, the subject matter of the invention may lie in fewer than all the features of a single disclosed example. Therefore, the appended claims are incorporated herein by reference, wherein each claim may itself serve as a separate example. While each claim may itself serve as a separate example, it should be noted that although dependent claims may refer to a specific combination with one or more other claims in the claims, other examples may also include combinations of dependent claims with the subject matter of each other dependent claim, or combinations of each feature with other dependent or independent claims. Such combinations are proposed herein unless it is stated that a specific combination is not contemplated. Furthermore, even if a claim is not directly dependent on any other independent claim, the features of that claim are contemplated to be included in that independent claim.

[0065] While specific embodiments have been shown and described herein, those skilled in the art will understand that various alternatives and / or equivalent implementations may be substituted for the specific embodiments shown and described without departing from the scope of the invention. This application is intended to cover any adaptations or variations of the specific embodiments discussed herein. Therefore, it is contemplated that the embodiments are limited only by the claims and their equivalents.

Claims

1. A method (100) for a vehicle, the method (100) comprising: (110) Information about at least one object in the environment of the vehicle is obtained from sensor data of at least one environmental sensor of the vehicle; as well as The information (120) is provided to generate characteristic sounds for the objects inside the vehicle.

2. The method (100) of claim 1, wherein the information includes information about the type, location and / or movement of the object.

3. The method (100) of claim 1 or 2, wherein the method (100) further comprises generating an acoustic signal for the characteristic sound in the interior of the vehicle based on the information.

4. The method (100) of claim 3, wherein generating the sound includes selecting at least one of a plurality of predefined sounds of the object based on the information.

5. The method (100) as described in any of the preceding claims, wherein the information indicates the relative position and / or movement of the object relative to the vehicle, and wherein the sound is a spatial sound indicating the relative position and / or movement of the object.

6. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method (100) of any one of claims 1 to 5.

7. A computer-readable data carrier storing the computer program of claim 6.

8. A device (200, 300) for a vehicle, said device comprising: One or more interfaces (210) for communication; as well as A data processing circuit (220, 320) configured to perform the method (100) of any one of claims 1 to 5.

9. The device (200, 300) as claimed in claim 8, wherein the device further comprises: At least one environmental sensor (310) is used to acquire information about at least one object in the environment of the vehicle from sensor data of the environmental sensor; and / or A sound generator (330) is used to generate sound inside the vehicle.

10. The device (200) of claim 9, wherein the information indicates the relative position and / or movement of the object relative to the vehicle, wherein the sound generator is configured to generate three-dimensional (3D) sound, and wherein the sound is a 3D sound indicating the relative position and / or movement of the object.

11. A vehicle comprising the apparatus (200, 300) of claim 10.

Images