Control method for vehicle-mounted loudspeaker and related device
Patent Information
- Application Number
- PCT/CN2024/080839
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-08
- Publication Date
- 2025-10-02
AI Technical Summary
The fixed position and orientation of the speakers in the car lead to differences in passengers' hearing experience, especially for passengers who are not facing the speakers directly, who cannot hear the sound directly, affecting the riding experience.
By adjusting the orientation and playback parameters of the vehicle speakers, the frequency response curve at the target passenger position meets the preset conditions, including automatic or manual adjustment of the speaker orientation and adjusting the playback parameters according to the corresponding relationship between the target passenger position and the stored in the vehicle.
The listening experience in every position in the car is improved, especially for passengers who are not directly facing the speaker, achieving better listening effects and realizing high-quality audio playback without the need for professional audio knowledge.
Smart Images

Figure CN2024080839_02102025_PF_FP_ABST
Abstract
Description
A control method and related equipment for vehicle-mounted speakers Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a control method and related equipment for a vehicle-mounted speaker. Background Art
[0002] With the advancement of automotive technology, people's demands for vehicle comfort are increasing. Audio playback devices (e.g., speakers) have gradually become an indispensable feature of automobiles, providing a comfortable music environment for drivers and passengers. Currently, speakers are fixed in position and orientation within the vehicle, resulting in different hearing experiences for passengers in different positions within the vehicle. This is especially true for passengers not facing the speakers. Since the sound from the speakers cannot reach them directly, the sound is not focused, affecting the riding experience.
[0003] Summary of the Invention
[0004] The embodiments of the present application provide a control method and related equipment for a vehicle-mounted speaker to enhance the listening experience of passengers.
[0005] In a first aspect, a method for controlling an in-vehicle speaker is provided. The method may include: controlling the in-vehicle speaker to face the target passenger based on the target passenger's location or the orientation adjustment operation of the in-vehicle speaker; and adjusting playback parameters of the in-vehicle speaker so that the frequency response curve of the sound from the in-vehicle speaker at the target passenger's location meets preset conditions.
[0006] In this embodiment of the present application, not only can the orientation of the vehicle speaker be adjusted to face the target passenger, but the playback parameters of the vehicle speaker can also be adjusted so that the frequency response curve of the vehicle speaker at the target passenger's position meets preset conditions, thereby improving the target passenger's in-vehicle listening experience. Compared with solutions that simply adjust the orientation of the vehicle speaker without adjusting the playback parameters of the vehicle speaker, the technical solution provided by this embodiment of the present application improves the listening experience of the target passenger.
[0007] In embodiments of the present application, the orientation of the vehicle speakers can be adjusted automatically or manually. For example, after the vehicle determines the location of a target passenger, it can automatically adjust the orientation of the vehicle speakers based on the target passenger's location, so that the speakers face the target passenger. For example, for manual adjustment, the vehicle can include buttons, handles, or other devices that allow passengers to manually adjust the orientation of the vehicle speakers; alternatively, the vehicle display can include a display component for adjusting the vehicle speakers, which allows passengers to adjust the orientation of the vehicle speakers using this display component.
[0008] Optionally, the playback parameters of the vehicle-mounted speaker may include one or more of high-frequency parameters, mid-frequency parameters, and low-frequency parameters. High frequency can be understood as sound whose audio frequency band is in the high-frequency band. The high-frequency band may include, for example, 2000Hz to 20000Hz. High-frequency parameters may include the volume value and phase corresponding to the high-frequency band. Mid-frequency can be understood as sound whose audio frequency band is in the mid-frequency band. The mid-frequency band may include, for example, 500Hz to 2000Hz. Mid-frequency parameters may include the volume value and phase corresponding to the mid-frequency band. Low frequency can be understood as sound whose audio frequency band is in the low-frequency band. The low-frequency band may include, for example, 20Hz to 500Hz. Low-frequency parameters may include the volume value and phase corresponding to the low-frequency band. It should be noted that the division of high frequency band, mid-frequency band, and low frequency band here is only an example, and there may be more division methods, which are not limited in the embodiments of the present application.
[0009] It is worth noting that adjusting the playback parameters of a car speaker (e.g., high-frequency parameters, mid-frequency parameters, and low-frequency parameters) often requires professional audio knowledge. For users without professional audio knowledge, adjusting the playback parameters to improve the playback effect (e.g., flattening the frequency response curve) is somewhat difficult. In the embodiment of the present application, the playback parameters of the car speaker can be automatically adjusted, and the adjusted playback parameters can ensure that the frequency response curve of the car speaker's sound at the target passenger's position meets preset conditions (e.g., a relatively flat frequency response curve), eliminating the need for manual adjustment of the playback parameters and reducing the difficulty of use.
[0010] In a possible design, the preset condition is that the fluctuation range of the frequency response curve is within a preset range.
[0011] In the embodiment of the present application, the horizontal axis of the frequency response curve is frequency, and the vertical axis is amplitude (or loudness). The fluctuation range of the frequency response curve can include: the difference between the amplitudes corresponding to different frequencies on the frequency response curve, that is, the difference between the vertical axes corresponding to different horizontal axes. The fluctuation range of the frequency response curve is within a preset range, that is, the difference between the amplitudes corresponding to different frequencies on the frequency response curve is within a preset range. In this way, the overall fluctuation of the frequency response curve can be controlled to not exceed the preset range. The smaller the fluctuation of the frequency response curve, the flatter the frequency response curve, the more balanced the spectrum, the less distortion of the sound heard by the target passengers, and the higher the quality.
[0012] In a possible design, the fluctuation range of the frequency response curve is within a preset range includes: a difference between the frequency response curve and a preset frequency response curve is within a preset range.
[0013] In this embodiment of the present application, the difference between the frequency response curve and the preset frequency response curve can include the difference between the amplitudes corresponding to the same frequency on the frequency response curve and the preset frequency response curve. In this way, the frequency response curve can be controlled to be closer to the preset frequency response curve, so that the sound effect heard by the target passenger matches the sound effect corresponding to the preset frequency response curve.
[0014] In one possible design, a first correspondence is stored in the vehicle, which includes different positions in the vehicle and preset frequency response curves corresponding to the different positions in the vehicle. The method further includes: determining the preset frequency response curve corresponding to the target passenger's position based on the target passenger's position and the first correspondence.
[0015] In an embodiment of the present application, the playback parameters are adjusted differently when the vehicle speaker is facing different passengers. For example, when the vehicle speaker is facing passenger A, the playback parameter is adjusted to parameter A. Parameter A can make the frequency response curve of the vehicle speaker's sound at passenger A's position close to the preset frequency response curve A (the preset frequency response curve corresponding to passenger A's position in the first correspondence). When the vehicle speaker is facing passenger B, the playback parameter is adjusted to parameter B. Parameter B can make the frequency response curve of the vehicle speaker's sound at passenger B's position close to the preset frequency response curve B (the preset frequency response curve corresponding to passenger B's position in the first correspondence). In this way, when the vehicle speaker is facing different positions in the vehicle, the playback parameters can be adjusted to achieve the corresponding sound effect at each position (i.e., the sound effect corresponding to the preset frequency response curve for each position in the first correspondence), thereby ensuring that each position in the vehicle can have an optimal listening experience.
[0016] In one possible design, a second correspondence is stored in the vehicle, and the second correspondence includes different positions in the vehicle and the playback parameters corresponding to the different positions in the vehicle, and the playback parameters corresponding to the different positions make the frequency response curve of the sound of the vehicle speaker at the corresponding position in the different positions meet the preset conditions; adjusting the playback parameters of the vehicle speaker includes: adjusting the playback parameters of the vehicle speaker according to the position of the target passenger and the second correspondence.
[0017] In this embodiment, not only can the orientation of the vehicle's speakers be adjusted to face the target passenger, but the playback parameters of the vehicle's speakers can also be adjusted so that the frequency response curve of the sound from the vehicle's speakers at the target passenger's location meets preset conditions, thereby improving the target passenger's in-vehicle listening experience. Furthermore, the playback parameters are adjusted based on the target passenger's location and the first correspondence stored in the vehicle, eliminating the need for manual adjustment and providing a better listening experience.
[0018] In one possible design, the second correspondence also includes audio playback modes corresponding to different positions in the car; according to the position of the target passenger and the second correspondence, the playback parameters of the car speaker are adjusted, including: according to the position of the target passenger, the first audio playback mode, and the second correspondence, the playback parameters of the car speaker are adjusted, and the first audio playback mode is the mode of the currently playing audio.
[0019] In the embodiment of the present application, not only can the direction of the vehicle speaker be adjusted to face the target passenger, but the playback parameters of the vehicle speaker can also be adjusted according to the location of the target passenger. Moreover, when adjusting the playback parameters of the vehicle speaker, the current audio playback mode can be comprehensively considered to improve accuracy.
[0020] In one possible design, adjusting the playback parameters of the vehicle-mounted speaker includes: receiving sound information of the vehicle-mounted speaker at the location of the target passenger collected by a sound collection device; and adjusting the playback parameters of the vehicle-mounted speaker according to the sound signal.
[0021] In an embodiment of the present application, after adjusting the direction of the vehicle-mounted speaker toward the target passenger, the sound collection device at the target passenger's location can collect sound information from the vehicle-mounted speaker, and adjust the playback parameters of the vehicle-mounted speaker based on the sound information to improve accuracy.
[0022] In one possible design, adjusting the playback parameters of the vehicle-mounted speaker based on the sound signal includes: obtaining relative position information between the sound collection device and the position of the target passenger; and adjusting the playback parameters of the vehicle-mounted speaker based on the sound signal and the relative position information.
[0023] In the embodiment of the present application, considering that there is a certain distance between the sound collection device and the target passenger, the sound information of the vehicle-mounted speaker collected by the sound collection device is not necessarily the same as the sound information of the speaker heard by the target passenger at the location. In order to improve the accuracy of the playback parameter adjustment, it can be adjusted according to the relative position information between the sound collection device and the target passenger.
[0024] In one possible design, the method further includes: adjusting the volume of the vehicle-mounted speaker according to the relative distance between the vehicle-mounted speaker and the target passenger.
[0025] In the embodiment of the present application, while the vehicle-mounted speaker is facing the target passenger, the volume of the vehicle-mounted speaker is adjusted in real time with the relative distance between the vehicle-mounted speaker and the target passenger, ensuring that the volume of the sound heard by the target passenger is relatively smooth.
[0026] In one possible design, after controlling the vehicle speaker to face the target passenger and adjusting the playback parameters of the vehicle speaker, the method further includes: obtaining feedback from the target passenger on the output sound of the vehicle speaker, the feedback including sound feedback and / or facial expression feedback; and adjusting the playback parameters of the vehicle speaker again based on the feedback.
[0027] In an embodiment of the present application, after the vehicle-mounted speaker is directed toward the target passenger and the playback parameters are adjusted, feedback from the target passenger can be obtained. If it is determined through the feedback from the target passenger that the adjustment effect is not good, the playback parameters can be adjusted again to ensure the user's auditory experience.
[0028] In one possible design, the target passenger's position includes: the specific position of the target passenger or the orientation of the target passenger relative to the vehicle-mounted speaker, and the specific position includes: one of the position of the target passenger's seat, the position of the headrest of the target passenger's seat, the position of the target passenger's head, and the position of the target passenger's ear.
[0029] In the embodiment of the present application, the car speaker can be directed to various positions in the car, which is relatively flexible, and the playback parameters can be adjusted when directed to various positions so that the frequency response curve of the car speaker's sound at various positions meets the preset conditions, thereby ensuring a better listening experience at various positions in the car.
[0030] In one possible design, before determining the location of the target passenger in the vehicle, the method further includes: collecting a passenger's facial image and determining that a passenger whose facial features match pre-stored facial features is the target passenger; or, collecting a passenger's voice signal and determining that a passenger whose voice signal matches a pre-stored voice signal is the target passenger; or, receiving a designated operation of the target passenger through an on-board display screen, and determining the target passenger based on the operation.
[0031] In the embodiment of the present application, the vehicle can identify the target passenger through various methods, such as facial features, voice features, and user-specified features, which are not limited in the present embodiment. After the target passenger is identified, the vehicle's speakers can be adjusted toward the target passenger and the playback parameters of the speakers can be adjusted so that the frequency response curve of the sound from the speakers at the target passenger's location meets preset conditions, thereby improving the target passenger's listening experience.
[0032] In one possible design, the vehicle-mounted speaker includes a tweeter. It should be noted that the embodiment of the present application does not limit the type of the vehicle-mounted speaker, which may be a tweeter, a midrange speaker, a woofer, etc.
[0033] In a second aspect, a control device for a vehicle-mounted speaker is provided, comprising a processor and a memory, wherein the processor and the memory are connected, and the memory stores a computer program. When the computer program stored in the memory is executed by the processor, the device performs:
[0034] According to the position of the target passenger or the direction adjustment operation of the vehicle speaker, the vehicle speaker is controlled to face the target passenger;
[0035] The playback parameters of the vehicle-mounted speaker are adjusted so that the frequency response curve of the sound of the vehicle-mounted speaker at the target passenger position meets a preset condition.
[0036] In a possible design, the preset condition is that the fluctuation range of the frequency response curve is within a preset range.
[0037] In a possible design, the fluctuation range of the frequency response curve is within a preset range, including: a difference between the frequency response curve and a preset frequency response curve is within a preset range.
[0038] In one possible design, a first correspondence is stored in the vehicle, and the first correspondence includes different positions in the vehicle and preset frequency response curves corresponding to the different positions in the vehicle; when the computer program stored in the memory is executed by the processor, the device further performs: determining the preset frequency response curve corresponding to the target passenger's position based on the target passenger's position and the first correspondence.
[0039] In one possible design, a second correspondence is stored in the vehicle, and the second correspondence includes different positions in the vehicle and the playback parameters corresponding to the different positions in the vehicle, and the playback parameters corresponding to the different positions make the frequency response curve of the sound of the vehicle speaker at the corresponding position in the different positions meet the preset conditions; when the computer program stored in the memory is executed by the processor, the device specifically performs: adjusting the playback parameters of the vehicle speaker according to the position of the target passenger and the second correspondence.
[0040] In one possible design, the second correspondence also includes audio playback modes corresponding to different positions in the vehicle; when the computer program stored in the memory is executed by the processor, the device specifically performs: adjusting the playback parameters of the vehicle speaker according to the position of the target passenger, the first audio playback mode, and the second correspondence, where the first audio playback mode is the mode of the currently playing audio.
[0041] In one possible design, when the computer program stored in the memory is executed by the processor, the device specifically performs the following steps: receiving sound information of the vehicle-mounted speaker at the location of the target passenger collected by a sound collection device; and adjusting the playback parameters of the vehicle-mounted speaker according to the sound signal.
[0042] In one possible design, when the computer program stored in the memory is executed by the processor, the device specifically performs the following steps: obtaining relative position information between the sound collection device and the location of the target passenger; and adjusting the playback parameters of the vehicle-mounted speaker based on the sound signal and the relative position information.
[0043] In one possible design, when the computer program stored in the memory is executed by the processor, the device further performs: adjusting the volume of the vehicle-mounted speaker according to the relative distance between the vehicle-mounted speaker and the target passenger.
[0044] In one possible design, when the computer program stored in the memory is executed by the processor, the vehicle driving device further performs: obtaining the target passenger's feedback on the output sound of the vehicle speaker, the feedback including sound feedback and / or facial expression feedback; and adjusting the playback parameters of the vehicle speaker again based on the feedback.
[0045] In one possible design, the target passenger's position includes: the specific position of the target passenger or the orientation of the target passenger relative to the vehicle-mounted speaker, and the specific position includes: one of the position of the target passenger's seat, the position of the headrest of the target passenger's seat, the position of the target passenger's head, and the position of the target passenger's ear.
[0046] In one possible design, when the computer program stored in the memory is executed by the processor, the vehicle driving device further executes:
[0047] Collecting a passenger's facial image and determining a passenger whose facial features match pre-stored facial features as a target passenger; or,
[0048] Collecting a passenger's voice signal and determining a passenger whose voice signal matches a pre-stored voice signal as a target passenger; or,
[0049] The designated operation of the target passenger is received through the vehicle display screen, and the target passenger is determined according to the operation.
[0050] In one possible design, the vehicle-mounted speaker includes a tweeter.
[0051] In a third aspect, the present application provides a control device for a vehicle-mounted speaker, comprising modules / units for executing the method corresponding to any one of the designs in the first aspect. These modules / units may be implemented in hardware, or in hardware executing corresponding software implementations.
[0052] In a fourth aspect, the present application provides a vehicle, comprising: a control device for a vehicle-mounted speaker, wherein the control device for the vehicle-mounted speaker is configured to execute the method as described in any one of the above-mentioned first aspects.
[0053] In a fifth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by at least one processor, it implements the method described in any one of the first aspects above.
[0054] In a sixth aspect, the present application provides a chip comprising a processor and an interface; the processor is configured to read instructions through the interface to execute the method as described in any one of the first aspects above.
[0055] In a seventh aspect, the present application provides a computer program product, which includes a computer program. When the computer program runs on a computer, the computer can execute the method described in any one of the first aspects above.
[0056] The beneficial effects of the design in any of the second to seventh aspects can refer to the beneficial effects of the corresponding design in the first aspect, and this application will not elaborate on them one by one. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] FIG1 is a schematic diagram of a speaker orientation according to an embodiment of the present application;
[0058] FIG2 is a schematic diagram of a frequency response curve provided by an embodiment of the present application;
[0059] FIG3 is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0060] FIG4 is a schematic diagram of a vehicle provided in one embodiment of the present application;
[0061] FIG5 is a flow chart of a method for controlling a vehicle-mounted speaker according to an embodiment of the present application;
[0062] FIG6 is a schematic diagram of a vehicle-mounted display screen provided in one embodiment of the present application;
[0063] FIG7 is a schematic diagram of a control device for a vehicle-mounted speaker provided in one embodiment of the present application;
[0064] FIG8 is another schematic diagram of a control device for a vehicle-mounted speaker provided in an embodiment of the present application. DETAILED DESCRIPTION
[0065] Below, some terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.
[0066] (1), at least one of the embodiments of the present application includes one or more; wherein, more means greater than or equal to two. In addition, it should be understood that in the description of this specification, words such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as expressing or implying relative importance, nor can they be understood as expressing or implying order. For example, the first position and the second position do not represent the importance of the two or the order of the two, but are only for distinguishing descriptions. In the embodiments of the present application, "and / or" is only a description of the association relationship, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects related to each other are in an "or" relationship.
[0067] (2) The directional terms mentioned in the embodiments of the present application, such as "upper", "lower", "left", "right", "inner", "outer", etc., are only references to the directions in the drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of the present application, rather than indicating or implying that the devices or components referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the embodiments of the present application.
[0068] (3) References to "one embodiment," "in some examples," or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in one or more embodiments of this specification. Thus, phrases such as "in some examples," "in one embodiment," "in some other embodiments," and "in other embodiments" appearing in different places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0069] (4) The direction of the speaker, that is, the sound emitted by the speaker has directionality. For example, as shown in Figure 1, the acoustic axis (it can also be called other names) of the speaker is facing to the right, so the sound effect perceived by people to the right is better. For off-axis positions (i.e., positions that deviate from the acoustic axis by a certain angle), the sound will attenuate and the perceived sound effect will be poor. For example, the larger the off-axis angle, the poorer the perceived sound effect.
[0070] (5) Frequency response characteristics. Frequency response is the abbreviation of frequency response, which refers to the response ability of an acoustic device or equipment to signals of different frequencies. Optionally, the frequency response characteristics can be expressed in the form of a frequency response curve. For example, please refer to Figure 2, which is a schematic diagram of a frequency response curve. As shown in Figure 2, the horizontal axis of the frequency response curve represents the frequency of the sound, the unit is Hertz (Hz), and the vertical axis is the amplitude (or loudness), the unit is decibel (dB). It should be noted that Figure 2 is only an example of a frequency response curve, not a limitation of the frequency response curve.
[0071] Sound quality is related to the frequency response curve. For example, the flatter the frequency response curve, the less distortion and the higher the sound quality. Therefore, an ideal frequency response curve would be one that is straight and smooth, without distinct peaks and valleys. Generally speaking, by adjusting the playback parameters of car speakers (e.g., low-frequency parameters, mid-frequency parameters, high-frequency parameters, etc.), the frequency response curve of the sound output by the car speakers can be made as close to flat as possible. However, for users without professional audio knowledge, adjusting the playback parameters of car speakers to achieve a frequency response curve that is as close to flat as possible is relatively difficult.
[0072] Currently, in-vehicle speakers are generally oriented in a fixed direction, as shown in Figure 1 above. The sound emitted by the speakers is directional, resulting in different listening experiences at different locations within the vehicle. This is especially true for passengers not facing the speakers, as the sound cannot reach them directly and is attenuated, impacting their listening experience.
[0073] To address this technical problem, an embodiment of the present application provides a method for controlling an in-vehicle speaker, wherein the orientation of the in-vehicle speaker can be adjusted. For example, after the vehicle leaves the factory, the speaker is set to face the driver by default. During actual driving, the in-vehicle speaker can be directed toward passengers, such as the front passenger seat or rear passengers, thereby improving the passengers' listening experience.
[0074] Furthermore, in the vehicle speaker control method provided in the embodiment of the present application, while adjusting the vehicle speaker toward a certain passenger (for example, the front passenger seat passenger, the rear passenger), the playback parameters of the vehicle speaker can also be adjusted so that the frequency response curve of the sound of the vehicle speaker at the passenger's position meets preset conditions (for example, the frequency response curve is as close to flat as possible).
[0075] For ease of understanding, FIG3 shows an application scenario of an embodiment of the present application.
[0076] As shown in Figure 3 (a), the car speaker is located in the center console of the vehicle (also known as the center speaker). The car speaker is currently facing the driver. In this case, the playback parameter used by the car speaker is parameter 1. Parameter 1 ensures that the frequency response curve of the car speaker at the driver's position meets the preset conditions. As shown in Figure 3 (b), the car speaker has been adjusted to face the front passenger, and the playback parameter of the car speaker has been adjusted from parameter 1 to parameter 2. Parameter 2 ensures that the frequency response curve of the car speaker at the front passenger's position meets the preset conditions.
[0077] Therefore, the technical solution of the embodiment of this application not only adjusts the orientation of the car speaker, but also adjusts the playback parameters of the car speaker. No matter where the car speaker is facing, it can play sound using the playback parameters adapted to that position, thus ensuring an optimal listening experience in all positions. This process eliminates the need for manual adjustment of playback parameters and does not require the user to master professional audio knowledge. More professional playback parameters are automatically adjusted, improving operational convenience.
[0078] It should be noted that in the application scenario shown in Figure 3, the car speaker is a speaker installed in the center console of the vehicle (i.e., a center speaker) as an example. It can be understood that the car speaker can also be a speaker installed in other positions, such as the door, A-pillar / B-pillar / C-pillar, ceiling, seat headrest, trunk, etc. The embodiment of the present application does not limit the position of the speaker.
[0079] The control method of the vehicle-mounted speaker provided in the embodiment of the present application can be applied to a control device. The control device can be arranged in a vehicle. For example, the control device can automatically adjust the driving signal of the speaker in the vehicle according to the position of the target passenger detected by the detection device in the vehicle, so as to control the speaker in the vehicle to face the target passenger. In a specific example, the control device can be a vehicle-mounted terminal, a vehicle computer, an in-vehicle audio-visual entertainment device, etc. arranged in the vehicle. The above-mentioned detection device can be, for example, an image acquisition device, a sound acquisition device, etc. arranged in the vehicle. In some examples, the detection device can synchronize the detected data to the control device in real time or periodically, and the control device adjusts the direction and playback parameters of the in-vehicle speaker according to the detected data. Alternatively, the control device periodically queries the detection device for data, and the detection device sends the detected data to the control device after receiving the query request from the control device.
[0080] FIG4 shows a schematic structural diagram of a vehicle 100 . The vehicle 100 may be an autonomous driving vehicle or a non-autonomous driving vehicle. In the case where the vehicle 100 is an autonomous driving vehicle, the autonomous driving vehicle is configured to operate in a fully or partially autonomous driving mode. As shown in FIG4 , the vehicle 100 may include various subsystems, such as a travel system 102 , a sensor system 104 , a control system 106 , one or more peripheral devices 108 , a power supply 110 , a computer system 112 , and a user interface 116 . Optionally, the vehicle 100 may also include vehicle auxiliary equipment 160 ; further optionally, the vehicle 100 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of the vehicle 100 may be interconnected by wire or wirelessly.
[0081] The propulsion system 102 may include components that provide powered motion for the vehicle 100. In one embodiment, the propulsion system 102 may include an engine 118, an energy source 119, a transmission 120, and wheels (also referred to as tires) 121. The engine 118 may be an internal combustion engine, an electric motor, an air compression engine, or a combination of other types of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air compression engine. The engine 118 converts the energy source 119 into mechanical energy. Examples of energy sources 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other electrical sources. The energy source 119 may also provide energy for other systems of the vehicle 100. The transmission 120 transmits mechanical power from the engine 118 to the wheels 121. The transmission 120 may include a gearbox, a differential, and a driveshaft. In one embodiment, the transmission 120 may also include other components, such as a clutch. The driveshaft may include one or more shafts that can be coupled to one or more wheels 121.
[0082] Sensor system 104 may include several sensors that sense information about the environment surrounding vehicle 100. For example, sensor system 104 may include a positioning system 122 (the positioning system may be a Global Positioning System (GPS), a BeiDou system, or other positioning systems), an inertial measurement unit (IMU) 124, a radar 126, a laser rangefinder 128, and a camera 130. Sensor system 104 may also include sensors for internal systems of monitored vehicle 100 (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors may be used to detect objects and their corresponding characteristics (position, shape, direction, speed, etc.). This detection and recognition is a key function for the safe operation of autonomous vehicle 100.
[0083] Among them, the positioning system 122 can be used to estimate the geographic location of the vehicle 100. The IMU 124 is used to sense the position and orientation changes of the vehicle 100 based on inertial acceleration. In one embodiment, the IMU 124 can be a combination of an accelerometer and a gyroscope. The radar 126 can use radio signals to sense objects in the surrounding environment of the vehicle 100, and can specifically be a millimeter wave radar or a laser radar. In some embodiments, in addition to sensing objects, the radar 126 can also be used to sense the speed and / or direction of travel of objects. The laser rangefinder 128 can use lasers to sense objects in the environment in which the vehicle 100 is located. In some embodiments, the laser rangefinder 128 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components. The camera 130 can be used to capture multiple images of the surrounding environment of the vehicle 100. The camera 130 can be a still camera or a video camera.
[0084] In some embodiments of the present application, the sensor system 104 may include a pressure sensor or a human infrared sensor set for each seat in the vehicle 100, and the pressure sensor or human infrared sensor may be used to measure whether there is a passenger in the seat.
[0085] In other embodiments of the present application, the sensor system 104 may include multiple cameras 130. In some examples, the sensor system 104 includes cameras disposed within the vehicle, capable of capturing images within the vehicle. For example, one or more cameras may be positioned near the vehicle's front rearview mirror to capture images of passengers in all seats within the vehicle. Alternatively, one or more cameras may be positioned in the front row of the vehicle to capture images of passengers in the front row. Alternatively, one or more cameras may be positioned in the rear row of the vehicle to capture images of passengers in the rear row.
[0086] Furthermore, the processor 113 of the vehicle 100 may perform facial recognition on the image captured by the camera 130 to determine whether the passenger is the target passenger. Optionally, the image captured by the camera 130 may also be subjected to expression recognition / state recognition to obtain the passenger's expression feedback or determine the passenger's current state (e.g., resting state or non-resting state).
[0087] The control system 106 is an operating system for controlling the vehicle 100 and its components. The control system 106 may include various components, including a steering system 132, a throttle 134, a brake unit 136, a computer vision system 140, a route control system 142, and an obstacle avoidance system 144. The steering system 132 is used to adjust the vehicle 100's direction of travel. For example, in one embodiment, the steering system 132 may be a steering wheel system. The throttle 134 is used to control the speed of the engine 118 and, in turn, the speed of the vehicle 100. The brake unit 136 is used to control the deceleration of the vehicle 100. The brake unit 136 may use friction to slow the wheels 121. In other embodiments, the brake unit 136 may convert the kinetic energy of the wheels 121 into electrical current. The brake unit 136 may also take other forms to slow the rotational speed of the wheels 121 and thereby control the speed of the vehicle 100. The computer vision system 140 may be operable to process and analyze images captured by the camera 130 to identify objects and / or features in the vehicle 100's surroundings. These objects and / or features may include traffic signs, road boundaries, and obstacles. The computer vision system 140 may utilize object recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, the computer vision system 140 may be used to map the environment, track objects, estimate their speed, and so on. The route control system 142 is used to determine the route and speed of the vehicle 100. In some embodiments, the route control system 142 may include a lateral planning module 1421 and a longitudinal planning module 1422, each of which is used to determine the route and speed for the vehicle 100 by combining data from the obstacle avoidance system 144, the GPS 122, and one or more predetermined maps. The obstacle avoidance system 144 is used to identify, assess, and avoid or otherwise navigate obstacles in the vehicle 100's environment. These obstacles may specifically represent actual obstacles and virtual moving objects that may collide with the vehicle 100. In one embodiment, the control system 106 may include additional or alternative components in addition to those shown and described. Alternatively, some of the components shown above may be reduced.
[0088] Vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users via peripheral devices 108. Peripheral devices 108 may include a wireless communication system 146, a microphone 148, a speaker 150, and / or an onboard computer 152. In some embodiments, peripheral devices 108 provide a means for a user of vehicle 100 to interact with user interface 116. For example, onboard computer 152 may provide information to the user of vehicle 100. User interface 116 may also operate onboard computer 152 to receive user input. Onboard computer 152 may be operated via a touchscreen.
[0089] In other cases, peripheral devices 108 may provide a means for vehicle 100 to communicate with other devices located within the vehicle. For example, microphone 148 may receive audio (e.g., voice commands or other audio input) from a user of vehicle 100. Similarly, speaker 150 may output audio to a user of vehicle 100.
[0090] In some embodiments of the present application, the peripheral device 108 may include one or more speakers 150. The speakers 150 may be arranged in the center console, four doors, A-pillars / B-pillars / C-pillars, ceiling, seat headrests, trunk, and other locations of the vehicle 100. For example, a speaker (also called a center speaker, such as a high-low two-way speaker) is arranged in the center console of the vehicle, a speaker (such as a high, medium, low-frequency three-way speaker, or a high-low two-way speaker) is arranged at the four doors of the vehicle, a speaker (such as a high, medium, low-frequency three-way speaker, or a high-low two-way speaker) is arranged at the rear of the rear row (such as a high-low two-way speaker, or a full-range speaker that can be used as a surround sound speaker), a subwoofer is arranged in the trunk, a headrest speaker is arranged in the seat (for example, each seat can be provided with a pair of stereo speakers, or a speaker array is provided on each side of the left and right sides of the headrest), a sky sound speaker is arranged on the ceiling above each seat, and a speaker is arranged on the A-pillar / B-pillar / C-pillar of the vehicle. It should be noted that the embodiment of the present application does not limit the position of the speaker 150 in the vehicle 100 , nor does it limit the type of the speaker 150 or the number of the speakers 150 .
[0091] It should also be noted that one or more speakers in a vehicle can be a speaker array. For example, the speakers in the center console, the speakers at the four doors, and the speakers behind the rear seats can all be speaker arrays. For example, when the left front door speaker is a three-way speaker, the left front door speaker can be a speaker array. In other words, the left front door speaker can include multiple sub-speakers, one or more of which plays sound signals corresponding to a frequency band (high frequency / mid frequency / low frequency), thereby achieving a sense of stereo and spatial audio.
[0092] In one embodiment of the present application, the orientation of the speaker 150 is adjustable. For example, the speaker 150 is connected to a drive motor (not shown in FIG4 ), which can drive the vehicle speaker to rotate to adjust the orientation of the vehicle speaker. As an example, the speaker 150 can be embedded in the vehicle body shell or can be installed outside the vehicle body shell (for example, it can be liftable), which is not limited in this embodiment of the present application.
[0093] The wireless communication system 146 can wirelessly communicate with one or more devices directly or via a communication network. For example, the wireless communication system 146 can use 3G cellular communication, 4G cellular communication, 5G cellular communication, or wireless local area network (WLAN) communication, etc. In some embodiments, the wireless communication system 146 can directly communicate with the device using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicle communication systems, for example, the wireless communication system 146 may include one or more dedicated short range communications (DSRC) devices, which can include public and / or private data communications between vehicles and / or roadside stations.
[0094] In some embodiments of the present application, after the vehicle 100 establishes a connection with an electronic device (such as a mobile phone, a wearable device, a tablet computer, etc.) through the wireless communication module 146, the electronic device can project the screen through the central control screen of the vehicle 100. When the electronic device projects the screen through the central control screen of the vehicle 100, the content displayed on the central control screen of the vehicle 100 may not be exactly the same as the screen content of the electronic device. The content displayed on the central control screen may be an application that has been configured for the vehicle 100 and multiple applications in the terminal device. That is, when the vehicle 100 is not connected to the electronic device, it has its own user interface (UI). After the vehicle 100 is connected to the electronic device, there may be more icons for applications on the UI interface of the vehicle 100, or the functions of the vehicle 100 may be increased.
[0095] Optionally, after the vehicle 100 and the electronic device are connected, they can also achieve mutual assistance at the hardware level. For example, the electronic device can use the global positioning system (GPS) configured in the vehicle 100 to improve the accuracy of the electronic device's navigation. As another example, the electronic device can use the camera on the vehicle 100 to make video calls, etc., and the examples are not exhaustive here.
[0096] In other embodiments of the present application, the vehicle 100 can establish a wireless connection (e.g., a Bluetooth connection or a Wi-Fi connection) with an electronic device (e.g., a wearable device, such as a smartwatch or smart bracelet) carried by a passenger through the wireless communication module 146. The computer system 112 can then obtain physiological characteristic signals such as the passenger's electroencephalogram (EEG) signal and electrocardiogram (ECG) signal from the electronic device carried by the passenger, and determine the passenger's state, such as whether the passenger is in a resting state, by combining polysomnography or cardiopulmonary coupling technology.
[0097] Power source 110 can provide power to various components of vehicle 100. In one embodiment, power source 110 can be a rechargeable lithium-ion or lead-acid battery. One or more battery packs of such batteries can be configured as a power source to provide power to various components of vehicle 100. In some embodiments, power source 110 and energy source 119 can be implemented together, such as in some all-electric vehicles.
[0098] Some or all functions of vehicle 100 are controlled by computer system 112. Computer system 112 may include at least one processor 113 that executes instructions 115 stored in a non-transitory computer-readable medium, such as memory 114. Computer system 112 may also be a plurality of computing devices that control individual components or subsystems of vehicle 100 in a distributed manner. Processor 113 may be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, processor 113 may be a specialized device, such as an application-specific integrated circuit (ASIC) or other hardware-based processor. Although FIG2 functionally illustrates the processor, memory, and other components of computer system 112 in the same block, those skilled in the art will appreciate that the processor or memory may actually include multiple processors or memories that are not stored in the same physical housing. For example, memory 114 may be a hard drive or other storage medium located in a different housing than computer system 112. Therefore, references to processor 113 or memory 114 should be understood to include references to a collection of processors or memories that may or may not operate in parallel. Rather than using a single processor to perform the steps described herein, some components, such as the steering assembly and the retarding assembly, may each have its own processor that performs only calculations related to the functionality of the component specific component.
[0099] In various aspects described herein, the processor 113 may be located remotely from the vehicle 100 and in wireless communication with the vehicle 100. In other aspects, some of the processes described herein are performed on the processor 113 disposed within the vehicle 100 while others are performed by the remote processor 113, including taking the necessary steps to perform a single maneuver.
[0100] In some embodiments, memory 114 may contain instructions 115 (e.g., program logic) that are executable by processor 113 to perform various functions of vehicle 100, including those described above. Memory 114 may also contain additional instructions, including instructions for sending data to, receiving data from, interacting with, and / or controlling one or more of travel system 102, sensor system 104, control system 106, and peripherals 108. In addition to instructions 115, memory 114 may also store data such as road maps, route information, the vehicle's location, direction, speed, and other such vehicle data, as well as other information. This information may be used by vehicle 100 and computer system 112 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes. A user interface 116 is provided for providing information to or receiving information from a user of vehicle 100. Optionally, user interface 116 may include one or more input / output devices within the set of peripherals 108, such as wireless communication system 146, onboard computer 152, microphone 148, and speaker 150.
[0101] Computer system 112 may control functions of vehicle 100 based on input received from various subsystems (e.g., travel system 102, sensor system 104, and control system 106) and from user interface 116. For example, computer system 112 may utilize input from control system 106 to control steering system 132 to avoid obstacles detected by sensor system 104 and obstacle avoidance system 144. In some embodiments, computer system 112 may be operable to provide control over many aspects of vehicle 100 and its subsystems.
[0102] In some embodiments of the present application, computer system 112 may obtain a passenger's facial image from camera 130, and processor 113 may perform facial recognition on the image captured by camera 130 to determine whether the passenger is a target passenger. If the passenger is a target passenger, processor 113 automatically adjusts the drive signal of speaker 150 to direct speaker 150 toward the target passenger. Processor 113 may also adjust the playback parameters of speaker 150 so that the frequency response curve of the sound from speaker 150 at the target passenger's position meets preset conditions.
[0103] Alternatively, one or more of the above components may be installed or associated separately from the vehicle 100. For example, the memory 114 may be partially or completely separate from the vehicle 100. The above components may be communicatively coupled together in a wired and / or wireless manner.
[0104] Optionally, the above components are just an example. In actual applications, the components in the above modules may be added or deleted according to actual needs. Figure 4 should not be understood as a limitation to the embodiments of the present application. An autonomous driving vehicle traveling on a road, such as vehicle 100 above, can identify objects in its surrounding environment to determine adjustments to the current speed. The objects can be other vehicles, traffic control devices, or other types of objects. In some examples, each identified object can be considered independently, and based on the respective characteristics of the object, such as its current speed, acceleration, distance from the vehicle, etc., it can be used to determine the speed to be adjusted by the autonomous driving vehicle.
[0105] In some implementations, the control method for the vehicle-mounted speaker provided in the embodiments of the present application is pre-loaded into the memory 114 in the form of a computer program product. The processor 113 in the vehicle 100 can execute the instructions in the memory 114 to direct the speaker 150 in the vehicle toward the target passenger and adjust the playback parameters of the speaker 150 so that the frequency response curve of the sound of the speaker 150 at the target passenger position meets the preset conditions.
[0106] In some embodiments, the software system of the processor 113 in the vehicle 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc. For example, the processor 113 of the vehicle 100 may adopt an Android system or a Hongmeng system with a layered architecture.
[0107] In other implementations, the execution entity of the control method of the vehicle speaker provided in the embodiment of the present application can be a vehicle auxiliary device 160, and the vehicle auxiliary device 160 can be installed in the vehicle 100 in the form of an independent device. The vehicle auxiliary device 160 can specifically be manifested as an in-vehicle audio and video entertainment device, a vehicle display screen, a driving recorder, a vehicle rearview mirror or other product forms, etc., which are not limited here.
[0108] The vehicle 100 may be a car, truck, motorcycle, bus, ship, airplane, helicopter, lawn mower, recreational vehicle, amusement park vehicle, construction equipment, tram, golf cart, train, and cart, etc., and the embodiments of the present application do not impose any particular limitation.
[0109] The technical solutions provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.
[0110] Please refer to Figure 5, which is a flow chart of a method for controlling a vehicle-mounted speaker according to an embodiment of the present application. This method can be applied to the application scenario shown in Figure 3 and the vehicle shown in Figure 4. As shown in Figure 5, the process includes:
[0111] S501: Receive an adjustment instruction for a vehicle speaker, where the adjustment instruction includes a direction of the vehicle speaker, and control the vehicle speaker to face a target passenger according to the adjustment instruction.
[0112] Optionally, the vehicle can generate speaker adjustment instructions using either of the following two methods: Method 1: Generate speaker adjustment instructions based on the target passenger's location; Method 2: Generate speaker adjustment instructions based on the speaker's orientation adjustment operation. Each method is described below.
[0113] Method 1
[0114] Before using method 1, the vehicle can first determine the target passenger in the vehicle. It is understandable that there can be one or more passengers in the vehicle. If there is only one passenger, then that passenger is determined as the target passenger. If there are multiple passengers, the target passenger can be determined by any one or more combinations of the following three methods (methods A to C). For example, each seat is provided with a pressure sensor, which can be used to detect whether there is a passenger in the seat and thus determine the number of passengers. Alternatively, regardless of whether there is one or more passengers in the vehicle, the target passenger can be determined by any one or more of the following three methods (methods A to C).
[0115] Method A: One or more cameras are installed inside the vehicle to capture images of the interior. It is understood that these one or more cameras can capture the entire interior of the vehicle, or they can capture images of passengers in each seat in the vehicle. The camera sends the captured images to a processor in the vehicle, which performs facial recognition on the captured images to determine whether the passengers in each seat are target passengers. For example, the facial features (or facial characteristics) of the target passengers are pre-stored in the vehicle. After the vehicle obtains the facial features of each passenger through image facial recognition technology, it can match each passenger's facial features with the pre-stored facial features. Once a passenger's facial features are determined to match the pre-stored facial features, the passenger is determined to be the target passenger. In this method, the vehicle needs to pre-store the facial features of the target passengers. One possible method is that the passenger can record his or her facial image through the camera in the vehicle and designate the passenger corresponding to the facial image as the target passenger. The vehicle can then obtain and store the facial features of the target passenger through facial recognition technology. Another possible way is that the vehicle can establish a connection (for example, Bluetooth connection or Wi-Fi connection, etc.) with the passenger's electronic device (for example, a mobile phone or wearable device such as a smart watch or smart bracelet), obtain the passenger's facial image through the passenger's electronic device, and designate the passenger corresponding to the facial image as the target passenger. The vehicle can then obtain and store the facial features of the target passenger through facial recognition technology.
[0116] In Option B, one or more microphones are installed inside the vehicle to collect sound signals within the vehicle. It's understood that the microphones can be located anywhere within the vehicle. Of course, to more accurately capture the voices of passengers, the microphones can be placed close to the passengers, such as near the headrests of the seats. The microphones transmit the collected sound signals to a processor in the vehicle, which identifies the sound signals to determine whether the occupants of each seat are target passengers. For example, the vehicle may pre-store the voice characteristics of target passengers. After the vehicle uses voice recognition technology to identify the voice characteristics of each passenger from the sound signals collected by the microphones, it can then match each passenger's voice characteristics with the pre-stored voice characteristics. Once a passenger's voice characteristics match the pre-stored voice characteristics, the passenger is identified as the target passenger. In this option, the vehicle must pre-store the voice characteristics of the target passengers. One possible approach is for the passenger to record their own voice using the vehicle's microphone and designate the passenger corresponding to the voice as the target passenger. The vehicle can then use voice recognition technology to obtain and store the target passenger's voice characteristics.
[0117] Method C: One or more touchscreen displays are installed inside the vehicle for specifying target passengers. For example, see Figure 6, which shows a display interface displayed on a touchscreen display inside the vehicle provided by this application. This display interface includes a prompt message: "Please specify the target passenger" and may also display the current passenger distribution within the vehicle. Assuming that the pressure sensors on the seats detect that there are occupants in the driver's and passenger's seats, but no one is in the back seat, then in Figure 6, images of people are displayed on the driver's and passenger's seats, while the back seat is blank, i.e., no person images are displayed. It should be noted that the images of people on the driver's and passenger's seats in Figure 6 can be images of passengers or virtual images, such as cartoon images, as long as they can indicate that the driver's and passenger's seats are occupied. Assuming that the touchscreen displays a click on the passenger's seat, the passenger in the passenger's seat is determined to be the target passenger. It should be noted that Figure 6 is only an example of specifying target passengers; other methods of specifying target passengers are possible and are not limited by this embodiment of the application.
[0118] The above three methods (methods A to C) can be used alone or in combination. Take the combination of method A and method B as an example, for example, method A is used first to determine the target passenger, and if the target passenger is not determined, method B can be used to determine it.
[0119] In some embodiments, the vehicle may periodically detect the target passenger, which may be 10 minutes, 20 minutes, half an hour, etc., and is not limited in this embodiment of the application.
[0120] In one possible scenario, the vehicle identifies multiple target passengers. For example, the vehicle may have pre-stored facial features or voice features of multiple target passengers, so multiple target passengers may be identified. In this case, the vehicle may identify a target passenger from among the multiple target passengers, and this identified target passenger may be the final target passenger. For example, the vehicle may store a priority relationship for different target passengers. When multiple target passengers are identified, the vehicle may determine a target passenger with the highest priority based on this priority relationship. For example, if a father, mother, and daughter are all on the vehicle and are all target passengers, the daughter's priority is higher than the mother's and higher than the father's, so the daughter is determined as the final target passenger. Optionally, the priority relationship may be specified by the user (e.g., the driver), or may be determined based on the passenger's number of rides, for example, with a higher priority for a passenger with a higher number of rides and a lower priority for a passenger with a lower number of rides, or vice versa.
[0121] In some specific examples, the target passenger location may include: the location of the target passenger's seat, the location of the headrest of the target passenger's seat, the location of the target passenger's head, the location of the target passenger's ears, etc. Preferably, the target passenger location may be the location of the target passenger's ears, so that the speaker can be directed toward the location of the target passenger's ears for better effect.
[0122] After determining the location of the target passenger, the orientation of the vehicle speakers can be determined based on the target passenger's location, and an adjustment instruction for the vehicle speakers can be generated. The adjustment instruction includes the orientation of the vehicle speakers, and the adjustment instruction can direct the vehicle speakers toward the target passenger. For example, a correspondence relationship is stored in the vehicle, including different locations within the vehicle and the corresponding orientations of the vehicle speakers at each location. Based on the target passenger's location and the correspondence relationship, the orientation of the vehicle speakers can be determined, and the adjustment instruction for the vehicle speakers can be generated.
[0123] Method 2
[0124] For example, the vehicle may include buttons, handles, or other devices that allow passengers to adjust the direction of the vehicle speakers. Alternatively, the vehicle display may include a display component for adjusting the vehicle speakers, and passengers may adjust the direction of the vehicle speakers using this display component. Thus, a button, handle, or vehicle display may trigger an adjustment instruction for the vehicle speakers, and the adjustment instruction may include the direction of the vehicle speakers. The vehicle speakers are then controlled to face the target passenger based on the adjustment instruction.
[0125] In some embodiments, the vehicle speaker is connected to a drive motor that can rotate the vehicle speaker to adjust the orientation of the vehicle speaker. Upon receiving an adjustment command for the vehicle speaker, the vehicle can control the drive motor to rotate the vehicle speaker to a corresponding angle based on the adjustment command, so that the vehicle speaker faces the target passenger.
[0126] S502 , adjusting the playback parameters of the vehicle-mounted speaker so that the frequency response curve of the sound of the vehicle-mounted speaker at the target passenger position meets a preset condition.
[0127] Optionally, the playback parameters of the vehicle speaker may include one or more of high-frequency parameters, mid-frequency parameters, and low-frequency parameters. High-frequency can be understood as sound within the high-frequency range. For example, the high-frequency range may include 2000 Hz to 20,000 Hz. High-frequency parameters may include one or more of the following: volume values, phase, and other parameters corresponding to the high-frequency range or individual frequencies or sub-frequency ranges within the high-frequency range. Mid-frequency can be understood as sound within the mid-frequency range. For example, the mid-frequency range may include 500 Hz to 2000 Hz. Mid-frequency parameters may include one or more of the following: volume values, phase, and other parameters corresponding to the mid-frequency range or individual frequencies or sub-frequency ranges within the mid-frequency range. Low-frequency can be understood as sound within the low-frequency range. For example, the low-frequency range may include 20 Hz to 500 Hz. Low-frequency parameters may include one or more of the following: volume values, phase, and other parameters corresponding to the low-frequency range or individual frequencies or sub-frequency ranges within the low-frequency range. It should be noted that the division of high frequency band, medium frequency band and low frequency band here is only an example, and there can be more division methods, for example, the high frequency band is above 1500Hz, the medium frequency band is 500Hz~1500Hz, and the low frequency band is below 500Hz, or it can be divided only into medium and high frequency bands and low frequency bands, for example, the medium and high frequency band is above 500Hz, and the low frequency band is below 500Hz. The embodiment of the present application does not limit the division method of the frequency bands.
[0128] It should be understood that the above-mentioned high-frequency parameters, mid-frequency parameters, and low-frequency parameters are related to the types of corresponding car speakers. Car speakers can be divided into tweeters, mid-range speakers, woofers, mid-bass speakers and other frequency-divided speakers, and also include full-range speakers. Therefore, the corresponding playback parameters can be adjusted according to the type of car speakers.
[0129] In the embodiment of the present application, the frequency response curve satisfies the preset condition, which may include: the fluctuation range of the frequency response curve is within the preset range. The fluctuation range of the frequency response curve is within the preset range, which may include the following two situations:
[0130] Case 1: The flatness of the frequency response curve is within a preset range. For example, the horizontal coordinate of the frequency response curve is frequency, and the vertical coordinate is amplitude (or loudness). The flatness of the frequency response curve can be understood as the difference between the amplitudes corresponding to different frequencies on the frequency response curve, that is, the difference between the vertical coordinates corresponding to different horizontal coordinates. The flatness of the frequency response curve is within a preset range, that is, the difference between the amplitudes corresponding to different frequencies on the frequency response curve is within a preset range. Exemplarily, the preset range can be -2dB to 2dB, or -4dB to 4dB. The specific preset range can be set according to the actual scenario, and this application does not make specific limitations. In this way, the frequency response curve can be controlled to be relatively flat, so that the spectrum is balanced, the sound distortion heard by the target passengers is small, and the quality is high.
[0131] Case 2: The difference between the frequency response curve and the preset frequency response curve is within a preset range. The difference between the frequency response curve and the preset frequency response curve may include: the difference between the amplitudes corresponding to the same frequency on the frequency response curve and the preset frequency response curve. For example, the preset range may be -2dB to 2dB, or -4dB to 4dB. The specific preset range can be set according to the actual scenario and is not specifically limited in this application. In this way, the frequency response curve can be controlled to be closer to the preset frequency response curve, so that the sound effect heard by the target passenger reaches the sound effect corresponding to the preset frequency response curve.
[0132] In some specific examples, the preset frequency response curve can be determined based on the target passenger's location. For example, when the target passenger is at position A, the preset frequency response curve is preset frequency response curve 1, and when the target passenger is at position B, the preset frequency response curve is preset frequency response curve 2. In this way, the comparison criteria for the frequency response curves of the vehicle speaker sound at different locations vary (because the preset frequency response curves at different locations are different), ensuring that each location has an optimal listening experience. As an example, a first correspondence is stored in the vehicle, including different locations within the vehicle and the preset frequency response curves corresponding to each location, such as shown in Table 1 below.
[0133] Table 1
[0134] Assuming the target passenger is at position X, the vehicle determines, based on the first comparison file (i.e., Table 1), a position whose distance from position X is less than a preset distance, such as position B, and determines the preset frequency response curve to be preset frequency response curve 2. Of course, if, based on the first comparison file (i.e., Table 1), there are multiple positions, such as position A and position B, whose distance from position X is less than the preset distance, one position may be determined from the multiple positions, for example, a position may be randomly selected, such as position B, and the preset frequency response curve may be determined to be preset frequency response curve 2.
[0135] In the embodiment of the present application, the methods of adjusting the playback parameters of the vehicle-mounted speaker include but are not limited to the following two methods.
[0136] In the first approach, a second mapping relationship is pre-stored within the vehicle. This mapping relationship includes different vehicle locations and their corresponding playback parameters. These parameters ensure that the frequency response curves of the vehicle speakers at these locations meet pre-set requirements. Therefore, the vehicle can adjust the playback parameters of the vehicle speakers based on the target passenger's location and the second mapping relationship.
[0137] As an example, the second corresponding relationship may be as shown in Table 2 below.
[0138] Table 2
[0139] Assuming the target passenger is at position X, the vehicle can determine a position, such as position B, from the second correspondence (e.g., Table 2 above) that is less than a preset distance from position X, and then determine the playback parameters of the vehicle speakers to be parameter B. Of course, if, according to the second comparison file (i.e., Table 2), there are multiple positions, such as position A and position B, that are less than the preset distance from position X, one position can be determined from the multiple positions, for example, a position can be randomly selected, such as position B, and the playback parameters of the vehicle speakers can be determined to be parameter B.
[0140] Optionally, the second correspondence can be pre-stored in the vehicle before it leaves the factory or is sold. For example, before the vehicle leaves the factory or is sold, a tuner adjusts the vehicle's speakers to face different locations within the vehicle. For each location, a set of playback parameters is debugged to obtain the playback parameters corresponding to each location, i.e., the second correspondence. This second correspondence is then recorded in the vehicle. Optionally, the different locations within the vehicle in the second correspondence can include the locations of different seats within the vehicle or the locations of the headrests of different seats, or can also include the locations of the heads or ears of different passengers. Taking the ear locations of different passengers as an example, before the vehicle leaves the factory or is sold, one or more testers are assigned to sit in a certain seat within the vehicle. The ear locations of the testers are then counted, and the vehicle's speakers are oriented toward the counted ear locations. The tuner then adjusts the speaker playback parameters to obtain the playback parameters when the speakers are oriented toward that location. Considering that the ear positions of different passengers vary in reality, for example, some taller passengers have higher ears, while others have lower ears. Therefore, to improve accuracy, the testers are selected to cover as many different heights as possible. For example, the testers may include multiple groups, the first group includes 10 people with a height of 150-160, the second group includes 10 people with a height of 160-170, the third group includes 10 people with a height of 170-180, and the fourth group includes 10 people with a height of 180-190. For the first group of testers, each tester can be asked to sit in the same position (for example, the co-pilot position) in turn, and then the average ear position A of the first group of testers in this position can be calculated. After the speaker is facing the position A, the playback parameters of the speaker are debugged to obtain the playback parameters corresponding to position A. Similarly, for the second group of testers, each tester can be asked to sit in the same position (for example, the co-pilot position) in turn, and then the average ear position B of the second group of testers can be calculated. After the speaker is facing the position B, the playback parameters of the speaker are debugged to obtain the playback parameters corresponding to position B. The same approach is followed for testers in other groups. In this way, the playback parameters corresponding to different ear positions can be obtained.
[0141] In the first way, the position of the target passenger can be the position of the target passenger's head or ear. In this case, since the target passenger's head may move constantly (for example, chatting with other passengers), the playback parameters of the vehicle speaker may be adjusted frequently. In order to avoid this situation, one possible implementation method is that when the vehicle detects that the position of the target passenger's ear moves from position C to position D, if it is determined to be stable at position D (for example, the duration of stability at position D is greater than the preset duration), the playback parameters of the vehicle speaker are adjusted based on position D and the second corresponding relationship, otherwise, the playback parameters are not adjusted. Another possible implementation method is that when the vehicle determines that the target passenger is currently in a chatting state (for example, chatting with other passengers), the playback parameters will not be adjusted even if the target passenger's head position is detected to move.
[0142] As another example, the second correspondence may also include audio playback modes corresponding to different locations in the vehicle. For example, the audio playback modes may include various audio playback modes such as classic, jazz, soft, and pop, with different audio playback modes corresponding to different music styles. For example, the second correspondence may also be as shown in Table 3 below.
[0143] Table 3
[0144] When the second correspondence is the correspondence shown in Table 3, the vehicle can adjust the playback parameters of the vehicle speakers according to the location of the target passenger, the first audio playback mode, and the second correspondence (i.e., Table 3). The first audio playback mode can be the current audio playback mode. Assuming that the first audio playback mode is audio playback mode 1 and the location of the target passenger is location X, the vehicle can determine a location less than a preset distance from location X, such as location B, based on the above second correspondence (i.e., Table 3), and then determine the playback parameter corresponding to audio playback mode 1 among the multiple audio playback modes corresponding to location B, i.e., parameter C.
[0145] Optionally, the first audio playback mode may be the current audio playback mode; or, the first audio playback mode may also be determined based on the target passenger, for example, in at least one of the following ways:
[0146] Method 1: The first audio playback mode is an audio playback mode that meets the personal preferences of the target passenger. In this method, the vehicle needs to determine the audio playback mode that the target passenger likes. One possible implementation method is that the vehicle can infer the audio playback mode that the target passenger likes based on the age and / or gender of the target passenger. For example, when the target passenger is older, the classic mode or the soft mode can be used, and when the target passenger is younger, the pop mode or the jazz mode can be used. Alternatively, when the target passenger is male, the classic mode or the jazz mode can be used, and when the target passenger is female, the pop mode or the soft mode can be used. Other possible implementation methods are that the vehicle can determine that the audio playback mode frequently used by the target passenger is the audio playback mode that the target passenger likes.
[0147] Method 2, the first playback mode is an audio playback mode that matches the current state of the target passenger. In some examples, the current state of the target passenger may include a resting state or an active state (or non-resting state). For example, when the current state of the target passenger is a resting state, the first audio playback mode may be a soft mode. When the current state of the target passenger is an active state, the first audio playback mode may be a classic mode or a jazz mode, etc. In this method, the vehicle needs to determine the state of the target passenger (for example, a resting state or a non-resting state). One possible implementation method is that the camera in the vehicle sends the captured image of the target passenger to the processor in the vehicle, and the processor performs facial expression recognition on the captured image to determine the current state of the target passenger. For example, if the processor recognizes that the target passenger is squinting, it determines that the target passenger is currently in a resting state. Another possible implementation method is that the vehicle establishes a connection (such as Bluetooth connection or Wi-Fi connection, etc.) with the passenger's electronic device (such as wearable devices, such as smart watches, smart bracelets), then the passenger's brain wave (electroencephalogram, EEG) signal, electrocardiogram (electrocardiogram, ECG) signal and other physiological characteristic signals can be obtained through the passenger's electronic device, and combined with polysomnography or cardiopulmonary coupling technology to judge the passenger's status, such as whether he is in a resting state.
[0148] The second method is to have a sound collection device in the car. For example, a sound collection device is set at the position where the target passenger is located (for example, the headrest position of the seat where the target passenger is located) to collect the sound information of the car speaker at the position where the target passenger is located; the vehicle can adjust the playback parameters of the car speaker according to the sound information.
[0149] As an example, a vehicle can obtain a frequency response curve corresponding to the sound information collected by the sound collection device. If the frequency response curve does not meet preset conditions, a frequency response correction algorithm can be used to calculate playback parameters for the vehicle's speakers. These playback parameters ensure that the frequency response curve of the sound information at the target passenger's location meets the conditions. If the frequency response curve of the sound information collected by the sound collection device contains irregularities (e.g., distinct troughs), the frequency response correction algorithm can be used to calculate the playback parameters for the speakers so that, when the speakers use these playback parameters, the frequency response curve of the sound information at the target passenger's location is as close to flat as possible (e.g., the troughs in the frequency response curve approach a flat surface). If the frequency response curve of the sound information collected by the sound collection device differs from a preset frequency response curve by more than a preset range (e.g., the amplitude difference between the two frequency response curves within the same frequency band exceeds a preset range), the frequency response correction algorithm can be used to calculate the playback parameters for the speakers so that, when the speakers use these playback parameters, the difference between the frequency response curve of the sound information at the target passenger's location and the preset frequency response curve falls within a preset range. Optionally, the frequency response correction algorithm may include a filtering algorithm, a sound pressure intensity adjustment algorithm, an amplitude adjustment algorithm, etc., which is not limited in the embodiment of the present application.
[0150] As another example, considering the distance between the sound collection device and the target passenger's location, to improve accuracy, the vehicle can also obtain relative position information between the sound collection device and the target passenger's location and adjust the playback parameters of the vehicle's speakers based on this relative position information. For example, if the sound collection device is located at location 1 and the target passenger is located at location 2, the vehicle can obtain the sound information of the vehicle's speakers at location 1 through the sound collection device. Then, based on the sound information at location 1 and the relative position information between locations 1 and 2, the vehicle can determine the sound information of the vehicle's speakers at location 2. The vehicle then determines the frequency response curve corresponding to the sound information at location 2. If this frequency response curve does not meet pre-set conditions, the vehicle can use a frequency response correction algorithm to calculate playback parameters for the vehicle's speakers that ensure the frequency response curve of the sound information at location 2 meets the conditions. In this approach, the vehicle needs to determine the sound information of the vehicle's speakers at location 2 based on the sound information of the vehicle's speakers at location 1 and the relative position information between locations 1 and 2. One possible approach is for the vehicle to pre-store corresponding relationships, which include the relative position information between different locations and the sound change values Δ (e.g., amplitude change values) corresponding to each relative position information. The vehicle can determine the corresponding sound change value Δ based on the relative position information between position 1 and position 2, and the corresponding relationship, and then determine the sound information of the vehicle speaker at position 2 based on the sound information of the vehicle speaker at position 1 and the sound change value Δ.
[0151] Optionally, considering that the sound information collected by the sound collection device may include noise (for example, engine noise, human voice, etc.), before using the second method, the sound information collected by the sound collection device can be filtered to remove engine noise, human voice, etc. to obtain the sound information of the vehicle speaker.
[0152] In other embodiments, the vehicle can also adjust the volume of its speakers based on the relative distance between the speakers and the target passenger. For example, when the distance between the speakers and the target passenger is greater, the volume of the speakers is higher; when the distance between the speakers and the target passenger is closer, the volume is lower. Optionally, to ensure consistent hearing for the target passenger as their position changes, the vehicle can gradually adjust the volume, for example, gradually increasing or decreasing the volume, as the speakers adjust their orientation.
[0153] In actual applications, after adjusting the playback parameters and volume of the vehicle's speakers, the target passenger may not be satisfied with the results. In this case, the vehicle can also capture the target passenger's feedback and readjust the playback parameters and / or volume of the vehicle's speakers based on the target passenger's feedback. This feedback may include the target passenger's voice feedback, facial expression feedback, etc.
[0154] Taking sound feedback as an example, after the vehicle speaker is facing the target passenger and the volume is adjusted according to the relative distance between the vehicle speaker and the target passenger, if the sound collection device in the vehicle collects the sound signal and, through sound content recognition, determines that the sound signal includes keywords such as "the sound is too high" or "the sound is too low", the volume is readjusted. Alternatively, when it is determined that the sound signal includes keywords such as "the sound is too high" or "the sound is too low", the vehicle can first output a prompt message (for example, a voice prompt message) to prompt whether the sound is too high and needs to be lowered, or whether the sound is too low and needs to be raised. When a confirmation instruction from the target passenger is received (for example, the sound collection device collects the sound signal including the keyword "yes"), the volume is adjusted.
[0155] Taking facial expression feedback as an example, after the vehicle-mounted speaker is facing the target passenger and the volume is adjusted according to the relative distance between the vehicle-mounted speaker and the target passenger, if the image acquisition device in the vehicle captures the image of the target passenger and performs facial expression recognition on the image, and determines that the expression of the target passenger is a first preset expression (for example, frowning, squinting, arching the nose, etc.), it is determined that the sound is too high and the sound can be lowered. Alternatively, a prompt message can be output first to prompt whether the sound is too high and needs to be lowered, and when the target passenger's confirmation instruction is received, the volume is lowered. If the target passenger's expression is a second preset expression (for example, dilated eyes, tense face), it is determined that the sound is too low and the sound can be raised. Alternatively, a prompt message can be output first to prompt whether the sound is too low and needs to be raised, and when the target passenger's confirmation instruction is received, the sound is raised.
[0156] According to the aforementioned method, FIG7 exemplarily shows a structural diagram of a control device for a vehicle-mounted speaker provided in an embodiment of the present application. The device may be a chip or a circuit, such as a chip or a circuit that can be set in a vehicle. As shown in FIG7 , the control device 700 for the vehicle-mounted speaker may include a vehicle-mounted speaker orientation adjustment unit 710 and a playback parameter adjustment unit 720. The orientation adjustment unit 710 is used to control the vehicle-mounted speaker to face the target passenger according to the position of the target passenger or the orientation adjustment operation of the vehicle-mounted speaker. The playback parameter adjustment unit 720 is used to adjust the playback parameters of the vehicle-mounted speaker so that the frequency response curve of the sound of the vehicle-mounted speaker at the target passenger position meets a preset condition.
[0157] In an optional implementation, the frequency response curve meeting a preset condition may include: a fluctuation range of the frequency response curve being within a preset range.
[0158] In an optional implementation manner, the fluctuation range of the frequency response curve is within a preset range, including: a difference between the frequency response curve and a preset frequency response curve is within a preset range.
[0159] In an optional embodiment, the vehicle includes a storage unit (e.g., a memory), wherein a first correspondence is stored in the storage unit, the first correspondence including different positions in the vehicle and preset frequency response curves corresponding to the different positions in the vehicle; the playback parameter adjustment unit 720 is further configured to determine the preset frequency response curve corresponding to the target passenger's position based on the target passenger's position and the first correspondence.
[0160] In an optional embodiment, the vehicle includes a storage unit (e.g., a memory), which stores a second correspondence, including different positions in the vehicle and playback parameters corresponding to different positions in the vehicle, and the playback parameters corresponding to different positions make the frequency response curve of the sound of the vehicle speaker at the corresponding position in different positions meet preset conditions; the playback parameter adjustment unit 720 is specifically used to: adjust the playback parameters of the vehicle speaker according to the position of the target passenger and the second correspondence.
[0161] In an optional embodiment, the second correspondence also includes audio playback modes corresponding to different positions in the vehicle; the playback parameter adjustment unit 720 is specifically used to adjust the playback parameters of the vehicle speakers according to the position of the target passenger, the first audio playback mode, and the second correspondence, where the first audio playback mode is the mode of the currently playing audio.
[0162] In an optional embodiment, the vehicle also includes a sound collection unit (e.g., a microphone), which can be set at the location of the target passenger, and the playback parameter adjustment unit 720 is specifically used to adjust the playback parameters of the vehicle-mounted speaker at the location of the target passenger according to the sound information of the vehicle-mounted speaker at the location of the target passenger collected by the sound collection device.
[0163] In an optional embodiment, there is a certain distance between the sound collection unit (e.g., microphone) in the vehicle and the target passenger. The playback parameter adjustment unit 720 is specifically configured to obtain relative position information between the sound collection device and the target passenger, and adjust the playback parameters of the vehicle speaker based on the relative position information.
[0164] In an optional implementation, the playback parameter adjustment unit 720 is further configured to adjust the volume of the vehicle-mounted speaker according to the relative distance between the vehicle-mounted speaker and the target passenger.
[0165] In an optional embodiment, the vehicle further includes a sound acquisition unit (e.g., a microphone) and an image acquisition unit (e.g., a camera), and the playback parameter adjustment unit 720 is further used to: obtain voice feedback from the target passenger through the sound acquisition unit, and / or obtain facial expression feedback from the target passenger through the image acquisition unit; and adjust the playback parameters of the vehicle-mounted speakers again based on the feedback.
[0166] In an optional embodiment, the target passenger's position includes: the specific position of the target passenger or the orientation of the target passenger relative to the vehicle speaker, and the specific position includes: one of the position of the target passenger's seat, the position of the headrest of the target passenger's seat, the position of the target passenger's head, and the position of the target passenger's ear.
[0167] In an optional embodiment, the vehicle further includes a sound acquisition unit (e.g., a microphone), an image acquisition unit (e.g., a camera), and a display unit (e.g., an on-board display screen). The vehicle further includes a processing unit (not shown in FIG7 ), and the processing unit is specifically configured to: acquire a facial image of a passenger through the image acquisition unit, and determine that a passenger whose facial features match pre-stored facial features is a target passenger; or, acquire a voice signal of a passenger through the sound acquisition unit, and determine that a passenger whose voice signal matches a pre-stored voice signal is a target passenger; or, receive a designated operation of the target passenger through the on-board display screen, and determine the target passenger based on the operation.
[0168] It should be understood that the division of the units of the above-mentioned vehicle speaker control device 700 is merely a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or physically separated, which is not limited in the embodiments of the present application.
[0169] According to the aforementioned method, Figure 8 is a schematic diagram of the structure of a vehicle speaker control device provided in an embodiment of the present application. As shown in Figure 8 , the device can be a vehicle or a server, or a chip or circuit, such as a chip or circuit installed in a vehicle, or a chip or circuit installed in a server. As shown in Figure 8 , the vehicle speaker control device 800 may include: one or more processors 801; one or more memories 802; a communication interface 803; and one or more computer programs 804. These components may be connected via one or more communication buses 805. The one or more computer programs 804 are stored in the memory 802 and configured to be executed by the one or more processors 801. The one or more computer programs 804 include instructions. For example, when these instructions are executed, the steps of the vehicle speaker control device described in the above embodiments, such as the steps of Figure 5 , can be executed. The communication interface 803 is used to enable communication between the vehicle speaker control device 800 and other devices. For example, the communication interface may be a transceiver.
[0170] It should be understood that the processor 801 may be a chip. For example, the processor 801 may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0171] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor 801 or by instructions in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor 801. The software module can be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 802, and the processor 801 reads the information in the memory 802 and completes the steps of the above method in conjunction with its hardware.
[0172] It is understood that the memory 802 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0173] For the concepts, explanations, detailed descriptions and other steps involved in the control device 800 of the vehicle-mounted speaker and related to the technical solution provided in the embodiment of the present application, please refer to the description of these contents in the aforementioned method or other embodiments, which will not be repeated here.
[0174] According to the method provided in the embodiments of the present application, the present application also provides a computer program product, which includes: computer program code, which, when running on a computer, enables the computer to execute the method of any one of the embodiments shown in Figures 1 to 6.
[0175] According to the method provided in the embodiments of the present application, the present application also provides a computer-readable storage medium, which stores program code. When the program code runs on a computer, the computer executes the method of any one of the embodiments shown in Figures 1 to 6.
[0176] According to the method provided in the embodiment of the present application, the present application also provides a vehicle, which may include a control device for a vehicle-mounted speaker as shown in FIG. 7 or FIG. 8 .
[0177] The above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiments of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).
[0178] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A method for controlling a vehicle-mounted speaker, characterized in that: include: According to the position of the target passenger or the direction adjustment operation of the vehicle speaker, the vehicle speaker is controlled to face the target passenger; The playback parameters of the vehicle-mounted speaker are adjusted so that the frequency response curve of the sound of the vehicle-mounted speaker at the target passenger position meets a preset condition.
2. The method according to claim 1, characterized in that The preset condition is that the fluctuation range of the frequency response curve is within a preset range.
3. The method according to claim 2, characterized in that The fluctuation range of the frequency response curve is within a preset range, which includes: a difference between the frequency response curve and a preset frequency response curve is within a preset range.
4. The method according to claim 3, characterized in that The vehicle stores a first correspondence relationship, the first correspondence relationship including different positions in the vehicle and preset frequency response curves corresponding to the different positions in the vehicle; the method further includes: A preset frequency response curve corresponding to the target passenger's position is determined according to the target passenger's position and the first corresponding relationship.
5. The method according to any one of claims 1 to 4, characterized in that A second correspondence is stored in the vehicle, the second correspondence including different positions in the vehicle and playback parameters corresponding to the different positions in the vehicle, the playback parameters corresponding to the different positions making the frequency response curves of the sound of the vehicle speaker corresponding to the different positions meet the preset conditions; The adjusting the playback parameters of the vehicle-mounted speaker includes: The playback parameters of the vehicle-mounted speaker are adjusted according to the location of the target passenger and the second corresponding relationship.
6. The method according to claim 5, characterized in that The second corresponding relationship also includes audio playback modes corresponding to different positions in the vehicle; Adjusting the playback parameters of the vehicle-mounted speaker according to the location of the target passenger and the second corresponding relationship includes: The playback parameters of the vehicle-mounted speaker are adjusted according to the location of the target passenger, the first audio playback mode, and the second corresponding relationship, where the first audio playback mode is the mode of the currently played audio.
7. The method according to any one of claims 1 to 4, characterized in that The adjusting the playback parameters of the vehicle-mounted speaker includes: receiving sound information collected by the vehicle-mounted speaker at the location of the target passenger from a sound collection device; Adjust the playback parameters of the vehicle-mounted speaker according to the sound signal.
8. The method according to claim 7, characterized in that The adjusting the playback parameters of the vehicle-mounted speaker according to the sound signal includes: Obtaining relative position information between the sound collection device and the location of the target passenger; Adjust the playback parameters of the vehicle-mounted speaker according to the sound signal and the relative position information.
9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: The volume of the vehicle-mounted speaker is adjusted according to the relative distance between the vehicle-mounted speaker and the target passenger.
10. The method according to any one of claims 1 to 9, characterized in that After controlling the vehicle-mounted speaker to face the target passenger and adjusting the playback parameters of the vehicle-mounted speaker, the method further includes: Obtaining feedback from the target passenger on the output sound of the vehicle-mounted speaker, the feedback including voice feedback and / or facial expression feedback; According to the feedback, the playback parameters of the vehicle-mounted speaker are adjusted again.
11. The method according to any one of claims 1 to 10, characterized in that The target passenger's location includes: the specific location of the target passenger or the orientation of the target passenger relative to the vehicle-mounted speaker. The specific location includes: one of the position of the target passenger's seat, the position of the headrest of the target passenger's seat, the position of the target passenger's head, and the position of the target passenger's ear.
12. The method according to any one of claims 1 to 11, characterized in that Before determining the location of the target passenger in the vehicle, the method further includes: Collecting a passenger's facial image and determining a passenger whose facial features match pre-stored facial features as a target passenger; or, Collecting a passenger's voice signal and determining a passenger whose voice signal matches a pre-stored voice signal as a target passenger; or, The designated operation of the target passenger is received through the vehicle display screen, and the target passenger is determined according to the operation.
13. A control device for a vehicle-mounted speaker, characterized in that: include: The direction adjustment unit and playback parameter adjustment unit of the car speaker, The direction adjustment unit is used to control the vehicle-mounted speaker to face the target passenger according to the position of the target passenger or the direction adjustment operation of the vehicle-mounted speaker; The playback parameter adjustment unit is used to adjust the playback parameters of the vehicle-mounted speaker so that the frequency response curve of the sound of the vehicle-mounted speaker at the target passenger position meets a preset condition.
14. The device according to claim 13, characterized in that The preset condition is that the fluctuation range of the frequency response curve is within a preset range.
15. The device according to claim 14, characterized in that The fluctuation range of the frequency response curve is within a preset range, which includes: a difference between the frequency response curve and a preset frequency response curve is within a preset range.
16. The device according to claim 15, characterized in that The vehicle stores a first correspondence relationship, the first correspondence relationship including different positions in the vehicle and preset frequency response curves corresponding to the different positions in the vehicle; the playback parameter adjustment unit is further configured to: A preset frequency response curve corresponding to the target passenger's position is determined according to the target passenger's position and the first corresponding relationship.
17. The device according to any one of claims 13 to 16, characterized in that A second correspondence is stored in the vehicle, the second correspondence including different positions in the vehicle and playback parameters corresponding to the different positions in the vehicle, the playback parameters corresponding to the different positions making the frequency response curves of the sound of the vehicle speaker corresponding to the different positions meet the preset conditions; The playback parameter adjustment unit is specifically used to: The playback parameters of the vehicle-mounted speaker are adjusted according to the location of the target passenger and the second corresponding relationship.
18. The device according to claim 17, characterized in that The second correspondence further includes audio playback modes corresponding to different positions in the vehicle; the playback parameter adjustment unit is specifically configured to: The playback parameters of the vehicle-mounted speaker are adjusted according to the location of the target passenger, the first audio playback mode, and the second corresponding relationship, where the first audio playback mode is the mode of the currently played audio.
19. The device according to any one of claims 13 to 16, characterized in that The playback parameter adjustment unit is specifically used to: receiving sound information collected by the vehicle-mounted speaker at the location of the target passenger from a sound collection device; Adjust the playback parameters of the vehicle-mounted speaker according to the sound signal.
20. The device according to claim 19, characterized in that The playback parameter adjustment unit is specifically used to: Obtaining relative position information between the sound collection device and the location of the target passenger; Adjust the playback parameters of the vehicle-mounted speaker according to the sound signal and the relative position information.
21. The device according to any one of claims 13 to 20, characterized in that The playback parameter adjustment unit is further configured to: The volume of the vehicle-mounted speaker is adjusted according to the relative distance between the vehicle-mounted speaker and the target passenger.
22. The device according to any one of claims 13 to 21, characterized in that The playback parameter adjustment unit is further configured to: Obtaining feedback from the target passenger on the output sound of the vehicle-mounted speaker, the feedback including voice feedback and / or facial expression feedback; According to the feedback, the playback parameters of the vehicle-mounted speaker are adjusted again.
23. The device according to any one of claims 13 to 22, characterized in that The target passenger's location includes: the specific location of the target passenger or the orientation of the target passenger relative to the vehicle-mounted speaker. The specific location includes: one of the position of the target passenger's seat, the position of the headrest of the target passenger's seat, the position of the target passenger's head, and the position of the target passenger's ear.
24. The device according to any one of claims 13 to 23, characterized in that The orientation adjustment unit is further configured to: Obtaining a passenger's facial image and determining a passenger whose facial features match pre-stored facial features as a target passenger; or, Acquire a passenger's voice signal and determine a passenger whose voice signal matches a pre-stored voice signal as a target passenger; or, The designated operation of the target passenger is received through the vehicle display screen, and the target passenger is determined according to the operation.
25. A control device for a vehicle-mounted speaker, characterized in that: The apparatus comprises at least one processor and a memory, wherein the processor and the memory are connected, and the memory stores a computer program. When the computer program stored in the memory is executed by the at least one processor, the apparatus performs the method according to any one of claims 1 to 12.
26. A vehicle, characterized in that: include: A control device for a vehicle-mounted speaker, wherein the control device for the vehicle-mounted speaker is configured to execute the method according to any one of claims 1 to 12.
27. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 12.
28. A computer program product, characterized in that The computer program product comprises a computer program which, when run on a computer, causes the computer to perform the method according to any one of claims 1 to 12.