Sound generation device control method, electronic device, system, computer program and vehicle

Abstract

The present invention provides a sound generator control method, a sound generator system, and a vehicle that help multiple users enjoy a good listening experience and improve the user's listening experience. [Solution] The sound generation device control method includes the steps of: a first device acquiring location information of multiple areas where multiple users are located; and the first device controlling the multiple sound generation devices to operate based on the location information of the multiple areas and the location information of the multiple sound generation devices. In this method, the user does not need to manually adjust the sound generation devices.

Description

Technical Field

[0005] , , , , , ,

[0006] ,

[0001] This application claims priority to Chinese Patent Application No. 202110744208.4, titled "Method for Controlling a Sound Generating Device, Sound Generating System, and Vehicle", filed with the China National Intellectual Property Administration on June 30, 2021, the entire disclosure of which is incorporated herein by reference.

[0002] Embodiments of the present application relate to the field of intelligent vehicles, and more specifically, to a method for controlling a sound generating device, a sound generating system, and a vehicle.

Background Art

[0003] With the improvement of people's living standards, vehicles have become an important means of transportation for people's travel. People who like to listen to music and radio may, in some cases, watch movies and view short videos while driving or waiting. Therefore, the sound field effect inside the vehicle has become an important element of concern, and a good acoustic effect can always bring a comfortable experience to people.

[0004] Currently, in order to achieve an optimal sound field at the target point position, users need to manually adjust the playback intensity of each speaker. When the driver needs to manually adjust the playback intensity, the driver needs to shift attention to the screen. This is a safety issue for driving. In addition, when the passengers inside the vehicle change their positions or the number of passengers increases, the speakers need to be continuously manually adjusted. This brings an unsatisfactory user experience.

Summary of the Invention

[0005] Embodiments of the present application provide a method for controlling a sound generating device, a sound generating system, and a vehicle. Position information of the area where the user is located is acquired to adaptively adjust the sound field optimization center, which helps to improve the user's listening experience.

[0006] According to the first embodiment, a method for controlling sound generators is provided. This method includes: a first device acquires location information of multiple areas where multiple users are located; and the first device controls the multiple sound generators to operate based on the location information of the multiple areas and the location information of the multiple sound generators.

[0007] In this embodiment of the present application, the first device acquires location information of multiple areas where multiple users are located, and controls the operation of the multiple sound generators based on the location information of the multiple areas and the location information of the multiple sound generators, without requiring the users to manually adjust the sound generators. This helps to reduce the learning cost for users and reduce the complexity of user operation. In addition, this also helps multiple users enjoy a good listening experience and improves the user experience.

[0008] In several possible implementations, the first device may be a sound generation system in a vehicle or home theater, or a sound generation system in a KTV.

[0009] In some possible implementations, before the first device obtains location information of an area where multiple users are located, the method further includes: the first device detects the first user action.

[0010] In several possible implementations, the first operation is a user operation that controls the first device to play audio content; or the first operation is a user operation that connects the second device to the first device and plays audio content on the second device by using the first device; or the first device is a user operation that enables the sound field adaptive switch.

[0011] Referring to the first aspect, in some implementations of the first aspect, the acquisition of location information of multiple areas where multiple users are located by a first device includes: the first device determines the location information of the areas where multiple users are located based on the collected detection information. The detection information may be one or more of image information, audio information, and pressure information. Image information may be collected by an image sensor, e.g., a camera or radar. Audio information may be collected by an acoustic sensor, e.g., a microphone array. Pressure information may be collected by a pressure sensor, e.g., a pressure sensor mounted on a seat. In addition, the detection information may be data collected by sensors, or information acquired based on data collected by sensors.

[0012] Referring to the first aspect, in some implementations of the first aspect, the acquisition of location information of multiple regions where multiple users are located by a first device includes: the first device determining the location information of multiple regions based on data collected by an image sensor; or the first device determining the location information of multiple regions based on data collected by a pressure sensor; or the first device determining the location information of multiple regions based on data collected by an acoustic sensor.

[0013] In this embodiment of the present invention, the multiple sound generators are controlled to operate based on location information of multiple areas where multiple users are located and location information of multiple sound generators. In this way, the computation process by which the first device controls the operation of the multiple sound generators can be simplified, and the first device can control the multiple sound generators more conveniently.

[0014] In some possible implementations, the image sensor may include a camera and a lidar, etc.

[0015] In some possible implementations, the image sensor may determine whether a user is present within a region by collecting image information within that region, and, based on the image information, determine whether the image information includes facial contour information, human ear information, iris information, etc.

[0016] In some possible implementations, the acoustic sensor may include a microphone array.

[0017] The sensor may be a single sensor or multiple sensors, where multiple sensors may be of the same type, such as all image sensors. Alternatively, detection information from multiple types of sensors, such as image and sound information collected by image and acoustic sensors, may be used to determine the user.

[0018] In some possible implementations, location information for multiple regions where multiple users are located may include the center point of each of the regions, or a pre-defined point in each of the regions, or a point in each region obtained according to a pre-defined rule.

[0019] Referring to the first aspect, in some implementations of the first aspect, the first device controlling the operation of the plurality of sound generators based on the positional information of the plurality of regions and the positional information of the plurality of sound generators includes: the first device determining a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all the plurality of regions is equal; and the first device controlling each of the plurality of sound generators to operate based on the distance between the sound field optimization center point and each of the plurality of sound generators.

[0020] In this embodiment of the present application, before controlling the operation of multiple sound generators, the first device may first determine the current sound field optimization center point and control the operation of the sound generators based on information about the distance between the sound field optimization center point and the multiple sound generators. This helps multiple users enjoy a good listening effect and improves the user experience.

[0021] In several possible implementations, the first device controlling the operation of multiple sound generators based on the location information of multiple regions and the location information of multiple sound generators includes: controlling the operation of multiple sound generators based on the location information of multiple regions and mapping relationships, where the mapping relationship is the mapping relationship between the locations of the multiple regions and the playback intensity of the multiple sound generators.

[0022] Referring to the first embodiment, in some implementations of the first embodiment, the method further includes: the first device notifies the position information of the sound field optimization center point.

[0023] In this embodiment of the present invention, the positional information of the sound field optimization center point is notified to the user, thereby improving the listening effect for multiple users and also helping the user determine the current sound field optimization center point.

[0024] In several possible implementations, the notification of the location information of the sound field optimization center point by the first device includes: the first device notifying the location information of the sound field optimization center point by using a human-computer interaction interface (HMI) or sound.

[0025] In several possible implementations, the first device may be a vehicle, and the first device notifying the location information of the sound field optimization center point includes: the vehicle notifying the location information of the sound field optimization center point by using ambient light.

[0026] Referring to the first aspect, in some implementations of the first aspect, the plurality of regions are regions in the cockpit of a vehicle.

[0027] Referring to the first aspect, in some implementations of the first aspect, the plurality of regions include a front row region and a rear row region.

[0028] Referring to the first aspect, in some implementations of the first aspect, the plurality of regions may include a driver region and a passenger region.

[0029] In some possible implementations, the plurality of regions include a driver region, a passenger region, a left region in the second row, and a right region in the second row.

[0030] In some possible implementations, the first device may be a vehicle, and the first device obtaining the position information of the plurality of regions where the plurality of users are located includes the following: the vehicle obtains the position information of the plurality of regions where the plurality of users are located by using pressure sensors under the seats in the regions.

[0031] In some possible implementations, the first device includes a microphone array, and the first device obtaining the position information of the plurality of users includes the following: the first device obtains an audio signal in the environment by using the microphone array; and based on the audio signal, determines the position information of the plurality of regions where the plurality of users in the environment are located.

[0032] Referring to the first aspect, in some implementations of the first aspect, the method further includes the following: the first device notifies the position information of the plurality of regions where the plurality of users are located.

[0033] In some possible implementations, the first device notifying the position information of the plurality of regions where the plurality of users are located includes the following: the first device notifies the position information of the plurality of regions where the plurality of users are located by using a human-computer interaction interface HMI or sound.

[0034] In several possible implementations, the first device may be a vehicle, and the first device notifying location information of multiple areas where multiple users are located includes: the vehicle notifying location information of multiple areas where multiple users are located by using ambient light.

[0035] Referring to the first embodiment, in some implementations of the first embodiment, controlling the operation of the plurality of sound generating devices includes: adjusting the playback intensity of each of the plurality of sound generating devices.

[0036] In some possible implementations, the playback intensity of each of the multiple sound generators is directly proportional to the distance between each sound generator and the user.

[0037] Referring to the first embodiment, in some implementations of the first embodiment, a plurality of sound generators include a first sound generator, and the adjustment of the playback intensity of each sound generator by the first device includes: the first device controls the playback intensity of the first sound generator to a first playback intensity. The method further includes: the first device receives a user command to adjust the playback intensity of the first sound generator from a first playback intensity to a second playback intensity; and the first device adjusts the playback intensity of the first sound generator to a second playback intensity in response to receiving the command.

[0038] In this embodiment of the present application, if the first device detects a user operation to adjust the playback intensity of the first sound generator from the first playback intensity to the second playback intensity after the playback intensity of the first sound generator has been adjusted to the first playback intensity, the first device may adjust the playback intensity of the first sound generator to the second playback intensity. In this way, the user can quickly adjust the playback intensity of the first sound generator, and as a result, the first sound generator better satisfies the user's listening needs.

[0039] According to a second embodiment, a sound generation system is provided, which includes a sensor, a controller, and a plurality of sound generating devices. The sensor is configured to collect data and transmit the data to the controller. The controller is configured to acquire location information of a plurality of areas where a plurality of users are located, based on the data; and to control the plurality of sound generating devices to operate, based on the location information of the plurality of areas and the location information of the plurality of sound generating devices.

[0040] Referring to the second aspect, in some implementations of the second aspect, the controller is specifically configured to: acquire location information of multiple regions based on data collected by an image sensor; acquire location information of multiple regions based on data collected by a pressure sensor; or acquire location information of multiple regions based on data collected by an acoustic sensor.

[0041] Referring to the second aspect, in some implementations of the second aspect, the controller is specifically configured to: determine a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all the multiple regions is equal; and control each of the multiple sound generators to operate based on the distance between the sound field optimization center point and each of the multiple sound generators.

[0042] Referring to the second aspect, in some implementations of the second aspect, the controller is further configured to send a first command to a first prompting device, where the first command instructs the first prompting device to provide positional information of the sound field optimization center point.

[0043] Referring to the second aspect, in some implementations of the second aspect, the plurality of regions are regions in the vehicle cockpit.

[0044] Referring to the second aspect, in some implementations of the second aspect, the multiple regions include a front-row region and a back-row region.

[0045] Referring to the second aspect, in some implementations of the second aspect, the front area includes the driver area and the passenger seat area.

[0046] Referring to the second aspect, in some implementations of the second aspect, the controller is further configured to send a second instruction to a second prompting device, where the second instruction instructs the second prompting device to provide location information of multiple areas where multiple users are located.

[0047] Referring to the second embodiment, in some implementations of the second embodiment, the controller is specifically configured to adjust the playback intensity of each of the multiple sound generating devices.

[0048] Referring to the second embodiment, in some implementations of the second embodiment, the plurality of sound generators include a first sound generator. The controller is specifically configured to control the playback intensity of the first sound generator to a first playback intensity. The controller is further configured to: receive a third command from the user to adjust the playback intensity of the first sound generator from the first playback intensity to a second playback intensity; and, in response to receiving the third command, adjust the playback intensity of the first sound generator to the second playback intensity.

[0049] According to a third embodiment, an electronic device is provided, which includes: a transmitting / receiving unit configured to receive detection information; and a processing unit configured to acquire location information of a plurality of areas where a plurality of users are located, based on the detection information. The processing unit is further configured to control the plurality of sound generators to operate based on the location information of the plurality of areas and the location information of the plurality of sound generators.

[0050] Referring to a third aspect, in some implementations of the third aspect, the processing unit is further configured to control the plurality of sound generators to operate based on the positional information of the plurality of regions and the positional information of the plurality of sound generators, which includes: the processing unit is configured to: determine a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all the plurality of regions is equal; and control each of the plurality of sound generators to operate based on the distance between the sound field optimization center point and each of the plurality of sound generators.

[0051] Referring to a third aspect, in some implementations of the third aspect, the transmitting / receiving unit is further configured to transmit a first command to a first prompting unit, wherein the first command instructs the first prompting unit to notify the position information of the sound field optimization center point.

[0052] Referring to the third aspect, in some implementations of the third aspect, the multiple regions are regions in the vehicle's cockpit.

[0053] Referring to the third aspect, in some implementations of the third aspect, the multiple regions include a front-row region and a back-row region.

[0054] Referring to the third aspect, in some implementations of the third aspect, the multiple areas include a driver area and a passenger seat area.

[0055] Referring to a third aspect, in some implementations of the third aspect, the transmitting / receiving unit is further configured to transmit a second instruction to a second prompting unit, the second instruction instructing the second prompting unit to notify the second prompting unit of the location information of the plurality of regions in which the plurality of users are located.

[0056] Referring to the third embodiment, in some implementations of the third embodiment, the processing unit is specifically configured to adjust the playback intensity of each of the plurality of sound generating devices.

[0057] Referring to the third aspect, in some implementations of the third aspect, the plurality of sound generators include a first sound generator. A processing unit is specifically configured to control the playback intensity of the first sound generator to a first playback intensity. A transmitting / receiving unit is further configured to receive a third command, which is a command to adjust the playback intensity of the first sound generator from a first playback intensity to a second playback intensity. The processing unit is further configured to adjust the playback intensity of the first sound generator to a second playback intensity.

[0058] Referring to the third embodiment, in some implementations of the third embodiment, the detection information includes one or more of image information, pressure information, and audio information.

[0059] In some possible implementations, the electronic device may be a chip or an in-vehicle device (e.g., a controller).

[0060] In some possible implementations, the transmit / receive unit may be an interface circuit.

[0061] In some possible implementations, the processing unit may be a processor or a processing unit, etc.

[0062] According to a fourth aspect, an apparatus is provided. The apparatus includes a unit configured to perform the method in any implementation of the first aspect.

[0063] According to the fifth aspect, an apparatus is provided. The apparatus includes a processing unit and a storage unit. The storage unit is configured to store instructions, and the processing unit executes the instructions stored in the storage unit, thereby the apparatus performs the method in any possible implementation of the first aspect.

[0064] Optionally, the processing unit may be a processor, and the storage unit may be memory. Memory may be a storage unit within a chip (e.g., registers or cache), or a storage unit located outside the chip in the vehicle (e.g., read-only memory or random-access memory).

[0065] According to the sixth aspect, a system is provided. The system includes sensors and electronic devices. The electronic devices may be electronic devices relating to any possible implementation of the third aspect.

[0066] Referring to the sixth aspect, in some implementations of the sixth aspect, the system further includes a plurality of sound generating devices.

[0067] According to the seventh embodiment, a system is provided. The system includes a plurality of sound generating devices and an electronic device, wherein the electronic device may be an electronic device relating to any possible implementation of the third embodiment.

[0068] Referring to the seventh aspect, in some implementations of the seventh aspect, the system further includes a sensor.

[0069] According to the eighth aspect, a vehicle is provided, the vehicle including a sound generating system relating to any one of the possible implementations of the second aspect, or the vehicle including an electronic device relating to any one of the possible implementations of the third aspect, or the vehicle including a device relating to any possible implementation of the fourth aspect, or the vehicle including a device relating to any possible implementation of the fifth aspect, or the vehicle including a system relating to any possible implementation of the sixth aspect, or the vehicle including a system relating to any possible implementation of the seventh aspect.

[0070] According to the ninth aspect, a computer program product is provided. The computer program product includes computer program code, and when the computer program code is executed on a computer, the computer is able to perform the method according to the first aspect.

[0071] It should be noted that all or part of the computer program code may be stored in a first storage medium. The first storage medium may be encapsulated together with the processor or separately from the processor. This is not specifically limited to this embodiment of the present application.

[0072] According to the tenth aspect, a computer-readable medium is provided. The computer-readable medium stores program code, and when the computer program code is executed on a computer, the computer is able to perform the method according to the first aspect. [Brief explanation of the drawing]

[0073] [Figure 1] This is a schematic functional block diagram of a vehicle according to an embodiment of the present invention.

[0074] [Figure 2] This is a schematic diagram of the structure of a sound generation system according to an embodiment of the present application.

[0075] [Figure 3] This is a schematic diagram of another structure of the sound generation system according to the present invention.

[0076] [Figure 4] This is a top view of the vehicle.

[0077] [Figure 5] This is a schematic flowchart of the sound generation device control method according to the embodiment of the present application.

[0078] [Figure 6] This is a schematic diagram showing the positions of the four speakers in the vehicle cockpit.

[0079] [Figure 7] This is a schematic diagram of a speaker sound field optimization center in a vehicle when users are present in the driver's seat, passenger seat, left-hand area of ​​the second row, and right-hand area of ​​the second row, according to an embodiment of the present application.

[0080] [Figure 8] This is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0081] [Figure 9] This is a schematic diagram of a speaker sound field optimization center in a vehicle according to an embodiment of the present application, when a user is present in the driver's seat, passenger seat, and the left-hand side of the second row.

[0082] [Figure 10] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0083] [Figure 11] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0084] [Figure 12] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0085] [Figure 13] This is a schematic diagram of a speaker sound field optimization center in a vehicle according to an embodiment of the present invention, when a user is present in the driver's seat and the left-hand side of the second row.

[0086] [Figure 14] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0087] [Figure 15] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0088] [Figure 16] This is a schematic diagram of a sound field optimization center in a vehicle when users are present in the driver's seat and passenger seat, according to an embodiment of the present application.

[0089] [Figure 17] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0090] [Figure 18] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0091] [Figure 19] This is a schematic diagram of a sound field optimization center in a vehicle according to an embodiment of the present invention, when a user is present in the driver's seat and the left-hand area of ​​the second row.

[0092] [Figure 20] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0093] [Figure 21] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0094] [Figure 22] This is a schematic diagram of a sound field optimization center in a vehicle when a user is present in the driver's seat according to an embodiment of the present invention.

[0095] [Figure 23] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0096] [Figure 24] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0097] [Figure 25] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0098] [Figure 26] This is another schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present invention.

[0099] [Figure 27] A group of graphic user interfaces (GUIs) according to the present invention is shown.

[0100] [Figure 28] Another group of GUIs according to the embodiment of this application is shown.

[0101] [Figure 29] This is a schematic diagram showing a sound generation device control method according to an embodiment of the present invention applied to a home theater.

[0102] [Figure 30] This is a schematic diagram of a sound field optimization center in a home theater according to an embodiment of the present invention.

[0103] [Figure 31] This is another schematic flowchart of the sound generation device control method according to the embodiment of the present application.

[0104] [Figure 32] This is a schematic diagram of the structure of a sound generation system according to an embodiment of the present application.

[0105] [Figure 33] This is a schematic block diagram of the apparatus according to an embodiment of the present application. [Modes for carrying out the invention]

[0106] The technical solution of this application will be described below with reference to the attached drawings.

[0107] Figure 1 is a schematic functional block diagram of a vehicle 100 according to an embodiment of the present invention. The vehicle 100 can be configured to be in a fully autonomous driving mode or a partially autonomous driving mode. For example, the vehicle 100 can implement fully autonomous driving by acquiring environmental information around the vehicle 100 using a detection system 120 and acquiring an autonomous driving policy based on an analysis of the surrounding environmental information, or it can implement partially autonomous driving by presenting the analysis results to the user.

[0108] Vehicle 100 may include various subsystems, such as an infotainment system 110, a sensing system 120, a decision control system 130, a propulsion system 140, and a computing platform 150. Optionally, vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of vehicle 100 may be interconnected by wired or wireless means.

[0109] In some embodiments, the infotainment system 110 may include a communication system 111, an entertainment system 112, and a navigation system 113.

[0110] The communication system 111 may include a wireless communication system that can communicate with one or more devices directly or via a communication network. For example, the wireless communication system 146 may use third-generation (3G) cellular communication, such as code division multiple access (CDMA), evolution data optimized (EVDO), global system for mobile communication (GSM®), or general packet radio service (GPRS); or fourth-generation (4G) cellular communication, such as long-term evolution (LTE); or fifth-generation (5G) cellular communication. The wireless communication system may communicate with a wireless local area network (WLAN) via Wi-Fi®. In some embodiments, the wireless communication system 146 may communicate directly with devices by using an infrared link, Bluetooth®, or ZigBee®. With regard to various vehicle communication systems in other wireless protocols, for example, the wireless communication system may include one or more dedicated short-range communications (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.

[0111] The entertainment system 112 may include a central control screen, a microphone, and a sound box. The user can listen to the radio and play music in the vehicle via the entertainment system. Alternatively, a mobile phone may be connected to the vehicle to project the phone's screen onto the central control screen. The central control screen may be a touchscreen, and the user can operate it by touching the screen. In some cases, the user's voice signal may be acquired using the microphone, and some controls performed by the user on the vehicle 100 may be implemented based on an analysis of the user's voice signal, for example, adjusting the temperature inside the vehicle. In other cases, music may be played for the user using the sound box.

[0112] The navigation system 113 may provide the vehicle 100 with route navigation by including a map service provided by a map provider. The navigation system 113 may be used in conjunction with the vehicle's Global Positioning System 121 and Inertial Measurement Unit 122. The map service provided by the map provider may be a two-dimensional map or a high-precision map.

[0113] The detection system 120 may include several types of sensors that detect information about the surrounding environment of the vehicle 100. For example, the detection system 120 may include a global positioning system 121 (the global positioning system may be a GPS system, or a BeiDou system or another positioning system), an inertial measurement unit (IMU) 122, a lidar 123, a millimeter-wave radar 124, an ultrasonic radar 125, and a camera device 126. The detection system 120 may further include sensors from the internal systems of the vehicle 100 being monitored (e.g., an onboard air quality monitor, a fuel gauge, and an oil temperature gauge). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, direction, and speed, etc.). Such detection and recognition are important functions for the safe operation of the vehicle 100.

[0114] The Global Positioning System 121 may be configured to estimate the geographical location of the vehicle 100.

[0115] The inertial measurement unit 122 is configured to detect changes in the position and orientation of the vehicle 100 based on inertial acceleration. In some embodiments, the inertial measurement unit 122 may be a combination of an accelerometer and a gyroscope.

[0116] The lidar 123 can detect objects in the environment in which the vehicle 100 is located by using a laser. In some embodiments, the lidar 123 may include one or more laser sources, a laser scanner, one or more detectors, and other system components.

[0117] The millimeter-wave radar 124 can detect objects in the surrounding environment of the vehicle 100 by using radio signals. In some embodiments, in addition to detecting objects, the radar 126 may be configured to further detect the speed and / or direction of movement of objects.

[0118] The ultrasonic radar 125 can detect objects around the vehicle 100 by using ultrasonic signals.

[0119] The camera device 126 may be configured to capture image information of the surrounding environment of the vehicle 100. The camera device 126 may include a monocular camera device, a binocular camera device, a structural optical camera device, and a panoramic camera device, etc. The image information acquired using the camera device 126 may include still images or may include video stream information.

[0120] The decision control system 130 includes a computing system 131 that performs analysis and decision-making based on information acquired by the detection system 120. The decision control system 130 further includes a vehicle control unit 132 that controls the power system of the vehicle 100, and a steering system 133, throttle 134, and brake system 135 configured to control the vehicle 100.

[0121] The computing system 131 may process and analyze various information acquired by the detection system 120 to identify targets, objects, and / or features in the environment surrounding the vehicle 100. Targets may include pedestrians or animals, and objects and / or features may include traffic signals, road boundaries, and obstacles. The computing system 131 may use techniques such as object recognition algorithms, structure from motion (SFM) algorithms, and video tracking. In some embodiments, the computing system 131 may be configured to map the environment, track objects, and estimate the speed of objects, etc. The computing system 131 may analyze the various information acquired to obtain a control policy for the vehicle.

[0122] The vehicle control unit 132 may be configured to improve the power performance of the vehicle 100 by coordinating and controlling the vehicle's power battery and engine 141.

[0123] The steering system 133 can be operated to adjust the direction of movement of the vehicle 100. For example, in an embodiment, the steering system 133 may be a steering wheel system.

[0124] The throttle 134 is configured to control the operating speed of the engine 141 and to control the speed of the vehicle 100.

[0125] The braking system 135 is configured to control the vehicle 100 to decelerate. The braking system 135 can reduce the speed of the wheels 144 by using frictional force. In some embodiments, the braking system 135 can convert the kinetic energy of the wheels 144 into an electric current. The braking system 135 may also control the speed of the vehicle 100 by reducing the rotational speed of the wheels 144 using other means.

[0126] The propulsion system 140 may include components that provide power to move the vehicle 100. In embodiments, the propulsion system 140 may include an engine 141, an energy source 142, a drive system 143, and wheels 144. The engine 141 may be an internal combustion engine, an electric motor, an air compressor engine, or a combination of other types of engines, for example, a hybrid engine formed by a gasoline engine and an electric motor, or a hybrid engine formed by an internal combustion engine and an air compressor engine. The engine 141 converts the energy source 142 into mechanical energy.

[0127] Examples of energy sources 142 include gasoline, diesel, other oil-based fuels, propane, other compressed gas-based fuels, ethyl alcohol, solar panels, batteries, and other power sources. Energy sources 142 may also supply energy to other systems of vehicle 100.

[0128] The drive unit 143 can transmit mechanical power from the engine 141 to the wheels 144. The drive unit 143 may include a gearbox, a differential, and a drive shaft. In embodiments, the drive unit 143 may further include another component, such as a clutch. The drive shaft may include one or more shafts that can be coupled to one or more wheels 121.

[0129] Some or all of the functions of the vehicle 100 are controlled by a computing platform 150. The computing platform 150 may include at least one processor 151, which can execute instructions 153 stored in a non-temporary computer-readable medium such as memory 152. In some embodiments, the computing platform 150 may alternatively be a plurality of computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner.

[0130] The processor 151 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor 151 may further include a graphics process unit (GPU), a field programmable gate array (FPGA), a system on a chip (SOC), an application-specific integrated circuit (ASIC), or a combination thereof. Figure 1 functionally illustrates the processor, memory, and other components of the computer 110 in the same block, but those skilled in the art should understand that a processor, computer, or memory may actually include multiple processors, computers, or memories, which may or may not be housed in the same physical housing. For example, the memory may be a hard disk drive or another storage medium located in a different housing than that of the computer 110. Thus, it should be understood that a reference to a processor or computer includes a reference to a set of processors or computers or memories, which may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as the steering component and the deceleration component, may include their own processors. The processors perform only the calculations related to the component-specific functions.

[0131] In various embodiments described herein, the processor may be located far from the vehicle and may communicate with the vehicle wirelessly. In another embodiment, some processes described herein are performed on a processor located within the vehicle, while other processes are performed by a remote processor (including performing the steps required for a single operation).

[0132] In some embodiments, memory 152 may include instructions 153 (e.g., program logic) which, when executed by the processor 151, can perform various functions of the vehicle 100. Memory 152 may also include additional instructions, including instructions used to transmit data to, receive data from, interact with, and / or control one or more of the infotainment system 110, sensing system 120, decision control system 130, and propulsion system 140.

[0133] In addition to instruction 153, memory 152 may further store data such as roadmaps, route information, vehicle position, direction, speed, and other vehicle data, and other information. This information may be used by the vehicle 100 and the computing platform 150 during the operation of the vehicle 100 in autonomous, semi-autonomous, and / or manual modes.

[0134] The computing platform 150 can control the functions of the vehicle 100 based on inputs received from various subsystems (e.g., the propulsion system 140, the sensing system 120, and the decision control system 130). For example, the computing platform 150 can use input from the decision control system 130 to control the steering system 133 to avoid obstacles detected by the sensing system 120. In some embodiments, the computing platform 150 may operate to provide control to many aspects of the vehicle 100 and its subsystems.

[0135] Optionally, one or more of the aforementioned components may be installed separately from the vehicle 100 or associated with the vehicle 100. For example, the memory 152 may be partially or completely isolated from the vehicle 100. The aforementioned components may be coupled together so as to be able to communicate together via wired and / or wireless means.

[0136] The components described above are merely examples, at their discretion. In actual application, components in the aforementioned modules may be added or removed based on actual requirements. Figure 1 should not be construed as limiting this embodiment of the present application.

[0137] An autonomous vehicle traveling on a road, for example, vehicle 100, may identify objects in its surrounding environment and decide to adjust its current speed. These objects may be other vehicles, traffic control devices, or other types of objects. In some examples, each identified object may be considered independently, and characteristics of each object, such as its current speed, acceleration, and the distance between the object and the vehicle, may be used to determine the speed adjusted by the autonomous vehicle.

[0138] Optionally, the vehicle 100 or a sensing and computing device associated with the vehicle 100 (e.g., computing system 131 and computing platform 150) may predict the behavior of an identified object based on the characteristics of the identified object and the state of the surrounding environment (e.g., road traffic, rain, and ice). Optionally, all identified objects depend on each other's behavior, and therefore, all identified objects can be considered together to predict the behavior of a single identified object. The vehicle 100 can adjust its speed based on the predicted behavior of the identified object. In other words, the autonomous vehicle can determine a stable state (e.g., acceleration, deceleration, or stopping) to which the vehicle needs to adjust based on the predicted behavior of the object. In this process, other factors may also be considered to determine the speed of the vehicle 100, such as the horizontal position of the vehicle 100 on the road it is driving on, the curvature of the road, and the proximity between static and dynamic objects.

[0139] In addition to providing commands to adjust the speed of the autonomous vehicle, the computing device may further provide commands to change the steering angle of the vehicle 100 so that the autonomous vehicle can follow a predetermined track and / or maintain a safe lateral and longitudinal distance between the autonomous vehicle and nearby objects (e.g., cars in adjacent lanes on the road).

[0140] Vehicle 100 could be an automobile, truck, motorcycle, bus, boat, airplane, helicopter, lawnmower, leisure vehicle, playground vehicle, construction device, trolley, golf cart, or train, etc. This is not specifically limited to the embodiments of the present application.

[0141] As people's living standards improve, vehicles have become an important means of transportation for getting around. People who enjoy listening to music and radio, and sometimes watching movies, may also browse short videos while driving or waiting. Therefore, the sound field effect inside a vehicle has become an important factor of interest, and good acoustics can always provide people with a comfortable experience.

[0142] Currently, users must manually adjust the playback intensity of each speaker to achieve the optimal sound field at the target point. When the driver needs to manually adjust the playback intensity, the driver must shift their focus to the screen, which poses a safety issue while driving. In addition, when passengers in the vehicle change positions or the number of passengers increases, the speaker playback intensity must be continuously adjusted manually, resulting in an unsatisfactory user experience.

[0143] Embodiments of this application provide a sound generation device control method, a sound generation system, and a vehicle. Location information of the area where the user is located is identified, and the sound field optimization center is automatically adjusted, resulting in each user achieving a good listening experience.

[0144] The in-vehicle sound generation system provided in the embodiments of the present application will be described below with reference to Figures 2 and 3. Figure 2 is a schematic diagram of the structure of the sound generation system according to the embodiment of the present application. The sound generation system may be a controller area network (CAN) control system. The CAN control system may include a plurality of sensors (e.g., sensor 1 and sensor 2), a plurality of electronic control units (ECUs), an in-vehicle entertainment host, a speaker controller, and a speaker. The sensors include, but are not limited to, cameras, microphones, ultrasonic radar, millimeter-wave radar, lidar, vehicle speed sensors, motor power sensors, and engine speed sensors. The ECUs are configured to receive data collected by the sensors, execute corresponding commands, and acquire periodic or event signals after executing the corresponding commands. The ECUs may then transmit these signals to a public CAN network, where the ECUs include, but are not limited to, a full vehicle controller, a hybrid controller, an automatic transmission controller, and an autonomous driving controller. The in-vehicle entertainment host is configured to capture periodic or event signals transmitted by each ECU over a public CAN network, and to perform a corresponding operation or forward the signal to the speaker controller when the corresponding signal is recognized. The speaker controller is used to adjust the speakers by receiving command signals from the in-vehicle entertainment host on a private CAN network. For example, in this embodiment of the present application, the in-vehicle entertainment host may capture image information collected by a camera from the CAN bus. Based on the image information, the in-vehicle entertainment host may determine whether a user is present in multiple areas within the vehicle and transmit the user's location information to the speaker controller. The speaker controller may control the playback intensity of each speaker based on the user's location information.

[0145] Figure 3 is a schematic diagram of another structure of an in-vehicle sound generation system according to an embodiment of the present application. The sound generation system may be a ring network communication architecture. All sensors and actuators (such as speakers, ambient light, air conditioners, and motors that acquire and execute commands) may be connected to a nearby vehicle integration unit (VIU). As a communication interface unit, the VIU may be deployed in a location where the vehicle's sensors and actuators are densely located, thereby enabling the vehicle's sensors and actuators to perform nearby connectivity. In addition, the VIU may have specific computing and driving capabilities (for example, the VIU may absorb the driving computing functions of several actuators). Sensors include, but are not limited to, cameras, microphones, ultrasonic radar, millimeter-wave radar, lidar, vehicle speed sensors, motor power sensors, and engine rotation speed sensors.

[0146] The VIUs communicate with each other via a network. The Intelligent Driving Computing Platform / Mobile Data Center (MDC), Vehicle Domain Controller (VDC), and Intelligent Cockpit Domain Controller (CDC) are individually and redundantly connected to the ring network communication network formed by the VIUs. After a sensor (e.g., a camera) collects data, the sensor can transmit the collected data to the VIU. The VIUs can then publish the data to the ring network. The MDC, VDC, and CDC collect relevant data on the ring network, compute the data, convert the data into a signal containing user location information, and publish the signal to the ring network. The speaker playback intensity is controlled via the corresponding computing and driving capabilities in the VIUs.

[0147] As shown in Figure 3, it should be understood that correspondences can exist between different VIUs and speakers located in different positions. For example, VIU1 may be configured to drive speaker 1, VIU2 to drive speaker 2, VIU3 to drive speaker 3, and VIU4 to drive speaker 4. The placement of VIUs may be independent of the speakers. For example, VIU1 may be located in the rear left side of the vehicle, while speaker 1 may be located near the driver's side door. Sensors or actuators can be connected to nearby VIUs, thereby reducing cable bundles. Due to the limited number of MDC, VDC, and CDC interfaces, VIUs can be connected to multiple sensors and multiple actuators to implement interface and communication functions.

[0148] In this embodiment of the present application, the VIU to which the sensor or controller is connected and the controller controlling the connection may be configured before shipment of the sound generation system or may be defined by the user, and it should be further understood that the hardware of the sound generation system may be replaced and upgraded.

[0149] It should be further understood that the VIU can absorb the operational computing functions of several sensors and actuators. Thus, when some actuators (e.g., CDC or VDC) fail, the VIU can directly process the data collected by the sensors to further control the actuators.

[0150] In one embodiment, the communication architecture shown in Figure 3 may be an intelligent digital vehicle platform (IDVP) ring network communication architecture.

[0151] Figure 4 is a top view of the vehicle. As shown in Figure 4, position 1 is the driver's seat, position 2 is the passenger seat, positions 3 through 5 are the rear row area, positions 6a through 6d are the locations of the four speakers in the vehicle, position 7 is the location of the onboard camera, and position 8 is the location of the CDC and the onboard central control screen. The speakers may be configured to play media sound in the vehicle. The onboard camera may be used to detect the location of passengers in the vehicle. The onboard central control screen may be used to display image information and application interfaces. The CDC is used to connect peripheral devices and provide data analysis and processing capabilities.

[0152] In Figure 4, please understand that only examples of speakers located near the driver's door, near the passenger's door, near the door in the second row left area, and near the door in the second row right area are used for illustrative purposes. In this embodiment of the present application, the speaker locations are not specifically limited. Speakers can alternatively be located near the vehicle doors, near the large central control screen, on the ceiling, floor, or seats (e.g., near the headrest of the seat).

[0153] Figure 5 is a schematic flowchart of a sound generation device control method 500 according to an embodiment of the present application. The method 500 may be applied to a vehicle, which includes a plurality of sound generation devices (e.g., speakers), and the method 500 includes the following steps.

[0154] S501: The vehicle acquires the user's location information.

[0155] In one embodiment, a vehicle may acquire image information of each area within the vehicle (e.g., the driver's seat, passenger seat, and rear seat area) by activating an onboard camera, and determine whether a user is present in the area based on the image information of each area. For example, the vehicle may analyze whether the image information collected by the camera includes the contours of a person's face, and as a result, the vehicle may determine whether a user is present in the area. In another example, the vehicle may analyze whether the image information collected by the camera includes iris information of a person's eye, and as a result, the vehicle may determine that a user is present in the area.

[0156] In one embodiment, when the vehicle detects that the user has turned on the sound field adaptive switch, the vehicle may activate the camera and acquire image information of each area within the vehicle.

[0157] For example, a user can enter the sound effects function interface by selecting a setting option on a large central control screen, and then choose to enable the sound field adaptive switch on the sound effects function interface.

[0158] In an embodiment, the vehicle may alternatively detect whether a user is present in the current area by using a pressure sensor located under the seat. For example, if the pressure value detected by the pressure sensor located under the seat in the area is greater than or equal to a preset value, it may be determined that a user is present in the area.

[0159] In one embodiment, the vehicle may alternatively determine the location of a sound source by using audio information acquired by a microphone array to determine a specific area where the user is located.

[0160] In the embodiment, the vehicle may alternatively acquire the location information of a user inside the vehicle by using one or a combination of an onboard camera, a pressure sensor, and a microphone array.

[0161] In this embodiment of the present invention, it should be understood that data collected by sensors (e.g., an in-vehicle camera, a pressure sensor, or a microphone array) may be transmitted to a CDC, which may process the data to determine a specific area where a user is located.

[0162] For example, after processing the data, CDC may convert the data into flag bits. For example, CDC may output 1000 when a user is only in the driver's seat. CDC may output 0100 when a user is only in the passenger seat. CDC may output 0010 when a user is only in the left-hand area of ​​the second row. CDC may output 1100 when a user is in both the driver's and passenger seats. CDC may output 1110 when a user is in the driver's seat, passenger seat, and the left-hand area of ​​the second row.

[0163] It should be understood that the method of outputting location information by the CDC is merely described by using flag bits as an example. This embodiment of the present application is not limited thereto.

[0164] It should be further understood that the above description uses an example in which the user seating area in the vehicle is divided into the driver's seat, passenger seat, second row left area, and second row right area. This embodiment of the present application is not limited thereto. For example, the area in the vehicle may alternatively be divided into the driver's seat, passenger seat, second row left area, second row middle area, and second row right area. In another example, in the case of a seven-seat SUV, the area in the vehicle may alternatively be divided into the driver's seat, passenger seat, second row left area, second row right area, third row left area, and third row right area. In another example, in the case of a passenger car, the area in the vehicle may be divided into a front row area and a rear row area. Alternatively, in the case of a multi-seat passenger car, the area in the vehicle may be divided into a driver's area and a passenger area, etc.

[0165] S502: The vehicle adjusts the sound generator based on the user's location information.

[0166] For example, an example where the sound generating device is a speaker is used for illustrative purposes, referring to speakers 6a through 6d in Figure 2. Figure 6 shows the positions of four speakers. For example, the graph formed by the connecting lines of the points where the four speakers are located is rectangle ABCD. Speaker 1 is located at point A on rectangle ABCD, speaker 2 is located at point B, speaker 3 is located at point C, and speaker 4 is located at point D. Point O is the center point of rectangle ABCD (the distances between point O and the four points A, B, C, and D are equal). It should be understood that different automobiles will have different positions and different numbers of speakers. In a particular implementation process, a particular tuning scheme may be designed based on the model of the automobile or the speaker configuration in the automobile. This is not limited to the present invention.

[0167] Figure 7 is a schematic diagram of the sound field optimization center for speakers in a vehicle according to an embodiment of the present application, when users are present in the driver's seat, passenger seat, left-hand region of the second row, and right-hand region of the second row. The center points of all regions can form a rectangle EFGH, and the center point of the rectangle EFGH may be point Q. Point Q may be the current sound field optimization center point in the vehicle.

[0168] For example, point Q may coincide with point O. Since the distance between the center point Q of rectangle EFGH and the four speakers is equal, the vehicle can control the playback intensity of the four speakers to be the same (for example, the playback intensity of all four speakers is p).

[0169] For example, if points Q and O do not overlap, the vehicle can control the playback intensity of the four speakers based on the distance between point Q and the four speakers.

[0170] For example, in the case of speaker 1 (located at point A), the vehicle controls the playback intensity of speaker 1.

number

[0171] In another example, if speaker 2 (located at point B) is located, the vehicle will adjust the playback intensity of speaker 2.

number

[0172] In another example, if speaker 3 (located at point C) is located, the vehicle will adjust the playback intensity of speaker 3.

number

[0173] In another example, if speaker 4 (located at point D) is located, the vehicle will adjust the playback intensity of speaker 4.

number

[0174] Figure 8 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat, passenger seat, second row left area, and second row right area, the large central control screen may notify the user that "people have been detected in the driver's seat, passenger seat, second row left area, and second row right area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located, the center point of the area where the passenger seat is located, the center point of the second row left area, and the center point of the second row right area.

[0175] Figure 9 is a schematic diagram of the sound field optimization center for speakers in a vehicle, according to an embodiment of the present application, when a user is present in the driver's seat, passenger seat, and the left-hand region of the second row. The center points of the driver's seat, passenger seat, and the left-hand region of the second row may form a triangle EFG, where the circumcenter of triangle EFG may be point Q. Point Q may be the current sound field optimization center point in the vehicle.

[0176] For example, point Q may coincide with point O. Since the distance between the center point Q of rectangle EFGH and the four speakers is equal, the vehicle can control the playback intensity of the four speakers to be the same (for example, the playback intensity of all four speakers is p).

[0177] For example, points Q and O may not overlap. In this case, please refer to the description in the above embodiment for how the vehicle controls the playback intensity of the four speakers. Further details will not be described again in this specification.

[0178] Figure 10 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat, passenger seat, and the second row left area, the large central control screen may notify the user that "people have been detected in the driver's seat, passenger seat, and the second row left area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located, the center point of the area where the passenger seat is located, and the center point of the second row left area.

[0179] Figure 11 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat, passenger seat, and the second row right area, the large central control screen may notify the user that "people have been detected in the driver's seat, passenger seat, and the second row right area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located, the center point of the area where the passenger seat is located, and the center point of the second row right area.

[0180] Figure 12 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat, the left-hand area of ​​the second row, and the right-hand area of ​​the second row, the large central control screen may notify the user that "people have been detected in the driver's seat, the left-hand area of ​​the second row, and the right-hand area of ​​the second row," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located, the center point of the left-hand area of ​​the second row, and the center point of the right-hand area of ​​the second row.

[0181] Regarding the method by which the vehicle controls the playback intensity of the four speakers when a user is present in the driver's seat, passenger seat, and the right-hand area of ​​the second row, or when a user is present in the driver's seat, the left-hand area of ​​the second row, and the right-hand area of ​​the second row, please understand that this may refer to the aforementioned method by which the vehicle controls the playback intensity of the four speakers when a user is present in the driver's seat, passenger seat, and the left-hand area of ​​the second row. Further details will not be explained again in this specification.

[0182] Figure 13 is a schematic diagram of the sound field optimization center for a speaker in a vehicle, according to an embodiment of the present application, when a user is present in the driver's seat and the left-hand region of the second row. The connecting line between the center point of the driver's seat and the center point of the left-hand region of the second row is EG, where the midpoint of EG may be point Q. Point Q may be the current sound field optimization center point in the vehicle.

[0183] For example, point Q may coincide with point O. Since the midpoint of line segment EH and the distances between the four speakers are equal, the vehicle can control the playback intensity of the four speakers to be the same (for example, the playback intensity of all four speakers is p).

[0184] For example, if points Q and O do not overlap, the vehicle may control the playback intensity of the four speakers based on the distance between point Q and the four speakers. For a specific control process, please refer to the description of the embodiments above. Further details are not described again herein.

[0185] Figure 14 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat and the second row right area, the large central control screen may notify the user that "a person has been detected in the driver's seat and the second row right area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located and the center point of the second row right area.

[0186] Figure 15 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the passenger seat and the second row left area, the large central control screen may notify the user that "a person has been detected in the passenger seat and the second row left area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the passenger seat is located and the center point of the second row left area.

[0187] Figure 16 is a schematic diagram of a sound field optimization center in a vehicle when users are present in the driver's seat and passenger seat, according to an embodiment of the present application. The connecting line between the center points of the regions where the driver's seat and passenger seat are located is EF, where the midpoint of EF may be point P. Point P may be the current sound field optimization center within the vehicle.

[0188] Figure 17 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat and passenger seat, the central control screen may notify the user that "people have been detected in the driver's seat and passenger seat" and that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located and the center point of the area where the passenger seat is located.

[0189] For example, the vehicle can control the playback intensity of the four speakers based on the distance between point P and the four speakers.

[0190] For example, in the case of speaker 1 (located at point A), the vehicle controls the playback intensity of speaker 1.

number

[0191] In another example, if speaker 2 (located at point B) is located, the vehicle will adjust the playback intensity of speaker 2.

number

[0192] In another example, if speaker 3 (located at point C) is located, the vehicle will adjust the playback intensity of speaker 3.

number

[0193] In another example, if speaker 4 (located at point D) is located, the vehicle will adjust the playback intensity of speaker 4.

number

[0194] Figure 18 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the second row left area and the second row right area inside the vehicle, the large central control screen may notify the user that "people have been detected in the second row left area and the second row right area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the second row left area and the center point of the second row right area.

[0195] Figure 19 is a schematic diagram of a sound field optimization center in a vehicle according to an embodiment of the present application, when a user is present in the driver's seat and the left-hand region of the second row. The connecting line between the center point of the driver's seat and the center point of the left-hand region of the second row is EH, where the midpoint of EH may be point R. Point R may be the current sound field optimization center in the vehicle.

[0196] Figure 20 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat and the second row left area, the large central control screen may notify the user that "a person has been detected in the driver's seat and the second row left area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the driver's seat is located and the center point of the second row left area.

[0197] For example, the vehicle can control the playback intensity of the four speakers based on the distance between point R and the four speakers.

[0198] For example, in the case of speaker 1 (located at point A), the vehicle controls the playback intensity of speaker 1.

number

[0199] In another example, if speaker 2 (located at point B) is located, the vehicle will adjust the playback intensity of speaker 2.

number

[0200] In another example, if speaker 3 (located at point C) is located, the vehicle will adjust the playback intensity of speaker 3.

number

[0201] In another example, if speaker 4 (located at point D) is located, the vehicle will adjust the playback intensity of speaker 4.

number

[0202] Figure 21 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the passenger seat and the second row right area, the large central control screen may notify the user that "a person has been detected in the passenger seat and the second row right area," and may also notify the user that the current sound field optimization center point may be a point equidistant from the center point of the area where the passenger seat is located and the center point of the second row right area.

[0203] Figure 22 is a schematic diagram of the sound field optimization center in a vehicle when a user is present in the driver's seat according to an embodiment of the present application. Point E is the center point of the region where the driver's seat is located, and point E may be the current sound field optimization center point within the vehicle.

[0204] Figure 23 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the driver's seat, the large central control screen may notify the user that "a person has been detected in the driver's seat" and that the current sound field optimization center point may be the center point of the area where the driver's seat is located.

[0205] For example, the vehicle can control the playback intensity of the four speakers based on the distance between point E and the four speakers.

[0206] For example, in the case of speaker 1 (located at point A), the vehicle controls the playback intensity of speaker 1.

number

[0207] In another example, if speaker 2 (located at point B) is located, the vehicle will adjust the playback intensity of speaker 2.

number

[0208] In another example, if speaker 3 (located at point C) is located, the vehicle will adjust the playback intensity of speaker 3.

number

[0209] In another example, if speaker 4 (located at point D) is located, the vehicle will adjust the playback intensity of speaker 4.

number

[0210] Figure 24 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the passenger seat, the large central control screen may notify the user that "a person has been detected in the passenger seat" and that the current sound field optimization center point may be the center point of the area where the passenger seat is located.

[0211] Figure 25 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the left-hand area of ​​the second row, the large central control screen may notify the user that "a person has been detected in the left-hand area of ​​the second row" and that the current sound field optimization center point may be the center point of the left-hand area of ​​the second row.

[0212] Figure 26 is a schematic diagram showing the sound field optimization center on a large central control screen of a vehicle according to an embodiment of the present application. When the vehicle detects that a user is present in the right-hand area of ​​the second row, the large central control screen may notify the user that "a person has been detected in the right-hand area of ​​the second row" and that the current sound field optimization center point may be the center point of the right-hand area of ​​the second row.

[0213] It should be understood that the example used for illustrative purposes in S501, where the user's location information is the center point of the region where the user is located, is used here. This embodiment of the present application is not limited thereto. For example, the user's location information could alternatively be another predefined point in the region where the user is located, or it could alternatively be a point in the region obtained through calculation according to a predefined rule (e.g., a predefined algorithm).

[0214] In some embodiments, the user's location information may be determined alternatively based on the location information of the user's human ears. The location information of the user's human ears may be determined based on image information collected by a camera device. For example, the location information of the user's human ears is the midpoint of the connecting line between a first point and a second point, where the first point is a point on the user's left ear and the second point is a point on the user's right ear. In another example, the location information of the user's auricle may be determined based on image information collected by a camera device. The location information of a region may be determined based on the location information of the user's human ears or the location information of the auricle of the human ear. Referring to Figures 27 and 28, the following describes the process by which the user manually adjusts the playback intensity of a particular speaker after the vehicle has adjusted the playback intensity of multiple sound generators using the user's location information.

[0215] Figure 27 shows a group of graphical user interfaces (GUIs) according to the embodiment of the present application.

[0216] As shown in Figure 27(a), when a user is present in the driver's seat, passenger seat, left-hand area of ​​the second row, and right-hand area of ​​the second row, the vehicle may notify the user on the HMI that "a person has been detected in the driver's seat, passenger seat, left-hand area of ​​the second row, and right-hand area of ​​the second row," and may also notify the user of the current sound field optimization center. As shown in Figure 27(a), the smiles in the driver's seat, passenger seat, left-hand area of ​​the second row, and upper-right area of ​​the second row indicate the presence of a user within the area. When the vehicle detects that the user has touched and held the smile in the left-hand area of ​​the second row, it may display icon 2701 (e.g., a trash can icon) on the HMI. When the vehicle detects that the user has dragged the smile in the left-hand area of ​​the second row to icon 2701, it may display the GUI shown in Figure 27(b) on the HMI.

[0217] As shown in Figure 27(b), in response to a detected operation in which the user drags the smiley face in the left-hand area of ​​the second row to icon 2701, the vehicle may notify the user on the HMI that "the speaker volume in the left-hand area of ​​the second row has been reduced to 0."

[0218] In this embodiment, if a user is present in the driver's seat, passenger seat, second row left area, and second row right area, the current playback intensity of the four speakers may be p. When the vehicle detects that the user has dragged the smiley face in the second row left area to icon 2701, the vehicle may reduce the playback intensity of the speaker in the second row left area to 0, or reduce the playback intensity of the speaker in the second row left area from p to 0.1p. This is not limited to this embodiment of the present application.

[0219] Figure 28 shows a group of GUIs according to the present invention.

[0220] As shown in (a) of Figure 28, when a user is present in the driver's seat, passenger seat, left-hand area of ​​the second row, and right-hand area of ​​the second row, the vehicle may notify the user on the HMI that "a person has been detected in the driver's seat, passenger seat, left-hand area of ​​the second row, and right-hand area of ​​the second row," and may also notify the user of the current sound field optimization center. When the vehicle detects on the HMI that the user's finger is sliding upwards within the left-hand area of ​​the second row, a playback intensity scroll bar 2801 may be displayed. The playback intensity scroll bar 2801 may include a scroll block 2802.

[0221] As shown in Figure 28(b), in response to a detected operation in which the user's finger slides upward within the left-hand area of ​​the second row, the vehicle may increase the playback intensity of the speaker near the left-hand area of ​​the second row and indicate that the scroll block 2802 on the HMI is moving upward. For example, the playback intensity of the speaker near the left-hand area of ​​the second row may increase from p to 1.5p. At the same time, the vehicle may notify the user on the HMI that "the volume of the speaker in the left-hand area of ​​the second row has increased."

[0222] In this embodiment of the present application, after adjusting the playback intensity of the first sound generator to the first playback intensity, if the vehicle detects that the user has adjusted the playback intensity of the speaker from the first playback intensity to the second playback intensity, the vehicle may adjust the playback intensity of the speaker to the second playback intensity. In this way, the user can quickly adjust the playback intensity of the speakers within the region, and as a result, the speakers within the region better satisfy the user's listening needs.

[0223] In the embodiment, the vehicle may further determine the state of a user within a region based on image information collected by a camera, thereby adjusting the playback intensity of speakers near the region by referring to the region's location information and the user's state. For example, if the vehicle detects that a user is present in the left-hand region of the second row and that the user is resting, the vehicle may control the playback intensity of speakers near the left-hand region of the second row to 0 or another value.

[0224] In this embodiment, the second playback intensity may alternatively be the default playback intensity (for example, the second playback intensity is 0). When the vehicle detects a pre-set user operation within an area on a large central control screen (for example, the area on the left of the second row), the vehicle may adjust the playback intensity of the speakers within that area from the first playback intensity to the default playback intensity.

[0225] In this embodiment, the pre-set operations include, but are not limited to, touch-and-hold operations by the user detected within the area (for example, touching and holding a seat in the left-hand area of ​​the second row), and slide or tap operations within the area.

[0226] Referring to Figures 6 to 28, the above description has focused on the application of the sound generator control method provided in the embodiments of the present application to an in-vehicle scenario. It should be understood that the control method can be applied to other scenarios, such as a home theater scenario or a KTV scenario. Figure 29 is a schematic diagram of the sound generator control method according to the embodiments of the present application when applied to a home theater. As shown in Figure 29, the home theater may include soundbox 1, soundbox 2, and soundbox 3. The sound generation system in the home theater can adjust the three soundboxes by detecting the positional relationship between the user and the three soundboxes.

[0227] Figure 30 is a schematic diagram of a sound field optimization center in a home theater according to an embodiment of the present invention. For example, the graph including the connecting lines of the points where the three soundboxes are located is triangle ABC, where soundbox 1 is located at point A on triangle ABC, soundbox 2 is located at point B, and soundbox 3 is located at point C. Point O is the circumcenter of triangle ABC.

[0228] When the center point of the area where the user is located coincides with point O, or when point O is located within the area where the user is located, the sound generation system can control soundbox 1, soundbox 2, and soundbox 3 to have the same playback intensity. (For example, the playback intensity of all three soundboxes is p).

[0229] When the center point of the area where the user is located does not coincide with point O, or when point O is not located in the area where the user is located, the sound generation system may adjust the playback intensity of the three sound boxes based on the positional relationship between the area where the user is located and the three sound boxes.

[0230] For example, if the center point of the area where the user is located is point Q, and in the case of soundbox 1 (located at point A), the sound generation system will adjust the playback intensity of soundbox 1.

number

[0231] In another example, for soundbox 2 (located at point B), the sound generation system controls the playback intensity of soundbox 2.

number

[0232] In another example, for soundbox 3 (located at point C), the sound generation system controls the playback intensity of soundbox 3.

number

[0233] Figure 31 is a schematic flowchart of a sound generator control method 3100 according to an embodiment of the present application. Method 3100 may be applied to a first device. As shown in Figure 31, method 3100 includes the following steps.

[0234] S3101: The first device acquires location information for multiple areas where multiple users are located.

[0235] Optionally, the first device acquiring location information for multiple areas where multiple users are located includes: acquiring detection information; and determining the location information for the multiple areas based on the detection information, where the detection information includes one or more of image information, pressure information, and audio information.

[0236] For example, detection information may include image information. The first device may acquire image information by using an image sensor.

[0237] For example, the first device is a vehicle. Based on image information collected by an imaging device, the vehicle may determine whether the image information includes facial contour information, human ear information, or iris information, etc. When the vehicle needs to determine whether a user is present in the driver area, the vehicle may acquire image information of the driver area collected by a driver camera. If the vehicle can determine that the image information includes one or more of facial contour information, human ear information, or iris information, the first device may determine that a user is present in the driver area.

[0238] It should be understood that the implementation process for determining that image information includes one or more of facial contour information, human ear information, or iris information is not limited to this embodiment of the present application. For example, a vehicle may input image information into a neural network to obtain a classification result that the region includes the user's face.

[0239] In another example, the vehicle may further establish a coordinate system for the driver's area. When the vehicle needs to determine whether there is a person in the driver's area, it may collect image information from multiple coordinate points within the coordinate system by using a driver camera and further analyze whether human feature information exists at those coordinate points. If human feature information exists, the vehicle may determine that a user is present in the driver's area.

[0240] Optionally, the first device may be a vehicle, and the detected information may be pressure information. For example, pressure sensors may be located under each seat in the vehicle, and the first device acquiring location information for multiple areas where multiple users are located includes: the first device acquiring location information for multiple areas where multiple users are located based on pressure information (e.g., pressure values) collected by the pressure sensors.

[0241] Optionally, if the pressure value collected by the pressure sensor is greater than or equal to a first threshold, the vehicle determines that a user is present in the area corresponding to the pressure sensor. For example, if the pressure value detected by the pressure sensor under the seat in the driver's area is greater than or equal to a preset pressure value, the vehicle may determine that a user is present in the driver's area.

[0242] Optionally, the detection information may be audio information. The acquisition of location information of multiple areas where multiple users are located by the first device includes: the first device acquires location information of multiple areas where multiple users are located by using sound signals collected by a microphone array. For example, the first device may position a user based on sound signals collected by a microphone array. If the first device positions itself based on the sound signals such that a user is located in an area, the first device may determine that a user is present in the area.

[0243] Optionally, the first device may further determine whether a user is present in the area by referring to at least two types of image information, pressure information, and voice information.

[0244] For example, the first device is a vehicle. When the vehicle needs to determine whether a user is present in the driver area, the vehicle may obtain the image information collected by the driver camera and the pressure information collected by the pressure sensor in the driver's seat. Based on the image information collected by the driver camera, if it is determined that the image information includes face information and the pressure value collected by the pressure sensor in the driver's seat is greater than or equal to the first threshold value, the vehicle may determine that a user is present in the driver area.

[0245] In another example, when the first device needs to determine whether a user is present in the area, the first device may obtain the image information within the area collected by the camera and pick up the voice information in the environment by using the microphone array. Based on the image information of the area collected by the camera, if it is determined that the image information includes face information, and based on the voice information collected by the microphone array, if it is determined that the sound is coming from the area, the vehicle may determine that a user is present in the area.

[0246] S3102: The first device controls the plurality of sound generating devices to operate based on the position information of the plurality of areas where the plurality of users are located and the position information of the plurality of sound generating devices.

[0247] Optionally, the position information of the plurality of areas where the plurality of users are located may include the center point of each of the plurality of areas, or a preset point of each of the plurality of areas, or a point of each area obtained according to a preset rule (for example, a preset algorithm).

[0248] Optionally, the first device controlling the operation of multiple sound generators based on the location information of multiple regions and the location information of multiple sound generators includes: controlling the operation of multiple sound generators based on the location information of multiple regions and mapping relationships, where the mapping relationship is the mapping relationship between the locations of the multiple regions and the playback intensity of the multiple sound generators.

[0249] For example, the vehicle shown in Figure 4 is used as an example. Table 1 shows the mapping relationship between the locations of multiple regions and the reproduction intensities of multiple sound generating devices. [Table 1] [Table 1]

[0250] Please understand that the mapping relationships between positions and the reproduction intensities of multiple sound generators shown in Table 1 are merely examples. The region division method and speaker reproduction intensities are not limited to this embodiment of the present application.

[0251] Optionally, the first device controls the operation of multiple sound generators based on the positional information of multiple regions and the positional information of multiple sound generators, which includes: the first device determines a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all multiple regions is equal; and the first device controls the operation of each of the multiple sound generators based on the distance between the sound field optimization center point and each of the multiple sound generators.

[0252] Optionally, this method further includes: the first device notifying the location information of the sound field optimization center point.

[0253] Optionally, the first device communicates the current location information of the sound field optimization center by using HMI, sound, or ambient light.

[0254] Selectively, multiple regions are areas within the vehicle cockpit.

[0255] Optionally, the multiple regions may include a front-row region and a rear-row region. Optionally, the multiple regions may include a driver's area and a passenger-side region.

[0256] Optionally, the method further includes: a first device notifying location information of multiple areas where multiple users are located.

[0257] Selectively controlling the first device to operate multiple sound generators includes the following:

[0258] The first device adjusts the playback intensity of each of the multiple sound generating devices.

[0259] Optionally, multiple sound generators include a first sound generator, and the first device adjusting the playback intensity of each sound generator includes: the first device controlling the playback intensity of the first sound generator to a first playback intensity. The method further includes: the first device receiving a user command to adjust the playback intensity of the first sound generator from a first playback intensity to a second playback intensity; and the first device adjusting the playback intensity of the first sound generator to a second playback intensity in response to receiving the command.

[0260] For example, as shown in (b) of Figure 27, users are present in the driver's seat, passenger seat, the left-hand area of ​​the second row, and the right-hand area of ​​the second row within the vehicle. In this case, the vehicle may control the playback intensity of the four speakers to be set to p. When the vehicle detects that the user has dragged the smiley face in the left-hand area of ​​the second row onto icon 2701 on the HMI, the vehicle may adjust the playback intensity of the speaker near the left-hand area of ​​the second row from p to 0.

[0261] For example, as shown in (b) of FIG. 28, there are users in the driver's seat, passenger seat, left area of the second row, and right area of the second row inside the vehicle. In this case, the vehicle can control the playback intensity of the four speakers to be p. When the vehicle detects an upward sliding operation by the user in the left area of the second row on the HMI, the vehicle can adjust the playback intensity of the speaker near the left area of the second row from p to 1.5p.

[0262] In this embodiment of the present application, the first device acquires the position information of a plurality of areas where a plurality of users are located, and based on the position information of the plurality of areas and the position information of the plurality of sound generating devices, controls the plurality of sound generating devices to operate without the user needing to manually adjust the sound generating devices. This helps to reduce the learning cost of the user and reduce the cumbersome operations of the user. In addition, this also helps a plurality of users to enjoy a good listening effect and helps to improve the user experience.

[0263] FIG. 32 is a schematic diagram of the structure of a sound generating system 3200 according to an embodiment of the present application. The sound generating system may include a sensor 3201, a controller 3202, and a plurality of sound generating devices 3203. The sound generating system includes a sensor, a controller, and a plurality of sound generating devices.

[0264] The sensor 3201 is configured to collect data and transmit the data to the controller.

[0265] The controller 3202 is configured to acquire the position information of a plurality of areas where a plurality of users are located based on the data; and control the plurality of sound generating devices 3203 to operate based on the position information of the plurality of areas and the position information of the plurality of sound generating devices. Optionally, the data includes at least one of image information, pressure information, and voice information.

[0266] Optionally, the controller 3202 is specifically configured to: determine a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all multiple regions is equal; and control each of the multiple sound generators to operate based on the distance between the sound field optimization center point and each of the multiple sound generators.

[0267] Optionally, the controller 3202 is further configured to send a first command to a first prompting device, instructing the first prompting device to notify it of the position information of the sound field optimization center point.

[0268] Selectively, multiple regions are areas within the vehicle cockpit.

[0269] Optionally, multiple regions include front-row regions and back-row regions.

[0270] Optionally, multiple areas may include the driver's area and the passenger seat area.

[0271] Optionally, the controller 3202 is further configured to send a second instruction to a second prompting device, instructing the second prompting device to notify it of location information for multiple areas where multiple users are located.

[0272] Optionally, the controller 3202 is specifically configured to adjust the playback intensity of each of the multiple sound generators 3203.

[0273] Optionally, the multiple sound generators 3203 include a first sound generator. The controller 3202 is specifically configured to control the playback intensity of the first sound generator to a first playback intensity. The controller 3202 is further configured to: receive a third command from the user to adjust the playback intensity of the first sound generator from a first playback intensity to a second playback intensity; and, in response to receiving the third command, adjust the playback intensity of the first sound generator to the second playback intensity.

[0274] Figure 33 is a schematic block diagram of an apparatus 3300 according to an embodiment of the present application. The apparatus 3300 includes a transmitting / receiving unit 3301 and a processing unit 3302. The transmitting / receiving unit 3301 is configured to receive detection information. The processing unit 3302 is configured to acquire location information of multiple areas where multiple users are located based on the detection information. The processing unit 3302 is further configured to control the operation of multiple sound generators based on the location information of multiple areas where multiple users are located and the location information of multiple sound generators.

[0275] Optionally, the processing unit 3302 is configured to further control the operation of multiple sound generators based on the positional information of multiple regions and the positional information of multiple sound generators, which includes: the processing unit 3302 is configured to: determine a sound field optimization center point, where the distance between the sound field optimization center point and the center points of all multiple regions is equal; and control each of the multiple sound generators to operate based on the distance between the sound field optimization center point and each of the multiple sound generators.

[0276] Optionally, the transmitting / receiving unit 3301 is further configured to send a first command to a first prompting unit, instructing the first prompting unit to notify it of the position information of the sound field optimization center point.

[0277] Selectively, multiple regions are areas within the vehicle cockpit.

[0278] Optionally, multiple regions include front-row regions and back-row regions.

[0279] Optionally, multiple areas include the driver's area and the passenger seat area.

[0280] Optionally, the transmit / receive unit 3301 is further configured to send a second command to a second prompt unit, instructing the second prompt unit to notify the second prompt unit of location information of multiple areas where multiple users are located.

[0281] Optionally, the processing unit 3302 is specifically configured to adjust the playback intensity of each of the multiple sound generating devices.

[0282] Optionally, the multiple sound generators include a first sound generator. The processing unit 3302 is specifically configured to control the playback intensity of the first sound generator to a first playback intensity. The transmitting / receiving unit 3301 is further configured to receive a third command, which is a command to adjust the playback intensity of the first sound generator from a first playback intensity to a second playback intensity. The processing unit 3302 is further configured to adjust the playback intensity of the first sound generator to a second playback intensity.

[0283] Optionally, the detection information includes one or more of the following: image information, pressure information, and audio information.

[0284] Embodiments of the present invention further provide an apparatus, the apparatus including a processing unit and a storage unit. The storage unit is configured to store instructions, the processing unit executes the instructions stored in the storage unit, and as a result the apparatus performs a sound generator control method.

[0285] Optionally, the processing unit may be the processor 151 shown in Figure 1, and the storage unit may be the memory 152 shown in Figure 1. The memory 152 may be a storage unit within the chip (e.g., a register or cache), or it may be a storage unit located outside the chip in the vehicle (e.g., a read-only memory or random access memory).

[0286] Embodiments of the present invention further provide a vehicle including a sound generating system 3200 or device 3300.

[0287] Embodiments of the present invention further provide a computer program product. The computer program product includes computer program code, and when the computer program code is executed on a computer, the computer is able to perform the present method.

[0288] Embodiments of the present invention further provide a computer-readable medium. The computer-readable medium stores program code, and when the computer program code is executed on a computer, the computer can execute the present method.

[0289] In the implementation process, the steps in this method may be implemented by using hardware integrated logic circuits in the processor 151 or by using instructions in the form of software. The methods disclosed with reference to embodiments of this application may be performed directly by a hardware processor or by using a combination of hardware and software modules in the processor 151. The software modules may reside in mature storage media of the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. The storage medium is located in memory, and the processor 151 reads information from memory 152 and, in combination with the hardware of the processor 151, completes the steps in this method. To avoid repetition, details are not described again in this specification.

[0290] It should be understood that the processor 151 in the embodiments of this application may be a central processing unit (CPU), or another general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another programmable logic device, discrete gate or transistor logic device, or discrete hardware component, etc. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc.

[0291] In embodiments of the present application, it should also be understood that the memory 152 includes read-only memory and random-access memory, and can provide instructions and data to the processor.

[0292] In the embodiments of this application, the terms "first," "second," and various numerical designations are used solely for illustrative purposes and are not intended to limit the scope of the embodiments. For example, "first," "second," and various numerical designations are used to distinguish different pipes, through-holes, etc.

[0293] In this specification, the term "and / or" describes only the correspondence between the relevant objects, and it should be understood that three relationships may exist. For example, A and / or B can represent three cases: A exists only, both A and B exist, and B exists only. In addition, the symbol " / " in this specification generally indicates an "or" relationship between the relevant objects.

[0294] It should be understood that the sequence numbers of the processes described above do not represent the execution sequences in the various embodiments of the present application. The execution sequences of the processes should be determined according to the function and internal logic of the processes and should not be interpreted as any limitation to the implementation processes of the embodiments of the present application.

[0295] Those skilled in the art will recognize, in combination with the examples described in the embodiments disclosed herein, that the unit and algorithmic stages can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are performed by hardware or by software will depend on the specific application and the design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementations should not be considered to be beyond the scope of the Application.

[0296] For the purpose of providing a simple and concise explanation, it will be readily apparent to those skilled in the art that the detailed operation of the aforementioned systems, apparatus, and units can be described by referring to the corresponding processes in the embodiments of the methods described above. Further details are not described again herein.

[0297] It should be understood that in some embodiments provided herein, the disclosed systems, devices, and methods may be implemented in other ways. For example, the embodiments of the devices described are merely examples. For example, the division into units is merely a logical functional division, and other divisions may be possible in actual implementations. For example, multiple units or components may be combined or integrated into another system, or some functions may be ignored or not performed. In addition, the mutual coupling, direct coupling, or communication connection shown or discussed may be implemented by using some interfaces. Indirect coupling or communication connection between devices or units may be implemented in electronic, mechanical, or other forms.

[0298] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one location, or may be distributed across multiple network units. Some or all of the units may be selected based on the actual requirements for achieving the objectives of the solution of the embodiment.

[0299] In addition, the functional units in the embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically in isolation, or two or more units may be integrated into a single unit.

[0300] When a function is implemented in the form of a software function unit and sold or used as an independent product, the function may be stored on a computer-readable storage medium. Based on such understanding, the technical solutions of the present application, or parts of them that contribute to the prior art, or some of these technical solutions, may be implemented in the form of a software product. A computer software product is stored on a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, server, or network device) to perform all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes any medium capable of storing program code, such as a USB flash drive, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0301] The foregoing description is merely a specific implementation of the present application and is not intended to limit the scope of protection of the present application. Any modifications or substitutions that are readily conceivable to a person skilled in the art within the technical scope disclosed herein shall be included in the scope of protection of the present application. Accordingly, the scope of protection of the present application shall be subject to the scope of protection of the claims.

Claims

1. The step of obtaining location information for multiple areas where multiple users are located; and A step of controlling the operation of the plurality of sound generating devices based on the positional information of the plurality of regions and the positional information of the plurality of sound generating devices. A sound generation device control method comprising the above.

2. The step of controlling the operation of the plurality of sound generating devices based on the positional information of the plurality of regions and the positional information of the plurality of sound generating devices is: In the step of determining the sound field optimization center point, the distance between the sound field optimization center point and the center points of all the plurality of regions is equal; and A step of controlling each of the plurality of sound generating devices to operate based on the distance between the sound field optimization center point and each of the plurality of sound generating devices. The method according to claim 1, including the method described in claim 1.

3. The aforementioned method further: Step of notifying the position information of the sound field optimization center point. The method according to claim 2, comprising:

4. The method according to any one of claims 1 to 3, wherein the plurality of regions are regions in the vehicle cockpit.

5. The method according to claim 4, wherein the plurality of regions include a front row region and a back row region.

6. The method according to claim 4, wherein the plurality of areas include a driver area and a passenger seat area.

7. The aforementioned method further: The step of notifying the location information of the multiple areas where the multiple users are located. The method according to any one of claims 1 to 6, comprising:

8. The step of controlling the operation of the plurality of sound generating devices is: Steps to adjust the playback intensity of each of the aforementioned plurality of sound generating devices. The method according to any one of claims 1 to 7, including the method described in any one of claims 1 to 7.

9. The aforementioned plurality of sound generating devices include a first sound generating device, and the step of adjusting the playback intensity of each of the plurality of sound generating devices is: A step of controlling the playback intensity of the first sound generating device to a first playback intensity. Includes, The aforementioned method further: A step of obtaining a user command to adjust the playback intensity of the first sound generating device from the first playback intensity to the second playback intensity; and Steps to adjust the playback intensity of the first sound generator to the second playback intensity in response to receiving the aforementioned command. The method according to claim 8, comprising:

10. The aforementioned step of obtaining location information for multiple areas where multiple users are located is: The stage of acquiring detection information; and The step of determining the position information of the plurality of regions based on the detection information. This includes, here The method according to any one of claims 1 to 9, wherein the detection information includes one or more of image information, pressure information, and audio information.

11. A transceiver configured to receive detection information; and A processing unit configured to acquire location information of multiple areas where multiple users are located, based on the aforementioned detection information. Equipped with, here The processing unit is further configured to control the operation of the plurality of sound generating devices based on the positional information of the plurality of regions and the positional information of the plurality of sound generating devices, as an electronic device.

12. The processing unit is further configured to control the operation of the plurality of sound generating devices based on the positional information of the plurality of regions and the positional information of the plurality of sound generating devices: The aforementioned processing unit: Determining the sound field optimization center point, where the distance between the sound field optimization center point and the center points of all the plurality of regions is equal; and Controlling each of the multiple sound generating devices to operate based on the distance between the sound field optimization center point and each of the multiple sound generating devices. The electronic device according to claim 11, which is configured to perform the following:

13. The electronic device according to claim 12, wherein the transmitting / receiving unit is further configured to transmit a first command to a first prompt unit, the first command instructing the first prompt unit to notify the position information of the sound field optimization center point.

14. The electronic device according to any one of claims 11 to 13, wherein the plurality of regions are regions in a vehicle cockpit.

15. The electronic device according to claim 14, wherein the plurality of regions include a front row region and a rear row region.

16. The electronic device according to claim 14, wherein the plurality of regions include a driver's area and a passenger seat area.

17. The electronic device according to any one of claims 11 to 16, wherein the transmitting / receiving unit is further configured to transmit a second command to a second prompting unit, the second command instructing the second prompting unit to notify the second prompting unit of the location information of the plurality of regions in which the plurality of users are located.

18. The electronic device according to any one of claims 11 to 17, wherein the processing unit is specifically configured to adjust the playback intensity of each of the plurality of sound generating devices.

19. The plurality of sound generating devices include a first sound generating device, and the processing unit is specifically configured to control the playback intensity of the first sound generating device to a first playback intensity; The transmitting and receiving unit is further configured to receive a third command, the third command being a command to adjust the playback intensity of the first sound generator from the first playback intensity to the second playback intensity; The electronic device according to claim 18, wherein the processing unit is further configured to adjust the playback intensity of the first sound generating device to the second playback intensity.

20. The electronic device according to any one of claims 11 to 19, wherein the detection information includes one or more of image information, pressure information, and audio information.

21. Memory configured to store instructions; and A processor configured to read the aforementioned instructions and perform the method described in any one of claims 1 to 10. An electronic device equipped with the following features.

22. A system comprising a sensor and an electronic device, wherein the electronic device is the electronic device described in any one of claims 11 to 21.

23. The system according to claim 22, further comprising a plurality of sound generating devices.

24. A computer-readable storage medium, wherein the computer-readable storage medium stores program code, and when the program code is executed on a computer, the computer is able to perform the method according to any one of claims 1 to 10.

25. A vehicle comprising an electronic device as described in any one of claims 11 to 21, or a vehicle comprising a system as described in claim 22 or 23.

Images