Control method and device for vehicle-mounted external speaker and vehicle-mounted external speaker system
By installing multiple external speakers on the vehicle, combining camera and power system to adjust the speaker position and volume in real time, the problem of insufficient outdoor stereo surround sound field in the prior art is solved, improving user experience and optimizing electrical energy use.
Patent Information
- Application Number
- CN202111106116.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-22
- Publication Date
- 2025-08-22
- Estimated Expiration
- 2041-09-22
AI Technical Summary
The existing car speakers are mainly used for in-car playback, and cannot provide a high-quality three-dimensional surround sound field outdoors, resulting in inconvenience to users in open fields and affecting user experience.
By installing multiple external speakers on the vehicle, combining the camera device and power system, the position and volume of the speakers are adjusted in real time, a stereo surround sound field is provided according to the relative position relationship between the user and the vehicle, and the obstacles can be avoided, and a variety of surround modes are realized to optimize sound effects and save electricity.
It realizes the provision of a three-dimensional surround sound field outdoors, improves user experience, adapts to different scenario needs, saves electricity, avoids interference from obstacles, and provides clear auditory effects.
Smart Images

Figure CN115134736B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicles, and in particular to a vehicle-mounted external speaker system in the vehicle-mounted field, and a control method and a control device for the external speaker. Background Art
[0002] With economic development, especially the automotive industry, the number of cars in society is increasing. As people's living standards improve, using cars as a means of transportation has become widespread, and consumers are increasingly demanding higher specifications when purchasing a car. Furthermore, as cars become increasingly prevalent in modern life, people's expectations for cars are no longer limited to a single means of transportation. With technological advancements, the space within cars is constantly expanding, no longer confined to the interior but extending increasingly outside the vehicle, which is subverting our understanding of cars.
[0003] For example, in-car speakers are typically installed inside the vehicle to play audio data for users inside the vehicle. Even in some existing technologies, rear-mounted speakers are used to emit sound outside the vehicle to warn people outside, but these speakers primarily serve as warnings, similar to car horns.
[0004] However, with the increasing popularity of vehicles and the diversification of car usage scenarios, there's a desire to expand the application scenarios and functions of in-car speakers. For example, more and more families are choosing to go on road trips on weekends. After parking their cars on lawns, users often leave the vehicles and walk around freely on the lawns next to them. At these times, beautiful music enhances their free time. However, due to the openness of outdoor spaces, the built-in speakers of portable mobile devices (smartphones, tablets) alone cannot provide high-quality listening experience, often requiring specialized speakers. However, requiring users to always have speakers ready when traveling is obviously unreasonable and can be a hassle.
[0005] In view of this, we hope to use the user's vehicle to turn it into a large mobile speaker that can provide a stereo surround sound field, which can accompany the user on travel and facilitate the user's use in open areas, thereby expanding the application scenarios of the vehicle and improving the user experience. Summary of the Invention
[0006] The following is a brief summary of one or more aspects to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceivable aspects and is neither intended to identify key or critical elements of all aspects nor to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that will be provided later.
[0007] An object of the present invention is to provide a control method and device for a vehicle-mounted external speaker and a vehicle-mounted external speaker system. The advantage of the present invention is that it provides a mode of using a vehicle as a large mobile speaker that can provide a stereo surround sound field. It can accompany the user on travel and is convenient for the user to use in open areas, thereby expanding the application scenarios of the vehicle and improving the user experience.
[0008] Another object of the present invention is to provide a control method and device for a vehicle-mounted external speaker and a vehicle-mounted external speaker system, which has the advantage of being able to adjust the provided stereo surround sound field according to the relative position relationship between the user and the vehicle, thereby improving the overall auditory effect and providing a better user experience.
[0009] Another object of the present invention is to provide a control method and device for a vehicle-mounted external speaker and a vehicle-mounted external speaker system, which has the advantage of providing multiple surround modes. Different surround modes correspond to different numbers of speakers and channels. Considering the power consumption of the speakers, different surround modes can be set to achieve a stereo surround sound effect and a balance between the power consumption of the speakers.
[0010] Another object of the present invention is to provide a method and device for controlling an in-vehicle external speaker, as well as an in-vehicle external speaker system. These methods, based on the relative position of the user and the vehicle, can control the vehicle's movement, proactively approaching the user to provide a clearer and more effective stereo surround sound field. Furthermore, the system can adjust the vehicle's movement trajectory based on obstacles, intelligently avoiding them to position the vehicle to provide the user with optimal sound quality.
[0011] Another object of the present invention is to provide a method and device for controlling in-vehicle external speakers, as well as an in-vehicle external speaker system. These methods take into account obstacles between the vehicle and the user, as well as obstacles surrounding the vehicle itself, and can adjust the vehicle's position accordingly, thereby providing the user with a clearer and more effective stereo surround sound field. Alternatively, speakers facing the obstacle can be disabled based on the obstacle, reducing speaker power consumption without affecting the overall sound quality.
[0012] Another object of the present invention is to provide a control method and device for a vehicle-mounted external speaker and a vehicle-mounted external speaker system, which has the advantage of being able to determine the target volume of the target speaker based on the relative position relationship between the user and the vehicle, thereby playing audio data at the target volume and giving the user a good auditory experience.
[0013] The advantages and features of the present invention will be fully reflected in the following detailed description and can be realized through the accompanying exemplary embodiments.
[0014] One aspect of the present invention provides a method for controlling an in-vehicle external speaker, comprising the following steps: in response to activation of an in-vehicle speaker mode, obtaining a relative positional relationship between a user and a vehicle at predetermined time intervals, the vehicle having multiple in-vehicle external speakers for emitting sound outward; determining a target speaker and its corresponding channel from the multiple in-vehicle external speakers based at least on the relative positional relationship; and controlling each of the target speakers to play audio data of the corresponding channel.
[0015] According to one embodiment of the present invention, determining the target speaker and its corresponding channel from the multiple vehicle-mounted external speakers further includes the following steps: determining the number of the target speakers and the number of channels based on the vehicle-mounted speaker mode; determining the vehicle-mounted external speaker that meets the preset conditions as the center speaker based on the relative position relationship, and determining the corresponding channel of the center speaker as the middle channel, and the center speaker belongs to the target speaker; and determining other target speakers and their corresponding channels based on the number of the target speakers and the number of channels based on the center speaker.
[0016] According to one embodiment of the present invention, the vehicle speaker mode includes a full surround mode and a semi-surround mode, and the number of target speakers and the number of channels corresponding to the semi-surround mode are both less than the number of target speakers and the number of channels corresponding to the full surround mode.
[0017] According to one embodiment of the present invention, the relative position relationship includes the relative distance between the user and the vehicle. After the step of obtaining the relative position relationship between the user and the vehicle at predetermined time intervals, the control method further includes the following steps: in response to the relative distance exceeding a preset distance, generating a moving route of the vehicle; and controlling the vehicle to move according to the moving route.
[0018] According to one embodiment of the present invention, the relative position relationship also includes the angle of the user relative to the vehicle, and generating the movement route of the vehicle further includes the following steps: generating an initial movement route based on the relative distance between the user and the vehicle, the angle of the user relative to the vehicle, and the preset distance; obtaining first obstacle information on the initial movement route, the first obstacle information indicating the first obstacle on the initial movement route; and in response to the presence of the first obstacle on the initial movement route, adjusting the initial movement route based on the first obstacle information to generate the movement route.
[0019] According to one embodiment of the present invention, after the step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers, the control method further includes the following steps: obtaining second obstacle information near each of the target speakers, the second obstacle information indicating the second obstacle near each of the target speakers; and in response to the presence of a target speaker facing the second obstacle, turning off the target speaker facing the second obstacle, or controlling the vehicle to move to avoid the second obstacle.
[0020] According to one embodiment of the present invention, before the step of controlling each of the target speakers to play the audio data of the corresponding channel, the control method further includes the step of: determining the target volume of each of the target speakers based on the relative position relationship; wherein, controlling each of the target speakers to play the audio data of the corresponding channel further includes the step of: controlling each of the target speakers to play the audio data of the corresponding channel at the corresponding target volume.
[0021] Another aspect of the present invention also provides a vehicle-mounted external speaker system, which includes a control device, a vehicle-mounted camera device, and multiple vehicle-mounted external speakers arranged on the vehicle to emit sound outward, and the control device has a communication connection with the vehicle-mounted camera device and the multiple vehicle-mounted external speakers; wherein the control device is configured to: in response to the activation of the vehicle-mounted speaker mode, obtain the relative position relationship between the user and the vehicle through the vehicle-mounted camera device at predetermined time intervals; determine the target speaker and its corresponding channel from the multiple vehicle-mounted external speakers based on at least the relative position relationship; and control each of the target speakers to play the audio data of the corresponding channel.
[0022] According to one embodiment of the present invention, the vehicle-mounted external speaker system also includes a power system, and a communication connection is established between the power system and the control device, wherein the relative position relationship includes the relative distance between the user and the vehicle; after the step of obtaining the relative position relationship between the user and the vehicle through the vehicle-mounted camera device at predetermined time intervals, the control device is further configured to: generate a moving route of the vehicle in response to the relative distance exceeding a preset distance; and control the vehicle to move according to the moving route via the power system.
[0023] According to one embodiment of the present invention, the vehicle-mounted external speaker system further includes a power system and an obstacle detection device, and the power system is communicatively connected to the control device and the obstacle detection device. After the step of determining a target speaker and its corresponding channel from the multiple vehicle-mounted external speakers, the control device is further configured to: obtain obstacle information near each of the target speakers based on the vehicle-mounted camera device and / or the obstacle detection device; and in response to the presence of a target speaker facing an obstacle, turn off the target speaker facing the obstacle, or control the vehicle to move via the power system to avoid the obstacle.
[0024] Another aspect of the present invention provides a vehicle-mounted external speaker system, which includes a control device, a positioning device arranged on a vehicle, and a plurality of vehicle-mounted external speakers arranged on the vehicle for emitting sound outward, wherein the control device has a communication connection with the positioning device and the plurality of vehicle-mounted external speakers; wherein the control device is configured to: in response to the activation of the vehicle-mounted speaker mode, obtain the relative position relationship between the user and the vehicle through the user's mobile device and the positioning device at predetermined time intervals; determine the target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers based at least on the relative position relationship; and control each of the target speakers to play the audio data of the corresponding channel.
[0025] According to one embodiment of the present invention, the vehicle-mounted external speaker system also includes a power system, and a communication connection is established between the power system and the control device, wherein the relative position relationship includes the relative distance between the user and the vehicle; after the step of obtaining the relative position relationship between the user and the vehicle through the user's mobile device and the positioning device at predetermined time intervals, the control device is further configured to: generate a moving route of the vehicle in response to the relative distance exceeding a preset distance; and control the vehicle to move according to the moving route via the power system.
[0026] According to one embodiment of the present invention, the vehicle-mounted external speaker system further includes a power system and an obstacle detection device, and the power system is communicatively connected to the control device and the obstacle detection device. After the step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers, the control device is further configured to: obtain obstacle information near each of the target speakers based on the obstacle detection device; and in response to the presence of a target speaker facing an obstacle, turn off the target speaker facing the obstacle, or control the vehicle to move via the power system to avoid the obstacle.
[0027] Another aspect of the present invention provides a control device for an in-vehicle external speaker, comprising: at least one processor; and a memory coupled to the at least one processor, the memory containing instructions stored therein, and when the instructions are executed by the at least one processor, the control device executes the control method for the in-vehicle external speaker provided by the present invention.
[0028] Another aspect of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the control method for the vehicle-mounted external speaker provided by the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The above features and advantages of the present invention will be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or characteristics may have the same or similar reference numerals.
[0030] Figure 1 A schematic diagram of an application scenario of the present invention is shown.
[0031] Figure 2A The figure shows a structural diagram of an embodiment of a vehicle-mounted external speaker system provided by the present invention.
[0032] Figure 2B FIG2 shows a structural diagram of another embodiment of the vehicle-mounted external speaker system provided by the present invention.
[0033] Figure 3 The figure shows a flow chart of an embodiment of a method for controlling an in-vehicle external speaker provided by the present invention.
[0034] Figure 4 Shown Figure 3 FIG. 5 is a flow chart of a specific embodiment of step S200 in FIG.
[0035] Figure 5A A schematic diagram showing a full surround mode in the vehicle speaker mode of the present invention is shown.
[0036] Figure 5B A schematic diagram showing a semi-surround mode in the vehicle speaker mode of the present invention is shown.
[0037] Figure 6A Shown Figure 4 FIG. 5 is a flow chart of a specific embodiment of step S220 in FIG.
[0038] Figure 6B Indicated Figure 6A The angular range formed by any two adjacent speakers.
[0039] Figure 7 Shown Figure 4 FIG. 5 is a flow chart of another specific embodiment of step S220 in FIG.
[0040] Figure 8A A flow chart showing another aspect of the control method provided by the present invention is shown.
[0041] Figure 8B Shown Figure 8A A flowchart of a specific embodiment of the present invention is provided.
[0042] Figure 8C Indicated Figure 8A 、 8B The movement route in .
[0043] Figure 9A A flow chart showing another aspect of the control method provided by the present invention is shown.
[0044] Figure 9B Shown Figure 9A A schematic diagram of a scenario in which a target speaker is turned off based on a second obstacle.
[0045] Figure 9C Shown Figure 9A On the other hand, a schematic diagram of a scenario in which the vehicle moves to avoid a second obstacle.
[0046] Figure 10 A flow chart showing another aspect of the control method provided by the present invention is shown.
[0047] Figure 11 A schematic structural diagram of a control device for an in-vehicle external speaker provided by another aspect of the present invention is shown.
[0048] Reference numerals
[0049] 110, 110' vehicles;
[0050] 111, 230 Car external speakers;
[0051] 120 users;
[0052] 121 mobile devices;
[0053] 200 in-car external speaker system;
[0054] 210 control devices;
[0055] 221 Vehicle-mounted camera device;
[0056] 222 positioning device;
[0057] 240 Powertrain;
[0058] 250 obstacle detection device;
[0059] 800 First Obstacle;
[0060] 900 Second Obstacle;
[0061] 810, 820, 920 mobile routes;
[0062] 1100 Control devices;
[0063] 1101 memory;
[0064] 1102 processor;
[0065] 1103 bus;
[0066] 1104 Random Access Memory;
[0067] 1105 cache memory;
[0068] 1106 Storage System;
[0069] 1107 program module;
[0070] 1108 external devices;
[0071] 1109 display;
[0072] 1110 Input / output (I / O) interface;
[0073] 1111 Network adapter. DETAILED DESCRIPTION
[0074] The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. Note that the various aspects described below with reference to the accompanying drawings and specific embodiments are merely exemplary and should not be construed as limiting the scope of protection of the present invention.
[0075] The following description is provided to enable those skilled in the art to make and use the present invention and to incorporate it into a specific application context. Various modifications and uses in different applications will be readily apparent to those skilled in the art, and the general principles defined herein are applicable to a wide range of embodiments. Thus, the present invention is not limited to the embodiments set forth herein, but should be accorded the broadest scope consistent with the principles and novel features disclosed herein.
[0076] In the following detailed description, many specific details are set forth to provide a more thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the practice of the present invention need not be limited to these specific details. In other words, known structures and devices are shown in block diagram form without detailed display to avoid obscuring the present invention.
[0077] The reader's attention is drawn to all documents and materials filed concurrently with this specification and open to public inspection, and the contents of all such documents and materials are incorporated herein by reference. Unless otherwise expressly stated, all features disclosed in this specification (including any accompanying claims, abstracts, and drawings) may be replaced by alternative features serving the same, equivalent, or similar purpose. Therefore, unless expressly stated otherwise, each feature disclosed is merely an example of a group of equivalent or similar features.
[0078] Note that where used, the terms left, right, front, back, top, bottom, forward, reverse, clockwise, and counterclockwise are used for convenience only and do not imply any specific fixed direction. Instead, they are used to reflect the relative position and / or orientation of various parts of an object. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
[0079] Note that, where used, "further," "preferably," "further," and "more preferably" are simply prefaces for describing another embodiment based on the preceding embodiment. The contents of the "further," "preferably," "further," or "more preferably" combined with the preceding embodiment constitute a complete configuration of another embodiment. Multiple "further," "preferably," "more preferably," or "more preferably" clauses appended to the same embodiment can be arbitrarily combined to form yet another embodiment.
[0080] The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. Note that the various aspects described below with reference to the accompanying drawings and specific embodiments are merely exemplary and should not be construed as limiting the scope of protection of the present invention.
[0081] As described above, in order to utilize the user's vehicle and transform it into a large mobile speaker that can provide a stereo surround sound field, which can accompany the user on travel and is convenient for the user to use in open areas, thereby expanding the application scenarios of the vehicle and improving the user experience, the present invention provides a control method and device for a vehicle-mounted external speaker and a vehicle-mounted external speaker system.
[0082] First, please refer to Figure 1 To understand the application scenario of the present invention. Figure 1As shown, the present invention is applied to an in-vehicle environment, enabling a user 120 to use an in-vehicle external speaker 111 from outside the vehicle 110, using the vehicle as a large mobile speaker, thereby listening to audio outside the vehicle 110. The user can use the in-vehicle external speaker 111 of the present invention to play and listen to audio outdoors, such as in lawns, squares, and camping sites, or indoors, such as in underground parking lots, open factories, workshops, and indoor sports fields.
[0083] like Figure 1 As shown, in order to achieve a more three-dimensional sound effect, in one embodiment of the present invention, at least on-board external speakers 111 are installed on the front hood, left front door, right front door, left rear door, right rear door, and rear trunk door of the vehicle 110, so as to create a three-dimensional, surround sound field when these external speakers are working.
[0084] In one embodiment, the user 120 can connect to the vehicle external speaker system through the mobile device 121 carried by the user 120, so that the vehicle external speaker 111 can be controlled through the mobile device 121 outside the vehicle.
[0085] Please further combine Figure 2A and Figure 2B To understand the vehicle-mounted external speaker system that implements the vehicle-mounted external speaker control method provided by the present invention. Figure 2A As shown, the vehicle external speaker system 200 includes a control device 210, a vehicle camera 221, and multiple vehicle external speakers 230 installed on the vehicle to emit sound. The control device 210 is in communication with the vehicle camera 221 and the multiple vehicle external speakers 230.
[0086] The control device 210 is configured to: in response to the activation of the vehicle speaker mode, obtain the relative position relationship between the user and the vehicle through the vehicle camera device 221 at predetermined time intervals; determine the target speaker and its corresponding channel from the multiple vehicle external speakers 230 based at least on the relative position relationship; and control each target speaker to play the audio data of the corresponding channel, thereby realizing the control method of the vehicle external speaker provided by the present invention.
[0087] In such Figure 2A In the preferred embodiment shown, the vehicle-mounted external speaker system 200 further includes a power system 240 and an obstacle detection device. The power system 240, the obstacle detection device 250 and the control device 210 are all in communication connection.
[0088] In one aspect, in response to the relative position relationship between the user and the vehicle exceeding a preset distance, the control device 210 is further configured to: generate a movement route of the vehicle; and control the vehicle to move according to the movement route via the power system 240 .
[0089] In another aspect, the control device 210 is further configured to: obtain obstacle information near each target speaker based on the onboard camera 221 and / or the obstacle detection device 250; and, in response to the presence of a target speaker facing an obstacle, turn off the target speaker facing the obstacle, or control the vehicle to move around the obstacle via the power system 240. The obstacles mentioned above include the first obstacle and the second obstacle described below. In other words, the onboard camera 221 and / or the obstacle detection device 250 are capable of detecting obstacles in the broadest sense.
[0090] It is understood that the control device 210 described above can be considered a general-purpose processor. It may include a memory and a processor. The memory includes, but is not limited to, a computer-readable storage medium provided in another aspect of the present invention, on which computer instructions are stored. The processor is connected to the memory and configured to execute the computer instructions stored in the memory to implement the above-mentioned method for controlling the in-vehicle external speaker provided in one aspect of the present invention.
[0091] The aforementioned on-board camera device 221 can be directed to one or more cameras fixed to the vehicle or installed later. In the present invention, the on-board camera device 221 is used to capture images of the vehicle's exterior, thereby acquiring information about users located outside the vehicle and information about obstacles outside the vehicle. This obstacle information includes the first and second obstacles described below. In other words, the on-board camera device 221 is capable of detecting obstacles in the broadest sense.
[0092] Please combine Figure 1 To understand the above-mentioned multiple vehicle-mounted external speakers 230. The above-mentioned multiple vehicle-mounted external speakers 230 are arranged on the inner side of the vehicle body panel and can emit sound to the outside of the vehicle body. Figure 1 As shown, multiple vehicle-mounted external speakers 230 ( Figure 1 The vehicle-mounted external speakers 111) can be evenly arranged around the vehicle body, thereby providing a three-dimensional, surround sound field.
[0093] The target speakers are directed to several vehicle-mounted external speakers selected from a plurality of vehicle-mounted external speakers 230 carried on the vehicle according to the control method of the present invention, and are used for working, that is, for emitting sound outside the vehicle body.
[0094] As described above, since multiple vehicle-mounted external speakers 230 can be distributedly arranged on the front hood, left front door, right front door, left rear door, right rear door, and rear trunk door of the vehicle 110, when the user is in different positions and facing different angles, a stereoscopic and surround sound field can be provided by controlling these external speakers. The stereoscopic and surround sound field in the present invention should be understood from the broadest and lowest requirements. For example, when the user is at the front of the vehicle and facing the left side of the vehicle, it can be considered that the front and rear surround feeling is achieved by controlling the vehicle-mounted external speakers 230 on the left side of the vehicle to play the audio corresponding to the front channel and controlling the vehicle-mounted external speakers 230 on the right side of the vehicle to play the audio corresponding to the rear channel. In addition, since different vehicle-mounted external speakers are responsible for playing audio data corresponding to different channels, the channel waveforms of the audio data corresponding to different channels are not exactly the same, which constitutes a stereoscopic feeling.
[0095] The aforementioned power system 240 refers to the power system of an existing or future vehicle, encompassing the entire mechanical arrangement that transmits power generated by the engine / motor through a series of power transmissions to the wheels. By controlling the power system 240, the vehicle can be transformed into a large mobile speaker, thereby enriching its application scenarios.
[0096] The aforementioned obstacle detection device 250 can be directed toward various obstacle detection sensors, including but not limited to radar sensors, laser ranging sensors, and infrared sensors. Alternatively, the obstacle detection device 250 can be directed toward an onboard camera that captures images of the vehicle's exterior environment, detecting obstacles through image recognition. These obstacles include the first and second obstacles described below. In other words, the onboard camera 221 and / or obstacle detection device 250 are capable of detecting obstacles in the broadest sense.
[0097] In another embodiment of the vehicle-mounted external speaker system provided by the present invention, Figure 2B As shown, the device for obtaining the relative position relationship between the user and the vehicle is not the vehicle-mounted camera device, but the positioning device 222. In addition to the difference in the device for obtaining the relative position relationship between the user and the vehicle, Figure 2A and Figure 2B The other components of the vehicle-mounted external speaker system shown are the same, please refer to the relevant description above and will not be repeated here.
[0098] In such Figure 2BIn the illustrated embodiment, control device 210 is configured to, in response to activation of the vehicle speaker mode, obtain the relative positional relationship between the user and the vehicle at predetermined intervals via the user's mobile device 121 and positioning device 222. In this embodiment, obstacle detection device 250 is required to obtain obstacle information around the vehicle (target speaker).
[0099] In such Figure 2B In the illustrated embodiment, the positioning device 222 can be implemented using Bluetooth positioning technology or UWB technology. UWB (Ultra Wide Band) is a carrier-free communication technology that uses non-sinusoidal narrow pulses in the nanosecond to microsecond range to transmit data. By transmitting extremely low-power signals over a wider spectrum, UWB can achieve data transmission rates of hundreds of Mbit / s to several Gbit / s within a range of about 10 meters. UWB has strong anti-interference performance, high transmission rate, and large system capacity. The UWB system has very low transmission power, and communication equipment can achieve communication with a transmission power of less than 1mW. The low transmission power of UWB greatly extends the system power supply working time. At the same time, the user's mobile device 121 is required to have a corresponding positioning function.
[0100] The following will describe the control method of the vehicle-mounted external speaker provided by the present invention in combination with the application scenario of the present invention and the above-mentioned vehicle-mounted external speaker system. Figure 3 As shown, the control method of the vehicle-mounted external speaker provided by the present invention includes the following steps:
[0101] Step S100: in response to the vehicle speaker mode being turned on, obtaining a relative position relationship between the user and the vehicle at predetermined time intervals;
[0102] Step S200: determining a target speaker and its corresponding channel from a plurality of vehicle-mounted external speakers based at least on a relative position relationship; and
[0103] Step S300: controlling each target speaker to play audio data of a corresponding channel.
[0104] In step S100, the vehicle speaker mode refers to a mode in which the vehicle is used as a large mobile speaker capable of providing a stereo surround sound field. This mode is typically activated when the user is walking from the vehicle interior to the exterior after parking and wishes to use the vehicle as a speaker. This mode can be activated by user command or automatically according to pre-set control logic.
[0105] The present invention not only provides a mode for using a vehicle as a large mobile speaker capable of providing a stereo surround sound field, but also, in the vehicle speaker mode, in order to provide the user with a stereo surround sound field, it is necessary to obtain the relative position relationship between the user and the vehicle at predetermined time intervals, so that when the relative position relationship between the user and the vehicle changes and affects the sound field, the target speaker and its corresponding channel that are instructed to work can be adjusted in time.
[0106] Those skilled in the art can set different predetermined time intervals as needed. It is understood that the smaller the predetermined time interval, the more sensitive the present invention is, but it may also cause power consumption and other issues due to the large amount of data processing. In one embodiment, it is also possible to allow the user to independently set the desired predetermined time interval to take into account user needs.
[0107] In one embodiment of step S100, the relative positional relationship between the user and the vehicle can be obtained using the vehicle-mounted camera 221. The vehicle-mounted camera 221 can be a panoramic or wide-angle camera mounted on the vehicle, capturing images of the vehicle's exterior. Therefore, in the above embodiment, it can be assumed that the vehicle-mounted camera 221 can represent the vehicle's position, and thus the current relative positional relationship between the user and the vehicle can be determined using the user image captured by the vehicle-mounted camera 221.
[0108] In another embodiment of the above step S100, the relative position relationship between the user and the vehicle can be obtained through the mobile device 121 of the user 120 and the positioning device 222 of the vehicle 110. In this embodiment, as described above, the mobile device 121 and the positioning device 222 can use Bluetooth positioning technology or UWB technology to achieve positioning. Furthermore, in order to obtain the relative position relationship between the user and the vehicle, it is implicitly necessary to first obtain the current position of the user and the vehicle through the mobile device 121 and the positioning device 222, so as to obtain relative position information based on the current positions of the two.
[0109] Furthermore, it can be understood that, in step S100, the relative position relationship obtained includes the relative distance and relative angle between the user and the vehicle.
[0110] Please refer to further Figure 4 To understand the above step S200. In one embodiment, Figure 4 As shown, step S200 further includes:
[0111] Step S210: Determine the number of target speakers and the number of channels based on the vehicle speaker mode;
[0112] Step S220: Based on the relative position relationship, determine that the vehicle-mounted external speaker that meets the preset conditions is the center speaker among the target speakers, and determine that the corresponding channel of the center speaker is the center channel; and
[0113] Step S230: Taking the center speaker as a reference, other target speakers and their corresponding channels are determined according to the number of target speakers and the number of channels.
[0114] Please combine Figure 5A and Figure 5B To understand the vehicle speaker mode in step S210 above. In the present invention, the vehicle speaker mode not only represents the mode of using the vehicle as a large mobile speaker that can provide a stereo surround sound field, but also can preset different types of vehicle speaker modes, such as Figure 5A Full surround mode shown, and Figure 5B Semi-surround mode shown.
[0115] In full surround mode, it can be assumed that all of the vehicle's external speakers 230 are in operation to emit sound outward (i.e., all are selected as target speakers). Furthermore, because all of the vehicle's external speakers 230 are in operation, a greater number of channels can be designed. For example, a left channel, a left center channel, a center channel, a right center channel, a right channel, a channel for distant sound playback, a bass channel, etc. can be designed.
[0116] from Figure 5A It can be seen that even if the user 120 is located on the right side of the vehicle 110, the vehicle's external speakers still emit sound to the surroundings, thereby forming different far and near, high and low frequency channels, bringing an immersive auditory effect to the user.
[0117] In semi-surround mode, it can be considered that only a portion of the vehicle's external speakers 230 are selected to operate and emit sound outward. These selected speakers are used as the target speakers for the vehicle's external speakers emitting sound outward. It is understandable that in semi-surround mode, since only a portion of the vehicle's external speakers are selected as target speakers, a rich channel count cannot be achieved. In this case, channels that meet basic auditory needs can be selected. For example, at least the center channel needs to be guaranteed, and then the other channels can be determined based on the number of target speakers.
[0118] from Figure 5BAs can be seen in the figure, since the user 120 is located in the right front of the vehicle 110, only the external speakers on the right side and front of the vehicle emit sound. In this case, the most basic auditory requirements can still be met. In semi-surround mode, since the amount of speaker data used for operation is less than that in full surround mode, the power loss caused by the operation of the speakers can be effectively reduced. When the car speaker mode needs to be used for a long time, or when the power supply of the vehicle is poor, the semi-surround mode can be preferred.
[0119] Please further combine Figure 6A 、 6B and Figure 7 To understand the above step S220. Figure 6A 、 6B A specific method of implementing step S220 is shown. Figure 7 Another specific way of implementing step S220 is illustrated.
[0120] First, if Figure 6A As shown, the above step S220 further includes:
[0121] Step S221: obtaining an angle range formed by any two adjacent speakers among a plurality of vehicle-mounted external speakers relative to the center of the vehicle body; and
[0122] Step S222: Based on the relative position relationship, any two adjacent speakers corresponding to the angle range where the user is located are determined as central speakers.
[0123] Please combine Figure 6B To understand the angle range formed by the two adjacent speakers relative to the vehicle body center in the above step S221. Figure 6B As shown, we can first determine the center point O of the vehicle. Then, by connecting point O with each of the vehicle's external speakers, we can see that the space surrounding the vehicle is divided into six zones, A to F. Each zone is bounded by two adjacent speakers, and these two adjacent speakers can be considered relatively neutral relative to the users within their respective zones. For example, the speaker at the front of the vehicle and the speaker on the front left—this pair of adjacent speakers—are preferably responsible for zone A, and are relatively neutral relative to users within zone A.
[0124] Subsequently, in step S222, based on the relative position relationship, the angle range of the user is determined, so that the two adjacent speakers corresponding to the angle range are determined to be center speakers, and the channel of the center speaker is determined to be the center channel.
[0125] Still a reference Figure 6BAfter determining that any two adjacent speakers form six areas AF relative to the center of the vehicle body, based on the relative position relationship, it can be known that the user is located in area E. Therefore, the right front speaker and the right rear speaker forming area E are determined to be the center speaker.
[0126] In another embodiment of implementing step S220, please refer to Figure 7 , the above step S220 further includes:
[0127] Step S223: determining the distance of each of the plurality of vehicle-mounted external speakers relative to the user based on the relative position relationship; and
[0128] Step S224: Determine the speaker closest to the user as the central speaker.
[0129] If you say, Figure 6A 、 6B The embodiment shown is based on the design of the center speaker from the perspective of the relative position. Figure 7 In the illustrated embodiment, step S224 directly designs the center speaker based on the angle of the closest relative distance.
[0130] It can be understood that if the relative position relationship between the user and the vehicle has been obtained in step S100, since the positions of the various speakers set on the vehicle are unchanged, the distance of each speaker in the multiple vehicle-mounted external speakers relative to the user can be determined based on the relative position relationship in step S223.
[0131] Or Figure 6B Taking the illustrated relative relationship between vehicle 110 and user 120 as an example, it can be found that in this case, the vehicle's external speaker closest to user 120 is the left front speaker, while the left rear speaker is approximately the same distance from user 120, but slightly further away. Therefore, in an embodiment where there is only one center speaker, the left front speaker can be determined as the center speaker. If there are two center speakers, both the left front and left rear speakers can be determined as center speakers.
[0132] It is understood that the number of center speakers is generally one or two. After the number of target speakers and the number of channels are determined in surround mode, and the target speakers and their number as center speakers are determined, in step S230, the target speakers are determined based on the remaining number of target speakers and the number of channels, with the center speaker as the center, and the channels of these target speakers are determined as left and / or right channels. In full surround mode, the speakers farther from the center speaker are selected to process the distant sound channel or bass channel.
[0133] Still combined Figure 6B , that is, based on Figure 6A The specific embodiment of step S220 shown is used to illustrate the specific implementation of step S230. After determining that the right front speaker and the right rear speaker constituting area E are the center speakers, in full surround mode, if the user is facing the vehicle body, the speaker located at the front of the vehicle between areas A and F can be determined as the speaker of the right channel. The speaker located at the rear of the vehicle between areas C and D is determined to be the speaker of the left channel, and the left front speaker and the left rear speaker constituting area B are the channel for processing distant sounds or the bass channel. Alternatively, after determining that the right front speaker and the right rear speaker constituting area E are the center speakers, in full surround mode, if the user is facing the front of the vehicle, the speaker located at the front of the vehicle between areas A and F can be determined to be the speaker of the front channel. The speaker located at the rear of the vehicle between areas C and D is determined to be the speaker of the rear channel, and the left front speaker and the left rear speaker constituting area B are the center left channel.
[0134] Please combine Figures 8A-8C To understand another aspect of the control method provided by the present invention. First, Figure 8A As shown, after the step of obtaining the relative position relationship between the user and the vehicle at predetermined time intervals, the control method further includes the following steps:
[0135] Step S410: In response to the relative distance exceeding the preset distance, generating a moving route of the vehicle; and
[0136] Step S420: Control the vehicle to move according to the moving route.
[0137] Specifically, Figure 8B A preferred embodiment of step S410 is shown, that is, step S410 further includes:
[0138] Step S411: generating an initial movement route based on the relative distance between the user and the vehicle, the angle of the user relative to the vehicle, and the preset distance;
[0139] Step S412: obtaining first obstacle information on the initial moving route; and
[0140] Step S413: In response to the presence of a first obstacle on the initial movement route, adjusting the initial movement route based on the first obstacle information to generate a movement route.
[0141] Please further combine Figure 8C To understand Figure 8A and Figure 8B The method shown. Figure 8CAs shown, in the initial state, the relative distance between vehicle 110 and user 120 is relatively long. In this case, it may not be possible to provide the user with a good auditory experience. Therefore, it is necessary to perform step S410 to generate a vehicle movement route and adjust the relative position between the vehicle and the user by controlling the vehicle's position, thereby improving the user's auditory experience.
[0142] Furthermore, in step S410, it is understood that in order to make the vehicle 110 approach the user 120, it is necessary to move the vehicle in a direction toward the user based on the relative angle relationship between the vehicle and the user until the relative distance between the vehicle and the user is within a preset distance range, such as Figure 8C , the vehicle 110' is located. Based on the principle of shortest straight-line distance between two points, if the vehicle 110' is ultimately to be driven to its location, a movement route 810 can be determined, and the vehicle's movement can be controlled based on this movement route 810. Because this movement route 810 does not consider drivability, it can be considered an initial movement route or an ideal movement route.
[0143] Although the ideal movement route 810 has been determined, since this is the route based on which the vehicle's movement is controlled, if a first obstacle exists on this route, it will cause unnecessary trouble. The first obstacle on the travel route needs to be considered. The first obstacle mentioned above refers to a living or non-living object that blocks the vehicle's travel.
[0144] In some existing or future autonomous driving technologies, if it is already possible to automatically detect obstacle information during travel according to the optimal moving route, then in the present invention, it is not necessary to consider obstacle information. It is only necessary to output the ideal moving route 810 to the autonomous driving controller that intelligently handles obstacles, so that the vehicle can be controlled to move according to the moving route 810 based on the vehicle's power system 240 and intelligently avoid obstacles.
[0145] If the existing assisted driving technology is still unable to automatically avoid obstacles on the road, it is necessary to execute step S412 to generate a moving route that takes into account the first obstacle information. In step S412, it is necessary to obtain the first obstacle situation on the initial moving route 810 based on the obstacle detection device 250 and / or the vehicle-mounted camera device 221. Figure 8C As shown, there is indeed a first obstacle 800 on the initial moving route 810, so it is necessary to execute step S413 to adjust the initial moving route based on the first obstacle information to generate a moving route. Figure 8C As shown, it is necessary to bypass the first obstacle 800 to reach the position of the vehicle 110 ′. Therefore, a movement route 820 is generated that takes the first obstacle information into consideration. Then, in step S420 , the vehicle movement is controlled based on the movement route 820 .
[0146] Please combine Figures 9A-9C To understand another aspect of the control method provided by the present invention. First, Figure 9A As shown, after the step of determining the target speaker and its corresponding channel from a plurality of vehicle-mounted external speakers, the control method further includes the following steps:
[0147] Step S510: Acquire second obstacle information near each target speaker; and
[0148] Step S520: In response to the presence of the target speaker facing the second obstacle, turning off the target speaker facing the second obstacle; or
[0149] Step S530: In response to the presence of the target speaker facing the second obstacle, controlling the vehicle to move to avoid the obstacle.
[0150] It's understandable that while the present invention aims to provide users with a pleasant auditory experience, the effects of sound, or sound waves, upon encountering a secondary obstacle are uncontrollable and can affect the overall sound field. Therefore, ideally, there should be no secondary obstacles surrounding the vehicle, or at least no secondary obstacles in the direction facing the user. These secondary obstacles are non-living objects that obstruct sound wave propagation (causing most of the sound waves to be reflected or refracted).
[0151] After the step of determining the target speaker and its corresponding sound channel from a plurality of vehicle-mounted external speakers, step S510 needs to be executed to determine the second obstacle information near each target speaker. The second obstacle information near each of the above-mentioned speakers can also be obtained by an obstacle detection device and / or a vehicle-mounted camera device, which will not be repeated here. If the target speaker faces the second obstacle, it means that on the normal driving path of the sound waves emitted by the target speaker, there is a second obstacle that is less than a preset distance from the target speaker, and it can be considered that the target speaker is facing the second obstacle. If there is indeed a target speaker facing the second obstacle, it is necessary to implement an additional processing method such as step S520 or step S530.
[0152] In step S520, the target speakers facing the second obstacle are considered turned off. In this embodiment, since these target speakers face the second obstacle, if they are not turned off, they will generally not achieve the expected sound field effect due to the presence of the second obstacle. Therefore, to save power, the target speakers facing the second obstacle can be turned off.
[0153] In step S530, the vehicle is controlled to avoid the second obstacle. In this embodiment, the goal is to provide the user with a better auditory experience. Therefore, if moving the vehicle is feasible, a movement route to avoid the first obstacle is determined, as in step S413, so that the vehicle can be controlled to avoid the first obstacle.
[0154] like Figure 9B As shown, the left front, left rear and rear speakers of the vehicle 110 are all facing the second obstacle 900. According to the embodiment provided in step S520, the left front, left rear and rear speakers are directly turned off, leaving only the right front, right rear and front speakers working.
[0155] like Figure 9C As shown, in the initial state, the left front, left rear, and rear speakers of vehicle 110 all face second obstacle 900. According to the embodiment provided in step S530, if it is feasible to move the vehicle until all target speakers no longer face the second obstacle, a movement route 920 can be determined to avoid the obstruction of second obstacle 900, thereby controlling the vehicle to the location of vehicle 110'. At the location of vehicle 110', all target speakers no longer face the second obstacle. This ensures that the user can still be provided with an all-around surround sound field, ensuring a pleasant listening experience.
[0156] Please refer to further Figure 10 To understand another aspect of the control method provided by the present invention. Figure 10 As shown, before step S300: controlling each target speaker to play the audio data of the corresponding channel, the control method provided by the present invention further includes the following steps:
[0157] S600: Determine the target volume of each target speaker according to the relative position relationship.
[0158] In addition, step S300 is further refined as follows:
[0159] Step S310: Control each target speaker to play the audio data of the corresponding channel at the corresponding target volume.
[0160] The playback volume of each target speaker also affects the user's auditory perception. Figure 10In the illustrated embodiment, the target volume for each target speaker is determined based on the relative position relationship. Based on human physiological parameters, a preferred relative loudness range acceptable to the human ear (e.g., 40-60 decibels) can be preset. The target volume mentioned above refers to the volume of the vehicle's external speakers, based on the relative position relationship between the user and the vehicle, such that the sound reaching the user remains within the preset preferred relative loudness range (40-60 decibels). It should be noted that the aforementioned 40-60 decibel range is merely illustrative and should not unduly limit the present invention.
[0161] For example, the volume of each target speaker increases as the distance increases. In addition, as a preferred embodiment, the noise of the user's surrounding environment can also be taken into consideration to dynamically adjust the volume.
[0162] For example, assume the baseline distance between the vehicle and the user is A, corresponding to a volume of X. For each additional distance ΔA, the volume increases by ΔX. The ambient noise level around the user is n, and the noise volume compensation coefficient is k. Then, the volume at distance A' is X' = X + ΔX * (A' - A) / ΔA + (n - 50) * k.
[0163] For example, we can assume: A = 5 meters, X = 20, ΔA = 5 meters, ΔX = 4, n = 80, k = 0.2, and calculate:
[0164] i. When A' = 10 meters, X' = 30;
[0165] ii. When A' = 15 meters, X' = 34;
[0166] iii. When A' = 20 meters, X' = 38.
[0167] On the other hand, although the present invention can maximize the relative position between the vehicle and the user to maintain a preset optimal state, in some scenarios, such as when there are too many obstacles and the vehicle cannot plan to avoid them to reach the optimal relative position, or when the vehicle is parked across an obstacle such as a river that the vehicle cannot avoid, adjusting the volume can reduce the problem of low sound caused by the vehicle's immobility, thereby ensuring the user's listening experience.
[0168] After the target volume of each target speaker is determined, step S310 is executed: each target speaker is controlled to play the audio data of the corresponding channel at the corresponding target volume, thereby providing the user with a more perfect listening experience while taking the volume into consideration.
[0169] Those skilled in the art will appreciate that, in the present invention, the audio data that the user wishes to play can be processed into multiple channels, so that each target speaker can be controlled to play the audio data of the corresponding channel in steps S300 and S310, thereby providing the user with a good sound field for listening to the audio data.
[0170] So far, the control method of the vehicle-mounted external speaker provided by one aspect of the present invention has been described. The present invention provides a mode of using a vehicle as a large mobile speaker that can provide a stereo surround sound field. It can accompany the user on travel and facilitate the user's use in open areas, thereby expanding the application scenarios of the vehicle and improving the user experience. The present invention can adjust the provided stereo surround sound field according to the relative position relationship between the user and the vehicle, thereby improving the overall auditory effect and providing a better user experience. The present invention provides multiple surround modes, and different surround modes correspond to different numbers of speakers and channels. Considering the power consumption of the speakers, the stereo surround sound effect and the power consumption of the speakers can be balanced by setting different surround modes. The present invention can control the movement of the vehicle based on the relative position relationship between the user and the vehicle, so that it can actively approach the user and provide the user with a clearer and better stereo surround sound field. In addition, the vehicle's movement line can be adjusted according to the obstacle situation, and obstacles can be intelligently avoided to move the vehicle to a position that can provide the best sound effect for the user. The invention also fully considers obstacles between the vehicle and the user, as well as those surrounding the vehicle itself. It can adjust the vehicle's position based on the obstacles, thereby adjusting the relative position between the vehicle and the user, providing users with a clearer and more effective stereo surround sound field. Alternatively, it can selectively disable speakers facing the obstacle, reducing speaker power consumption without affecting the overall sound quality.
[0171] Another aspect of the present invention provides a control device for in-vehicle audio and video playback, comprising: at least one processor; and a memory coupled to the at least one processor, wherein the memory contains instructions stored therein, and when the instructions are executed by the at least one processor, the control device executes the following Figure 3 The control method of the vehicle external speaker is shown.
[0172] Please combine Figure 11 To understand the control device 1100 of the vehicle-mounted external speaker provided by the present invention. Figure 11 As shown, in this embodiment, the control device 1100 is implemented as a general-purpose computer device and is used to implement the steps of the vehicle-mounted external speaker control method described in any of the above embodiments. For details, please refer to the above description of the vehicle-mounted external speaker control method, which will not be repeated here.
[0173] The components of the control device 1100 may include one or more memories 1101 , one or more processors 1102 , and a bus 1103 connecting different system components (including the memories 1101 and the processors 1102 ).
[0174] Bus 1103 includes a data bus, an address bus, and a control bus. The product of the number of bits of the data bus and the operating frequency is proportional to the data transfer rate. The number of bits of the address bus determines the maximum addressable memory space. The control bus (read / write) indicates the type of bus cycle and the time when the current input / output operation is completed. Processor 1102 is connected to memory 1101 via bus 1103 and is configured to implement the control method for an in-vehicle external speaker provided in any of the above-mentioned embodiments.
[0175] Processor 1102, the computing and control core of control device 1100, is the final execution unit for information processing and program execution. All software layer operations in the computer system are ultimately mapped to processor 1102 operations through the instruction set. Processor 1102 primarily processes instructions, executes operations, manages time, and processes data.
[0176] Memory 1101 refers to various storage devices in a computer that store programs and data. Memory 1101 may include computer-readable media in the form of volatile memory, such as random access memory (RAM) 1104 and / or cache memory 1105.
[0177] Random Access Memory (RAM) 1104 is internal memory that directly exchanges data with processor 1102. It can be read and written at any time (except when refreshing) and is very fast. It is typically used as a temporary data storage medium for the operating system or other running programs. If power is lost, the data stored in it will be lost. Cache Memory (Cache) 1105 is a primary memory located between main memory and processor 1102. It has a relatively small capacity but a much higher speed than main memory, approaching the speed of processor 1102.
[0178] It should be noted that when the control device 1100 includes multiple memories 1101 and multiple processors 1102, the multiple memories 1101 and the multiple processors 1102 can have a distributed structure. For example, the control device 1100 can include memories and processors located locally and in a backend cloud, respectively, with the local and backend cloud jointly implementing the above-mentioned vehicle-mounted external speaker control method. Furthermore, in embodiments employing a distributed structure, the specific execution terminal of each step can be adjusted according to actual circumstances, and the specific implementation of each step on a specific terminal should not unduly limit the scope of protection of the present invention.
[0179] The control device 1100 may further include other removable / immovable, volatile / non-volatile computer system storage media. In this embodiment, the storage system 1106 may be used to read and write immovable, non-volatile magnetic media.
[0180] Memory 1101 may also include at least one set of program modules 1107. Program modules 1107 may be stored in memory 1101. Program modules 1107 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 1107 generally implement the functions and / or methods described in the embodiments of the present invention.
[0181] The control device 1100 can also communicate with one or more external devices 1108. In this embodiment, the external devices 1108 include the vehicle-mounted external speakers 230, the vehicle-mounted camera 221, the positioning device 222, the power system 240, the obstacle detection device 250, and the like described above. The external devices 1108 also include a display 1109. When implementing the vehicle-mounted external speaker control method, the control device 1100 can provide feedback on the operating status of each target speaker via the display 1109.
[0182] The control device 1100 may also communicate with one or more devices that enable a user to interact with the control device 1100 and / or with any device that enables the control device 1100 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may occur through an input / output (I / O) interface 1110.
[0183] The control device 1100 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and / or a public network such as the Internet) through a network adapter 1111. Figure 11 As shown, the network adapter 1111 communicates with other modules of the control device 1100 via the bus 1103. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the control device 1100, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0184] Another aspect of the present invention provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the steps of the method for controlling an in-vehicle external speaker as described in any of the above embodiments. For details, please refer to the above description and will not be repeated here. Furthermore, it will be understood that the aforementioned computer-readable storage medium may also be in the form of a system, i.e., comprising multiple computer-readable storage sub-media, so that the steps of the method for controlling an in-vehicle external speaker described above are implemented by the multiple computer-readable storage media.
[0185] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed using a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
[0186] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read and write information from / to the storage medium. In an alternative, the storage medium may be integrated into the processor. The processor and storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and storage medium may reside in a user terminal as discrete components.
[0187] In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software as a computer program product, the functions may be stored on or transmitted via a computer-readable medium as one or more instructions or code. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates the transfer of a computer program from one location to another. A storage medium may be any available medium that can be accessed by a computer. By way of example and not limitation, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Any connection is also properly referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks typically reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0188] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. However, it should be understood that the scope of protection of the present invention is subject to the appended claims and is not limited to the specific structures and components of the above-illustrated embodiments. Those skilled in the art may make various changes and modifications to the various embodiments within the spirit and scope of the present invention, and such changes and modifications are also within the scope of protection of the present invention.
Claims
1. A method for controlling an in-vehicle external speaker, characterized in that: The following steps are involved: In response to activation of the vehicle speaker mode, obtaining a relative positional relationship between a user and a vehicle at predetermined time intervals, the vehicle having a plurality of vehicle-mounted external speakers for emitting sound outward, the plurality of vehicle-mounted external speakers being disposed on an inner side of a body panel of the vehicle and configured to emit sound outward; determining a target speaker and its corresponding channel from the plurality of in-vehicle external speakers based at least on the relative position relationship; as well as Controlling each of the target speakers to play the audio data of the corresponding channel; The step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers further comprises the following steps: Determining the number of target speakers and the number of channels based on the vehicle speaker mode; Obtaining an angular range formed by any two adjacent speakers among the plurality of vehicle-mounted external speakers relative to a body center of the vehicle; Based on the relative position relationship, determining any two adjacent speakers corresponding to the angle range where the user is located as center speakers, and determining the corresponding channels of the center speakers as the middle channels, and the center speakers belong to the target speakers; and Taking the central speaker as a reference, other target speakers and their corresponding channels are determined according to the number of the target speakers and the number of channels.
2. The control method according to claim 1, wherein the determining of the center speaker further comprises the following steps: Based on the relative position relationship, determining a distance of each of the plurality of in-vehicle external speakers relative to the user; as well as The speaker closest to the user is determined as the central speaker.
3. The control method according to claim 1, wherein the vehicle speaker mode includes a full surround mode and a semi-surround mode, and the number of the target speakers and the number of the channels corresponding to the semi-surround mode are both less than the number of the target speakers and the number of the channels corresponding to the full surround mode.
4. The control method according to claim 1 , wherein the relative position relationship includes a relative distance between the user and the vehicle, and after the step of acquiring the relative position relationship between the user and the vehicle at predetermined time intervals, the control method further comprises the following steps: generating a movement route of the vehicle in response to the relative distance exceeding a preset distance; as well as The vehicle is controlled to move along the movement route.
5. The control method according to claim 4, wherein the relative position relationship further includes an angle of the user relative to the vehicle, and generating the movement route of the vehicle further comprises the following steps: generating an initial movement route based on a relative distance between the user and the vehicle, an angle of the user relative to the vehicle, and the preset distance; acquiring first obstacle information on the initial moving route, where the first obstacle information indicates a first obstacle on the initial moving route; as well as In response to a first obstacle existing on the initial movement route, the initial movement route is adjusted based on the first obstacle information to generate the movement route.
6. The control method according to any one of claims 1 to 5, further comprising the steps of: According to the relative position relationship, the target volume of each target speaker is determined; wherein, The controlling each of the target speakers to play the audio data of the corresponding channel further comprises the steps of: Each of the target speakers is controlled to play the audio data of the corresponding channel at the corresponding target volume.
7. The control method according to any one of claims 1 to 5, further comprising the following steps after the step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers: Acquire second obstacle information near each of the target speakers, where the second obstacle information indicates the second obstacle near each of the target speakers; as well as In response to the presence of a target speaker facing the second obstacle, the target speaker facing the second obstacle is turned off, or the vehicle is controlled to move to avoid the second obstacle.
8. The control method according to any one of claims 1 to 5, wherein obtaining the relative position relationship between the user and the vehicle further comprises the following steps: Acquiring the relative position relationship between the user and the vehicle through a vehicle-mounted camera device; and / or, The relative position relationship between the user and the vehicle is obtained through the user's mobile device and the vehicle's positioning device.
9. A vehicle-mounted external speaker system, characterized in that: The vehicle-mounted external speaker system includes a control device, a vehicle-mounted camera device, and a plurality of vehicle-mounted external speakers arranged on the inner side of a vehicle body panel and used to emit sound to the outside of the vehicle body. The control device is in communication with the vehicle-mounted camera device and the plurality of vehicle-mounted external speakers; wherein, The control device is configured to: In response to the activation of the vehicle speaker mode, obtaining a relative position relationship between the user and the vehicle through the vehicle camera device at predetermined time intervals; determining a target speaker and its corresponding channel from the plurality of in-vehicle external speakers based at least on the relative position relationship; and Controlling each of the target speakers to play the audio data of the corresponding channel; The step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers further comprises the following steps: Determining the number of target speakers and the number of channels based on the vehicle speaker mode; Obtaining an angular range formed by any two adjacent speakers among the plurality of vehicle-mounted external speakers relative to a body center of the vehicle; Based on the relative position relationship, determining any two adjacent speakers corresponding to the angle range where the user is located as center speakers, and determining the corresponding channels of the center speakers as the middle channels, and the center speakers belong to the target speakers; and Taking the central speaker as a reference, other target speakers and their corresponding channels are determined according to the number of the target speakers and the number of channels.
10. The vehicle-mounted external speaker system according to claim 9, further comprising a power system, wherein the power system is in communication with the control device, wherein: The relative position relationship includes the relative distance between the user and the vehicle; After the step of acquiring the relative position relationship between the user and the vehicle by the vehicle-mounted camera device at predetermined time intervals, the control device is further configured to: generating a movement route of the vehicle in response to the relative distance exceeding a preset distance; and The vehicle is controlled via the power system to move along the movement route.
11. The vehicle-mounted external speaker system according to claim 9, further comprising a power system and an obstacle detection device, wherein the power system is in communication with the control device and the obstacle detection device, wherein: After the step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers, the control device is further configured to: Obtaining obstacle information near each of the target speakers based on the vehicle-mounted camera device and / or the obstacle detection device; as well as In response to the presence of a target speaker facing an obstacle, the target speaker facing the obstacle is turned off, or the vehicle is controlled to move to avoid the obstacle via the power system.
12. A vehicle-mounted external speaker system, characterized in that: The vehicle-mounted external speaker system includes a control device, a positioning device provided on the vehicle, and a plurality of vehicle-mounted external speakers provided on the inner side of the vehicle body panel and used for emitting sound to the outside of the vehicle body. The control device is in communication with the positioning device and the plurality of vehicle-mounted external speakers; wherein, The control device is configured to: In response to the vehicle speaker mode being turned on, obtaining a relative position relationship between the user and the vehicle through the user's mobile device and the positioning device at predetermined time intervals; determining a target speaker and its corresponding channel from the plurality of in-vehicle external speakers based at least on the relative position relationship; and Controlling each of the target speakers to play the audio data of the corresponding channel; The step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers further comprises the following steps: Determining the number of target speakers and the number of channels based on the vehicle speaker mode; Obtaining an angular range formed by any two adjacent speakers among the plurality of vehicle-mounted external speakers relative to a body center of the vehicle; Based on the relative position relationship, determining any two adjacent speakers corresponding to the angle range where the user is located as center speakers, and determining the corresponding channels of the center speakers as the middle channels, and the center speakers belong to the target speakers; and Taking the central speaker as a reference, other target speakers and their corresponding channels are determined according to the number of the target speakers and the number of channels.
13. The vehicle-mounted external speaker system according to claim 12, further comprising a power system, wherein the power system is in communication with the control device, wherein: The relative position relationship includes the relative distance between the user and the vehicle; After the step of obtaining the relative position relationship between the user and the vehicle through the user's mobile device and the positioning device at predetermined time intervals, the control device is further configured to: generating a movement route of the vehicle in response to the relative distance exceeding a preset distance; and The vehicle is controlled via the power system to move along the movement route.
14. The vehicle-mounted external speaker system according to claim 12, further comprising a power system and an obstacle detection device, wherein the power system is in communication with the control device and the obstacle detection device, wherein: After the step of determining a target speaker and its corresponding channel from the plurality of vehicle-mounted external speakers, the control device is further configured to: Obtaining obstacle information near each of the target speakers based on the obstacle detection device; as well as In response to the presence of a target speaker facing an obstacle, the target speaker facing the obstacle is turned off, or the vehicle is controlled to move to avoid the obstacle via the power system.
15. A control device for an in-vehicle external speaker, comprising: at least one processor; as well as A memory coupled to the at least one processor, the memory containing instructions stored therein, wherein when the instructions are executed by the at least one processor, the control device executes the control method for the in-vehicle external speaker according to any one of claims 1 to 8.
16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for controlling the in-vehicle external speaker according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Handhold apparatus and switching method for audio signal outputting
CN101489168A
Control and adjustment method and terminal for home equipment as well as home equipment
CN110032156A
Intelligent sound box
CN207589144U
Loud-speaker device and control method for the same
JP2017152864A
Surround-system, information processing terminal using the same, and information processing method
JP2020191539A