Control method, entertainment device, vehicle, and readable storage medium

Abstract

The application discloses a control method, an entertainment device, a vehicle and a computer readable storage medium. The control method is applied to the entertainment device and includes the following steps: in response to playing sound information, cooperating with the in-vehicle sound to play a sweep frequency sound; determining a sound collecting direction according to the position information of a target person, and performing sound collecting control for the sound collecting direction to obtain directional audio information; and performing sound effect adjustment control according to the directional audio information and reference audio information to adjust the audio playing parameter of the entertainment device when playing the sound information for the sound collecting direction. Through the technical scheme of the application, when the vehicle plays sound information, directional sound collecting can be performed for the in-vehicle position of the driver or passenger to obtain directional audio information, so that the directional audio information and the reference audio information representing the optimal sound listening effect are compared, the audio playing parameter of the entertainment device when playing the sound information is adjusted according to the comparison result, and the sound listening effect of the driver or passenger is improved.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a control method, entertainment device, vehicle, and computer-readable storage medium. Background Technology

[0002] With the development of science and technology, more and more intelligent vehicles have emerged. Typically, intelligent vehicles can be equipped with various intelligent devices to expand their intelligent functions and enhance the user experience.

[0003] Currently, smart vehicles typically have fixed audio equipment installed for playing sound information. However, in practical applications, fixed audio equipment cannot adjust the sound effects according to the position of the driver and passengers inside the vehicle. Therefore, how to improve the in-vehicle listening experience for drivers and passengers is a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] The purpose of this application is to provide a control method, entertainment device, vehicle, and computer-readable storage medium that can improve the in-vehicle audio experience for drivers and passengers, thereby enhancing the user experience.

[0005] To achieve the above objectives:

[0006] In a first aspect, embodiments of this application provide a control method applied to an entertainment device, comprising: responding to playing sound information, playing a sweeping tone in conjunction with an in-vehicle audio system; determining the sound reception direction based on the obtained location information of the target person, and performing sound reception control for the sound reception direction to obtain directional audio information; and performing sound effect adjustment control based on the directional audio information and reference audio information to adjust the audio playback parameters of the entertainment device when playing sound information for the sound reception direction.

[0007] In one embodiment, the entertainment device includes a base and a levitation component; and / or,

[0008] At least one of the base and the levitation component is equipped with a shooting device; and / or,

[0009] At least one of the base and the levitation component is provided with a device microphone; and / or,

[0010] At least one of the base and the levitation component is equipped with a device speaker.

[0011] In one embodiment, the device microphone is an extendable microphone.

[0012] In one embodiment, the step of determining the sound reception direction based on the acquired in-vehicle location information of the target person and performing sound reception control in response to the sound reception direction to obtain directional audio information includes: acquiring in-vehicle environment information through a shooting device; acquiring the ear position information of the target person based on the in-vehicle environment information; determining the sound reception direction based on the ear position information; and controlling an extendable microphone to extend towards the sound reception direction and receive sound to obtain directional audio information.

[0013] In one embodiment, the step of obtaining the ear location information of the target person based on the in-vehicle environment information includes: when there is a driver or passenger in the in-vehicle environment information that meets preset conditions, the driver or passenger is identified as the target person.

[0014] In one embodiment, the occupants who meet the preset conditions include at least one of the following:

[0015] The only person in the vehicle;

[0016] Pre-set driver and passenger occupants;

[0017] There are drivers and passengers who perform interactive actions corresponding to sound information.

[0018] In one embodiment, the method further includes: predicting inertial characteristics in response to a change in the vehicle's operating state, the inertial characteristics including the direction of inertial force and / or inertial force; and adjusting the magnetic force between the base and the suspendable component according to the inertial characteristics to maintain the relative spatial positional relationship between the base and the suspendable component.

[0019] In one embodiment, the method further includes: responding to the installation configuration of the entertainment device, controlling the in-vehicle speaker corresponding to a preset in-vehicle location to emit sound, the in-vehicle speaker being included in the in-vehicle audio system; performing sound reception analysis using the device microphone and the in-vehicle microphone to determine the in-vehicle installation location information of the entertainment device; forming a microphone array by combining the device microphone and the in-vehicle microphone; determining the target angle of the sound source location of the interactive voice relative to the entertainment device based on the interactive voice received by the microphone array and the in-vehicle installation location information; controlling the interactive surface of the levitable component to face the sound source location based on the target angle, and performing voice broadcast.

[0020] In one embodiment, after the step of controlling the interactive surface of the suspendable component to face the sound source position according to the angle and performing voice broadcast, the method includes: in response to the end of the voice broadcast, controlling the suspendable component to rotate to the initial angle.

[0021] Secondly, embodiments of this application provide an entertainment device for implementing the steps of the control method as described in any of the preceding claims.

[0022] In one embodiment, the system includes a base and a levitation component; the bottom of the levitation component is provided with a magnet component and at least two laser ranging components; the base includes a spiral component and an electromagnetic conversion component.

[0023] In one embodiment, the electromagnetic conversion component and the magnet component, under the action of magnetic force, enable the base to maintain the levitation component in a levitation state or a non-levitation state.

[0024] In one embodiment, one of the two laser ranging components is used to align with the center of the spiral component and measure distance to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the first ranging information to maintain the relative spatial position relationship between the base and the levitable component; the other of the two laser ranging components is used to align with the thread of the spiral component and measure distance to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the second ranging information and the target angle, so that the interaction surface of the levitable component rotates to the target angle.

[0025] Thirdly, embodiments of this application provide a vehicle equipped with the entertainment equipment described in any of the preceding claims.

[0026] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the control method described in any of the preceding claims.

[0027] The control method, entertainment device, vehicle, and computer-readable storage medium provided in this application embodiment are as follows: the control method is applied to the entertainment device and includes: in response to playing sound information, playing a sweeping tone in conjunction with the in-vehicle audio system; determining the sound reception direction based on the acquired location information of the target person, and performing sound reception control for the sound reception direction to obtain directional audio information; and performing sound effect adjustment control based on the directional audio information and reference audio information to adjust the audio playback parameters of the entertainment device when playing sound information in accordance with the sound reception direction. Through the technical solution of this application, when playing sound information in a vehicle, directional sound reception can be performed for the location of the driver and passengers in the vehicle to obtain directional audio information. Then, the directional audio information is compared with reference audio information representing the optimal listening effect, and the audio playback parameters of the entertainment device when playing sound information are adjusted according to the comparison result to improve the listening effect for the driver and passengers. Therefore, the technical solution of this application can improve the in-vehicle listening effect for the driver and passengers, thereby improving the user experience. Attached Figure Description

[0028] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0029] Figure 1 This is a flowchart illustrating the control method provided in the embodiments of this application.

[0030] Figure 2 This is a schematic diagram comparing the example standard curve with the measured values ​​inside the vehicle in this embodiment.

[0031] Figure 3 This is a schematic diagram of the electromagnet coil and power supply system as exemplified in this application.

[0032] Figure 4 This is a schematic diagram of the forces acting in a stationary vehicle scenario as illustrated in this application.

[0033] Figure 5 This is a schematic diagram of the forces acting in a vehicle acceleration scenario as illustrated in this application.

[0034] Figure 6 This is a schematic diagram showing the distribution of the various microphones in the vehicle described in this application example.

[0035] Figure 7 This is a schematic diagram of the internal structure of the entertainment device provided in the embodiments of this application;

[0036] Figure 8 This is a structural diagram illustrating the bottom configuration and main configuration of the base of the suspendable component in this application example.

[0037] Figure 9 This is a cross-sectional structural diagram of the base of the example in this application.

[0038] The realization of the objectives, functional features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0039] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0040] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which must be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0041] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if," as used herein, can be interpreted as "when," "when," or "in response to determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising," "including," indicate the presence of the stated feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms "or" and "and / or" as used herein are to be interpreted as inclusive, or mean any one or any combination thereof. Therefore, "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A, B, and C". Exceptions to this definition will only occur if the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0042] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0043] It should be noted that step designations such as S11 and S12 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S12 first and then S11, etc., but these should all be within the protection scope of this application.

[0044] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0045] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0046] See Figure 1 This application provides a control method that can be executed by an entertainment device provided in this application. The entertainment device can be implemented in software and / or hardware. Optionally, the entertainment device may be, for example, a floating speaker or an interactive robot.

[0047] This embodiment provides a control method, which includes the following steps (steps S11 to S13):

[0048] Step S11: In response to the playback of sound information, play a sweeping tone in conjunction with the in-vehicle audio system.

[0049] In one embodiment, the sound information can characterize various sounds that can be played by a speaker. Optionally, the sound information includes, but is not limited to, music information, voice broadcast information, etc.

[0050] In one embodiment, when playing audio information, the in-vehicle audio system and entertainment device can play it together.

[0051] In one embodiment, in-vehicle audio can refer to the audio system built into the vehicle, which may include multiple in-vehicle speakers, each located at a different position within the vehicle.

[0052] In one embodiment, the in-vehicle audio system and the peripheral entertainment equipment in the vehicle can be combined into a single audio system.

[0053] In one implementation, a swept tone is a sound signal whose frequency changes continuously over time, typically used for the calibration and testing of audio systems. It covers the frequency range audible to the human ear, from low to high frequencies, to ensure that the audio system accurately reproduces sound at all frequency points. The swept tone can be linear, logarithmic, or follow other patterns.

[0054] In one embodiment, during the calibration process of the audio system, a sweep tone is used to test the audio system's response to different frequencies.

[0055] In one embodiment, playing a sweeping tone in conjunction with the vehicle's audio system indicates that the entertainment device and the vehicle's audio system are playing the same sweeping tone simultaneously. Optionally, the same sweeping tone can be played simultaneously by the entertainment device and the vehicle's audio system before playing audio information; or, after playing audio information, the playback of the audio information can be paused as needed, and then the same sweeping tone can be played simultaneously by the entertainment device and the vehicle's audio system.

[0056] Step S12: Determine the sound reception direction based on the obtained location information of the target personnel, and perform sound reception control according to the sound reception direction to obtain directional audio information.

[0057] In one embodiment, the positioning method for obtaining the location information of the target person includes, but is not limited to, at least one or a combination of multiple of the following: positioning method based on image recognition, positioning method based on sound source recognition, positioning method based on vehicle seat sensor, etc.

[0058] In one embodiment, the entertainment device may include a base and a levitation component; and / or,

[0059] At least one of the base and the levitation component is equipped with a shooting device (e.g., a TOF camera); and / or,

[0060] At least one of the base and the levitation component is provided with a device microphone; and / or,

[0061] At least one of the base and the levitation component is equipped with a device speaker.

[0062] In one embodiment, the engagement state between the base and the levitation component includes a levitation state and a non-levitation state. In the levitation state, the levitation component can be suspended above the base by magnetic force. In the non-levitation state, the levitation component can contact and be fixed to the base.

[0063] In one embodiment, the principle by which the base and the levitation component achieve levitation can include: First, when the magnetic field near the metal changes, electrons on the metal move, generating an electric current. Second, the magnetic effect of the electric current; when current flows through a wire or a piece of metal, a magnetic field is generated; at this time, the current-carrying coil acts as a magnet. Third, magnets interact with each other; like poles repel, and unlike poles attract. Specifically, the first principle: when a magnet passes over a piece of metal, electrons on the metal begin to move due to the change in the magnetic field; the second principle: electrons form a circuit, thus generating their own magnetic field; the third principle: because like poles of magnets repel each other, when a magnet moves over another magnet, it generates an upward pushing force on the moving magnet.

[0064] In one embodiment, the device microphone may be an extendable microphone.

[0065] In one embodiment, step S12: determining the sound reception direction based on the acquired in-vehicle location information of the target person, and controlling the sound reception in the direction of sound reception to obtain directional audio information, may include: acquiring in-vehicle environment information through a camera; acquiring the ear position information of the target person based on the in-vehicle environment information; determining the sound reception direction based on the ear position information; and controlling the extendable microphone to extend and receive sound in the direction of sound reception to obtain directional audio information. Thus, the technical solution of this embodiment can determine the direction from the entertainment device to the target person's ear as the sound reception direction based on the in-vehicle environment information acquired by the camera, and control the extendable microphone to extend and receive sound in the direction of sound reception, thereby more accurately identifying the directional audio information reaching the target person's ear, so as to optimize the audio received by the ear and improve the listening effect of the target person (driver / passenger).

[0066] In one embodiment, the step of obtaining the ear location information of the target person based on the in-vehicle environment information includes: when there is a driver or passenger in the in-vehicle environment information that meets preset conditions, the driver or passenger is identified as the target person.

[0067] In one embodiment, the occupants who meet the preset conditions include, but are not limited to, at least one of the following:

[0068] The only person in the vehicle;

[0069] Pre-set driver and passenger occupants;

[0070] Passengers who engage in interactive actions corresponding to sound information;

[0071] The highest priority among all passengers in the vehicle.

[0072] In one embodiment, the pre-set occupants can correspond to the vehicle owner and / or other persons associated with the vehicle owner. The pre-set occupants can be associated with stored biometric information, allowing the entertainment device to determine the pre-set target occupants based on biometric detection of the in-vehicle environment. Optionally, the biometric information includes facial information, iris information, etc.

[0073] In one embodiment, the interactive actions corresponding to the sound information include, but are not limited to: lip movements in response to broadcast voice information, lip movements in singing along to music information, and rhythmic body movements in response to the rhythm of music information.

[0074] In one embodiment, the interactive action can be obtained by image recognition and analysis of the images of people in the in-vehicle environment information.

[0075] In one embodiment, when there are drivers and passengers in the in-vehicle environment information that meet preset conditions, the step of selecting drivers and passengers as target personnel includes: when there are multiple drivers and passengers in the in-vehicle environment information, determining the personnel tag corresponding to each driver and passenger; and selecting the driver and passenger with the highest priority among all drivers and passengers in the vehicle as the target personnel according to the priority corresponding to each personnel tag.

[0076] In one embodiment, the personnel tag can represent an identifier that distinguishes drivers and passengers by type. The personnel tag can include at least one of the following: vehicle owner, vehicle owner-preset personnel, stranger, driver or passenger exhibiting interactive actions corresponding to voice information, etc.

[0077] In one implementation, each person tag can be associated with a priority level.

[0078] In one implementation, the priority order of personnel tags can be arbitrarily set according to requirements. The following are examples of several priority orderings for personnel tags from highest to lowest for reference:

[0079] (1) There are drivers, strangers, people preset by the car owner, and car owners who have interactive actions corresponding to the sound information; thus, the technical solution of this embodiment can better provide a good riding experience for new passengers and drivers with high interaction needs.

[0080] (2) There are drivers, car owners, car owners' preset personnel, strangers, etc. who have interactive actions corresponding to the sound information; thus, the technical solution of this embodiment can better provide a good riding experience for drivers and passengers with high interaction needs.

[0081] (3) The vehicle owner, the vehicle owner's preset personnel, the driver and passengers who have interactive actions corresponding to the sound information, strangers, etc.; thus, the technical solution of this embodiment can prioritize providing a good driving experience for the preset driver and passengers (i.e., the vehicle owner and the vehicle owner's preset personnel).

[0082] In one embodiment, the step of determining the sound reception direction based on ear position information may include: determining a central position based on the ear position information of multiple target individuals; and determining the direction from the entertainment device towards the central position as the sound reception direction. Thus, the technical solution of this embodiment controls the extendable microphone to extend and receive sound in the sound reception direction, thereby more accurately identifying the directional audio information reaching the ears of multiple target individuals, facilitating subsequent optimization of the audio received by the ears, and achieving the goal of improving the listening experience for multiple target individuals (drivers and passengers).

[0083] Step S13: Adjust the sound effects based on the directional audio information and the reference audio information to adjust the audio playback parameters of the entertainment device when playing sound information according to the direction of sound reception.

[0084] In one implementation, the entertainment device can collect sound data using its own microphone, then analyze this data to obtain directional audio information. Based on this directional audio information and reference audio information for optimal listening experience, it identifies frequency bands that exceed a critical threshold (a performance standard set by the audio system that may cause distortion or an undesirable listening experience). The device's built-in software then automatically adjusts digital signal processing (DSP) settings, such as equalizers (EQ), to compensate for the gain at specific frequencies until all frequency bands are within the critical threshold, completing the calibration. Through automatic calibration, even users without professional acoustic knowledge can enjoy optimized sound quality.

[0085] See Figure 2 This is a schematic diagram comparing the example standard curve (i.e., reference audio information) with the actual measured values ​​inside the vehicle (i.e., directional audio information) in this embodiment. Based on the technical concept of step S13, the purpose is to bring the actual measured values ​​inside the vehicle closer to the standard curve, using the adjustment parameter closest to the standard curve as the target adjustment parameter, and then controlling the sound effect adjustment based on the target adjustment parameter. Figure 2 For example, if the measured low-frequency data inside the vehicle is higher than the standard curve data, and the measured high-frequency data is lower than the standard curve data, the parameters of the entertainment system's speakers can be adjusted to lower the low-frequency data to near the standard curve and raise the high-frequency data to near the standard curve. In this way, the frequency band exceeding the critical line is automatically compensated until all frequencies are within the critical line, completing the calibration. Therefore, this example implements automatic compensation for frequency bands exceeding the critical line until all frequencies are within the critical line, completing the calibration.

[0086] In one embodiment, the method provided in this embodiment (e.g., before step S11 or after step S13) may further include: predicting inertial characteristics in response to a change in vehicle operating state, the inertial characteristics including the direction of inertial force and / or inertial force; adjusting the magnetic force between the base and the suspendable component according to the inertial characteristics to maintain the relative spatial positional relationship between the base and the suspendable component. Thus, the technical solution of this embodiment can monitor and predict the vehicle operating state, and can adjust the magnetic force between the base and the suspendable component to overcome the inertial force during driving when the vehicle operating state changes. Therefore, it can prevent the suspendable component from detaching from the base or flying out due to the magnetic attraction generated by the base, thus affecting driving safety and property safety.

[0087] In one embodiment, prior to the step of predicting inertial characteristics in response to a change in vehicle operating state, the method may include: acquiring current driving information of the vehicle, which may include at least one of motor current, motor speed, accelerator pedal opening, brake pedal opening, vehicle speed, steering wheel angle, etc.; predicting the current vehicle operating state when the current driving information differs from the driving information at the previous moment, which may include at least one of acceleration, deceleration, left turn, right turn, etc.; and determining that the vehicle operating state has changed when the current vehicle operating state differs from the vehicle operating state at the previous moment. Thus, the technical solution of this embodiment can predict whether the vehicle operating state is about to change based on the acquired vehicle driving information, thereby timely enhancing the magnetic attraction between the base and the suspendable component to overcome the inertial force during driving when the vehicle operating state is about to change.

[0088] In one embodiment, see Figure 3 The base includes an electromagnetic conversion assembly, which includes at least one electromagnet coil. The electromagnet coil has a first end m1 and a second end m2, and both ends m1 and m2 can be connected to a power supply system. A magnet assembly is located at the bottom of the levitation assembly. Figure 3 (Not shown).

[0089] In one embodiment, the step of enhancing the magnetic attraction between the base and the levitable component based on inertial characteristics to maintain the relative spatial position relationship between the base and the levitable component may include: determining control current information of the electromagnet coil based on the inertial characteristics, wherein the control current information may include at least one of current direction, current magnitude, etc.; and controlling the energization of at least one electromagnet coil based on the control current information to maintain the relative spatial position relationship between the base and the levitable component.

[0090] In one embodiment, the connection relationship between the first end m1 and the second end m2 of an electromagnet coil and the positive and negative poles can be determined according to the control current information, so that the electromagnet coil has N and S poles. For example, the first end m1 corresponds to the N pole and the second end m2 corresponds to the S pole; or the first end m1 corresponds to the S pole and the second end m2 corresponds to the N pole.

[0091] In one embodiment, when the suspendable component is in a non-suspended state (or idle state), the first end m1 is connected to the positive terminal and the second end m2 is connected to the negative terminal, or the first end m1 is connected to the negative terminal and the second end m2 is connected to the positive terminal, or neither the first end m1 nor the second end m2 is powered.

[0092] Based on the aforementioned technical principles, the following examples illustrate the force interactions of a suspended component in different scenarios while it is suspended:

[0093] The levitation component includes a magnet component, which contains multiple magnets;

[0094] (1) Scene with stationary vehicle:

[0095] See Figure 4 The electromagnetic conversion component of the base includes multiple electromagnet coils, each energized so that the lower end of each coil is the S pole and the upper end is the N pole. The upper end of each coil is positioned close to the N pole of the magnet in the levitation component, thus allowing the levitation component to levitate under repulsive forces (e.g., ...). , Under the influence of (etc.), it levitates above the base; one way to achieve this is that the resultant force of the repulsive force between each electromagnet coil and the magnet in the levitable component is equal to the weight of the levitable component. Furthermore, the resultant force is in the opposite direction to gravity.

[0096] (2) Vehicle acceleration scenario:

[0097] See Figure 5 The electromagnetic conversion component of the base includes multiple electromagnet coils. Each electromagnet coil is energized, so that the lower end of each electromagnet coil is the S pole and the upper end is the N pole. The upper end of each electromagnet coil is close to the N pole of the magnet in the levitation component, so that the levitation component is levitated above the base under the action of repulsive force.

[0098] When a vehicle accelerates in the first direction with acceleration *a*, the direction of inertia in its inertial characteristics is the second direction, opposite to the first direction. Therefore, the resultant force of the repulsive forces exerted by each electromagnet coil on the magnets in the levitation component must tilt towards the first direction to overcome the inertial force towards the second direction. The resultant force tilting towards the first direction can be decomposed into an accelerating force towards the first direction. and vertical upward suspension support force Among them, acceleration force =ma (where m is the weight of the suspendable component), where the suspending support force is equal to the weight of the suspendable component ( = ).

[0099] It should be understood that the scenarios of vehicle deceleration, vehicle left turn, and vehicle right turn are similar to the aforementioned vehicle acceleration scenarios, and will not be repeated here.

[0100] (3) Vehicle bumping scene (upward, downward):

[0101] The electromagnetic conversion component of the base includes multiple electromagnet coils. Each electromagnet coil is energized, so that the lower end of each electromagnet coil is the S pole and the upper end is the N pole. The upper end of each electromagnet coil is close to the N pole of the magnet in the levitation component, so that the levitation component is levitated above the base under the action of repulsive force.

[0102] By changing the magnetic direction and magnitude of each electromagnet coil, the resultant force of the repulsive force between the levitation component and the base can overcome gravity and inertia.

[0103] In one embodiment, the method provided in this embodiment (e.g., before step S11) may further include: in response to the installation configuration of the entertainment device, controlling the in-vehicle speaker corresponding to a preset in-vehicle location to emit sound, the in-vehicle speaker being included in the in-vehicle audio system; performing sound reception analysis through the device microphone and the in-vehicle microphone to determine the in-vehicle installation location information of the entertainment device; and forming a microphone array based on the device microphone and the in-vehicle microphone. Thus, in the technical solution of this embodiment, when the entertainment device is installed, it can determine its installation location in the vehicle based on the sound emitted by the in-vehicle speaker, which is convenient for subsequent use. In addition, in the technical solution of this embodiment, the entertainment device can form a microphone array with its own device microphone and the in-vehicle microphone, which has at least the following advantages: (1) Improve the accuracy of speech recognition: Through beamforming technology, the microphone array can focus on picking up sound from a specific direction and suppress noise from other directions, thereby accurately recognizing the driver's voice commands in a noisy in-vehicle environment; (2) Enhance the sound source localization capability: The microphone array can accurately calculate the angle and distance between the sound source and the array based on the time difference of sound arrival, thereby realizing the localization and tracking of the target sound source; (3) Reduce noise interference: Utilizing the spatial filtering characteristics of the microphone array, a pickup pattern is formed in the direction of the target speaker. (3) Sound beam: only picks up the signal of the beam, suppresses noise and reverberation outside the beam, and filters out the sound emitted by the audio device through echo cancellation technology, so that the user's voice obtained by the speech recognition engine is clearer and purer; (4) Adapts to a variety of driving environments: even at high speeds or in noisy environments outside the vehicle, it can maintain a high accuracy and real-time performance of speech recognition; (5) Optimizes in-vehicle communication quality: by reducing echo and noise and adjusting gain and frequency equalization, it ensures that the voice of passengers in the vehicle can be clearly heard through the car hands-free system; (6) Realizes sound source signal extraction or separation: extracts the target signal from multiple sound signals, improving the clarity and intelligibility of the speech signal; (7) Enhances anti-interference capability: through algorithm control, the microphone array can point the beam at the current speaker after searching for the speaker's location, significantly reducing the impact of ambient noise and echo.

[0104] In one embodiment, the in-vehicle speaker corresponding to the preset in-vehicle position can be the in-vehicle speaker located in the middle of the vehicle cabin.

[0105] In one embodiment, the in-vehicle speaker can represent speakers built into different locations within the vehicle.

[0106] In one embodiment, the method provided in this embodiment may further include: determining a target angle between the sound source position of the interactive voice and the in-vehicle installation position information, based on the interactive voice received by the microphone array and the in-vehicle installation position information; controlling the interactive surface of the suspendable component to face the sound source position according to the target angle, and performing voice broadcast. Thus, the technical solution of this embodiment uses a microphone array formed by the device microphone of the entertainment device and the in-vehicle microphone to locate the user for voice interaction, thereby enabling control of the interactive surface of the entertainment device to face the user for interaction.

[0107] In one embodiment, the interactive surface may represent the front of the entertainment device or the side with the display screen.

[0108] Based on the aforementioned technical concept, see Figure 6 The following example illustrates a scenario for voice interaction based on a microphone array, for reference:

[0109] (1) When a passenger wakes up the in-vehicle voice system, the voice command (i.e., interactive voice, sound signal) issued is recognized by the vehicle’s four built-in in-vehicle microphones (MIC1, MIC2, MIC3, MIC4). Based on the difference in sound energy (Lp1-Lp2=20Lg(r2 / r1)) and phase (the time difference between the arrival of the sound at each in-vehicle microphone) recognized by the four in-vehicle microphones, the sound source position (human mouth) is located, so as to locate the position of the human head.

[0110] Optionally, the formula Lp1-Lp2=20Lg(r2 / r1) can be used to calculate the difference in sound energy received by each in-vehicle microphone and its adjacent in-vehicle microphone, where Lp1 represents the sound pressure level of the sound source entering the microphone in this vehicle, Lp2 represents the sound pressure level of the sound source entering the microphone in the adjacent in-vehicle microphone, r1 represents the distance from the microphone in this vehicle to the sound source, and r2 represents the distance from the adjacent in-vehicle microphone to the sound source.

[0111] (2) The microphone MIC5 of the entertainment device (e.g., the floating speaker) compares the sound information picked up by the four in-vehicle microphones to confirm its own position relative to the sound source (head), and can also confirm its own position in the vehicle; thus, the entertainment device (e.g., the floating speaker) can determine the position of the sound source (head) of the voice command relative to its own target angle, and control the interactive surface of the floating component of the entertainment device to face the sound source (head) according to the target angle, and perform voice broadcast.

[0112] In one embodiment, after controlling the interactive surface of the levitable component to face the sound source position according to the angle and performing voice broadcast, the method further includes: in response to the end of the voice broadcast, controlling the levitable component to rotate back to the initial angle. Thus, the technical solution of this embodiment enables the levitable component to reset after the interaction is completed, improving the interactive experience.

[0113] In one embodiment, at least two laser ranging components may be provided at the bottom of the suspendable component; the base may also include a spiral component.

[0114] In one embodiment, one of the two laser ranging components is used to align with the center of the spiral component and measure distance to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the first ranging information to maintain the relative spatial position relationship between the base and the levitable component; the other of the two laser ranging components is used to align with the thread of the spiral component and measure distance to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the second ranging information and the target angle, so that the interaction surface of the levitable component rotates to the target angle.

[0115] The control method provided in this embodiment, applied to an entertainment device, includes: Step S11: In response to playing sound information, playing a sweeping tone in coordination with the vehicle's audio system; Step S12: Determining the sound reception direction based on the acquired location information of the target person, and performing sound reception control for the sound reception direction to obtain directional audio information; Step S13: Performing sound effect adjustment control based on the directional audio information and reference audio information to adjust the audio playback parameters of the entertainment device when playing sound information in accordance with the sound reception direction. Through the technical solution of this embodiment, when playing sound information in a vehicle, directional sound reception can be performed for the location of the driver and passengers to obtain directional audio information. Then, the directional audio information is compared with reference audio information representing the optimal listening effect, and the audio playback parameters of the entertainment device when playing sound information are adjusted according to the comparison result. This allows for adaptive compensation of the sound effects when playing sound information at the corresponding location, completing the coordination with the vehicle's speakers, improving the listening effect at the specified location, and enhancing the listening experience for the driver and passengers. Therefore, the technical solution of this embodiment can improve the in-vehicle listening experience for drivers and passengers, thereby improving the user experience.

[0116] Based on the aforementioned technical concept, this embodiment enables the adaptation of entertainment devices to vehicles, achieving enhanced interaction. Furthermore, this embodiment also allows for angle changes (e.g., 180° rotation) of the levitable component of the entertainment device. When a passenger controls the vehicle via voice commands, the levitable component of the entertainment device will provide corresponding feedback. In this embodiment, the levitable component of the entertainment device can face the passenger using voice commands. Specifically, the levitable component can employ a magnet array structure, with a coil array as the base. A microphone array, composed of the device's microphone and the in-vehicle microphone of the car audio system, calibrates the entertainment device's position within the vehicle and clarifies its position relative to the passenger. When the passenger uses voice commands, the relative position coordinates between the passenger and the entertainment device can be acquired by the entertainment device. Based on these relative position coordinates, the electromagnet coils of the base can be activated to generate magnetic force, causing the levitable component to perform interactive actions such as facing the passenger.

[0117] Based on the aforementioned technical concept, this embodiment can also adapt to the vehicle's motion state. Thus, when the vehicle is accelerating, decelerating, turning, or in other motion states, the entertainment device can stabilize the levitable component, ensuring that the entertainment device can be used in multiple scenarios inside the vehicle. At the same time, the entertainment device also has the capability of adaptive enhancement of in-vehicle sound effects, which can automatically calibrate and match the sound field of the entire vehicle according to the placement position, improving the listening effect at the designated location.

[0118] The entertainment device in this embodiment may include a magnetic calibration module, a magnetic module, a sound generation module, a signal transmission module, a sound calibration module, and a position calibration module. The magnetic levitation speaker is controlled via vehicle-mounted signals, allowing users to freely choose its placement location based on their needs, enhancing interaction between the speaker and passengers, and proactively boosting the sound effects at designated locations.

[0119] Based on the same inventive concept as the foregoing embodiments, this application provides an entertainment device, such as... Figure 7 As shown, the device includes: a processor 310 and a memory 311 storing a computer program; wherein, Figure 7 The processor 310 shown in the diagram does not indicate that there is only one processor 310, but only indicates the positional relationship of the processor 310 relative to other devices. In practical applications, there can be one or more processors 310; similarly, Figure 7 The memory 311 illustrated herein has the same meaning, that is, it is only used to indicate the positional relationship of memory 311 relative to other devices. In practical applications, there can be one or more memories 311. When the processor 310 runs the computer program, it implements the steps of the control method applied to the above-mentioned device.

[0120] The device may also include at least one network interface 312. The various components of the device are coupled together via a bus system 313. It is understood that the bus system 313 is used to implement communication between these components. In addition to a data bus, the bus system 313 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 7 The general designated all buses as Bus System 313.

[0121] The memory 311 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); magnetic surface memory can be disk storage or magnetic tape storage. Volatile memory can be random access memory (RAM), used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memory 311 described in the embodiments of this application is intended to include, but is not limited to, these and any other suitable types of memory.

[0122] The memory 311 in this embodiment is used to store various types of data to support the operation of the device. Examples of this data include any computer programs used to operate on the device, such as operating systems and applications. The operating system includes various system programs, such as framework layers, core library layers, and driver layers, used to implement various basic business functions and handle hardware-based tasks. Applications can include various applications, such as media players and browsers, used to implement various application services. Here, the program implementing the steps of the control method in this embodiment can be included in the application.

[0123] In one embodiment, the entertainment device also includes a base and a levitation component.

[0124] In one embodiment, a magnet assembly and at least two laser ranging assemblies are disposed at the bottom of the levitable component. The laser ranging assemblies may include a laser emitter and a photosensor.

[0125] In one embodiment, the base includes a spiral assembly and an electromagnetic conversion assembly. The electromagnetic conversion assembly may include multiple electromagnet coils.

[0126] In one embodiment, the electromagnetic conversion component and the magnet component, under the action of magnetic force, enable the base to maintain the levitation component in a levitation state or a non-levitation state.

[0127] See Figure 8 This embodiment illustrates the bottom configuration and main configuration of a levitable component's base. The levitable component may include multiple magnets (each magnet having the same magnetic properties), two laser emitters, and a photosensor. Multiple coils (i.e., electromagnet coils) are arranged around the periphery of the base. A fixed tray for the levitable component is located at the center of the base, and a threaded coil (i.e., a spiral component, used to cooperate with the laser ranging component for distance measurement) is arranged within this fixed tray. The center point of the threaded coil is flat, and its edges gradually curve upwards, so that the distance information obtained by the laser ranging component at different positions around the spiral coil varies. See also... Figure 9 A light-transmitting cover can be installed above the spiral coil to prevent foreign objects from obstructing the threads and affecting the laser ranging component's laser ranging function.

[0128] In one embodiment, one of the two laser ranging components is used to align with the center of the threaded coil and measure the distance to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the first ranging information to maintain the relative spatial position relationship between the base and the levitable component.

[0129] In one embodiment, one of the two laser ranging components is used to align with and measure distance to the thread of the threaded coil to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force based on the second ranging information and the target angle, so that the interaction surface of the levitable component rotates to the target angle.

[0130] In one embodiment, the structural fit between the levitable component of the entertainment device and the base includes:

[0131] (1) When the suspendable component is not in use, it can be placed on the fixed tray (inserted). For specific configuration, please refer to the following. Figure 8 Through size matching (the bottom of the suspendable component is a in length and b in width, the distance between the two laser emitters is c, the fixed tray in the base is a in length and b in width, and the distance from the center to the edge of the spiral coil is c) and magnetic attraction;

[0132] (2) The laser emitter t1 at the center of the levitable component is responsible for positioning the levitable component and the fixed tray of the base. When the laser ranging at the center changes > the distance threshold e, it is considered that the levitable component deviates from the center of the fixed tray. The levitable component needs to be moved and corrected to the center of the fixed tray. The basic method is to energize the electromagnetic conversion component of the corresponding base to generate magnetic force to restore it to the center of the fixed tray.

[0133] (3) The laser emitter t2 on one side is responsible for triggering the angle detection of the levitable component relative to the fixed tray. The edge of the spiral coil corresponding to the laser emitter t2 is spiral. When the levitable component rotates, the corresponding laser ranging distance will also change. In order to avoid the distance change caused by the tilt of the levitable component misleading the results, the height difference at different positions on the spiral edge needs to be calculated to control the magnetic force and avoid the levitable component tilting.

[0134] (4) When the entertainment equipment is in use, the electromagnetic conversion component in the fixed tray is energized and generates a magnetic force to lift the levitation component. The height is controlled by the distance obtained by the laser ranging component corresponding to the laser emitter t1 (similarly, when not in use, the levitation component is placed on the fixed tray).

[0135] (5) The top of the suspendable component is equipped with a device microphone. After the base position of the entertainment device is fixed, the built-in in-vehicle speaker (the parameter selects a speaker in the in-vehicle position) emits sound. The in-vehicle position information of the entertainment device is confirmed according to the energy difference between the in-vehicle microphone and the device microphone of the suspendable component. The entertainment device forms a microphone array by cooperating with the in-vehicle microphone. Beamforming technology is used to identify the angle of the voice command issuer relative to the entertainment device. When the voice command issuer uses the entertainment device to replace the voice broadcast of the vehicle machine, the entertainment device faces the user. After the voice broadcast is completed, it returns to the initial position according to the distance obtained by the laser ranging component corresponding to the laser emitter t2.

[0136] The entertainment device provided in this embodiment can easily, conveniently, and at low cost achieve rotation and angle positioning of the levitable component in a levitable state or a non-levitable state through a magnet component and at least two laser ranging components set at the bottom of the levitable component, as well as a spiral component and an electromagnetic conversion component set at the base.

[0137] This application provides a vehicle equipped with the entertainment equipment described above.

[0138] Based on the same inventive concept as the foregoing embodiments, this embodiment also provides a computer-readable storage medium storing a computer program. The computer-readable storage medium can be a magnetic random access memory (FRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM), etc.; it can also be various devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc. When the computer program stored in the computer-readable storage medium is run by a processor, it implements the above method. For the specific steps implemented when the computer program is executed by the processor, please refer to [link to relevant documentation]. Figure 1 The description of the illustrated embodiments will not be repeated here.

[0139] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0140] In this document, the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, which includes not only the elements listed but also other elements not expressly listed.

[0141] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A control method characterized by, The control method is applied to an entertainment device, the entertainment device comprising a base and a suspendable component, at least one of the base and the suspendable component is provided with a device microphone, at least one of the base and the suspendable component is provided with a device speaker, and the control method comprises: In response to playing sound information, cooperating with the in-vehicle sound system to play a sweep frequency sound; According to the obtained position information of the target person, determining a sound collecting direction, and performing sound collecting control for the sound collecting direction to obtain directional audio information; According to the directional audio information and reference audio information, performing sound effect adjustment control to adjust the audio playing parameters of the entertainment device when playing the sound information for the sound collecting direction; The control method further comprises: In response to the installation configuration of the entertainment device, controlling the in-vehicle speaker corresponding to the preset in-vehicle position to sound, the in-vehicle speaker being included in the in-vehicle sound system; Performing sound collecting analysis through the device microphone and the in-vehicle microphone to determine the in-vehicle installation position information of the entertainment device, and forming a microphone array with the device microphone and the in-vehicle microphone, wherein the interactive voice received by the microphone array and the in-vehicle installation position information can determine a target angle of the sound source position of the interactive voice relative to the entertainment device, and the target angle is used to indicate that the interactive surface of the suspendable component faces the sound source position.

2. The method of claim 1, wherein: At least one of the base and the suspendable component is provided with a shooting device.

3. The method of claim 2, wherein, The device microphone is a stretchable microphone; The step of determining a sound collecting direction according to the obtained in-vehicle position information of the target person, and performing sound collecting control for the sound collecting direction to obtain directional audio information, comprises: Obtaining in-vehicle environment information through the shooting device; Obtaining ear position information of the target person according to the in-vehicle environment information; Determining the sound collecting direction according to the ear position information; Controlling the stretchable microphone to stretch and collect sound towards the sound collecting direction to obtain the directional audio information.

4. The method of claim 3, wherein, In the step of obtaining ear position information of the target person according to the in-vehicle environment information, comprising: When there is a driver or passenger in the in-vehicle environment information who meets a preset condition, the driver or passenger is taken as the target person; The driver or passenger who meets the preset condition comprises at least one of: The only driver or passenger in the vehicle; A pre-set driver or passenger; A driver or passenger who has an interactive action corresponding to the sound information.

5. The method of claim 1, wherein, Further comprising: In response to a change in the vehicle operating state, predicting an inertial characteristic, the inertial characteristic comprising an inertial force direction and / or an inertial force; According to the inertial characteristic, adjusting the magnetic force between the base and the suspendable component to maintain the relative spatial positional relationship between the base and the suspendable component.

6. The method of claim 1, wherein, Further comprising: According to the target angle, controlling the interactive surface of the suspendable component to face the sound source position and performing voice broadcast.

7. The method of claim 6, wherein, After the step of controlling the interactive surface of the suspendable component to face the sound source position according to the angle and performing voice broadcast, comprising: In response to the end of the voice broadcast, the controllable floating component is controlled to rotate to an initial angle.

8. An entertainment apparatus characterized by comprising: The processor and a memory storing a computer program are included. The processor runs the computer program in the memory to implement the steps of the control method in any one of claims 1 to 7.

9. The entertainment device of claim 8, wherein, The bottom of the controllable floating component is provided with a magnet assembly and at least two laser ranging assemblies. The base includes a screw assembly and an electromagnetic conversion assembly. The electromagnetic conversion assembly and the magnet assembly maintain the floating state or non-floating state of the controllable floating component under the action of magnetic force. One of the two laser ranging assemblies is used to align with the center of the screw assembly and measure the distance to obtain first ranging information, and the processor controls the electromagnetic conversion assembly to generate magnetic force to maintain the relative spatial position relationship between the base and the controllable floating component according to the first ranging information. The other of the two laser ranging assemblies is used to align with the thread of the screw assembly and measure the distance to obtain second ranging information, and the processor controls the electromagnetic conversion assembly to generate magnetic force to rotate the interaction surface of the controllable floating component to the target angle according to the second ranging information and the target angle.

10. A vehicle characterized by comprising: The vehicle is provided with the entertainment device of claim 8 or claim 9.

11. A computer readable storage medium, characterized in that, The memory stores a computer program, and the processor executes the computer program to implement the steps of the control method in any one of claims 1 to 7.

Images