Control method, entertainment equipment, vehicle and readable storage medium

Abstract

The invention discloses a control method, entertainment equipment, a vehicle and a computer readable storage medium, and the control method is applied to the entertainment equipment, and comprises the steps: responding to playing sound information, and cooperating with a sound box in the vehicle to play a sweep frequency sound; determining a sound receiving direction according to the obtained position information of the target person, and performing sound receiving control for the sound receiving direction to obtain directional audio information; and performing sound effect adjustment control according to the directional audio information and the reference audio information so as to adjust audio playing parameters when the entertainment equipment plays the sound information according to the sound receiving direction. According to the technical scheme of the invention, when the vehicle plays the sound information, directional sound reception can be carried out according to the in-vehicle position of a driver and a passenger to obtain the directional audio information, so that the directional audio information is compared with the reference audio information representing the optimal sound listening effect; and adjusting an audio playing parameter when the entertainment equipment plays the sound information according to the comparison result so as to improve the sound listening effect of the driver and the passengers.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a control method, an entertainment device, a vehicle, and a computer-readable storage medium. Background Art

[0002] With the development of science and technology, more and more intelligent vehicles have emerged. Generally, various intelligent devices can be installed in intelligent vehicles to expand various intelligent functions of intelligent vehicles and improve user experience.

[0003] At present, smart vehicles are usually equipped with fixed audio equipment for playing sound information. However, in practical applications, fixed audio equipment cannot adjust the sound effects according to the position of the driver and passengers in the car. Therefore, how to improve the in-car listening effect of the driver and passengers is a technical problem that technicians in this field need to solve urgently. Summary of the invention

[0004] The purpose of this application is to provide a control method, entertainment equipment, vehicle and computer-readable storage medium, which can improve the in-vehicle listening experience of drivers and passengers, thereby improving the user experience.

[0005] To achieve the above objectives: In a first aspect, an embodiment of the present application provides a control method, which is applied to entertainment equipment, including: in response to playing sound information, playing sweep frequency sound in cooperation with the in-vehicle audio system; determining the sound reception direction based on the acquired position information of the target person, and performing sound reception control with respect to the sound reception direction to obtain directional audio information; performing sound effect adjustment control based on the directional audio information and reference audio information to adjust the audio playback parameters of the entertainment equipment when playing sound information with respect to the sound reception direction.

[0006] In one embodiment, the entertainment device comprises a base and a levitable component; and / or, At least one of the base and the levitable component is provided with a photographing device; and / or, At least one of the base and the floatable component is provided with a device microphone; and / or, At least one of the base and the floatable assembly is provided with a device speaker.

[0007] In one embodiment, the device microphone is an extendable microphone.

[0008] In one embodiment, the sound collection direction is determined based on the obtained in-vehicle position information of the target person, and the sound collection direction is controlled to obtain directional audio information, including: obtaining in-vehicle environment information through a shooting device; obtaining the target person's ear position information based on the in-vehicle environment information; determining the sound collection direction based on the ear position information; controlling the extendable microphone to extend toward the sound collection direction and collect sound to obtain directional audio information.

[0009] In one embodiment, the step of acquiring ear position information of a target person according to in-vehicle environment information includes: when there are drivers or passengers who meet preset conditions in the in-vehicle environment information, the drivers or passengers are taken as target persons.

[0010] In one embodiment, the driver and passenger who meet the preset conditions include at least one of the following: The only occupant of the vehicle; Pre-set drivers and passengers; There are passengers who perform interactive actions corresponding to the sound information.

[0011] In one embodiment, the method further includes: predicting inertial characteristics in response to a change in the vehicle's operating state, the inertial characteristics including the direction of the inertial force and / or the inertial force; and adjusting the magnetic force between the base and the levitable component according to the inertial characteristics to maintain the relative spatial position relationship between the base and the levitable component.

[0012] In one embodiment, it also includes: in response to the installation configuration of the entertainment device, controlling the in-vehicle speaker corresponding to a preset in-vehicle position to make sound, the in-vehicle speaker being included in the in-vehicle audio system; performing sound reception analysis through the device microphone and the in-vehicle microphone to determine the in-vehicle installation position information of the entertainment device; forming a microphone array with the device microphone and the in-vehicle microphone; determining the sound source position of the interactive voice relative to the target angle of the entertainment device based on the interactive voice and the in-vehicle installation position information received by the microphone array; controlling the interactive surface of the suspendable component to face the sound source position based on the target angle, and performing voice broadcasting.

[0013] In one embodiment, after the step of controlling the interaction surface of the levitable component to face the sound source position according to the angle and performing voice broadcast, the method further includes: in response to the end of the voice broadcast, controlling the levitable component to rotate to the initial angle.

[0014] In a second aspect, an embodiment of the present application provides an entertainment device for implementing the steps of the control method described in any one of the above items.

[0015] In one embodiment, it includes a base and a levitable component; the bottom of the levitable component is provided with a magnet component and at least two laser ranging components; the base includes a spiral component and an electromagnetic conversion component.

[0016] In one embodiment, the electromagnetic conversion component and the magnet component enable the base to maintain the suspended state or non-suspended state of the levitable component under the action of magnetic force.

[0017] In one embodiment, one of the two laser ranging components is used to align and measure the distance with the center of the spiral component to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the first ranging information to maintain the relative spatial position relationship between the base and the suspendable component; wherein the other of the two laser ranging components is used to align and measure the distance with the thread of the spiral component to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the second ranging information and the target angle, so that the interaction surface of the suspendable component rotates to the target angle.

[0018] In a third aspect, an embodiment of the present application provides a vehicle, which is equipped with an entertainment device as described in any of the above items.

[0019] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the control method described in any one of the above items are implemented.

[0020] The control method, entertainment device, vehicle and computer-readable storage medium provided in the embodiment of the present application, the control method is applied to the entertainment device, including: in response to playing sound information, playing the sweeping frequency sound in cooperation with the in-car audio system; determining the sound receiving direction according to the acquired position information of the target person, and performing sound receiving control for the sound receiving direction to obtain directional audio information; performing sound effect adjustment control according to the directional audio information and the reference audio information, so as to adjust the audio playing parameters of the entertainment device when playing the sound information according to the sound receiving direction. Through the technical solution of the present application, when the vehicle plays sound information, it is possible to perform directional sound receiving for the in-car position of the driver and passenger to obtain directional audio information, thereby comparing the directional audio information with the reference audio information representing the optimal listening effect, and adjusting the audio playing parameters of the entertainment device when playing the sound information according to the comparison result, so as to improve the listening effect of the driver and passenger. Therefore, the technical solution of the present application can improve the in-car listening effect of the driver and passenger, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0022] Figure 1 It is a flow chart of the control method provided in the embodiment of the present application.

[0023] Figure 2 It is a schematic diagram comparing the exemplary standard curve of this embodiment with the actual measured value in the vehicle.

[0024] Figure 3 It is a schematic diagram of the electromagnet coil and power supply system of the example of this application.

[0025] Figure 4 It is a schematic diagram of the forces acting on the vehicle in a stationary scenario in the example of this application.

[0026] Figure 5 It is a schematic diagram of the forces in the vehicle acceleration scenario of the example of this application.

[0027] Figure 6 It is a schematic diagram of the distribution positions of various microphones in the vehicle of the example of the present application.

[0028] Figure 7 is a schematic diagram of the internal structure of the entertainment device provided in the embodiment of the present application; Figure 8 It is a structural schematic diagram of the bottom configuration of the levitable component and the main configuration of the base of the example of this application.

[0029] Fig. 9 It is a schematic diagram of the cross-sectional structure of the base of the example of this application.

[0030] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0031] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0032] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0033] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of..." or "when..." or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising", "including" indicate that there are described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or" and "and / or" used herein are interpreted as inclusive, or mean any one or any combination. Thus, “A, B, or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A, B, and C.” An exception to this definition will occur only when a combination of elements, functions, steps, or operations are inherently mutually exclusive in some manner.

[0034] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0035] It should be noted that, in this article, step codes such as S11, S12, etc. are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing it specifically, those skilled in the art may execute S12 first and then S11, etc., but these should all be within the scope of protection of this application.

[0036] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0037] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0038] See also Figure 1 , is a control method provided in an embodiment of the present application, which can be executed by an entertainment device provided in an embodiment of the present application, and the entertainment device can be implemented in software and / or hardware. Optionally, the entertainment device is, for example, a suspended sound system, an interactive robot, etc.

[0039] A control method provided in this embodiment includes the following steps (step S11 to step S13): Step S11: In response to the sound playing information, the sweep frequency sound is played in coordination with the in-car audio system.

[0040] In one embodiment, the sound information may represent various sounds that can be played by a speaker. Optionally, the sound information includes but is not limited to music information, voice broadcast information, and the like.

[0041] In one implementation, when the sound information is played, the in-car audio system and the entertainment device may be used to play the sound information in coordination.

[0042] In one embodiment, the in-vehicle audio system may refer to the audio system built into the vehicle, which may include a plurality of in-vehicle speakers respectively disposed at different locations in the vehicle.

[0043] In one embodiment, the in-vehicle audio system and the external entertainment device in the vehicle may be assembled into a set of audio system.

[0044] In one embodiment, the swept frequency tone is a sound signal whose frequency changes continuously over time, and is usually used for calibration and testing of the sound system. It covers the frequency range that the human ear can hear, from low frequency to high frequency, to ensure that the sound system can accurately restore the sound at each frequency point. The swept frequency tone can change linearly, or according to logarithm or other rules.

[0045] In one embodiment, during the calibration process of the sound system, a swept frequency tone is used to test the response of the sound system to different frequencies.

[0046] In one embodiment, playing the sweep frequency tone in conjunction with the in-car audio system may indicate that the entertainment device and the in-car audio system simultaneously play the same sweep frequency tone. Optionally, before playing the sound information, the entertainment device and the in-car audio system simultaneously play the same sweep frequency tone; or, after playing the sound information, the entertainment device and the in-car audio system simultaneously play the same sweep frequency tone after pausing the sound information as required.

[0047] Step S12: determining the sound collection direction according to the acquired position information of the target person, and performing sound collection control with respect to the sound collection direction to obtain directional audio information.

[0048] In one embodiment, the positioning method for obtaining the location information of the target person includes, but is not limited to: at least one or a combination of positioning methods based on image recognition, positioning methods based on sound source recognition, positioning methods based on vehicle seat sensors, etc.

[0049] In one embodiment, the entertainment device may include a base and a levitable component; and / or, At least one of the base and the levitable component is provided with a shooting device (such as a TOF camera); and / or, At least one of the base and the floatable component is provided with a device microphone; and / or, At least one of the base and the floatable assembly is provided with a device speaker.

[0050] In one embodiment, the matching state between the base and the levitable component includes a levitated state and a non-levitated state. In the levitated state, the levitable component can be suspended above the base by magnetic force. In the non-levitated state, the levitable component can be in contact with the base and fixed.

[0051] In one embodiment, the principles for achieving suspension between the base and the levitable component may include: the first principle is that when the magnetic field near the metal changes, the electrons on the metal will move and generate current. The second principle is the magnetic effect of electric current; when electric current flows in a wire or a piece of metal, a magnetic field will be generated; at this time, the energized coil is equivalent to a magnet. The third principle is that magnets will interact with each other, with like polarities repelling each other and opposite polarities attracting each other. Specifically, the first principle: when a magnet passes over a piece of metal, the electrons on the metal begin to move due to the change in the magnetic field; the second principle: the electrons form a loop, so they then generate their own magnetic field. The third principle: because like poles of magnets repel each other, a magnet moves over another magnet, resulting in a force pushing the moving magnet upward.

[0052] In one embodiment, the device microphone may be an extendable microphone.

[0053] In one embodiment, step S12: determining the sound receiving direction according to the acquired in-car position information of the target person, and performing sound receiving control for the sound receiving direction to obtain directional audio information, may include: acquiring in-car environment information through a shooting device; acquiring the human ear position information of the target person according to the in-car environment information; determining the sound receiving direction according to the human ear position information; controlling the extendable microphone to extend and receive sound in the sound receiving direction to obtain directional audio information. In this way, the technical solution of this embodiment can determine the direction from the entertainment device to the human ear of the target person as the sound receiving direction through the in-car environment information acquired by the shooting device, so as to control the extendable microphone to extend and receive sound in the sound receiving direction, thereby more accurately identifying the directional audio information reaching the human ear of the target person, so as to optimize the audio received by the human ear in the subsequent process, and achieve the purpose of improving the listening effect of the target person (driver and passenger).

[0054] In one embodiment, the step of acquiring ear position information of a target person according to in-vehicle environment information includes: when there are drivers or passengers who meet preset conditions in the in-vehicle environment information, the drivers or passengers are taken as target persons.

[0055] In one embodiment, the driver and passenger who meet the preset conditions include, but are not limited to, at least one of the following: The only occupant of the vehicle; Pre-set drivers and passengers; There are drivers and passengers who perform interactive actions corresponding to the sound information; The driver or occupant with the highest priority among all the occupants in the vehicle.

[0056] In one embodiment, the preset driver and passenger may correspond to the vehicle owner and / or other persons related to the vehicle owner. The preset driver and passenger may be associated with stored biometric information, so that the entertainment device may determine the preset target driver and passenger by performing biometric detection on the in-vehicle environment information and obtaining the biometric information. Optionally, the biometric information includes facial information, iris information, etc.

[0057] In one embodiment, the interactive actions corresponding to the sound information include, but are not limited to: reply lip shapes corresponding to the broadcast voice information, sing-along lip shapes corresponding to the music information, and rhythmic body movements corresponding to the rhythm of the music information.

[0058] In one implementation, the interactive action may be obtained by performing image recognition and analysis on the image of the person in the in-vehicle environment information.

[0059] In one embodiment, when there are drivers and passengers who meet preset conditions in the in-vehicle environment information, the step of taking the drivers and passengers as target persons includes: when there are multiple drivers and passengers in the in-vehicle environment information, determining the personnel label corresponding to each driver and passenger; and according to the priority corresponding to each personnel label, taking the driver and passenger with the highest priority among all the drivers and passengers in the vehicle as the target person.

[0060] In one embodiment, the person tag may represent an identifier for distinguishing the driver and passenger by type. The person tag may include at least one of the vehicle owner, a person preset by the vehicle owner, a stranger, a driver and passenger who has an interactive action corresponding to the sound information, and the like.

[0061] In one embodiment, each personnel tag may be associated with a priority.

[0062] In one implementation, the priority order of each person tag can be set arbitrarily according to the requirements. The following examples show the order of priority of each person tag from high to low for reference: (1) There are passengers, strangers, persons preset by the vehicle owner, and the vehicle owner who perform interactive actions corresponding to the sound information; thus, the technical solution of this embodiment can better provide a good riding experience for new passengers and passengers with high interactive needs.

[0063] (2) There are drivers and passengers, car owners, people preset by the car owner, strangers, etc. who perform interactive actions corresponding to the sound information; in this way, the technical solution of this embodiment can better provide a good riding experience for drivers and passengers with high interactive needs.

[0064] (3) the car owner, persons preset by the car owner, passengers who have interactive actions corresponding to the sound information, strangers, etc.; in this way, the technical solution of this embodiment can give priority to providing a good driving experience for the pre-set passengers (i.e., the car owner and persons preset by the car owner).

[0065] In one embodiment, the step of determining the sound collection direction according to the human ear position information may include: determining the middle position according to the human ear position information of multiple target persons; and determining the direction from the entertainment device to the middle position as the sound collection direction. In this way, the technical solution of this embodiment controls the extendable microphone to extend and collect sound in the sound collection direction, thereby more accurately identifying the directional audio information reaching the human ears of multiple target persons, so as to optimize the audio received by the human ears in the subsequent process, and achieve the purpose of improving the listening effect of multiple target persons (drivers and passengers).

[0066] Step S13: Performing sound effect adjustment control according to the directional audio information and the reference audio information, so as to adjust the audio playing parameters of the entertainment device when playing the sound information according to the sound receiving direction.

[0067] In one embodiment, the entertainment device can collect sound data through its own device microphone, and then analyze the sound data to obtain directional audio information, thereby identifying the frequency band that exceeds the critical line (the critical line refers to the performance standard set by the sound system, exceeding this standard may cause distortion or undesirable listening experience) based on the directional audio information and the reference audio information of the optimal listening effect, so that the built-in software of the entertainment device will automatically adjust the digital signal processing (DSP) settings, such as the equalizer (EQ), according to the analysis results to compensate for the gain of specific frequencies until all frequency bands are within the critical line, completing the calibration. Through automatic calibration, even users without professional acoustic knowledge can enjoy optimized sound quality.

[0068] See also Figure 2 : is a schematic diagram comparing the standard curve (i.e., reference audio information) and the measured value in the vehicle (i.e., directional audio information) of this embodiment. Based on the technical concept of step S13, its purpose is to achieve the goal of bringing the measured value in the vehicle closer to the standard curve, so as to use the adjustment parameter closest to the standard curve as the target adjustment parameter, and perform sound effect adjustment control based on the target adjustment parameter. Figure 2 For example, the low-frequency measured data of the measured value in the car is higher than the data of the standard curve, and the high-frequency measured data of the measured value in the car is lower than the data of the standard curve. By adjusting the parameters of the device speakers of the entertainment equipment, the low-frequency measured data is reduced to close to the standard curve, and the high-frequency measured data is increased to close to the standard curve. In this way, the frequency band that exceeds the critical line is automatically compensated until it is within the critical line and the calibration is completed. Therefore, this example realizes automatic compensation of the frequency band that exceeds the critical line until it is within the critical line and the calibration is completed.

[0069] In one embodiment, the method provided in this embodiment (for example, before step S11 or after step S13) may further include: predicting inertial characteristics in response to changes in the vehicle's operating state, the inertial characteristics including the direction of the inertial force and / or the inertial force; adjusting the magnetic force between the base and the levitable component according to the inertial characteristics to maintain the relative spatial position relationship between the base and the levitable component. In this way, the technical solution of this embodiment can monitor and predict the vehicle's operating state, and when the vehicle's operating state changes, the magnetic force between the base and the levitable component can be adjusted to overcome the inertial force during driving, thereby preventing the levitable component from detaching from the base or flying out due to the magnetic attraction generated by the base, affecting driving safety and property safety.

[0070] In one embodiment, in response to the change of the vehicle running state, before the step of predicting the inertial characteristics, it can include: obtaining the current driving information of the vehicle, the current driving information can include at least one of the motor current, motor speed, accelerator pedal opening, brake pedal opening, vehicle speed, steering wheel angle, etc.; when the current driving information of the vehicle is different from the driving information at the previous moment, predicting the current vehicle running state, the current vehicle running state can include at least one of the acceleration state, deceleration state, left turn state, right turn state, etc.; when the current vehicle running state is different from the vehicle running state at the previous moment, determining that the vehicle running state has changed. In this way, the technical solution of this embodiment can predict whether the vehicle running state is about to change based on the acquired vehicle driving information, so that when the vehicle running state is about to change, the magnetic attraction between the base and the levitable component can be timely enhanced to overcome the inertial force during driving.

[0071] In one embodiment, see Figure 3 The base includes an electromagnetic conversion component, which includes at least one electromagnet coil, wherein the electromagnet coil includes a first end m1 and a second end m2, wherein the first end m1 and the second end m2 can be connected to a power supply system. A magnet component ( Figure 3 not shown).

[0072] In one embodiment, the step of enhancing the magnetic attraction between the base and the levitable component according to the inertial characteristics to maintain the relative spatial position relationship between the base and the levitable component may include: determining the control current information of the electromagnet coil according to the inertial characteristics, the control current information may include at least one of the current direction, current magnitude, etc.; and controlling the power supply of at least one electromagnet coil according to the control current information to maintain the relative spatial position relationship between the base and the levitable component.

[0073] In one embodiment, the first end m1 and the second end m2 of an electromagnet coil can determine the connection relationship between the first end m1 and the second end m2 and the positive and negative poles according to the control current information, so that the electromagnet coil has N and S poles, for example, the first end m1 corresponds to the N pole, and the second end m2 corresponds to the S pole; or the first end m1 corresponds to the S pole, and the second end m2 corresponds to the N pole.

[0074] In one embodiment, when the suspendable component is in a non-suspended state (or idle state), the first end m1 is connected to the positive electrode and the second end m2 is connected to the negative electrode, or the first end m1 is connected to the negative electrode and the second end m2 is connected to the positive electrode, or both the first end m1 and the second end m2 are not powered.

[0075] Based on the above technical principles, the following examples illustrate the forces acting on the suspended components in different scenarios: Wherein, the levitable component includes a magnet component, and the magnet component includes a plurality of magnets; (1) Vehicle stationary scene: See also Figure 4 The electromagnetic conversion component of the base includes a plurality of electromagnet coils, which are energized respectively, so that the lower end of each electromagnet coil is an S pole and the upper end is an N pole, and the upper end of each electromagnet coil is close to the N pole of the magnet in the levitable component, so that the levitable component is repelled by the repulsive force (for example , Under the action of the electromagnetic coils, the levitable component is suspended above the base; one implementation method may be that the combined force of the repulsive force of each electromagnet coil on the magnet in the levitable component is equal to the gravity of the levitable component ( ), and the direction of this force is opposite to that of gravity.

[0076] (2) Vehicle acceleration scenario: See also Figure 5 The electromagnetic conversion component of the base includes a plurality of electromagnet coils, and the plurality of electromagnet coils are energized respectively, so that the lower end of each electromagnet coil is an S pole and the upper end is an N pole, and the upper end of each electromagnet coil is close to the N pole of the magnet in the levitable component, so that the levitable component is suspended above the base under the action of the repulsive force; The vehicle accelerates in a first direction at an acceleration a. At this time, the inertial direction in the inertial characteristic is a second direction opposite to the first direction. Therefore, the resultant force of the repulsive force of each electromagnet coil on the magnet in the levitable component needs to be inclined toward the first direction to overcome the inertial force toward the second direction. Among them, the resultant force inclined toward the first direction can be decomposed into an acceleration force toward the first direction. And vertical upward suspension support Among them, the acceleration force =ma (m is the weight of the suspendable component), where the suspension support force is equal to the gravity of the suspendable component ( = ).

[0077] It should be understood that the vehicle deceleration scenario, the vehicle left turn scenario, and the vehicle right turn scenario are the same as the aforementioned vehicle acceleration scenario and will not be repeated here.

[0078] (3) Vehicle bumping scene (upward, downward): The electromagnetic conversion component of the base includes a plurality of electromagnet coils, and the plurality of electromagnet coils are energized respectively, so that the lower end of each electromagnet coil is an S pole and the upper end is an N pole, and the upper end of each electromagnet coil is close to the N pole of the magnet in the levitable component, so that the levitable component is suspended above the base under the action of the repulsive force; The magnetic direction and size of each electromagnet coil are changed so that the combined force of the repulsive force between the levitable component and the base overcomes gravity and inertia.

[0079] In one implementation, the method provided in this embodiment (for example, before step S11) may also include: in response to the installation configuration of the entertainment device, controlling the in-vehicle speaker corresponding to a preset in-vehicle position to make sound, the in-vehicle speaker being included in the in-vehicle audio system; performing sound collection analysis through the device microphone and the in-vehicle microphone to determine the in-vehicle installation position information of the entertainment device; and forming a microphone array based on the device microphone and the in-vehicle microphone. Thus, when the entertainment device in the technical solution of this embodiment is installed, it can locate itself according to the sound of the speakers in the car to determine the installation position information in the car, which is convenient for subsequent use; in addition, the entertainment device in the technical solution of this embodiment can form a microphone array with its own device microphone and the microphone in the car, which has at least the following advantages: (1) Improving the accuracy of speech recognition: Through beamforming technology, the microphone array can focus on picking up sounds in a specific direction and suppress noise in other directions, so as to accurately recognize the driver's voice commands in a noisy car environment; (2) Enhancing the ability to locate the sound source: The microphone array can accurately calculate the angle and distance between the sound source and the array based on the time difference of the sound arrival, so as to locate and track the target sound source; (3) Reducing noise interference: Using the spatial filtering characteristics of the microphone array, a beamforming pattern is formed in the direction of the target speaker. The acoustic beam only picks up the signal of the beam and suppresses the noise and reverberation outside the beam. At the same time, the echo cancellation technology is used to filter out the sound emitted by the audio device, making the user voice obtained by the voice recognition engine clearer and purer; (4) Adapt to various driving environments: Even when the vehicle speed is high or the environment outside the vehicle is noisy, it can maintain a high voice recognition accuracy and real-time performance; (5) Optimize the quality of in-car communication: By reducing echo and noise and adjusting gain and frequency balance, ensure that the voices of passengers in the car can be clearly heard through the car hands-free system; (6) Realize sound source signal extraction or separation: Extract the target signal from multiple sound signals to improve the clarity and intelligibility of the voice signal; (7) Enhance anti-interference ability: Through algorithm control, the microphone array can point the beam to the current speaker after searching for the speaker's position, significantly reducing the impact of surrounding environmental noise and echo.

[0080] In one implementation, the in-vehicle speaker corresponding to the preset in-vehicle position may be an in-vehicle speaker located in the middle of the vehicle cabin.

[0081] In one implementation, the in-vehicle speakers may represent speakers built into a vehicle and located at different locations in the vehicle.

[0082] In one implementation, the method provided in this embodiment may further include: determining the target angle of the sound source position of the interactive voice relative to the entertainment device based on the interactive voice received by the microphone array and the in-vehicle installation position information; controlling the interactive surface of the levitable component to face the sound source position based on the target angle, and performing voice broadcasting. In this way, the technical solution of this embodiment locates the user of voice interaction through the microphone array formed by the device microphone of the entertainment device and the microphone in the car, thereby controlling the interactive surface of the entertainment device to face the user for interaction.

[0083] In one embodiment, the interactive surface may represent the front side of the entertainment device or the side having a display screen.

[0084] Based on the above technical concept, see Figure 6 The following example shows a scenario of voice interaction based on a microphone array for reference: (1) When the passenger wakes up the in-vehicle voice, the voice command (i.e., interactive voice, sound signal) issued by the passenger is recognized by the vehicle's four built-in microphones (MIC1, MIC2, MIC3, and MIC4). The sound source position (human mouth) is located based on the difference in sound energy (Lp1-Lp2=20Lg(r2 / r1)) and phase (the time difference between the sound reaching each microphone in the vehicle) recognized by the four microphones in the vehicle, so as to locate the position of the human head; Optionally, the formula Lp1-Lp2=20Lg(r2 / r1) is used to calculate the difference in sound energy received by each in-car microphone and its adjacent in-car microphone, wherein Lp1 represents the sound pressure level of the sound source transmitted to the in-car microphone, Lp2 represents the sound pressure level of the sound source transmitted to the adjacent in-car microphone of the in-car microphone, r1 represents the distance from the in-car microphone to the sound source, and r2 represents the distance from the adjacent in-car microphone to the sound source.

[0085] (2) The microphone MIC5 of the entertainment device (such as a floating speaker) compares the sound information picked up by the four microphones in the car to confirm its own position (the floating speaker) relative to the sound source (the human head), and can also confirm its own position in the car; thus, the entertainment device (such as a floating speaker) can determine the position of the sound source (the human head) of the voice command relative to its own target angle, and control the interactive surface of the floating component of the entertainment device to face the position of the sound source (the human head) according to the target angle, and perform voice broadcast.

[0086] In one embodiment, after the step of controlling the interactive surface of the levitable component to face the sound source according to the angle and performing the voice broadcast, the method further includes: in response to the end of the voice broadcast, controlling the levitable component to rotate to the initial angle. In this way, the technical solution of this embodiment can make the levitable component reset after the interaction is completed, thereby improving the interactive experience.

[0087] In one embodiment, at least two laser distance measuring components may be provided at the bottom of the levitable component; and the base may further include a spiral component.

[0088] In one embodiment, one of the two laser ranging components is used to align and measure the distance with the center of the spiral component to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the first ranging information to maintain the relative spatial position relationship between the base and the suspendable component; wherein the other of the two laser ranging components is used to align and measure the distance with the thread of the spiral component to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the second ranging information and the target angle, so that the interaction surface of the suspendable component rotates to the target angle.

[0089] The control method provided in this embodiment is applied to entertainment equipment, including: step S11: in response to playing sound information, playing sweep frequency sound in coordination with the in-car audio system; step S12: determining the sound receiving direction according to the acquired position information of the target person, and performing sound receiving control for the sound receiving direction to obtain directional audio information; step S13: performing sound effect adjustment control according to the directional audio information and the reference audio information, so as to adjust the audio playing parameters of the entertainment equipment when playing sound information according to the sound receiving direction. Through the technical solution of this embodiment, when the vehicle plays sound information, it is possible to perform directional sound receiving for the in-car position of the driver and passenger to obtain directional audio information, so as to compare the directional audio information with the reference audio information representing the optimal listening effect, and adjust the audio playing parameters of the entertainment equipment when playing sound information according to the comparison result, so as to adaptively compensate the sound effect when playing sound information at the corresponding position, complete the coordinated sounding with the speaker of the vehicle, improve the listening effect at the designated position, and realize the improvement of the listening effect of the driver and passenger. Therefore, the technical solution of this embodiment can improve the in-car listening effect of the driver and passenger, thereby improving the user experience.

[0090] Based on the technical concept of the aforementioned technical solution, this embodiment can adapt the entertainment device to the vehicle and realize enhanced interaction; in addition, this embodiment can also realize the angle change of the levitable component of the entertainment device (for example, 180° rotation), and when the passenger controls the vehicle through voice commands, the levitable component of the entertainment device will have corresponding feedback. In this embodiment, the levitable component of the entertainment device can be oriented toward the passenger using voice. Specifically, the levitable component can adopt a magnet array structure, and the base is a coil array. The microphone array composed of the device microphone of the levitable component and the in-car microphone of the car audio can be used to calibrate the position of the entertainment device in the car at this time, and clarify the position of the entertainment device relative to the passenger. At this time, when the passenger uses voice commands, the relative position coordinates of the passenger and the entertainment device can be obtained by the entertainment device, and then based on the relative position coordinates, the base electromagnet coil can be controlled to generate magnetic force, so that the levitable box component can make interactive actions such as facing the passenger.

[0091] Based on the technical concept of the aforementioned technical solution, the present embodiment can also adapt to the vehicle's motion state, so that when the vehicle is in motion states such as acceleration, deceleration, and turning, the entertainment device can stabilize the floating components, ensuring that the entertainment device can be used in multiple scenarios in the vehicle. At the same time, the entertainment device also has the ability to adaptively enhance the in-vehicle sound effects, and can automatically calibrate and match the entire vehicle sound field according to the placement position, thereby improving the listening effect at a specified position.

[0092] The entertainment device in this embodiment may include a magnetic calibration module, a magnetic module, a sound module, a signal transmission module, a sound calibration module, and a position calibration module. The magnetic suspension audio is controlled by the vehicle computer signal, and the position to be placed is freely selected according to the user's needs, thereby improving the interaction between the audio and the passengers and actively enhancing the audio effect of the designated position.

[0093] Based on the same inventive concept as the above embodiments, the present application embodiment provides an entertainment device, such as Figure 7 As shown, the device includes: a processor 310 and a memory 311 storing a computer program; wherein, Figure 7 The processor 310 shown in the figure is not used to indicate that the number of the processor 310 is one, but is only used to indicate the positional relationship of the processor 310 relative to other devices. In actual applications, the number of the processor 310 may be one or more; similarly, Figure 7 The memory 311 shown in the figure has the same meaning, that is, it is only used to refer to the position relationship of the memory 311 relative to other devices. In practical applications, the number of memories 311 can be one or more. When the processor 310 runs the computer program, the steps of the control method applied to the above device are implemented.

[0094] The device may also include: at least one network interface 312. The various components in the device are coupled together via a bus system 313. It is understood that the bus system 313 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 313 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Figure 7 Various buses are labeled as bus system 313.

[0095] The memory 311 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAMbus random access memory (DRRAM, Direct Rambus Random Access Memory).The memory 311 described in the embodiments of the present application is intended to include but is not limited to these and any other suitable types of memories.

[0096] The memory 311 in the embodiment of the present application is used to store various types of data to support the operation of the device. Examples of these data include: any computer program used to operate on the device, such as an operating system and an application program. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and handle hardware-based tasks. The application program may include various applications, such as a media player (MediaPlayer), a browser (Browser), etc., which are used to implement various application services. Here, the program that implements the steps of the control method of the embodiment of the present application may be included in the application program.

[0097] In one embodiment, the entertainment device further includes a base and a suspendable component.

[0098] In one embodiment, a magnet assembly and at least two laser distance measuring assemblies are disposed at the bottom of the levitable assembly, wherein the laser distance measuring assemblies may include a laser transmitter and a photosensitive sensor.

[0099] In one embodiment, the base includes a spiral component and an electromagnetic conversion component, wherein the electromagnetic conversion component may include a plurality of electromagnet coils.

[0100] In one embodiment, the electromagnetic conversion component and the magnet component enable the base to maintain the suspended state or non-suspended state of the levitable component under the action of magnetic force.

[0101] See also Figure 8 This embodiment illustrates the bottom configuration of a levitable component and the main configuration of the base. The levitable component may include multiple magnets (each magnet has the same magnetic properties), two laser emitters and a photosensitive sensor; multiple coils (i.e., electromagnet coils) are arranged on the periphery of the base, a fixed tray of the levitable component is arranged at the center of the base, and a threaded coil (i.e., a spiral component, used to cooperate with the laser distance measuring component to measure distance) is arranged in the fixed tray, wherein the center point of the threaded coil is a plane and the surroundings are gradually tilted, so that the laser distance measuring component maps different distance information at different positions around the spiral coil. See Fig. 9 A light-transmitting cover plate may be provided above the spiral coil to prevent foreign matter from blocking the thread and affecting the laser ranging of the laser ranging assembly.

[0102] In one embodiment, one of the two laser ranging components is used to align with the center of the threaded coil and measure the distance to obtain first ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the first ranging information to maintain the relative spatial position relationship between the base and the suspendable component.

[0103] In one embodiment, the other of the two laser ranging components is used to align with and measure the distance of the thread of the threaded coil to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the second ranging information and the target angle, so that the interaction surface of the levitable component rotates to the target angle.

[0104] In one embodiment, the structural matching relationship between the levitable component and the base of the entertainment device includes: (1) The suspended component can be placed on a fixed tray (inserted) when not in use. For details, refer to Figure 8 , through size matching (the length of the bottom of the levitable component is a, the width is b, the distance between the two laser emitters is c, the length of the fixed tray in the base is a, the width is b, and the distance from the center to the edge of the spiral coil is c) and magnetic attraction; (2) The laser transmitter t1 at the center of the levitable component is responsible for locating the levitable component and the fixed tray of the base. When the laser distance measurement at the center changes by more than the distance threshold e, it is considered that the levitable component deviates from the center of the fixed tray. The levitable component needs to be moved and corrected to the center of the fixed tray. The basic method is to energize the electromagnetic conversion component of the corresponding base to generate magnetic force to restore it to the center of the fixed tray. (3) The laser transmitter t2 near one side is responsible for triggering the angle detection of the levitable component relative to the fixed tray. The edge of the spiral coil corresponding to the laser transmitter t2 is spiral-shaped. When the levitable component rotates, the corresponding laser ranging distance will also change. In order to avoid misleading results due to the distance change caused by the tilt of the levitable component, the height difference at different positions on the spiral edge needs to be calculated to control the magnetic force and prevent the levitable component from tilting. (4) When the entertainment device is in use, the electromagnetic conversion component in the fixed tray is energized to generate magnetic force to lift the levitable component, and the height is controlled by the distance obtained by the laser ranging component corresponding to the laser transmitter t1 (similarly, when not in use, the levitable component is placed on the fixed tray); (5) A device microphone is provided on the top of the levitable component. After the base position of the entertainment device is fixed, the built-in in-car speaker (a speaker at a position in the car is selected by parameters) makes a sound. The in-car position information of the entertainment device is confirmed based on the energy difference between the in-car microphone and the device microphone of the levitable component. The entertainment device cooperates with the in-car microphone to form a microphone array and beamforming technology to identify the angle of the sender of the voice command relative to the entertainment device. When the sender of the voice command uses the entertainment device to replace the voice broadcast of the car computer, the entertainment device faces the user and, after completing the voice broadcast, returns to the initial position based on the distance obtained by the laser ranging component corresponding to the laser transmitter t2.

[0105] The entertainment device provided in this embodiment can simply, conveniently and at low cost realize the rotation and angular positioning of the levitable component in a suspended state or a non-suspended state through a magnet component and at least two laser ranging components arranged at the bottom of the levitable component, and a spiral component and an electromagnetic conversion component arranged at the base.

[0106] An embodiment of the present application provides a vehicle, which is equipped with the entertainment device described above.

[0107] Based on the same inventive concept as the above-mentioned embodiment, this embodiment further provides a computer-readable storage medium, in which a computer program is stored. The computer-readable storage medium may be a ferromagnetic random access memory (FRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); it may also be various devices including one or any combination of the above-mentioned memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, etc. When the computer program stored in the computer-readable storage medium is executed by the processor, the above-mentioned method is implemented. For the specific steps implemented when the computer program is executed by the processor, please refer to Figure 1 The description of the illustrated embodiment will not be repeated here.

[0108] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0109] In this document, the terms "comprises," "comprising," or any other variations thereof, are intended to cover a non-exclusive inclusion of elements other than those listed and may also include additional elements not expressly listed.

[0110] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A control method, characterized in that: Applied to entertainment equipment, including: In response to the playing sound information, playing the sweeping frequency sound in cooperation with the in-vehicle audio system; Determine the sound receiving direction according to the acquired position information of the target person, and perform sound receiving control for the sound receiving direction to obtain directional audio information; Sound effect adjustment control is performed according to the directional audio information and the reference audio information, so as to adjust the audio playing parameters of the entertainment device when playing the sound information according to the sound receiving direction.

2. The method according to claim 1, characterized in that: The entertainment device comprises a base and a suspendable component; and / or, At least one of the base and the levitable component is provided with a photographing device; and / or, At least one of the base and the levitable component is provided with a device microphone; and / or, At least one of the base and the levitable component is provided with a device speaker.

3. The method according to claim 2, characterized in that The device microphone is an extendable microphone; The step of determining the sound receiving direction according to the acquired in-vehicle position information of the target person, and performing sound receiving control for the sound receiving direction to obtain directional audio information includes: Acquiring in-vehicle environment information through the photographing device; Acquiring ear position information of the target person according to the in-vehicle environment information; Determining the sound receiving direction according to the human ear position information; The extendable microphone is controlled to extend toward the sound collection direction and collect sound, so as to obtain the directional audio information.

4. The method according to claim 3, characterized in that The step of obtaining the ear position information of the target person according to the in-vehicle environment information includes: When there is a driver or passenger who meets the preset conditions in the in-vehicle environment information, the driver or passenger is used as the target person; The driver and passenger who meet the preset conditions include at least one of the following: The only occupant of the vehicle; Pre-set drivers and passengers; There are passengers who perform interactive actions corresponding to the sound information.

5. The method according to claim 2, characterized in that: Also includes: In response to a change in the operating state of the vehicle, predicting an inertial characteristic, the inertial characteristic including an inertial force direction and / or an inertial force; The magnetic force between the base and the levitable component is adjusted according to the inertial characteristic to maintain a relative spatial position relationship between the base and the levitable component.

6. The method according to claim 2, characterized in that Also includes: In response to the installation configuration of the entertainment device, controlling an in-vehicle speaker corresponding to a preset in-vehicle position to emit sound, the in-vehicle speaker being included in the in-vehicle audio system; Performing sound analysis through the device microphone and the in-car microphone to determine the in-car installation location information of the entertainment device; The device microphone and the in-car microphone form a microphone array; Determining a target angle of a sound source position of the interactive speech relative to the entertainment device according to the interactive speech received by the microphone array and the in-vehicle installation position information; The interactive surface of the levitable component is controlled to face the sound source position according to the target angle, and voice broadcast is performed.

7. The method according to claim 6, characterized in that After the step of controlling the interaction surface of the levitable component to face the sound source position according to the angle and performing voice broadcast, the method further comprises: In response to the end of the voice broadcast, the levitable component is controlled to rotate to an initial angle.

8. An entertainment device, characterized in that: Steps for implementing the control method according to any one of claims 1 to 7.

9. The entertainment device according to claim 8, characterized in that Also includes a base and a levitable component; A magnet assembly and at least two laser distance measuring assemblies are arranged at the bottom of the levitable assembly; The base includes a spiral component and an electromagnetic conversion component; Wherein, under the action of magnetic force, the electromagnetic conversion component and the magnet component enable the base to maintain the suspended state or non-suspended state of the suspendable component; Wherein, one of the two laser distance measuring components is used to align with the center of the spiral component and measure the distance to obtain first distance measuring information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the first distance measuring information to maintain the relative spatial position relationship between the base and the levitable component; Among them, the other of the two laser ranging components is used to align and measure the distance with the thread of the spiral component to obtain second ranging information, and the processor controls the electromagnetic conversion component to generate magnetic force according to the second ranging information and the target angle, so that the interaction surface of the levitable component rotates to the target angle.

10. A vehicle, characterized in that: The vehicle is equipped with the entertainment device according to claim 8 or claim 9.

11. A computer-readable storage medium, characterized in that: A computer program is stored, and when the computer program is executed by a processor, the steps of the control method according to any one of claims 1 to 7 are implemented.

Images