Lifting type vehicle-mounted interaction device and method, electronic equipment and medium

Abstract

The invention relates to the field of vehicle interaction, in particular to a lifting type vehicle-mounted interaction device and method, electronic equipment and a medium. The device comprises a motion module which comprises a motor and a transmission mechanism, and the motion module controls the device to ascend and descend in the vertical direction and / or rotate in the horizontal direction based on a control instruction of a processing module; the information acquisition module is in communication connection with the processing module and is used for acquiring information in the vehicle, and the information acquisition module comprises a plurality of audio acquisition units arranged at different positions and is used for acquiring sound information in the vehicle; the output module is used for outputting multimedia information to a user, and the multimedia information at least comprises audio information; and the processing module sends a control instruction to the motion module based on the sound information, so that the output module outputs the multimedia information to the target user.

Description

Technical Field

[0001] This disclosure relates to the field of vehicle interaction, and more specifically, to a liftable in-vehicle interaction device, method, electronic device, and medium. Background Technology

[0002] With the development of automotive intelligent technology, in-vehicle interactive systems have become an important component for enhancing the driving and riding experience. Currently, devices used for information interaction and entertainment output in vehicles, such as speakers, are typically fixedly installed in specific locations such as the dashboard and door panels. This fixed installation method means that the physical orientation and sound field direction of the devices cannot be changed. In actual use, whether the driver or the front passenger wants to obtain the best audio listening experience, the system cannot identify and respond to the user's location, let alone adjust its physical position to face the current target user.

[0003] Therefore, the core problem facing existing technologies lies in the contradiction between the static attributes of in-vehicle interactive devices and the dynamic changes in the user's position. This results in a lack of spatial directionality in the interaction process and an inability to focus the audio output, significantly reducing the accuracy and immersion of voice interaction, and ultimately affecting the overall integrity and user-friendliness of the smart cockpit interactive experience. Summary of the Invention

[0004] One objective of this disclosure is to provide a liftable in-vehicle interaction device that improves the specificity and scenario adaptability of human-computer interaction in an in-vehicle environment.

[0005] According to a first aspect of this disclosure, a liftable in-vehicle interactive device is provided, comprising: The motion module includes a motor and a transmission mechanism, which, based on control commands from the processing module, controls the device to lift and / or rotate in the horizontal direction. An information acquisition module, which is communicatively connected to the processing module, is used to acquire in-vehicle information. The information acquisition module includes multiple audio acquisition units with different settings, used to acquire in-vehicle sound information. An output module, the output module being used to output multimedia information to a user, the multimedia information including at least audio information; The processing module sends control commands to the motion module based on the sound information, so that the output module outputs multimedia information to the target user.

[0006] According to a second aspect of this disclosure, a control method based on a liftable in-vehicle interactive device is provided, the method comprising: The device acquires in-vehicle audio information through its information acquisition module, which includes multiple audio acquisition units located at different positions. Based on the sound information, control commands are generated; Based on the control commands, the device is controlled to move up and down in the vertical direction and rotate in the horizontal direction to output multimedia information to the target user; wherein the multimedia information includes at least audio information.

[0007] According to a third aspect of this disclosure, an electronic device is provided, including a processor and a memory, wherein the memory stores computer instructions that, when executed by the processor, implement the method described in the second aspect.

[0008] According to a fourth aspect of this disclosure, a storage medium is provided that stores computer instructions thereon, which, when executed by a processor, implement the method described in the second aspect.

[0009] One technical advantage of this disclosure is that it provides a liftable in-vehicle interactive device. Through the coordinated operation of a motion module, an information acquisition module, and a processing module, it effectively solves the problem of lack of spatial directionality in traditional in-vehicle interactive devices due to fixed installation. In real-world scenarios where the user's position inside the vehicle changes dynamically, the device can use sound information collected by multiple audio acquisition units. The processing module identifies the target user and generates control commands, driving the motion module to lift the output module vertically and rotate it horizontally, allowing it to dynamically adjust its spatial orientation to align with the target user. Compared to traditional statically installed interactive devices, this invention not only achieves spatial orientation of the interaction process and audio output but also significantly improves the accuracy of voice interaction and the targeting of audio propagation through a dynamic adjustment mechanism of physical motion, fundamentally improving the exclusivity and scenario adaptability of human-computer interaction in the in-vehicle environment.

[0010] Other features and advantages of the embodiments of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0011] The accompanying drawings, which form part of this specification, illustrate embodiments of the present disclosure and, together with the specification, serve to explain the principles of the embodiments of the present disclosure.

[0012] Figure 1 This is a schematic diagram of a liftable in-vehicle interactive device according to one embodiment; Figure 2 This is a flowchart of a control method based on a liftable in-vehicle interactive device according to one embodiment; Figure 3 This is a schematic diagram of an electronic device according to one embodiment. Detailed Implementation

[0013] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0014] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0015] Technologies and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such technologies and equipment should be considered part of the specification.

[0016] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0017] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0018] It should be noted that all actions related to the collection, storage, use, processing, transmission, provision, disclosure, and deletion of data in this disclosure are carried out in accordance with local data protection regulations and with the full authorization of the relevant data owners.

[0019] This application discloses a liftable in-vehicle interactive device 100, such as... Figure 1 As shown, the system includes a motion module 101, which includes a motor and a transmission mechanism. Based on control commands from the processing module, the motion module controls the device to lift vertically and / or rotate horizontally. An information acquisition module 102, communicatively connected to the processing module, is used to acquire in-vehicle information. The information acquisition module includes multiple audio acquisition units at different locations to acquire in-vehicle sound information. An output module 103 is used to output multimedia information to the user, including at least audio information. A processing module 104, based on the sound information, sends control commands to the motion module, causing the output module to output multimedia information to the target user.

[0020] In one example, a retractable in-vehicle interactive device can be embodied in a height-adjustable and rotatable tweeter system within the car cabin. This device is installed on the surface of the vehicle's center console or in a suitable location, and its core function is to enable intelligent spatial interaction with the occupants through physical movement. In practical applications, this device integrates a tweeter unit, which serves as both the audio output carrier and the actuator for spatial movement. When the vehicle is started or the user wakes up the system, the tweeter, originally housed in the center console, is smoothly raised to a suitable height to play audio. Alternatively, the device can also integrate a display unit, providing multimedia capabilities such as displaying partial video content.

[0021] In this example, the motion module is the core component for adjusting the spatial attitude of the device. This module typically includes a motor and a precision transmission mechanism. The motor, as the power source, begins to rotate after receiving an electrical signal command from the processing module. The transmission mechanism is responsible for converting the motor's rotational motion into the required mechanical action, such as converting the rotational motion into linear lifting via a lead screw and nut assembly, or transmitting the rotation of the motor shaft to the horizontal rotating platform via a set of worm gears.

[0022] In practical applications, when the device's posture needs adjustment, the processing module sends a control signal to the motor drive circuit. The motor then starts, driving the entire support platform to move via the transmission mechanism. For example, when user interaction is required, the motor can first smoothly lift the speaker unit from its storage position to the working height above the operating interface via a lead screw mechanism. Then, it drives the rotating base via a worm gear system, causing the speaker unit's horizontal orientation to rotate from the default forward position, precisely aligning it with the driver's position. Throughout the entire movement, the transmission mechanism not only transmits power but also provides sufficient torque through an appropriate reduction ratio, ensuring the smoothness and precision of lifting and rotating actions. It also features a self-locking function to maintain a stable posture in any position.

[0023] In this example, the information acquisition module is primarily responsible for collecting environmental information related to interaction within the vehicle. This module maintains a real-time data connection with the processing module via wired or wireless communication. It comprises multiple audio acquisition units positioned in different physical locations, typically employing high-sensitivity microphone arrays. These microphones are strategically mounted on the device or in specific locations within the vehicle; this spatial distribution design allows each microphone to capture sound wave signals of varying intensities and phases. When a voice command is given within the vehicle, the microphones in each location simultaneously acquire the sound signal. Because sound waves take time to propagate, microphones closer to the sound source receive the signal first, while those farther away receive it slightly later. For example, when the driver issues the command "turn on the music," the microphone mounted on the driver's side will capture the sound a few milliseconds earlier than the microphone on the passenger side, and the sound intensity will also be significantly higher on the other side.

[0024] In this example, the output module could be a high-performance tweeter unit connected to the vehicle's head unit via a dedicated audio harness, receiving decoded digital audio signals and converting them into sound output. Alternatively, the output module could be a display screen.

[0025] In this embodiment, when the audio data from the information acquisition module arrives at the processing module, it first undergoes deep signal analysis. The processing module can preprocess the raw sound collected by multiple microphones, including noise reduction filtering and echo cancellation, to extract effective speech signals. Next, using a sound source localization algorithm, it accurately calculates the time difference and intensity difference of the sound reaching different microphones, thereby establishing a positional model of the sound within the vehicle's interior space.

[0026] In practice, the processing module can parse the semantic content of voice commands in real time. For example, when it recognizes a command like "turn towards me," the module immediately initiates a location determination process. By analyzing the input data from the microphone array, the system can accurately determine whether the sound source is located in the driver's or passenger's area. After determining the sound source's location, the processing module generates a corresponding sequence of control commands. These commands are sent to the motion module via a dedicated communication interface.

[0027] In one example of this embodiment, a control command is sent to the motion module based on sound information, including: determining the direction of sound source by comparing the arrival time difference of the same sound signal received by multiple audio acquisition units, the direction of source corresponding to the target user inside the vehicle; and generating a control command based on the direction of source to rotate the output module in the horizontal direction to face the target user.

[0028] In this example, when an occupant issues a voice command, two or more microphones located at different positions simultaneously receive the sound signal. Since sound waves take time to travel through the air, the microphone closer to the speaker receives the signal earlier than the microphone further away; this slight difference in time is called the time difference of arrival (TDOA). The specialized acoustic processor within the processing module performs cross-correlation analysis on these simultaneously acquired audio signals, precisely measuring this minute time difference by calculating the peak position of the cross-correlation function between the signals. Based on the speed of sound in the air, the system can further calculate the azimuth angle of the sound source relative to the microphone array. In practical applications, this calculation process comprehensively considers the characteristics of the in-vehicle acoustic environment, including the reflection effects of surfaces such as glass and seats, to ensure the accuracy of the positioning results.

[0029] After obtaining the direction of the sound source, the processing module maps it to specific spatial location information. For example, the system identifies sound sources within a 30-90 degree range to the left as the driver, and sound sources within the corresponding range to the right as the front passenger. This mapping relationship is pre-configured during system initialization based on the specific vehicle's cabin layout.

[0030] Based on this location determination, the processing module generates corresponding motion control commands. These commands, containing specific rotation angles and motion parameters, are sent to the motion module's motor controller via a digital communication interface. For example, when the sound is determined to originate from the passenger seat, the processing module calculates that the output module needs to be rotated approximately 60 degrees to the right from its current default position, generating a complete control command including the rotation direction, target angle, and speed. Upon receiving these commands, the motion module drives the motor to smoothly rotate the entire output module via a transmission mechanism. During rotation, the system continuously monitors feedback from the position sensors to ensure the final stopping position is precisely aligned with the target user. This intelligent steering mechanism based on sound source localization enables the system to achieve truly user-specific directional interaction, significantly improving the accuracy of voice interaction and the relevance of audio output.

[0031] In one example of this embodiment, the information acquisition module further includes an image acquisition unit for acquiring video information inside the vehicle; the processing module is further configured to: determine the location of the user who made the voice based on the video information acquired by the image acquisition unit; determine the target user by combining the source direction and the user's location; and generate a control command based on the determined target user and the recognized voice command to control the motion module to rotate the output module in the horizontal direction to face the target user.

[0032] In this example, the information acquisition module also includes an image acquisition unit, such as a camera integrated around the output module. When the audio acquisition unit detects a valid voice signal, the image acquisition unit simultaneously activates and captures a real-time view of the current in-vehicle scene. This video data is transmitted to the visual analysis unit of the processing module and processed by a pre-trained facial recognition algorithm. This algorithm first locates the face region in the image and then calculates its orientation angle based on the spatial distribution of facial feature points. For example, when a facial feature point is detected to be rotated approximately 15 degrees to the left, combined with the horizontal position of the face in the image, it can be determined that the person is in the driver's seat and facing the center console.

[0033] The processing module can process audio and video information in parallel. Assuming the front passenger issues a voice command, the acoustic positioning system will initially determine that the sound source is from the right side based on time-difference analysis of the microphone array. Simultaneously, the visual analysis system will identify the time synchronization between the lip-opening / closing motion of the face on the right side of the image and the voice signal. This multimodal cross-validation mechanism significantly improves the reliability of location determination.

[0034] In one example of this embodiment, the output module further includes a status indicator unit for indicating the working status of the device by generating a visually perceptible status signal; the processing module is further configured to: control the status indicator unit to display a corresponding display mode according to different working modes of the device; wherein the working modes include at least a normal standby mode, an instruction receiving mode, and a system abnormal mode, and the display mode corresponds one-to-one with the working mode.

[0035] In this example, the status indicator unit typically consists of a ring of LEDs that conveys the system's operating status through different colors, brightness variations, and dynamic effects. In normal standby mode, the ring displays a soft color and breathes slowly at a low frequency. When any microphone detects a valid wake-up word, the system immediately switches to command receiving mode. At this time, the ring color changes to another color and its brightness increases, visually indicating to the user that the system is ready to receive voice commands. When the system detects an internal anomaly, such as motor jamming, sensor malfunction, or communication interruption, the status indicator unit immediately activates an anomaly warning mode. The ring changes to a bright color, such as red; this high-contrast visual signal effectively attracts the attention of the occupants.

[0036] In one example of this embodiment, the device further includes a power management module, comprising: a power conversion unit connected to the vehicle power supply, used to convert the input voltage into the operating voltage required by the processing module, motion module, information acquisition module and output module; and a switch control unit disposed between the power conversion unit and the power supply link of at least one of the motion module, information acquisition module and output module, the switch control unit being communicatively connected to the processing module, used to switch the power supply link of the corresponding module on and off under the control of the processing module.

[0037] In this embodiment, the power conversion unit can be directly connected to the vehicle's electrical system. This unit employs a multi-output design, capable of simultaneously converting the vehicle's 12V power supply into various operating voltages required by the system. For example, the processing core requires a stable 3.3V voltage, the motor drive requires 5V, and the audio unit requires purified 12V audio power. These different voltage outputs are achieved through independent voltage regulation circuits, ensuring no interference between them and guaranteeing a clean and stable power supply to each subsystem. The switch control unit includes multiple switch circuits, each independently controlling the power supply to a functional module. In the actual configuration, the system provides independent power switches for the camera, steering motor, and each microphone.

[0038] In one example of this embodiment, the processing module is further configured to: after the device is initially powered on and completes self-test, control the motion module to perform a preset initialization action, causing the output module to move to the default working position; after the initialization action is completed, control the switch to control the subunit to cut off the power supply link of at least one audio acquisition unit in the motion module and the information acquisition module, while maintaining the power supply of the processing module and one audio acquisition unit in the information acquisition module used to receive the wake-up signal; when the audio acquisition unit in the powered state detects a valid wake-up signal, the processing module controls the switch to control the subunit to restore the cut-off power supply link, so that the system enters the full-function working mode.

[0039] In this example, the processing module is also used to execute the following low-power control process: after the device is initially powered on and completes its self-test, it controls the motion module to perform a preset initialization action, causing the output module to move to the default working position; after the initialization action is completed, the control switch control unit cuts off the power supply link of at least one audio acquisition unit in the motion module and the information acquisition module, while maintaining the power supply of the processing module and one audio acquisition unit in the information acquisition module used to receive the wake-up signal; when the audio acquisition unit in the powered state detects a valid wake-up signal, the processing module controls the control switch control unit to restore the cut-off power supply link, so that the system enters the full-function working mode.

[0040] In practical implementation, after the vehicle ignition system supplies power to the device, the processing module first executes a system self-test program to verify the functional integrity of each hardware unit. Upon successful self-test, the processing module immediately sends an initialization command to the motion module. The drive motor, through the transmission mechanism, lifts the output module from its storage position and rotates it to the standard working position facing the driver. After completing the initialization and positioning, the processing module immediately activates a low-power management mode. The power supply to multiple functional modules is sequentially cut off via the switch control unit: first, the motor drive power to the motion module is disconnected, keeping the transmission mechanism locked; then, the power supply to some audio acquisition units in the information acquisition module is disconnected, such as the microphone circuit on the passenger side; simultaneously, the processing module itself and the driver-side audio acquisition unit are continuously powered.

[0041] In this low-power state, the system maintains only the most basic voice wake-up function. The continuously powered driver-side audio acquisition unit remains active, constantly monitoring ambient sound signals and specifically recognizing the preset wake-up word. Other modules that are powered off completely cease operation, thereby significantly reducing system standby power consumption.

[0042] When the driver-side audio acquisition unit receives a valid wake-up signal, the processing module immediately initiates the power restoration procedure. The switch control unit reconnects the severed power supply links in a specific sequence: first, it restores full power to all audio acquisition units to ensure the integrity of the voice acquisition system; then, it reconnects the drive power to the motion module to prepare for possible steering maneuvers. At this point, all modules of the system have resumed power and enter full-function operation mode, capable of fully executing subsequent complex tasks such as voice recognition, orientation determination, and steering control.

[0043] In one example of this embodiment, the motion module further includes a position detection unit for real-time detection of the position of the output module; the processing module is further configured to: determine the target position of the output module according to voice commands; generate a control signal for the motor based on the current position and the target position; and adjust the control signal according to the real-time position feedback from the position detection unit during motor operation until the output module reaches the target position.

[0044] In this example, the motion module also includes a position detection unit for real-time detection of the output module's position. This unit typically employs a non-contact detection method, such as mounting a magnetic element on the motor output shaft and simultaneously placing a high-precision Hall sensor at a fixed location. When the motor drives the output module, the magnetic element rotates with the shaft, and the Hall sensor accurately calculates the rotation angle by sensing changes in the magnetic field, thereby determining the real-time spatial position of the output module. The processing module parses the target position information based on the content of the voice command. For example, when the command "turn to the passenger side" is recognized, the processing module retrieves the corresponding target angle value from a preset position mapping table. This value is accurate orientation data pre-calibrated based on the vehicle's cabin layout. The system compares the current position fed back by the position detection unit with this target position to calculate the specific angle and direction of rotation required.

[0045] Based on the difference between the current position and the target position, the processing module generates a corresponding motor control signal. This signal includes the precise rotation direction, target speed, and expected stopping position. After the motor starts running, the processing module continuously receives real-time position data from the position detection unit and dynamically adjusts the motor speed and direction through a closed-loop control algorithm. When the output module approaches the target position, the system automatically reduces the speed to achieve precise positioning, ultimately stopping the output module accurately at the preset target position.

[0046] This application also provides a control method based on a liftable in-vehicle interactive device, such as... Figure 2 As shown, it includes steps S11-S13; Step S11: Acquire in-vehicle sound information through the device's information acquisition module. The information acquisition module includes multiple audio acquisition units with different settings. Step S12: Generate control commands based on the sound information; Step S13: Based on control commands, the control device moves up and down in the vertical direction and rotates in the horizontal direction to output multimedia information to the target user; wherein, the multimedia information includes at least audio information.

[0047] Optionally, based on the sound information, control commands are generated, including: determining the direction of sound source by comparing the arrival time difference of the same sound signal received by multiple audio acquisition units, wherein the direction of source corresponds to the target user inside the vehicle; and generating control commands based on the direction of source.

[0048] Optionally, the information acquisition module further includes an image acquisition unit for acquiring video information inside the vehicle; generating control commands based on sound information, including determining the location of the user who made the voice based on the video information acquired by the image acquisition unit; determining the target user by combining the source direction and the user's location; and generating control commands based on the determined target user and the recognized voice command.

[0049] Optionally, the method further includes: according to different operating modes of the device, the control status indicator unit displays a corresponding display mode; wherein the operating modes include at least a normal standby mode, an instruction receiving mode, and a system abnormal mode, and the display mode corresponds one-to-one with the operating mode.

[0050] Optionally, the method further includes: after the device is initially powered on and completes its self-test, performing a preset initialization action to move the device to a default working position; after the initialization action is completed, disconnecting the power supply link of at least one audio acquisition unit in the motion module and information acquisition module of the device, while maintaining the power supply to one audio acquisition unit in the processing module and information acquisition module used to receive a wake-up signal; when the audio acquisition unit in the powered state detects a valid wake-up signal, the control switch controls the subunit to restore the disconnected power supply link, so that the system enters a full-function working mode.

[0051] Optionally, the method further includes: determining the target position based on a voice command; and generating a control signal for the motor based on the current position of the device and the target position.

[0052] like Figure 3 As shown, this application embodiment also provides an electronic device 200, including a processor 201 and a memory 202. The memory 202 stores computer instructions, which, when executed by the processor 201, implement any one of the control embodiments based on the lift-type vehicle interactive device.

[0053] This application also provides a storage medium storing computer instructions. When the computer instructions are executed by a processor, they implement any of the control embodiments based on the lifting vehicle interactive device described above and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0054] The various embodiments in this disclosure are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and apparatus embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0055] The foregoing has described specific embodiments of this disclosure. In some cases, the described actions or steps may be performed in a different order than those shown in the embodiments and the desired results may still be achieved. Furthermore, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0056] Embodiments of this disclosure may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of this disclosure.

[0057] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0058] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0059] Computer program instructions used to perform the operations of embodiments of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on a user's computer, partially on a user's computer, as a standalone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays, may execute the computer-readable program instructions to implement various aspects of embodiments of this disclosure by utilizing state information from the computer-readable program instructions.

[0060] Various aspects of embodiments of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0061] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0062] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0063] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are equivalent.

[0064] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A liftable in-vehicle interactive device, characterized in that, include: The motion module includes a motor and a transmission mechanism, which, based on control commands from the processing module, controls the device to lift and / or rotate in the horizontal direction. An information acquisition module, which is communicatively connected to the processing module, is used to acquire in-vehicle information. The information acquisition module includes multiple audio acquisition units with different settings, used to acquire in-vehicle sound information. An output module, the output module being used to output multimedia information to a user, the multimedia information including at least audio information; The processing module sends control commands to the motion module based on the sound information, so that the output module outputs multimedia information to the target user.

2. The apparatus according to claim 1, characterized in that, The step of sending control commands to the motion module based on the sound information includes: The direction of the sound source is determined by comparing the arrival time difference of the same sound signal received by the multiple audio acquisition units, and the direction of the sound source corresponds to the target user inside the vehicle. Based on the source direction, a control command is generated, which causes the output module to rotate horizontally via the motion module, so as to face the target user.

3. The apparatus according to claim 2, characterized in that, The information acquisition module also includes an image acquisition unit for acquiring video information inside the vehicle; The processing module is also used to: determine the location of the user who made the voice based on the video information acquired by the image acquisition unit; The target user is determined by combining the source direction with the user's location; Based on the identified target user and the recognized voice command, a control command is generated to control the motion module to rotate the output module in the horizontal direction so that it faces the target user.

4. The apparatus according to claim 1, characterized in that, The output module also includes a status indication unit, which is used to indicate the working status of the device by generating a visually perceptible status signal; The processing module is also used for: According to the different operating modes of the device, the status indicator unit is controlled to exhibit the corresponding display mode; The working modes include at least a normal standby mode, an instruction receiving mode, and a system abnormal mode, and the display modes correspond one-to-one with the working modes.

5. The apparatus according to any one of claims 1-4, further comprising a power management module, including: The power conversion unit is connected to the vehicle power supply and is used to convert the input voltage into the operating voltage required by the processing module, motion module, information acquisition module and output module. A switch control unit is disposed between the power conversion unit and the power supply link of at least one of the motion module, information acquisition module, and output module. The switch control unit is communicatively connected to the processing module and is used to switch the power supply link of the corresponding module on and off under the control of the processing module.

6. The apparatus according to claim 5, characterized in that, The processing module is also used for: After the device is initially powered on and completes its self-test, the motion module is controlled to perform a preset initialization action, causing the output module to move to the default working position. After the initialization action is completed, the switch control subunit is controlled to cut off the power supply link of at least one audio acquisition unit in the motion module and the information acquisition module, while maintaining the power supply of the processing module and one audio acquisition unit in the information acquisition module used to receive the wake-up signal. When the audio acquisition unit, which is in a powered state, detects a valid wake-up signal, the processing module controls the switch control subunit to restore the disconnected power supply link, enabling the system to enter a full-function working mode.

7. The apparatus according to claim 1, characterized in that, The motion module further includes a position detection unit for real-time detection of the position of the output module; the processing module is also used for: The target position of the output module is determined according to the voice command; Based on the current position of the output module and the target position, a control signal for the motor is generated; During the operation of the motor, the control signal is adjusted according to the real-time position feedback from the position detection unit until the output module reaches the target position.

8. A control method based on a liftable in-vehicle interactive device, characterized in that, The method includes: The device acquires in-vehicle audio information through its information acquisition module, which includes multiple audio acquisition units located at different positions. Based on the sound information, control commands are generated; Based on the control commands, the device is controlled to move up and down in the vertical direction and rotate in the horizontal direction to output multimedia information to the target user; wherein the multimedia information includes at least audio information.

9. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores computer instructions that, when executed by the processor, implement the method of any one of claims 8.

10. A storage medium, characterized in that, It stores computer instructions that, when executed by a processor, implement the method described in any one of claims 8.

Images