Vehicle-mounted multimedia interaction method and device, vehicle and storage medium

Abstract

The invention provides a vehicle-mounted multimedia interaction method and device, a vehicle and a storage medium, and the method comprises the following steps: S1, receiving real-time state information in real time through an air conditioner, a temperature sensor and a multimedia host; in the step S2, the real-time state information is purely transmitted to the cloud, and the cloud generates push event information; in the step S3, the push event information generated by the cloud is pushed to the multifunctional steering wheel, and the push event information received by the multifunctional steering wheel is accepted or rejected by a vehicle user; if the user receives the push event information, a control instruction is generated, and the step S4 is executed; in the step S4, the control instruction is distributed to the air conditioner and / or the multimedia host, and the control instruction is executed. According to the invention, the interaction efficiency and security of the vehicle-mounted multimedia system are significantly improved through real-time data acquisition, cloud pushing, simplified interaction confirmation and the like.

Description

Technical Field

[0001] The present invention relates to the automotive field, and in particular to an in-vehicle multimedia interaction method, device, vehicle and storage medium. Background Art

[0002] With the development of intelligent automobiles, the human-computer interaction methods of in-vehicle multimedia systems are becoming increasingly diversified. Currently, function activation and operation mainly rely on physical buttons, touch screens, and voice recognition technologies.

[0003] However, existing interaction methods have significant flaws in vehicle driving scenarios: when the driver operates physical buttons or touch screens while driving, they need to divert their visual attention and shift their hand control direction, resulting in a decreased perception of the driving environment and a significant increase in driving safety risks. Although voice interaction can reduce driver distraction, it is affected by factors such as environmental noise, user pronunciation differences, and dialects, and the recognition accuracy is difficult to guarantee stably. In particular, in complex acoustic scenarios, the problem of commands being falsely triggered or misrecognized is prominent, resulting in low interaction efficiency and poor user experience. Therefore, it is urgent to develop a new human-computer interaction solution that can balance operational intuitiveness and system response reliability while ensuring driving safety. Summary of the Invention

[0004] In response to the defects in the prior art, the purpose of the present invention is to provide an in-vehicle multimedia interaction method, device, vehicle and storage medium, aiming to significantly improve the interaction efficiency and security of the in-vehicle multimedia system through real-time data collection, cloud push, simplified interaction confirmation and other means.

[0005] In order to achieve the above-mentioned object of the invention, the present invention adopts the following technical solution:

[0006] According to a first aspect of the present invention, there is provided a vehicle-mounted multimedia interactive method, comprising the following steps:

[0007] In step S1, real-time status information is received through the air conditioner, temperature sensor, and multimedia host; the real-time status information includes air conditioner operation information, temperature information, multimedia operation status information, and user identity information;

[0008] In step S2, the real-time status information is transmitted to the cloud, which generates push event information. The push event information includes adjustment suggestions for the air conditioner and multimedia host. The cloud obtains the user's vehicle usage habits based on the user's identity information, compares it with the real-time status information, and generates push event information based on the comparison results.

[0009] In step S3, the push event information generated in the cloud is pushed to the multi-function steering wheel, and the vehicle user accepts or rejects the push event information received by the multi-function steering wheel; if the vehicle user accepts the push event information, a control instruction is generated and the process proceeds to step S4;

[0010] In step S4, the control instruction is distributed to the air conditioner and / or multimedia host, and the control instruction is executed.

[0011] Preferably, in step S1, the air conditioning operation information includes at least the switch status, set temperature, set wind speed, and air outlet direction; the temperature information includes at least the ambient temperature inside the vehicle and the ambient temperature outside the vehicle; the multimedia operation status information includes at least the channel, the software being run, and the external volume information.

[0012] Preferably, in step S2, the vehicle usage habit information includes: multimedia host channels and software applications that are frequently used by vehicle users in history, and air-conditioning set temperatures, wind speeds, and air outlet directions that are frequently used.

[0013] Preferably, a combination of one or more push event information pre-made by the vehicle user is obtained and uploaded to the cloud;

[0014] When the preset conditions are met, the cloud obtains the corresponding combination plan of push event information based on the user's identity information, and sends it to the multi-function steering wheel. The vehicle user can set it with one click, and it will be executed uniformly after the setting is completed.

[0015] According to a second aspect of the present invention, there is provided an in-vehicle multimedia interactive system for executing the above-mentioned in-vehicle multimedia interactive method, comprising:

[0016] Status information transceiver module, used for air conditioners, temperature sensors, and multimedia hosts to receive real-time status information and transmit it to the cloud;

[0017] The cloud module is used to receive real-time status information, generate push event information, and push the push event information to the multi-function steering wheel. The push event information includes adjustment suggestions for the air conditioner and multimedia host;

[0018] The multi-function steering wheel module is used to receive push event information and generate control instructions when recognizing that the vehicle user accepts the push event information;

[0019] The execution module is used to receive and execute control instructions.

[0020] According to a third aspect of the present invention, a vehicle is provided, comprising the above-mentioned in-vehicle multimedia interactive system.

[0021] According to a fourth aspect of the present invention, there is provided a storage medium storing computer-executable instructions for causing a computer to execute the in-vehicle multimedia interactive method recited in the preceding claims.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] 1. The present invention simplifies the interaction process for vehicle users through special step design. It does not require physical buttons or voice recognition on the multi-function steering wheel, and can also achieve traditional multimedia interaction effects, greatly reducing costs.

[0024] 2. The present invention combines the real-time data of the vehicle with the cloud data to predict in advance what operations the driver needs to perform and sends push events to the user for confirmation. Through batch push, quick settings can be achieved without repeated adjustments during driving, which can significantly improve interaction efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Other features, objects and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments with reference to the following drawings:

[0026] Figure 1 Schematic diagram of the process described in Example 1. DETAILED DESCRIPTION

[0027] To make the objectives, technical solutions, and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Generally, the components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations.

[0028] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for protection, but merely represents selected embodiments of the present application. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the present application without making any creative efforts shall fall within the scope of protection of the present application.

[0029] It should be noted that similar reference numerals and letters denote similar items in the following figures. Therefore, once an item is defined in one figure, it does not require further definition or explanation in subsequent figures. Furthermore, all directional designations (such as up, down, left, right, front, back, bottom, etc.) in this application are intended only to explain the relative positional relationships and movement of components in a specific posture (as shown in the figures). If the specific posture changes, the directional designations will also change accordingly.

[0030] Example 1

[0031] This embodiment provides an in-vehicle multimedia interaction method, which aims to solve the safety and efficiency problems of traditional vehicle human-computer interaction methods and address the hidden dangers existing in existing in-vehicle multimedia interactions, such as the safety hazards caused by the distraction of operating physical buttons or touch screens while driving, the limitations of voice recognition due to low recognition rates caused by pronunciation differences, and the cumbersome operation that requires multiple adjustments to achieve personalized settings.

[0032] The method provided in this embodiment includes:

[0033] In step S1, real-time status information is received in real time via the air conditioner, temperature sensor, and multimedia host. This real-time status information includes air conditioner operation information, temperature information, and multimedia operation status information. Specifically, air conditioner operation information includes at least on / off status, set temperature, set wind speed, and airflow direction; temperature information includes at least vehicle interior and exterior ambient temperatures; and multimedia operation status information includes at least the channel currently being used, the software currently being run, and the volume of the external speaker.

[0034] In step S2, the real-time status information is transmitted to the cloud, and the cloud generates push event information, which includes adjustment suggestions for the air conditioner and the multimedia host.

[0035] Furthermore, real-time status information also includes user identity information, such as the user ID account information used to log in to the multimedia console, or the use of the vehicle's facial recognition system to identify the vehicle owner and log in to the vehicle system. After receiving the real-time status information from the vehicle system, the cloud obtains the vehicle user's vehicle usage habits based on the user identity information, such as the vehicle user's frequently used multimedia console channels and software applications, as well as frequently used air conditioning settings such as temperature, wind speed, and airflow direction. This information is then compared with the real-time status information and a push event message is generated based on the comparison results.

[0036] In step S3, the push event information generated in the cloud is pushed to the multi-function steering wheel, where the driver accepts or rejects the push event information received by the multi-function steering wheel. If the driver accepts the push event information, a control instruction is generated and the process proceeds to step S4. The customer simply selects the Yes or No button on the multi-function steering wheel to perform the corresponding operation. This step differs from the traditional interaction mode that requires multiple operations on physical buttons or touch screens. The driver only needs to "confirm" or "reject" the push suggestion on the steering wheel, significantly reducing the frequency of shifting eyes and hand operations, ensuring that the driver's focus is on the road.

[0037] In step S4, the control instruction is distributed to the air conditioner and / or multimedia host, and the control instruction is executed.

[0038] Furthermore, the method provided in this embodiment can also retrieve one or more push event information combinations pre-configured by the vehicle user and upload them to the cloud. When pre-set conditions are met, the cloud retrieves the corresponding push event information combination based on the user's identity information and sends it to the multi-function steering wheel. The vehicle user can then set it with a single click, and once set, it is executed uniformly. This step allows vehicle users to pre-configure one or more personalized push event information combinations, which are then executed when pre-set conditions are met (for example, when the vehicle user starts the engine for the first time or when the vehicle usage time reaches a threshold). This improves the cloud's ability to match the vehicle user's needs, significantly enhancing user interaction efficiency and the vehicle experience. Through this step, when different drivers log in, the cloud can automatically load their unique settings (e.g., User A prefers "26°C + classical music" and User B prefers "22°C + podcasts") for their confirmation, achieving a personalized "one person, one car" experience.

[0039] The present invention can achieve the following beneficial effects: (1) This embodiment simplifies the interaction process for vehicle users through special step design. It does not require physical buttons or voice recognition on the multi-function steering wheel, and can also achieve traditional multimedia interaction effects, greatly reducing costs. (2) This embodiment combines the vehicle's real-time data with cloud data to predict in advance what operations the driver needs to perform and sends push events to the user for confirmation. The vehicle's temperature, volume, air conditioning mode, etc. can be quickly set through batch push, eliminating the need for repeated adjustments during driving, which can significantly improve interaction efficiency.

[0040] Example 2

[0041] This embodiment provides an in-vehicle multimedia interactive system, and the modules of the system cooperate with each other to implement the in-vehicle multimedia interactive method described in Example 1.

[0042] The system provided in this embodiment includes: a status information transceiver module, which is used to receive real-time status information in real time through the air conditioner, temperature sensor, and multimedia host, and transmit the real-time status information to the cloud; a cloud module, which is used to receive real-time status information, generate push event information, and push the push event information to the multi-function steering wheel, and the push event information includes adjustment suggestions for the air conditioner and the multimedia host; a multi-function steering wheel module, which is used to receive push event information and generate control instructions when it recognizes that the vehicle user accepts the push event information; and an execution module, which is used to receive and execute control instructions.

[0043] It should be noted that the explanation of the implementation method and beneficial effects of the method in the above-mentioned embodiment 1 is also applicable to this embodiment. To avoid redundancy, it will not be expanded here in detail.

[0044] Example 3

[0045] This embodiment provides a vehicle, which includes the in-vehicle multimedia interactive system described in Example 2. The modules of the system cooperate with each other to implement the in-vehicle multimedia interactive method described in Example 1.

[0046] It should be noted that the explanations of the implementation methods and beneficial effects of the method in the above-mentioned Examples 1 and 2 are also applicable to this example and will not be elaborated on in detail to avoid redundancy.

[0047] Example 4

[0048] This embodiment provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the in-vehicle multimedia interaction method described in Example 1.

[0049] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device or other non-transient solid-state storage device. In some embodiments, the memory may include a memory remotely located relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0050] It should be noted that the explanation of the implementation method and beneficial effects of the method in the above-mentioned embodiment 1 is also applicable to this embodiment. To avoid redundancy, it will not be expanded here in detail.

[0051] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the scope of the technical concept of this invention.

Claims

1. A vehicle-mounted multimedia interactive method, characterized in that: The steps include: In step S1, real-time status information is received through the air conditioner, temperature sensor, and multimedia host; the real-time status information includes air conditioner operation information, temperature information, multimedia operation status information, and user identity information; In step S2, the real-time status information is transmitted to the cloud, which generates push event information. The push event information includes adjustment suggestions for the air conditioner and multimedia host. The cloud obtains the user's vehicle usage habits based on the user's identity information, compares it with the real-time status information, and generates push event information based on the comparison results. In step S3, the push event information generated in the cloud is pushed to the multi-function steering wheel, and the vehicle user accepts or rejects the push event information of the multi-function steering wheel; If the user accepts the push event information, a control instruction is generated and the process goes to step S4; In step S4, the control instruction is distributed to the air conditioner and / or multimedia host, and the control instruction is executed.

2. The vehicle-mounted multimedia interactive method according to claim 1, characterized in that: In step S1, the air conditioning operation information includes at least the switch status, set temperature, set wind speed, and air outlet direction; the temperature information includes at least the ambient temperature inside the vehicle and the ambient temperature outside the vehicle; the multimedia operation status information includes at least the channel, the software being run, and the external speaker volume information.

3. The vehicle-mounted multimedia interactive method according to claim 1, characterized in that: In step S2, the vehicle usage habit information includes: the multimedia host channels and software applications that the vehicle user has used frequently in the past, and the air-conditioning set temperature, wind speed, and air outlet direction that the vehicle user has used frequently.

4. The in-vehicle multimedia interactive method according to claim 1, characterized in that: Obtain one or more push event information combination plans pre-made by the vehicle user and upload them to the cloud; When the preset conditions are met, the cloud obtains the corresponding combination plan of push event information based on the user's identity information, and sends it to the multi-function steering wheel. The vehicle user can set it with one click, and it will be executed uniformly after the setting is completed.

5. An in-vehicle multimedia interactive system, characterized in that: A vehicle-mounted multimedia interactive method for executing any one of claims 1 to 4, comprising: Status information transceiver module, used for air conditioners, temperature sensors, and multimedia hosts to receive real-time status information and transmit it to the cloud; The cloud module is used to receive real-time status information, generate push event information, and push the push event information to the multi-function steering wheel. The push event information includes adjustment suggestions for the air conditioner and multimedia host; The multi-function steering wheel module is used to receive push event information and generate control instructions when recognizing that the vehicle user accepts the push event information; The execution module is used to receive and execute control instructions.

6. A vehicle, characterized in that: Including the in-vehicle multimedia interactive system as described in claim 5.

7. A storage medium, characterized in that: Computer-executable instructions are stored, and the computer-executable instructions are used to enable a computer to execute the in-vehicle multimedia interaction method described in any one of claims 1-4.

Images