Vehicle hardware control method and device, terminal equipment and storage medium

Abstract

The application is suitable for the field of vehicle software technology, and particularly relates to a vehicle hardware control method and device, a terminal equipment and a storage medium. The application determines hardware response reference time information based on current playing progress information and comprehensive advance time information of a video and audio playing application in a vehicle, determines whether there is at least one video and audio associated hardware that needs to perform a video and audio associated response operation, and controls the corresponding video and audio associated hardware to perform the video and audio associated response operation in the case that the countdown ends in any of the countdown information. The application can enable the user to accurately obtain the feedback experience provided by the video and audio associated hardware at a specific time point in the video and audio playing scene, so as to enable the user to obtain an immersive experience related to the movie and music content in the vehicle, and improve the use experience of the user in the vehicle when watching the movie and listening to the music and the like.

Description

Technical Field

[0001] This application belongs to the field of vehicle software technology, and in particular relates to vehicle hardware control methods, devices, terminal equipment and computer-readable storage media. Background Technology

[0002] With cars becoming increasingly common, and as people's "second home," the exploration and enrichment of entertainment experiences in in-vehicle infotainment systems are receiving more and more attention from car manufacturers, and 5D cockpits have become a standard feature for various manufacturers.

[0003] Currently, 5D movies on in-vehicle systems are generated by annotating specific time points in the movie, creating a mapping relationship between key timestamps and in-vehicle hardware control information, which is then stored in the 5D script. The hardware associated with the in-vehicle system includes, but is not limited to, air conditioning, seats, suspension, fragrance systems, lights, steering wheel, and screens. The in-vehicle hardware control information mainly describes how the hardware interacts at specific points in time. When playing a movie, by matching the video playback progress with the time stamp information in the 5D script, signals are sent to the corresponding hardware controllers to drive the associated hardware to interact.

[0004] However, the mechanical or physical characteristics of the hardware associated with the vehicle's infotainment system cause execution delays. For example, active suspension uses an electric motor to drive a hydraulic system, which has a certain degree of physical inertia. Ultimately, this can lead to a mismatch between the actual viewing experience and the hardware's interaction, affecting the user's 5D movie viewing experience. Summary of the Invention

[0005] This application provides a vehicle hardware control method, device, terminal equipment, and storage medium, which can solve the technical problem of mismatch between the actual movie screen and hardware linkage when the user watches a movie in the vehicle due to hardware execution delay.

[0006] In a first aspect, embodiments of this application provide a vehicle hardware control method, including:

[0007] Based on the current playback progress information and comprehensive advance time information of the in-vehicle audio-visual playback application, determine the hardware response reference time information;

[0008] Based on the hardware response reference time information, determine whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation;

[0009] If there is at least one audio-visual associated hardware that needs to perform the audio-visual associated response operation, one or more countdown information is determined based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware, wherein each audio-visual associated hardware corresponds to one countdown information.

[0010] When the countdown executed by any of the countdown information ends, the audio-visual associated hardware corresponding to the countdown information is controlled to execute the audio-visual associated response operation.

[0011] In one possible implementation of the first aspect, the integrated advance time information is determined based on one or more hardware execution time information of one or more audio-visual associated hardware.

[0012] In one possible implementation of the first aspect, the comprehensive advance time information is determined by rounding up the maximum value of one or more hardware execution time information of one or more audio-visual associated hardware.

[0013] In one possible implementation of the first aspect, the hardware execution time information of the audio-visual associated hardware is determined based on the type information and / or service life information of the audio-visual associated hardware.

[0014] In one possible implementation of the first aspect, determining the hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle includes:

[0015] The hardware response reference time information is determined based on the sum of the current playback progress information and the comprehensive advance time information.

[0016] In one possible implementation of the first aspect, determining one or more countdown information based on the integrated advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware includes:

[0017] For any audio-visual associated hardware, the countdown information of the audio-visual associated hardware is determined based on the difference between the comprehensive advance time information and the hardware execution time information of the audio-visual associated hardware.

[0018] In one possible implementation of the first aspect, the control of the audio-visual association hardware corresponding to the countdown information to perform the audio-visual association response operation includes:

[0019] The audio-visual associated hardware corresponding to the countdown information is triggered to execute the audio-visual associated response operation according to the response operation control information corresponding to the audio-visual associated hardware, wherein the response operation control information includes at least one of the following: execution time information and operation type information.

[0020] Secondly, embodiments of this application provide a vehicle hardware control device, including:

[0021] The first determining module is used to determine the hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle.

[0022] The second determining module is used to determine, based on the hardware response reference time information, whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation.

[0023] The third determining module is used to determine one or more countdown information based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware if at least one audio-visual associated hardware needs to perform the audio-visual associated response operation, wherein each audio-visual associated hardware corresponds to one countdown information.

[0024] The control module is used to control the audio-visual association hardware corresponding to any of the countdown information to perform the audio-visual association response operation when the countdown ends.

[0025] Thirdly, embodiments of this application provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the vehicle hardware control method as described in the first aspect above.

[0026] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the vehicle hardware control method of the first aspect described above.

[0027] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, enables the terminal device to implement the vehicle hardware control method described in the first aspect.

[0028] The beneficial effects of the embodiments in this application compared with the prior art are:

[0029] Since audio-visual hardware requires a certain delay from startup to actual operation, this application determines hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle, determines whether there is at least one audio-visual hardware that needs to perform audio-visual related response operations, and controls the corresponding audio-visual hardware to perform audio-visual related response operations when the countdown executed by any of the aforementioned countdown information ends. This allows the actual working time of the audio-visual hardware to match more accurately with the time of specific viewing scenes and specific music segments in the audio-visual playback scenario. Therefore, this application enables users to accurately obtain feedback from the audio-visual hardware at specific time points in the audio-visual playback scenario, thereby providing users with an immersive experience related to movie and music content in the vehicle and improving the user experience of watching movies and listening to music in the vehicle.

[0030] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 This is a schematic flowchart of a vehicle hardware control method provided in an embodiment of this application;

[0033] Figure 2 This is a schematic flowchart of a vehicle hardware control method provided in an application embodiment of this application;

[0034] Figure 3 This is a schematic diagram of the structure of a vehicle hardware control device provided in an embodiment of this application;

[0035] Figure 4 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0036] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0037] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0038] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0039] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0040] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0041] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0042] The vehicle hardware control method provided in this application can be applied to terminal devices such as in-vehicle systems, mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of terminal device.

[0043] For example, the terminal device may be a station (STAION, ST) in a WLAN, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with wireless communication capabilities, a computing device or other processing device connected to a wireless modem, an in-vehicle device, a vehicle networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite wireless device, a wireless modem card, a set-top box (STB), customer premises equipment (CPE), and / or other devices used for communication over a wireless system, as well as next-generation communication systems, such as mobile terminals in 5G networks or mobile terminals in future evolved Public Land Mobile Network (PLMN) networks.

[0044] As an example and not a limitation, when the terminal device is a wearable device, the term "wearable device" can also refer to any device that utilizes wearable technology to intelligently design and develop everyday wearables, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices worn directly on the body or integrated into a user's clothing or accessories. Wearable devices are not merely hardware devices; they achieve powerful functions through software support, data interaction, and cloud interaction. Broadly defined, wearable smart devices include those with comprehensive functions, large sizes, and the ability to perform complete or partial functions without relying on a smartphone, such as smartwatches or smart glasses, as well as those focused on a specific application function that require interaction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0045] Currently, the inherent characteristics of the hardware associated with the vehicle's infotainment system cause execution delays. For example, active suspension uses an electric motor to drive a hydraulic system, which has a certain degree of physical inertia. Ultimately, this can lead to a mismatch between the actual movie screen seen by the user in the vehicle and the hardware's interaction, affecting the user's 5D movie viewing experience.

[0046] This application aims to address some pain points in the 5D cockpit movie viewing experience in vehicles, improve the overall 5D movie viewing experience in vehicles, and provide users with a more immersive experience in the car movie viewing scenario.

[0047] Figure 1 This is a schematic flowchart of a vehicle hardware control method provided in an embodiment of this application.

[0048] S11, based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle, determines the hardware response reference time information.

[0049] For example, audio and video playback applications include, but are not limited to, various apps used for playing videos and music. By monitoring these applications, one can obtain information about the current playback progress in the vehicle, such as when the video / audio playback has reached the 10th second or the 25th minute and 30th second.

[0050] Comprehensive advance time information refers to the time advance determined by considering various factors such as the execution time of one or more audio-visual related hardware components in the vehicle. Examples of comprehensive advance time information include 1 second, 1.5 seconds, and 2 seconds.

[0051] The audio-visual hardware in a vehicle includes, but is not limited to, various hardware related to audio-visual playback, such as air conditioning, seats, suspension, fragrance systems, lighting (including ambient lighting), steering wheel, and screens. In audiovisual scenarios such as playing 5D movies, 4D movies, and listening to music, users can receive hardware feedback related to the movie or music content through methods such as air conditioning blowing, seat shaking, and light flashing. This allows users to have an immersive experience related to the movie or music content in the vehicle, enhancing their overall experience of watching movies and listening to music in the vehicle.

[0052] Here, the comprehensive lead time information can be stored in a computer-readable storage medium or in a cloud device. Accordingly, the comprehensive lead time information can be obtained by reading the computer-readable storage medium or by interacting with the cloud device. Those skilled in the art should understand that the above-mentioned and other unlisted methods of obtaining comprehensive lead time information are all within the scope of protection of this application.

[0053] Since audio-visual hardware requires a certain amount of time from startup to actual operation, this application, by determining comprehensive lead time information, can more accurately match the actual operating time of the audio-visual hardware with specific time points in the audio-visual playback scenario. Therefore, this application allows users to accurately receive feedback from the audio-visual hardware at specific time points in the audio-visual playback scenario, thereby providing users with an immersive experience related to movie and music content in the vehicle and enhancing the user experience of watching movies and listening to music in the vehicle.

[0054] Among them, the hardware response reference time information refers to the hardware response time determined by taking into account two factors: the hardware execution time information of the audio-visual related hardware represented by the comprehensive advance time information, and the current playback progress information.

[0055] Because it takes into account factors such as comprehensive advance time information, the value of the hardware response reference time information is generally greater than the value of the current playback progress information of the audio-visual playback application. Therefore, it can make advance preparations for the audio-visual related response operations that will be triggered later, thereby reserving the amount of time required for the hardware execution time information of the audio-visual related hardware.

[0056] Those skilled in the art should understand that when determining hardware response reference time information, in addition to the current playback progress information and comprehensive advance time information, other factors, such as internal processing delay, can be added to make the actual working time of the audio-visual associated hardware more accurately match the specific time point in the audio-visual playback scenario.

[0057] S12, based on the hardware response reference time information, determine whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation.

[0058] Here, based on the hardware response reference time information, the audio-visual playback hardware response time schedule can be searched to determine whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation. The audio-visual playback hardware response time schedule includes the correspondence between playback time and audio-visual associated hardware. For example, the seat might trigger an audio-visual associated response operation at the 5th second, and the air conditioner might trigger an audio-visual associated response operation at the 10th second.

[0059] Here, based on the audio-visual identification information corresponding to the movie or music the user is currently watching, the audio-visual playback hardware response time schedule corresponding to the movie or music the user is currently watching can be obtained by querying the audio-visual playback hardware response time database stored in the cloud or locally.

[0060] Following the previous example, if the hardware response reference time information `realtime` is at the 5th second, and the audio / video playback hardware response timetable includes the 5th second triggering the seat to perform an audio / video associated response operation, then it can be determined that at least one audio / video associated hardware, namely the seat, needs to perform the audio / video associated response operation. If the audio / video playback hardware response timetable does not include information about the 5th second triggering any audio / video associated hardware to perform an audio / video associated response operation, then subsequent steps will not be executed.

[0061] The audio / video playback hardware response timetable includes the correspondence between various playback times and associated audio / video hardware. Therefore, during actual operation, the audio / video playback hardware response timetable can be checked multiple times based on the constantly changing hardware response reference time information to determine if at least one audio / video associated hardware requires an audio / video associated response operation. For example, based on the user's current playback progress, the current playback progress information can be obtained once per second, and then, based on the current hardware response reference time information, the audio / video playback hardware response timetable can be checked to determine if at least one audio / video associated hardware requires an audio / video associated response operation.

[0062] Audio-visual related response operations performed by audio-visual related hardware refer to response operations performed by the hardware that are related to the content of movie and music playback. In audio-visual scenarios such as playing 5D movies (five-dimensional movies), 4D movies (four-dimensional movies), and listening to music, hardware feedback experiences related to the movie and music content can be provided to users through methods such as air conditioning blowing, seat shaking, and ambient lighting flashing. This allows users to have an immersive experience related to the movie and music content in the vehicle, enhancing the user experience of watching movies and listening to music in the vehicle.

[0063] For any audio-visual associated hardware, the corresponding audio-visual associated response operation can be a pre-agreed fixed operation with a fixed time. For example, for a seat, the corresponding audio-visual associated response operation can be vibration with a fixed time of 1 second; for an air conditioner, the corresponding audio-visual associated response operation can be airflow with a fixed time of 1 second; for ambient lighting, the corresponding audio-visual associated response operation can be flashing with a fixed time of 0.5 seconds; for a fully active suspension, the corresponding audio-visual associated response operation can be left and right swaying with a fixed time of 0.6 seconds; and for a steering wheel, the corresponding audio-visual associated response operation can be vibration with a fixed time of 1 second. Accordingly, the audio-visual playback hardware response schedule may not include specific execution time information, operation type information, or other response operation control information. For example, the audio-visual playback hardware response schedule is shown in Table 1 below:

[0064]

[0065] Table 1

[0066] As shown in Table 1 above, the audio-visual hardware that needs to perform an audio-visual response operation at the 5th second of video playback is the seat and the fully active suspension. At the 10th second of video playback, the audio-visual hardware that needs to perform an audio-visual response operation is the air conditioner and the steering wheel.

[0067] Those skilled in the art will understand that the parameter values ​​in Table 1 above are merely illustrative examples, and the actual parameter values ​​can be set according to the actual situation. The above parameter values ​​do not constitute a limitation on the scope of protection of this application. Optionally, for any audio-visual associated hardware, the corresponding audio-visual associated response operation can also be of multiple types. For example, for a seat, the corresponding audio-visual associated response operation may include seat vibration and seat heating. For a fully active suspension, the corresponding audio-visual associated response operation may include suspension pitching and suspension swaying. Accordingly, the audio-visual playback hardware response schedule may include specific execution time information, operation type information, and other response operation control information. For example, the audio-visual playback hardware response schedule is shown in Table 2 below:

[0068]

[0069] Table 2

[0070] As shown in Table 2 above, at the 5th second of the video playback, the seat vibrates for 1 second and heats for 2 seconds, while the fully active suspension nods for 3 seconds and sways left and right for 2 seconds. At the 10th second of the video playback, the air conditioning cools for 3 seconds, and the steering wheel vibrates for 3 seconds.

[0071] Those skilled in the art will understand that the parameter values ​​in Table 2 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0072] S13, if there is at least one audio-visual associated hardware that needs to perform the audio-visual associated response operation, one or more countdown information is determined based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware, wherein each audio-visual associated hardware corresponds to one countdown information.

[0073] Here, for any audio-visual associated hardware that needs to perform an audio-visual associated response operation, the countdown information corresponding to that audio-visual associated hardware can be determined separately. For example, if there are three audio-visual associated hardware devices (seat, fully active suspension, and steering wheel) that need to perform audio-visual associated response operations, the countdown information corresponding to each audio-visual associated hardware can be determined based on the comprehensive advance time information and the execution time information of the three different hardware devices corresponding to these three audio-visual associated hardware devices. That is, the countdown information corresponding to the seat, the countdown information corresponding to the fully active suspension, and the countdown information corresponding to the steering wheel.

[0074] Those skilled in the art should understand that when determining countdown information, in addition to comprehensive advance time information and hardware execution time information, other factors, such as internal processing delay, can be added to make the actual working time of the audio-visual associated hardware more accurately match the specific time point in the audio-visual playback scenario.

[0075] Previously, due to the consideration of comprehensive advance time information, the hardware response reference time was generally greater than the current playback progress of the audio-visual playback application, reserving an amount of time greater than the hardware execution time required by the audio-visual associated hardware. Therefore, to ensure that the actual working time of the audio-visual associated hardware accurately matches the specific time point in the audio-visual playback scenario, this method deducts the previously reserved time by determining countdown information. After the countdown corresponding to the countdown information ends, the audio-visual associated hardware corresponding to the countdown information is controlled to execute the audio-visual associated response operation, thus achieving the goal of accurately matching the actual working time of the audio-visual associated hardware with the specific time point in the audio-visual playback scenario.

[0076] S14, if the countdown executed by any of the countdown information ends, control the audio-visual association hardware corresponding to the countdown information to execute the audio-visual association response operation.

[0077] As mentioned earlier, for any audio-visual associated hardware, the corresponding audio-visual associated response operation can be a pre-agreed fixed operation with a fixed time. Therefore, when the countdown timer for any audio-visual associated hardware ends, the corresponding audio-visual associated hardware can be triggered to perform a fixed audio-visual associated response operation.

[0078] Following the previous example, when the air conditioning countdown ends at 0.9 seconds, the air conditioning will blow air for 1 second. When the ambient lighting countdown ends at 0.8 seconds, the ambient lighting will flash for 1 second. When the seat countdown ends at 0.95 seconds, the seat will vibrate for 1 second. When the fully active suspension countdown ends at 0.85 seconds, the fully active suspension will sway left and right for 1 second. When the steering wheel countdown ends at 0.88 seconds, the steering wheel will vibrate for 1 second.

[0079] Since audio-visual hardware requires a certain delay from startup to actual operation, this application combines 5D event advance triggering and delay compensation to offset the time consumption caused by hardware execution delay, enabling precise matching between the viewing screen and hardware linkage, thus improving the user's 5D viewing experience. This application determines hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle, determines whether there is at least one audio-visual hardware that needs to perform audio-visual related response operations, and controls the corresponding audio-visual hardware to perform audio-visual related response operations when the countdown of any of the aforementioned countdown information ends. This allows the actual working time of the audio-visual hardware to match more accurately with the time of specific viewing screens and specific music segments in the audio-visual playback scene. Therefore, this application enables users to accurately obtain feedback from the audio-visual hardware at specific times in the audio-visual playback scene, thereby providing users with an immersive experience related to movie and music content in the vehicle, enhancing the user experience of watching movies and listening to music in the vehicle.

[0080] According to one embodiment of this application, the comprehensive advance time information is determined based on the hardware execution time information of one or more audio-visual associated hardware devices.

[0081] Among them, the hardware execution time information of audio-visual related hardware refers to the amount of time required for the audio-visual related hardware to start up and actually work. For example, the hardware execution time information of Full Active Suspension (FAS) is 150 milliseconds, the hardware execution time information of air conditioning is 100 milliseconds, and the hardware execution time information of ambient lighting is 200 milliseconds, etc.

[0082] The execution time information of one or more audio-visual associated hardware devices can be stored, for example, in a hardware execution time configuration information table. A hardware execution time configuration information table is shown in Table 3 below:

[0083]

[0084]

[0085] Table 3

[0086] Here, Plain Text represents plain text data. [air:100ms] indicates that the hardware execution time for the air conditioning is 100 milliseconds. [light:200ms] indicates that the hardware execution time for the ambient lighting is 200 milliseconds. [seat:50ms] indicates that the hardware execution time for the seat is 50 milliseconds. [fas:150ms] indicates that the hardware execution time for the fully active suspension is 150 milliseconds. [steeringwheel:120ms] indicates that the hardware execution time for the steering wheel is 120 milliseconds.

[0087] Those skilled in the art will understand that the parameter values ​​in Table 3 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0088] Here, the overall lead time information of one or more audio-visual associated hardware devices can be determined in various ways based on the execution time information of one or more hardware devices. For example, the maximum value among multiple hardware execution time information can be determined as the overall lead time information. Another example is determining twice the maximum value among multiple hardware execution time information as the overall lead time information. Yet another example is determining twice the average value of multiple hardware execution time information as the overall lead time information.

[0089] Since audio-visual hardware requires a certain amount of time from startup to actual operation, this application obtains comprehensive advance time information based on the execution time information of one or more audio-visual hardware components. This allows for a more accurate match between the actual operating time of the audio-visual hardware and specific time points in the audio-visual playback scenario. Therefore, this application enables users to accurately receive feedback from the audio-visual hardware at specific time points in the audio-visual playback scenario, thereby providing users with an immersive experience related to movie and music content in the vehicle and enhancing their experience of watching movies and listening to music in the vehicle.

[0090] According to one embodiment of this application, the comprehensive advance time information is determined by rounding up the maximum value among the execution time information of one or more audio-visual associated hardware devices.

[0091] Here, when measured in seconds, hardware execution time is typically a non-integer value, such as 0.1 seconds, 0.2 seconds, 1.1 seconds, 1.3 seconds, etc. The round-up operation determines the nearest integer value that is greater than the non-integer value.

[0092] For example, following the previous example, [air:100ms] indicates that the hardware execution time for the air conditioner is 100 milliseconds. [light:200ms] indicates that the hardware execution time for the ambient lighting is 200 milliseconds. [seat:50ms] indicates that the hardware execution time for the seat is 50 milliseconds. [fas:150ms] indicates that the hardware execution time for the fully active suspension is 150 milliseconds. [steeringwheel:120ms] indicates that the hardware execution time for the steering wheel is 120 milliseconds. The maximum value of these five hardware execution times for the audio-visual related hardware is 0.2 seconds (200 milliseconds). After rounding up, the combined advance time of these five audio-visual related hardware is determined to be 1 second.

[0093] Here, the overall lead time information for one or more audio-visual associated hardware devices can be determined based on the following formula:

[0094] leadtime=ceil(max(consumingtime1,……,consumingtime n ))

[0095] Wherein, leadtime represents the overall lead time information of one or more audio-visual associated hardware, consumingtime1,……,consumingtimen represents the execution time information of one or more hardware of one or more audio-visual associated hardware, max(consumingtime1,……,consumingtimen) represents the maximum value among the execution time information of one or more hardware of one or more audio-visual associated hardware, and ceil(max(consumingtime1,……,consumingtimen)) represents the rounding up operation of the maximum value among the execution time information of one or more hardware of one or more audio-visual associated hardware.

[0096] For example, following the previous example, the overall lead time information for one or more audio-visual associated hardware devices can be determined based on the following formula:

[0097] leadtime=ceil(max(air,light,seat,fas,steeringwheel,……) / 1000.0)

[0098] Here, `leadtime` represents the comprehensive lead time information of one or more audio-visual related hardware components. `air,light,seat,fas,steeringwheel,...` represents the hardware execution time information of the air conditioner, ambient lighting, seat, fully active suspension, and steering wheel respectively. `max(air,light,seat,fas,steeringwheel,...)` represents the maximum value among the hardware execution time information of the air conditioner, ambient lighting, seat, fully active suspension, and steering wheel respectively. `max(air,light,seat,fas,steeringwheel,...) / 1000.0` represents dividing the maximum value among the hardware execution time information of the air conditioner, ambient lighting, seat, fully active suspension, and steering wheel respectively by 1000 to convert the millisecond value to a value in seconds. `ceil(max(air,light,seat,fas,steeringwheel,...) / 1000.0)` represents rounding up the maximum value (a decimal in seconds) among the hardware execution time information of the air conditioner, ambient lighting, seat, fully active suspension, and steering wheel respectively to obtain an integer value.

[0099] Following the previous example, by substituting the execution time information of the air conditioning, ambient lighting, seats, fully active suspension, and steering wheel into the formula, we can obtain:

[0100] leadtime=ceil(max(100,200,50,150,120) / 1000.0)=1

[0101] The overall lead time information is 1 second.

[0102] Since audio-visual hardware requires a certain amount of time from startup to actual operation, this application obtains comprehensive advance time information by rounding up the maximum value of the execution time information of one or more audio-visual hardware components. This allows the actual operating time of the audio-visual hardware to more accurately match a specific time point in the audio-visual playback scenario. Therefore, this application enables users to accurately receive feedback from the audio-visual hardware at specific times in the audio-visual playback scenario, thereby providing users with an immersive experience related to movie and music content in the vehicle and enhancing the user experience of watching movies and listening to music in the vehicle.

[0103] According to one embodiment of this application, the hardware execution time information of the audio-visual associated hardware is determined based on the type information and / or service life information of the audio-visual associated hardware.

[0104] The type information of the audio-visual associated hardware includes, but is not limited to, the brand and model of the audio-visual associated hardware.

[0105] Here, the hardware execution time information of the audio-visual associated hardware can be determined by querying the hardware execution time table based on the type and service life information of the audio-visual associated hardware. Alternatively, the hardware execution time information of the audio-visual associated hardware can be determined by calculation based on the type and service life information of the audio-visual associated hardware.

[0106] The hardware execution time table is shown in Table 4 below:

[0107] Audio-visual related hardware brand model Service life Hardware execution time information Active suspension A X 3 100ms Active suspension A X 5 300ms Active suspension A X 10 500ms Active suspension A Y 5 200ms Active suspension A Y 10 500ms air conditioner ABC XXX 3 100ms air conditioner ABC XXX 10 200ms ……

[0108] Table 4

[0109] Here, the hardware execution time table can be dynamically configured via the cloud. The hardware execution time information will differ for the same hardware but different brands and models. Furthermore, the hardware execution time information will increase over time. Therefore, this application comprehensively considers factors such as brand, model, and vehicle age to determine the hardware execution time information.

[0110] As shown in Table 4, for example, for an active suspension system of brand A, model X, and with a service life of 3 years, the hardware execution time is 100 seconds. Other information in Table 4 is similar.

[0111] Those skilled in the art will understand that the parameter values ​​in Table 4 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0112] Those skilled in the art should understand that the above methods for determining the hardware execution time information of audio-visual associated hardware based on its type and service life are merely examples. Besides the above methods, the hardware execution time information of audio-visual associated hardware can also be determined solely based on its service life. Alternatively, it can be determined solely based on its type. For example, the hardware execution time information can be determined solely based on the brand of the audio-visual associated hardware. Or, it can be determined solely based on its model number. Those skilled in the art should understand that the above methods for determining the hardware execution time information of audio-visual associated hardware, as well as other methods for determining the hardware execution time information of audio-visual associated hardware, all fall within the scope of protection of this application.

[0113] Since audio-visual hardware requires a certain amount of time from startup to actual operation, this application determines the hardware execution time information of the audio-visual hardware based on its type and / or service life. This allows for an accurate determination of the precise hardware execution time of the audio-visual hardware in the vehicle, ensuring a more accurate match between the actual operating time of the audio-visual hardware and specific time points in the audio-visual playback scenario. Therefore, this application enables users to accurately receive feedback from the audio-visual hardware at specific time points in the audio-visual playback scenario, thereby providing an immersive experience related to movie and music content in the vehicle and enhancing the user experience of watching movies and listening to music in the vehicle.

[0114] According to one embodiment of this application, hardware response reference time information is determined based on the current playback progress information of the audio-visual playback application in the vehicle and comprehensive advance time information, including:

[0115] Based on the sum of the current playback progress information and the comprehensive advance time information, the hardware response reference time information is determined.

[0116] Here, the hardware response reference time information can be determined based on the following formula:

[0117] realtime = progress + leadtime

[0118] Among them, realtime represents the hardware response reference time information, progress represents the current playback progress information of the audio and video playback application in the vehicle, and leadtime represents the comprehensive advance time information.

[0119] Following the previous example, with the leadtime information being 1 second, and assuming the current playback progress is at the 4th second, the hardware response reference time information realtime is at the 5th second.

[0120] By delaying the current playback progress information by a factor of 1, a hardware response reference time can be obtained. For example, if the current playback progress is at the 4th second and the overall advance time is 1 second, delaying the 4th second by 1 second will give a hardware response reference time of the 5th second.

[0121] Since audio-visual hardware requires a certain amount of time from startup to actual operation, this application determines the hardware response reference time information based on the sum of the current playback progress information and the comprehensive advance time information. This allows for advance preparation for subsequent audio-visual related response operations, reserving the time required for the hardware execution of the audio-visual hardware. This ensures that the actual working time of the audio-visual hardware matches the specific time point in the audio-visual playback scenario more accurately. Therefore, this application enables users to accurately obtain feedback from the audio-visual hardware at specific time points in the audio-visual playback scenario, thereby providing users with an immersive experience related to movie and music content in the vehicle and enhancing the user experience of watching movies and listening to music in the vehicle.

[0122] According to one embodiment of this application, one or more countdown information is determined based on comprehensive advance time information and execution time information of one or more hardware corresponding to each audio-visual associated hardware, including:

[0123] For any audio-visual associated hardware, the countdown information of the audio-visual associated hardware is determined based on the difference between the comprehensive advance time information and the hardware execution time information of the audio-visual associated hardware.

[0124] Here, the hardware response reference time information can be determined based on the following formula:

[0125] dela y timei = leadtime - consumingtimei

[0126] Among them, delaytime i This represents the countdown information for the i-th audio-visual associated hardware, where leadtime represents the overall lead time information, and consumingtime represents the countdown time. i This represents the hardware execution time information for the i-th audio-visual associated hardware.

[0127] Following the previous example, considering the overall leadtime information as 1 second, the hardware execution time of the air conditioning as 0.1 seconds, the countdown time for the air conditioning is 0.9 seconds. The hardware execution time of the ambient lighting as 0.2 seconds, the countdown time for the ambient lighting is 0.8 seconds. The hardware execution time of the seat as 0.05 seconds, the countdown time for the seat is 0.95 seconds. The hardware execution time of the fully active suspension as 0.15 seconds, the countdown time for the fully active suspension is 0.85 seconds. The hardware execution time of the steering wheel as 0.12 seconds, the countdown time for the steering wheel is 0.88 seconds.

[0128] For any audio-visual associated hardware, the hardware execution time of the audio-visual associated hardware is subtracted from the comprehensive lead time information to obtain the countdown information of the audio-visual associated hardware. For example, if the comprehensive lead time information leadtime is 1 second and the hardware execution time information of the air conditioner is 0.1 seconds, subtracting 0.1 seconds from 1 second will give the countdown information of the air conditioner as 0.9 seconds.

[0129] Since a time limit exceeding the startup time required for the audio-visual hardware to begin actual operation was previously allocated, this application determines the countdown information for the audio-visual hardware based on the difference between the comprehensive advance time information and the hardware execution time information. This allows for the deduction of the previously allocated time exceeding the hardware execution time, ensuring a more accurate match between the actual operating time of the audio-visual hardware and specific time points within the audio-visual playback scenario. Therefore, this application enables users to accurately receive feedback from the audio-visual hardware at specific time points within the audio-visual playback scenario, thereby providing an immersive experience related to movie and music content in the vehicle and enhancing the user experience of watching movies and listening to music in the vehicle.

[0130] According to one embodiment of this application, controlling the audio-visual association hardware corresponding to the countdown information to perform an audio-visual association response operation includes:

[0131] The audio-visual associated hardware corresponding to the trigger countdown information executes the audio-visual associated response operation according to the response operation control information corresponding to the audio-visual associated hardware, wherein the response operation control information includes at least one of the following: execution time information and operation type information.

[0132] Here, the audio / video playback hardware response schedule also includes response operation control information corresponding to one or more audio / video associated hardware devices. Response operation control information refers to the control information when the audio / video associated hardware performs an audio / video associated response operation. Response operation control information includes, but is not limited to, execution time information and operation type information. Those skilled in the art should understand that the response operation control information may only include execution time information; accordingly, the audio / video associated hardware may perform a fixed type of audio / video associated response operation according to the execution time information. The response operation control information may also only include operation type information; accordingly, the audio / video associated hardware may perform an audio / video associated response operation for a fixed time according to the operation type information. The response operation control information may also include both execution time information and operation type information.

[0133] As shown in Table 2 above, the audio-visual playback hardware response time schedule includes both execution time information and operation type information.

[0134] Following the previous example, when the countdown for the seat reaches 0.95 seconds, the seat is triggered to vibrate for 1 second (execution time information: 1 second, operation type information: vibration), and to heat for 2 seconds (execution time information: 2 seconds, operation type information: heating). When the countdown for the fully active suspension reaches 0.85 seconds, the fully active suspension is triggered to nod for 3 seconds (execution time information: 3 seconds, operation type information: head nod), and to rock left and right for 2 seconds (execution time information: 2 seconds, operation type information: left and right rocking).

[0135] This application sets response operation control information corresponding to one or more audio-visual associated hardware in the audio-visual playback hardware response schedule. This allows the audio-visual associated hardware to execute audio-visual associated response operations according to the corresponding response operation control information, thereby providing users with a rich variety of audio-visual associated response operations. This enables users to obtain a more immersive experience related to movie and music content in the vehicle, and improves the user experience of watching movies and listening to music in the vehicle.

[0136] Figure 2 This is a flowchart illustrating a vehicle hardware control method provided in an application embodiment of this application.

[0137] When a user launches a 5D movie-related application in the cockpit, the following will be executed upon application launch:

[0138] Based on the brand and model of the audio-visual related hardware (such as air conditioning, seats, ambient lighting, suspension, etc.) in the current vehicle, as well as the current vehicle's age, the time consumption configuration information for 5D related hardware execution is downloaded from the cloud and stored in the "Hardware Execution Time Consumption Configuration Information Table", as shown in Table 5 below:

[0139]

[0140] Table 5

[0141] Here, Plain Text represents plain text data. [air:100ms] indicates that the hardware execution time for the air conditioning is 100 milliseconds. [light:200ms] indicates that the hardware execution time for the ambient lighting is 200 milliseconds. [seat:50ms] indicates that the hardware execution time for the seat is 50 milliseconds. [fas:150ms] indicates that the hardware execution time for the fully active suspension is 150 milliseconds. [steeringwheel:120ms] indicates that the hardware execution time for the steering wheel is 120 milliseconds.

[0142] Those skilled in the art will understand that the parameter values ​​in Table 5 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0143] Based on the obtained "Hardware Execution Time Configuration Information Table", the leadtime (in seconds) for triggering 5D events in the movie is set to the maximum value in the "Hardware Execution Time Configuration Information Table", converted to seconds and rounded up, i.e.:

[0144] leadtime=ceil(max(air,light,seat,fas,steeringwheel,……) / 1000.0)

[0145] For the example above, the leadtime is:

[0146] leadtime=ceil(max(100,200,50,150,120) / 1000.0)=1

[0147] Therefore, the value of leadtime is 1 second.

[0148] When a user clicks on a specific movie to watch:

[0149] Download all 5D script annotation information (i.e., information from the audio-visual playback hardware response time table) for the current movie from the cloud based on the movie ID. The annotation information is shown in Table 6 below:

[0150] At the 5-second mark of the video playback, the seat vibrates for 1 second, the seat heats up for 2 seconds, the suspension nods for 3 seconds, and the suspension vibrates for 2 seconds.

[0151] At the 10-second mark of the video, the air conditioning cooled for 3 seconds and the steering wheel vibrated for 3 seconds.

[0152]

[0153] Table 6

[0154] Those skilled in the art will understand that the parameter values ​​in Table 6 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0155] Monitor the video playback progress and call back once per second.

[0156] Based on the current video playback progress (progess) and leadtime, the actual trigger timestamp (realtime) of the 5D event is calculated.

[0157] realtime = progress + leadtime

[0158] Based on the calculated realtime, search for the 5D script annotation information. If found, it means that the current progress requires the execution of the 5D script; otherwise, it will not be executed.

[0159] In the previous example, the leadtime is 1 second. Assuming the current playback progress is at 4 seconds, the realtime is 5 seconds. Looking up the 5D script annotations, we find that the following script needs to be executed at 5 seconds, as shown in Table 7 below:

[0160]

[0161] Table 7

[0162] Those skilled in the art will understand that the parameter values ​​in Table 7 above are merely illustrative examples, and actual parameter values ​​can be set according to actual circumstances. The above parameter values ​​do not constitute a limitation on the scope of protection of this application.

[0163] Find the current hardware execution time (consumingtime) based on the "Hardware Execution Time Configuration Information Table". i Then calculate the actual delay time required for execution for each hardware type. i The calculation formula is:

[0164] dela y timei = leadtime - consumingtimei

[0165] Based on all the hardware linkage information configured in the found 5D script, iterate through each type of hardware linkage instruction and delay the actual execution time required for that type of hardware (delaytime). i Then, execute the corresponding 5D instructions, looping through all instructions in the script until execution is complete.

[0166] Until the video finishes playing.

[0167] In one example: the point information in a certain video scene includes ambient lighting, seats, and active suspension linkage.

[0168] Assuming the ambient lighting response time is configured to be 100ms, the seat response time to be configured to be 200ms, and the active suspension response time to be configured to be 300ms.

[0169] The entire tracking information is moved forward, and the forward time is equal to the longest hardware response time, converted to seconds, and then rounded up to 1 second.

[0170] When executing hardware commands, delay compensation is applied to commands with a delay of less than 1 second. In the example above, when the marking information is received (1 second in advance), the active suspension command is executed after a delay of 1000-300=700 milliseconds, the seat command is executed after a delay of 1000-200=800 milliseconds, and the ambient light command is executed after a delay of 1000-100=900 milliseconds.

[0171] Figure 3 This is a schematic diagram of the structure of a vehicle hardware control device provided in an embodiment of this application.

[0172] like Figure 3 As shown, the vehicle hardware control device 3 includes:

[0173] The first determining module 31 is used to determine the hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle.

[0174] The second determining module 32 is used to determine, based on the hardware response reference time information, whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation.

[0175] The third determining module 33 is used to determine one or more countdown information based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware if at least one audio-visual associated hardware needs to perform the audio-visual associated response operation, wherein each audio-visual associated hardware corresponds to one countdown information.

[0176] Control module 34 is used to control the audio-visual association hardware corresponding to the countdown information to perform the audio-visual association response operation when the countdown executed by any of the countdown information ends.

[0177] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiment, the comprehensive advance time information is determined based on the execution time information of one or more audio-visual associated hardware devices.

[0178] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiment, the comprehensive advance time information is determined by rounding up the maximum value among the execution time information of one or more audio-visual associated hardware.

[0179] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiment, the hardware execution time information of the audio-visual associated hardware is determined based on the type information and / or service life information of the audio-visual associated hardware.

[0180] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiments, the first determining module 31 is used for:

[0181] The hardware response reference time information is determined based on the sum of the current playback progress information and the comprehensive advance time information.

[0182] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiment, the third determining module 33 is used for:

[0183] For any audio-visual associated hardware, the countdown information of the audio-visual associated hardware is determined based on the difference between the comprehensive advance time information and the hardware execution time information of the audio-visual associated hardware.

[0184] Another embodiment of the present invention discloses a vehicle hardware control device 3. This embodiment is based on the above... Figure 3 Based on the corresponding embodiment, the control module 34 is used for:

[0185] The audio-visual associated hardware corresponding to the countdown information is triggered to execute the audio-visual associated response operation according to the response operation control information corresponding to the audio-visual associated hardware, wherein the response operation control information includes at least one of the following: execution time information and operation type information.

[0186] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0187] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0188] This application also provides a terminal device, such as... Figure 4 As shown, the terminal device 4 includes: at least one processor 40, a memory 41, and a computer program 42 stored in the memory 41 and executable on the at least one processor 40. When the processor 40 executes the computer program 42, it implements the steps in any of the above-described method embodiments.

[0189] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps described in the various method embodiments above.

[0190] This application provides a computer program product that, when run on a terminal device, enables the terminal device to implement the steps described in the various method embodiments above.

[0191] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0192] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0193] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0194] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0195] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0196] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A vehicle hardware control method, characterized in that, include: Based on the current playback progress information and comprehensive advance time information of the in-vehicle audio-visual playback application, determine the hardware response reference time information; Based on the hardware response reference time information, determine whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation; If there is at least one audio-visual associated hardware that needs to perform the audio-visual associated response operation, one or more countdown information is determined based on the comprehensive advance time information and the one or more hardware execution time information corresponding to each audio-visual associated hardware, wherein each audio-visual associated hardware corresponds to one countdown information, and the comprehensive advance time information is determined based on the one or more hardware execution time information of one or more audio-visual associated hardware; When the countdown executed by any of the countdown information ends, the audio-visual associated hardware corresponding to the countdown information is controlled to execute the audio-visual associated response operation.

2. The vehicle hardware control method as described in claim 1, characterized in that, The comprehensive advance time information is determined by rounding up the maximum value among the execution time information of one or more audio-visual associated hardware devices.

3. The vehicle hardware control method as described in claim 1 or 2, characterized in that, The hardware execution time information of the audio-visual associated hardware is determined based on the type information and / or service life information of the audio-visual associated hardware.

4. The vehicle hardware control method as described in claim 1 or 2, characterized in that, The hardware response reference time information is determined based on the current playback progress information and comprehensive advance time information of the in-vehicle audio-visual playback application, including: The hardware response reference time information is determined based on the sum of the current playback progress information and the comprehensive advance time information.

5. The vehicle hardware control method as described in claim 1 or 2, characterized in that, Based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware, one or more countdown information is determined, including: For any audio-visual associated hardware, the countdown information of the audio-visual associated hardware is determined based on the difference between the comprehensive advance time information and the hardware execution time information of the audio-visual associated hardware.

6. The vehicle hardware control method as described in claim 1 or 2, characterized in that, The control of the audio-visual association hardware corresponding to the countdown information to execute the audio-visual association response operation includes: The audio-visual associated hardware corresponding to the countdown information is triggered to execute the audio-visual associated response operation according to the response operation control information corresponding to the audio-visual associated hardware, wherein the response operation control information includes at least one of the following: execution time information and operation type information.

7. A vehicle hardware control device, characterized in that, include: The first determining module is used to determine the hardware response reference time information based on the current playback progress information and comprehensive advance time information of the audio-visual playback application in the vehicle. The second determining module is used to determine, based on the hardware response reference time information, whether there is at least one audio-visual associated hardware that needs to perform an audio-visual associated response operation. The third determining module is used to determine one or more countdown information based on the comprehensive advance time information and the execution time information of one or more hardware corresponding to each audio-visual associated hardware, if at least one audio-visual associated hardware needs to perform the audio-visual associated response operation. Each audio-visual associated hardware corresponds to one countdown information. The comprehensive advance time information is determined based on the execution time information of one or more hardware of one or more audio-visual associated hardware. The control module is used to control the audio-visual association hardware corresponding to any of the countdown information to perform the audio-visual association response operation when the countdown ends.

8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the vehicle hardware control method as described in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the vehicle hardware control method as described in any one of claims 1 to 6.

Images