The invention discloses an automobile cabin
software control method and
system based on multi-mode interaction, and relates to the field of multi-mode data, and the method comprises the steps: S1, multi-source
signal synchronous collection and
timestamp calibration; a user voice instruction, a gesture track and eye
fixation point information are collected in real time through a distributed
sensor array; according to sensor data, a three-level synchronization architecture is combined with a PTP precise
time protocol to achieve
microsecond-level
clock synchronization, a unified time service
timestamp is embedded in a data packet header, and the
timestamp error is controlled within + / -0.5 ms; s2, dynamic environment interference compensation; the method comprises the following steps: constructing an
environmental noise perception model; the construction of the
environmental noise perception model comprises the following steps: starting a regional strong light suppression
algorithm for a strong light scene with the illumination intensity greater than 10,000
lux; activating a motion compensation module for a bumpy scene with a
vertical acceleration greater than 0.3 g, and outputting an environment compensation multi-
modal data stream; s3, analyzing time-space association
semantics; and S4, confidence decision and instruction execution.