Smart packaging digital human multi-modal interaction system and method based on NFC triggering

The NFC-triggered smart packaging digital human multimodal interaction system solves the problems of single data storage, single interaction mode, insufficient digital human expressiveness, poor real-time performance, and insufficient privacy compliance in smart packaging. It realizes multimodal interaction, enhanced digital human expressiveness, improved real-time performance, and guaranteed privacy compliance, and is applicable to various types of commodity packaging.

CN122336210APending Publication Date: 2026-07-03HUZHOU HEPIN NETWORK TECHNOLOGY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
HUZHOU HEPIN NETWORK TECHNOLOGY CO LTD
Filing Date
2026-03-22
Publication Date
2026-07-03

AI Technical Summary

Technical Problem

Existing smart packaging technologies suffer from problems such as limited data storage, limited interaction modes, insufficient digital human expressiveness, poor real-time performance, low system integration, and inadequate privacy compliance, failing to meet users' diverse interaction needs and privacy protection requirements.

Method used

The system employs an NFC-triggered intelligent packaging digital human multimodal interaction system, comprising an NFC triggering unit, a context parsing unit, a multimodal interaction unit, a digital human rendering unit, an AR immersive experience unit, an intelligent decision-making unit, and a synchronization control unit. It stores structured context data through an NTAG 424 DNA chip, supports multimodal interaction, and uses FastSpeech2 and HiFi-GAN technologies for digital human rendering. It achieves local voice processing and anonymized data transmission, and coordinates the working sequence of each unit to improve system integration and real-time performance.

Benefits of technology

It achieves enhanced multimodal interaction capabilities, improved digital human expressiveness, improved real-time performance, guaranteed privacy compliance, and low-cost widespread adoption. The interaction response time is ≤1.8 seconds, the lip-sync accuracy is ≤100ms, the total time is ≤2.7 seconds, it complies with privacy protection regulations, and is suitable for various product packaging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FT_1
    Figure FT_1
  • Figure FT_2
    Figure FT_2
  • Figure FT_3
    Figure FT_3
Patent Text Reader

Abstract

This invention discloses an NFC-triggered smart packaging digital human multimodal interaction system and method, belonging to the field of smart packaging and human-computer interaction technology. The system includes an NFC triggering unit, a context parsing unit, a multimodal interaction unit, a digital human rendering unit, an AR immersive experience unit, an intelligent decision-making unit, and a synchronization control unit. The system stores structured context data through an NFC chip. When a user device approaches the packaging, a communication connection is automatically established, context information is parsed, the digital human model is activated, and an AR immersive scene is constructed, realizing audio-driven facial animation technology, multimodal interaction, and synchronization control. This invention is specifically designed for smart packaging scenarios, differing from general digital human interaction systems and general authentication schemes. It solves the technical problems of traditional smart packaging, such as single interaction, long activation time, fragmented user experience, and insufficient privacy compliance. It achieves a time of ≤2.7 seconds from NFC triggering to system activation, lip-sync accuracy of ≤100ms, and interaction response time of ≤1.8 seconds, and can be applied to scenarios such as product culture explanation and brand marketing.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Virtual digital human generation and interaction optimization system based on multi-modal data fusion

    CN119888027A