Intelligent IP periphery and virtual character interaction system based on near field communication and AI technology

Abstract

The invention relates to the technical field of near field communication and artificial intelligence, in particular to an intelligent IP peripheral and virtual character interaction system based on near field communication and AI (artificial intelligence) technology, which comprises an IP peripheral product subsystem, an NFC (near field communication) information subsystem, a user authentication subsystem, a virtual character simulation subsystem and an intelligent interaction subsystem, the NFC information subsystem obtains label information in an IP peripheral product NFC label based on the IP peripheral product subsystem; the user authentication subsystem judges a user account condition based on the label information and performs a user authentication program to obtain a user authentication result; the virtual character simulation subsystem associates a virtual character corresponding to the IP peripheral product according to the label information and the user authentication result, and simulates an interactive interface and voice of the virtual character; and the intelligent interaction subsystem receives a user touch operation signal, and updates and renders virtual role model parameters in combination with the touch operation signal, an interaction interface and a voice simulation result so as to realize real-time interaction feedback between the virtual role corresponding to the IP peripheral product and the user.

Description

Technical Field

[0001] The present invention relates to the field of near field communication and artificial intelligence technology, and in particular to an intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology. Background Art

[0002] Most of the related physical peripheral products are limited to the single function of collection and display, and fail to fully meet the user's pursuit of deep interactive experience. At the same time, in the field of information services, enterprises and institutions are also facing an urgent need to improve user experience. Traditional signboards and manual service methods have obvious shortcomings in efficiency and cost.

[0003] With the development of artificial intelligence technology, virtual character interactive applications have gradually improved, bringing new interactive experiences to users. However, existing virtual character interactive applications require users to perform cumbersome operation processes, such as manually opening mobile applications and selecting specific characters for interaction, which not only affects the smoothness of the user experience, but also reduces the user retention rate. Therefore, there is an urgent need for a system that perfectly integrates physical IP peripheral products with virtual character interactions to meet users' dual needs for high interactivity and convenience.

[0004] In addition, in public service places such as government and enterprise reception desks, hospitals, etc., traditional manual guidance and consulting service methods can no longer meet the fast-paced needs of modern society. Efficient and convenient human-computer interaction methods are also needed to replace traditional manual service models.

[0005] Furthermore, in the current market and technological development context, there is a need for a method that combines physical IP peripheral products with virtual character interactions to enhance the interactivity and convenience of user experience; at the same time, it can provide efficient and convenient human-computer interaction methods in public service places to replace traditional manual service models, further bringing new changes and development opportunities to the cultural and creative industries and information service fields. Summary of the invention

[0006] In view of the shortcomings of existing methods and the needs of practical applications, in order to combine physical IP peripheral products with virtual character interactions, improve the interactivity and convenience of user experience; at the same time, provide an efficient and convenient human-computer interaction method in public service places. On the one hand, the present invention provides an intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology, and the system includes: an IP peripheral product subsystem, an NFC information subsystem, a user authentication subsystem, a virtual character simulation subsystem and an intelligent interaction subsystem; the NFC information subsystem obtains the tag information in the NFC tag of the IP peripheral product based on the IP peripheral product subsystem; the user authentication subsystem determines the user account status based on the tag information, performs a user authentication procedure based on the user account status, and obtains the user authentication result; the virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result, and simulates the interactive interface and interactive voice of the virtual character; the intelligent interaction subsystem receives the user's touch operation signal, and updates and renders the model parameters of the virtual character in combination with the touch operation signal, the interactive interface simulation result and the interactive voice simulation result, so as to realize the real-time interactive feedback between the virtual character corresponding to the IP peripheral product and the user.

[0007] The intelligent IP peripheral and virtual character interaction system based on near-field communication and AI technology provided by the present invention not only improves the interactivity and convenience of user experience, but also expands the application scenarios and service quality of IP peripheral products, providing a new development direction for the development of the cultural and creative industries.

[0008] Optionally, the intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology also includes: designing physical peripheral products in the IP peripheral product subsystem, and the physical peripheral products include: figures, standees, key chains, badges, cards, stationery, and clothing accessories; and setting NFC tags on the surface or inside of the physical peripheral products. The present invention can automatically trigger the interaction with the virtual character as long as the device with NFC function is close to the physical peripheral product, which enhances the fun and attractiveness of the product and provides users with a diverse interactive experience.

[0009] Optionally, the NFC information subsystem acquires the tag information in the NFC tag of the IP peripheral product based on the IP peripheral product subsystem, including: presetting a near field information trigger mechanism; based on the near field information trigger mechanism, the NFC information subsystem monitors the NFC signal of the NFC tag of the IP peripheral product and obtains the NFC monitoring signal; analyzes the NFC tag logic according to the NFC monitoring signal; parses the NFC tag data based on the NFC tag logic and acquires the NFC tag ID; acquires the tag information in the NFC tag of the IP peripheral product according to the NFC tag ID. The NFC information subsystem of the present invention acquires the tag information of the IP peripheral product through a series of steps, which not only improves the accuracy and efficiency of information acquisition, but also enhances the stability and reliability of the system, and expands the application scenarios and business models.

[0010] Optionally, the user authentication subsystem determines the user account status based on the tag information, and performing a user authentication procedure based on the user account status includes: the user authentication subsystem receives and processes the tag information and obtains a tag information processing result; determines the user account status according to the tag information processing result; and performs a user authentication procedure based on the user account status, wherein the user authentication procedure includes a binding authentication interface, a dialogue interface, and a startup interface. The present invention identifies user account information based on tag information, ensures the accuracy of user authentication results, and further enhances the security of the system.

[0011] Optionally, the virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result, including: calling the HttpRequestUtil.bindNFCTag method; sending a binding request signal based on the HttpRequestUtil.bindNFCTag method, the tag information and the user authentication result; associating the NFC tag with the virtual character according to the binding request signal, and obtaining the virtual character corresponding to the IP peripheral product. The present invention can select or customize a virtual character that matches the user's preferences and the characteristics of the IP peripheral product, thereby enhancing the sense of immersion and substitution during use, and improving the fun and participation of the interaction.

[0012] Optionally, the simulation of the interactive interface and interactive voice of the virtual character includes: setting a virtual character interactive interface and a voice interaction module in the virtual character simulation subsystem; the virtual character interactive interface simulates the image, lip shape, expression and action of the virtual character based on Live2D / 3D technology; the voice interaction module simulates the voice communication between the virtual character and the user based on the voice recognition function and the voice synthesis function. The present invention sets up a virtual character interactive interface and a voice interaction module, which can significantly improve the realism of the user experience, expand application scenarios and usage modes, and enhance the brand image and market competitiveness.

[0013] Optionally, the intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology also includes: setting a touch interaction module, a delegated management module, a view module, a model manager and a virtual character model in the intelligent interaction subsystem. The intelligent interaction subsystem of the present invention adopts a modular design method, and each module is relatively independent, which is convenient for system maintenance and upgrading. At the same time, the system can add or delete modules according to actual needs, which improves the flexibility and scalability of the system.

[0014] Optionally, the intelligent interaction subsystem receiving the user's touch operation signal includes: the intelligent interaction subsystem using the touch interaction module to obtain and receive the user's touch operation signal; the intelligent interaction subsystem transmits a touch event based on the touch operation signal. The touch operation of the present invention is an intuitive user interaction method. The system can instantly identify and respond to the user's touch operation and provide instant feedback, so that the user can quickly obtain the required information or services.

[0015] Optionally, the updating and rendering of the model parameters of the virtual character by combining the touch operation signal, the interactive interface simulation result and the interactive voice simulation result includes: the intelligent interactive subsystem receives and transmits the touch event through the delegated management module; the view module in the intelligent interactive subsystem receives the touch event, processes the touch event to obtain touch logical coordinates, and outputs drag information; the model manager receives the drag information, and updates the drag parameters of the virtual character based on the drag information. The interactive interface simulation results of the present invention can be adjusted and modified according to the user's preferences and habits, so that the user can better interact with the virtual character.

[0016] Optionally, the intelligent interaction subsystem receives the user's touch operation signal, and updates and renders the model parameters of the virtual character in combination with the touch operation signal, the interactive interface simulation result, and the interactive voice simulation result, so as to realize the real-time interactive feedback between the virtual character corresponding to the IP peripheral product and the user, including: introducing the setDragging method and the update method in the intelligent interaction subsystem; updating the facial parameters of the virtual character according to the setDragging method, the update method, and the dragging parameters; rendering the virtual character in combination with the interactive interface simulation result, the interactive voice simulation result, and the updated facial parameters, and displaying the updated rendered virtual character on the screen to realize the real-time interactive feedback between the virtual character and the user. The system of the present invention can instantly receive and process the user's touch operation signal, thereby realizing the real-time update of the virtual character model parameters, ensuring that the user can immediately see the reaction of the virtual character during the operation, and improving the real-time nature of the interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a flow chart of the intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology of the present invention; Figure 2 The NFC signal monitoring code of the present invention; Figure 3 The NFC tag logic parsing code of the present invention; Figure 4 Extracting code for the NFC tag ID of the present invention; Figure 5 The NFC tag information acquisition code of the present invention; Figure 6 Extracting code for user account information of the present invention; Figure 7 A user account status determination code of the present invention; Figure 8 The binding request code of the present invention; Fig. 9 A virtual character simulation code of the present invention; Fig.10 Configuration code for expression parameters of the present invention; Fig.11 is the lip parameter control code of the present invention; Fig.12 The touch event capture code of the present invention; Fig.13 A touch event delivery code for the present invention; Fig.14 The touch logic coordinate analysis code of the present invention; Fig.15 A virtual character parameter update code of the present invention; Fig.16 The present invention is a schematic diagram of the structure of the intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology. DETAILED DESCRIPTION

[0018] The specific embodiments of the present invention will be described in detail below. It should be noted that the embodiments described herein are only for illustration and are not intended to limit the present invention. In the following description, a large number of specific details are set forth in order to provide a thorough understanding of the present invention. However, it is obvious to those of ordinary skill in the art that these specific details do not need to be adopted to implement the present invention. In other examples, in order to avoid confusing the present invention, known circuits, software or methods are not specifically described.

[0019] Throughout the specification, references to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment," "in an embodiment," "an example," or "an example" appearing in various places throughout the specification do not necessarily all refer to the same embodiment or example. In addition, particular features, structures, or characteristics may be combined in one or more embodiments or examples in any suitable combination and / or subcombination. In addition, it should be understood by those of ordinary skill in the art that the figures provided herein are for illustrative purposes and that the figures are not necessarily drawn to scale.

[0020] See also Figure 1 In order to enhance the interactivity of physical IP peripheral products, simplify the interaction process between users and virtual characters, realize personalized and continuous interaction, and expand the application scenarios of physical peripheral products. The present invention provides an intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology, and the above-mentioned intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology includes the following steps: The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology is set up with: IP peripheral product subsystem, NFC information subsystem, user authentication subsystem, virtual character simulation subsystem and intelligent interaction subsystem.

[0021] S1. The NFC information subsystem obtains the tag information in the NFC tag of the IP peripheral product based on the IP peripheral product subsystem. The specific setting steps and implementation contents are as follows: In the embodiment, physical peripheral products are designed in the IP peripheral product subsystem, and the above-mentioned physical peripheral products mainly include figures, standees, key chains, badges, cards, stationery, and clothing accessories; at the same time, corresponding NFC tags are set on the surface or inside of the above-mentioned physical peripheral products.

[0022] The above-mentioned IP peripheral product subsystem covers a variety of physical peripheral products, including but not limited to action figures, stand decorations, keys, ornaments, badge collections, cards, stationery and clothing accessories. The relevant physical peripheral products not only have ornamental and practical value, but also have NFC (near field communication) tags embedded on the surface or inside of the physical peripheral products.

[0023] In an optional embodiment, NFC tags are embedded in physical products such as figures, standees, pendants, and even display boards and signboards in public places are equipped with NFC functions, so that users can easily interact with related physical products using only NFC-enabled smartphones or tablets.

[0024] In order to ensure the actual performance of the IP peripheral product subsystem, a dedicated mobile terminal device application is also provided to users. The above program supports NFC function and can interact conveniently through mini-programs. Users only need to bring the mobile terminal device close to the physical peripheral product to trigger interactive actions, such as viewing detailed information of the virtual character, unlocking special content, etc.

[0025] In addition, the server side of the system plays an important role in the interaction process. It is composed of multiple parts such as database, business logic layer, artificial intelligence engine and memory layer components. It is responsible for processing user requests and generating virtual character responses based on user operations. It not only ensures the smoothness and real-time nature of the interaction, but also provides users with a more intelligent and personalized experience through artificial intelligence technology.

[0026] An NFC tag integration solution is provided in the embodiment.

[0027] Advanced near field communication (NFC) tags such as Ntag213 / 215 / 216 are used. The above tags have a unique identifier (UID) to ensure the uniqueness of each tag. During the production process, the specific URI Scheme or application package name and the tag's UID are written into the NFC tag. This design not only allows each tag to have specific information, but also provides users with a convenient way to interact with the tag.

[0028] At the same time, the NFC tag adopts a backing adhesive design, which improves the practicality and convenience of the tag. Users can easily achieve NFC interaction by simply sticking the tag on various physical peripheral products or public facilities. Whether it is a figurine, a stand, a sign or a display board, it can be seamlessly connected to the user's smart device through the NFC tag, bringing users a more colorful interactive experience.

[0029] The IP peripheral product subsystem not only adopts advanced NFC technology, but also focuses on the practicality and convenience of the tags. Through the NFC tag integration solution, users can easily apply NFC tags to various scenarios, thereby providing more intelligent, personalized and convenient services.

[0030] In this embodiment, a near-field information trigger mechanism is preset.

[0031] Based on the above-mentioned near-field information trigger mechanism, the NFC information subsystem monitors the NFC signal of the NFC tag of the above-mentioned IP peripheral product and obtains the NFC monitoring signal; then, the NFC tag logic is analyzed according to the NFC monitoring signal; then, the NFC tag data is parsed based on the NFC tag logic and the NFC tag ID is obtained; finally, the tag information in the NFC tag of the IP peripheral product is obtained according to the NFC tag ID.

[0032] The specific process of the NFC information subsystem obtaining NFC tag information is as follows: First, the NFC information subsystem starts the NFC signal monitoring function, which is implemented by declaring NFC permissions and intent filters in the AndroidManifest.xml file of the Android application. For related codes, see Figure 2 , which clearly states that the application requires NFC functionality and implements the NFC signal monitoring logic in the NfcHandlerActivity class.

[0033] When the NFC information subsystem successfully monitors the NFC signal, it will enter the tag information reading stage. In the handleIntent method, the system will check whether the received intent is NFC_NDEF_DISCOVERED. If so, the system will extract the NDEF message from the intent. For the relevant code of the above steps, please refer to Figure 3 .

[0034] Next, the NFC information subsystem uses the extractNFCTagDataFromNDEFMessage method to parse the data in the NDEF message. The above method iterates through the NDEF records, looking for records of type T (text), and extracts the NFC tag ID from them. For the code related to this step, see Figure 4 .

[0035] Finally, when the NFC tag ID is parsed, the NFC information subsystem calls the fetchNFCTagInfoFromServer method to obtain the complete NFC tag information by sending a request to the server. For the relevant code of the above steps, see Figure 5, which uses the HttpRequestUtil.fetchNFCTagInfo method to send a request to the server and receive the NFC tag details returned by the server.

[0036] In summary, the NFC information subsystem implements a series of steps such as monitoring NFC signals, reading tag information, parsing NFC tag data, and obtaining NFC tag information, thereby realizing the complete identification and information extraction of NFC tags of IP peripheral products. The above process is not only efficient but also accurate, providing users with a more convenient and intelligent interactive experience.

[0037] The method for obtaining NFC tag information of IP peripheral products in this embodiment is only an optional implementation of the present invention. In one or some other embodiments, the data acquisition method can be adjusted according to actual data requirements and IP peripheral product conditions. By adjusting the data acquisition method, it can be ensured that the system can adapt to different types of IP peripheral products and data change requirements, so that the system can be widely used in various scenarios and fields.

[0038] S2. The user authentication subsystem determines the user account status based on the tag information, performs the user authentication procedure based on the user account status, and obtains the user authentication result. The specific setting steps and implementation contents are as follows: The user authentication subsystem receives and processes the tag information and obtains the tag information processing result; then, the user account status is determined based on the tag information processing result; finally, the user authentication procedure is performed based on the user account status. The user authentication procedure mainly includes a binding authentication interface, a dialogue interface and a startup interface.

[0039] During the operation of the user authentication subsystem, a series of steps are taken in the embodiment to ensure the accuracy and security of the user identity. The above process starts with the user authentication subsystem receiving and processing the NFC tag information until the user authentication procedure is completed. The specific setting steps and implementation contents are as follows: First, the user authentication subsystem receives the NFC tag information from the NFC information subsystem and processes it. The above steps are aimed at extracting key user account information from the tag information, laying a solid foundation for subsequent user authentication procedures. For related codes, please refer to Figure 6 ,based on Figure 6 The information shows that whether the tag is bound depends on whether the userId or roleId in the tag information exists. If the tag is not bound, the system will guide the user to the binding interface; otherwise, it will intelligently choose to jump to the dialogue interface or the startup interface based on the main activity status of the application.

[0040] In order to manage and use NFC tag information more efficiently, the NFCTagRemoteData class is defined to store tag data obtained from the server. This class covers many key attributes of NFC tags, including but not limited to tag ID, role ID, user ID, scenario description, and access times. For details, see Figure 7 ,The design of the above data structure is helpful for the storage, query and processing of NFC tag information.

[0041] On the other hand, the binding function of NFC tags not only provides great convenience for users, but also opens up new possibilities for new interactive methods such as AR applications. Through this function, users can closely associate NFC tags with identities or roles in the virtual world, thereby achieving a more natural and smooth interactive experience.

[0042] In summary, the user authentication subsystem receives and processes NFC tag information, defines the tag data structure, and implements the NFC tag binding function, thereby building a user authentication process that is both secure and convenient. The above process not only improves the user experience, but also provides technical support for new applications such as AR.

[0043] The specific implementation steps of the user authentication program in this embodiment are only an optional condition of the present invention. In one or some other embodiments, the user authentication program can be optimized according to the virtual character interaction system conditions and tag information, which can reduce the user's operation steps and time, making it easier for the user to enter the virtual character interaction system, which can significantly improve user satisfaction and bring more active users to the system.

[0044] S3, the virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result, and simulates the interactive interface and interactive voice of the virtual character. The specific implementation content is as follows: The virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result.

[0045] First, you need to call the HttpRequestUtil.bindNFCTag method; then, send a binding request signal based on the HttpRequestUtil.bindNFCTag method, tag information and user authentication results; thereby associating the NFC tag with the virtual character according to the binding request signal, and obtaining the virtual character corresponding to the IP peripheral product.

[0046] After the user authentication process is completed, the virtual role simulation subsystem implements the virtual role binding function in the BindingProcessFragment class. For related code, see Figure 8, when the user chooses to associate the NFC tag with a specific character, the system will call the HttpRequestUtil.bindNFCTag method to send a binding request to the server. After the server receives the request, it will perform the corresponding binding operation and return the complete tag information to the application; subsequently, the application will dynamically adjust its behavior based on the above information content to provide a more personalized user experience.

[0047] Furthermore, the interaction interface and interaction voice of the virtual character are simulated.

[0048] Set up a virtual character interaction interface and a voice interaction module in the virtual character simulation subsystem; the virtual character interaction interface simulates the image, lip movement, expression, and actions of the virtual character based on Live2D / 3D technology; the voice interaction module simulates the situation of the virtual character communicating with the user based on the voice recognition function and the voice synthesis function.

[0049] In the virtual character simulation subsystem, a virtual character interaction interface and a voice interaction module are designed to provide an immersive user experience. The virtual character interaction interface mainly uses Live2D / 3D technology to simulate the virtual character image, including but not limited to its lip movement changes, expression situations, and action performances.

[0050] In terms of image display, Live2D / 3D technology is used to achieve high-precision rendering of the virtual character. Through the models and animations designed in the embodiments, the image of the virtual character is presented to the user.

[0051] To enhance the interactivity of the system, the generation and detection of virtual character expressions and actions are further carried out. In the embodiments, the corresponding generation model and detection model are designed and implemented, which can automatically generate corresponding expressions and actions according to the user's input or preset scenarios. That is, the Live2D expression file (.exp3.json) is used to define various expressions of the virtual character. The above expression file records the changes of key parameters such as eye opening and closing, mouth shape, and eyebrow angle, so as to enrich and improve the expression effect. For relevant code, please refer to Fig. 9 .

[0052] In an optional embodiment, in the app / src / main / assets / Alicia / expression16.exp3.json file, the parameter configuration information of a specific expression "staff" is defined. For relevant code, please refer to Fig.10 .

[0053] A parameter control method is used for lip sync. The key parameter mouthOpenY is used to precisely control the degree of opening and closing of the character's mouth, thereby achieving close synchronization with the virtual character's voice. In the rendering loop, the value of mouthOpenY is dynamically adjusted according to real-time audio input or preset data to ensure that the virtual character's mouth shape and voice are perfectly matched. For related codes, please refer to Fig.11 .

[0054] In addition, in order to achieve more natural facial expressions and eye movements of virtual characters, Live2D is also used to provide blinking and breathing functions. By initializing modules such as CubismEyeBlink and CubismBreath, blinking and breathing action effects are added to the virtual characters, further enhancing the realism and interactivity of the virtual characters.

[0055] In terms of the voice interaction module, based on speech recognition and speech synthesis technology, voice communication between virtual characters and users is realized. Users can interact with virtual characters through voice commands, and virtual characters can respond and take actions according to user input. The above functions not only enhance the user's sense of immersion, but also provide users with a more convenient and natural way of interaction. The specific code is as follows: ```java:app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumModel.java CubismEyeBlink eyeBlink; / / Automatic blinking CubismBreath breath; / / Automatic breathing Furthermore, the analysis step of the interaction simulation of the virtual character in the embodiment is only an optional condition of the present invention. In one or some other embodiments, the virtual character interaction simulation step can be adjusted according to the virtual character interaction requirements and the actual needs of the user. In different application scenarios, the virtual character interaction simulation step can be flexibly adjusted and optimized according to the specific interaction requirements of the virtual character and the actual needs of the user, providing the user with a more realistic, natural and immersive interaction experience.

[0056] S4. The intelligent interaction subsystem receives the user's touch operation signal, and updates and renders the model parameters of the virtual character in combination with the touch operation signal, the interactive interface simulation result, and the interactive voice simulation result, so as to realize the real-time interactive feedback between the virtual character corresponding to the IP peripheral product and the user. The specific steps and implementation contents are as follows: The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology also includes a touch interaction module, a delegation management module, a view module, a model manager and a virtual character model in the intelligent interaction subsystem.

[0057] The intelligent IP peripheral and virtual character interaction system based on near field communication (NFC) and artificial intelligence technology (AI) is equipped with the following key modules in its internal integrated intelligent interaction subsystem, each of which has specific functional responsibilities: The touch interaction module is used to capture the user's touch actions.

[0058] In the MainActivityMinimum activity class, the touch coordinate information is obtained by listening to the onTouchEvent method, and then the above information is passed to the LAppMinimumDelegate proxy class for further processing.

[0059] The delegate management module is responsible for delegating touch events to appropriate processing units.

[0060] LAppMinimumDelegate receives coordinate information from the touch sensing module and calls the corresponding method of the LAppMinimumView view class to respond to touch events based on the relevant information.

[0061] The view module processes touch events at the view level and performs coordinate conversion.

[0062] After receiving a touch event, LAppMinimumView first converts the coordinates in the device coordinate system to the coordinates in the view coordinate system, then manages the touch state and triggers the onDrag method in the model manager to respond to the drag action.

[0063] The model manager is responsible for updating drag parameters and dynamically adjusting the model.

[0064] As a model controller, LAppMinimumLive2DManager receives drag information and calls the setDragging method of the virtual character model to apply the drag effect. At the same time, LAppMinimumModel adjusts parameters such as the model's facial orientation according to the current drag parameters in its update method to achieve dynamic visual feedback.

[0065] The virtual character model is responsible for rendering and displaying the updated model.

[0066] After the model controller updates the model, the virtual character will generate corresponding visual feedback based on the user's touch operation, such as changes in facial expressions or adjustments in body posture, thereby providing users with a better interactive experience.

[0067] Through the collaborative work of the above modules, the entire intelligent interaction subsystem realizes a complete closed loop from user touch input to system response to visual feedback, improving the fluency and realism of the interaction between users and virtual characters.

[0068] Furthermore, the specific implementation steps and contents of the above different modules are as follows: The intelligent interaction subsystem receives the user's touch operation signal. The intelligent interaction subsystem obtains and receives the user's touch operation signal using the touch interaction module; the intelligent interaction subsystem transmits the touch event based on the touch operation signal.

[0069] The intelligent interaction subsystem has the ability to receive touch operation signals. The above ability mainly relies on its built-in touch interaction module. When the user interacts with the screen by touch, the touch interaction module will quickly capture and receive the touch signal from the user.

[0070] In the touch event capture phase, the intelligent interaction subsystem adopts an efficient and accurate strategy. On the Android platform, the onTouchEvent method is rewritten in the Activity class to accurately capture user touch events. The above process occurs in the key file app / src / main / java / com / oto / whyucallmev11 / Live2D / MainActivityMinimum.java.

[0071] In the MainActivityMinimum class, the rewritten onTouchEvent method is not only responsible for capturing touch events, but also for passing touch coordinate information to the LAppMinimumDelegate processing class. The above transmission process ensures that touch events can be processed in a timely and effective manner, providing a solid data foundation for subsequent touch event responses and visual feedback. For related codes, please refer to Fig.12 .

[0072] The intelligent interaction subsystem can accurately receive and process the user's touch operation signals through its touch interaction module. On the Android platform, the above process mainly relies on the onTouchEvent method rewritten in the MainActivityMinimum class, and the effective collaboration between this method and the LAppMinimumDelegate processing class, which not only improves the smoothness and accuracy of user interaction, but also brings users a richer touch interaction experience.

[0073] The model parameters of the virtual character are updated and rendered in combination with the touch operation signal, the interactive interface simulation result and the interactive voice simulation result.

[0074] The intelligent interaction subsystem receives and transmits touch events through the delegate management module; the view module in the intelligent interaction subsystem receives touch events, processes the touch events to obtain touch logical coordinates, and outputs drag information; the model manager receives the drag information and updates the drag parameters of the virtual character based on the drag information.

[0075] LAppMinimumDelegate plays an important role as the core management class in the application. Its Activity receives touch events and accurately passes the events to the LAppMinimumView view class for further processing.

[0076] In the source file app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumDelegate.java, see Fig.13 Based on this, we can see that the LAppMinimumDelegate class plays an important role. When a touch event is captured and passed to LAppMinimumDelegate, it does not process it immediately, but passes the event seamlessly to LAppMinimumView, which not only improves the modularity and readability of the code, but also ensures that touch events can be processed efficiently and accurately.

[0077] LAppMinimumDelegate ensures that touch information flows smoothly from Activity to LAppMinimumView in the application, providing a basis for subsequent view processing and visual feedback.

[0078] LAppMinimumView is responsible for converting the device coordinates generated when the user touches the screen into logical coordinates (i.e., view coordinates) that are easier to understand and process in the application. The above conversion process ensures that the touch events can be accurately mapped to the view layer of the application, providing an accurate data basis for subsequent interaction logic.

[0079] In the key file app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumView.java, see the relevant code Fig.14, and we can know that LAppMinimumView implements the response to touch movement events. When the user's finger moves on the screen, the onTouchesMoved method will be triggered. The above method will first convert the received device coordinates (that is, the actual position of the touch point on the mobile phone screen) into view coordinates (that is, the position relative to LAppMinimumView).

[0080] After completing the coordinate conversion, LAppMinimumView does not directly process the user touch information, but passes the view coordinates containing the drag information to the model manager LAppMinimumLive2DManager. This is further implemented by calling LAppMinimumLive2DManager.getInstance().onDrag(viewX, viewY), where viewX and viewY represent the horizontal and vertical coordinates of the touch point in the view coordinate system, respectively.

[0081] As the core of model management, LAppMinimumLive2DManager will adjust the actions and postures of the virtual character according to the current interaction logic and model status after receiving the drag information. This process ensures that the user's touch operation can reflect the dynamic performance of the virtual character in real time, bringing users a more realistic and immersive interactive experience.

[0082] In the embodiment, LAppMinimumView converts the touch coordinates from the device coordinate system to the view coordinate system, and can also pass the drag information to the model manager, so that the touch events can be smoothly passed from the view layer to the model layer, providing technical support for subsequent model parameter updates and visual feedback.

[0083] LAppMinimumLive2DManager is the core component responsible for model management in the application. When receiving drag information from LAppMinimumView, LAppMinimumLive2DManager will take immediate action to ensure that relevant information can be accurately applied to the model.

[0084] In the key file app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumLive2DManager.java, you can see that LAppMinimumLive2DManager implements the response to drag information. Once the drag information is received, LAppMinimumLive2DManager will first parse the relevant information and extract the new position of the user's touch point.

[0085] Subsequently, LAppMinimumLive2DManager calls the model setDragging method and passes the parsed drag information as a parameter to the model. The above steps ensure that the model parameters can be updated in real time according to the user's touch operations.

[0086] The setDragging method will adjust the internal state of the model according to the incoming drag information, including but not limited to updating key parameters such as the model's coordinates, rotation angle, and scaling, to ensure that the model can accurately reflect the user's dragging intention.

[0087] Through the above process, LAppMinimumLive2DManager not only realizes the effective transmission between drag information and the model, but also ensures that the model responds to the user's touch operations in real time, bringing users a smoother and more natural interactive experience.

[0088] After receiving the drag information, LAppMinimumLive2DManager calls the model's setDragging method to implement real-time updates of the model's dragging parameters, thereby ensuring consistency and interactivity between the model and user touch operations.

[0089] The code related to the model manager updating the drag parameters of the model is as follows: ```java:app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumLive2DManager.java public void onDrag(float x, float y) { model.setDragging(x, y); } ``` The setDragging method and update method are introduced in the intelligent interaction subsystem.

[0090] The facial parameters of the virtual character are updated according to the setDragging method, the update method and the dragging parameters; the virtual character is further rendered in combination with the interactive interface simulation results, the interactive voice simulation results and the updated facial parameters, and the updated rendered virtual character is displayed on the screen to achieve real-time interactive feedback between the virtual character and the user.

[0091] In the update method of the LAppMinimumModel class, the model dynamically adjusts its internal state according to the drag parameters received from LAppMinimumLive2DManager. The above adjustment process ensures that the model can respond to the user's touch operations in real time, providing users with intuitive and natural interactive feedback.

[0092] In the key file app / src / main / java / com / oto / whyucallmev11 / Live2D / mini / LAppMinimumModel.java, the update method calculates the corresponding adjustments that the model should make based on the new position in the drag information. The above calculation process involves complex mathematical transformations and physical simulations to ensure that the model's actions are both in line with physical laws and can reflect the user's intentions. For related code, see Fig.15 .

[0093] exist Fig.15 In the code snippet shown, we can clearly see that the model updates its facial orientation parameters according to the drag information. That is, the model adjusts the facial ANGLE_X and ANGLE_Y parameters according to the horizontal and vertical drag distances of the user. The above two parameters control the rotation angle of the model head in the horizontal and vertical directions respectively.

[0094] By adjusting the above two parameters, the model can follow the user's dragging operation in real time and present the corresponding head rotation effect on the screen, which not only enhances the vividness and interactivity of the virtual character, but also brings a more immersive touch interaction experience to users.

[0095] Through its update method, LAppMinimumModel dynamically adjusts key parameters such as the model's facial orientation according to the drag parameters received from LAppMinimumLive2DManager, and presents the adjustment results on the screen in real time through the rendering process, thereby achieving real-time interaction and feedback with user touch operations.

[0096] Finally, rendering is performed. After the model parameters are updated, the above changes are presented on the screen in real time through the rendering process. The above steps help to achieve the final realization of the complete interaction process from user touch operation to virtual character feedback.

[0097] When the update method of LAppMinimumModel completes the adjustment of the internal state of the model according to the drag parameters, the above changes will not be immediately visible to the user. In order to allow the user to intuitively feel the dynamic changes of the model, the updated model data is passed to the rendering engine for real-time rendering.

[0098] The rendering engine will calculate the corresponding image information based on the new state of the model and draw it to the screen. The above process ensures that users can instantly see the model's response to touch operations, whether it is a slight turn of the head or other changes in movement.

[0099] Through the rendering display process, users can not only obtain instant visual feedback, but also participate more deeply in the interaction with the virtual characters. The real-time and intuitive feedback mechanism enhances the user experience and interactivity.

[0100] In the embodiment, the intelligent IP peripheral and virtual character interaction system works together through a series of modules to achieve accurate response to user touch operations and display real-time dynamic feedback of virtual characters. The above implementation steps describe in detail the entire process from initial capture of touch events, to touch information processing, to dynamic update of virtual character parameters and final rendering. The relevant algorithms and steps build a complete and efficient interaction mechanism, allowing users to intuitively feel the real-time interaction with virtual characters.

[0101] The capture of touch events is the starting point of the entire interaction process, which ensures that the user's operation can be accurately recognized by the system. Subsequently, the touch information is converted into parameters that the model can understand through a series of processing. The above parameters are then used to update the internal state of the virtual character, so that it can make feedback actions corresponding to the user's touch operation.

[0102] Finally, after real-time processing by the rendering engine, the updated virtual character status is converted into image information and presented on the screen, which not only provides users with intuitive visual feedback, but also greatly enhances the immersion and interactivity of the user experience.

[0103] See also Fig.16 In an optional embodiment, the present invention further provides an intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology, the system includes an IP peripheral product subsystem, an NFC information subsystem, a user authentication subsystem, a virtual character simulation subsystem and an intelligent interaction subsystem, and performs the specific steps of the intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology and related embodiments provided by the present invention. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology of the present invention has a complete structure, is objective and stable, and can efficiently perform the specific steps of the present invention, thereby improving the overall applicability and practical application ability of the present invention.

[0104] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention.

Claims

1. Intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology, characterized by: The intelligent IP peripheral and virtual character interaction system using near field communication and AI technology includes: an IP peripheral product subsystem, an NFC information subsystem, a user authentication subsystem, a virtual character simulation subsystem, and an intelligent interaction subsystem; The NFC information subsystem obtains tag information in the NFC tag of the IP peripheral product based on the IP peripheral product subsystem; The user authentication subsystem determines the user account status based on the tag information, performs a user authentication procedure based on the user account status, and obtains a user authentication result; The virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result, and simulates the interactive interface and interactive voice of the virtual character; The intelligent interaction subsystem receives the user's touch operation signal, and updates and renders the model parameters of the virtual character in combination with the touch operation signal, the interaction interface simulation result and the interaction voice simulation result, so as to realize real-time interaction feedback between the virtual character corresponding to the IP peripheral product and the user.

2. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 1 is characterized in that: The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology also includes: Design physical peripheral products in the IP peripheral product subsystem, wherein the physical peripheral products include: figurines, standees, key chains, badges, cards, stationery, and clothing accessories; An NFC tag is arranged on the surface or inside of the physical peripheral product.

3. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 1 is characterized in that: The NFC information subsystem acquires tag information in the NFC tag of the IP peripheral product based on the IP peripheral product subsystem, including: Preset near-field information trigger mechanism; Based on the near field information trigger mechanism, the NFC information subsystem monitors the NFC signal of the NFC tag of the IP peripheral product and obtains the NFC monitoring signal; Analyzing NFC tag logic according to the NFC monitoring signal; Parse NFC tag data based on the NFC tag logic and obtain the NFC tag ID; The tag information in the NFC tag of the IP peripheral product is obtained according to the NFC tag ID.

4. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 1 is characterized in that: The user authentication subsystem determines the user account status based on the tag information, and performs a user authentication procedure based on the user account status, including: The user authentication subsystem receives and processes the tag information, and obtains a tag information processing result; Determine the user account status according to the tag information processing result; A user authentication procedure is performed based on the user account situation, and the user authentication procedure includes a binding authentication interface, a dialogue interface and a startup interface.

5. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 1 is characterized in that: The virtual character simulation subsystem associates the virtual character corresponding to the IP peripheral product according to the tag information and the user authentication result, including: Call HttpRequestUtil.bindNFCTag method; Sending a binding request signal based on the HttpRequestUtil.bindNFCTag method, the tag information and the user authentication result; The NFC tag is associated with the virtual character according to the binding request signal, and the virtual character corresponding to the IP peripheral product is obtained.

6. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 5 is characterized in that: The simulating of the interactive interface and interactive voice of the virtual character includes: Setting a virtual character interaction interface and a voice interaction module in the virtual character simulation subsystem; The virtual character interaction interface simulates the image, lip shape, expression and movement of the virtual character based on Live2D / 3D technology; The voice interaction module simulates the voice communication between the virtual character and the user based on the voice recognition function and the voice synthesis function.

7. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 1 is characterized in that: The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology also includes: A touch interaction module, a delegation management module, a view module, a model manager and a virtual role model are set in the intelligent interaction subsystem.

8. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 7 is characterized in that: The intelligent interaction subsystem receiving a user's touch operation signal includes: The intelligent interaction subsystem obtains and receives a user's touch operation signal by using the touch interaction module; The intelligent interaction subsystem transmits a touch event based on the touch operation signal.

9. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 8 is characterized in that: The updating and rendering of the model parameters of the virtual character in combination with the touch operation signal, the interactive interface simulation result and the interactive voice simulation result includes: The intelligent interaction subsystem receives and transmits the touch event through the delegated management module; The view module in the intelligent interaction subsystem receives the touch event, processes the touch event to obtain touch logical coordinates, and outputs drag information; The model manager receives the drag information, and updates the drag parameters of the virtual character based on the drag information.

10. The intelligent IP peripheral and virtual character interaction system based on near field communication and AI technology according to claim 9 is characterized in that: The intelligent interaction subsystem receives the user's touch operation signal, and updates and renders the model parameters of the virtual character in combination with the touch operation signal, the interactive interface simulation result, and the interactive voice simulation result, so as to realize the real-time interactive feedback between the virtual character corresponding to the IP peripheral product and the user, including: Introduce the setDragging method and the update method in the intelligent interaction subsystem; Update the facial parameters of the virtual character according to the setDragging method, the update method and the dragging parameters; The virtual character is rendered in combination with the interactive interface simulation results, the interactive voice simulation results, and the updated facial parameters, and the updated rendered virtual character is displayed on the screen to achieve real-time interactive feedback between the virtual character and the user.

Images