Electronic product box opening setting guidance system, method and terminal based on artificial intelligence

Abstract

The invention discloses an electronic product box opening setting guidance system and method based on artificial intelligence and an intelligent mobile terminal, the guidance system comprises the intelligent mobile terminal and a model server, the model server is configured with a generative artificial intelligence big language model, and the intelligent mobile terminal is provided with a client program with a plurality of demonstration pages. The intelligent mobile terminal plays the demonstration page through the client program to guide a user to carry out box opening setting operation on the electronic product, obtains interaction information between the user and the client program in the box opening setting process, and sends a text generated based on the interaction information to the model server; the model server analyzes the text through the generative artificial intelligence large language model and returns an analysis result to the intelligent mobile terminal, and the intelligent mobile terminal determines a target demonstration page according to the analysis result and plays the target demonstration page. The box opening setting and using efficiency of the electronic product can be improved, and the viscosity of the product is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of smart glasses technology, and more particularly to an electronic product unpacking and setting guidance system, method and smart mobile terminal based on artificial intelligence. Background Art

[0002] Unboxing refers to the process of users opening the packaging box after purchasing the product, taking out the electronic products packaged therein, and then assembling and setting up the electronic products. With the development of computer technology, smart electronic products are becoming more and more popular, and the structure and functions of smart electronic products are becoming more and more complex. However, existing paper manuals usually only have a few words, and it is difficult for users to get effective help from paper manuals during the unboxing of electronic products. In particular, when the manual description is unclear, the electronic product setup process is difficult, or technical failures are encountered, users are often unable to correctly set up and use the electronic products, which affects the efficiency of unboxing, setting up and using the electronic products, causing users to have some unpleasant feelings and experiences with the electronic products, thereby reducing product stickiness. Summary of the invention

[0003] The embodiments of the present application provide an electronic product unpacking and setting guidance system, method and intelligent mobile terminal based on artificial intelligence, which are used to improve the efficiency of electronic product unpacking, setting and use, and increase product stickiness.

[0004] On the one hand, an embodiment of the present application provides an electronic product unpacking and setting guidance system based on artificial intelligence, the system comprising: an intelligent mobile terminal and a model server, wherein a generative artificial intelligence large language model is configured on the model server, and a client program with multiple demonstration pages is installed on the intelligent mobile terminal;

[0005] The smart mobile terminal is used to play the demonstration page through the client program to guide the user to perform unpacking and setting operations on the electronic product, obtain the interaction information between the user and the client program during the unpacking and setting process, and send the text generated based on the interaction information to the model server;

[0006] The model server is used to parse the text through the generative artificial intelligence large language model and return the parsing result to the smart mobile terminal;

[0007] The intelligent mobile terminal is further used to determine a target demonstration page according to the analysis result, and play the target demonstration page.

[0008] On one hand, an embodiment of the present application further provides an electronic product unpacking and setting guidance method based on artificial intelligence, which is applied to a smart mobile terminal, and the method includes:

[0009] Playing a preset demonstration page through a client program installed on the smart mobile terminal to guide the user to perform unpacking and setting operations on the electronic product, wherein the client program has a plurality of the demonstration pages;

[0010] Acquire the interaction information between the user and the client program during the unboxing and setting process, and send the text generated based on the interaction information to the model server, so that the model server parses the text through the generative artificial intelligence large language model, and returns the parsing result to the smart mobile terminal;

[0011] A target demonstration page is determined according to the analysis result, and the target demonstration page is played.

[0012] In one aspect, an embodiment of the present application further provides an intelligent mobile terminal, characterized in that it includes: a processor and a non-transitory storage electrically connected to the processor, a wireless communication device, an input device, and an output device;

[0013] The non-transitory storage stores one or more computer programs executable by the processor, wherein the computer programs include a plurality of instructions for:

[0014] Playing a demonstration page in the client program through the output device to guide the user to perform unpacking and setting operations on the smart mobile terminal, wherein the client program has a plurality of the demonstration pages;

[0015] Acquire the interaction information between the user and the client program during the unboxing and setting process through the input device, and send the text generated based on the interaction information to the model server through the wireless communication device, so that the model server parses the text through the generative artificial intelligence large language model and obtains the parsing result;

[0016] The analysis result returned by the model server is received through the wireless communication device, a target demonstration page is determined according to the analysis result, and the target demonstration page is played through the output device.

[0017] In the embodiments of the present application, since the smart mobile terminal can play a demonstration page through a client program to guide the user to perform unboxing and setup operations on the electronic product, and in the process of interaction with the user, the user's intention is analyzed through a generative artificial intelligence large language model, and the target demonstration page is played according to the intention to answer the user's questions, it can effectively help the user complete the unboxing and setup operations, thereby improving the efficiency of unboxing, setup and use of electronic products and increasing product stickiness. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0019] Figure 1 A schematic diagram of the structure of an electronic product unpacking and setting guidance system based on artificial intelligence provided in one embodiment of the present application;

[0020] Figure 2 A flowchart of an electronic product unpacking and setting guidance method based on artificial intelligence provided in an embodiment of the present application;

[0021] Figure 3 for Figure 2 A schematic diagram of an application scenario of the method shown;

[0022] Figure 4 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0023] Figure 5 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0024] Figure 6 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0025] Figure 7 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0026] Figure 8 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0027] Fig. 9 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0028] Fig.10 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0029] Fig.11 for Figure 2 A schematic diagram of a demonstration page in the method shown;

[0030] Fig.12 A schematic diagram of the structure of a smart mobile terminal provided in one embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] Hereinafter, the terms "including", "having" and their cognates, which may be used in various embodiments of the present invention, are intended only to indicate specific features, numbers, steps, operations, elements, components or combinations of the foregoing items, and should not be understood as first excluding the existence of one or more other features, numbers, steps, operations, elements, components or combinations of the foregoing items or adding the possibility of one or more features, numbers, steps, operations, elements, components or combinations of the foregoing items.

[0033] Furthermore, the terms “first”, “second”, “third”, etc. are merely used for distinguishing descriptions and are not to be understood as indicating or implying relative importance.

[0034] Unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as those generally understood by those skilled in the art to which the various embodiments of the present invention belong. The terms (such as those defined in generally used dictionaries) will be interpreted as having the same meanings as the contextual meanings in the relevant technical field and will not be interpreted as having idealized meanings or overly formal meanings unless clearly defined in the various embodiments of the present invention.

[0035] See also Figure 1 , Figure 1 This is a schematic diagram of the structure of an electronic product unpacking and setting guidance system based on artificial intelligence provided by an embodiment of the present application. Figure 1 As shown, the guidance system 100 includes: a smart mobile terminal 110 and a model server 120.

[0036] The intelligent mobile terminal 110 may include, but is not limited to: a cellular phone, a smart phone, other wireless communication devices, a personal digital assistant, an audio player, other media players, a music recorder, a video recorder, a camera, other media recorders, a smart radio, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a moving picture expert group (MPEG-1 or MPEG-2) audio layer 3 (MP3) player, a digital camera, and an intelligent wearable device (such as a smart watch, a smart bracelet, etc.). The intelligent mobile terminal 112 is also installed with Android, iOS or other operating systems.

[0037] The model server 120 may be a single server or a distributed server cluster consisting of multiple servers, on which a Generative Artificial Intelligence Large Language Model (GAILLM) is configured. For ease of understanding, it is collectively referred to as a GAILLM server below. A Generative Artificial Intelligence Large Language Model is a pre-trained language model with billions of parameters (B+) (e.g., GPT-3, Bloom, LLaMA) obtained based on artificial intelligence technology that can generate content, solutions or new concepts. It is usually based on advanced algorithms such as deep learning and neural networks and is obtained through training with large amounts of data.

[0038] The GAILLM can be, for example but not limited to: OpenAI's ChatGPT, Google's Bard, and other models with similar functions. The GAILLM is trained by taking a large number of characters or character groups and their corresponding meanings as samples. Among them, the characters may include: characters or character groups converted from user voices, and the meanings corresponding to the characters or character groups may include incomplete semantics and complete semantics corresponding to the characters or character groups. Alternatively, the characters may also include: characters or character groups input by the user, and the meanings corresponding to the characters or character groups may include complete semantics corresponding to the characters or character groups. Alternatively, the characters or character groups may also include: characters or character groups used to describe user operations, and the meanings corresponding to the characters or character groups may include the intentions corresponding to the user operations.

[0039] Specifically, a client program with multiple preset demonstration pages is installed on the smart mobile terminal 110. The demonstration page contains preset guidance information, which includes: information for introducing the electronic product 130 and / or at least one of text, demonstration animation and voice for guiding the user to perform one or more operations related to unpacking. Among them, one or more operations related to unpacking may include but are not limited to: assembling the electronic product 130, configuring parameters of the electronic product 130, using the electronic product 130 and troubleshooting and repairing the electronic product 130, introducing the functions of the electronic product 130 to the user, and guiding the user on how to use the electronic product 130. The smart mobile terminal 110 generally refers to a smart phone, a smart watch, a smart bracelet, etc. In some specific cases, the smart mobile terminal 110 can be an electronic product 130.

[0040] The smart mobile terminal 110 is used to play the demonstration page through the client program to guide the user to perform unpacking and setting operations on the electronic product, obtain the interaction information between the user and the client program during the unpacking and setting process, and send the text generated based on the interaction information to the model server 120. Among them, the electronic product 130 may include but is not limited to: smart wearable devices (such as: smart glasses, smart watches, smart earrings, smart bracelets, smart clothing and smart shoes and hats, etc.) and other smart non-wearable devices (such as: smart cameras, smart home appliances, smart phones, tablets, laptops and desktop computers, etc.). The text can be generated by the smart mobile terminal 110 based on the interaction information. Alternatively, the smart mobile terminal 110 can also send the interaction information to other external devices, such as a cloud server or an electronic product 130, etc., and other external devices can generate the text based on the interaction information.

[0041] The GAILLM server 120 is used to parse the text through GAILLM and return the parsing result to the smart mobile terminal 110. Specifically, GAILLM can perform semantic parsing on the text and use the semantics contained in the text obtained by parsing as the parsing result.

[0042] The smart mobile terminal 110 is also used to determine the target demonstration page according to the analysis result, and play the target demonstration page, for example: display the text information and / or image information in the target demonstration page on the display screen, play the sound in the target demonstration page through the speaker, etc. Optionally, the smart mobile terminal 110 also stores a file recording the association relationship between multiple preset demonstration pages and different analysis results (such as different semantics) in the client program APP, and the target demonstration page can be determined by querying the file recording the association relationship between multiple preset demonstration pages and different analysis results. Specifically, the file recording the association relationship between multiple preset demonstration pages and different analysis results can be a part of the APP, and the APP determines the target demonstration page by querying the file. Alternatively, the file recording the association relationship between multiple preset demonstration pages and different analysis results can also be a third-party data stored in the smart mobile terminal 110 that is independent of the APP. Other software modules in the smart mobile terminal 110 determine the target demonstration page by querying the file, and send the relevant data of the target demonstration page to the APP, so that the APP plays the target demonstration page.

[0043] Optionally, in other embodiments of the present application, the smart mobile terminal 110 is further used to obtain a download link of the client program, download an installation program of the client program according to the download link, and run the installation program to install the client program on the smart mobile terminal 110, wherein the client program matches the device information of the smart mobile terminal 110. For example, the server may store multiple versions of the client program to be respectively applicable to smart phones with different operating systems.

[0044] Specifically, the smart mobile terminal 110 can obtain the download link of the client program by scanning a graphic code (such as a QR code or a barcode) on the electronic product. Alternatively, the smart mobile terminal 110 can also obtain the download link of the client program input by the user through an input device (such as a keyboard, a touch screen, etc.). Alternatively, the smart mobile terminal 110 can also obtain the download link of the client program according to the user's search operation in the application store software.

[0045] When the smart mobile terminal 110 sends a download request to the software storage server according to the download link, the smart mobile terminal 110 sends the device information of the smart mobile terminal 110 to the software storage server, so that the software storage server sends the installation program of the client program that matches the device information to the smart mobile terminal 110 according to the device information.

[0046] The device information of the smart mobile terminal 110 may include, but is not limited to, at least one of the hardware information, operating system type, operating system version number, and device model of the smart mobile terminal 110 .

[0047] Optionally, in other embodiments of the present application, at least one presentation interface of the multiple presentation pages is a user interaction interface, and the interaction information includes text information input by the user in the user interaction interface.

[0048] Optionally, in other embodiments of the present application, the interaction information includes user voice. The smart mobile terminal 110 is further configured to receive the user voice sent by the electronic product 130, or to obtain the user voice through a built-in microphone, and convert the user voice into the text.

[0049] Specifically, the smart mobile terminal 110 can convert the user voice into corresponding text through a built-in voice-to-text engine. Alternatively, the smart mobile terminal 110 can also send the user voice to a conversion server to convert the user voice into corresponding text through a voice-to-text engine configured in the conversion server.

[0050] The smart mobile terminal 110 first determines whether a speech-to-text engine is installed locally based on the installation log. If the speech-to-text engine is installed locally, the speech-to-text engine is called to convert the user's speech into corresponding text. If the speech-to-text engine is not installed locally, the user's speech is sent to the conversion server.

[0051] Optionally, in other implementations of the present application, the interactive information includes personal information input by the user.

[0052] The intelligent mobile terminal 110 is further used to generate a virtual character matching the user's personal information and configure the virtual character into the demonstration page.

[0053] The intelligent mobile terminal 110 is further used to synchronously control the virtual character when playing the target demonstration page, so as to interact with the user through the virtual character.

[0054] The virtual character includes: a two-dimensional or three-dimensional dynamic virtual character image in an animated form. In addition to the virtual character, the target demonstration page also includes preset guidance information, such as: at least one of an explanation text, a demonstration animation, and an explanation voice of the function and usage of the electronic product asked by the user.

[0055] While playing the guidance information in the target demonstration page, the smart mobile terminal 110 can control the virtual character to synchronously make corresponding expressions and / or actions to assist or guide the user to complete the product assembly and / or configuration process, or introduce the product functions to the user and guide the user on how to use the product.

[0056] Optionally, in other embodiments of the present application, the above-mentioned multiple demonstration pages include a first demonstration page for guiding pairing. The smart mobile terminal 110 is also used to respond to the user's operation on the first demonstration page, and pair with the electronic product 130 through the client program using a short-range wireless communication network. Among them, the short-range wireless communication network can include but is not limited to: Bluetooth network, WIFI (Wireless Fidelity) network, infrared point-to-point communication network (IrDA), near field communication (NFC, Near Field Communication) network and ZigBee (Purple Bee) network, etc.

[0057] Optionally, in other embodiments of the present application, the multiple demonstration pages also include a second demonstration page for guiding new users to register. The smart mobile terminal 110 is further configured to obtain registration information input by the user on the second demonstration page, and perform a user registration operation according to the registration information.

[0058] Optionally, in other embodiments of the present application, the guidance system 100 further includes an application server. The application server is configured with a generative artificial intelligence language model for obtaining target operation instructions, and the generative artificial intelligence language model for obtaining target operation instructions is obtained by training with a large number of parsing results and corresponding operation instructions as samples.

[0059] The intelligent mobile terminal 110 is further configured to send the analysis result to the application server.

[0060] The application server is used to obtain the target operation instruction according to the analysis result through the generative artificial intelligence large language model for obtaining the target operation instruction, and send the target operation instruction to the smart mobile terminal 110.

[0061] The intelligent mobile terminal 110 is also used to execute the operation indicated by the target operation instruction through the client program, wherein the operation includes at least one of the following: playing the page indicated by the target operation instruction, playing the animation indicated by the target operation instruction, playing the voice indicated by the target operation instruction, displaying the text indicated by the target operation instruction, modifying the configuration parameters of the virtual character, and running the application indicated by the target operation instruction. Among them, modifying the configuration parameters of the virtual character may specifically include but is not limited to: modifying the image, expression, action or sound (or voice) of the virtual character to use a specified image, expression, action or sound. Specifically, the user can select his favorite image, expression, action or sound from multiple alternative images, expressions, actions or sounds of the virtual character pre-set in the APP by clicking in the menu bar provided by the APP or by using voice commands, so as to personalize the configuration parameters of the virtual character.

[0062] Alternatively, in other embodiments of the present application, the model server 120 may also send the analysis result and the identity information of the smart mobile terminal 110 to the application server after obtaining the analysis result, so that the application server obtains the target operation instruction according to the analysis result through the generative artificial intelligence large language model for obtaining the target operation instruction, and sends the target operation instruction to the smart mobile terminal 110 according to the identity information of the smart mobile terminal 110.

[0063] Optionally, in other implementations of the present application, the guidance system 100 also includes a page server, and a plurality of demonstration pages are stored in the page server.

[0064] The smart mobile terminal 110 is further configured to determine whether the target demonstration page is included in the multiple demonstration pages according to the parsing result, and if the target demonstration page is included in the multiple demonstration pages, play the target demonstration page, and if the target demonstration page is not included in the multiple demonstration pages, send the description information of the target demonstration page to the page server to download the target demonstration page from the page server. The description information of the target demonstration page may include, but is not limited to, the number or purpose description of the target demonstration page.

[0065] Optionally, in other implementations of the present application, the analysis results include questions raised by the user.

[0066] The smart mobile terminal 110 is also used to determine whether the question is included in the currently played demonstration page, wherein the currently played demonstration page includes multiple alternative questions and hyperlinks to demonstration pages associated with each alternative question; if the currently played demonstration page includes the question, the target demonstration page is played according to the hyperlink; if the currently played demonstration page does not include the question, the question is sent to the application server to determine the target demonstration page through the application server, and the application server determines the target demonstration page according to the question, and sends the identity information of the target demonstration page, or the download link of the target demonstration page, or the data of the target demonstration page to the smart mobile terminal 110.

[0067] The smart mobile terminal 110 is further configured to play the target demonstration page according to the identity information or the download link or the data of the target demonstration page sent by the application server. The target demonstration page includes: at least one of text, demonstration animation and voice for answering the user's question, a virtual character and a navigation menu.

[0068] In the system provided in this embodiment, the smart mobile terminal can play a demonstration page through a client program to guide the user to perform unboxing and setup operations on the electronic product. In the process of interaction with the user, the generative artificial intelligence large language model is used to analyze the user's intention, and the target demonstration page is played according to the intention to answer the user's questions, thereby effectively helping the user to complete the unboxing and setup operations, thereby improving the efficiency of unboxing, setup and use of electronic products and increasing product stickiness.

[0069] See also Figure 2 , is a flow chart of an electronic product unpacking and setting guidance method based on artificial intelligence provided in an embodiment of the present application. The method can be applied to Figure 1 The smart mobile terminal 110 in the embodiment shown. Figure 2 As shown, the method comprises the following steps:

[0070] S301, playing a preset demonstration page through a client program installed on the smart mobile terminal to guide the user to perform unpacking and setting operations on the electronic product;

[0071] The client program has multiple preset demonstration pages. The intelligent terminal plays the preset demonstration screens through the built-in client program according to the playback instructions to guide the user to perform unpacking and setting operations on the electronic product.

[0072] The demonstration page includes preset guidance information, which includes: information for introducing the electronic product and / or at least one of text, demonstration animation and voice for guiding the user to perform one or more operations related to unpacking. The one or more operations related to unpacking may include, but are not limited to: assembling the electronic product, configuring parameters of the electronic product, using the electronic product, troubleshooting and repairing the electronic product, etc.

[0073] Furthermore, in other embodiments of the present application, the method also includes: obtaining a download link of the client program, and downloading an installation program of the client program according to the download link; running the installation program to install the client program on the smart mobile terminal, wherein the client program matches the device information of the smart mobile terminal.

[0074] Specifically, the smart mobile terminal 110 can obtain the download link of the client program by scanning a graphic code (such as a QR code or a barcode) on the electronic product. Alternatively, the smart mobile terminal 110 can also obtain the download link of the client program input by the user through an input device (such as a keyboard, a touch screen, etc.) of the smart mobile terminal 110. Alternatively, the smart mobile terminal 110 can also obtain the download link of the client program based on the user's search operation in the application store software.

[0075] S302, obtaining the interaction information between the user and the client program during the unpacking and setting process, and sending the text generated based on the interaction information to the model server;

[0076] The smart mobile terminal uses the generative artificial intelligence large language model in the model server to parse the interaction information between the user and the client program during the unboxing and setup process to determine the user's intention.

[0077] The interactive information may include text information input by the user on the demonstration page.

[0078] Alternatively, the interaction information may also include a user voice sent by the electronic product or a user voice acquired by a built-in microphone of the smart mobile terminal. The smart mobile terminal may convert the user voice into text using a built-in voice-to-text engine, or may convert the user voice into text using a voice-to-text engine in an external device (such as a conversion server in the cloud).

[0079] Alternatively, the interaction information may also include associated data of various preset operations of the user on the demonstration page, such as: associated information of options and buttons in the menu bar of the demonstration page clicked by the user, associated information of sliding gestures made by the user on the demonstration page, etc.

[0080] S303: Determine the target demonstration page according to the parsing result returned by the model server, and play the target demonstration page.

[0081] Optionally, in other embodiments of the present application, the method also includes: generating a virtual character that matches the user's personal information, and configuring the virtual character into the demonstration page; and, when playing the target demonstration page, synchronously controlling the virtual character to interact with the user through the virtual character.

[0082] Optionally, in other embodiments of the present application, the multiple demonstration pages include a first demonstration page for guiding pairing, and the method further includes: in response to the user's operation on the first demonstration page, pairing with the electronic product via the client program using a short-range wireless communication network.

[0083] Optionally, in other embodiments of the present application, the multiple demonstration pages include a second demonstration page for guiding new users to register, and the method also includes: obtaining registration information entered by the user on the second demonstration page, and performing a user registration operation based on the registration information.

[0084] To help understand, the following will be combined Figures 3 to 11 , the guidance method provided by this application is illustrated by example. In one application example, Figure 3 As shown, the guidance method can be used to guide the unboxing and setting operation of the smart glasses 200 through the smart phone 110 and the model server 120. It can be understood that in addition to the unboxing and setting, the user can also obtain guidance on the setting operation of the smart glasses 200 through the guidance method at any other time or in any scenario.

[0085] Specifically, after the user takes out the smart glasses 200 from the packaging box, the user obtains the download link of the client program APP by scanning the QR code on the smart glasses 200 using the camera on the smart phone 110. The smart phone 110 downloads the installation program of the APP according to the download link and runs it to install the APP in the smart phone 110. The APP is preset with multiple demonstration pages for guiding the user to assemble, set up, use, troubleshoot and repair, and report repairs of the smart glasses.

[0086] It is understandable that different models of smart glasses may have different functions. Smart phone 110 runs the APP and automatically plays the following Figure 4 The start page of the multiple demonstration pages shown is used to guide the user to select the model of the smart glasses 200, and determine the corresponding demonstration page according to the model selected by the user, so as to determine the target demonstration page from the corresponding demonstration page according to the parsing result returned by the model server in subsequent operations. Further, if the target demonstration page is determined by other devices (such as the above-mentioned application server), the smart phone 110 can send the information of the model of the smart glasses 200 selected by the user to the other devices, so that the other devices can determine the target demonstration page according to the model and the parsing result.

[0087] Furthermore, the smart phone 110 responds to the user clicking Figure 4 The operation of the "Next Page" button in the demonstration page is shown. Figure 5 The demonstration page shown is used to guide the user to register a new user. The smart phone 110 obtains the user's Figure 5 The user can also issue a voice command of "next page" to instruct the smart phone 110 to jump to the next page of the demonstration page for playback. The process of the smart phone parsing the voice command through GAILLM to determine the corresponding operation can be specifically referred to the above-mentioned related content, which will not be repeated here.

[0088] Furthermore, the smart phone 110 responds to the user clicking Figure 5 The operation of the "Log in later" button in the demonstration page is shown as follows: Figure 6 The navigation page shown in the figure includes a virtual character 501, a selection menu 502 (e.g., "Yes, please guide me", "No, thank you"), a prompt text (e.g., "Do you need me to guide you to perform the setting operation?"), a control button 503, and a prompt voice, such as, "Do you need me to guide you to perform the setting operation? Please say your choice, or you can make a choice by clicking "Yes, please guide me" or "No, thank you" ( Figure 6 not shown).

[0089] Furthermore, the smartphone 110 obtains the interaction information between the user and the APP, such as the voice uttered by the user while pressing the control button 503, converts the voice into text, and then sends the text to the model server, and displays the text in the current demonstration page, such as Figure 6 "Yes, that's a good idea" in.

[0090] The model server performs semantic analysis on the text through a generative artificial intelligence large language model to obtain the user's intention, that is, to perform a navigation operation, and sends the analysis result to the smart phone 110.

[0091] Smart phone 110 confirms the playback according to the analysis result. Figure 7 A demonstration page is shown for guiding the user to pair with the smart glasses 200. Figure 7 The demonstration page shown includes a virtual character 701, a demonstration animation 702, a prompt text 703, a control button or a navigation menu 704, and a prompt voice, such as the voice corresponding to the prompt text 703 ( Figure 7 not shown).

[0092] Afterwards, the smartphone 110 responds to the user clicking Figure 7 The control button in the navigation menu 704 is operated to play the Figure 8 The demonstration page shown guides the user to perform the pairing operation on the smartphone 110 and prompts the pairing process through voice, text and animation. After the smartphone 110 detects that the pairing with the smart glasses 200 is completed, it plays the following Fig. 9 The demo page shown here prompts the user to complete the pairing.

[0093] Furthermore, the smartphone 110 obtains the user's Fig. 9 The interactive information of the demonstration page shown in the figure, such as the information input by the user clicking the "OK" button, or the user's voice obtained through the microphone, etc., and the text containing the interactive information is sent to the model server. The model server parses the text and confirms that the user may want to ask a question, so it sends the parsing result containing the instruction information for guiding the user to ask questions to the smart phone 110. The smart phone 110 plays the video according to the parsing result. Fig.10 The demonstration page shown is used to guide the user in asking questions.

[0094] like Fig.10As shown, the demonstration page includes multiple navigation menus to help users select questions that need to be answered, such as "Can you tell me how to turn on / off the machine?", "How to adjust the volume?", etc. Further, the demonstration page may also include prompt voices, such as: "You can choose the following questions, or you can press and hold the virtual button on the smart glasses and ask questions related to AirGo." At this time, if the user chooses to press and hold the virtual button on the smart glasses and ask questions related to AirGo, the smart glasses 200 will send the user voice to the smart phone 110 after obtaining the user voice. The smart phone 110 can convert the user voice into corresponding text through the built-in speech-to-text engine or conversion server, and display the content of the text in the current demonstration page, such as Fig.10 In the example shown in the figure, “Can you tell me how to chat in ‘SolosChat’?” At the same time, the smartphone 110 sends the text to the model server, so that the model server can perform semantic analysis on the text. The smartphone 110 determines whether the user’s question is a question in the navigation menu based on the analysis result returned by the model server. If it is a question in the navigation menu, the smartphone 110 obtains the data of the corresponding demonstration page for playback based on the hyperlink associated with the navigation menu. If it is not a question in the navigation menu, the smartphone 110 determines whether the question is a question in the navigation menu based on the association relationship between the preset different analysis results and the demonstration page. Fig.11 Click on the target demo page shown and play it.

[0095] It should be noted that Figures 3 to 11 This is only an example and is not limited to this in actual applications.

[0096] For details not covered in the above embodiments of the guidance method, please refer to the relevant descriptions in the above-mentioned guidance system and the following embodiments of the smart mobile terminal, which will not be repeated here.

[0097] The method provided in this embodiment uses a built-in client program to play a demonstration page through a smart mobile terminal to guide the user to perform unboxing and setup operations on an electronic product. In the process of interaction with the user, the generative artificial intelligence large language model is used to analyze the user's intention, and the target demonstration page is played according to the intention to answer the user's questions, thereby effectively helping the user to complete the unboxing and setup operations, thereby improving the efficiency of unboxing, setup and use of electronic products and increasing product stickiness.

[0098] See also Fig.12 , Fig.12 This is a schematic diagram of the structure of an intelligent mobile terminal provided in an embodiment of the present application. The intelligent mobile terminal includes: one or more processors 501, one or more memories 502, one or more wireless communication devices 503, one or more input devices 504, and one or more output devices 504 (for ease of understanding, for each device, Fig.12 Only one is shown in the figure, and it is not limited to this in actual application).

[0099] One or more processors 501 are electrically connected to one or more memories 502, one or more wireless communication devices 503, one or more input devices 504, and one or more output devices 504, and perform data communication among them through a communication bus.

[0100] The one or more memories 502 may be non-temporary storage. The one or more input devices 504 may be at least one of a camera, a microphone, a touch panel, a physical button or a mouse, and various sensors. The one or more output devices 804 may be at least one of a display screen and a speaker.

[0101] The one or more wireless communication devices 503 include: a wireless signal transceiver and surrounding circuits. The wireless signal transceiver can use but is not limited to at least one of the WiFi (Wireless Fidelity) protocol, NFC (Near Field Communication) protocol, ZigBee, UWB (Ultra Wideband, carrier-free communication), RFID (Radio Frequency Identification) protocol and cellular mobile communication (Cellular Mobile Communication) protocol (such as 3G / 4G / 5G, etc.) for data transmission.

[0102] The non-transitory storage 502 stores one or more computer programs executable by the processor 501, wherein the computer program includes a plurality of instructions for:

[0103] Playing a demonstration page in the client program through the output device 505 to guide the user to perform unpacking and setting operations on the smart mobile terminal, wherein the client program has a plurality of such demonstration pages;

[0104] The interactive information between the user and the client program during the unpacking and setting process is obtained through the input device 504, and the text generated based on the interactive information is sent to the model server through the wireless communication device 503, so that the model server can parse the text and obtain the parsing result through the generative artificial intelligence large language model;

[0105] The analysis result returned by the model server is received via the wireless communication device 503 , a target demonstration page is determined according to the analysis result, and the target demonstration page is played via the output device 505 .

[0106] Optionally, in other implementations of the present application, the multiple instructions are also used to:

[0107] Obtain a download link of the client program, and download an installation program of the client program according to the download link through the wireless communication device 503;

[0108] The installation program is run to install the client program in the smart mobile terminal, wherein the client program matches the device information of the smart mobile terminal.

[0109] Optionally, in other embodiments of the present application, at least one of the multiple demonstration pages includes a user interaction interface, and the interaction information includes text information input by the user in the user interaction interface.

[0110] Optionally, in other embodiments of the present application, the interaction information includes user voice, the input device 504 includes a microphone, and the multiple instructions are further used to obtain the user voice through the microphone and convert the user voice into the text.

[0111] Optionally, in other implementations of the present application, the multiple instructions are also used to:

[0112] Generate a virtual character that matches the user's personal information, and configure the virtual character into the demonstration page; and

[0113] When the target demonstration page is played, the virtual character is synchronously controlled to interact with the user through the virtual character.

[0114] Optionally, in other implementations of the present application, the multiple instructions are also used to:

[0115] The registration information entered by the user on the demonstration page for guiding new user registration is obtained, and the user registration operation is performed according to the registration information.

[0116] For details not covered in the above embodiments of the intelligent mobile terminal, please refer to the relevant descriptions in the embodiments of the above guidance system and guidance method, which will not be repeated here.

[0117] The smart mobile terminal provided in this embodiment uses a built-in client program to play a demonstration page to guide the user to perform unboxing and setup operations on the electronic product. In the process of interaction with the user, the generative artificial intelligence large language model is used to analyze the user's intention, and the target demonstration page is played according to the intention to answer the user's questions, thereby effectively helping the user to complete the unboxing and setup operations, thereby improving the efficiency of unboxing, setup and use of electronic products and increasing product stickiness.

[0118] The present application also provides a non-transitory computer-readable storage medium, which may be disposed in the smart mobile terminal in the above embodiments. The non-transitory computer-readable storage medium may be the above Fig.12 The memory 502 in the illustrated embodiment. The computer-readable storage medium stores a computer program, which, when executed by the processor, implements the electronic product unpacking setting guidance method based on artificial intelligence described in the aforementioned embodiments. Furthermore, the computer-storable medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and other media that can store program codes.

[0119] In the several embodiments provided in the present application, it should be understood that the disclosed guidance system, method and terminal can be implemented in other ways. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not performed. Another point is that the connection or direct connection or communication connection between each other shown or discussed can be an indirect connection or communication connection through some interface, device or module, which can be electrical, mechanical or other forms.

[0120] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0121] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0122] The above is a description of the guidance system, method and terminal provided in the present application. For technicians in this field, according to the ideas of the embodiments of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An electronic product unpacking and setting guidance system based on artificial intelligence, characterized in that: The system comprises: an intelligent mobile terminal and a model server, wherein the model server is configured with a generative artificial intelligence large language model, and the intelligent mobile terminal is installed with a client program having multiple demonstration pages; The smart mobile terminal is used to play the demonstration page through the client program to guide the user to perform unpacking and setting operations on the electronic product, obtain the interaction information between the user and the client program during the unpacking and setting process, and send the text generated based on the interaction information to the model server; The model server is used to parse the text through the generative artificial intelligence large language model and return the parsing result to the smart mobile terminal; The intelligent mobile terminal is further used to determine a target demonstration page according to the analysis result, and play the target demonstration page.

2. The system according to claim 1, characterized in that The smart mobile terminal is also used to obtain a download link for the client program, download an installation program for the client program according to the download link, and run the installation program to install the client program on the smart mobile terminal, wherein the client program matches the device information of the smart mobile terminal.

3. The system according to claim 1, characterized in that At least one of the demonstration pages is a user interaction interface, and the interaction information includes text information input by the user in the user interaction interface.

4. The system according to claim 1, characterized in that The interaction information includes user voice; The intelligent mobile terminal is further used to receive the user voice sent by the electronic product, or to obtain the user voice through a built-in microphone, and to convert the user voice into the text.

5. The system according to claim 1, wherein: The intelligent mobile terminal is further used to generate a virtual character matching the personal information of the user, and configure the virtual character into the demonstration page; The intelligent mobile terminal is further used to synchronously control the virtual character when playing the target demonstration page, so as to interact with the user through the virtual character.

6. The system according to claim 1, characterized in that The plurality of demonstration pages include a first demonstration page for guiding pairing; The intelligent mobile terminal is also used to respond to the user's operation on the first demonstration page and pair with the electronic product through the client program using a short-range wireless communication network.

7. The system according to claim 6, characterized in that The short-range wireless communication network includes: a Bluetooth network, a Wireless Fidelity network and a Near Field Communication network.

8. The system of claim 1, wherein: The plurality of demonstration pages include a second demonstration page for guiding new users to register; The smart mobile terminal is further used to obtain registration information input by the user on the second demonstration page, and perform a user registration operation according to the registration information.

9. An artificial intelligence-based electronic product unpacking and setting guidance method, applied to a smart mobile terminal, characterized in that: The method comprises: Playing a preset demonstration page through a client program installed on the smart mobile terminal to guide the user to perform unpacking and setting operations on the electronic product, wherein the client program has a plurality of the demonstration pages; Acquire the interaction information between the user and the client program during the unboxing and setting process, and send the text generated based on the interaction information to the model server, so that the model server parses the text through the generative artificial intelligence large language model, and returns the parsing result to the smart mobile terminal; A target demonstration page is determined according to the analysis result, and the target demonstration page is played.

10. The method according to claim 9, characterized in that The method further comprises: Obtain a download link for the client program, and download an installation program for the client program according to the download link; The installation program is run to install the client program in the smart mobile terminal, wherein the client program matches the device information of the smart mobile terminal.

11. The method according to claim 9, characterized in that At least one of the demonstration pages is a user interaction interface, and the interaction information includes text information input by the user in the user interaction interface.

12. The method according to claim 9, characterized in that The interaction information includes user voice, and the method further includes: Receiving the user voice sent by the electronic product, or acquiring the user voice through the microphone of the smart mobile terminal; The user speech is converted into the text.

13. The method according to claim 9, characterized in that The method further comprises: Generating a virtual character that matches the personal information of the user, and configuring the virtual character into the demonstration page; When the target demonstration page is played, the virtual character is synchronously controlled so as to interact with the user through the virtual character.

14. The method according to claim 9, characterized in that The plurality of demonstration pages include a first demonstration page for guiding pairing, and the method further includes: In response to the user's operation on the first demonstration page, the client program is used to pair with the electronic product using a short-range wireless communication network.

15. The method according to claim 9, characterized in that The plurality of demonstration pages include a second demonstration page for guiding a new user to register, and the method further includes: The registration information input by the user on the second demonstration page is obtained, and a user registration operation is performed according to the registration information.

16. A smart mobile terminal, characterized in that: include: A processor and a non-transitory storage, a wireless communication device, an input device, and an output device electrically connected to the processor; The non-transitory storage stores one or more computer programs executable by the processor, wherein the computer programs include a plurality of instructions for: Playing a demonstration page in the client program through the output device to guide the user to perform unpacking and setting operations on the smart mobile terminal, wherein the client program has a plurality of the demonstration pages; Acquire the interaction information between the user and the client program during the unboxing and setting process through the input device, and send the text generated based on the interaction information to the model server through the wireless communication device, so that the model server parses the text through the generative artificial intelligence large language model and obtains the parsing result; The analysis result returned by the model server is received through the wireless communication device, a target demonstration page is determined according to the analysis result, and the target demonstration page is played through the output device.

17. The intelligent mobile terminal according to claim 16, characterized in that: The plurality of instructions are also used to: Obtaining a download link of the client program, and downloading an installation program of the client program according to the download link through the wireless communication device; The installation program is run to install the client program in the smart mobile terminal, wherein the client program matches the device information of the smart mobile terminal.

18. The intelligent mobile terminal according to claim 16, characterized in that: At least one of the multiple demonstration pages includes a user interaction interface, and the interaction information includes text information input by the user in the user interaction interface.

19. The intelligent mobile terminal according to claim 16, characterized in that: The interaction information includes user voice, the input device includes a microphone, and the multiple instructions are further used to obtain the user voice through the microphone and convert the user voice into the text.

20. The intelligent mobile terminal according to claim 16, characterized in that: The plurality of instructions are also used to: Generating a virtual character that matches the user's personal information, and configuring the virtual character into the demonstration page; and When the target demonstration page is played, the virtual character is synchronously controlled so as to interact with the user through the virtual character.

21. The intelligent mobile terminal according to claim 16, characterized in that: The demonstration page includes a demonstration page for guiding new users to register, and the plurality of instructions are further used to: The registration information input by the user on the demonstration page for guiding new user registration is obtained, and a user registration operation is performed according to the registration information.

Images