Interaction method of intelligent children's story machine, story machine, medium and program product
By integrating Bluetooth speakers and control terminals in children's story machine, crying voice detection and personalized voice services are realized, which solves the problem that traditional devices cannot coax children to sleep, and provides intelligent and personalized remote voice comfort and precise matching customer service support. Improved sleep coaxing effect.
Patent Information
- Application Number
- CN202411073733.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2044-08-07
AI Technical Summary
The existing children's story machines cannot effectively coax children to sleep when parents cannot participate in close or remotely, and lack intelligent interaction functions, so they cannot actively contact parents or provide personalized voice services.
Detect children's crying voices through Bluetooth speakers and send cry processing instructions, establish connections between parents or customer service terminals, and provide personalized voice services, including voice change and self-service mediation functions to ensure that children receive timely comfort and precise matching customer service support.
It realizes the coordinated coaxing of parents and customer service, improves the comfort efficiency and quality of children, solves the problem that traditional equipment cannot actively respond to children's crying situations, and provides intelligent and personalized remote voice services.
Smart Images

Figure CN118631603B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of educational demonstration tools, and in particular to an interactive method, a story machine, a medium and a program product of an intelligent children's story machine. Background Art
[0002] With the advancement of technology, smart home devices are increasingly integrated into people's daily lives, especially in children's education and companionship. Various smart devices designed to accompany children's growth have appeared on the market, such as smart storytelling machines, smart monitoring devices, etc. These devices usually attract children's attention and increase the fun of life by playing stories, music or providing interactive games.
[0003] In the related art, the story playing of children's story machines mainly relies on pre-recorded content or stories and music downloaded from the Internet. These devices usually have basic timing functions, which can start or end playing at a set time to adapt to the children's schedule. Some story machines can also achieve real-time data synchronization and content updates by connecting to the Internet to keep the content fresh and educationally targeted.
[0004] However, when parents are busy at work or for other reasons and are unable to coax their children to sleep at close range or remotely through a storytelling machine, the children's storytelling machine in the related art can only play simple songs or stories and cannot meet the need for coaxing children to sleep. Summary of the invention
[0005] The present application provides an interactive method, a story machine, a medium and a program product of an intelligent children's story machine, which are used to provide online customer service for children when parents are unable to interact with them remotely to coax them to sleep.
[0006] In a first aspect, the present application provides an interactive method for an intelligent children's story machine, the intelligent children's story machine includes a Bluetooth speaker and a control terminal, the Bluetooth speaker and the control terminal are connected via Bluetooth communication, the method comprising: the control terminal responds to a crying processing instruction and sends a call connection request to a user terminal used by a parent; the crying processing instruction is sent to the control terminal by the Bluetooth speaker after detecting the crying voice of a child; after the control terminal establishes a call connection with the user terminal, the control terminal receives the parent voice returned by the user terminal, and controls the Bluetooth speaker to play the parent voice; after the parent sets the child's to-be-matched information through the user terminal and triggers the mediation request instruction, the control terminal obtains and uploads the child's to-be-matched information to a server; the child's to-be-matched information is set by the parent, including child status information and customer service selection information; after receiving the matching success information returned by the server, the control terminal establishes a call connection with the corresponding customer service terminal that has successfully matched, and controls the Bluetooth speaker to play the customer service voice returned by the customer service terminal; the control terminal records the customer service call voice through the Bluetooth speaker, and sends the customer service call voice to the user terminal used by the parent; the control terminal receives the parent guidance information returned by the user terminal, and sends the parent guidance information to the customer service terminal.
[0007] In the above embodiment, when the Bluetooth speaker detects the crying voice of a child, it will send a crying processing instruction to the control terminal, and the control terminal will then send a call request to the user terminal to monitor the crying status of the child and contact the parents. Compared with traditional devices that can only passively play music such as lullabies, it can allow parents to understand the child's situation in time, help parents remotely participate in the process of coaxing their children to sleep, and optimize the coaxing effect.
[0008] In combination with some embodiments of the first aspect, in some embodiments, the crying processing instruction can also be sent to the control terminal by the Bluetooth speaker after detecting that a preset button is pressed; after the control terminal responds to the crying processing instruction and sends a call connection request to the user terminal used by the parent, the method also includes: the control terminal obtains an audio list preset by the parent including multiple lullabies and story songs; the control terminal controls the Bluetooth speaker to play multiple audios in the audio list.
[0009] In the above embodiment, when a child presses a preset button, a call can also be triggered, enabling the child to actively seek help, expanding the use scenarios of the story machine, providing help for children of more age groups, and improving the user experience. After sending a call request, the control terminal will also play the audio in the audio list, and use the audio to comfort the child while waiting for the parent to connect, thereby improving the efficiency of coaxing the child to sleep.
[0010] In combination with some embodiments of the first aspect, in some embodiments, after the control terminal sends a call connection request to the user terminal used by the parent in response to the crying processing instruction, the method also includes: within the preset waiting time, if the control terminal fails to establish a connection with the user terminal, the control terminal obtains the alternative setting information preset by the parent; the alternative setting information includes alternative disconnection disposal and default information to be matched; when the alternative disconnection disposal is self-service mediation, the control terminal uploads the default information to be matched to the server.
[0011] In the above embodiment, when the connection to the parent fails, the user can switch to self-service mediation to avoid poor coaxing effect due to no response. Self-service mediation can contact customer service for coaxing according to the default information set by the parent, which can quickly respond to the crying of the child and improve the coaxing efficiency. Using a backup plan to deal with emergencies where the parent cannot be connected improves the experience of using the story machine.
[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of the control terminal sending a call connection request to the user terminal used by the parent in response to the crying processing instruction, the method also includes: when the alternative disconnection is handled as an alternative user connection, the control terminal sends a call connection request to the alternative terminal used by the alternative user.
[0013] In the above embodiment, when the connection with the parent fails, the alternative user can be switched to the alternative user, and the alternative user connection is to contact other preset personnel, thereby expanding the possible range of assistance in coaxing the child to sleep and improving the success rate of coaxing the child to sleep. This allows the storytelling machine and related personnel to quickly respond to the child's crying and improve the efficiency of coaxing the child to sleep.
[0014] In combination with some embodiments of the first aspect, in some embodiments, after the parent sets the child's to-be-matched information through the user terminal and triggers the mediation request instruction, after the control terminal obtains and uploads the child's to-be-matched information to the server, the method also includes: after receiving the child's to-be-matched information, the server determines multiple customer service terminals to be matched according to the customer service selection information in the child's to-be-matched information; the server extracts a customer service terminal in an idle state from the multiple customer service terminals to be matched as the target customer service terminal; the idle state is set by the customer service at the customer service terminal; the server sends a call connection request including the child's status information to the target customer service terminal; after the target customer service terminal returns the call confirmation information, the server sends a matching success information to the control terminal.
[0015] In the above embodiment, parents can actively set child information and customer service selection through the interface, and the server can extract key information from it for accurate matching and select idle customer service. Parents can choose the most matching customer service conditions according to the current situation, and the server can select real-time idle customer service from them to ensure the provision of instant voice coaxing service and improve the quality of remote coaxing.
[0016] In combination with some embodiments of the first aspect, in some embodiments, after the target customer service terminal returns the call confirmation information, after the server sends the matching success information to the control terminal, the method also includes: the server receives the initial voice sent by the target customer service terminal; the server performs voice change processing on the initial voice according to the corresponding target voice setting in the user terminal to obtain a customer service voice that meets the target voice setting; the server sends the customer service voice to the control terminal.
[0017] In the above embodiment, the server can change the voice of the customer service to make it in line with the preferences of children. It is more familiar to children than directly using the original voice of the customer service, which is not abrupt and improves the quality of coaxing them to sleep. The voice change processing can set different voice roles according to the interests of different children, realize personalized voice experience, enhance the attractiveness and pertinence of the voice, optimize the customer service effect, reduce the dependence on professional customer service voice, and realize better intelligent remote companionship.
[0018] In combination with some embodiments of the first aspect, in some embodiments, after the step of controlling the terminal to record the customer service call voice through a Bluetooth speaker and sending the customer service call voice to a user terminal used by a parent, the method further includes: after receiving the customer service tag information sent by the user terminal, the server obtains the customer service information corresponding to the customer service terminal; the server stores the customer service information in an alternative customer service library corresponding to the user terminal.
[0019] In the above embodiment, parents can mark customer service as a well-received customer service, and the well-received customer service can be stored for parents to choose later, avoiding the cumbersome settings of subsequent customer service selection. Storing in the historical customer service pool can simplify the selection process and improve the user experience. At the same time, well-received customer service is more likely to meet the needs of children, and directly using historical well-received customer service can improve the quality and success rate of coaxing children to sleep.
[0020] In a second aspect, an embodiment of the present application provides an intelligent children's story machine, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the intelligent children's story machine to execute the method described in the first aspect and any possible implementation method of the first aspect.
[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when the computer program product is run on a smart children's story machine, enables the smart children's story machine to execute the method described in the first aspect and any possible implementation method of the first aspect.
[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium comprising instructions. When the instructions are executed on a smart children's story machine, the smart children's story machine executes the method described in the first aspect and any possible implementation method of the first aspect.
[0023] It is understandable that the intelligent children's storytelling machine provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.
[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
[0025] 1. Since a Bluetooth speaker is used to detect the crying voice of children and send crying processing instructions to the control terminal, and the control terminal then sends a call request to the user terminal, the function of monitoring the status of children and actively contacting parents is realized, which effectively solves the problem that children's story machines in related technologies can only passively trigger music playback, and thus achieves the effect of intelligently and actively contacting parents to participate in coaxing them to sleep.
[0026] 2. Since parents actively set the child and customer service information through the user terminal, and the server extracts key information from it to accurately match the most suitable customer service, the function of accurately matching customer service based on parental needs is realized, which effectively solves the problem that the simple matching method based on fixed rules in related technologies is not accurate enough, and thus realizes accurate and real-time customer service matching and selection effects.
[0027] 3. Since the customer service voice is intelligently changed according to the target parameters set by parents, the function of generating personalized voice effects that meet children's preferences is realized, which effectively solves the problem of insufficient personalization of customer service voice and difficulty for children to adapt in related technologies, and then realizes intelligent personalized voice and improves the quality of coaxing the child to sleep. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 It is an interactive scene diagram of the intelligent children's story machine in the embodiment of the present application;
[0029] Figure 2 It is a flow chart of the interactive method of the intelligent children's story machine in the embodiment of the present application;
[0030] Figure 3 is another flowchart of the interactive method of the intelligent children's story machine in the embodiment of the present application;
[0031] Figure 4It is a schematic diagram of the physical device structure of the intelligent children's story machine in the embodiment of the present application. DETAILED DESCRIPTION
[0032] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.
[0033] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0034] For ease of understanding, the following describes the interactive scenarios of the smart children's story machine in this article. Figure 1 , which is an interactive scene diagram of the intelligent children's story machine in the embodiment of the present application.
[0035] exist Figure 1 In the figure, there are four devices in different spatial locations: the smart children's story machine 101 is set at the child's residence to provide story playing and sleep-inducing services for the child; the server 102 is set in the back-end computer room to coordinate multiple devices and provide data processing, storage and interconnection services; the user terminal 103 is set at the parent's location and is a terminal device such as a mobile phone used by the parent; the customer service terminal 104 is set at the customer service location and is similar to the user terminal 103. The customer service terminal 104 is a terminal device such as a mobile phone and a computer used by the customer service staff. Among them, the smart children's story machine 101 is divided into a control terminal 1011 and a Bluetooth speaker 1012, and the control terminal 1011 and the Bluetooth speaker 1012 are connected via Bluetooth communication.
[0036] It should be noted that, in some embodiments, the control terminal 1011 and the Bluetooth speaker 1012 are integrated, that is, the control terminal 1011 and the Bluetooth speaker 1012 are both embedded in the smart children's story machine 101 and are a whole. In other embodiments, the control terminal 1011 and the Bluetooth speaker 1012 are split, that is, for portability and controllability, the Bluetooth speaker 1012 is separated as a device for recording and playing audio, and the control terminal 1011 is a computer, mobile phone or tablet device connected to the Bluetooth speaker 1012 via Bluetooth. The control terminal 1011, the user terminal 103 and the customer service terminal 104 are all installed with corresponding applications (APPs), and each application has corresponding account information for data interaction with the server 102; the application is also customized with a specified control for controlling the Bluetooth speaker 1012 to perform audio recording or playback tasks.
[0037] By using this application, through the server 102, the smart children's story machine 101 and the user terminal 103 can realize the call function; the smart children's story machine 101 and the customer service terminal 103 can also realize the call function; the above call functions are not restricted by location, that is, parents and customer service can use the corresponding application to realize remote voice comfort and mediation for the child on the side of the smart children's story machine 101, and tell stories to the child to put him to sleep.
[0038] It can be seen that the interactive method of the smart children's story machine in the embodiment of the present application can realize the collaborative coaxing work of parents, customer service and other parties, effectively solving the problem that the related technology uses simple songs or stories to coax children to sleep, but the effect is not good. The Bluetooth speaker 1012 of the smart children's story machine 101 also has a crying detection function, that is, through the baby crying recognition algorithm based on deep neural network, it can realize the accurate recognition of the crying of children, and upload it to the server to request the parents or customer service to mediate and deal with it, effectively solving the problem that the related technology is difficult to make timely judgments and solve the bad state of children.
[0039] For ease of understanding, the following is a description of the process of the method provided by this implementation. Figure 2 , which is a flow chart of the interactive method of the intelligent children's story machine in the embodiment of the present application.
[0040] It should be noted that, in order to facilitate the clarification of the specific implementation details of the smart children's story machine 101, the following process splits the smart children's story machine 101 into a control terminal 1011 and a Bluetooth speaker 1012, and the execution subject of the process is the control terminal 1011. In fact, the actions of the control terminal 1011 can be directly defined as the actions of the smart children's story machine 101 in a broad sense, that is, the execution subject of the process is also described as the smart children's story machine 101.
[0041] S201. In response to a crying processing instruction, the control terminal sends a call connection request to a user terminal used by a parent.
[0042] Among them, the control terminal represents the control device in the smart children's story machine, which is used to coordinate the work of devices such as Bluetooth speakers; the crying processing instruction refers to the processing request instruction sent by the Bluetooth speaker to the control terminal after detecting a child crying; the user terminal refers to smart devices such as mobile phones used by parents.
[0043] Specifically, when the Bluetooth speaker records ambient voice and detects the child crying from the ambient voice, or the child cries for more than a preset time, a crying processing instruction will be sent to the control terminal. After receiving the crying processing instruction, the control terminal will send a call request to the parent's user terminal, requesting the parent to make a call and coax the child to sleep.
[0044] In some embodiments, the control terminal may send a call request to the user terminal in a variety of ways. Optionally, after the control terminal detects a crying processing instruction, it uploads a user information acquisition request to the server, obtains the user terminal's phone number from the server, and dials the phone number; Optionally, after the control terminal detects a crying processing instruction, it uploads a user connection request to the server, and the server will make an information prompt and an online call request through the application on the user terminal.
[0045] In some embodiments, the crying processing instruction can also be sent to the control terminal after the Bluetooth speaker detects that a preset button has been pressed. The setting of this button can be used to provide older children with the function of actively seeking help. Through the active triggering of the button, rather than just the detection and triggering of crying, children can be provided with a more convenient and quick option to contact their parents.
[0046] At the same time, after the control terminal responds to the crying processing instruction and sends a call connection request to the user terminal, the control terminal will also obtain the audio list including multiple lullabies and story songs preset by the parents from its own stored database, and control the Bluetooth speaker to play multiple audios in the audio list. The audio list is set by the parents (users) and is used to automatically trigger the playback after detecting the child's crying, soothing or familiar lullabies or stories to coax the child to sleep.
[0047] In some embodiments, to avoid frequent false triggers, the crying processing instruction needs to wait for the child to cry for a preset time before it can be triggered. At this time, the audio in the audio list will be played immediately when the child is detected crying.
[0048] S202: After establishing a call connection with the user terminal, the control terminal receives the parent's voice sent back by the user terminal, and controls the Bluetooth speaker to play the parent's voice.
[0049] Specifically, after the control terminal successfully establishes a call connection with the user terminal, the parent can speak or ask questions to the child through the user terminal such as the mobile phone. After the mobile phone collects the parent's voice signal, it will be uploaded in real time. After the parent's voice is transmitted to the control terminal through the server, the control terminal will control the Bluetooth speaker to play the parent's voice so that the child can hear the parent's voice. The connection between the user terminal and the story machine is established because they use the same application and have account information that is bound to each other. The user terminal and the story machine can simultaneously send information connection requests to the background server through the application; after receiving the request, the background server can confirm the identity and grant the call permission.
[0050] In some embodiments, within a preset waiting time, if the control terminal fails to establish a connection with the user terminal, the control terminal will obtain the alternative setting information preset by the parent; when the alternative disconnection disposal is self-service mediation, the control terminal uploads the default information to be matched to the server; when the alternative disconnection disposal is an alternative user connection, the control terminal sends a call connection request to the alternative terminal used by the alternative user.
[0051] Specifically, parents set the alternative disconnection disposal to self-service mediation through the application program interface of the user terminal, and set default customer service matching conditions such as gender, age, and language to form the default information to be matched; when the control terminal obtains the alternative setting information from the user terminal through the API interface of the application, if the disconnection is self-service mediation, the default information to be matched will be uploaded to the server (through HTTP request).
[0052] Optionally, the parent sets the alternative disconnection disposal as an alternative user connection through the application interface of the user terminal, and selects alternative connection users such as relatives and friends from the address book; the control terminal obtains the alternative user information from the user terminal, and if it is an alternative user connection during disconnection, it initiates a connection request to each alternative terminal in turn until the connection is successful. It is understandable that other methods can also be used to set and use alternative setting information, such as saving settings locally on the control terminal, allowing multiple alternative disposal methods to be mixed, etc., which are not limited here.
[0053] S203: After the parent sets the child's information to be matched through the user terminal and triggers a mediation request instruction, the control terminal obtains and uploads the child's information to be matched to the server.
[0054] Among them, the child's matching information represents the child's status information and customer service selection information that need to be uploaded to the server, which is set and uploaded by the parents on the user terminal; the child's status information may include the child's emotional state, needs, etc.; the customer service selection information may include specific customer service type or customer service name, etc.
[0055] Specifically, when parents are unable to conduct mediation processes such as storytelling and comforting their children due to special circumstances such as going out, working, or temporarily leaving the child's room, they can check the child's current status information through the application interface of the smart device and select a designated customer service to soothe the child's emotions. After the settings are completed, parents can click the Submit button to trigger the mediation request instruction; after the control terminal receives the mediation request instruction, it will obtain the child's pending matching information set and upload the child's pending matching information to the server. The child's pending matching information can also include the child's basic information preset by the parents, such as age, gender, etc. The child's pending matching information will be password-encoded during the transmission process to ensure information security.
[0056] In some embodiments, parents can preset the child's to-be-matched information according to the mediation function usage habits, so that parents can set the child's to-be-matched information more quickly. At the same time, the server can provide a preset selection of the child's to-be-matched information on the application interface according to the user's historical selection.
[0057] S204. After receiving the matching success information returned by the server, the control terminal establishes a call connection with the corresponding successfully matched customer service terminal, and controls the Bluetooth speaker to play the customer service voice sent back by the customer service terminal.
[0058] Specifically, after receiving the successful matching prompt returned by the server, the control terminal will connect to the server through the application and establish a call connection with the assigned customer service terminal. After that, the customer service voice used for mediation will be forwarded to the control terminal through the server, and the control terminal will control the Bluetooth speaker to play it, so that the customer service can use voice to coax the child to sleep.
[0059] In some embodiments, before the customer service voice is played, it will be checked and reviewed for sensitive words on the server side to remove or block sensitive sentences, so as to avoid situations where the customer service voice is not suitable for the scene or may cause discomfort to children, thereby ensuring the effect of coaxing them to sleep.
[0060] S205. The control terminal records the customer service call voice through the Bluetooth speaker, and sends the customer service call voice to the user terminal used by the parent.
[0061] Specifically, the control terminal will control the Bluetooth speaker to record the customer service call voice of the entire customer service call process in real time, and then send the recorded customer service voice to the parent's user terminal for the parent's reference or review.
[0062] In some embodiments, the customer service call voice can also be converted into text data and sent to the user terminal. The text contains the timestamp of the corresponding sentence to facilitate parents to quickly check.
[0063] S206: The control terminal receives the parent guidance information returned by the user terminal, and sends the parent guidance information to the customer service terminal.
[0064] Among them, parent guidance information refers to the follow-up guidance given by parents based on the voice effect of the customer service. Specifically, while listening to the voice of the customer service, parents can give the next step of guidance based on the voice effect, such as asking the customer service to choose a specific story to tell, etc. These guidance information will be sent from the user terminal to the control terminal, and then the control terminal will forward the guidance information to the customer service terminal so that the customer service can adjust the voice.
[0065] It should be noted that during the above steps, including the child's to-be-matched information and the parent's guidance information, are uploaded to the server through the control terminal and then transferred to the customer service terminal. Although the child's to-be-matched information and the parent's guidance information are sent by the user terminal, they need to be transferred through the control terminal, the purpose of which is to protect the privacy information of the user terminal. The control terminal does not store the user-related information of the parents, and sending it to the customer service terminal can ensure data security. In some embodiments, after the parents authorize and allow the user terminal, they can also directly upload the information to the customer service terminal through the user terminal.
[0066] It should also be noted that the customer service on the customer service terminal side can be a child customer service butler who has undergone a series of systematic training. Each child customer service butler can serve the smart children's story machine that subscribes to a designated package; the customer service can also be users who download the designated application by themselves. After passing a specific review, these users can accept orders for child coaxing tasks to sleep in the form of rewards.
[0067] It should also be noted that the interfaces of the control terminal, user terminal, and customer service terminal are all different in the application. In the application of the control terminal, there are controls for instructing the Bluetooth speaker to play audio, controls for instructing the Bluetooth speaker to record audio, story song library, parent paging controls, and general setting controls, etc., which are used for local control of the Bluetooth speaker, parent interconnection, and general settings; in the application of the user terminal, there are interfaces for remote device control (that is, all interfaces of the control terminal with the story machine), user account information settings, customer service information library, historical database, and customer service connection request controls, etc., which are used for remote control of the Bluetooth speaker (story machine), customer service selection, and other settings; and in the application of the customer service terminal, there are sections such as receiving sleep-inducing tasks, historical receiving information, and receiving rewards.
[0068] After combining the above-mentioned method implementation scenario of the intelligent children's story machine 101, the following further describes the process of the method provided by this implementation from the perspective of the server 102 corresponding to the intelligent children's story machine 101. Figure 3 , is another flow chart of the interactive method of the smart children's story machine in the embodiment of the present application.
[0069] S301. After receiving the child's to-be-matched information, the server determines a plurality of to-be-matched customer service terminals according to the customer service selection information in the child's to-be-matched information.
[0070] Specifically, after the above step S203, the server receives the child to-be-matched information uploaded by the control terminal containing the customer service selection information, and the server selects multiple customer service terminals that meet the requirements from the server-side database according to these selection conditions as the customer service terminals to be matched as the candidate for this matching. In some embodiments, the customer service selection information can be naming information, that is, information that specifies one or more specific customer services for connection; or it can be information for selecting the type of customer service, including selecting the age group of children to be coaxed to sleep, the coaxing skills (storytelling, singing), etc. that the customer service is good at.
[0071] The server stores the registration information of the customer service terminal, including the customer service's age, skills, customer evaluation, order completion rate and other information. The server will first filter out the matching candidate customer service according to the customer service selection information. For example, if the age range of 0-3 years old and storytelling skills are selected, the customer service who meets both conditions will be selected. Then the server will sort the selected candidate customer service according to the order completion rate and customer evaluation. Customer service with higher order completion rate and customer evaluation will be given priority. Finally, the server will select several customer service terminals with higher ranking as the customer service terminals to be matched.
[0072] S302: The server extracts a customer service terminal in an idle state from multiple customer service terminals to be matched as a target customer service terminal.
[0073] Specifically, from the multiple candidate customer service terminals determined in the previous step S301, the server will retrieve the current online status information of the candidate customer service terminals, and each customer service terminal will report its current online status to the server, including idle, busy and other information. The server will filter out the customer service terminals that are currently in an idle state from the candidate customer service terminals, which means that these customer service terminals are not currently processing other coaxing tasks and can immediately respond to new coaxing requests. Then the server will sort the idle customer service terminals according to the customer service's historical order completion rate and customer evaluation, and select the customer service terminal with the highest ranking as the final target customer service terminal.
[0074] S303: The server sends a call connection request including the child status information to the target customer service terminal.
[0075] Specifically, after determining the target customer service, the server will send the child status information set by the parent to the target customer service terminal through the application program interface. The child status information includes the child's age, gender, current emotional state, type of coaxing to sleep, etc., where the emotional state indicates the child's current positive or negative emotions, and the type of demand may be wanting to listen to stories or sing nursery rhymes. The server sends this information to enable the customer service to fully understand the child's current specific situation, such as what age group the child belongs to, what the current mental state is, what coaxing effect they want to achieve, etc. This information is the parent's selection or option on the user terminal, so that the customer service can provide personalized voice coaxing to sleep service that meets the child's actual needs.
[0076] S304: After the target customer service terminal returns call confirmation information, the server sends a matching success message to the control terminal.
[0077] Specifically, after receiving the confirmation response from the customer service terminal to the connection request, the server will send a notification of successful matching to the control terminal. The confirmation response includes three items: confirmation identifier, customer service ID and estimated response time, indicating that the customer service accepts the request and responds. The confirmation identifier represents acceptance of the request, the customer service ID identifies the specific customer service who accepts the order, and the estimated response time is the connection time predicted by the customer service.
[0078] After receiving this confirmation response containing three items, the server will group the matching success information and send it to the control terminal. The matching success information also includes a confirmation mark, an assigned customer service ID, and an estimated ringing time. The confirmation mark represents a successful match, the assigned customer service ID prompts the specific customer service that has been matched, and the estimated ringing time tells the control terminal how long it will take to connect to the customer service voice. In this way, the matching success information can let the control terminal know the matching status and the time when the subsequent call can be established, providing voice coaxing service for children.
[0079] S305: The server receives the initial voice sent by the target customer service terminal.
[0080] Specifically, after the server successfully matches the target customer service terminal, the customer service terminal will begin to send its original, unprocessed voice to the server. These original, unprocessed voices are the initial voices. The server receives these initial voices for the purpose of subsequent voice processing, converting the initial voices into processed customer service voices that suit children's preferences, and then providing them to children for voice coaxing to sleep services.
[0081] S306: The server performs voice change processing on the initial voice according to the corresponding target voice setting in the user terminal to obtain a customer service voice that meets the target voice setting.
[0082] Specifically, in order to make the customer service voice more in line with children's preferences, the server will use a voice processing algorithm to change and tune the received original initial voice based on the target voice parameters set by parents in the user terminal, and output a modified new customer service voice to meet the children's voice role requirements.
[0083] Among them, the target voice setting is the parents' requirement for the customer service voice timbre, which is generally a specified voice-changing character. Through this setting, the server can determine the voice character selected by the parents for the child.
[0084] S307. The server sends the customer service voice to the control terminal.
[0085] Specifically, after the server generates new customer service voices that meet the target voice parameter requirements using a voice processing algorithm, the server will send these processed customer service voices that meet the voice preferences of children to the control terminal. After receiving the personalized customer service voices sent by the server, the control terminal will control the Bluetooth speaker to play them.
[0086] In some embodiments, after receiving the customer service tag information sent by the user terminal, the server will obtain the customer service information corresponding to the customer service terminal, and store the customer service information in the alternative customer service library corresponding to the user terminal. Specifically, the user terminal pops up an evaluation prompt after the customer service call ends, or the parent can determine the degree of satisfaction with the customer service in the form of scoring during the customer service call; if the score is higher than the preset value, the customer service tag information containing the high score will be sent to the server; after receiving the tag information, the server extracts the customer service information from the customer service management system and stores it in the alternative customer service library data table named after the user ID.
[0087] Optionally, the control terminal detects that the parent presses a preset control used to mark a customer service during a call, such as a favorites button, and identifies it as the parent's selection of a customer service. After the call ends, the customer service ID is sent to the server as marking information; after receiving the marking information, the server notifies the corresponding customer service terminal to upload its own information and store it in the alternative customer service library corresponding to the user.
[0088] In the embodiments of the present application, due to the use of intelligent children's storytelling machines for intelligent voice interaction, multi-party collaboration, and personalized intelligent recommendations and other technical means, functions such as intelligent monitoring of children's status, contacting appropriate personnel for remote mediation, and providing personalized voice services are realized, which effectively solves the problem that traditional children's storytelling machines can only passively play voice content and cannot respond to and process children's status, thereby realizing intelligent, real-time, and personalized remote voice coaxing to sleep and emotional comfort.
[0089] The following describes the intelligent children's storytelling machine in the embodiment of the present invention from the perspective of hardware processing. Figure 4, is a schematic diagram of the physical device structure of the intelligent children's story machine in an embodiment of the present application.
[0090] It should be noted that Figure 4 The structure of the smart children's story machine shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0091] like Figure 4 As shown, the intelligent children's story machine includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 402 or the program loaded from the storage part 408 to the random access memory (RAM) 403, such as executing the method described in the above embodiment. In RAM 403, various programs and data required for system operation are also stored. CPU 401, ROM 402 and RAM 403 are connected to each other through bus 404. Input / output (I / O) interface 405 is also connected to bus 404.
[0092] The following components are connected to the I / O interface 405: an input section 406 including an audio input device, a button switch, etc.; an output section 407 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the I / O interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed so that a computer program read therefrom is installed into the storage section 408 as needed.
[0093] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 409, and / or installed from a removable medium 411. When the computer program is executed by the central processing unit (CPU) 401, various functions defined in the present invention are performed.
[0094] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.
[0095] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.
[0096] Specifically, the smart children's story machine of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, the interactive method of the smart children's story machine provided in the above embodiment is implemented.
[0097] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the intelligent children's story machine described in the above embodiment; or may exist independently without being assembled into the intelligent children's story machine. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the intelligent children's story machine, the intelligent children's story machine implements the interaction method of the intelligent children's story machine provided in the above embodiment.
[0098] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0099] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.
[0100] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Claims
1. An interactive method for an intelligent children's story machine, characterized in that: The smart children's story machine includes a Bluetooth speaker and a control terminal, the Bluetooth speaker is connected to the control terminal via Bluetooth communication, and the method includes: The control terminal sends a call connection request to the user terminal used by the parent in response to the crying processing instruction; the crying processing instruction is sent to the control terminal by the Bluetooth speaker after detecting the crying voice of the child, or is sent to the control terminal by the Bluetooth speaker after detecting that a preset button is pressed; After establishing a call connection with the user terminal, the control terminal receives the parent voice sent back by the user terminal, and controls the Bluetooth speaker to play the parent voice; After the parent sets the child's information to be matched through the user terminal and triggers the mediation request instruction, the control terminal obtains and uploads the child's information to be matched to the server; the child's information to be matched is set by the parent, including child status information and customer service selection information; After receiving the matching success information returned by the server, the control terminal establishes a call connection with the corresponding successfully matched customer service terminal, and controls the Bluetooth speaker to play the customer service voice sent back by the customer service terminal; The control terminal records the customer service call voice through the Bluetooth speaker, and sends the customer service call voice to the user terminal used by the parent; The control terminal receives the parent guidance information returned by the user terminal, and sends the parent guidance information to the customer service terminal.
2. The method according to claim 1, characterized in that After the control terminal sends a call connection request to a user terminal used by a parent in response to the crying processing instruction, the method further includes: The control terminal obtains an audio list preset by the parent, including a plurality of lullabies and story songs; The control terminal controls the Bluetooth speaker to play multiple audios in the audio list.
3. The method according to claim 1, characterized in that After the control terminal sends a call connection request to a user terminal used by a parent in response to the crying processing instruction, the method further includes: If the control terminal fails to establish a connection with the user terminal within the preset waiting time, the control terminal acquires the alternative setting information preset by the parent; the alternative setting information includes alternative disconnection disposal and default to-be-matched information; When the alternative disconnection disposal is self-service mediation, the control terminal uploads the default information to be matched to the server.
4. The method according to claim 3, characterized in that After the control terminal sends a call connection request to a user terminal used by a parent in response to the crying processing instruction, the method further includes: When the alternative disconnection treatment is alternative user connection, the control terminal sends a call connection request to the alternative terminal used by the alternative user.
5. The method according to claim 1, characterized in that After the parent sets the child's information to be matched through the user terminal and triggers the mediation request instruction, after the control terminal acquires and uploads the child's information to be matched to the server, the method further includes: After receiving the child to-be-matched information, the server determines a plurality of to-be-matched customer service terminals according to the customer service selection information in the child to-be-matched information; The server extracts a customer service terminal in an idle state from the multiple customer service terminals to be matched as a target customer service terminal; the idle state is set by the customer service on the customer service terminal; The server sends a call connection request including the child status information to the target customer service terminal; After the target customer service terminal returns the call confirmation information, the server sends a matching success message to the control terminal.
6. The method according to claim 5, characterized in that After the target customer service terminal returns the call confirmation information, after the step of the server sending the matching success information to the control terminal, the method further includes: The server receives the initial voice sent by the target customer service terminal; The server performs voice changing processing on the initial voice according to the corresponding target voice setting in the user terminal to obtain a customer service voice that meets the target voice setting; The server sends the customer service voice to the control terminal.
7. The method according to claim 1, characterized in that After the step of recording the customer service call voice by the control terminal through the Bluetooth speaker and sending the customer service call voice to the user terminal used by the parent, the method further includes: After receiving the customer service mark information sent by the user terminal, the server obtains the customer service information corresponding to the customer service terminal; The server stores the customer service information in a candidate customer service database corresponding to the user terminal.
8. An intelligent children's storytelling machine, characterized in that: The smart children's story machine includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the smart children's story machine to execute the method described in any one of claims 1-7.
9. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on the smart children's story machine, the smart children's story machine executes the method as described in any one of claims 1-7.
10. A computer program product, characterized in that When the computer program product runs on an intelligent children's story machine, the intelligent children's story machine executes the method as claimed in any one of claims 1 to 7.
Citation Information
Patent Citations
Mother and child information transmitting method and system based on information fusion
CN110808071A
Control method of babysitter robot, babysitter robot and chip
CN112743551A
