Methods and devices for providing reminders, storage media and electronic devices
By combining voice and image recognition technologies with voiceprint and facial recognition, the problem of traditional sticky notes being unable to provide intelligent reminders has been solved, achieving targeted, secure, and intelligent reminder effects, and supporting private reminders and feedback mechanisms.
Patent Information
- Application Number
- CN202211741617.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-30
- Publication Date
- 2025-12-02
- Estimated Expiration
- 2042-12-30
AI Technical Summary
Traditional sticky notes and message boards cannot provide intelligent reminders, nor can they guarantee that the recipients will receive the reminders in a timely manner. They also present environmental and efficiency issues.
By combining voice recognition and image recognition technologies with voiceprint and facial recognition, the system determines whether the recipient is within a preset range and provides a reminder if the conditions are met. It supports private reminders and priority management, enabling non-real-time voice interaction.
It provides targeted, secure, and intelligent reminders, preventing reminders from being missed. It also supports private reminders and feedback mechanisms, improving the accuracy and efficiency of reminders.
Smart Images

Figure CN116259162B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of smart home technology, and more specifically, to a method and apparatus for providing reminders, a storage medium, and an electronic device. Background Technology
[0002] Traditional sticky notes and message boards can be seen by anyone passing by, requiring the recipient to actively check them; they lack intelligent reminders. Furthermore, traditional sticky notes require writing on paper, which is neither environmentally friendly nor efficient. If a calendar alarm is used, it requires precise timing, and when the reminder is announced, it's uncertain whether the recipient is near the smart device, whether they can receive the reminder, or whether unrelated people nearby are simultaneously listening to it.
[0003] Furthermore, traditional sticky notes and message boards require users to actively check and find the message for themselves among all the messages. Regarding the issues that arise with traditional sticky notes, such as the recipient not being promptly notified, no effective solutions have yet been proposed.
[0004] Therefore, it is necessary to improve the relevant technology to overcome the aforementioned defects. Summary of the Invention
[0005] This application provides a method, apparatus, storage medium, and electronic device for providing reminders, in order to at least solve the problem in the related art where the recipient cannot be reminded in a timely manner when leaving a message on a traditional sticky note.
[0006] According to one embodiment of this application, a method for prompting reminder content is provided, comprising: obtaining a reminder event set by a first object for a second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions for the first object to remind the second object; and, when the reminder triggering conditions are met, prompting the second object with the reminder content according to a preset reminder method.
[0007] In an exemplary embodiment, obtaining a reminder event set by a first object includes: receiving a voice setting instruction from the first object; in response to the voice setting instruction, recognizing the voice content of the voice setting instruction and recognizing the identity information of the first object; and determining the reminder event based on a first recognition result corresponding to the voice content and a second recognition result of the identity information.
[0008] In an exemplary embodiment, the reminder triggering condition is determined to be met at least by: determining that the current time is within the time range indicated by the reminder triggering condition, and determining that the distance between the second object and the message board device is less than a preset threshold.
[0009] In an exemplary embodiment, determining that the distance between the second object and the target device is less than a preset threshold includes at least one of the following: determining that the distance between the second object and the message board device is less than a preset threshold when the voiceprint information of the second object is identified through the voiceprint recognition function of the target device; determining that the distance between the second object and the message board device is less than a preset threshold when the facial features of the second object are identified through the facial recognition function of the target device; or determining that the distance between the second object and the message board device is less than a preset threshold through the image recognition function of the target device; wherein, the target device includes at least one of the following: the message board device, or other home appliances.
[0010] In an exemplary embodiment, prompting the second object with the reminder content according to a preset reminder method includes: determining whether the second object exists only within a preset range of the message board device; if the second object exists only within the preset range, prompting the second object with the reminder content according to the preset reminder method; if the second object does not exist only within the preset range, prompting the reminder content through the text display page of the message board device.
[0011] In an exemplary embodiment, after prompting the second object with the reminder content according to a preset reminder method, the method further includes: obtaining the feedback voice of the second object; performing semantic recognition on the feedback voice to obtain a semantic recognition result; and setting a reminder event from the second object to the first object based on the semantic recognition result.
[0012] In an exemplary embodiment, prompting the second object with the reminder content according to a preset reminder method includes: when multiple first objects have set reminder events for the second object, obtaining the message priority order of the multiple first objects; and sequentially prompting the second object with the reminder events set by the multiple first objects for the second object according to the message priority order.
[0013] In an exemplary embodiment, before setting a reminder event on a target device according to the setting instructions of the first object, the process includes: obtaining the biometrics of the first object, wherein the biometrics include at least one of the following: voiceprint information, facial features; and, if the biometrics have been registered, determining that the first object has setting permissions.
[0014] In an exemplary embodiment, prompting the second object with the reminder content according to a preset reminder method includes at least one of the following: obtaining the maximum number of times the reminder content is prompted and the broadcast time interval corresponding to the reminder content, wherein the broadcast time interval is used to indicate the time interval between any two adjacent reminder content prompts; broadcasting the reminder content according to the broadcast time interval, and stopping the prompting of the reminder content when the number of broadcasts reaches the maximum number of times the reminder content is prompted.
[0015] In an exemplary embodiment, after prompting the second object with the reminder content according to a preset reminder method, the method further includes: obtaining the feedback voice of the second object; performing semantic recognition on the feedback voice to obtain a semantic recognition result; and sending the semantic recognition result to the mobile terminal corresponding to the first object.
[0016] According to another embodiment of the present application, a reminder content prompting device is also provided, comprising: an acquisition module, configured to acquire a reminder event set by a first object for a second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions for the first object to remind the second object; and a prompting module, configured to prompt the reminder content to the second object according to a preset reminder method when the reminder triggering conditions are met.
[0017] According to another aspect of the embodiments of this application, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer program, and the computer program is configured to execute the prompting method of the above-mentioned reminder content when running.
[0018] According to another aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the prompting method of the above-mentioned reminder content through the computer program.
[0019] This application obtains a reminder event set by a first object for a second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions for the first object to remind the second object; when the reminder triggering conditions are met, the reminder content is displayed to the second object according to a preset reminder method. In other words, by setting a reminder event, and then displaying the reminder content to the second object according to a preset reminder method when the reminder triggering conditions indicated by the reminder event are met, the problem of not being able to be reminded in a timely manner when leaving messages on traditional sticky notes in related technologies is solved, thereby achieving the technical effect of targeted, safe, and intelligent reminders to the recipients of messages. Attached Figure Description
[0020] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0021] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1 This is a schematic diagram of the hardware environment for an optional reminder content prompting method according to an embodiment of this application;
[0023] Figure 2 This is a flowchart of an optional reminder content prompting method according to an embodiment of this application;
[0024] Figure 3 This is a flowchart of an optional embodiment of a method for displaying optional reminder content according to an embodiment of this application;
[0025] Figure 4 This is a structural block diagram of an optional reminder device according to an embodiment of this application. Detailed Implementation
[0026] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0027] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0028] In some embodiments, smart speakers or other smart devices can be set to use voice-based alarm clocks. However, these alarm clocks require a specific time to trigger the reminder, such as "Wake me up at 7 a.m. tomorrow." At the set time, the smart device will announce the reminder regardless of whether the person being reminded is nearby or in a convenient state to listen, making it easy for them to miss it. If the message is sent to a mobile phone, the timeliness of the user viewing the message and / or listening to the voice message cannot be accurately determined or guaranteed. Furthermore, even if the smart device accurately and appropriately reminds the person being reminded, it cannot achieve non-real-time voice interaction between the reminder and the person being reminded, thus preventing the reminder from receiving feedback when needed.
[0029] Based on the aforementioned shortcomings of smart devices, this application provides a method for prompting reminders. This method allows for voice-activated message reminders. Furthermore, when broadcasting reminders, based on image recognition, voiceprint recognition, and infrared sensing technologies, it can: 1) accurately identify whether the person being reminded is within the set reminder range and whether their current state meets the set conditions, such as time or whether only the person being reminded is present. The reminder will only be broadcast if the set conditions are met, thus effectively ensuring accurate reminders, preventing missed reminders, and protecting privacy. Correspondingly, for reminders that are not particularly urgent or have no time limit, a delayed reminder setting can be implemented. If the person being reminded is not identified and therefore no reminder is broadcast, the monitoring and identification function will be activated to identify the person being reminded based on the reminder's settings, determine if the conditions are met, and then broadcast the reminder. 2) Receive feedback from the person being reminded regarding the voice reminder and send it back to the reminder's terminal, or subsequently, when the reminder is detected passing by, prompt the person being reminded for their feedback. In addition, the person being reminded can also set broadcast conditions for feedback. It enables non-real-time voice interaction between the person reminding and the person being reminded.
[0030] According to one aspect of the embodiments of this application, a method for displaying reminder content is provided. This method for displaying reminder content is widely applicable to whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, and intelligencehouse ecosystems. Optionally, in this embodiment, the above-mentioned method for displaying reminder content can be applied to, for example... Figure 1 The hardware environment shown consists of multiple terminal devices 102 and a server 104. Figure 1As shown, server 104 is connected to multiple terminal devices 102 via a network and can be used to provide services (such as application services) to terminals or clients installed on terminals. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.
[0031] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.
[0032] This embodiment provides a method for displaying reminder content, including but not limited to applications in smart message boards. Figure 2 This is a flowchart of a method for displaying reminder content according to an embodiment of this application. The process includes the following steps:
[0033] Step S202: Obtain the reminder event set by the first object for the second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object;
[0034] Step S204: When the reminder triggering condition is met, the reminder content is prompted to the second object according to the preset reminder method.
[0035] Through the above steps, a reminder event set by the first object for the second object is obtained. This reminder event at least indicates the reminder content and triggering conditions for the first object to remind the second object. When the triggering conditions are met, the reminder content is displayed to the second object according to a preset reminder method. In other words, by setting a reminder event, and then displaying the reminder content to the second object according to a preset reminder method when the triggering conditions indicated by the reminder event are met, the problem of timely reminders for recipients of traditional sticky notes in related technologies is solved. This achieves a targeted, secure, and intelligent reminder effect for recipients of messages.
[0036] It should be noted that the setting of reminder events for the second object by the first object, and the determination of whether the reminder triggering conditions are met, can both be set and / or determined by the target device. Furthermore, the target device can be a device capable of allowing reminder events to be set and determining whether the reminder triggering conditions are met. The target device includes at least one of the following: the aforementioned message board device, other home appliances, specifically, a smart message board device; this application embodiment does not limit this.
[0037] Furthermore, the first object setting a reminder event for the second object can be achieved by the first object issuing a voice setting command to the target device; the first object directly inputting a text setting command on the target device; or the first object inputting the setting command on its own mobile terminal and then sending it to the target device via the mobile terminal. This application embodiment does not limit this.
[0038] Optionally, obtaining the reminder event set by the first object includes: receiving a voice setting instruction from the first object; responding to the voice setting instruction, recognizing the voice content of the voice setting instruction and recognizing the identity information of the first object; and determining the reminder event based on a first recognition result corresponding to the voice content and a second recognition result of the identity information.
[0039] For example, the message board device receives a voice setting instruction from a first party, and then identifies the voice content in the voice setting instruction, as well as the identity information of the first party. Furthermore, the voice content recognition can be performed using a voice recognition model trained with deep learning technology. Additionally, both the first and second parties register their identities with the target device before the notification event is set. Identity registration includes at least facial information registration and voiceprint information registration, and the registered identity information is aggregated and stored in the message board device. The identity information of the first party can be confirmed using facial recognition technology and voiceprint recognition technology.
[0040] Optionally, the reminder triggering condition is determined to be met by at least the following means: including determining that the current time is within the time range indicated by the reminder triggering condition, and determining that the distance between the second object and the message board device is less than a preset threshold.
[0041] Furthermore, the reminder triggering condition is determined to be met by at least one of the following methods: determining that the current time is within the time range indicated by the reminder triggering condition; determining that the distance between the second object and the message board device is less than a preset threshold. It is understood that reminder triggering conditions generally include time and location triggering conditions, but time or location triggering conditions can also be specified separately.
[0042] Optionally, determining that the distance between the second object and the target device is less than a preset threshold includes at least one of the following: if the voiceprint information of the second object is identified through the voiceprint recognition function of the target device, determining that the distance between the second object and the message board device is less than a preset threshold; if the facial features of the second object are identified through the facial recognition function of the target device, determining that the distance between the second object and the message board device is less than a preset threshold; or if the distance between the second object and the message board device is determined to be less than a preset threshold through the image recognition function of the target device; wherein, the target device includes at least one of the following: the message board device, other home appliances.
[0043] In other words, based on the identity information of the second object registered on the message board device before the reminder event was set, it can be determined whether the distance between the second object and the message board is less than a preset threshold. Furthermore, a coordinate system can be established with the message board device as the origin, and the coordinates of other home devices within the target device can be obtained in this coordinate system. Then, if the target device recognizes the second object through voiceprint recognition, and / or face recognition, and / or image recognition, the coordinates of the second object can be further calculated, thereby determining whether the distance between the second object and the message board is less than the preset threshold.
[0044] Optionally, prompting the second object with the reminder content according to a preset reminder method includes: determining whether the second object exists only within a preset range of the message board device; if the second object exists only within the preset range, prompting the second object with the reminder content according to the preset reminder method; if the second object does not exist only within the preset range, prompting the reminder content through the text display page of the message board device.
[0045] It should be noted that the embodiments of this application can also limit the privacy reminder. If the reminder event set by the first object includes a privacy reminder trigger condition, that is, if the intention to "only remind the second object" is recognized from the first object's voice setting command and / or text setting command, then the message board further sets a privacy reminder trigger condition. This privacy reminder trigger condition needs to be met simultaneously with trigger conditions such as time range and distance for the reminder content in the reminder event to be displayed. Furthermore, the preset reminder method can be a voice reminder; the preset range can be set to a distance range covered by the minimum volume that ensures the second object can hear the reminder content, as tested. This embodiment of the application does not limit this range. Therefore, if the second object is within the preset range, a voice reminder can be selected; if not within the preset range, the reminder content is displayed as text on the message board device.
[0046] Optionally, after prompting the second object with the reminder content according to a preset reminder method, the method further includes: obtaining the feedback voice of the second object; performing semantic recognition on the feedback voice to obtain a semantic recognition result; and setting a reminder event from the second object to the first object based on the semantic recognition result.
[0047] In other words, after the message board device sends a reminder to the second recipient, it can further receive feedback reminder events from the second recipient to the first recipient. The feedback reminder event can be set via voice feedback or via text information entered on the target device. The settings for the feedback reminder event, the fulfillment of the feedback reminder triggering conditions, and the prompting of the feedback reminder content are as shown in the optional embodiments described above, and will not be repeated here.
[0048] Optionally, the reminder content is prompted to the second object according to a preset reminder method, including: when there are multiple first objects that have set reminder events for the second object, obtaining the message priority order of the multiple first objects; and sequentially prompting the second object with the reminder events set by the multiple first objects for the second object according to the message priority order.
[0049] It is understandable that the first object is the object that sets the reminder event, and the second object is the object that receives the reminder content. There can be multiple first and second objects. Furthermore, when multiple first objects leave messages for the same second object, the message priority order of the first objects can be obtained. Then, when the reminder trigger condition is met, the reminder content is sequentially displayed to the second object. The message priority order can be preset. For example, in a family of three (father, mother, and child), the priority can be preset to mother-father-child, etc. The message priority order can also be further determined. For example, if multiple similar messages are received, the more similar messages, the higher the message priority. A weighted calculation method can then be used for determination, using the formula m = ax + by, where m is the comprehensive priority for further determination, x is the preset first object message priority value, y is the similarity of messages within the same first object (the more similar messages, the higher the similarity), and a and b are weights preset by the user.
[0050] Optionally, before setting a reminder event on the target device according to the setting instructions of the first object, the process includes: obtaining the biometrics of the first object, wherein the biometrics include at least one of the following: voiceprint information, facial features; and if the biometrics have been registered, determining that the first object has setting permissions.
[0051] Understandably, only registered users (i.e., the first user) have the permission to set reminder events. When the first user issues a voice setting command, the target device will detect whether the first user's facial and voiceprint features match those of the registered user. It should be noted that if the first user is not near the message board device, the smart home device closest to the first user will confirm the first user's setting permissions.
[0052] Optionally, the reminder content is prompted to the second object according to a preset reminder method, including at least one of the following: obtaining the maximum number of prompts and the broadcast time interval corresponding to the reminder content, wherein the broadcast time interval is used to indicate the time interval between any two adjacent reminder content prompts; broadcasting the reminder content according to the broadcast time interval, and stopping the prompting of the reminder content when the number of broadcasts reaches the maximum number of prompts for the reminder content.
[0053] To prevent the second party from failing to accurately receive the voice reminder, the number of playbacks and the playback time interval can be set for the voice reminder, such as repeating it three times with a 5-second interval. During the playback of the reminder content, the second party can receive voice commands, which can be used to pause / stop / continue playback of the reminder content, increase or decrease the playback volume, or change the device that is playing the reminder content.
[0054] Optionally, after prompting the second object with the reminder content according to a preset reminder method, the method further includes: obtaining the feedback voice of the second object; performing semantic recognition on the feedback voice to obtain a semantic recognition result; and sending the semantic recognition result to the mobile terminal corresponding to the first object.
[0055] Specifically, the system receives voice feedback from the second party through a microphone in the target device, obtains semantic recognition results (e.g., "finished drinking"), and sends them to the first party's voice terminal. Furthermore, if no voice feedback is received from the second party within a set time, a "no feedback received" message is sent directly to the first party's terminal.
[0056] Obviously, the embodiments described above are merely some embodiments of this application, and not all embodiments. To better understand the above-described method of providing reminders, the following description, in conjunction with embodiments, illustrates the process, but is not intended to limit the technical solutions of the embodiments of this application. Specifically:
[0057] Figure 3 This is a flowchart of an optional embodiment of a method for displaying optional reminder content according to an embodiment of this application, such as... Figure 3 As shown, the steps are as follows:
[0058] Step 1: Enable the voice-activated smart message board;
[0059] Step 2: User registration;
[0060] Both the person leaving the message (equivalent to the first object in the above embodiments) and the person receiving the message (equivalent to the second object in the above embodiments) need to register their identities; the registration methods include face recognition registration and voiceprint registration; users register by face, allowing the network device to identify the registered user through image monitoring.
[0061] Step 3: User voice interaction;
[0062] It can interact with any smart voice device in the whole house's smart home system;
[0063] Step 4: Semantic recognition of message intent;
[0064] The user specifies the target of the message (i.e., the second recipient), the broadcasting device, and the broadcasting conditions; for example, "Leave a message for the baby alone on the refrigerator." Then, through voice recognition technology, the system identifies the recipient the user wants to leave a message for, broadcasts the constraints, and delivers the message information. It should be noted that the broadcasting constraints can be information such as: no other people, time range (morning, afternoon, evening, etc.), location (kitchen, living room, hallway), etc.
[0065] Step 5: Store message information;
[0066] It can be recognized text; it can be a user's recorded message;
[0067] Step 6: Wait for the target user to leave a message;
[0068] Image recognition and voiceprint recognition are used to monitor whether the target user of the message has appeared. Specifically, infrared can be used to detect if a user has passed by, and then the camera and voiceprint detection can be activated. The user who left the message can be identified through face detection and voiceprint recognition technology.
[0069] Step 7: Check broadcast constraints;
[0070] Check whether the following constraints are met: whether it is near the designated broadcasting device, whether it meets the set time range, and whether it meets the privacy requirement (no one else is present).
[0071] Step 8: Announce the message.
[0072] Text messages are read aloud using Text to Speech (TTS); recorded messages are played directly.
[0073] This application allows for more convenient, flexible, and intelligent settings for message recipients and message triggering times via voice, going beyond a single point in time. It intelligently selects whether a reminder is needed based on the spatial relationship between the recipient and the smart device, as well as surrounding information. This makes message reminders more targeted, secure, and diverse, ultimately providing greater practical value to users.
[0074] Specifically, message reminders can be set via voice. Identity recognition (such as registered voiceprints or facial recognition) can be used to determine if the recipient is near the message board. Then, information collection through facial detection, image recognition, and infrared sensing can be used to further determine whether the constraints are met and whether to proactively broadcast the message to the user.
[0075] For example, the following scenarios can be addressed:
[0076] 1) Before going to work, Mom says to the refrigerator (which has a microphone and camera): "Remind the baby to drink a glass of milk." Under this setting, when Grandpa, Grandma, and Dad come near or in front of the refrigerator, it will not trigger Mom's message. Only when "Baby" comes near the refrigerator will the message be broadcast automatically after voiceprint comparison or facial recognition information comparison is used to identify "Baby".
[0077] 2) Mom can leave a private message for Dad: "Leave a message for Dad alone, xxxxx"; when Dad appears in front of the refrigerator (face registration, feature extraction to define whether it is Dad), and there is no one else around (face detection, detecting how many people are in front of the screen), Mom's message will be read aloud.
[0078] 3) Scenario "Remind me to bring my keys before leaving home": Based on the image detection device's set location (entrance hall), image clothing detection (formal wear, casual wear, sportswear), fixed time period each day, and other devices detecting that the user was indoors a few minutes prior, the system comprehensively judges whether the user is preparing to leave home and broadcasts a reminder.
[0079] Furthermore, through this application, users can deliver information to specific users in specific scenarios without setting a specific time, ensuring that the information is conveyed correctly. For example, leaving a message on the refrigerator for a specific user to drink a glass of milk; or leaving a message on the dressing mirror in the hallway for a specific user to remember to bring their keys.
[0080] In public settings, smart message boards allow users to easily and quickly set message recipients, broadcast constraints, and message information via voice. The smart message board uses voice recognition to interpret user commands, combined with image recognition and other sensor data, to intelligently determine if the conditions for message broadcasting are met, creating a multimodal smart message exchange experience. When the recipient passes by the message board, the board identifies them using infrared sensors, video cameras, and audio information. Based on whether the constraints set by the sender are met, it decides whether to proactively broadcast the message. If the constraints are met, the system sends a message or reminder to the designated user via a public smart device, ensuring exclusive access to the information and preventing missed reminders or reminders at inappropriate times that might be ignored.
[0081] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.
[0082] This embodiment also provides a reminder device for displaying reminder content. This device is used to implement the above embodiments and preferred embodiments, and details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.
[0083] Figure 4This is a structural block diagram of a reminder device for optional reminder content according to an embodiment of this application. The device includes:
[0084] The acquisition module 42 is used to acquire a reminder event set by the first object for the second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object;
[0085] The prompt module 44 is used to prompt the second object with the prompt content according to a preset prompt method when the prompt triggering condition is met.
[0086] The aforementioned device acquires a reminder event set by a first object for a second object. This reminder event at least indicates the reminder content and triggering conditions for the first object to remind the second object. When the triggering conditions are met, the reminder content is displayed to the second object according to a preset reminder method. In other words, by setting a reminder event, and then displaying the reminder content to the second object according to a preset reminder method when the triggering conditions indicated by the reminder event are met, the problem in related technologies where the recipient of a traditional sticky note cannot be reminded in a timely manner is solved. This achieves a targeted, safe, and intelligent reminder effect for the recipient of the message.
[0087] Optionally, the acquisition module 42 is further configured to receive a voice setting instruction from the first object; in response to the voice setting instruction, to recognize the voice content of the voice setting instruction and to recognize the identity information of the first object; and to determine the reminder event based on a first recognition result corresponding to the voice content and a second recognition result of the identity information.
[0088] For example, the message board device receives a voice setting instruction from a first party, and then identifies the voice content in the voice setting instruction, as well as the identity information of the first party. Furthermore, the voice content recognition can be performed using a voice recognition model trained with deep learning technology. Additionally, both the first and second parties register their identities with the target device before the notification event is set. Identity registration includes at least facial information registration and voiceprint information registration, and the registered identity information is aggregated and stored in the message board device. The identity information of the first party can be confirmed using facial recognition technology and voiceprint recognition technology.
[0089] Optionally, the prompt module 44 is also configured to determine that the reminder triggering condition is met at least by: determining that the current time is within the time range indicated by the reminder triggering condition, and determining that the distance between the second object and the message board device is less than a preset threshold.
[0090] Furthermore, the reminder triggering condition is determined to be met by at least one of the following methods: determining that the current time is within the time range indicated by the reminder triggering condition; determining that the distance between the second object and the message board device is less than a preset threshold. It is understood that reminder triggering conditions generally include time and location triggering conditions, but time or location triggering conditions can also be specified separately.
[0091] Optionally, the prompting module 44 is further configured to determine that the distance between the second object and the target device is less than a preset threshold, including at least one of the following: if the voiceprint information of the second object is identified through the voiceprint recognition function of the target device, determine that the distance between the second object and the message board device is less than a preset threshold; if the facial features of the second object are identified through the facial recognition function of the target device, determine that the distance between the second object and the message board device is less than a preset threshold; or if the distance between the second object and the message board device is less than a preset threshold through the image recognition function of the target device; wherein, the target device includes at least one of the following: the message board device, other home appliances.
[0092] In other words, based on the identity information of the second object registered on the message board device before the reminder event was set, it can be determined whether the distance between the second object and the message board is less than a preset threshold. Furthermore, a coordinate system with the message board device as the origin can be established, and the coordinates of other home devices within the target device can be obtained in this coordinate system. Then, if the target device recognizes the second object through voiceprint recognition, and / or face recognition, and / or image recognition, the coordinates of the second object can be further calculated, thereby determining whether the distance between the second object and the message board is less than the preset threshold.
[0093] Optionally, the prompting module 44 is further configured to determine whether only the second object exists within the preset range of the message board device; if only the second object exists within the preset range, prompt the second object with the prompting content according to the preset prompting method; if not only the second object exists within the preset range, prompt the prompting content through the text display page of the message board device.
[0094] It should be noted that the embodiments of this application can also limit the privacy reminder. If the reminder event set by the first object includes a privacy reminder trigger condition, that is, if the intention to "only remind the second object" is recognized from the first object's voice setting command and / or text setting command, then the message board further sets a privacy reminder trigger condition. This privacy reminder trigger condition needs to be met simultaneously with trigger conditions such as time range and distance for the reminder content in the reminder event to be displayed. Furthermore, the preset reminder method can be a voice reminder; the preset range can be set to a distance range covered by the minimum volume that ensures the second object can hear the reminder content, as tested. This embodiment of the application does not limit this range. Therefore, if the second object is within the preset range, a voice reminder can be selected; if not within the preset range, the reminder content is displayed as text on the message board device.
[0095] Optionally, the prompting module 44 is further configured to, after prompting the second object with the prompting content according to a preset prompting method, obtain the feedback voice of the second object; perform semantic recognition on the feedback voice to obtain a semantic recognition result; and set a prompting event from the second object to the first object based on the semantic recognition result.
[0096] In other words, after the message board device sends a reminder to the second recipient, it can further receive feedback reminder events from the second recipient to the first recipient. The feedback reminder event can be set via voice feedback or via text information entered on the target device. The settings for the feedback reminder event, the fulfillment of the feedback reminder triggering conditions, and the prompting of the feedback reminder content are as shown in the optional embodiments described above, and will not be repeated here.
[0097] Optionally, the prompting module 44 is further configured to, when there are multiple first objects setting reminder events for the second object, obtain the message priority order of the multiple first objects; and sequentially prompt the second object with the reminder events set by the multiple first objects for the second object according to the message priority order.
[0098] It is understandable that the first object is the object that sets the reminder event, and the second object is the object that receives the reminder content. There can be multiple first and second objects. Furthermore, when multiple first objects leave messages for the same second object, the message priority order of the first objects can be obtained. Then, when the reminder trigger condition is met, the reminder content is sequentially displayed to the second object. The message priority order can be preset. For example, in a family of three (father, mother, and child), the priority can be preset to mother-father-child, etc. The message priority order can also be further determined. For example, if multiple similar messages are received, the more similar messages, the higher the message priority. A weighted calculation method can then be used for determination, using the formula m = ax + by, where m is the comprehensive priority for further determination, x is the preset first object message priority value, y is the similarity of messages within the same first object (the more similar messages, the higher the similarity), and a and b are weights preset by the user.
[0099] Optionally, the acquisition module 42 is further configured to acquire the biometric features of the first object before setting a reminder event on the target device according to the setting instruction of the first object, wherein the biometric features include at least one of the following: voiceprint information, facial features; and determine that the first object has setting permissions if the biometric features have been registered.
[0100] Understandably, only registered users (i.e., the first user) have the permission to set reminder events. When the first user issues a voice setting command, the target device will detect whether the first user's facial and voiceprint features match those of the registered user. It should be noted that if the first user is not near the message board device, the smart home device closest to the first user will confirm the first user's setting permissions.
[0101] Optionally, the prompting module 44 is further configured to: obtain the maximum number of prompts and the broadcast time interval corresponding to the prompt content, wherein the broadcast time interval is used to indicate the time interval between any two adjacent prompts of the prompt content; broadcast the prompt content according to the broadcast time interval, and stop prompting the prompt content when the number of broadcasts reaches the maximum number of prompts of the prompt content.
[0102] To prevent the second party from failing to accurately receive the voice reminder, the number of playbacks and the playback time interval can be set for the voice reminder, such as repeating it three times with a 5-second interval. During the playback of the reminder content, the second party can receive voice commands, which can be used to pause / stop / continue playback of the reminder content, increase or decrease the playback volume, or change the device that is playing the reminder content.
[0103] Optionally, the prompting module 44 is further configured to, after prompting the second object with the prompting content according to a preset prompting method, obtain the feedback voice of the second object; perform semantic recognition on the feedback voice to obtain a semantic recognition result; and send the semantic recognition result to the mobile terminal corresponding to the first object.
[0104] Specifically, the system receives voice feedback from the second party through a microphone in the target device, obtains semantic recognition results (e.g., "finished drinking"), and sends them to the first party's voice terminal. Furthermore, if no voice feedback is received from the second party within a set time, a "no feedback received" message is sent directly to the first party's terminal.
[0105] Embodiments of this application also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when run.
[0106] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:
[0107] S1, obtain the reminder event set by the first object for the second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object;
[0108] S2, when the reminder triggering condition is met, the reminder content is prompted to the second object according to the preset reminder method.
[0109] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.
[0110] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.
[0111] Embodiments of this application also provide an electronic device including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.
[0112] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:
[0113] S1, obtain the reminder event set by the first object for the second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object;
[0114] S2, when the reminder triggering condition is met, the reminder content is prompted to the second object according to the preset reminder method.
[0115] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.
[0116] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.
[0117] Obviously, those skilled in the art should understand that the modules or steps of this application described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this application is not limited to any particular combination of hardware and software.
[0118] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A method for displaying reminder content, characterized in that, include: Obtain a reminder event set by a first object for a second object, wherein the reminder event is at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object; When the reminder triggering condition is met, the reminder content is displayed to the second object according to a preset reminder method. The reminder triggering condition is determined to be met by at least the following methods: including: Determine that the current time falls within the time range indicated by the reminder triggering condition, and It is determined that the distance between the second object and the message board device is less than a preset threshold. Specifically, when the target device recognizes the second object through voiceprint recognition, face recognition, or image recognition, the coordinates of the second object in a coordinate system with the message board device as the origin are calculated to determine whether the distance between the second object and the message board device is less than a preset threshold.
2. The method for prompting reminder content according to claim 1, characterized in that, Retrieve the notification event set by the first object, including: Receive the voice setting command from the first object; In response to the voice setting command, the voice content of the voice setting command is recognized, and the identity information of the first object is recognized; The reminder event is determined based on the first recognition result corresponding to the voice content and the second recognition result of the identity information.
3. The method for prompting reminder content according to claim 1, characterized in that, The reminder content is displayed to the second object according to a preset reminder method, including: Determine whether the second object exists only within the preset range of the message board device; If only the second object exists within the preset range, the reminder content is displayed to the second object according to the preset reminder method; If the second object is not the only one present within the preset range, the reminder content will be displayed on the text display page of the message board device.
4. The method for prompting reminder content according to any one of claims 1-3, characterized in that, After prompting the second object with the reminder content according to the preset reminder method, the method further includes: Obtain the feedback voice from the second object; The feedback speech is subjected to semantic recognition to obtain the semantic recognition result; Based on the semantic recognition result, the second object sets a reminder event for the first object.
5. The method for prompting reminder content according to any one of claims 1-3, characterized in that, The reminder content is displayed to the second object according to a preset reminder method, including: In the case where multiple first objects set reminder events for the second object, the message priority order of the multiple first objects is obtained; The reminder events set by the first object for the second object are sequentially displayed to the second object according to the priority order of the messages.
6. A reminder device for a specific content, characterized in that, include: The acquisition module is used to acquire reminder events set by the first object for the second object, wherein the reminder events are at least used to indicate the reminder content and reminder triggering conditions of the first object reminding the second object; The notification module is used to notify the second object of the notification content according to a preset notification method when the notification triggering condition is met. The reminder triggering condition is determined to be met by at least the following methods: including: Determine that the current time falls within the time range indicated by the reminder triggering condition, and It is determined that the distance between the second object and the message board device is less than a preset threshold. Specifically, when the target device recognizes the second object through voiceprint recognition, face recognition, or image recognition, the coordinates of the second object in a coordinate system with the message board device as the origin are calculated to determine whether the distance between the second object and the message board device is less than a preset threshold.
7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method of any one of claims 1 to 5.
8. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method of any one of claims 1 to 5 through the computer program.
Citation Information
Patent Citations
Event reminding method and device, electronic equipment and storage medium
CN111970403A
Reminding method and water heater
CN112785241A