Monitoring reminding method and device and storage medium
By monitoring audio signals in real time and generating reminder events, the problem of low efficiency in time management and planning in the prior art is solved, automated reminders are realized, and users' time management efficiency and relief of life pressure are improved.
Patent Information
- Application Number
- CN202410976050.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-26
AI Technical Summary
In the prior art, people need to organize reminders by themselves when managing time and planning time, which is inefficient and consumes a lot of time.
By monitoring audio signals in real time, using the voice recognition model to identify time, place and behavioral information in the text, generate reminder events, and send reminder information to users based on these conditions to realize the automated reminder function.
Save users' time, improve efficiency, automatically capture voice information in daily work and life, help users collect information sorting and manage time, and alleviate the pressure of study, work and life.
Smart Images

Figure CN119028341A_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to the field of communication technology, and in particular to a monitoring reminder method, device and storage medium. [Background technology]
[0002] With the development of science and technology and society, the pace of modern society is getting faster and faster, and the requirements for efficiency are getting higher and higher. The fast pace and trivial affairs of modern society often make people feel at a loss, and these trivial matters require people to spend a lot of time and energy. In order to manage time and plan, in the existing technology, people use mobile phone apps or computers to create reminders, but it takes a lot of time to organize them by themselves, which is not efficient. [Summary of the invention]
[0003] The present invention overcomes the shortcomings of the prior art and provides a monitoring reminder method, device and storage medium, which actively generates reminder events and sends reminder messages through real-time monitoring to improve efficiency.
[0004] A first aspect of the present invention provides a monitoring reminder method, comprising:
[0005] Monitor audio signals in real time;
[0006] Recognize the audio signal through a speech recognition model to obtain a text corresponding to the audio signal;
[0007] Extracting target keywords corresponding to time information, location information, and behavior action information in the text;
[0008] A reminder event is generated according to the target keyword, and the reminder event includes a time condition and / or a location condition.
[0009] A second aspect of the present invention provides a monitoring reminder device, comprising:
[0010] A monitoring unit, used for monitoring audio signals in real time;
[0011] A recognition unit, configured to recognize the audio signal through a speech recognition model to obtain a text corresponding to the audio signal;
[0012] An extraction unit, used to extract target keywords corresponding to time information, location information and behavior action information in the text;
[0013] A generating unit, configured to generate a reminder event according to the target keyword, wherein the reminder event includes a time condition and / or a location condition;
[0014] The reminder unit is used to send reminder information to the user according to the time condition and / or the location condition.
[0015] A third aspect of an embodiment of the present application provides a monitoring reminder device, which includes at least one connected processor, a memory and a transceiver, wherein the memory is used to store program code, and the processor is used to call the program code in the memory to execute the steps of the monitoring reminder method described in the first aspect above.
[0016] A fourth aspect of the present invention provides a computer-readable storage medium, which includes instructions, and when the instructions are executed on a computer, the computer executes the steps of the monitoring reminder method described in the first aspect.
[0017] Compared with the related art, the monitoring reminder method provided by the present invention monitors audio signals in real time, identifies audio signals to obtain the text corresponding to the audio signals, extracts target keywords in the text, generates reminder events according to the target keywords, and sends reminder information to users according to time conditions and / or location conditions. Through this method, voice information in users' daily work and life is automatically captured to help users collect and organize information without the need for users to organize it themselves, saving time and being highly efficient. At the same time, reminder information is sent to users based on the content of the information to help users manage their time and plan, and relieve users' pressure in study, work, and life.
Brief Description of the Drawings
[0018] Figure 1 A schematic diagram of a flow chart of a monitoring reminder method provided by the present invention;
[0019] Figure 2 A schematic diagram of a virtual structure of a monitoring reminder device provided by an embodiment of the present invention;
[0020] Figure 3 A schematic diagram of the hardware structure of the monitoring reminder device provided in an embodiment of the present invention. [Specific implementation method]
[0021] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0022] First, the monitoring reminder method is described from the perspective of the monitoring reminder device. The monitoring reminder device is a wearable device that the user can wear on his body. Figure 1 The present invention provides a monitoring reminder method, the method comprising the following steps:
[0023] 101. Monitor audio signals in real time.
[0024] In this embodiment, after the user wears the monitoring reminder device, the monitoring reminder device can monitor the audio signals and communication audio signals of the user's environment in real time. Specifically, the monitoring reminder device can monitor the human voices in the user's environment, including other people's voices and the user's own voice. For example, when the user participates in a meeting, the monitoring reminder device monitors the speech of the user and other users participating in the meeting.
[0025] In one embodiment, the monitoring reminder device may monitor the audio signals around the user's location in real time in the following manner:
[0026] Confirm the monitoring mode, which includes host monitoring mode and headphone monitoring mode;
[0027] Monitor audio signals in real time based on host monitoring mode or headphone monitoring mode.
[0028] In this embodiment, the monitoring reminder device includes a host and a headset. The host corresponds to the host monitoring mode. The host can be a wearable terminal such as a wristband, armband, belt, necklace, etc., which is not specifically limited here. The headset corresponds to the headset monitoring mode. The headset is a wireless headset, which is wirelessly connected to the host. Specifically, it can be a left-ear air conduction Bluetooth headset, preferably, an ear-hook non-in-ear air conduction headset.
[0029] The host monitoring mode is to monitor the audio signal through the host, and the headphone monitoring mode is to monitor the audio signal through the headphone. It includes the following two situations:
[0030] Scenario 1: Wearable host, the host is wirelessly connected to the user's mobile phone, the monitoring mode is the host monitoring mode, and the host monitors the human voice in the user's environment.
[0031] Taking the host as a wristband as an example, the host is wirelessly connected to the user's mobile phone through a wireless communication module. When the user wears the wristband, the host can sense the skin through the skin sensor, receive the signal sent by the skin sensor through the processor, and control the host's microphone to turn on. The host uses the microphone to continuously and actively monitor the human voice in the user's environment. Of course, it can also monitor passively. The user interacts with the host and sends monitoring instructions to the host. The host implements monitoring after receiving the user's monitoring instructions.
[0032] In addition, when the user issues commands through voice or by touching the touch screen of the host to control the user's mobile phone to make or answer a call, the host can monitor the user's audio signal through the microphone and / or pickup, and process it into an electrical signal through the processor, and transmit it to the user's mobile phone; at the same time, the host obtains the electrical signal corresponding to the audio signal of the user's calling party, and plays the audio signal of the user's calling party through the speaker.
[0033] Scenario 2: Wearing a host and headphones, the host and headphones are wirelessly connected to the user's mobile phone respectively. The user makes a voice call or sends a command to the host through the headphones. The monitoring mode is the headphone monitoring mode, and the user's voice call is monitored through the headphones.
[0034] Taking the host as a wristband as an example, the host is wirelessly connected to the headset and the user's mobile phone through the wireless communication module. When the user wears the wristband and the headset at the same time, the headset senses the human ear through the sensor and the headset is turned on. The headset senses the user's continuous touch through the touch module, controls the headset's pickup to turn on, and the host's pickup to turn off. The headset's pickup monitors the audio signal corresponding to the command issued by the user and transmits it to the host. The host executes the corresponding command, for example, to call A, the host sends the corresponding dialing command to the user's mobile phone.
[0035] When the user uses the headset to control the user's mobile phone to make or answer a call, the headset can monitor the user's audio signal through the microphone and / or pickup, and transmit it to the host; at the same time, the host obtains the electrical signal corresponding to the audio signal of the user's call partner and transmits it to the headset, and the headset plays the audio signal of the user's call partner through the speaker.
[0036] It is understandable that continuously touching the touch module of the headset can be set as a shortcut operation for answering a call to facilitate quick answering of the call.
[0037] It can also be understood that when the headphone monitoring mode ends and the headphone pickup is turned off, the monitoring reminder device will automatically enter the host monitoring mode, and the host pickup is started. The user's end of touching the touch module of the headphone can be set as an operation instruction to turn off the headphone pickup.
[0038] 102. Recognize the audio signal through a speech recognition model to obtain the text corresponding to the audio signal.
[0039] In this embodiment, after the monitoring reminder device monitors the audio signal in real time through the host monitoring mode or the headphone monitoring mode, the host recognizes the audio signal through the speech recognition model to obtain the text corresponding to the audio signal, and the host can store the text in the memory and / or storage.
[0040] The monitoring reminder device recognizes the audio signal through the speech recognition model to obtain the text corresponding to the audio signal including:
[0041] Determine the target type corresponding to the audio signal, the target type includes a reminder event type, a meeting summary event type, a conversation summary event type, and a to-do event type;
[0042] Determining a target speech recognition model corresponding to the target type;
[0043] The audio signal is input into the target speech recognition model to obtain the text corresponding to the audio signal.
[0044] The target speech recognition model is obtained by training the convolutional neural network model using speech training samples. The speech training samples are audio signals. Since there are different types of audio signals, different speech recognition models can be trained for different types in order to make the recognition more accurate. For example, for an audio signal of the reminder time type, a reminder speech recognition model is trained accordingly. The recognition focus of the reminder speech recognition model will be on the recognition of the audio related to the reminder in the audio signal. Therefore, each type of speech recognition model has different focuses and is more accurate in audio signal recognition.
[0045] 103. Extract target keywords corresponding to time information, location information, and behavioral action information in the text.
[0046] In this embodiment, after the corresponding text information is obtained by recognizing the audio signal, the host uses keyword extraction or natural language processing technology to extract the target keywords corresponding to the time information, location information and behavior action information in the text. The following is a specific description:
[0047] Time information refers to the time expression that appears in the text, such as today, before work tomorrow, 10:30, August 15, etc., which are words that specifically express time. The host will extract these time expressions as target keywords corresponding to the time information. It should be noted that the host can process and optimize the time information according to the current time and / or the optimization information library. The optimization information library is a user information library stored in the host set by the user, including a set of mapping relationships between target keywords and user information. For example, if the extracted target keyword is "today" and the current time is August 15, 2023, then "today" is optimized to "August 15, 2023"; if the extracted target keyword is "before work tomorrow", the current time is August 15, 2023, and there is a mapping relationship between work time and 9:00 in the optimization information library, then "before work tomorrow" is optimized to "August 15, 2023 9:00". The host can also process and optimize the time information according to the current time and the target location of the user. The host can obtain the target location of the user through the Global Positioning System (GPS). For example, if the extracted target keyword is "Washington time August 15", the target location of the user obtained through GPS is China, and the current time is August 15, China, then "Washington time August 15" is optimized to "August 16, 2023 12:00" according to the time difference between Washington and China. The host can also process and optimize the time information according to the reminder events that have been generated and stored in the host. For example, if the extracted target keyword is "after the course ends tomorrow", the current time is August 14, and the reminder event is the course training from 9:00 to 10:00 on August 15, 2023, then "after the course ends tomorrow" is optimized to "August 15, 2023 10:00" according to the reminder event.
[0048] Location information refers to the location expressions that appear in the text, such as A Restaurant, B Building, C Conference Room, D Community, etc.
[0049] Behavior action information refers to the behavior action expression appearing in the text, for example, if you go to the factory at 9:00 tomorrow, the behavior action information is "go to the factory"; if you attend a meeting in Conference Room C at 10:00 today, the behavior action information is "attend the meeting".
[0050] It is understandable that although the above-mentioned “going to the factory” includes the location of “factory”, “going to the factory” is a purposeful behavior, and the host will still identify it as behavior action information rather than location information when identifying it.
[0051] It can also be understood that the target keywords extracted from the text corresponding to the reminder event type correspond to the reminder event type, the target keywords extracted from the text corresponding to the text summary event type correspond to the text summary event type, and the target keywords extracted from the text corresponding to the conversation summary event type correspond to the conversation summary event type.
[0052] It should be noted that the target keywords corresponding to the time information, location information and behavioral action information in the text are extracted here. Of course, other methods can also be used to achieve this, for example, through large language models including but not limited to GPT or iFlytek Spark, etc. There is no specific limitation, as long as the target keywords can be extracted.
[0053] 104. Generate a reminder event according to the target keyword corresponding to the reminder event type.
[0054] In this embodiment, after extracting the target keyword in the text, the host generates a reminder event according to the association between the behavior information corresponding to the target keyword and the time information and location information. For example, the obtained text is "Where are you, Company A, it is 9 o'clock now, and there is a work meeting at Company B at 2 o'clock in the afternoon." Among them, the target keywords corresponding to the time information include "9 o'clock" and "2 o'clock in the afternoon", the target keywords corresponding to the location information include "Company A" and "Company B", the target keyword corresponding to the behavior information is "there is a work meeting", the behavior information is associated with "2 o'clock in the afternoon" and "Company B", and is not associated with "9 o'clock" and "Company A", then the time condition of the reminder event is "2 o'clock in the afternoon", and the location condition is "Company B".
[0055] In one embodiment, the monitoring reminder device generates a reminder event according to the target keyword, including:
[0056] According to the behavior information in the text, the reminder events are divided into complete reminder events and missing reminder events, among which the missing reminder events include reminder events with missing time conditions and location conditions;
[0057] Generate missing inquiry events according to missing reminder events;
[0058] Sending inquiry information to the user according to the missing inquiry event to obtain the inquiry result returned by the user;
[0059] The reminder event is generated according to the inquiry result.
[0060] That is, when the host generates a reminder event based on the target keyword, it is found that the target keyword corresponding to the behavior action information lacks the associated time information and location information, and neither the time condition nor the location condition can be generated. Then, it is marked as a missing reminder event, and a query message is sent to the user to obtain the query result returned by the user, and the reminder event is generated according to the query result. The following is a detailed description:
[0061] For the convenience of explanation, the complete reminder event is first explained here. The condition types of complete reminder events include time type, location type and time and location type. A complete reminder event of time type refers to a complete reminder event that includes time conditions but does not include location conditions. A complete reminder event of location type refers to a complete reminder event that includes location conditions but does not include time conditions. A complete reminder event of time and location type refers to a complete reminder event that includes location conditions and time conditions.
[0062] Compared with a complete reminder event, a missing reminder event refers to a reminder event in which the target keyword lacks the time information and location information corresponding to the behavioral action information, and the corresponding target keyword cannot be extracted. There is neither a time condition nor a location condition, and the host cannot issue a reminder based on the reminder event.
[0063] A missing query event is generated based on the missing reminder event, and a query message is sent to the user. After receiving the query message, the user has four operations:
[0064] One operation is to supplement the time information and confirm that the location information is not missing. Then the host generates a complete reminder event of the time type according to the supplemented time information and the missing reminder event. Thus, even in the case of missing time information, a corresponding reminder event can be generated with the assistance of the user.
[0065] One operation is to supplement the location information and confirm that it does not lack time information. Then the host generates a complete reminder event of the location type according to the supplemented location information and the missing reminder event. Thus, in the case of lack of location information, a corresponding reminder event can be generated with the assistance of the user.
[0066] One operation is to supplement the time information and location information, and the host generates a complete reminder event of the time and location type according to the supplemented time and location information and the missing reminder event, so that when there is only an ambiguous target keyword in the absence of time information and location information, a corresponding reminder event can also be generated with the assistance of the user;
[0067] One operation is to abandon the reminder event corresponding to the target keyword.
[0068] In one embodiment, the monitoring reminder device generates a reminder event according to the target keyword, further comprising:
[0069] Get the target location of the user at the current moment;
[0070] Determine the target duration between the current moment and the time condition;
[0071] determining target distances between target locations and location conditions;
[0072] Determine whether there is a target type of transportation vehicle based on the target distance and target duration;
[0073] If there is no target type vehicle, the reminder event is determined to be a conflict reminder event;
[0074] A conflict inquiry event is generated according to the conflict reminder event.
[0075] That is, when the host generates a reminder event based on the target keyword, it confirms whether the reminder information corresponding to the reminder event is implementable. For example, the current time is "9:00", the user's target location is Company A in City A, the time condition is "12:00", and the location condition is Company B in City B, then the target duration is 3 hours, and the target distance is the distance between Company A in City A and Company B in City B. If the host confirms that there is no target type of transportation, that is, it confirms that the user cannot reach Company B in City B from Company A in City A within 3 hours, then the reminder event is marked as a conflict reminder event. A conflict inquiry event is generated based on the conflict reminder event, and the host directly sends an inquiry message to the user, or the host controls the headset to send an inquiry message to the user and monitors the audio signal in real time. After obtaining the inquiry result, the reminder event can be updated or deleted based on the inquiry result. For example, if the user answers "postpone it to 2 p.m.", the host recognizes the audio signal, obtains the text corresponding to the audio signal, extracts the time information in the text as the time condition, and then updates the time condition of the reminder event to "14:00," and confirms again whether the updated reminder event is a conflicting reminder event until it is confirmed that it is not a conflicting reminder event; if the user answers "delete" or "cancel," the host recognizes the audio signal, obtains the text corresponding to the audio signal, and executes the operation of deleting this reminder event.
[0076] It should be noted that the target type of transportation is the transportation mode that the user can use. For example, common transportation includes cars, high-speed rail, trains, airplanes, ships, motorcycles, electric vehicles, buses, bicycles, etc. However, if the user cannot take a plane or ship from company C to company D in the same city, the host will not use airplanes and ships as target type transportation when confirming whether companies A and B in the same city have target type transportation. Of course, users can also set target type transportation by themselves and save them in the optimization information library.
[0077] In this embodiment, the monitoring reminder method further includes:
[0078] Generate a meeting summary event according to the target keyword corresponding to the text summary event type;
[0079] Generate a conversation summary event according to the target keyword corresponding to the conversation summary event type.
[0080] Generate to-do events according to the target keywords corresponding to the to-do event types.
[0081] In this embodiment, the host classifies and stores reminder events, meeting summary events, conversation summary events, and to-do events in the host application.
[0082] 105. Send reminder information to the user according to time conditions and / or location conditions.
[0083] In this embodiment, after the monitoring reminder device generates the time condition and / or location condition of the reminder condition, it can send a reminder message to the user according to the time condition and / or location condition. Sending a reminder message to the user according to the time condition and location condition specifically includes:
[0084] Real-time monitoring of time and location information;
[0085] Confirm the condition type corresponding to the reminder event;
[0086] If the condition type is a time type, determining whether the time information matches the time condition;
[0087] If the time information matches the time condition, sending the reminder information to the user;
[0088] If the condition type is a location type, determining whether the location information matches the location condition;
[0089] If the location information matches the location condition, sending the reminder information to the user;
[0090] If the condition type is a time and location type, determining whether the time information matches the time condition, and whether the location information matches the location condition;
[0091] If the time information matches the time condition, and the location information matches the location condition, the reminder information is sent to the user.
[0092] Specifically, the host can confirm the condition type corresponding to the reminder event based on the time condition and / or location condition of the reminder event. For example, the text recognized by the audio signal is "Remind me to go to the factory at 10 o'clock today", the current time is August 15, 2023, and the target keyword corresponding to the time information is "August 15, 2023 10:00", which is the time condition. When the time information matches the time condition, the host sends a reminder message to the user; the text recognized by the audio signal is "Remind me to contact colleague A when I go to the company", the target keyword corresponding to the action information is "Contact colleague A", and the target keyword corresponding to the location information is "company", which is the location condition. When the location information and the location condition match, , the host sends a reminder message to the user; the text recognized by the audio signal is "Remind me to buy F products, G products and H products in E mall tomorrow", the current time is August 15, 2023, and the target keyword corresponding to the time information is "August 16, 2023", which is the time condition, the target keyword corresponding to the behavior action information is "buy F products, G products and H products", and the target keyword corresponding to the location information is "E mall", which is the location condition. When the time information and the time condition match, and the location information and the location condition match, the host sends a reminder message to the user.
[0093] It is understandable that the host determines whether the time information and the time condition match according to the first preset matching standard. The first preset matching standard is that when the time difference between the time information and the time condition is less than or equal to the preset difference, the time information and the time condition are judged to match. The preset difference can be set to a fixed value and can be customized by the user. For example, for a reminder event, the time condition is 9 o'clock and the preset difference is 10 minutes. When the time information is from 8:50 to 9:10, the host determines that the time information matches the time condition and sends the reminder information to the user. Of course, the user can also set different preset differences for different reminder events.
[0094] The host determines whether the location information and the location condition match according to the second preset matching standard. The second preset matching standard is that when the range distance between the location information and the location condition is less than the preset distance, the location information and the location condition are judged to match. The preset distance can be set to a fixed value and can be set by the user. It should be noted that the preset distance can be the actual distance length or the travel time. For example, the preset distance can be set to 500 meters or the driving time of 3 minutes.
[0095] Sending reminder information to users based on time conditions and / or location conditions also includes:
[0096] Determine a use environment, where the use environment includes a first use environment, a second use environment, and a third use environment, where the first use environment is to communicate with a user's mobile phone, the second use environment is to communicate with a headset, and the third use environment is to communicate with the user's mobile phone and the headset respectively;
[0097] If the usage environment is the first usage environment, a reminder message is sent to the user via the user's mobile phone;
[0098] If the usage environment is the second usage environment, a reminder message is sent to the user through the earphone;
[0099] If the usage environment is the third usage environment, a reminder message is sent to the user via the user's mobile phone or the user's earphones.
[0100] Compared with the related art, the monitoring reminder method provided by the present invention monitors audio signals in real time, identifies audio signals to obtain the text corresponding to the audio signals, extracts target keywords in the text, generates reminder events according to the target keywords, and sends reminder information to users according to time conditions and / or location conditions. Through this method, voice information in users' daily work and life is automatically captured to help users collect and organize information without the need for users to organize it themselves, saving time and being highly efficient. At the same time, reminder information is sent to users based on the content of the information to help users manage their time and plan, and relieve users' pressure in study, work, and life.
[0101] The above describes the monitoring reminder method provided in the embodiment of the present invention. The following describes the monitoring reminder device provided in the embodiment of the present application.
[0102] See also Figure 2 The present invention provides a monitoring reminder device 200, the monitoring reminder device 200 comprises:
[0103] A monitoring unit 201, used for monitoring audio signals in real time;
[0104] The recognition unit 202 is used to recognize the audio signal through a speech recognition model to obtain the text corresponding to the audio signal;
[0105] An extraction unit 203 is used to extract target keywords corresponding to time information, location information and behavior action information in the text;
[0106] A generating unit 204, configured to generate a reminder event according to the target keyword, wherein the reminder event includes a time condition and / or a location condition;
[0107] The reminder unit 205 is used to send reminder information to the user according to time conditions and / or location conditions.
[0108] In one embodiment, the monitoring unit 201 is specifically used for:
[0109] Confirm the monitoring mode, which includes host monitoring mode and headphone monitoring mode;
[0110] Monitor audio signals in real time based on host monitoring mode or headphone monitoring mode.
[0111] In one embodiment, the identification unit 202 is specifically configured to:
[0112] Confirm the target type corresponding to the audio signal, the target type includes a reminder event type, a meeting summary event type, a conversation summary event type, and a to-do event type;
[0113] Determining a target speech recognition model corresponding to the target type;
[0114] The audio signal is input into the target speech recognition model to obtain the text corresponding to the reminder event type, the text corresponding to the text summary event type, the text corresponding to the conversation summary event type, and the text corresponding to the to-do event type.
[0115] In one embodiment, the generating unit 204 is specifically used for:
[0116] According to the behavior information in the text, the reminder events are divided into complete reminder events and missing reminder events, among which the missing reminder events include reminder events with missing time conditions and location conditions;
[0117] Generate missing inquiry events according to missing reminder events;
[0118] Sending inquiry information to the user according to the missing inquiry event to obtain the inquiry result returned by the user;
[0119] A reminder event is generated according to the query result.
[0120] In one embodiment, the generating unit 204 is further configured to:
[0121] Get the target location of the user at the current moment;
[0122] Determine the target duration between the current moment and the time condition;
[0123] determining target distances between target locations and location conditions;
[0124] Determine whether there is a target type of transportation vehicle based on the target distance and target duration;
[0125] If there is no target type vehicle, the reminder event is determined to be a conflict reminder event;
[0126] A conflict inquiry event is generated according to the conflict reminder event.
[0127] In one embodiment, the generating unit 204 is further configured to:
[0128] Generate a meeting summary event according to the target keyword corresponding to the text summary event type;
[0129] Generate a conversation summary event according to the target keyword corresponding to the conversation summary event type;
[0130] Generate to-do events according to the target keywords corresponding to the to-do event types.
[0131] In this embodiment, the host classifies and stores reminder events, meeting summary events, conversation summary events, and to-do events in the host application.
[0132] In one embodiment, the reminder unit 205 is specifically used for:
[0133] Real-time monitoring of time and location information;
[0134] Confirm the condition type corresponding to the reminder event, the condition type including time type, location type and time and location type;
[0135] If the condition type is a time type, determining whether the time information matches the time condition;
[0136] If the time information matches the time condition, sending the reminder information to the user;
[0137] If the condition type is a location type, determining whether the location information matches the location condition;
[0138] If the location information matches the location condition, determining whether the location information matches the location condition;
[0139] If the condition type is a time and location type, determining whether the time information matches the time condition, and whether the location information matches the location condition;
[0140] If the time information matches the time condition, and the location information matches the location condition, the reminder information is sent to the user.
[0141] In one embodiment, the reminder unit 205 is further configured to:
[0142] Determine a use environment, where the use environment includes a first use environment, a second use environment, and a third use environment, where the first use environment is to communicate with a user's mobile phone, the second use environment is to communicate with a headset, and the third use environment is to communicate with the user's mobile phone and the headset respectively;
[0143] If the usage environment is the first usage environment, a reminder message is sent to the user via the user's mobile phone;
[0144] If the usage environment is the second usage environment, a reminder message is sent to the user through the earphone;
[0145] If the usage environment is the third usage environment, a reminder message is sent to the user through the user's mobile phone or the user's earphones.
[0146] Next, another monitoring reminder device provided by the embodiment of the present application is introduced. The monitoring reminder device can be a terminal device. Figure 3 , the terminal device 300 includes:
[0147] The receiver 301, the transmitter 302, the processor 303 and the memory 304 (the number of the processor 303 in the monitoring reminder device 300 can be one or more, Figure 3 In some embodiments of the present application, the receiver 301, the transmitter 302, the processor 303 and the memory 304 may be connected via a bus or other means, wherein: Figure 3 The example of connecting through bus is taken in the following.
[0148] The memory 304 may include a read-only memory and a random access memory, and provides instructions and data to the processor 303. A portion of the memory 304 may also include an NVRAM. The memory 304 stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an extended set thereof, wherein the operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and processing hardware-based tasks.
[0149] The processor 303 controls the operation of the monitoring reminder device, and the processor 303 can also be called a CPU. In a specific application, the various components of the monitoring reminder device are coupled together through a bus system, wherein the bus system includes not only a data bus, but also a power bus, a control bus, and a status signal bus, etc. However, for the sake of clarity, various buses are referred to as bus systems in the figure.
[0150] The method disclosed in the above embodiment of the present application can be applied to the processor 303, or implemented by the processor 303. The processor 303 can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 303 or the instruction in the form of software. The above processor 303 can be a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor are combined to execute. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 304, and the processor 303 reads the information in the memory 304 and completes the steps of the above method in combination with its hardware.
[0151] In the embodiment of the present application, the processor 303 is used to execute the operations performed by the above-mentioned monitoring reminder device.
[0152] The embodiment of the present application also provides a computer-readable medium, which includes computer execution instructions. The computer execution instructions can enable the monitoring reminder device to execute the monitoring reminder method described in the above embodiment. Its implementation principle and technical effect are similar and will not be repeated here.
[0153] In the above Figure 1 In the illustrated embodiment, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0154] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.
[0155] It should be understood that the processor mentioned in the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0156] It should also be understood that the number of processors in the present application can be one or more, which can be adjusted according to the actual application scenario, which is only an exemplary description and not limited here. The number of memories in the embodiments of the present application can be one or more, which can be adjusted according to the actual application scenario, which is only an exemplary description and not limited here.
[0157] It should also be noted that when the terminal device includes a processor (or processing unit) and a memory, the processor in this application can be integrated with the memory, or the processor and the memory can be connected through an interface. The specific adjustment can be made according to the actual application scenario and is not limited.
[0158] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0159] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0160] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0161] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0162] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or other device, etc.) to execute the present application. Figure 1 All or part of the steps of the method for determining the fusion intersection angle.
[0163] It should be understood that the storage medium or memory mentioned in the present application may include volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).
[0164] It should be noted that the memory described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0165] The embodiments described above are only used to illustrate the technical solutions of the invention rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A monitoring reminder method, characterized in that: include: Monitor audio signals in real time; Recognize the audio signal through a speech recognition model to obtain a text corresponding to the audio signal; Extracting target keywords corresponding to time information, location information, and behavior action information in the text; Generate a reminder event according to the target keyword, wherein the reminder event includes a time condition and / or a location condition; A reminder message is sent to the user according to the time condition and / or the location condition.
2. The method according to claim 1, characterized in that The sending of reminder information to the user according to the time condition and / or the location condition includes: Real-time monitoring of time and location information; Confirm the condition type corresponding to the reminder event, the condition type including time type, location type and time and location type; If the condition type is a time type, determining whether the time information matches the time condition; If the time information matches the time condition, sending the reminder information to the user; If the condition type is a location type, determining whether the location information matches the location condition; If the location information matches the location condition, sending the reminder information to the user; If the condition type is a time and location type, determining whether the time information matches the time condition, and whether the location information matches the location condition; If the time information matches the time condition, and the location information matches the location condition, the reminder information is sent to the user.
3. The method according to claim 2, characterized in that The sending of the reminder information to the user comprises: Determine a usage environment, the usage environment including a first usage environment, a second usage environment and a third usage environment, the first usage environment is to communicate with a user's mobile phone, the second usage environment is to communicate with a headset, and the third usage environment is to communicate with the user's mobile phone and the headset respectively; If the usage environment is the first usage environment, sending a reminder message to the user via the user's mobile phone; If the usage environment is the second usage environment, sending a reminder message to the user through the headset; If the usage environment is the third usage environment, a reminder message is sent to the user via the user's mobile phone or the user's earphone.
4. The method according to claim 1, characterized in that: Generating a reminder event according to the target keyword includes: According to the behavior action information in the text, the reminder event is divided into a complete reminder event and a missing reminder event, wherein the missing reminder event is a reminder event that lacks time conditions and location conditions; Generate a missing query event according to the missing reminder event; Sending inquiry information to the user according to the missing inquiry event to obtain the inquiry result returned by the user; The reminder event is generated according to the inquiry result.
5. The method according to claim 1, characterized in that Generating a reminder event according to the target keyword includes: Get the target location of the user at the current moment; Determine a target duration between the current moment and the time condition; determining a target distance between the target location and the location condition; Determining whether there is a target type of transportation vehicle according to the target distance and the target duration; If the target type of vehicle does not exist, determining the reminder event as a conflict reminder event; A conflict inquiry event is generated according to the conflict reminder event.
6. The method according to claim 1, characterized in that The step of recognizing the audio signal by using a speech recognition model to obtain a text corresponding to the audio signal includes: Determining a target type corresponding to the audio signal, the target type including a reminder event type, a meeting summary event type, a conversation summary event type, and a to-do event type; Determining a target speech recognition model corresponding to the target type; The audio signal is input into the target speech recognition model to obtain the text corresponding to the audio signal.
7. The method according to any one of claims 1 to 6, characterized in that The real-time monitoring audio signal comprises: Determine a monitoring mode, wherein the monitoring mode includes a host monitoring mode and a headphone monitoring mode; The audio signal is monitored in real time based on the host monitoring mode or the headphone monitoring mode.
8. A monitoring reminder device, characterized in that: include: A monitoring unit, used for monitoring audio signals in real time; A recognition unit, configured to recognize the audio signal through a speech recognition model to obtain a text corresponding to the audio signal; An extraction unit, used to extract target keywords corresponding to time information, location information and behavior action information in the text; A generating unit, configured to generate a reminder event according to the target keyword, wherein the reminder event includes a time condition and / or a location condition; The reminder unit is used to send reminder information to the user according to the time condition and / or the location condition.
9. A monitoring reminder device, characterized in that: include: At least one connected processor, memory and transceiver, wherein the memory is used to store program code, and the processor is used to call the program code in the memory to execute the steps of the monitoring reminder method as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: include: Instructions, when the instructions are executed on a computer, enable the computer to execute the steps of the monitoring reminder method as described in any one of claims 1 to 7.
Citation Information
Cited By
Intelligent reminding task creation method and device, electronic equipment and storage medium
CN121547530A
