Information processing method, system and device and readable storage medium

Abstract

The invention discloses an information processing method, system and device and a readable storage medium, unreliable system internal state query is abandoned, a brand new thought of visual failure judgment is combined, the state is judged by analyzing a consistent UI interface seen by a final user, and the user experience is improved. And the problems of compatibility and reliability of telephone state acquisition are solved fundamentally. The method has the technical effects that real low-cost full automation is realized, that is, the method can be realized by using universal communication equipment, and special hardware or cloud service is not needed; the unattended automation of the whole process from dialing to broadcasting is realized, the efficiency is greatly improved, and the cost is reduced; and the data security is ensured, that is, all call tasks and data are processed locally, so that the risk that sensitive information is uploaded to a third-party platform is avoided.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to an information processing method, system, device and readable storage medium. Background Technology

[0002] In scenarios such as power outage notifications and emergency warnings, it is necessary to quickly and accurately make phone calls and issue voice announcements to a large number of relevant personnel. While methods such as manual dialing, mass SMS messaging, and cloud-based calling platforms can be used for this purpose, these methods suffer from problems including low efficiency, unreliable delivery rates, high costs, and data privacy risks.

[0003] Controlling a phone to make automatic calls via the Android Debug Bridge (ADB) relies on querying the internal state of the system (such as using the dumpsys telephony.registry command), but this method suffers from poor compatibility, insufficient reliability, and unstable interfaces.

[0004] In conclusion, how to effectively solve the problem of accurately issuing announcements is a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide an information processing method, system, device, and readable storage medium that abandons unreliable internal system status queries and instead combines a novel approach of visual judgment to determine the status by analyzing the consistent UI interface seen by the end user, thereby fundamentally solving the compatibility and reliability problems of status acquisition.

[0006] To solve the above-mentioned technical problems, this application provides the following technical solution:

[0007] A notification method, comprising:

[0008] When a telephone notification is required, obtain the notification text and contact information;

[0009] Use a communication device to dial the contact numbers corresponding to the contact information, and obtain the display data of the communication device;

[0010] The phone status is determined using the displayed data, and if the phone status is a call, the broadcast voice corresponding to the notification content text is transmitted to the communication peer device using the communication device.

[0011] Obtain the latest call status and latest broadcast status for each call, and generate a notification report that records the latest call status and latest broadcast status for each call.

[0012] Preferably, acquiring the display data of the communication device includes:

[0013] Send an image export command to the communication device to obtain binary stream data on the display screen of the communication device;

[0014] The binary stream data is converted into an image format to obtain the display data.

[0015] Preferably, determining the telephone status using the displayed data includes:

[0016] After performing grayscale and binarization processing on the displayed data, the communication display area is captured;

[0017] The content of the communication display area is identified to obtain the identification result;

[0018] If the identification result includes a contact number or contact information, the phone status is determined to be dialing status;

[0019] If the recognition result includes the words "calling", then the phone status is determined to be call waiting status;

[0020] If the recognition result includes content in the specified time format, the phone status is determined to be a call status;

[0021] If the recognition result includes information indicating that the call has ended, then the call status is determined to be terminated.

[0022] If the identification result includes information corresponding to a call failure, then the phone status is determined to be a call failure.

[0023] Preferably, transmitting the broadcast voice corresponding to the notification content text to the communication peer device using the communication device includes:

[0024] The notification content text is converted into a speech signal using a text-to-speech engine.

[0025] The voice signal is transmitted to the microphone interface of the communication device using a physical audio recording cable, so that the communication device can transmit the corresponding broadcast voice to the communication peer device.

[0026] Preferably, the method involves using a communication device to dial the contact numbers corresponding to the contact information, including:

[0027] Dial the corresponding contact numbers in the order of the contact information provided.

[0028] Preferably, obtaining the latest call status and latest broadcast status for each call includes:

[0029] After determining the change in the phone status of the target call, the current phone status is determined as the latest phone status;

[0030] Before the communication device is used to transmit the broadcast voice corresponding to the notification content text to the communication peer device, the broadcast status is determined to be not broadcast;

[0031] After transmitting the broadcast voice corresponding to the notification content text to the communication peer device using the communication device, the broadcast status is determined to be broadcast;

[0032] If the phone call is in the "end" state when the communication device is used to transmit the notification text to the communication peer device, then the broadcast status is determined to be "incomplete broadcast".

[0033] After the broadcast status changes, the current broadcast status is determined as the latest broadcast status.

[0034] Preferably, generating a notification report that records the latest call status and the latest broadcast status for each call includes:

[0035] Generate call logs for each call; the call logs include the contact tag corresponding to the contact number, the latest call status, the latest broadcast status, and the call content, wherein the call content corresponds to the notification content text;

[0036] The notification report is generated using the call log.

[0037] An information processing system, comprising:

[0038] Host and communication equipment;

[0039] The host is used to execute the steps of the information processing method described above;

[0040] The communication device is used to make contact calls and transmit the voice message corresponding to the notification content text to the communication peer device.

[0041] An electronic device, comprising:

[0042] Memory, used to store computer programs;

[0043] A processor is used to implement the steps of the above-described information processing method when executing the computer program.

[0044] A readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the above-described information processing method.

[0045] Applying the method provided in the embodiments of this application, when a telephone notification is required, the notification content text and contact information are obtained; the contact phone numbers corresponding to the contact information are dialed using a communication device, and the display data of the communication device is obtained; the telephone status is determined using the display data, and if the telephone status is in a call state, the broadcast voice corresponding to the notification content text is transmitted to the communication peer device using the communication device; the latest telephone status and latest broadcast status for each call are obtained, and a notification report recording the latest telephone status and latest broadcast status for each call is generated.

[0046] In this application, when a telephone notification is required, the notification text and contact information are first obtained. Then, a communication device is used to dial the contact numbers corresponding to the contact information, and the display data of the communication device is obtained. Based on this display data, the call status of each call can be determined. If the call is in a call state, the communication device can be used to transmit the broadcast voice corresponding to the notification text to the other end of the communication. During this process, the latest call status and latest broadcast status for each call can be obtained, thereby generating a notification report recording the latest call status and latest broadcast status for each call.

[0047] As can be seen, this application abandons unreliable internal system status queries and instead adopts a novel approach combining visual judgment. It determines the status by analyzing the consistent UI interface seen by the end user, thus fundamentally solving the compatibility and reliability issues of telephone status acquisition. In other words, this application has the following technical effects: it achieves true low-cost full automation, which can be implemented using general-purpose communication equipment without the need for dedicated hardware or cloud services; it achieves unattended automation of the entire process from dialing to announcement, greatly improving efficiency and reducing costs; and it ensures data security, as all call tasks and data are processed locally, avoiding the risk of sensitive information being uploaded to third-party platforms.

[0048] Accordingly, embodiments of this application also provide information processing systems, devices, and readable storage media corresponding to the above-described information processing methods, which have the aforementioned technical effects, and will not be elaborated further here. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a flowchart illustrating the implementation of an information processing method in an embodiment of this application.

[0051] Figure 2 This is a schematic diagram of the structure of an information processing system according to an embodiment of this application;

[0052] Figure 3 This is a schematic diagram of a visual interface of a dialing system according to an embodiment of this application;

[0053] Figure 4 This is a schematic diagram illustrating the implementation process of an information processing method in an embodiment of this application;

[0054] Figure 5 This is a schematic diagram illustrating a specific implementation of a visual discrimination state in an embodiment of this application;

[0055] Figure 6 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application;

[0056] Figure 7 This is a schematic diagram of the specific structure of an electronic device in an embodiment of this application. Detailed Implementation

[0057] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are merely some embodiments of the present application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0058] Please refer to Figure 1 , Figure 1 This is a flowchart of an information processing method according to an embodiment of this application. The method includes the following steps:

[0059] S101. When it is necessary to make a telephone notification, obtain the notification text and contact information.

[0060] In this embodiment, there is no specific limitation on the circumstances under which a telephone notification is required. For example, a telephone notification may be required in emergency situations such as power failure notification or emergency warning, or in non-emergency situations such as meeting notification or order notification.

[0061] The need for a telephone notification can be determined by receiving instructions or requests, and the notification text and contact information can be obtained by reading storage media or receiving external input. The notification text is the specific content of the telephone notification. The contact information corresponds to the contact person to be dialed for this notification. This contact information can correspond to the specific phone numbers of one or more contacts, or it can be a contact tag, based on which the corresponding phone number can be determined.

[0062] S102. Use the communication equipment to dial the contact numbers corresponding to the contact information and obtain the display data of the communication equipment.

[0063] The communication device can be a device that has telephone dialing function, a display interface that can display telephone status information, such as a smartphone or landline. The following explanation uses an Android phone as an example of a communication device.

[0064] In practical applications, the number of calls to be made can be determined based on contact information, thus deciding which one or more communication devices to use to make the calls. When a telephone notification requires rapid dissemination, multiple communication devices can be used to make the calls separately. For example, if the notification text indicates that a single call takes one minute, and 20 contacts need to be notified within 10 minutes, two communication devices can be used simultaneously to make the notification, thereby informing the 20 contacts within 10 minutes.

[0065] After the communication device dials the corresponding contact number, in order to make the announcement, it is necessary to clarify when the voice announcement can begin. One approach is to control the phone to automatically dial via the Android Debug Bridge (ADB). However, these approaches suffer from a drawback in the reliability of their state determination. They typically rely on querying the internal system state (e.g., using the `dumpsystelephony.registry` command), but this method has the following insurmountable disadvantages:

[0066] A. Poor compatibility: The response formats and timings of internal interfaces vary greatly among different mobile phone manufacturers and different Android system versions, requiring adaptation for different models, resulting in extremely low universality.

[0067] B. Insufficient Reliability: Existing methods for querying the system's internal status using commands like dumpsys rely on a generalized set of states for the 'calling' status (e.g., mCallState=2), encompassing multiple sub-stages. This status is valid from the start of dialing until the call ends, failing to distinguish between critical sub-states such as 'ringing,' 'answering,' and 'connected and billing started.' Therefore, the system status alone cannot serve as a reliable trigger for initiating voice announcements, potentially leading to misinterpretations such as a connected call or the other party having already answered before the announcement has begun.

[0068] C. Unstable interfaces: The system's internal interfaces are not publicly available and may change or become invalid with system updates.

[0069] Based on this, this embodiment of the application abandons the unreliable internal system status query and proposes a novel approach to visual fault diagnosis. It determines the status by analyzing the consistent display interface seen by the end user, thus fundamentally solving the compatibility and reliability issues. Specifically, it acquires the display data of the communication device during the process of making a notification by dialing a contact number.

[0070] In one specific embodiment of this application, acquiring display data from a communication device includes:

[0071] Send an image export command to the communication device to obtain binary stream data on the display screen of the communication device;

[0072] Convert the binary stream data to an image format to obtain the display data.

[0073] In this application, an image export command can be directly sent to the communication device to obtain the binary stream data corresponding to the content displayed on the device's screen. The binary stream data can then be converted into an image format, thus obtaining the display data.

[0074] For example, executing the command `adb exec-out screencap -p` directly retrieves the binary stream data of the phone screen and decodes it into OpenCV image format. This method avoids creating temporary files and is faster. `adb exec-out screencap -p` is the core command in the Android Debug Bridge (ADB) used to silently capture the screen of an Android device and export the image to a computer, without requiring root access.

[0075] In one specific embodiment of this application, dialing contact numbers corresponding to contact information using a communication device includes: dialing the corresponding contact numbers according to the order of the contact information. Specifically, the contact information can be arranged according to the priority of the notification, with contacts requiring priority notification listed first and contacts not requiring priority notification listed last. In this way, by dialing the corresponding contact numbers according to the order of the contact information, the order of notification can be controlled to meet actual needs.

[0076] S103. Determine the telephone status using the displayed data, and if the telephone status is in a call state, use the communication equipment to transmit the broadcast voice corresponding to the notification content text to the communication peer equipment.

[0077] Once the displayed data is obtained, the call status can be determined based on this data. The call status corresponds to the current stage of the call. Since the interface displayed by the communication device differs depending on the status, the call status can be determined based on the displayed data.

[0078] For example, when making a phone call on a communication device, different interfaces are typically displayed depending on the status. These interfaces include, but are not limited to, the following:

[0079] Dialing input interface: This is the initial interface, the state before dialing. The core of the interface is the numeric keypad, which also displays the entered number. Some phones will also display the corresponding contact (if saved). At the bottom, there are usually function buttons such as "Dial," "Delete," and "Contacts." At this point, no call has been initiated; it is the preparation stage for dialing.

[0080] Call waiting screen: After pressing the dial button, the screen immediately switches to this state. iOS displays a large contact / number, along with the words "Calling" and a looping animation; Android usually displays the call status at the top, the contact information in the middle, and basic buttons such as "Hang Up," "Mute," and "Speaker" at the bottom. This screen will remain until the other party answers, and if the other party does not answer and is transferred to voicemail, the screen will remain in this state until the call times out.

[0081] Call Interface: After the other party answers the call, the interface undergoes its third change, primarily the addition of call-related function buttons. Common buttons include mute, speakerphone, hands-free, add call, and hang up. Some phones also display a call duration timer. Additionally, some iOS versions simplify the interface layout, while some Android models add elements such as contact avatars, but the location of the core function areas remains relatively fixed.

[0082] Call End and Return Screen: After clicking the hang-up button, the interface undergoes its fourth change. In most cases, a brief summary of the call duration will be displayed first, followed by an automatic return to the previous screen, usually the call log or dial pad; some phones may also return directly to the home screen. At this point, the call is completely terminated, and the interface reverts to its normal non-call interactive state.

[0083] Additional interface changes in special scenarios: If special circumstances occur during the call, the number of interface changes will increase.

[0084] Call waiting: If a third party calls during a call, a new prompt box will pop up on the screen (some phones will display a "End and answer" button, etc.). After selecting to answer, the screen will add buttons such as "Switch" and "Merge Calls", which will add 1-2 extra screen changes.

[0085] Multi-party calls: When multiple incoming calls are received and merged into a conference call, the interface will be adjusted to a multi-party call control layout, displaying the status of all parties involved in the call. This requires one more interface switch compared to a regular call.

[0086] Call Failure: If the other party does not answer or the signal is interrupted, the interface will display a "Call Failure" message. Some phones will also display a "Redial" button, which will add an extra brief message screen change.

[0087] Therefore, it is evident that the phone status can be effectively determined based on the display interface.

[0088] In one specific embodiment of this application, determining the telephone status using displayed data includes:

[0089] After performing grayscale and binarization on the displayed data, the communication display area is captured.

[0090] The content of the communication display area is identified, and the identification result is obtained;

[0091] If the identification result includes a contact number or contact information, the phone status is determined to be dialing status;

[0092] If the recognition result includes the words "calling", then the phone status is determined to be call waiting status;

[0093] If the recognition result includes content in the specified time format, the phone status is determined to be a call status;

[0094] If the recognition result includes information indicating that the call has ended, then the call status is determined to be terminated.

[0095] If the identification result includes information corresponding to a call failure, then the phone status is determined to be a call failure.

[0096] For example: The acquired display image (corresponding to the display data) is sequentially processed by grayscale conversion, binarization inversion (using the cv2.THRESH_BINARY_INV parameter to adapt to the dark mode interface of mobile phones), and morphological opening operation (using a 2x2 kernel), greatly enhancing the features of the displayed content. Then, key area localization: Based on statistical analysis of the UI layout of mainstream mobile phone dialer interfaces, a rectangular area from the top 15% to 35% of the screen height and from the left 35% to 65% of the screen width is accurately captured. This area is the general display area for call duration information. OCR recognition: The Tesseract OCR engine is used to recognize the preprocessed key area image, and a dedicated whitelist parameter -c tessedit_char_whitelist=0123456789 is configured so that the engine only focuses on numbers and colons, completely eliminating interference from other characters. Status determination: If the recognition result contains a string that conforms to the format of hour:minute:second or minute:second, it is immediately determined that the call has been connected.

[0097] When making a phone call to a contact, the phone status changes continuously depending on whether the call is being made. Notifying the other party requires the communication device to transmit the corresponding voice message of the notification text to the other end of the communication while the phone is in a call. In other words, a notification can only be made by transmitting a voice message to the other end of the communication while the call is in progress.

[0098] In one specific embodiment of this application, a communication device transmits a broadcast voice message corresponding to a notification text to a communication peer device, including:

[0099] Use a text-to-speech engine to convert the text of the notification content into a speech signal;

[0100] A physical audio recording cable is used to transmit voice signals to the microphone interface of a communication device, so that the communication device can transmit the corresponding broadcast voice to the communication peer device.

[0101] Once the call is connected, the TTS (Text-to-Speech) engine is activated to convert the notification text into an audio signal, which is then transmitted to the phone's microphone via a physical audio recording cable. The communication device can then transmit the corresponding audio message to the other end of the communication chain, allowing the other end to play the notification audio message corresponding to the text message. This enables the notification text to be delivered to the appropriate contact.

[0102] S104. Obtain the latest call status and latest broadcast status for each call, and generate a notification report that records the latest call status and latest broadcast status for each call.

[0103] In one specific embodiment of this application, obtaining the latest call status and the latest broadcast status corresponding to each call includes:

[0104] After determining the change in the phone status of the target call, the current phone status is set as the latest phone status;

[0105] Before transmitting the broadcast voice corresponding to the notification content text to the communication peer device using the communication device, the broadcast status is determined to be not broadcast;

[0106] After transmitting the notification text corresponding to the broadcast voice to the communication peer device using the communication device, the broadcast status is determined to be broadcast;

[0107] If the phone call status is "ended" when transmitting the notification text to the other end of the communication device using the communication device, then the broadcast status is determined to be "incomplete broadcast".

[0108] After the broadcast status changes, the current broadcast status will be set as the latest broadcast status.

[0109] In other words, the broadcast status corresponds to the progress of the broadcast message. After the broadcast status changes, it is adaptively updated to the latest status, thus reflecting the current progress of the broadcast message. Correspondingly, the current phone status is also continuously updated as the call continues or over time.

[0110] In one specific embodiment of this application, a notification report recording the latest call status and latest broadcast status of each call is generated, including:

[0111] Generate call logs for each call; the call logs include the contact tag corresponding to the contact number, the latest call status, the latest broadcast status, and the call content, where the call content corresponds to the notification text.

[0112] Generate notification reports using call logs.

[0113] In this application, corresponding call logs can be generated in real time based on the latest phone status and latest broadcast status of each call. These call logs can record the contact tag corresponding to the contact number, the latest phone status, the latest broadcast status, and the call content, where the call content corresponds to the notification text. The notification report consists of all the call logs involved in this announcement. Of course, in practical applications, the notification report can also record factors such as announcement success rate and time consumption.

[0114] For example: After the voice announcement is completed, or if the phone is detected as disconnected, the phone will automatically end the call. Then, it will automatically iterate and dial the next number in the contact group (corresponding to the contact information) until all numbers have been dialed. The entire process records detailed results for each call (including but not limited to: connected and successfully announced, connected but not fully announced, not connected, call failed), and ultimately generates a statistical report including success rate, a list of failures, and reasons.

[0115] Applying the method provided in the embodiments of this application, when a telephone notification is required, the notification content text and contact information are obtained; the contact phone numbers corresponding to the contact information are dialed using a communication device, and the display data of the communication device is obtained; the telephone status is determined using the display data, and if the telephone status is in a call state, the broadcast voice corresponding to the notification content text is transmitted to the communication peer device using the communication device; the latest telephone status and latest broadcast status for each call are obtained, and a notification report recording the latest telephone status and latest broadcast status for each call is generated.

[0116] In this application, when a telephone notification is required, the notification text and contact information are first obtained. Then, a communication device is used to dial the contact numbers corresponding to the contact information, and the display data of the communication device is obtained. Based on this display data, the call status of each call can be determined. If the call is in a call state, the communication device can be used to transmit the broadcast voice corresponding to the notification text to the other end of the communication. During this process, the latest call status and latest broadcast status for each call can be obtained, thereby generating a notification report recording the latest call status and latest broadcast status for each call.

[0117] As can be seen, this application abandons unreliable internal system status queries and instead adopts a novel approach combining visual judgment. It determines the status by analyzing the consistent UI interface seen by the end user, thus fundamentally solving the compatibility and reliability issues of telephone status acquisition. In other words, this application has the following technical effects: it achieves true low-cost full automation, which can be implemented using general-purpose communication equipment without the need for dedicated hardware or cloud services; it achieves unattended automation of the entire process from dialing to announcement, greatly improving efficiency and reducing costs; and it ensures data security, as all call tasks and data are processed locally, avoiding the risk of sensitive information being uploaded to third-party platforms.

[0118] Corresponding to the above method embodiments, this application also provides an information processing system, and the information processing system described below can be referred to in correspondence with the information processing method described above.

[0119] See Figure 2 As shown, the system includes:

[0120] Host 101 and communication device 102;

[0121] The host is used to execute the steps of the information processing method as described in the above method embodiments;

[0122] Communication equipment used to make contact calls and transmit the corresponding voice message of a notification to the other end of the communication network.

[0123] For example, the system can be implemented by connecting a computer (a host computer) to an Android phone (a specific communication device) via a USB data cable 103. Simultaneously, the computer's headphone jack is connected to the phone's microphone jack via an audio pairing cable 104. The phone is then configured to enable USB debugging mode.

[0124] A computer program can run on the host machine. This program can be developed using the Python language and depends on libraries such as pyttsx3, pytesseract, opencv-python, and numpy. Its graphical user interface (GUI) is as follows: Figure 3 As shown, it may include a contact group management area, a call content input area, and a result log display area.

[0125] Please refer to Figure 4 and Figure 5 The detailed implementation of the visual state discrimination step (i.e., the steps of implementing the method provided in the method embodiment on this information processing system) is as follows:

[0126] To capture a screenshot: Use the `subprocess` module to execute the `adb exec-out screencap -p` command, which directly retrieves the binary stream from the stdout pipe and decodes it into an image matrix using the `np.frombuffer` and `cv2.imdecode` functions. This method is more efficient and leaves no file residue compared to saving to a file first and then reading it.

[0127] Image preprocessing is as follows:

[0128] Grayscale conversion: gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY).

[0129] Binarization inversion (key parameters): _, thresh = cv2.threshold(gray, 150, 255, cv2.THRESH_BINARY_INV). This step is a necessary inversion operation for UI themes with dark backgrounds and light text.

[0130] Morphological operations: kernel = np.ones((2, 2), np.uint8); processed = cv2.morphologyEx(thresh, cv2.MORPH_OPEN, kernel) are used to remove noise.

[0131] The code for locating the call duration region (key coordinates) is as follows:

[0132] Python

[0133] height, width = processed_img.shape

[0134] top_region = int(height * 0.15) # 15% distance from the top

[0135] bottom_region = int(height * 0.35) # 35% from the top

[0136] left_width = int(width * 0.35) # 35% distance from the left side

[0137] right_width = int(width * 0.65) # 65% distance from the left side

[0138] time_region = processed_img[top_region:bottom_region, left_width:right_width]

[0139] The coordinates of this area were determined based on measurements and analysis of the dialer interfaces of multiple mainstream mobile phones, and represent the most universal and stable region.

[0140] The specific implementation code for OCR (Optical Character Recognition) recognition and judgment is as follows:

[0141] Python

[0142] custom_config = r'--oem 3 --psm 6 -c tessedit_char_whitelist=0123456789:'

[0143] text = pytesseract.image_to_string(time_region, config=custom_config)

[0144] Configuring the whitelist tessedit_char_whitelist=0123456789 is the key to significantly improving recognition accuracy, as it can prevent misrecognition of any letters or symbols.

[0145] Taking power line trip notification as an example: Maintenance personnel connect their work phones to their computers via cables, open the program, select "Line A Trip Notification Group," enter the notification content, and click start. The program will then automatically dial the phones of all personnel in the group in sequence, and after detecting that the other party answers, it will broadcast the accident information in a clear voice. The entire process requires no manual intervention, and a detailed call report (i.e., notification report) is provided after completion.

[0146] When a telephone notification is required, obtain the notification text and contact information; use the communication device to dial the contact number corresponding to the contact information and obtain the display data of the communication device; use the display data to determine the telephone status, and if the telephone status is in a call state, use the communication device to transmit the broadcast voice corresponding to the notification text to the communication peer device; obtain the latest telephone status and latest broadcast status for each call, and generate a notification report recording the latest telephone status and latest broadcast status for each call.

[0147] In this application, when a telephone notification is required, the notification text and contact information are first obtained. Then, a communication device is used to dial the contact numbers corresponding to the contact information, and the display data of the communication device is obtained. Based on this display data, the call status of each call can be determined. If the call is in a call state, the communication device can be used to transmit the broadcast voice corresponding to the notification text to the other end of the communication. During this process, the latest call status and latest broadcast status for each call can be obtained, thereby generating a notification report recording the latest call status and latest broadcast status for each call.

[0148] As can be seen, this application abandons unreliable internal system status queries and instead adopts a novel approach combining visual judgment. It determines the status by analyzing the consistent UI interface seen by the end user, thus fundamentally solving the compatibility and reliability issues of telephone status acquisition. In other words, this application has the following technical effects: it achieves true low-cost full automation, which can be implemented using general-purpose communication equipment without the need for dedicated hardware or cloud services; it achieves unattended automation of the entire process from dialing to announcement, greatly improving efficiency and reducing costs; and it ensures data security, as all call tasks and data are processed locally, avoiding the risk of sensitive information being uploaded to third-party platforms.

[0149] Corresponding to the above method embodiments, this application also provides an electronic device. The electronic device described below and the information processing method described above can be referred to each other.

[0150] See Figure 6 As shown, the electronic device includes:

[0151] Memory 332 is used to store computer programs;

[0152] The processor 322 is used to implement the steps of the information processing method in the above method embodiments when executing a computer program.

[0153] For details, please refer to Figure 7 , Figure 7 This is a schematic diagram of the specific structure of an electronic device provided in this embodiment. The electronic device can vary significantly due to differences in configuration or performance. It may include one or more central processing units (CPUs) (e.g., one or more processors) and a memory 332. The memory 332 stores one or more computer programs 342 or data 344. The memory 332 can be temporary or permanent storage. The program stored in the memory 332 may include one or more modules (not shown in the diagram), each module may include a series of instruction operations on the data processing device. Furthermore, the processor 322 may be configured to communicate with the memory 332 and execute the series of instruction operations stored in the memory 332 on the electronic device 301.

[0154] Electronic device 301 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input / output interfaces 358, and / or one or more operating systems 341.

[0155] The steps in the information processing method described above can be implemented by the structure of an electronic device.

[0156] Corresponding to the above method embodiments, this application also provides a readable storage medium. The readable storage medium described below can be referred to in conjunction with the information processing method described above.

[0157] A readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the information processing method described in the above method embodiments.

[0158] The readable storage medium can specifically be a USB flash drive, external hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk, or any other readable storage medium capable of storing program code.

[0159] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the systems disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple; relevant parts can be referred to the method section.

[0160] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0161] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0162] Finally, it should be noted that in this document, relationships such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "include," "contain," or any other variations are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus.

[0163] This document uses specific examples to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An information processing method, characterized in that, include: When a telephone notification is required, obtain the notification text and contact information; Use a communication device to dial the contact numbers corresponding to the contact information, and obtain the display data of the communication device; The phone status is determined using the displayed data, and if the phone status is a call, the broadcast voice corresponding to the notification content text is transmitted to the communication peer device using the communication device. Obtain the latest call status and latest broadcast status for each call, and generate a notification report that records the latest call status and latest broadcast status for each call.

2. The method according to claim 1, characterized in that, Acquiring the display data of the communication device includes: Send an image export command to the communication device to obtain binary stream data on the display screen of the communication device; The binary stream data is converted into an image format to obtain the display data.

3. The method according to claim 1, characterized in that, Determining the phone status using the displayed data includes: After performing grayscale and binarization processing on the displayed data, the communication display area is captured; The content of the communication display area is identified to obtain the identification result; If the identification result includes a contact number or contact information, the phone status is determined to be dialing status; If the recognition result includes the words "calling", then the phone status is determined to be call waiting status; If the recognition result includes content in the specified time format, the phone status is determined to be a call status; If the recognition result includes information indicating that the call has ended, then the call status is determined to be terminated. If the identification result includes information corresponding to a call failure, then the phone status is determined to be a call failure.

4. The method according to claim 1, characterized in that, The communication device is used to transmit the broadcast voice corresponding to the notification content text to the communication peer device, including: The notification content text is converted into a speech signal using a text-to-speech engine. The voice signal is transmitted to the microphone interface of the communication device using a physical audio recording cable, so that the communication device can transmit the corresponding broadcast voice to the communication peer device.

5. The method according to claim 1, characterized in that, Using communication equipment to dial the contact numbers corresponding to the contact information, including: Dial the corresponding contact numbers in the order of the contact information provided.

6. The method according to claim 1, characterized in that, Retrieve the latest call status and latest broadcast status for each call, including: After determining the change in the phone status of the target call, the current phone status is determined as the latest phone status; Before the communication device is used to transmit the broadcast voice corresponding to the notification content text to the communication peer device, the broadcast status is determined to be not broadcast; After transmitting the broadcast voice corresponding to the notification content text to the communication peer device using the communication device, the broadcast status is determined to be broadcast; If the phone call is in the "end" state when the communication device is used to transmit the notification text to the communication peer device, then the broadcast status is determined to be "incomplete broadcast". After the broadcast status changes, the current broadcast status is determined as the latest broadcast status.

7. The method according to any one of claims 1 to 6, characterized in that, Generate a notification report recording the latest call status and the latest broadcast status for each call, including: Generate call logs for each call; the call logs include the contact tag corresponding to the contact number, the latest call status, the latest broadcast status, and the call content, wherein the call content corresponds to the notification content text; The notification report is generated using the call log.

8. An information processing system, characterized in that, include: Host and communication equipment; The host is used to perform the steps of the information processing method as described in any one of claims 1 to 7; The communication device is used to make contact calls and transmit the voice message corresponding to the notification content text to the communication peer device.

9. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the information processing method as described in any one of claims 1 to 7.

10. A readable storage medium, characterized in that, The readable storage medium stores a computer program that, when executed by a processor, implements the steps of the information processing method as described in any one of claims 1 to 7.

Images