Communication method and apparatus therefor

Abstract

This application discloses a communication method and apparatus, belonging to the field of communication technology. The communication method is executed by an electronic device and includes: in response to an emergency call, displaying at least one alarm function control on a call application interface; receiving a first input to a target function control, wherein the target function control is at least one of the alarm function controls; in response to the first input, displaying at least one help-seeking text message corresponding to the target function control; receiving a second input to the target text message, wherein the target text message is at least one of the help-seeking text messages; and in response to the second input, sending the help-seeking information corresponding to the target text message to the other end of the emergency call.

Description

Technical Field

[0001] This application belongs to the field of communication technology, specifically relating to a communication method and apparatus. Background Technology

[0002] Current mainstream emergency assistance services mainly include telephone communication, SMS communication and multimedia communication. However, existing telephone communication methods rely heavily on voice interaction. When users are unable to express themselves verbally due to language barriers or environmental limitations, it is difficult to quickly and intuitively convey relevant information to the recipient. Relying solely on traditional SMS or multimedia communication methods results in cumbersome operation procedures and untimely information transmission, making it impossible to efficiently transmit assistance information simultaneously during emergency calls. Summary of the Invention

[0003] The purpose of this application is to provide a communication method and apparatus that can send help text information without voice interaction during emergency calls, thereby improving the smoothness of information communication during emergency calls.

[0004] In a first aspect, embodiments of this application provide a communication method executed by an electronic device, the method comprising: In response to an emergency call, at least one alarm function control is displayed on the call application interface; Receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; In response to the first input, at least one help request text message corresponding to the target function control is displayed; Receive a second input for target text information, wherein the target text information is at least one of the help request text information; In response to the second input, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call.

[0005] Secondly, embodiments of this application provide a communication device, the device comprising: The control display module is used to display at least one alarm function control on the call application interface in response to an emergency call. An input receiving module is configured to receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; The information display module is used to respond to the first input and display at least one help request text message corresponding to the target function control; The input receiving module is further configured to receive a second input for target text information, wherein the target text information is at least one of the help request text information; The information sending module is used to respond to the second input by sending the help request information corresponding to the target text information to the other end corresponding to the emergency call.

[0006] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect.

[0007] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect.

[0008] Fifthly, embodiments of this application provide a chip, which includes a processor and a communication interface, the communication interface and the processor being coupled together, the processor being used to run programs or instructions to implement the steps of the method as described in the first aspect.

[0009] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which, when executed by at least one processor, implements the steps of the method described in the first aspect.

[0010] This application embodiment displays an alarm function control on the call application interface when an emergency call is initiated, and sends the corresponding help text information to the other end based on the input operation of the control and the help text. This breaks through the limitations of traditional voice communication, ensures the user's ability to seek help in emergency call scenarios due to language barriers or environmental limitations, and enables the sending of help text information without voice interaction during emergency calls. At the same time, the help interaction is integrated into the call interface, thereby significantly improving the convenience, accuracy and efficiency of information transmission, and improving the smoothness of information communication during emergency calls. Attached Figure Description

[0011] Figure 1 A flowchart illustrating a communication method provided in an embodiment of this application; Figure 2 A schematic diagram of a call application interface provided in an embodiment of this application; Figure 3 This is a schematic diagram of another call application interface provided in an embodiment of this application; Figure 4 A schematic diagram of a call application interface for selecting a location control is provided in an embodiment of this application; Figure 5 A schematic diagram of a call application interface for selecting target text information is provided in an embodiment of this application; Figure 6A schematic diagram of a call application interface containing a list of location information is provided for an embodiment of this application; Figure 7 A schematic diagram of a call application interface containing scene description text, provided for an embodiment of this application; Figure 8 A schematic diagram of a call application interface containing action description text, provided for an embodiment of this application; Figure 9 A schematic diagram of a call application interface for selecting an emergency help control is provided in an embodiment of this application; Figure 10 This is a schematic diagram of the structure of a communication device provided in an embodiment of this application; Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 12 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0012] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0013] The terms "first," "second," etc., used in this application's specification are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, in the specification, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects have an "or" relationship.

[0014] Current mainstream emergency assistance services mainly include telephone communication, SMS communication, and multimedia communication. Telephone emergency calls have significant advantages in terms of recognition, ease of operation, and real-time interaction, making them the preferred method of alarm in emergencies. However, telephone emergency calls heavily rely on voice interaction, which has obvious limitations: hearing-impaired individuals, users unable to speak due to injury, illness, or environmental constraints, and users who have difficulty clearly expressing themselves due to stress in emergency situations all struggle to quickly and intuitively convey their request for help to the recipient via voice. Traditional SMS or multimedia communication methods, on the other hand, suffer from cumbersome procedures and untimely information delivery, failing to efficiently transmit request information simultaneously during an emergency call.

[0015] To address this, this application provides a communication method and apparatus. By displaying an alarm function control on the call application interface when an emergency call is initiated, and sending the corresponding help text information to the other end based on the input operation of the control and the help text, this method overcomes the limitations of traditional voice communication, ensuring the user's ability to seek help in emergency call scenarios due to language barriers or environmental limitations. It enables the sending of help text information without voice interaction during emergency calls, and integrates help interaction into the call interface, thereby significantly improving the convenience, accuracy, and efficiency of information transmission, and enhancing the smoothness of information communication during emergency calls.

[0016] The communication method and apparatus provided in this application will be described below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0017] Figure 1 This is a flowchart of a communication method provided in an embodiment of this application. This communication method can be applied to electronic devices such as mobile phones, tablets, and laptops that have call services, location services, and media services.

[0018] like Figure 1 As shown, the communication method is performed by an electronic device and may include the following steps S110-S150.

[0019] S110. In response to an emergency call, display at least one alarm function control on the call application interface.

[0020] The aforementioned emergency call is initiated by an electronic device and is a call request to a preset emergency service number (such as 110, 120, etc.) or a preset emergency contact. The alarm function control is a user interaction element set in the call application interface, such as a button, icon, or touch area, used to trigger specific help functions, such as location function, image acquisition function, etc.

[0021] For example, after an electronic device detects that an emergency call has been established, it may overlay at least one alarm function control on the regular display area of ​​the call application interface.

[0022] In some embodiments, in order not to affect the normal function of the underlying calling application, the electronic device may draw a floating window with system-level permissions after detecting that an emergency call has been established, and overlay it on the top layer of the calling application interface. This floating window is independent of the calling application, remains active throughout the call, and automatically closes and releases the relevant system resources when the call ends.

[0023] In terms of the layout design of the floating window, the window is presented as a semi-transparent panel located in a specific area of ​​the call application interface (such as the lower middle area of ​​the interface). The panel mainly contains a text display area and a function control area. The text display area is used to display text information, and the function control area is used to display at least one alarm function control.

[0024] In addition, to ensure the flexibility of the floating window, it also provides display attribute adjustment functions. Users can adjust the display attributes of the floating window according to their personal usage habits by inputting relevant information. For example, by long-pressing and dragging, the floating window can be moved to a specific position on the call application interface; by pinching, the display size of the floating window can be adjusted to adapt to different usage scenarios and interface sizes.

[0025] The establishment of an emergency call can be initiated automatically by the electronic device when it detects an emergency, such as an event that meets preset emergency conditions, such as a severe impact or fall from a height detected by the built-in sensor; or it can be initiated by the user, such as when the user dials an emergency service number. This embodiment does not limit the method of establishing an emergency call.

[0026] The aforementioned call application interface is the interactive interface displayed when the call application is running on an electronic device, including areas for regular call operations such as call status display, hanging up, and muting.

[0027] For example, to avoid accidentally triggering alarm-related functions during regular calls and to ensure the accuracy and rationality of emergency assistance procedures, the method further includes, before executing S110 above, determining that the called number in the emergency call belongs to a preset set of emergency numbers.

[0028] The called number is the number dialed by the electronic device when it initiates a call; the preset emergency number set includes preset emergency service numbers or preset emergency contact numbers.

[0029] For example, before initiating a call, or during the process of establishing a call but before the other party has answered, the electronic device extracts the called number, matches the called number with a set of emergency numbers stored locally, and if the called number belongs to the preset set of emergency numbers, then the current call is determined to be an emergency call, and proceeds to display at least one alarm function control and corresponding steps.

[0030] For example, the alarm function control involved in the above S110 includes at least one of emergency help control, location control, and image acquisition control; The emergency help control is used to trigger the display of at least one emergency help text corresponding to the emergency help control in the call application interface; The positioning control is used to trigger the display of location information; The image acquisition control is used to trigger the camera on an electronic device to capture images and generate corresponding descriptive text for the images.

[0031] The emergency help control is used to trigger the display of preset emergency help text, usually identified by "SOS" or "emergency help". For users who are hearing impaired, unable to speak, or have difficulty speaking, the emergency help control can call up the preset emergency help text with one click, allowing them to ask for help without voice interaction, thus ensuring the alarm capability in emergency scenarios.

[0032] The location control is used to trigger the display of location information. It is used to quickly obtain and display text related to the user's current location, solving the problem of unclear location description in emergency scenarios and greatly improving the timeliness and accuracy of rescue.

[0033] The image acquisition control is used to trigger the camera of an electronic device to acquire images and generate corresponding descriptive text. It can acquire a first image of the user's environment or a second image containing the user's actions and generate corresponding descriptive text, realizing the visual transmission of on-site information and the recognition and interaction of user actions.

[0034] For example, a camera is an image acquisition component configured in an electronic device, which may include a rear main camera for acquiring a first image and a front camera for acquiring a second image containing user actions, adapting to the image acquisition needs of different scenarios.

[0035] In some embodiments, to adapt to different scenarios and user needs, and to balance interface simplicity and functional completeness, the display methods of the aforementioned emergency assistance controls, location controls, and image acquisition controls are not fixed or singular, but can be flexibly combined and displayed according to actual usage. Furthermore, the alarm function controls are not limited to the above three types and may also include other function controls.

[0036] The specific display methods may include, but are not limited to: displaying only a single alarm function control; or displaying two or more of the above controls according to actual needs, and these controls can be configured in various combinations according to actual needs.

[0037] In addition, the system can visually identify and operate the emergency help and location controls, making it easier for users to quickly recognize and operate them in emergency situations. For example, the emergency help and location controls can be highlighted in red and blue, respectively.

[0038] For example, for users who are hearing impaired, unable to speak, or have difficulty speaking, in order to enable them to quickly and accurately complete the request for help and greatly improve the convenience and response speed of emergency help operations, when the electronic device detects that the target function control is an emergency help control, it responds to the first input to the emergency help control. At this time, it reads one or more emergency help texts that the user has pre-edited and saved from the local secure storage area of ​​the electronic device and displays them on the call application interface. The display location may include, but is not limited to, any of the following: the text display area of ​​the floating window; or a panel superimposed on the regular display area of ​​the call application interface.

[0039] The emergency help text is edited and entered by the user during the function initialization configuration phase. The system can also provide multiple default templates for users to choose from, such as "I need help, I can't speak right now, please help me immediately" or "I have encountered an emergency and can't communicate by voice. Please understand my situation through the voice broadcast in this call."

[0040] For example, to enhance text security and ensure the security of user privacy information, the aforementioned emergency help text is encrypted and stored in the secure storage area of ​​the electronic device.

[0041] The encrypted storage process can be specifically as follows: A secure key storage service provided by the operating system of an electronic device (such as the Android Keystore system) generates and protects a symmetric encryption key (such as an AES key). This key is protected by a hardware-level security module (such as a security chip) and cannot be accessed or exported by unauthorized applications.

[0042] When a user edits or updates an emergency help text, the system uses the symmetric key to encrypt the text, generating ciphertext data. This ciphertext data is then written to a secure storage area protected by the application (such as SharedPreferences or a local database), ensuring that the original emergency help text is not exposed to insecure environments.

[0043] When responding to the first input to the emergency help control, the system reads the encrypted emergency help text from the secure storage area, and simultaneously requests the secure key storage service provided by the operating system or hardware to call the hardware-protected symmetric key. The system then uses this key to decrypt the encrypted data and restore the original emergency help text for display.

[0044] In some embodiments, to achieve cross-device cloud backup and recovery of emergency help texts and ensure that relevant information is not lost while further protecting data security, when a user logs in to the corresponding account on an electronic device, the electronic device automatically reads the encrypted data corresponding to the emergency help text in the local secure storage area; based on an end-to-end encryption mechanism, the encrypted data is uploaded to the cloud server connected to the communication connection to complete the backup, without uploading plaintext data at all, and the server only stores the encrypted data, further ensuring data security.

[0045] When a user changes devices or reinstalls applications, and logs in with the same account as when backing up, the electronic device sends a query request to the cloud server to verify whether the account has backed-up encrypted data. If the cloud server confirms that a backup record exists, it returns the corresponding encrypted data to the electronic device.

[0046] Electronic devices call the system's security key service to decrypt downloaded encrypted data using a hardware-protected key; after decryption, the original emergency request text is restored for users to view, confirm, or edit.

[0047] For example, to ensure that users who cannot hear the voice or have language barriers can clearly understand the responses and inquiries from the other end, and to further guarantee the integrity and smoothness of communication during emergency assistance, the communication method specifically includes the following steps: Obtain voice data from the other end; Display the text information corresponding to the voice data on the call application interface.

[0048] In some embodiments, based on the audio capture interface provided by the operating system of the electronic device, the system requests and obtains system-level audio recording permissions to acquire voice data transmitted from the other end during an emergency call in real time; the voice data is then sent to a speech recognition engine. The other end is not limited to the direct communication partner in the emergency call, such as a terminal, but may also include devices associated with that direct communication partner, such as a backend server.

[0049] After receiving voice data from the other end, the voice recognition engine converts the voice data into corresponding text information in real time; the text information is returned to the call application interface in real time through the callback interface, realizing near real-time text display of the remote voice content.

[0050] The text information corresponding to the voice data can be displayed in the regular display area of ​​the call application interface or in the text display area of ​​the floating window. This embodiment does not limit the display method of the text information corresponding to the voice data.

[0051] In some embodiments, after an electronic device initiates a call, regardless of whether it is an emergency call, the operating system can detect whether the accessibility call assistance function is currently enabled. If it is enabled, the device proceeds to the steps described above: acquiring the voice data from the other end and displaying the corresponding text information on the call application interface. If the electronic device detects that the current call is an emergency call and the accessibility call assistance function is enabled, the interface display will automatically switch to emergency mode. While executing the steps of displaying at least one alarm function control and subsequent corresponding steps, the device will simultaneously execute the steps described above: acquiring the voice data from the other end and displaying the corresponding text information on the call application interface.

[0052] Among them, the accessibility call assistance function is used to convert the voice data of the other party into corresponding text information in real time and display it, so that users can clearly understand the other party's reply and inquiry.

[0053] In the case of a non-emergency call and accessibility features are enabled, the call application interface is as follows: Figure 2 As shown, area 21 is a display area for displaying text information corresponding to the voice data from the other end. Area 21 can be a panel superimposed on the regular display area of ​​the call application interface, or a floating window with system-level permissions. Controls 221 and 222 are the hang-up control and hands-free control in the call application, respectively, located in the regular call operation area of ​​the call application interface.

[0054] In the event of an emergency call with accessibility features enabled, the call application interface simultaneously displays at least one alarm function control, the text information corresponding to the other party's voice data, and the target text information selected by our side. For ease of understanding, it is described below. Figure 3 The interface display in the above scenarios is illustrated. Figure 3 The top displays the call status information "110 emergency call in progress 00:56"; among them, "Hello, this is the 110 emergency service, what's wrong?" is the text information corresponding to the voice data from the other end; "I need help, I can't speak right now, please help me immediately!" is the target text information selected by our side; "Okay, where are you now?" is the reply from the other end based on the target text information; controls 31, 32 and 33 are different alarm function controls, which can be respectively corresponding to the SOS control, the location control and the image acquisition control.

[0055] In addition, due to the limitations of the display size of the call application interface, the text information corresponding to the voice data of the other party and the target text information selected by our side will be updated or overwritten as the conversation progresses to adapt to the display space.

[0056] In the event of an emergency call with accessibility features enabled, if the user triggers a target function control (i.e., performs the first input on the target function control), at least one help-seeking text message corresponding to that target function control will be simultaneously displayed on the call application interface. For ease of understanding, Figure 4 illustrates the interface display in this scenario. When the user selects control 42 (the positioning control), the interface will look like this. Figure 4 As shown, Figure 4 The top also displays the call status information "110 emergency call in progress 00:56"; Figure 4 The text "Hello, where are you now?" in the text is the text information corresponding to the voice data from the other end; "GPS (Global Positioning System): Location Information 1", "Base Station: Location Information 2", "Common: Location Information 3" and "Common: Location Information 4" are all help text information corresponding to the positioning control; Controls 41, 42 and 43 are different alarm function controls, which can be respectively corresponding to SOS control, positioning control and image acquisition control.

[0057] When the user selects "GPS: Location Information 1" as the target text information (i.e., performs the second input for this request for help text information), the interface changes. Figure 4 Jump to Figure 5 In the state shown, the target text information is displayed on the call application interface in the form of "Our side: Location information 1!"; Controls 51, 52 and 53 are still different alarm function controls, which can be respectively SOS control, positioning control and image acquisition control.

[0058] In the above Figures 3 to 5 In the emergency call scenario shown, the text information display area and the alarm function control can be displayed in two ways: First, they can be directly overlaid on the corresponding area of ​​the call application interface; second, a floating window with system-level permissions can be drawn on top of the call application interface. Various text information can be displayed through the text display area of ​​the floating window, and alarm function controls can be displayed through the function control area of ​​the floating window. This floating window is independent of the underlying call application and does not affect the normal operation of the call application.

[0059] S120, Receive the first input for the target function control.

[0060] The aforementioned target function control is one or more alarm function controls selected by the user from at least one displayed alarm function control, used to perform the corresponding help operation; the first input is the specific trigger operation performed by the user on the target function control, including input forms such as clicking, long pressing, and swiping.

[0061] Specifically, the electronic device displays at least one alarm function control on the call application interface. The user selects the desired target function control by clicking, long-pressing, or swiping to complete the first input to the control.

[0062] In some embodiments, users can also select multiple alarm function controls simultaneously through specific operations. For example, users can complete the first input for multiple alarm function controls by checking or selecting them. After receiving such a first input that simultaneously targets multiple controls, the system will respond to the help requests corresponding to each target function control in parallel or sequentially, and execute S130 and subsequent corresponding steps respectively.

[0063] S130. In response to the first input, display at least one help message corresponding to the target function control.

[0064] The aforementioned help-seeking text information is text content associated with the function represented by the target control. For example, the "SOS control" corresponds to displaying a preset emergency help-seeking text; the "location control" corresponds to displaying help-seeking text information corresponding to the location information.

[0065] For example, a target function control corresponds to at least one request for help text message; upon receiving a first input to the target function control, the electronic device, in response to the first input, acquires and displays all request for help text messages corresponding to the target function control. The request for help text messages corresponding to the target function control can be pre-set or generated in real time; this embodiment does not limit the specific source of the request for help text messages.

[0066] In some embodiments, the display of all help-seeking text information corresponding to the target function control may include, but is not limited to, the following methods: directly filling all help-seeking text information corresponding to the target function control into the text input area attached to the call application; or, displaying all help-seeking text information corresponding to the target function control in the text display area of ​​the floating window; or, displaying all help-seeking text information corresponding to the target function control in the regular display area of ​​the call application interface.

[0067] For example, in order to solve the problem of unclear location description in emergency scenarios, and to avoid the failure of a single positioning method leading to inaccurate location reporting, the above-mentioned S130 may specifically include the following steps: in response to the first input to the positioning control, if the location information from multiple positioning sources is not missing, display the help text information corresponding to the location information from multiple positioning sources on the call application interface.

[0068] When an electronic device detects that the target function control is a location control, in response to the first input to the location control, the system will obtain multiple preset location information from different location sources. These multiple location information sources include, but are not limited to, at least one commonly used address pre-edited and saved locally by the user, such as home address or workplace address; the location address provided by the electronic device's carrier base station when dialing emergency service numbers; GPS satellite positioning information; and the electronic device's Wi-Fi positioning information.

[0069] After obtaining multiple preset location information from different location sources, the system will further determine whether any of the following conditions are met: 1. The user has not pre-entered a frequently used address; 2. The GPS, Wi-Fi, and base station positioning services of the electronic device cannot return location information.

[0070] If none of the above conditions are met, it means that location information from multiple location sources is not missing. In this case, a matching help request text (i.e., text containing location information) is generated based on the location information from each source and displayed on the call application interface. Each help request text corresponding to a location information also includes a source tag, for example... Figure 4 The terms "GPS", "base station", and "common" are shown in the image.

[0071] The display location may include, but is not limited to, any of the following: the text display area of ​​a floating window; or a panel overlaid in the regular display area of ​​a call application interface.

[0072] When obtaining location information through GPS, Wi-Fi, and base station positioning services of electronic devices, the following method can be used: obtain the latitude and longitude coordinates of the electronic device through the positioning service, and convert the latitude and longitude coordinates into a readable text address through the reverse geocoding service to obtain the location information.

[0073] In some embodiments, the help text information corresponding to the location information from multiple location sources can be displayed in a list form on the call application interface. The user can make a second input for the help text information corresponding to a certain location information, use it as the target text information, and send the help information corresponding to the target text information to the other end of the emergency call.

[0074] In addition, the system supports users to make multiple second inputs for the same location information corresponding to the help text information. Each second input will trigger a complete sending process, thereby solving the actual use needs of the staff on the other end who need to repeatedly obtain the location information because the location information cannot be completely recorded in a single reception.

[0075] For example, under the extreme condition that the user cannot input any text or voice and the user's location information is missing, in order to ensure that the location information can be accurately and conveniently transmitted to the other end, the above-mentioned S130 may specifically include the following steps: In response to the first input to the location control, if location information is missing from multiple location sources, a second dialog pop-up is displayed on the call application interface; Receive the fourth input in the second dialog pop-up window; In response to the fourth input within the second dialog pop-up, acquire the target image; The call application interface displays a help request text message corresponding to at least one location information corresponding to the target image.

[0076] When an electronic device detects that the target function control is a location control, in response to the first input to the location control, the system will obtain multiple preset location information from different location sources, and further determine whether any of the following conditions are met: 1. The user has not pre-entered a frequently used address; 2. The electronic device's GPS, Wi-Fi, and base station positioning services cannot return location information.

[0077] If any of the above conditions are met, it indicates that location information is missing from multiple location sources. In this case, a second dialog pop-up will be triggered and displayed on the call application interface. The second dialog pop-up will display the message "Current location failed, camera will be opened to obtain location shortly," and provide clear operation options such as "Confirm" and "Cancel."

[0078] The system listens for and receives the user's fourth input in the second dialog pop-up window, namely the user's trigger operation of the "confirm" option. At this time, the system responds to the fourth input, previews the video stream of the user's current environment through the rear camera on the electronic device, and extracts a high-definition target image from the video stream.

[0079] If the system does not receive any operation within the second dialog pop-up window after a certain period of time (e.g., 15 seconds) after displaying the second dialog pop-up window, or if it receives input from the user at any location outside the area of ​​the second dialog pop-up window, the system will also preview the video stream of the user's current environment through the rear camera on the electronic device.

[0080] After preprocessing the target image, at least one location information corresponding to the target image is generated through intelligent analysis methods such as local feature matching or cloud image location retrieval. Each analysis method can generate one location information corresponding to the target image; preprocessing includes, but is not limited to, denoising, image enhancement, and compression.

[0081] Subsequently, the system generates matching help request text (i.e., text containing location information) based on each location information corresponding to the target image, and displays it on the call application interface.

[0082] For example, to ensure stable acquisition of location information even in extreme scenarios, the location information corresponding to the target image can be determined based on at least one of the following methods: If the current network parameters meet the communication connection conditions, the target image is uploaded to the cloud server so that the cloud server can return the location information corresponding to the target image; If the current network parameters do not meet the communication connection conditions or the cloud server response times out, the target image is compared with the visual feature data of multiple landmark buildings to obtain the location information corresponding to the target image; the electronic device stores the location information corresponding to each landmark building. The target image is matched with multiple historical images to obtain the location information associated with the historical images that successfully match the target image. Each historical image is pre-associated with corresponding location information. If a historical image similar to the target image exists, the location information associated with the historical image is matched with at least one preset delivery location information, and the location information corresponding to the target image is determined from the at least one delivery location information.

[0083] In some embodiments, the network parameters mentioned above are parameters that can reflect the network status, such as bandwidth and network latency; the communication connection conditions are conditions used to determine whether the network parameters meet the preset standards, such as setting thresholds corresponding to bandwidth and network latency, and determining whether each indicator in the current network parameters meets the corresponding threshold requirements, such as bandwidth not lower than the preset minimum bandwidth and network latency not higher than the preset maximum latency. If all indicators meet the standards, it is determined that the current network parameters meet the communication connection conditions; if any indicator does not meet the standards, it is determined that the current network parameters do not meet the communication connection conditions.

[0084] After acquiring the target image, the system needs to further determine whether the current network parameters meet the communication connection conditions. If the current network parameters meet the communication connection conditions, it means that the current network status belongs to the third or fourth level of network demand levels. The fourth level requires high bandwidth and low latency to support real-time video stream analysis; the third level requires a stable network connection to support real-time image uploading.

[0085] If the current network parameters do not meet the communication connection conditions, it means that the current network status belongs to the first or second level of network demand. The second level requires intermittent network connection and supports breakpoint resume and result caching; the first level is available offline.

[0086] For example, when the current network parameters meet the communication connection conditions, the electronic device uploads the target image to the cloud server. The cloud server analyzes the target image through an AI (Artificial Intelligence) based image geolocation service and returns the corresponding location information.

[0087] The specific analysis method is as follows: The image geolocation service, based on a massive database of street view images and landmark building images, performs similarity matching between the target image and known geographical location images in the database. When the similarity between the target image and any known geographical location image exceeds a preset threshold, the cloud server returns the geographical location corresponding to that known geographical location image as the location information corresponding to the target image, along with the corresponding confidence score. The confidence score of the location information corresponding to the target image under that location source is the similarity between the target image and the known geographical location image.

[0088] In addition, if multiple known geographic location images have a similarity to the target image that exceeds a preset threshold, the geographic location corresponding to the known geographic location image with the highest similarity will be selected and returned.

[0089] For example, if the current network parameters do not meet the communication connection conditions or the cloud server response times out, the electronic device will perform local feature library matching to obtain the location information corresponding to the target image. Specifically, the system has a pre-built local feature library, which includes visual feature data of multiple frequently accessed landmarks (such as transportation hubs, medical facilities, commercial centers, famous scenic spots, etc.) and the location information corresponding to each landmark. The visual feature data is stored in the form of lightweight feature descriptors to ensure that the storage space occupied is controllable.

[0090] Among them, cloud server response timeout refers to the situation where, after uploading a target image to the cloud server under the condition that the current network parameters meet the communication connection conditions, no location information is received within a preset time (e.g., 5 seconds).

[0091] The system compares the target image with the visual feature data of multiple landmark buildings to obtain the similarity between the target image and each landmark building. When the similarity between the target image and any landmark building exceeds a preset threshold, the location information corresponding to that landmark building is used as the location information corresponding to the target image. At the same time, the similarity between the target image and that landmark building is used as the confidence score of the location information corresponding to the target image under that location source.

[0092] If multiple landmark buildings have a similarity to the target image that exceeds a preset threshold, then the location information of the landmark building with the highest similarity is selected as the location information corresponding to the target image.

[0093] In addition, the system supports incremental caching of visual feature data and corresponding location information of landmark buildings. When electronic devices are connected to the network in a Wi-Fi environment, the local feature library can be automatically updated in the background to improve the recognition accuracy in offline scenarios.

[0094] For example, the aforementioned historical images are images stored in the local photo album of an electronic device, and each historical image is pre-associated with corresponding location information. With the user's authorization to access the local photo album, the system performs similarity matching between the target image and multiple historical images. When the similarity between the target image and any historical image exceeds a preset threshold, the target image is considered a successful match with that historical image. At this point, the location information associated with that historical image is used as the location information corresponding to the target image, and the similarity between the target image and that historical image is used as the confidence score of the location information corresponding to the target image at that location source.

[0095] If multiple historical images have a similarity to the target image that exceeds a preset threshold, then the location information of the historical image with the highest similarity is selected as the location information corresponding to the target image.

[0096] For example, if a user encounters danger in their own home, and the target image captured is highly similar to a historical image taken at home in the local photo album, the system can determine the location information corresponding to the target image through the location information of that historical image.

[0097] For example, if a historical image similar to the target image exists, the system will further retrieve at least one preset delivery location information and perform text similarity matching, such as address keyword matching, on the location information associated with the historical image with each delivery location information. When the similarity between the location information associated with the historical image and any delivery location information exceeds a preset threshold, that delivery location information is then used as the location information corresponding to the target image.

[0098] The confidence score of the location information corresponding to the target image under the location source can be determined in the following ways: taking the product of the similarity between the location information associated with the historical image and the delivery location information, and the similarity between the historical image and the target image; or, taking a weighted sum of the similarity between the location information associated with the historical image and the delivery location information, and the similarity between the historical image and the target image.

[0099] If multiple delivery location information and the location information associated with historical images have similarities exceeding a preset threshold, then the delivery location information with the highest similarity will be selected as the location information corresponding to the target image.

[0100] The aforementioned preset delivery location information is a detailed address (such as home or work address) that the user has pre-stored locally on their electronic device for e-commerce shopping and express delivery. This type of address is usually accurate down to the house number, which can provide rescue forces with a more accurate and practical location description.

[0101] In some embodiments, the above-described methods for analyzing the location information corresponding to the target image include: cloud server analysis, local feature library comparison, local album matching, and delivery location information matching. Each analysis method corresponds to a location source of one location information for the target image, and one or more of these methods can be selected and combined to execute, provided that the applicable conditions are met.

[0102] For example, in order to prioritize the presentation of more reliable location results, facilitate users in quickly selecting accurate location information, and improve the efficiency of location reporting during emergency calls, the above-mentioned display of at least one location information corresponding to the target image and the corresponding help request text information on the call application interface specifically includes the following steps: When there are multiple requests for help text information corresponding to the location information of the target image, obtain the confidence score of the location information corresponding to each target image; Based on the confidence score of the location information corresponding to each target image, the help request text information corresponding to multiple location information of the target image is sorted to form a location information list; The list of location information is displayed on the call application interface.

[0103] In some embodiments, when multiple location information corresponding to a target image is obtained through various analysis methods, the system first reads the confidence score calculated for each location information under the corresponding analysis method; then, according to the confidence score from low to high, the help request text information corresponding to the multiple location information is sorted in ascending order to generate a location information list, and the help request text information corresponding to each location information can be labeled with the corresponding location source tag at the same time.

[0104] Finally, the system displays the sorted list of location information on the call application interface, allowing users to visually view and select the corresponding help-seeking text message to send as the target text message to the other end. The displayed location may include, but is not limited to, any of the following: the text display area of ​​a floating window; or a panel overlaid on the regular display area of ​​the call application interface. When displaying the location information list, location information with higher confidence scores can be placed closer to the bottom of the interface, or other display methods can be used; this embodiment does not impose any restrictions on this.

[0105] Simultaneously, if the location information list contains a distress text message corresponding to the location information analyzed by the cloud server, the call application interface will simultaneously display the target image and the results of the cloud server analysis, for example... Figure 6 As shown, area 61 displays the target image; below area 61, the analysis results from the cloud server are displayed, namely, "The current environment displayed in the target image has a similarity of 92% to XX"; below the analysis results, a list of location information is displayed, including "Cloud: Location Information 5", "Album: Location Information 6", and "Delivery: Location Information 7". Figure 6 The “cloud,” “album,” and “delivery” shown are the location sources for each location information; controls 611, 662, and 663 are different alarm function controls, which can be respectively identified as SOS control, positioning control, and image acquisition control.

[0106] For example, to address the problem that users cannot describe the specific situation on-site in words, and to further improve the success rate of emergency assistance and rescue efficiency, the above-mentioned S130 may specifically include the following steps: In response to a first input to the image acquisition control, a first image of the user's environment is acquired via a first camera on the electronic device; Display the scene description text corresponding to the first image on the call application interface.

[0107] When the electronic device detects that the target function control is an image acquisition control, in response to the first input to the image acquisition control, the system defaults to calling the first camera on the electronic device. The user can point the first camera at the target scene to be described, such as their own injured parts, the surrounding dangerous environment, an accident scene, suspicious persons, etc. In the preview screen, the system automatically captures keyframe images at fixed time intervals (e.g., every 2 seconds) to obtain a first image of the user's environment. The first camera can be the rear camera mounted on the electronic device.

[0108] In some embodiments, when the electronic device detects that the target function control is an image acquisition control, after responding to the first input to the image acquisition control, the system defaults to calling the second camera on the electronic device; if the user further performs a fifth input to the image acquisition control (for example, clicking the switch icon on the control), the system immediately switches to calling the first camera on the electronic device and points the first camera at the scene target to be described. The second camera is a front-facing camera mounted on the electronic device.

[0109] In some embodiments, the system transmits the first image to an AI image understanding service for analysis and processing: the AI ​​image understanding service performs semantic-level scene understanding and content description on the input first image based on a pre-trained multimodal large language model (such as a visual language model), and generates scene description text corresponding to the first image.

[0110] The specific processing flow of the AI ​​image understanding service can be as follows: First, target detection and scene classification are performed on the input first image to identify key entities (such as people, wounds, flames, vehicles, knives, etc.) and scene types (such as indoor, street, accident scene, etc.) in the first image; second, structured scene description text is generated based on the recognition results.

[0111] For emergency assistance scenarios, the AI ​​model undergoes specialized fine-tuning training to focus on key information related to the request for help when generating scene description text, employing a concise and clear expression. For example, when a user points the first camera at their injured leg, the AI-generated scene description text could be: "The user's left leg below the knee in the image shows obvious external injury with bleeding, which may require emergency medical assistance." When the user points the first camera at a distant accident scene, the AI-generated scene description text could be: "A suspected traffic accident has occurred in the distance, with two vehicles colliding and people lying on the ground. The situation is urgent, and the person filming may need assistance."

[0112] The system displays the scene description text corresponding to the first image as the help request text information for the image acquisition control on the call application interface. Users can view and confirm whether the scene description text accurately reflects the situation. If the user believes the description is basically accurate, they can make a second input on the scene description text, using it as the target text information for subsequent transmission. If the user believes the description is inaccurate or needs supplementation, they can adjust the angle of the first camera and wait for AI to regenerate the description. Alternatively, when input operations are triggered in areas other than the text display area and alarm function control area on the call application interface, a preset list of commonly used phrases will be displayed on the call application interface. Users can also select supplementary content from the preset list of commonly used phrases for additional broadcast. The list of commonly used phrases can also be displayed as the help request text information corresponding to the image acquisition control when responding to input on the image acquisition control.

[0113] In this way, even if users cannot describe the situation in words during an emergency, users on the other end can still understand the specific dangerous situation of the person making the alarm through the scene description text, thereby making more accurate and efficient dispatch decisions.

[0114] In addition, the system also pushes the real-time first image to be collected and displays it on the call application interface. The scene description text corresponding to the first image is used as the help text information of the image acquisition control and is displayed in real time below the first image. When the system receives the second input from the user regarding the scene description text, it is further displayed in the text display area to reflect the real-time interaction with the other end and is used as the target text information for subsequent sending processes.

[0115] For example, Figure 7 As shown, Figure 7 Area 71 is used to display the first image; below area 71, the scene description text corresponding to the first image output by AI analysis is displayed, namely, "The user's left leg below the knee has obvious external injury with bleeding marks, requiring emergency medical assistance"; below the scene description text, the text information that has been sent or is about to be sent to the other end is displayed, such as "The user's left leg below the knee has obvious external injury with bleeding marks, requiring emergency medical assistance" or "I need help, I can't speak right now, please help me immediately!": Controls 771, 772, and 773 are all different alarm function controls, which can be respectively corresponding to the SOS control, the positioning control, and the image acquisition control.

[0116] If the relevant content is displayed via a floating window, a preview area can be opened within the floating window after the first camera is activated. The preview area can be located in the upper half of the window, while the text display area and function control area are reserved below the preview area. This ensures that the user can still see the text content transcribed from the remote speech and the content sent to the other end as target text information while viewing the first image. At the same time, the scene description text corresponding to the first image is displayed in real time below the preview area.

[0117] For example, in order to further improve the success rate of emergency calls and the efficiency of rescue response, a two-way communication channel can be built for silent call scenarios to provide richer silent interaction methods. Specifically, S130 above may include the following steps: In response to a first input to the image acquisition control, a second image containing the user's actions is acquired via a second camera on the electronic device; The action description text corresponding to the second image is displayed on the call application interface.

[0118] When the electronic device detects that the target function control is an image acquisition control, after responding to the first input to the image acquisition control, the system defaults to using the first camera on the electronic device. If the user further performs a fifth input to the image acquisition control (for example, clicking the toggle icon on the control), the system immediately switches to using the second camera on the electronic device to capture a second image containing the user's actions. The first camera is the rear camera of the electronic device, and the second camera is the front camera of the electronic device.

[0119] In some embodiments, in response to a first input to the image acquisition control, the system by default invokes a second camera on the electronic device to acquire a second image containing the user's actions.

[0120] In this embodiment, the second image containing the user's action can be a multi-frame image sequence or a single-frame image; this embodiment does not impose any limitations on this. If the user action contained in the second image is a head action, the system can employ a head pose estimation algorithm based on facial key point detection to track the user's facial feature key points in real time. For a multi-frame image sequence, the system identifies the user's action by analyzing the displacement trajectory and motion pattern of the key points between consecutive frames. For a single-frame image, the system directly determines the type of head action based on the spatial distribution characteristics of the facial key points and inputs the identified action into a pre-trained large language model. The large language model then completes the semantic mapping from action to natural language text, thereby obtaining the action description text corresponding to the image. For example, if the user's action is shaking their head, the corresponding action description text is "no"; if the user's action is nodding, the corresponding action description text is "yes".

[0121] If the user action contained in the second image is a gesture, the system can use a gesture recognition model based on hand skeleton keypoint detection to identify the semantics corresponding to the gesture and use the corresponding semantics as the action description text for the image. The gesture recognition model can be a deep learning model, trained on a large number of gesture images labeled with corresponding semantics, capable of recognizing various common gestures and their corresponding semantics.

[0122] For example, raising your thumb means "okay" or "okay", waving your hand means "don't" or "stop", and extending one to five fingers means "numbers 1 to 5".

[0123] In practical applications, gesture recognition models face interference from complex environmental factors, including insufficient lighting, hand occlusion, and improper user posture, which may lead to decreased recognition accuracy or misjudgments. To address this, the system incorporates a multi-dimensional fault-tolerant processing mechanism in the gesture recognition process. Regarding lighting conditions, the system collects ambient lighting parameters in real time using a second camera. When the detected light intensity is below a preset threshold (e.g., 50 lux), it automatically triggers supplemental lighting logic. Regarding hand occlusion, the model employs a partial visibility inference strategy. When the number of visible key points reaches the minimum recognition requirement (e.g., at least 14 out of 21 key points are visible), it can still perform probabilistic inference based on visible features and output the corresponding confidence level. When the confidence level falls below a threshold (e.g., 80%), the system prompts the user to adjust their posture.

[0124] If the user's action in the second image is a sign language action, the system automatically activates the sign language recognition engine when it detects that the user is expressing themselves in sign language. The system then generates the corresponding semantics using the sign language recognition model and uses this semantics as the action description text for the image. The sign language recognition model can be a deep learning model, trained on a large dataset of sign language videos labeled with corresponding semantics.

[0125] After obtaining the action description text corresponding to the second image, the system uses it as the help request text information corresponding to the image acquisition control and displays it on the call application interface. When the system receives the user's second input on the action description text, it uses it as the target text information for subsequent sending processes, thereby improving the reliability of the interaction and preventing misidentification from causing the transmission of incorrect information.

[0126] For example, to further ensure the smooth operation of the interaction channel and the reliability of information transmission, after displaying the action description text corresponding to the second image on the call application interface, the communication method further includes: If no second input describing the action is received for a preset duration, at least one preset reply text will be displayed on the call application interface.

[0127] In some embodiments, after the system displays the action description text on the call application interface, it will start a timeout mechanism: During the timeout period, the system continuously listens to the user's input operations on the call application interface to determine whether a second input for the action description text has been received; if no second input for the action description text is received after a preset duration (e.g., 30 seconds), the system retrieves at least one preset reply text from the local machine, such as high-frequency phrases like "yes", "no", "okay", "help me", "danger", and "safe", and displays it on the call application interface. When the action recognition is inaccurate, the user can directly select from the preset reply text.

[0128] In addition, at least one preset reply text can also be triggered in another way: after receiving the user's first input to the image acquisition control, and after the user further performs a fifth input to the image acquisition control, the above-mentioned preset reply text is immediately displayed on the call application interface as a quick and selectable reply information for the user to choose from.

[0129] For example, Figure 8 As shown, Figure 8 Area 81 is used to display an image containing user actions; the left side of area 81 is used to display the action description text corresponding to the image, i.e., "My leg is injured"; below the action description text is used to display text information that has been sent or is about to be sent to the other end as target text information, as well as text information corresponding to the other end's voice data, where "Are you at home?" is the text information corresponding to the other end's voice data; "Gesture reply: Yes" is the target text information selected by our side; "Yes", "No", and "Okay" are preset reply texts; controls 881, 882, and 883 are all different alarm function controls, which can correspond to SOS control, location control, and image acquisition control, respectively.

[0130] S140, receive a second input for the target text information.

[0131] The target text information mentioned above is the help text information selected by the user from all the help text information corresponding to the displayed target function control; the second input is the selection and confirmation operation performed by the user on the target text information, which is used to trigger the text sending action.

[0132] For example, a user can directly click, long-press, or otherwise select a text request for help, thus confirming it as the target text message; or, a checkbox can be provided next to each text request for help, allowing the user to select one or more to confirm it as the target text message. Besides the above methods, other forms of second input may exist, and this embodiment does not limit them.

[0133] S150, in response to the second input, sends the help request information corresponding to the target text information to the other end corresponding to the emergency call.

[0134] Upon receiving a second input regarding the target text information, the electronic device responds to the second input by acquiring the distress information corresponding to the target text information and sending the distress information to the other end corresponding to the emergency call.

[0135] The request for help information corresponding to the target text information refers to the data carrier generated to convey the request for help to the other party. The specific form of the request for help information includes, but is not limited to: the original text data of the target text information itself, or the voice data converted from the target text information.

[0136] For example, sending the request for help corresponding to the target text information to the other end corresponding to the emergency call may include, but is not limited to, the following methods: based on the established emergency call link, sending the original text data of the target text information to the other end through the data channel; or, the operating system of the electronic device calls the text-to-speech engine to synthesize the target text information into speech data, and the synthesized speech data is transmitted to the other end in real time through the uplink voice channel of the emergency call, so that the other end can clearly hear the request for help that the user wants to express.

[0137] For example, to avoid users accidentally sending help requests, improve the accuracy of sending operations, and effectively reduce the risk of invalid help requests caused by misoperation, a secondary confirmation mechanism can be added to the dialog pop-up window. Specifically, S150 may include the following steps: In response to the second input, a first conversation pop-up is displayed on the call application interface; Receive the third input within the first dialog pop-up window; In response to the third input in the first dialog pop-up window, the help request information corresponding to the target text information is sent to the other end corresponding to the emergency call.

[0138] When a user performs a second input (such as clicking) on ​​a displayed emergency help text, the system treats it as the target text information but does not send it immediately. Instead, it triggers and displays a first dialog pop-up on the call application interface. The first dialog pop-up displays the message "Confirm sending this emergency help text" and provides clear operation options such as "Confirm" and "Cancel".

[0139] For example Figure 9 As shown, Figure 9 Area 91 in the text is the first dialog pop-up window. Figure 9 The top displays the call status information "110 emergency call in progress 00:56"; the text message "Hello, this is the 110 emergency service, what is the situation?" is the text information corresponding to the voice data from the other end; controls 991, 992 and 993 are different alarm function controls, which can be respectively SOS control, location control and image acquisition control.

[0140] Optionally, the "Confirm" option can be marked with a preset warning color (such as red), and the "Cancel" option can be set as the default focus option.

[0141] The system listens for and receives the user's third input within the first dialog pop-up window, i.e., the user's trigger action on the "Confirm" option. Upon receiving this third input, the system responds by sending a request for help corresponding to the target text information to the other end corresponding to the emergency call. The target text information can be one or more pieces of emergency request text. The input methods for the third input include, but are not limited to, clicking and long-pressing.

[0142] If the system does not receive any operation within the first dialog pop-up window for a certain period of time (e.g., 15 seconds) after displaying the first dialog pop-up window, or receives user input for the "Cancel" option, or receives user input for any location outside the first dialog pop-up window area, the system will close the first dialog pop-up window and cancel the current process of sending the help request information corresponding to the target text information.

[0143] This application embodiment displays an alarm function control on the call application interface when an emergency call is initiated, and sends the corresponding help text information to the other end based on the input operation of the control and the help text. This breaks through the limitations of traditional voice communication, ensures the user's ability to seek help in emergency call scenarios due to language barriers or environmental limitations, and enables the sending of help text information without voice interaction during emergency calls. At the same time, the help interaction is integrated into the call interface, thereby significantly improving the convenience, accuracy and efficiency of information transmission, and improving the smoothness of information communication during emergency calls.

[0144] It should be noted that the communication method provided in this application embodiment can be executed by a communication device or a processing module within that communication device for executing the communication method. This application embodiment uses the execution of the communication method by a communication device as an example to illustrate the communication device provided in this application embodiment.

[0145] Figure 10 This is a schematic diagram of the structure of a communication device provided in an embodiment of this application.

[0146] like Figure 10 As shown, the communication device 1000 is applied to an electronic device and may include: The control display module 1001 is used to display at least one alarm function control on the call application interface in response to an emergency call. The input receiving module 1002 is used to receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; Information display module 1003 is used to respond to the first input and display at least one help request text message corresponding to the target function control; The input receiving module 1002 is further configured to receive a second input for target text information, wherein the target text information is at least one of the help request text information; The information sending module 1004 is used to respond to the second input by sending the help request information corresponding to the target text information to the other end corresponding to the emergency call.

[0147] This application embodiment displays an alarm function control on the call application interface when an emergency call is initiated, and sends the corresponding help text information to the other end based on the input operation of the control and the help text. This breaks through the limitations of traditional voice communication, ensures the user's ability to seek help in emergency call scenarios due to language barriers or environmental limitations, and enables the sending of help text information without voice interaction during emergency calls. At the same time, the help interaction is integrated into the call interface, thereby significantly improving the convenience, accuracy and efficiency of information transmission, and improving the smoothness of information communication during emergency calls.

[0148] In some possible implementations of the embodiments of this application, the alarm function control includes at least one of an emergency help control, a positioning control, and an image acquisition control; The emergency help control is used to trigger the display of at least one emergency help text corresponding to the emergency help control on the call application interface; The positioning control is used to trigger the display of location information; The image acquisition control is used to trigger the camera on the electronic device to acquire an image and generate a description text corresponding to the image.

[0149] In some possible implementations of the embodiments of this application, the information sending module 1004 is specifically used for: In response to the second input, a first dialog pop-up is displayed on the call application interface; Receive the third input within the first dialog pop-up window; In response to a third input within the first dialog pop-up window, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call, wherein the target text information is at least one of the emergency help request texts.

[0150] In some possible implementations of the embodiments of this application, the information display module 1003 is specifically used for: In response to a first input to the location control, if the location information from multiple location sources is not missing, a help request text corresponding to the location information from the multiple location sources is displayed on the call application interface.

[0151] In some possible implementations of the embodiments of this application, the information display module 1003 is specifically used for: In response to a first input to the positioning control, if location information is missing from multiple positioning sources, a second dialog pop-up is displayed on the call application interface. Receive the fourth input within the second dialog pop-up window; In response to the fourth input within the second dialog pop-up, acquire the target image; The call application interface displays a help request text message corresponding to at least one location information corresponding to the target image.

[0152] In some possible implementations of the embodiments of this application, the information display module 1003 is specifically used for: In response to a first input to the image acquisition control, a first image of the user's environment is acquired via a first camera on the electronic device; Display scene description text corresponding to the first image on the call application interface; or In response to a first input to the image acquisition control, a second image containing the user's actions is acquired via a second camera on the electronic device; The action description text corresponding to the second image is displayed on the call application interface.

[0153] In some possible implementations of the embodiments of this application, the information display module 1003 is further configured to display at least one preset reply text on the call application interface if no second input for the action description text is received for a preset duration.

[0154] The communication device in this application embodiment can be a device or a component in an electronic device, such as an integrated circuit or a chip. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0155] The electronic device in this application embodiment can be a terminal with an operating system. The operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system.

[0156] The communication device provided in this application embodiment can achieve... Figures 1 to 9 The various processes in the communication method embodiments can achieve the same technical effect, and will not be described again here to avoid repetition.

[0157] like Figure 11 As shown, this application embodiment also provides an electronic device 1100, including a processor 1101 and a memory 1102. The memory 1102 stores programs or instructions that can run on the processor 1101. When the program or instructions are executed by the processor 1101, they implement the various steps of the above-described communication method embodiments and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0158] It should be noted that the electronic devices in the embodiments of this application include the mobile terminals and non-mobile terminals mentioned above.

[0159] Figure 12 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0160] The electronic device 1200 includes, but is not limited to, components such as: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210.

[0161] Those skilled in the art will understand that the electronic device 1200 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1210 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 12 The structure of the electronic device 1200 shown does not constitute a limitation on the electronic device 1200. The electronic device 1200 may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be described in detail here.

[0162] The processor 1210 is used to display at least one alarm function control on the call application interface in response to an emergency call. Receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; In response to the first input, at least one help request text message corresponding to the target function control is displayed; Receive a second input for target text information, wherein the target text information is at least one of the help request text information; In response to the second input, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call.

[0163] This application embodiment displays an alarm function control on the call application interface when an emergency call is initiated, and sends the corresponding help text information to the other end based on the input operation of the control and the help text. This breaks through the limitations of traditional voice communication, ensures the user's ability to seek help in emergency call scenarios due to language barriers or environmental limitations, and enables the sending of help text information without voice interaction during emergency calls. At the same time, the help interaction is integrated into the call interface, thereby significantly improving the convenience, accuracy and efficiency of information transmission, and improving the smoothness of information communication during emergency calls.

[0164] In some possible implementations of the embodiments of this application, the processor 1210 is further configured to display a first dialog pop-up on the call application interface in response to the second input; Receive the third input within the first dialog pop-up window; In response to a third input within the first dialog pop-up window, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call, wherein the target text information is at least one of the emergency help request texts.

[0165] In some possible implementations of this application, the processor 1210 is further configured to, in response to a first input to the positioning control, display help text information corresponding to the location information of the multiple positioning sources on the call application interface, provided that the location information from all multiple positioning sources is not missing.

[0166] In some possible implementations of the embodiments of this application, the processor 1210 is further configured to, in response to a first input to the positioning control, display a second dialog pop-up on the call application interface when location information is missing among multiple positioning sources; Receive the fourth input within the second dialog pop-up window; In response to the fourth input within the second dialog pop-up, acquire the target image; The call application interface displays a help request text message corresponding to at least one location information corresponding to the target image.

[0167] In some possible implementations of embodiments of this application, the processor 1210 is further configured to, in response to a first input to the image acquisition control, acquire a first image of the user's environment via a first camera on the electronic device; Display scene description text corresponding to the first image on the call application interface; or In response to a first input to the image acquisition control, a second image containing the user's actions is acquired via a second camera on the electronic device; The action description text corresponding to the second image is displayed on the call application interface.

[0168] In some possible implementations of the embodiments of this application, the processor 1210 is further configured to display at least one preset reply text on the call application interface if no second input for the action description text is received for a preset duration.

[0169] It should be understood that, in this embodiment, the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042. The GPU 12041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1206 may include a display panel 12061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0170] The memory 1209 can be used to store software programs and various data. The memory 1209 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1209 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1209 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0171] Processor 1210 may include one or more processing units; optionally, processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1210.

[0172] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described communication method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0173] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0174] This application also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described communication method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0175] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0176] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the communication method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0177] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0178] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the related technology, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0179] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A communication method, characterized in that, Performed by an electronic device, the method includes: In response to an emergency call, at least one alarm function control is displayed on the call application interface; Receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; In response to the first input, at least one help request text message corresponding to the target function control is displayed; Receive a second input for target text information, wherein the target text information is at least one of the help request text information; In response to the second input, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call.

2. The method according to claim 1, characterized in that, The alarm function control includes at least one of the following: emergency help control, location control, and image acquisition control; The emergency help control is used to trigger the display of at least one emergency help text corresponding to the emergency help control on the call application interface; The positioning control is used to trigger the display of location information; The image acquisition control is used to trigger the camera on the electronic device to acquire an image and generate a description text corresponding to the image.

3. The method according to claim 2, characterized in that, In response to the second input, sending a help request corresponding to the target text information to the other end corresponding to the emergency call includes: In response to the second input, a first dialog pop-up is displayed on the call application interface; Receive the third input within the first dialog pop-up window; In response to a third input within the first dialog pop-up window, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call, wherein the target text information is at least one of the emergency help request texts.

4. The method according to claim 2, characterized in that, The step of responding to the first input by displaying at least one help-seeking text message corresponding to the target function control includes: In response to a first input to the location control, if the location information from multiple location sources is not missing, a help request text corresponding to the location information from the multiple location sources is displayed on the call application interface.

5. The method according to claim 2, characterized in that, The step of responding to the first input by displaying at least one help-seeking text message corresponding to the target function control includes: In response to a first input to the positioning control, if location information is missing from multiple positioning sources, a second dialog pop-up is displayed on the call application interface. Receive the fourth input within the second dialog pop-up window; In response to the fourth input within the second dialog pop-up, acquire the target image; The call application interface displays a help request text message corresponding to at least one location information corresponding to the target image.

6. The method according to claim 2, characterized in that, The step of responding to the first input by displaying at least one help-seeking text message corresponding to the target function control includes: In response to a first input to the image acquisition control, a first image of the user's environment is acquired via a first camera on the electronic device; Display scene description text corresponding to the first image on the call application interface; or In response to a first input to the image acquisition control, a second image containing the user's actions is acquired via a second camera on the electronic device; The action description text corresponding to the second image is displayed on the call application interface.

7. The method according to claim 6, characterized in that, After displaying the action description text corresponding to the second image on the call application interface, the method further includes: If no second input describing the action is received for a preset duration, at least one preset reply text is displayed on the call application interface.

8. A communication device, characterized in that, Applied to electronic devices, the device includes: The control display module is used to display at least one alarm function control on the call application interface in response to an emergency call. An input receiving module is configured to receive a first input to a target function control, wherein the target function control is at least one of the alarm function controls; The information display module is used to respond to the first input and display at least one help request text message corresponding to the target function control; The input receiving module is further configured to receive a second input for target text information, wherein the target text information is at least one of the help request text information; The information sending module is used to respond to the second input by sending the help request information corresponding to the target text information to the other end corresponding to the emergency call.

9. The apparatus according to claim 8, characterized in that, The alarm function control includes at least one of the following: emergency help control, location control, and image acquisition control; The emergency help control is used to trigger the display of at least one emergency help text corresponding to the emergency help control on the call application interface; The positioning control is used to trigger the display of location information; The image acquisition control is used to trigger the camera on the electronic device to acquire an image and generate a description text corresponding to the image.

10. The apparatus according to claim 9, characterized in that, The information sending module is specifically used for: In response to the second input, a first dialog pop-up is displayed on the call application interface; Receive the third input within the first dialog pop-up window; In response to a third input within the first dialog pop-up window, a help request information corresponding to the target text information is sent to the other end corresponding to the emergency call, wherein the target text information is at least one of the emergency help request texts.

11. The apparatus according to claim 9, characterized in that, The information display module is specifically used for: In response to a first input to the location control, if the location information from multiple location sources is not missing, a help request text corresponding to the location information from the multiple location sources is displayed on the call application interface.

12. The apparatus according to claim 9, characterized in that, The information display module is specifically used for: In response to a first input to the positioning control, if location information is missing from multiple positioning sources, a second dialog pop-up is displayed on the call application interface. Receive the fourth input within the second dialog pop-up window; In response to the fourth input within the second dialog pop-up, acquire the target image; The call application interface displays a help request text message corresponding to at least one location information corresponding to the target image.

13. The apparatus according to claim 9, characterized in that, The information display module is specifically used for: In response to a first input to the image acquisition control, a first image of the user's environment is acquired via a first camera on the electronic device; The scene description text corresponding to the first image is displayed on the call application interface; or In response to a first input to the image acquisition control, a second image containing the user's actions is acquired via a second camera on the electronic device; The action description text corresponding to the second image is displayed on the call application interface.

14. The apparatus according to claim 13, characterized in that, The information display module is also used to display at least one preset reply text on the call application interface if no second input for the action description text is received for a preset duration.

Images