Information output method and device

Abstract

The invention discloses an information output method and device, and belongs to the technical field of electronic equipment. The information output method comprises the steps that a first interface is displayed, the first interface comprises a first area and a second area, a character identifier is displayed in the first area, and the second area is used for obtaining information input by a user; under the condition that first information is obtained through the second area, information output operation is executed, and the information output operation comprises any one of the following items: sign language information corresponding to the first information is output through a character identifier, and the first information is voice information or text information; and outputting voice information or text information corresponding to first information, wherein the first information is sign language information.

Description

Technical Field

[0001] This application belongs to the technical field of electronic devices, and particularly relates to an information output method and apparatus. Background Art

[0002] With the continuous development of electronic device technology, current electronic devices can provide various functions to meet the needs of hearing-impaired users. For example, when a hearing-impaired user communicates with a hearing-normal user, the hearing-impaired user can use the electronic device to input text for the hearing-normal user to view, while the hearing-normal user can use the electronic device to input speech and convert the speech into text through the speech-to-text function of the electronic device for the hearing-impaired user to view.

[0003] However, since some hearing-impaired users may have difficulties in spelling, have little or no literacy, it will bring obstacles to the communication between hearing-impaired users and hearing-normal users and information recording. Thus, the way of realizing information interaction of hearing-impaired users through electronic devices is not flexible enough. Summary of the Invention

[0004] The purpose of the embodiments of this application is to provide an information output method and apparatus, which can realize information interaction of hearing-impaired users through an electronic device, and improve the flexibility of the interaction method and the human-computer interaction performance.

[0005] In a first aspect, the embodiments of this application provide an information output method applied to an electronic device. The information output method includes: displaying a first interface, the first interface includes a first area and a second area, the first area displays a character identifier, and the second area is used to obtain information input by a user; in the case where a first piece of information is obtained through the second area, performing an information output operation, the information output operation includes any one of the following: outputting sign language information corresponding to the first piece of information through the character identifier, where the first piece of information is speech information or text information; outputting the speech information or text information corresponding to the first piece of information, where the first piece of information is sign language information.

[0006] In a second aspect, the embodiments of this application provide an information output apparatus. The information output apparatus includes: a display module and a processing module; the display module is used to display a first interface, the first interface includes a first area and a second area, the first area displays a character identifier, and the second area is used to obtain information input by a user; the processing module is used to perform an information output operation in the case where a first piece of information is obtained through the second area, and the information output operation includes any one of the following: outputting sign language information corresponding to the first piece of information through the character identifier, where the first piece of information is speech information or text information; outputting the speech information or text information corresponding to the first piece of information, where the first piece of information is sign language information.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores a program or instructions that can run on the processor. When the program or instructions are executed by the processor, the steps of the information output method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instructions are stored. When the program or instructions are executed by a processor, the steps of the information output method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run a program or instructions to implement the information output method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program / program product, which is stored in a storage medium. The program / program product is executed by at least one processor to implement the information output method described in the first aspect.

[0011] In an embodiment of the present application, the electronic device can display a first interface, which includes a first area and a second area. The first area displays a person identifier, and the second area is used to obtain information input by the user. Thus, when the first information is obtained through the second area, an information output operation is performed. The information output operation includes any one of the following: outputting sign language information corresponding to the first information through the person identifier, where the first information is voice information or text information; outputting voice information or text information corresponding to the first information, where the first information is sign language information. In this solution, since the second area can obtain information input by the user, that is, the user can input information through the second area, including voice information, text information, or sign language information. Thus, after the electronic device obtains the information input by the user through the second area, in one case, the electronic device can convert the voice information or text information input by the user into sign language information and output the corresponding sign language information through the person identifier, so that some special users, such as hearing-impaired users, can timely and efficiently obtain the required information. In another case, the electronic device can convert the sign language information input by the user into voice information or text information and output the voice information or text information corresponding to the first information, so that some special users, such as hearing-impaired users, can timely and efficiently express the required information through gestures. In this way, the information interaction of hearing-impaired users can be realized through the electronic device, improving the flexibility of the interaction method and the human-computer interaction performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is one of the flowcharts of the information output method provided by the embodiment of the present application;

[0013] Figure 2 It is the second flowchart of the information output method provided by the embodiments of the present application;

[0014] Figure 3 It is one of the schematic diagrams of the information interaction interface provided by the embodiments of the present application;

[0015] Figure 4 It is the third flowchart of the information output method provided by the embodiments of the present application;

[0016] Figure 5 It is the second schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0017] Figure 6 It is the third schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0018] Figure 7 It is the fourth flowchart of the information output method provided by the embodiments of the present application;

[0019] Figure 8 It is the fourth schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0020] Figure 9 It is the fifth schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0021] Figure 10 It is the fifth flowchart of the information output method provided by the embodiments of the present application;

[0022] Figure 11 It is the sixth schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0023] Figure 12 It is the seventh schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0024] Figure 13 It is the eighth schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0025] Figure 14 It is the ninth schematic diagram of the information interaction interface provided by the embodiments of the present application;

[0026] Figure 15 It is one of the schematic diagrams of the structure of the information output device provided by the embodiments of the present application;

[0027] Figure 16 It is the second schematic diagram of the structure of the information output device provided by the embodiments of the present application;

[0028] Figure 17 It is the third schematic diagram of the structure of the information output device provided by the embodiments of the present application;

[0029] Figure 18 It is one of the schematic diagrams of the hardware structure of the electronic device provided by the embodiments of the present application;

[0030] Figure 19 It is the second of the schematic diagrams of the hardware structure of the electronic device provided by the embodiments of the present application. Specific embodiments

[0031] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0032] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means an "or" relationship between the associated objects before and after.

[0033] The terms "at least one (item)", "at least one of", etc. in the specification and claims of the present application refer to any one, any two or more combinations of the objects it contains. For example, at least one (item) of a, b, and c can represent: "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" means two or more, and its meaning is similar to that of "at least one (item)".

[0034] Next, the information output method provided by the embodiments of the present application will be described in detail in conjunction with the accompanying drawings, through specific embodiments and their application scenarios.

[0035] The information output method in the embodiments of this application can be applied to scenarios where users use electronic devices for information interaction. For example, it can be specifically applied to scenarios where users use electronic devices for face-to-face information interaction or communication, or scenarios where users use the phone application of electronic devices for information interaction or communication, or scenarios where users use the instant messaging application of electronic devices for information interaction or communication, or scenarios where users use other applications of electronic devices for information interaction, such as the other application can be any application in electronic devices such as short message applications, note applications, news applications or shopping applications, etc.

[0036] The following takes some specific scenarios as examples to exemplarily illustrate the information output method provided by the embodiments of this application.

[0037] Scenario 1: A scenario where a user uses an electronic device for face-to-face information interaction or communication:

[0038] Exemplarily, taking a hearing-impaired user and a hearing-normal user as an example, assume that the hearing-impaired user wants to express the information he wants to express to the hearing-normal user face-to-face and obtain the information expressed by the hearing-normal user. Then the hearing-impaired user or the hearing-normal user can trigger the electronic device to display a first interface. The first area displays a person identifier, and the second area is used to obtain information input by the user. When the hearing-impaired user expresses the information he wants to express to the hearing-normal user, the hearing-impaired user can perform sign language actions. At this time, the electronic device can turn on the camera through the second area to collect the sign language actions of the hearing-impaired user, and convert the collected sign language actions into text information or voice information to output the text information or voice information to the user. Thus, the hearing-normal user can obtain the information expressed by the hearing-impaired user through the text information or voice information output by the electronic device; correspondingly, when the hearing-normal user expresses the information he wants to express to the hearing-impaired user, the hearing-normal user can input text information or voice information through the second area. At this time, the electronic device can convert the text information or voice information into sign language information and output the sign language information through the person identifier in the first area. Thus, the hearing-impaired user can obtain the information expressed by the hearing-normal user through the sign language information output by the person identifier. In this way, the way for the hearing-impaired user and the hearing-normal user to interact information face-to-face is more efficient and flexible.

[0039] Scenario 2: A scenario where a user uses the phone application or instant messaging application of an electronic device for information interaction or communication:

[0040] Exemplarily, taking a hearing-impaired user and a hearing-normal user as an example, assume that the hearing-impaired user wants to express the information he / she wants to convey and learn the information expressed by the hearing-normal user during a phone call or an instant messaging call (such as a voice call or a video call). Then the hearing-impaired user can trigger the electronic device 1 to display a first interface. The first area displays a person identifier, and the second area is used to obtain the information input by the user. And the second area displays the interface of the phone call or the instant messaging call. When the hearing-impaired user wants to convey the information he / she wants to express to the hearing-normal user, the hearing-impaired user can make sign language gestures. At this time, the electronic device 1 can turn on the camera through the second area to collect the sign language gestures of the hearing-impaired user, and convert the collected sign language gestures into voice information, so as to send the voice information to the electronic device 2 of the hearing-normal user through the ongoing phone call or instant messaging call. Thus, the hearing-normal user can learn the information expressed by the hearing-impaired user through sign language gestures through the voice information received by the electronic device 2; correspondingly, when the hearing-normal user wants to convey the information he / she wants to express to the hearing-impaired user, the hearing-normal user can speak directly. After the electronic device 2 collects the speech content (i.e., voice information) of the hearing-normal user, it can send the voice information to the electronic device 1 through the ongoing phone call or instant messaging call. Then the electronic device 1 can receive the voice information through the phone call or instant messaging call application in the second area. At this time, the electronic device 1 can convert the voice information into sign language information, and output the sign language information through the person identifier in the first area. Thus, the hearing-impaired user can learn the information expressed by the hearing-normal user through the sign language information output by the person identifier. In this way, the way for the hearing-impaired user and the hearing-normal user to interact information through the phone application or the instant messaging application is more efficient and flexible.

[0041] Scenario 3: The scenario where the user uses other applications of the electronic device for information interaction:

[0042] Exemplarily, taking a hearing-impaired user using a note application on an electronic device as an example, assume that the hearing-impaired user wants to use the note application on the electronic device to record the information they want to express and obtain the information recorded in the interface of the note application. Then, the hearing-impaired user can trigger the electronic device to display a first interface. The first area displays a human figure icon, and the second area is used to obtain the information input by the user. When the hearing-impaired user uses the note application on the electronic device to record the information they want to express, the hearing-impaired user can trigger the first area to display the interface of the note application, so that the hearing-impaired user can perform sign language actions. At this time, the electronic device can turn on the camera through the second area to collect the sign language actions of the hearing-impaired user, and convert the collected sign language actions into text information or voice information, and at the same time record the text information or voice information into the note application, so that the hearing-impaired user can record the information expressed by the sign language actions through the electronic device; correspondingly, when the hearing-impaired user uses the note application on the electronic device and wants to obtain the information recorded in the interface of the note application, the hearing-impaired user can trigger the electronic device to display the interface of the note application in the second area, so that the hearing-impaired user can drag the text information or voice information from the interface of the note application to the first area. At this time, the electronic device can convert the text information or voice information into sign language information, and output the sign language information through the human figure icon in the first area, so that the hearing-impaired user can obtain the information recorded in the interface of the note application through the sign language information output by the human figure icon.

[0043] In the solution provided in the embodiment of the present application, the electronic device can display a first interface. The first interface includes a first area and a second area. The first area displays a human figure icon, and the second area is used to obtain the information input by the user. Thus, in the case where the first information is obtained through the second area, an information output operation is performed. The information output operation includes any one of the following: outputting sign language information corresponding to the first information through the human figure icon, where the first information is voice information or text information; outputting voice information or text information corresponding to the first information, where the first information is sign language information. In this solution, since the second area can obtain the information input by the user, that is, the user can input information through the second area, including voice information, text information or sign language information. Thus, after the electronic device obtains the information input by the user through the second area, in one case, the electronic device can convert the voice information or text information input by the user into sign language information, and output the corresponding sign language information through the human figure icon, so that some special users, such as hearing-impaired users, can timely and efficiently obtain the required information. In another case, the electronic device can convert the sign language information input by the user into voice information or text information, and output the voice information or text information corresponding to the first information, so that some special users, such as hearing-impaired users, can timely and efficiently express the required information through gestures. In this way, the information interaction of hearing-impaired users can be realized through the electronic device, and the flexibility of the interaction method and the human-computer interaction performance are improved.

[0044] The execution subject of the information output method provided by the embodiments of the present application may be an information output device, which may be an electronic device, or a functional module or entity in the electronic device. Hereinafter, taking an electronic device as an example, the technical solution provided by the embodiments of the present application will be described.

[0045] The embodiments of the present application provide an information output method. Figure 1 The flowchart of an information output method provided by the embodiments of the present application is shown. This method can be applied to an electronic device. As Figure 1 shown, the information output method provided by the embodiments of the present application may include the following steps 201 and 202.

[0046] Step 201: The electronic device displays a first interface.

[0047] In the embodiments of the present application, the above first interface may include a first area and a second area. The first area displays a character identifier, and the second area is used to obtain information input by the user.

[0048] In the embodiments of the present application, the electronic device may display the first interface on the desktop, or may display the first interface on any application interface. Specifically, it is determined according to actual usage requirements, and the embodiments of the present application do not make restrictions.

[0049] In the embodiments of the present application, the above first interface may be a functional interface or an application interface in the electronic device. The functional interface or application interface has the function of being able to recognize the information input by the user and convert it into other forms of information. For example, the functional interface or application interface has the function of being able to recognize the voice information or text information input by the user, etc., and convert it into sign language information. Or, the functional interface or application interface has the function of being able to recognize the sign language information input by the user and convert it into voice information or text information.

[0050] Exemplarily, the above functional interface may be an interface of a component that can recognize the information input by the user. The above application interface may be an interface of an application program that can recognize the information input by the user.

[0051] For example, the user can trigger to open an application program that can recognize the information input by the user, so that the electronic device displays the first interface, so that the user can input information through the second area in the first interface.

[0052] Optionally, in the embodiments of the present application, the electronic device may be a single-screen electronic device, that is, the electronic device includes a single screen. The above first area may be the upper half screen area of the electronic device screen, and the above second area may be the lower half screen area of the electronic device screen, and vice versa. Or, the above first area may be the left half screen area of the electronic device screen, and the above second area may be the right half screen area of the electronic device screen, and vice versa.

[0053] Optionally, in the embodiments of the present application, the electronic device may be a large-screen electronic device. For example, the large-screen electronic device may be a foldable-screen electronic device, and the foldable screen may be a two-fold, three-fold, or other types of foldable screens. The above-mentioned first area may be an area in one screen of the foldable screen of the electronic device, and the above-mentioned second area may be an area in another screen of the foldable screen of the electronic device. Alternatively, the above-mentioned first area and second area may be different areas in one screen of the foldable screen of the electronic device, and the different areas may be the upper half screen area and the lower half screen area in the one screen, or may be the left half screen area and the right half screen area in the one screen.

[0054] It should be noted that the sizes of the above-mentioned first area and second area in the electronic device screen may be the same or different. The shapes of the above-mentioned first area and second area in the electronic device screen may be any shape, such as a square or a rectangle.

[0055] In the embodiments of the present application, the above-mentioned character identifier may be used to represent the voice information, text information, etc. input by the user in the form of actions.

[0056] Optionally, in the embodiments of the present application, the above-mentioned character identifier may be a virtual person capable of displaying sign language information, or an animated character, or other forms of identifiers. Specifically, it can be set according to actual usage requirements, and the embodiments of the present application do not make restrictions.

[0057] Optionally, in the embodiments of the present application, the above-mentioned character identifier may be the character identifier default in the electronic device system, or may be the character identifier customized by the user according to usage requirements.

[0058] In the embodiments of the present application, the above-mentioned second area may obtain various types of information input by the user, such as text information, voice information, or sign language information, etc.

[0059] Optionally, in the embodiments of the present application, the above-mentioned second area may display any interface, and the any interface includes an input method keyboard. The user can input text information through the input method keyboard, so that the electronic device obtains the text information input by the user through the second area.

[0060] Optionally, in the embodiments of the present application, the above-mentioned second area may display any interface, and the any interface includes a voice input control. The user can input voice information through the voice input control, so that the electronic device obtains the voice information input by the user through the second area.

[0061] Optionally, in the embodiments of the present application, any application interface may be displayed in the second region. When the application corresponding to the any application interface receives the user's voice information, the voice information may be a voice message or voice call content, and the electronic device may obtain the voice information received by the application through the second region. It should be noted that the voice call content may be the voice call content of a telephone call or the voice call content of an instant messaging call.

[0062] Optionally, in the embodiments of the present application, any interface may be displayed in the second region, and the any interface includes a shooting preview window. The electronic device may collect the user's sign language actions through the shooting preview window in the second region to obtain sign language information.

[0063] Step 202: When the electronic device obtains the first information through the second region, perform an information output operation.

[0064] In the embodiments of the present application, the information output operation may include any one of the following:

[0065] Output the sign language information corresponding to the first information through a character identifier, where the first information is voice information or text information;

[0066] Output the voice information or text information corresponding to the first information, where the first information is sign language information.

[0067] In the embodiments of the present application, the electronic device may perform the information output operation in the first region. Alternatively, the electronic device may perform the information output operation in the second region. Or the electronic device may perform the information output operation in the first region and the second region.

[0068] It can be understood that at least one of the first region and the second region may perform the information output operation.

[0069] It should be noted that for the specific implementation manner of the electronic device performing the information output operation in at least one of the first region and the second region, reference may be made to the specific description in the following embodiments, which will not be elaborated here.

[0070] Optionally, in the embodiments of the present application, when the electronic device obtains the text information input by the user through the second region, the electronic device may output the sign language information corresponding to the text information through a character identifier.

[0071] Optionally, in the embodiments of the present application, when the electronic device obtains the voice information input by the user through the second region, the electronic device may output the sign language information corresponding to the voice information through a character identifier.

[0072] Optionally, in the embodiments of the present application, when the electronic device obtains the voice information received by the application through the second area, the electronic device may output the sign language information corresponding to the voice information through the character identifier.

[0073] Optionally, in the embodiments of the present application, when the electronic device collects the sign language actions of the user through the shooting preview window in the second area to obtain sign language information, the electronic device may output the voice information or text information corresponding to the sign language information.

[0074] It should be noted that for the specific implementation manner of performing the information output operation when the first information is obtained in the second area as described above, reference may be made to the specific description in the following embodiments, which will not be elaborated here.

[0075] In the information output method provided by the embodiments of the present application, since the second area can obtain the information input by the user, that is, the user can input information through the second area, including voice information, text information or sign language information. Therefore, after the electronic device obtains the information input by the user through the second area, in one case, the electronic device may convert the voice information or text information input by the user into sign language information and output the corresponding sign language information through the character identifier, so that some special users, such as hearing-impaired users, can timely and efficiently obtain the required information. In another case, the electronic device may convert the sign language information input by the user into voice information or text information and output the voice information or text information corresponding to the first information, so that some special users, such as hearing-impaired users, can timely and efficiently express the required information through gestures. In this way, the electronic device can realize the information interaction of hearing-impaired users and improve the flexibility of the interaction method and the human-computer interaction performance.

[0076] Optionally, in the embodiments of the present application, in combination with Figure 1 , such as Figure 2 shown, step 202 above may be specifically implemented through the following step 202a.

[0077] Step 202a: When the electronic device receives the first information input by the user in the second area, it outputs the sign language information corresponding to the first information through the character identifier and displays the text information corresponding to the first information in the second area.

[0078] In the embodiments of the present application, the first information in step 202a above may be voice information or text information.

[0079] In the embodiments of the present application, when the first information in step 202a above is voice information, the electronic device may output the sign language information corresponding to the voice information through the character identifier and convert the voice information into text information to display the text information in the second area.

[0080] In an embodiment of the present application, the second area of the electronic device includes at least one of the following: an input method keyboard and a voice input control. Thus, the user can input text information in the second area through the input method keyboard. Alternatively, the user can input voice information in the second area through the voice input control.

[0081] Exemplarily, taking the scenario where a hearing-impaired user and a hearing-normal user interact face-to-face as an example, and taking the electronic device as a mobile phone as an example for illustration. As Figure 3 shown, the mobile phone displays a first interface 10, which includes a first area 11 and a second area 12. The first area 11 displays a person identifier 13, and the second area 12 includes an input method keyboard 14 and a voice input control 15. Then, the user (such as a hearing-normal user) can input text information in the second area 12 through the input method keyboard 14, such as "The weather is really nice today. Do you want to go out and play together", or the user (such as a hearing-normal user) can input voice information in the second area through the voice input control, such as a 10s voice message "The weather is really nice today. Do you want to go out and play together", so that the mobile phone can output sign language information corresponding to the text information or voice message "The weather is really nice today. Do you want to go out and play together" through the person identifier 13, and display the text information "The weather is really nice today. Do you want to go out and play together" in the second area 12. Thus, the hearing-impaired user can obtain the information expressed by the hearing-normal user through the sign language information output by the person identifier 13 and the text information displayed in the second area 12.

[0082] In an embodiment of the present application, after receiving the text information input by the user in the second area, the electronic device can perform semantic and syntactic parsing on the text information, extract the keywords in the text information, and combine with a sign language information library to convert the keywords into sign language information.

[0083] In an embodiment of the present application, after receiving the voice information input by the user in the second area, the electronic device can convert the voice information into text information, then perform semantic and syntactic parsing on the text information, extract the keywords in the text information, and combine with a sign language information library to convert the keywords into sign language information.

[0084] In this way, the electronic device can convert the text information or voice information input by the user into sign language information, and display the sign language information through the person identifier, which is convenient for the hearing-impaired user to obtain the information expressed by other users in a timely and efficient manner. In this way, the information interaction of the hearing-impaired user can be realized through the electronic device, and the flexibility of the interaction method and the human-computer interaction performance are improved.

[0085] It can be understood that a hearing-normal user can input voice information through the second area of the electronic device, so that the electronic device can express the voice information in the form of sign language using a person identifier. In this way, the text information converted from the voice of the hearing-normal user can be converted into sign language information again through the person identifier and expressed to the hearing-impaired user through sign language actions, which is convenient for the hearing-impaired user to understand the information that the hearing-normal user wants to express when they are more familiar with sign language but not with text. In addition, while the electronic device displays sign language information through the person identifier, it can also display the text information converted from the speech of the hearing-normal user in the second area, further realizing the intuitive display of the information that the hearing-normal user wants to express to the user through text.

[0086] Optionally, in the embodiments of the present application, in combination with Figure 1 , as Figure 4 shown, the above step 202 can be specifically implemented through the following step 202b.

[0087] Step 202b: When the electronic device collects the first information through a phone application or an instant messaging application, it outputs the sign language information corresponding to the first information through the person identifier and displays the text information corresponding to the first information in the first area.

[0088] In the embodiments of the present application, the first information in the above step 202b can be voice information.

[0089] In the embodiments of the present application, the second area of the electronic device displays the interface of the phone application or the instant messaging application, that is, the electronic device is currently in a phone call or an instant messaging call. When the electronic device receives voice information through the ongoing phone call or instant messaging call, that is, when the electronic device collects the first information through the phone application or the instant messaging application, the electronic device can output the sign language information corresponding to the first information through the person identifier and display the text information corresponding to the first information in the first area.

[0090] Exemplarily, taking the scenario where a hearing-impaired user and a hearing-normal user interact through a phone call as an example for illustration. As Figure 5 shown, the mobile phone displays the first interface 10, which includes a first area 11 and a second area 12. The first area 11 displays a person identifier 13, and the second area 12 includes the interface of the phone call. Then, when the mobile phone receives the voice information "Remember to attend the meeting on time this afternoon" through the ongoing phone call or instant messaging call, the mobile phone can output the sign language information corresponding to the voice information through the person identifier 13 and display the text information corresponding to the voice information "Remember to attend the meeting on time this afternoon" in the first area 11. Thus, the hearing-impaired user can learn the information expressed by the hearing-normal user through the sign language information output by the person identifier 13 and the text information displayed in the first area 11.

[0091] Optionally, in the embodiments of the present application, a shooting preview interface or a shooting preview window is displayed in the second area of the electronic device. After the electronic device receives an incoming call request or an instant messaging request, the electronic device may switch the shooting preview interface or the shooting preview window to a phone application or an instant

[0092] Optionally, in the embodiments of the present application, the user may switch the interface of the phone application or the instant messaging application displayed in the second area back to the shooting preview interface or the shooting preview window, so as to facilitate the hearing-impaired user to input their sign language information in real time through the shooting preview interface or the shooting preview window, and then cause the electronic device to convert the sign language information into voice information, and finally send the voice information to the speaker on the other end of the ongoing phone call or instant messaging call, completing the barrier-free communication between the hearing-impaired user and the speaker on the other end.

[0093] Optionally, in the embodiments of the present application, the user may actively switch the display front-back relationship between the shooting preview interface and the call interface (i.e., the interface of the phone application or the instant messaging application), actively switch the shooting preview interface to the foreground display, and display a call prompt window in the form of a corner mark on the shooting preview interface. The call prompt window is used to prompt that the phone call or instant messaging call is in progress.

[0094] Exemplarily, in combination with Figure 5 as shown, Figure 6 as shown, the user may switch the interface of the phone call in the second area 12 to the shooting preview interface 16, and display a phone call prompt window in the form of a corner mark (such as the upper left corner mark) on the shooting preview interface 16, such as a prompt window of "talking to user A". Thus, the hearing-impaired user may make sign language movements. At this time, the electronic device may collect the sign language movements of the hearing-impaired user through the shooting preview interface 16 to obtain sign language information, and then convert the sign language information into voice information to send the voice information to the speaker on the other end through the ongoing phone call, and display the text information corresponding to the sign language information "Okay, received, I will attend on time" in the second area 12. In this way, after the hearing-impaired user learns the information expressed by the speaker on the other end of the ongoing phone call through the person identifier, the hearing-impaired user may flexibly switch the call interface in the second area to the shooting preview interface, so as to facilitate the hearing-impaired user to input sign language information through the shooting preview interface, and cause the electronic device to send the voice information corresponding to the sign language information to the speaker on the other end through the ongoing phone call, so that the information interaction between the hearing-impaired user and the hearing-normal user during the call can be realized.

[0095] In this way, when the user uses the phone application or the instant messaging application, the electronic device can collect voice information through the phone application or the instant messaging application. After the electronic device obtains the voice information, it outputs sign language information corresponding to the voice information through the person identifier, and displays the text information corresponding to the first information in the first area. That is, when the user uses the call function of the phone application or the instant messaging application, the electronic device can obtain the information expressed by the user of the opposite electronic device, so that some special users, such as hearing-impaired users, can timely and efficiently obtain the required information.

[0096] Optionally, in the embodiments of the present application, in combination with Figure 1 , as Figure 7 shown, the above step 202 can be specifically implemented by the following step 202c.

[0097] Step 202c: When the electronic device collects the first information corresponding to the user's gesture action in the second area through the camera, display the text information or voice identifier corresponding to the first information in the second area.

[0098] In the embodiments of the present application, the above voice identifier is used to play the voice information corresponding to the first information.

[0099] In the embodiments of the present application, the first information in the above step 202c may be sign language information.

[0100] In the embodiments of the present application, the second area of the electronic device displays a shooting preview window or a shooting preview interface. When the electronic device collects the user's gesture action (which can also be called the user's sign language action) through the shooting preview window or the shooting preview interface, that is, when the electronic device collects the sign language information corresponding to the user's gesture action through the camera, the electronic device can display the text information or voice identifier corresponding to the sign language information in the second area.

[0101] In the embodiments of the present application, the above shooting preview window or shooting preview interface may be the shooting interface of the camera application, or may be the shooting interface of other applications with shooting functions. Specifically, it may be the shooting interface of the application default in the electronic device system, or may be the shooting interface of the application pre-opened by the user.

[0102] Optionally, in the embodiments of the present application, the above second area includes a sign language input icon, and the sign language input icon is a shortcut icon for entering the shooting preview window or the shooting preview interface, so that the user can input through the sign language input icon to trigger the electronic device to display the shooting preview window or the shooting preview interface.

[0103] Exemplarily, taking the scenario where a hearing-impaired user and a hearing-normal user interact face to face as an example. As Figure 8As shown in (a) of [Figure 0], the mobile phone displays a first interface 10, which includes a first area 11 and a second area 12. The first area 11 displays a person identifier 13, and the second area includes a sign language input icon 17. Then, the user (such as a hearing-impaired user) can click on the sign language input icon to display a shooting preview interface 16 in the second area 12, as shown in Figure 8 shown in (b) of [Figure 1]. Thus, the hearing-impaired user can perform sign language actions. At this time, the electronic device can collect the sign language actions of the hearing-impaired user through the shooting preview interface 16 to obtain sign language information, and then convert the sign language information into text information and voice information, and display the text information "Okay, let's go to the park and play together" corresponding to the sign language information or a voice identifier in the second area 12. The voice identifier is used to play the voice information "Okay, let's go to the park and play together". Thus, the hearing-normal user can obtain the information expressed by the hearing-impaired user through the text information or voice identifier displayed in the second area.

[0104] In the embodiment of the present application, after the electronic device detects the user's sign language actions through the second area, it can analyze the user's sign language actions and, in combination with the sign language information database, convert the user's sign language actions into text information.

[0105] In the embodiment of the present application, after the electronic device detects the user's sign language actions through the second area, it can analyze the user's sign language actions and, in combination with the sign language information database, convert the user's sign language actions into text information, and then convert the text information into voice information.

[0106] In this way, the user can directly display the information they want to express through sign language actions. Thus, the electronic device can collect the sign language information corresponding to the sign language actions through the camera in the second area and display it to other users in the form of voice or text, which is convenient for some special users, such as hearing-impaired users, to express the required information in a timely and efficient manner through gestures. In this way, through the electronic device, the conversion of the user's sign language information into text information or voice information can be realized, improving the flexibility of the interaction method and the human-computer interaction performance.

[0107] It can be understood that after the electronic device recognizes the sign language information of the hearing-impaired user through the second area, it can display it to the hearing-normal user in the form of voice or text. For example, for some hearing-impaired users with limited ability to input text but strong sign language ability, they can directly perform sign language actions to make the electronic device display the information they want to express to the hearing-normal user in the form of voice or text in an intuitive manner.

[0108] In the embodiments of the present application, an electronic device can convert speech into text and display it on the screen of the electronic device. At the same time, a person identifier is displayed in a first area of a first interface. The person identifier can convert the text information converted from the voice of a hearing-normal user into sign language information again, and express it to a hearing-impaired user through sign language actions, which is convenient for the hearing-impaired user to understand the information that the hearing-normal user wants to express when they are more familiar with sign language but not with text. After the hearing-impaired user obtains information through the sign language actions of the person identifier, they can transmit the content they want to express to the hearing-normal user in the form of text or speech.

[0109] If the voice ability of the hearing-impaired user is relatively weak and the text input ability is limited, they can enter the first interface. A person identifier is displayed in a first area of the first interface, and a shooting preview interface is displayed in a second area of the first interface and the gesture actions of the hearing-impaired user are automatically recorded. In this case, the first interface can also be called a sign language communication interface. When the gesture actions of the hearing-impaired user are successfully recognized, they can be displayed to the hearing-normal user in the form of voice or text in the first interface. After the hearing-normal user learns the information of the hearing-impaired user, they can directly input by voice. The electronic device can convert the content of the voice input into sign language information and transmit it to the hearing-impaired user through the person identifier, thereby completing the information communication between the hearing-normal user and the hearing-impaired user.

[0110] Optionally, in the embodiments of the present application, the information output method provided in the embodiments of the present application may further include the following step 203.

[0111] Step 203: The electronic device sends the voice information corresponding to the first information in the second area through a phone application or an instant messaging application.

[0112] In the embodiments of the present application, the first information in the above step 203 may be voice information.

[0113] In the embodiments of the present application, the second area of the electronic device displays the interface of a phone application or an instant messaging application, that is, the electronic device is currently making a phone call or an instant messaging call. When the first information (i.e., sign language information) corresponding to the user's gesture actions is collected in the second area through the camera, the electronic device can convert the first information into voice information and send it to the speaker at the other end through the ongoing phone call or instant messaging call.

[0114] It should be noted that the embodiments of the present application do not limit the execution order of the above step 203. For example, the above step 203 may be executed simultaneously with "displaying the text information or voice identifier corresponding to the first information in the second area" in the above step 202c; or step 203 may be executed first, and then "displaying the text information or voice identifier corresponding to the first information in the second area" in step 202c; or "displaying the text information or voice identifier corresponding to the first information in the second area" in step 202c may be executed first, and then step 203.

[0115] In this way, when the electronic device is currently making a phone call or an instant messaging call, the user can directly display the information they want to express through gesture actions. The electronic device can collect the sign language information corresponding to the user's gesture actions through the camera in the second area, and then send the voice information corresponding to the sign language information to the other end speaker through the ongoing phone call or instant messaging call, enabling barrier-free communication between the hearing-impaired user and the other end speaker. Thus, it is realized that the hearing-impaired user can timely and efficiently express the required information to the preset contact through gestures when using the phone application or the instant messaging application. In this way, the output of the hearing-impaired user's information can be achieved through the electronic device, improving the flexibility of the interaction method and the human-computer interaction performance.

[0116] It can be understood that the electronic device can recognize the sign language actions of the hearing-impaired user through the second area, and convert the sign language actions into text information and voice information to send the voice information to the other end speaker, completing the barrier-free communication between the hearing-impaired user and the other end speaker.

[0117] In the embodiments of the present application, the above first area may display a person identifier capable of expressing sign language information, and the second area may also display the interface of any application, such as the interface of the phone application. When a call comes in, the shooting preview interface displayed in the second area can be switched to the call interface of the phone application. After the electronic device obtains the voice information of the phone from the system, it converts the voice information into text information, and then converts the text information into sign language information, so as to express the phone voice of the other end speaker in sign language through the person identifier in the first area, enabling the hearing-impaired user to know what the other end speaker wants to express. The hearing-impaired user can switch the call interface of the phone application back to the shooting preview interface and keep it in this state, so that the hearing-impaired user can shoot their own sign language through the camera in real time, enabling the electronic device to convert the sign language information into voice information and finally send the voice information to the other end speaker, completing the barrier-free communication between the hearing-impaired user and the other end speaker.

[0118] Optionally, in the embodiments of the present application, the electronic device may include a folding screen, which includes a first interface and an atomic window area. Exemplarily, the information output method provided in the embodiments of the present application may further include step 204 below.

[0119] Step 204: When the electronic device receives a call request, display a call window corresponding to the call request in the atomic window area.

[0120] In the embodiments of the present application, the above call request is any one of the following: a phone call request, a voice call request, and a video call request.

[0121] It can be understood that the folding screen of the electronic device displays a first interface and an atomic window area. When a call request is received, a call window corresponding to the call request can be displayed in the atomic window area, so that the first interface and the call window are displayed in different areas of the folding screen.

[0122] Optionally, in the embodiments of the present application, the above atomic window area and the first interface may be displayed in different screens of the folding screen, or in different areas of one screen of the folding screen.

[0123] In the embodiments of the present application, the above atomic window area is an area that displays the interface of a recommended application in the form of a small window. The atomic window area may also be referred to as a dynamic application thumbnail recommendation area, a floating window area, or an application navigation bar area, and can dynamically display the application thumbnails recommended by the electronic device, that is, the interface thumbnails of the applications.

[0124] Optionally, in the embodiments of the present application, the above atomic window area may sort and display the application thumbnails according to the time information of the user using the application. Of course, the user can also manually adjust the display order of the application thumbnails in the atomic window area.

[0125] For example, the above atomic window area may place the thumbnail corresponding to the application that the user is currently using (such as running in the foreground or background) at the top of the atomic window area. For example, when the user makes or answers a call, the thumbnail of the phone application is displayed at the top of the atomic window area.

[0126] Optionally, in the embodiments of the present application, the above atomic window area may be displayed in any area of the electronic device screen, such as the left sidebar area of the left half screen of the folding screen or the right sidebar area of the right half screen of the folding screen, etc.

[0127] Optionally, in the embodiments of the present application, the display of the above atomic window area on the electronic device screen may be in any shape, such as a square or a rectangle.

[0128] Optionally, in the embodiments of the present application, the folding screen further includes at least one interaction control, and each interaction control corresponds to an information interaction method. For example, the information interaction method may be a sign language method, a text method, or a voice method. The user can select the interaction control to trigger the electronic device to obtain the information input by the user through the information interaction method corresponding to the selected interaction control in the second area, and display the input information to the user.

[0129] For example, if the interaction control selected by the user is a sign language control and the information interaction method corresponding to the sign language control is the sign language method, the electronic device can display the shooting preview interface corresponding to the sign language method in the second area to collect the user's gesture actions through the camera; and after collecting the sign language information corresponding to the user's gesture actions in the second area through the camera, the sign language information can be output through the person identifier in the first area, and the information expressed by the sign language information can be displayed in the second area in text or voice form.

[0130] For example, if the interaction control selected by the user is a voice control and the information interaction method corresponding to the voice control is the voice method, the electronic device can collect the user's voice to obtain voice information, and then the sign language information corresponding to the voice information can be output through the person identifier in the first area, and the information expressed by the sign language information can be displayed in the second area in text or voice form.

[0131] For example, if the interaction control selected by the user is an input method keyboard and the information interaction method corresponding to the input method keyboard is the text method, the electronic device can receive the text information input by the user through the input method keyboard, and then the sign language information corresponding to the text information can be output through the person identifier in the first area, and the information expressed by the sign language information can be displayed in the second area in text or voice form.

[0132] Exemplarily, taking the electronic device as a mobile phone and the folding screen of the mobile phone as a two-fold screen as an example. As Figure 9 shown, the folding screen of the mobile phone is in an unfolded state. The folding screen of the mobile phone displays a first interface 10, an atom window area 18, and at least one interaction control. Among them, the first area 11 and the second area 12 in the first interface 10 are respectively displayed on different screens of the folding screen. The atom window area 18 and the first area 11 are displayed on the same screen of the folding screen. The at least one interaction control is displayed on the first interface 10; when the mobile phone receives a call request, the mobile phone can display a call window corresponding to the call request in the atom window area 18, such as an incoming call window. Among them, a person identifier 13 is displayed in the first area 11, Figure 9 and the shooting preview interface is shown in the second area as an example.

[0133] It should be noted that the embodiments of the present application do not limit the execution order of the above step 204. For example, the above step 204 may be executed before or after the above step 202a, or step 204 may be executed before or after the above step 202b, or step 204 may be executed before or after the above step 202c, or step 204 may be executed before or after the above step 203.

[0134] In this way, while the electronic device is displaying the first interface, when a call request is received, the call window can be displayed through the atomic window area of the folding screen. Therefore, there is no need to switch the content displayed on the first interface, so that the user does not need to switch back and forth between the call window and the content displayed in the second area, improving the convenience of information interaction for hearing-impaired users using the electronic device.

[0135] Optionally, in the embodiments of the present application, in combination with Figure 1 , as Figure 10 shown, the above step 202 can be specifically implemented through the following step 202d.

[0136] Step 202d: When the electronic device acquires the first information corresponding to the user's gesture action through the camera in the second area, display the text information corresponding to the first information in the first area or the second area.

[0137] In the embodiments of the present application, the first information in the above step 202d may be sign language information.

[0138] In the embodiments of the present application, the second area of the electronic device displays a shooting preview window or a shooting preview interface. When the electronic device acquires the user's gesture action through the shooting preview window or the shooting preview interface, that is, when acquiring the sign language information corresponding to the user's gesture action through the camera, the electronic device can display the text information corresponding to the sign language information in the first area or the second area.

[0139] It should be noted that for the description of the shooting preview window or the shooting preview interface, reference can be made to the description in the above embodiments, and details are not described here again.

[0140] In the embodiments of the present application, when the user wants to record information in the electronic device, the user can directly perform a gesture action, so that the electronic device can acquire the sign language information corresponding to the user's gesture action through the camera in the second area, and display the text information corresponding to the sign language information to the user in the first area or the second area, that is, record the information expressed by the sign language information in the form of text in the electronic device. Therefore, it is convenient for some special users, such as hearing-impaired users, to express and record the required information in a timely and efficient manner through gestures, improving the flexibility of the information interaction method and the human-computer interaction performance.

[0141] Optionally, in the embodiments of the present application, after the above step 201, the information output method provided by the embodiments of the present application may further include the following step 205, and the above step 202d may be specifically implemented by the following step 202d1.

[0142] Step 205: The electronic device updates the person identifier in the first area to the second interface.

[0143] In the embodiments of the present application, after the electronic device displays the first interface, the user can trigger the electronic device to update the person identifier in the first area to the second interface.

[0144] In the embodiments of the present application, the above second interface may be an application interface selected by the user for recording the information input by the user.

[0145] Optionally, in the embodiments of the present application, after the electronic device displays the first interface, the user can input to the person identifier in the first area to select an application interface for recording the information input by the user.

[0146] For example, the user can input to the person identifier in the first area to trigger the electronic device to display at least one application identifier, and then the user can select one application identifier from the at least one application identifier, so that the electronic device displays the interface of the application indicated by the one application identifier. Alternatively, the above first area further includes a setting control, and the user can input to the setting control to trigger the electronic device to display at least one application identifier, and then the user can select one application identifier from the at least one application identifier, so that the electronic device displays the interface of the application indicated by the one application identifier.

[0147] Among them, the interface of the application indicated by the one application identifier may be the main interface of the application indicated by the one application identifier, or may be the interface selected by the user from the application indicated by the one application identifier after selecting the one application identifier from the at least one application identifier. It should be noted that the input of the user to the person identifier in the first area may be any form of input, such as long-press input or double-click input, etc.

[0148] In the embodiments of the present application, the above second interface may be any application interface in the electronic device, and the any application interface is an application interface for recording the information input by the user, that is, it can record the information input by the user. For example, the any application interface is an application interface containing text information.

[0149] Exemplarily, the above any application interface may include but is not limited to any one of the following: the interface of a note application, the interface of a memo application, the interface of a news application, the interface of an instant messaging application, the interface of a short message application, the interface of a shopping application, etc. Specifically, it can be determined according to actual usage requirements, and the embodiments of the present application do not make limitations.

[0150] Step 202d1: When the electronic device collects first information corresponding to the user's gesture action through the camera in the second area, the electronic device displays text information corresponding to the first information on the second interface.

[0151] In the embodiment of the present application, the first information in the above step 202d1 may be sign language information.

[0152] It should be noted that, for the description of the electronic device collecting the first information corresponding to the user gesture action through the camera in the second area, reference can be made to the description of step 202d in the above embodiment, which will not be repeated here.

[0153] For example, Figure 11 As shown in (a) of FIG, the mobile phone displays a first interface 10, which includes a first area 11 and a second area 12. The first area 11 displays a character identifier 13 and a setting control 19, and the second area 12 includes a shooting preview interface 16. The user can input the setting control 19 to trigger the mobile phone to update the character identifier 13 to the second interface, as shown in FIG. Figure 11 As shown in (b), the second interface can be the interface 20 of the note application, which can be used to record the information input by the user. Therefore, after the mobile phone collects the sign language information corresponding to the user's gesture action through the camera in the second area, the text information corresponding to the sign language information can be displayed on the interface 20 of the note application, "The weather is very good today. I went out to play with my friends. I saw the blue sky and white clouds.", thereby recording the information expressed by the user through sign language in the form of text.

[0154] In this way, the user can trigger the electronic device to update the character identifier in the first area to the application interface required by the user. Since the second area can obtain the sign language information input by the user, after the electronic device obtains the user input information through the second area, the electronic device can convert the user's sign language information into text information and record the text information corresponding to the sign language information in the application interface displayed in the first area. This allows some special users, such as hearing-impaired users, to conveniently and quickly record the required information through gestures. In this way, electronic devices can realize information recording for hearing-impaired users, improving the flexibility of interaction methods and human-computer interaction performance.

[0155] For example, when the user needs the electronic device to display a shooting preview interface, the user can input the second area to trigger the electronic device to switch back to the shooting preview interface, such as the shooting preview interface corresponding to an instant messaging application, so that the user can communicate with other users through gestures.

[0156] Optionally, in the embodiments of the present application, the electronic device includes a folding screen, the folding screen includes a first interface and an atomic window area, and the atomic window area includes at least one interface window. Exemplarily, the above step 205 can be specifically implemented by the following step 205a and step 205b.

[0157] Step 205a: The electronic device receives a third input for dragging a first interface window in at least one interface window to a second area.

[0158] Optionally, in the embodiments of the present application, the at least one interface window may include at least one application interface, and some or all of the at least one application interfaces are different interfaces of the same application, or all of the at least one application interfaces are interfaces of different applications.

[0159] Optionally, in the embodiments of the present application, the application interfaces included in the at least one interface window may be application interfaces recommended by the electronic device or application interfaces preset by the user. Among them, the application interfaces recommended by the electronic device may be application interfaces recommended by the electronic device according to the usage information of the user, and the usage information may include at least one of the number of uses, usage duration, usage frequency, and the most recent usage time, etc. For example, the application interfaces recommended by the electronic device may be application interfaces running in the background.

[0160] Optionally, in the embodiments of the present application, the application interfaces included in the at least one interface window may be interfaces of any application in the electronic device. For example, the any application may be a note application, a memo application, a news application, an instant messaging application, a short message application, a shopping application, etc. Specifically, it can be determined according to actual usage requirements, and the embodiments of the present application do not make limitations.

[0161] Optionally, in the embodiments of the present application, the display order of the at least one interface window in the atomic window area may be determined according to the usage information of the application corresponding to the at least one interface window. For example, the interface window of the most recently used application may be preferentially displayed in the first position.

[0162] Optionally, in the embodiments of the present application, an addition control is further included in the atomic window area, and the addition control is used to add an interface window, so that when the user's demand for adding other application interfaces increases, the user can input to the addition control to trigger the electronic device to add an interface window of the application interface required by the user in the atomic window area.

[0163] Step 205b: In response to the third input, the electronic device updates the person identifier in the first area to a second interface.

[0164] In the embodiments of the present application, the second interface is the application interface corresponding to the first interface window.

[0165] Exemplarily, take the electronic device as a mobile phone and the folding screen of the mobile phone as two folding screens as an example. As Figure 12 shown, the folding screen of the mobile phone is in the unfolded state, and the folding screen of the mobile phone displays the first interface 10 and the atom window area 18. Among them, the first area 11 and the second area 12 in the first interface 10 are respectively displayed on different screens of the folding screen, and the atom window area 18 is displayed on the same screen of the folding screen as the first area 11. Among them, a person icon 13 is displayed in the first area 11, Figure 12 taking the second area as an example to display the shooting preview interface for illustration. The atom window area 18 includes at least one interface window, such as interface windows of application A, application B, and application C, etc. Thus, the user can drag the interface window of application C (such as application C is a note application) in at least one interface window to the second area 12 to trigger the mobile phone to update the person icon 13 in the first area 11 to Figure 11 the interface 20 of the note application shown in (b) of

[0166] Exemplarily, if the user wants to input text information into the note application, then the user can drag the note interface window in the atom window area to the second area, and the electronic device can update the person icon originally displayed in the first area to the note interface; thus, after the electronic device collects the sign language information corresponding to the user's gesture action in the second area, it can display the text information corresponding to the sign language information in real time in the note interface in the first area, and at the same time, the note interface window in the atom window area can synchronously display the text information corresponding to the sign language information.

[0167] Exemplarily, if the user drags the conversation interface window of the instant messaging application to the second area, then the electronic device can update the person icon originally displayed in the first area to the conversation interface; thus, after the electronic device collects the sign language information corresponding to the user's gesture action in the second area, it can display the text information corresponding to the sign language information in real time in the conversation interface in the first area and send it to the peer contact through the conversation interface, and at the same time, the conversation interface window in the atom window area can synchronously display the text information corresponding to the sign language information.

[0168] Optionally, in the embodiments of the present application, the user can input to the second interface in the first area, such as dragging the second interface to other areas outside the first area for input, to trigger the electronic device to update the second interface displayed in the first area to a person icon, which is convenient for the user to drag text or voice in at any time for sign language translation, so that the information interaction of hearing-impaired users is completed more conveniently in the unfolded state of the folding screen.

[0169] In this way, the user can directly select an interface window from the interface windows displayed in the atomic window area of the folding screen, so as to trigger the electronic device to update the person identifier in the first area to the application interface corresponding to the interface window selected by the user, thereby improving the convenience for the user to trigger the switching of the application interface. Moreover, since the second area can obtain the sign language information input by the user, after the electronic device obtains the information input by the user through the second area, the electronic device can convert the sign language information input by the user into text information and record the text information corresponding to the sign language information in the application interface displayed in the first area, so that some special users, such as hearing-impaired users, can conveniently and quickly record the required information through gestures. In this way, the information recording of hearing-impaired users can be realized through the electronic device, improving the flexibility of the interaction method and the human-computer interaction performance.

[0170] Optionally, in the embodiments of the present application, the electronic device may include a folding screen, the folding screen includes a first interface and an atomic window area, and the atomic window area includes at least one interface window. Exemplarily, after step 202d above, the information output method provided in the embodiments of the present application may further include the following steps 206 and 207.

[0171] Step 206: The electronic device receives a first input for dragging the text information corresponding to the first information to the first interface window.

[0172] In the embodiments of the present application, the above first interface window is an interface window among the above at least one interface window.

[0173] In the embodiments of the present application, the user can drag the text information corresponding to the sign language information displayed in the first area or the second area to the first interface window to trigger the electronic device to display the text information in the first interface window.

[0174] Exemplarily, the above first interface window may be an interface window of any application in the electronic device. For example, the any application may be a note application, a memo application, a news application, an instant messaging application, a short message application, a shopping application, etc. Specifically, it can be determined according to actual usage requirements, and the embodiments of the present application do not make limitations.

[0175] It should be noted that for the description of the at least one interface window, reference can be made to the description in the above embodiments, and details are not described herein again.

[0176] Step 207: The electronic device, in response to the first input, displays the text information corresponding to the first information in the first interface window.

[0177] In an embodiment of the present application, after the electronic device displays the text information corresponding to the first information in the first area or the second area, the user can drag the text information to any interface window in the atomic window area to trigger the electronic device to display the text information in the any interface window. Of course, the electronic device can also process the text information through the application corresponding to the any interface window.

[0178] Exemplarily, assume that the user drags the text information to the note interface window in the atomic window area. Then the electronic device can display the text information in the note interface window and record and save the text information through the note application corresponding to the note interface.

[0179] Another exemplarily, assume that the user drags the text information to the conversation interface window in the atomic window area. Then the electronic device can display the text information in the conversation interface window and send the text information to the contact at the other end through the conversation interface window.

[0180] Another exemplarily, assume that the user drags the text information to the shopping application interface window in the atomic window area. Then the electronic device can display the text information in the shopping application interface window and search for the text information through the shopping application interface window to obtain the commodity information corresponding to the text information.

[0181] In this way, the user can directly drag the text information displayed on the first interface of the electronic device to a certain interface window in the folding screen to trigger the electronic device to display the text information in the interface window. That is, the user can conveniently associate the text information corresponding to the sign language information collected by the camera with any application interface, so that the electronic device can perform corresponding operations on the text information through the any application interface, thereby enabling the hearing-impaired user to conveniently and quickly record and process information through the application interface, improving the flexibility of the information interaction method and the human-computer interaction performance.

[0182] Optionally, in an embodiment of the present application, after the above step 201, the information output method provided by the embodiment of the present application may further include the following step 208, and the above step 202 may be specifically implemented by the following step 202e.

[0183] Step 208: The electronic device displays a third interface in the second area.

[0184] In an embodiment of the present application, after the electronic device displays the first interface, the user can trigger the electronic device to display a third interface in the second area.

[0185] For example, the user can input into the second area to trigger the electronic device to display at least one application identifier, and then the user can select one application identifier from the at least one application identifier, so that the electronic device displays the interface of the application indicated by the one application identifier in the second area. Alternatively, the second area further includes a setting control, and the user can input into the setting control to trigger the electronic device to display at least one application identifier, and then the user can select one application identifier from the at least one application identifier, so that the electronic device displays the interface of the application indicated by the one application identifier in the second area.

[0186] Wherein, the interface of the application indicated by the one application identifier may be the main interface of the application indicated by the one application identifier, or may be the interface selected by the user from the application indicated by the one application identifier after selecting the one application identifier from the at least one application identifier. It should be noted that the input of the user to the person identifier in the first area can be any form of input, such as long press input or double click input, etc.

[0187] Optionally, in the embodiment of the present application, when the shooting preview interface is displayed in the second area, the user can trigger the electronic device to update the shooting preview interface displayed in the second area to a third interface.

[0188] In the embodiment of the present application, the above-mentioned third interface is the interface of any application in the electronic device, and the third interface includes first information, and the first information is voice information or text information. For example, the interface of any application may be an application interface containing text information.

[0189] Exemplarily, the interface of any application may include but is not limited to any one of the following: the interface of a note application, the interface of a memo application, the interface of a news application, the interface of an instant messaging application, the interface of a short message application, the interface of a shopping application, etc. Specifically, it can be determined according to actual usage requirements, and the embodiment of the present application does not make any restrictions.

[0190] Step 202e: When the electronic device receives the user dragging the first information in the third interface to the first area, output sign language information corresponding to the first information through the person identifier, and display text information corresponding to the first information in the first area.

[0191] In the embodiment of the present application, the first information in the above-mentioned step 202e may be voice information or text information.

[0192] It should be noted that for the description of the electronic device outputting sign language information corresponding to the first information through the person identifier, reference can be made to the description in the above-mentioned embodiment, and details are not described herein again.

[0193] In the embodiments of the present application, a user can trigger an electronic device to display an arbitrary application interface in a second region, and then the user can drag text information in the arbitrary application interface to a first region, so that the electronic device can translate the text information into sign language information through a person identifier in the first region and display the sign language information, ensuring barrier-free reading and communication for hearing-impaired users.

[0194] Exemplarily, as Figure 13 shown in (a) of [], the mobile phone displays a first interface 10, which includes a first region 11 and a second region 12. The first region 11 displays a person identifier 13, and the second region 12 includes a setting control 21. The user can input to the setting control 21 to trigger the mobile phone to update the second region 12 to a second interface 22, and text information is displayed in this interface, such as "The weather is very good today. I went out to play with my little friends. I saw the blue sky and white clouds. I am very happy.", as Figure 13 shown in (b) of [], the user can select the text information in the second interface 22, such as "I am very happy", and drag it to the person identifier 13, so that the mobile phone can output the sign language information corresponding to the text information "I am very happy" through the person identifier 13, and display the text information "I am very happy" in the first region 11. Thus, the hearing-impaired user can obtain the information in the application interface through the sign language information output by the person identifier 13 and the text information displayed in the first region 11.

[0195] In this way, the user can select an application interface to trigger the electronic device to display the application interface in the second region, and then the user can drag the first information in the application interface to the first region. Thus, after the electronic device recognizes the voice information or text information dragged by the user to the first region, it converts the voice information or text information dragged by the user to the first region into sign language information and text information, and outputs the corresponding sign language information through the person identifier. At the same time, it can display the text information corresponding to the first information in the first region, so that some special users, such as hearing-impaired users, can obtain the required information in a timely and efficient manner. In this way, the electronic device can realize the information reception of hearing-impaired users, improving the flexibility of the interaction method and the human-computer interaction performance.

[0196] Optionally, in the embodiments of the present application, the electronic device may include a folding screen, and the folding screen includes a first interface and an atom window region, and the atom window region includes at least one interface window. Exemplarily, after the above step 201, the information output method provided by the embodiments of the present application may further include the following step 209, and the above step 202 may be specifically implemented by the following step 202f.

[0197] Step 209: The electronic device receives a second input for dragging the first information in the second interface window to the second region.

[0198] In the embodiments of the present application, the second interface window is an interface window among at least one interface window.

[0199] In the embodiments of the present application, the first information in step 209 may be text information or voice information.

[0200] In the embodiments of the present application, the user can drag the text information or voice information in any interface window in the atomic window area to the second area to trigger the output of the sign language information corresponding to the text information or voice information through the person identifier, and display the corresponding text information in the first area.

[0201] Exemplarily, the second interface window may be an interface window of any application in the electronic device. For example, the any application may be a note application, a memo application, a news application, an instant messaging application, a short message application, a shopping application, etc. Specifically, it can be determined according to actual usage requirements, and the embodiments of the present application do not make limitations.

[0202] It should be noted that for the description of at least one interface window, reference can be made to the description in the above embodiments, and details are not described herein again.

[0203] Step 202f: In response to the second input, the electronic device outputs the sign language information corresponding to the first information through the person identifier, and displays the text information corresponding to the first information in the first area.

[0204] In the embodiments of the present application, the first information in step 202f may be voice information or text information.

[0205] It should be noted that for the description of the electronic device outputting the sign language information corresponding to the first information through the person identifier, reference can be made to the description in the above embodiments, and details are not described herein again.

[0206] Exemplarily, the user can operate on any interface window in the atomic window area, such as a news application window, so that a certain interface in the news application is displayed. Then the user can drag the voice information or text information in the certain interface to the second area, so that the electronic device can convert the voice information or text information into sign language information.

[0207] If the user drags the voice information or text information in the conversation interface of the instant messaging application to the second area in the atomic window area, then the electronic device can convert the voice information or text information into sign language information and display it.

[0208] If the user drags the text information in the note interface window to the second area in the atomic window area, then the electronic device can convert the text information into sign language information and display it.

[0209] In this way, the user can drag the first information in any interface window of the foldable screen to the second area, so that the electronic device outputs the corresponding sign language information through the character identifier in the first area, and at the same time, the corresponding text information can be displayed in the first area, so that some special users, such as hearing-impaired users, can obtain the required information in a timely and efficient manner. In this way, the electronic device can realize the information reception of hearing-impaired users, improving the flexibility of the interaction method and the human-computer interaction performance.

[0210] Optionally, in the embodiment of the present application, a speech rate control is further included in the first area, and the user can input to the speech rate control to set the sign language speed when the character identifier outputs the sign language information.

[0211] Exemplarily, in combination with Figure 13 , such as Figure 14 shown, a speech rate control 23 is further included in the first area 11, and the user can input to the speech rate control 23 to set the sign language speed when the character identifier 13 outputs the sign language information. For example, sign language speeds such as slow, normal, and fast are available for the user to choose. In this way, the user can select a sign language speed suitable for themselves, so that the electronic device can adjust the speed at which the character identifier outputs the sign language information, facilitating the user to set a sign language speed that conforms to their own habits and improving the human-computer interaction performance.

[0212] It should be noted that the above-mentioned various method embodiments, or various possible implementation manners in the various method embodiments, can be executed separately, or, on the premise of no contradiction, can also be executed in combination with each other, which can be specifically determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0213] It should be noted that for the information output method provided in the embodiment of the present application, the execution subject can be an information output device. In the embodiment of the present application, taking the information output device executing the information output method as an example, the information output device provided in the embodiment of the present application is described.

[0214] Figure 15 shows a possible structural schematic diagram of the information output device involved in the embodiment of the present application. As Figure 15 shown, the information output device 70 may include: a display module 71 and a processing module 72.

[0215] Among them, the display module 71 is used to display a first interface, the first interface includes a first area and a second area, the first area displays a character identifier, and the second area is used to obtain information input by the user.

[0216] The processing module 72 is used to perform an information output operation when the first information is obtained through the second area, and the information output operation includes any one of the following:

[0217] Outputting sign language information corresponding to first information through the character identifier, where the first information is voice information or text information;

[0218] Output voice information or text information corresponding to the first information, where the first information is sign language information.

[0219] Optionally, in the embodiment of the present application, the processing module 72 is specifically configured to:

[0220] When receiving first information input by the user in the second area, outputting sign language information corresponding to the first information through the character identifier and displaying text information corresponding to the first information in the second area, where the first information is voice information or text information;

[0221] or,

[0222] When the first information is collected through a telephone application or an instant messaging application, sign language information corresponding to the first information is output through a character identifier, and text information corresponding to the first information is displayed in a first area. The first information is voice information.

[0223] Optionally, in an embodiment of the present application, the above-mentioned processing module 72 is specifically used to: when the first information corresponding to the user's gesture action is collected by the camera in the second area, the text information or voice mark corresponding to the first information is displayed in the second area, and the voice mark is used to play the voice information corresponding to the first information, and the first information is sign language information.

[0224] Optionally, in the embodiment of the present application, Figure 15 ,like Figure 16 As shown, the information output device 70 further includes a sending module 73. The sending module 73 is configured to send the voice information corresponding to the first information in the second area via a telephone application or an instant messaging application.

[0225] Optionally, in an embodiment of the present application, the information output device 70 includes a foldable screen, which includes a first interface and an atomic window area. The display module 71 is further configured to display a call window corresponding to a call request in the atomic window area upon receiving a call request, where the call request is any of the following: a phone call request, a voice call request, or a video call request.

[0226] Optionally, in an embodiment of the present application, the above-mentioned processing module 72 is specifically used to: when first information corresponding to a user gesture action is collected by a camera in the second area, display text information corresponding to the first information in the first area or the second area, and the first information is sign language information.

[0227] Optionally, in the embodiments of the present application, the above display module 71 is further configured to, after displaying the first interface, update the character identifier in the first area to a second interface, where the second interface is an application interface selected by the user for recording the information input by the user. Specifically, the display module 71 is configured to display the text information corresponding to the first information in the second interface.

[0228] Optionally, in the embodiments of the present application, the above information output device 79 includes a folding screen, the folding screen includes a first interface and an atomic window area, and the atomic window area includes at least one interface window. In combination Figure 15 , such as Figure 17 shown, the above information output device 70 further includes: a receiving module 74; the receiving module 74 is configured to receive a first input for dragging the text information corresponding to the first information to the first interface window, and the first interface window is an interface window among the at least one interface window; the above display module 71 is further configured to, in response to the first input received by the receiving module 74, display the text information corresponding to the first information in the first interface window.

[0229] Optionally, in the embodiments of the present application, the above display module 71 is further configured to, after displaying the first interface, display a third interface in the second area, where the third interface is an interface of any application in the above electronic device, and the third interface includes the first information, and the first information is voice information or text information.

[0230] Specifically, the above processing module 72 is configured to: when receiving that the user drags the first information in the third interface to the first area, output the sign language information corresponding to the first information through the character identifier, and display the text information corresponding to the first information in the first area.

[0231] Optionally, in the embodiments of the present application, the above information output device 70 includes a folding screen, the folding screen includes a first interface and an atomic window area, and the atomic window area includes at least one interface window. In combination Figure 15 , such as Figure 17 shown, the above information output device 70 further includes: a receiving module 74; the receiving module 74 is configured to, after the display module 71 displays the first interface, receive a second input for dragging the first information in the second interface window to the second area, and the second interface window is an interface window among the at least one interface window. The processing module is specifically configured to: in response to the second input received by the receiving module 74, output the sign language information corresponding to the first information through the character identifier, and display the text information corresponding to the first information in the first area, where the first information is voice information or text information.

[0232] An embodiment of the present application provides an information output device. Since the second area can obtain the information input by the user, that is, the user can input information through the second area, including voice information, text information or sign language information. After the information output device obtains the information input by the user through the second area, in one case, the information output device can convert the voice information or text information input by the user into sign language information, and output the corresponding sign language information through the character identifier, so that some special users, such as hearing-impaired users, can obtain the required information in a timely and efficient manner. In another case, the information output device can convert the sign language information input by the user into voice information or text information, and output the voice information or text information corresponding to the first information, so that some special users, such as hearing-impaired users, can timely and efficiently express the required information through gestures. In this way, the information output device can realize the information interaction of hearing-impaired users, improving the flexibility of the interaction method and the human-computer interaction performance.

[0233] The information output device in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an Augmented Reality (AR) / Virtual Reality (VR) device, a robot, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc. It can also be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a television (TV), a teller machine or a self-service machine, etc. The embodiment of the present application does not make specific limitations.

[0234] The information output device in the embodiment of the present application can be a device with an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems. The embodiment of the present application does not make specific limitations.

[0235] The information output device provided by the embodiment of the present application can implement each process implemented by the above information output method embodiment. To avoid repetition, it will not be elaborated here.

[0236] Optionally, as Figure 18As shown in the figure, an embodiment of the present application further provides an electronic device 900, including a processor 901 and a memory 902. A program or instruction that can run on the processor 901 is stored on the memory 902. When the program or instruction is executed by the processor 901, it implements each step of the above information output method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0237] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0238] Figure 19 It is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application.

[0239] The electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110, etc.

[0240] Those skilled in the art can understand that the electronic device 100 may further include a power supply (such as a battery) for supplying power to each component. The power supply can be logically connected to the processor 110 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 19 The structure of the electronic device shown in the figure does not limit the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0241] Among them, the above-mentioned display unit 106 is used to display a first interface. The first interface includes a first area and a second area. The first area displays a character identifier, and the second area is used to obtain information input by the user.

[0242] The above-mentioned processor 110 is used to perform an information output operation when a first piece of information is obtained through the second area. The information output operation includes any one of the following:

[0243] Output sign language information corresponding to the first information through the character identifier, where the first information is voice information or text information;

[0244] Output voice information or text information corresponding to the first information, where the first information is sign language information.

[0245] Optionally, in the embodiment of the present application, the above-mentioned processor 110 is specifically used for:

[0246] When receiving the first information input by the user in the second area, output the sign language information corresponding to the first information through the character identifier, and display the text information corresponding to the first information in the second area, where the first information is voice information or text information;

[0247] Alternatively, when the first information is collected through a phone application or an instant messaging application, output the sign language information corresponding to the first information through the character identifier, and display the text information corresponding to the first information in the first area, where the first information is voice information.

[0248] Optionally, in the embodiments of the present application, the above-mentioned processor 110 is specifically configured to:

[0249] When the first information corresponding to the user's gesture action is collected through the camera in the second area, display the text information corresponding to the first information or a voice identifier in the second area, where the voice identifier is used to play the voice information corresponding to the first information, and the first information is sign language information.

[0250] Optionally, in the embodiments of the present application, the above-mentioned radio frequency unit 101 is used to send the voice information corresponding to the first information through a phone application or an instant messaging application in the second area.

[0251] Optionally, in the embodiments of the present application, the electronic device includes a folding screen, and the folding screen includes a first interface and an atom window area. The above-mentioned display unit 106 is further configured to display a call window corresponding to a call request in the atom window area when receiving the call request, where the call request is any one of the following: a phone request, a voice call request, and a video call request.

[0252] Optionally, in the embodiments of the present application, the above-mentioned processor 110 is specifically configured to: when the first information corresponding to the user's gesture action is collected through the camera in the second area, display the text information corresponding to the first information in the first area or the second area, where the first information is sign language information.

[0253] Optionally, in the embodiments of the present application, the above-mentioned display unit 106 is further configured to update the character identifier in the first area to a second interface after displaying the first interface, where the second interface is an application interface selected by the user for recording the information input by the user;

[0254] The above-mentioned display unit 106 is specifically configured to display the text information corresponding to the first information in the second interface.

[0255] Optionally, in the embodiments of the present application, the electronic device includes a folding screen, which includes a first interface and an atomic window area. The atomic window area includes at least one interface window. The user input unit 107 is configured to receive a first input for dragging the text information corresponding to the first information to the first interface window, where the first interface window is one of the at least one interface window. The display unit 106 is further configured to, in response to the first input, display the text information corresponding to the first information in the first interface window.

[0256] Optionally, in the embodiments of the present application, the display unit 106 is further configured to, after displaying the first interface, display a third interface in a second area, where the third interface is an interface of any application in the electronic device, and the third interface includes the first information, and the first information is voice information or text information. The processor 110 is specifically configured to: when receiving that the user drags the first information in the third interface to the first area, output sign language information corresponding to the first information through a character identifier, and display the text information corresponding to the first information in the first area.

[0257] Optionally, in the embodiments of the present application, the electronic device includes a folding screen, which includes a first interface and an atomic window area. The atomic window area includes at least one interface window. The user input unit 107 is configured to, after the display unit 106 displays the first interface, receive a second input for dragging the first information in the second interface window to the second area, where the second interface window is one of the at least one interface window. The processor 110 is specifically configured to: in response to the second input, output sign language information corresponding to the first information through a character identifier, and display the text information corresponding to the first information in the first area, where the first information is voice information or text information.

[0258] In the embodiments of the present application, an electronic device is provided. Since the second area can obtain the information input by the user, that is, the user can input information through the second area, including voice information, text information or sign language information. After the electronic device obtains the information input by the user through the second area, in one case, the electronic device can convert the voice information or text information input by the user into sign language information, and output the corresponding sign language information through a character identifier, so that some special users, such as hearing-impaired users, can timely and efficiently obtain the required information. In another case, the electronic device can convert the sign language information input by the user into voice information or text information, and output the voice information or text information corresponding to the first information, so that some special users, such as hearing-impaired users, can timely and efficiently express the required information through gestures. In this way, the information interaction of hearing-impaired users can be realized through the electronic device, and the flexibility of the interaction method and the human-computer interaction performance are improved.

[0259] The electronic device provided by the embodiments of the present application can implement each process implemented by the above information output method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein again.

[0260] For the beneficial effects of various implementation manners in this embodiment, reference may be specifically made to the beneficial effects of the corresponding implementation manners in the above method embodiments. To avoid repetition, details are not described herein again.

[0261] It should be understood that in the embodiments of the present application, the input unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042. The graphics processor 1041 processes the image data of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. The other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.

[0262] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 109 can include volatile memory or non-volatile memory, or the memory 109 can include both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 109 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0263] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 110 either.

[0264] The embodiments of the present application also provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above-mentioned information output method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0265] Among them, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs.

[0266] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the information output method embodiment described above, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0267] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip.

[0268] The embodiments of the present application provide a computer program / program product. The computer program / program product is stored in a storage medium. The program / program product is executed by at least one processor to implement each process of the information output method embodiment described above, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0269] It should be noted that in this article, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of another identical element in the process, method, article or device including this element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0270] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0271] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific implementation manners. The above specific implementation manners are merely illustrative rather than restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

Claims

1. An information output method, characterized in that, Applied to an electronic device, the method includes: Displaying a first interface, the first interface including a first area and a second area, the first area displaying a person identifier, and the second area for obtaining information input by a user; In the case where first information is obtained through the second area, performing an information output operation, the information output operation including any one of the following: Outputting sign language information corresponding to the first information through the person identifier, where the first information is voice information or text information; Outputting voice information or text information corresponding to the first information, where the first information is sign language information.

2. The method according to claim 1, wherein The performing the information output operation in the case where first information is obtained through the second area includes: In the case where the first information input by the user in the second area is received, outputting sign language information corresponding to the first information through the person identifier, and displaying text information corresponding to the first information in the second area, where the first information is voice information or text information; Or, In the case where the first information is collected through a phone application or an instant messaging application, outputting sign language information corresponding to the first information through the person identifier, and displaying text information corresponding to the first information in the first area, where the first information is voice information.

3. The method according to claim 1, characterized in that, The performing the information output operation in the case where first information is obtained through the second area includes: In the case where the first information corresponding to the user's gesture action is collected through a camera in the second area, displaying text information or a voice identifier corresponding to the first information in the second area, where the voice identifier is used to play voice information corresponding to the first information, and the first information is sign language information.

4. The method according to claim 1, wherein The performing the information output operation in the case where first information is obtained through the second area includes: In the case where the first information corresponding to the user's gesture action is collected through a camera in the second area, displaying text information corresponding to the first information in the first area or the second area, where the first information is sign language information.

5. The method according to claim 4, wherein After displaying the first interface, the method further includes: Updating the person identifier in the first area to a second interface, where the second interface is an application interface selected by the user for recording information input by the user; The displaying text information corresponding to the first information in the first area or the second area includes: Displaying text information corresponding to the first information in the second interface.

6. The method according to claim 1, wherein After displaying the first interface, the method further includes: Displaying a third interface in the second area, where the third interface is an interface of any application in the electronic device, and the third interface includes the first information, where the first information is voice information or text information; The performing the information output operation in the case where first information is obtained through the second area includes: In the case where the user drags the first information in the third interface to the first area, outputting sign language information corresponding to the first information through the person identifier, and displaying text information corresponding to the first information in the first area.

7. The method according to claim 1, characterized in that The electronic device includes a folding screen, the folding screen includes the first interface and an atomic window area, and the atomic window area includes at least one interface window; After displaying the first interface, the method further includes: Receiving a second input for dragging the first information in the second interface window to the second area, where the second interface window is an interface window among the at least one interface window; When the first information is obtained through the second area, performing an information output operation, including: In response to the second input, outputting sign language information corresponding to the first information through the character identifier, and displaying text information corresponding to the first information in the first area, where the first information is voice information or text information.

8. An information output device, characterized in that, The information output device includes: a display module and a processing module; The display module is configured to display a first interface, the first interface includes a first area and a second area, the first area displays a character identifier, and the second area is used to obtain information input by the user; The processing module is configured to perform an information output operation when the first information is obtained through the second area, and the information output operation includes any one of the following: Outputting sign language information corresponding to the first information through the character identifier, where the first information is voice information or text information; Outputting voice information or text information corresponding to the first information, where the first information is sign language information.

9. The information output device according to claim 8, characterized in that, The processing module is specifically configured to: When receiving the first information input by the user in the second area, outputting sign language information corresponding to the first information through the character identifier, and displaying text information corresponding to the first information in the second area, where the first information is voice information or text information; Or, When the first information is collected through a phone application or an instant messaging application, outputting sign language information corresponding to the first information through the character identifier, and displaying text information corresponding to the first information in the first area, where the first information is voice information.

10. The information output device according to claim 8, wherein The processing module is specifically configured to: When the first information corresponding to the user's gesture action is collected through a camera in the second area, displaying text information or a voice identifier corresponding to the first information in the second area, where the voice identifier is used to play voice information corresponding to the first information, and the first information is sign language information.

11. The information output device according to claim 8, wherein The processing module is specifically configured to: When the first information corresponding to the user's gesture action is collected through a camera in the second area, displaying text information corresponding to the first information in the first area or the second area, where the first information is sign language information.

12. The information output device according to claim 11, wherein The display module is further configured to, after displaying the first interface, update the character identifier in the first area to a second interface, and the second interface is an application interface selected by the user for recording information input by the user; The display module is specifically configured to display text information corresponding to the first information in the second interface.

13. The information output device according to claim 8, characterized in that, The display module is further configured to, after displaying the first interface, display a third interface in the second region, where the third interface is an interface of any application in the electronic device, and the third interface includes the first information, and the first information is voice information or text information; The processing module is specifically configured to: When receiving that the user drags the first information in the third interface to the first region, output sign language information corresponding to the first information through the character identifier, and display text information corresponding to the first information in the first region.

14. The information output device according to claim 8, characterized in that, The information output device includes a folding screen, and the folding screen includes the first interface and an atom window area, and the atom window area includes at least one interface window; The information output device further includes: a receiving module; The receiving module is configured to, after the display module displays the first interface, receive a second input for dragging the first information in the second interface window to the second region, where the second interface window is an interface window among the at least one interface window; The processing module is specifically configured to: In response to the second input received by the receiving module, output sign language information corresponding to the first information through the character identifier, and display text information corresponding to the first information in the first region, where the first information is voice information or text information.

Images