Information display method and device

Abstract

The invention discloses an information display method and device, and belongs to the technical field of communication. The method comprises the following steps: acquiring first voice information and first user information of a first user in a multi-user session window; according to the first voice information and a first display parameter, a sign language animation window corresponding to the first user is displayed, and the first display parameter is associated with the first user information; the first display parameters comprise at least one of window color information, window shape information, window line style information, identification information and virtual image feature information.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to an information display method and device. Background Art

[0002] Electronic device manufacturers are increasingly prioritizing user experience and user-friendliness, particularly for those with hearing impairments. Hearing-impaired users face numerous challenges in multi-person video conferencing and video chat scenarios.

[0003] In a multi-person conversation, when someone is speaking, it may be inconvenient for hearing-impaired users to look up in time to determine who is speaking, making it difficult for them to distinguish different speakers. They are very likely to miss important information and cannot keep up with the pace of the multi-person conversation, resulting in a poor meeting experience.

[0004] Therefore, for the hearing-impaired, the efficiency of obtaining information in multi-person conversations is low. Summary of the Invention

[0005] The purpose of the embodiments of the present application is to provide an information display method and device that can solve the problem of low efficiency in obtaining information in multi-person conversations for hearing-impaired people.

[0006] In a first aspect, an embodiment of the present application provides an information display method, the method comprising:

[0007] Obtaining the first voice information and first user information of the first user in the multi-person conversation window;

[0008] displaying a sign language animation window corresponding to the first user according to the first voice information and a first display parameter, wherein the first display parameter is associated with the first user information;

[0009] The first display parameter includes at least one of the following:

[0010] Window color information, window shape information, window line style information, logo information and avatar feature information.

[0011] In a second aspect, an embodiment of the present application provides an information display device, the device comprising:

[0012] An acquisition module, configured to acquire first voice information and first user information of a first user in a multi-person conversation window;

[0013] A display module, configured to display a sign language animation window corresponding to the first user according to the first voice information and a first display parameter, wherein the first display parameter is associated with the first user information;

[0014] The first display parameter includes at least one of the following:

[0015] Window color information, window shape information, window line style information, logo information and avatar feature information.

[0016] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0020] In an embodiment of the present application, by obtaining the first voice information and first user information of the first user in the multi-person conversation window, and by accurately separating the voice information and user information of the first user from the complex environment of the multi-person conversation, basic data is provided for subsequent personalized processing and display of the user. According to the first voice information and the first display parameter, the sign language animation window corresponding to the first user is displayed, and the first display parameter is associated with the first user information. The first display parameter includes at least one of the following: window color information, window shape information, window line style information, identification information and virtual image feature information. The voice information of the first user is displayed in a specific window in the form of a sign language animation, so that hearing-impaired people or other people who need to understand voice content through sign language can easily obtain the voice information of the first user in the multi-person conversation scenario, thereby improving the efficiency and inclusiveness of information acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a flow chart of an information display method provided by an embodiment of the present application;

[0022] Figure 2a is a schematic diagram of a sign language animation window provided in an embodiment of the present application;

[0023] Figure 2b This is a schematic diagram of a quiet zone and a non-quiet zone provided in an embodiment of the present application;

[0024] Figure 2c This is a schematic diagram of adjusting a silent chat window provided in an embodiment of the present application;

[0025] Figure 2d is a schematic diagram of a sign language animation window of at least two users provided in an embodiment of the present application;

[0026] Figure 3a 1 is a schematic diagram of a sign language animation window of a foldable screen electronic device provided by an embodiment of the present application;

[0027] Figure 3b 1 is a schematic diagram of a sign language animation window of a foldable screen electronic device provided by an embodiment of the present application;

[0028] Figure 4 is a structural diagram of an information display device provided in an embodiment of the present application;

[0029] Figure 5 This is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;

[0030] Figure 6 This is the second hardware structure diagram of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the accompanying drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0032] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0033] In response to the problems arising in the related art, the embodiments of the present application provide an information display method and device, which can solve the problem in the related art that the hearing-impaired people have low efficiency in obtaining information in multi-person conversations.

[0034] The information display method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0035] Figure 1 A flowchart of an information display method provided in an embodiment of the present application.

[0036] like Figure 1 As shown, the information display method may include steps 110 to 120, and the method is applied to an information display device, as shown below:

[0037] Step 110: Acquire first voice information and first user information of the first user in the multi-person conversation window;

[0038] Multi-person conversation: refers to a real-time communication scenario in which multiple users participate simultaneously, such as multi-person voice calls and video conferences. In this scenario, multiple users can speak and interact simultaneously.

[0039] First user: a specific user who is designated or identified in a multi-person conversation, and may be the user who is currently speaking.

[0040] First voice information: The voice content sent by the first user in a multi-person conversation, in the form of an audio signal, including information such as the user's words and sound characteristics.

[0041] First user information: information related to the first user, including the user's identity, account information, and other user-related attribute data.

[0042] In a multi-person conversation environment, it is necessary to obtain the voice information of each user through an audio acquisition device, and determine the first user through a user ID or other identification mechanism, so as to extract the voice information and related user information of the user separately.

[0043] Step 120: Displaying a sign language animation window corresponding to the first user based on the first voice information and a first display parameter, where the first display parameter is associated with the first user information;

[0044] The first display parameter includes at least one of the following:

[0045] Window color information, window shape information, window line style information, logo information and avatar feature information.

[0046] First display parameters: a set of parameters used to determine how to display content related to the first user. These parameters are set based on the first user information and include window size, position, color, transparency, etc., and are used to control the display effect of the sign language animation window.

[0047] Sign language animation window: a graphical interface area specifically used to display sign language animation, which converts the first user's voice information into corresponding sign language movements in the form of animation, so that the hearing-impaired or other people in need can understand the voice content by watching the animation.

[0048] The first display parameter includes at least one of the following: window color information, window shape information, window line style information, logo information, and virtual image feature information.

[0049] Window color information: The color presented by the sign language animation window can be used to distinguish the sign language animation windows of different users or meet the user's personalized visual needs.

[0050] Window shape information: The geometric shape of the sign language animation window, such as rectangle, circle, ellipse, etc. Different shapes can bring different visual perception and operation experience to users.

[0051] Window line style information: The appearance characteristics of the window border line, such as solid line, dotted line, dash-dot line, etc. By changing the line style, the window display can be more diverse and personalized.

[0052] Identification information: information used to identify a specific user or sign language animation window. It can include the user's name, avatar, number, etc., to facilitate users to quickly identify and distinguish the sign language animation windows of different users.

[0053] Virtual image feature information: represents the virtual character image displayed by the first user in the sign language animation window. The image can present different appearance features according to the user's settings or default settings, such as different hairstyles, clothing, skin colors, etc., making the sign language animation more vivid and personalized.

[0054] When it is detected that the user performs an operation on the first user information, the operation is converted into a recognizable input signal, thereby receiving the user's first input. After receiving the first input, the input content is analyzed and processed according to pre-set rules and logic.

[0055] For example, if the user specifies window color information through input, that color information will be extracted and associated with the window color information attribute in the first display parameter. For parameters such as identification information and avatar feature information, the corresponding information and resources can be retrieved from a database or resource library based on the user input and determined as part of the first display parameter. In this way, the first display parameter is dynamically determined based on the user's input to meet the user's personalized needs for the sign language animation window display.

[0056] This allows users to interact with the first user information and perform operations, providing an entry point for subsequent personalized settings of the first display parameters. This enhances the user's control over the first user information, allowing users to set the first user information according to their needs and preferences, thereby improving user engagement and user experience.

[0057] This allows the display parameters of the sign language animation window to be dynamically adjusted based on user input, making the window display more personalized to the user's needs. By personalizing window color information, shape, line style, logo information, and avatar feature information, users can more quickly and accurately identify and focus on the sign language animation content of a specific user, improving the readability and comprehensibility of the information. At the same time, this personalized setting also enhances user-friendliness and appeal, meeting the diverse needs of different users for information display in multi-person conversation scenarios.

[0058] like Figure 2a As shown, a sign language animation window 211 is displayed, and the first display parameter of the sign language animation window is associated with the first user information.

[0059] Based on the acquired first voice information, speech recognition technology is used to convert the speech into text content, and then, based on a pre-established mapping relationship between sign language movements and text, the text content is converted into a corresponding sign language movement sequence. Simultaneously, based on the first display parameter associated with the first user information, various display attributes of the sign language animation window, such as the window size, position, and color, are set to conform to the user's setting preferences or default rules. The sign language animation is then played in a designated interface area, presenting the first user's voice information in the form of a visual sign language animation.

[0060] By accurately separating the first user's voice and user information from the complex environment of a multi-person conversation, this provides the foundational data for subsequent personalized processing and display for that user. This ensures focus on the specific user's voice content, avoiding interference from other users' information, and lays the foundation for accurate speech-to-sign language conversion and personalized display.

[0061] By displaying the first user's voice information in a specific window as a sign language animation, the hearing-impaired or others who rely on sign language to understand spoken content can easily access the first user's voice information in multi-person conversations, improving information accessibility and inclusiveness. Furthermore, by setting display parameters based on user information, personalized display effects are achieved, meeting the diverse display needs of different users and enhancing the user experience.

[0062] In a possible embodiment, before step 120, the following steps may be further included:

[0063] receiving a first input of the first user information;

[0064] In response to the first input, the first display parameter is determined.

[0065] The first input is an operation instruction input for the first user information. In response to the first input, at least one candidate display parameter may be displayed so that the user can determine the first display parameter from the at least one candidate display parameter.

[0066] In a possible embodiment, the following steps may also be included:

[0067] Converting the first voice information to obtain first text information;

[0068] Display a first chat window according to the first text information and the first display parameter.

[0069] The first text information: the text content obtained by converting the voice information of the first user, is the result of converting the voice signal into text form, and can clearly present the semantic information expressed by the first user.

[0070] First chat window: an area in the multi-person conversation interface specifically used to display the chat content of the first user, that is, the converted text information. Users can view the communication content of the first user in text form in this window.

[0071] The first voice information is analyzed and processed using speech recognition technology. Speech recognition technology typically includes steps such as voice signal acquisition, preprocessing, feature extraction, and pattern matching. The extracted voice features are matched with a pre-trained voice model to convert the voice signal into a corresponding text sequence, thereby obtaining the first text information.

[0072] After receiving the first text message, the layout and style of the first chat window are set according to the settings related to chat window display in the first display parameter. The first text message is then filled into the chat window according to a certain format and displayed at an appropriate location in the multi-person conversation interface, allowing users to easily view the first user's text chat content.

[0073] By converting the first user's voice content into text, it provides an alternative way to obtain information for those who cannot clearly hear voice messages or are more accustomed to reading text. This expands the audience range of information dissemination, improves the accessibility of information, and meets the communication needs of different users.

[0074] By displaying the first user's text chat content in a personalized manner, the first display parameter settings ensure that the chat window display conforms to the user's visual preferences and operating habits. For example, the appropriate window position and size facilitate users to quickly locate and view chat content, and the personalized background and text style enhance the user's visual experience. Furthermore, the clear presentation of the first user's text message helps maintain the order and readability of information in multi-person conversations, facilitating user communication.

[0075] In a possible embodiment, the following steps may also be included:

[0076] Acquire voice information and user information of at least two users in the multi-person conversation window, where the at least two users include the first user;

[0077] At a preset display position, the chat windows of the at least two users are displayed according to the voice information and user information of the at least two users.

[0078] At least two users: In a multi-person conversation scenario, a group of at least two participating users. This emphasizes the information processing and presentation of multiple users, including the first user mentioned above.

[0079] Preset display position: A specific area or position pre-set on the interface for displaying the chat window. This position can be fixed or dynamically adjusted according to certain rules so that users can easily view the chat content.

[0080] By continuously monitoring the voice signals of multi-person conversations through audio acquisition devices, the system uses voice signal processing and user identification technologies to separate the voice information of each user from the mixed audio stream and simultaneously obtain the user information corresponding to each user. For the identification of multiple users, a differentiation method based on voice characteristics or user identification may be used to ensure accurate acquisition of relevant data for each user, including information about the defined first user.

[0081] First, the acquired voice information of at least two users is processed, such as by converting it into text using voice recognition technology. Then, based on each user's information and pre-set display rules, a corresponding chat window is generated and displayed for each user at a pre-set display location. The chat window is filled with the user's chat content and relevant user identification information in a specific format, allowing users to clearly identify and distinguish between different users' chat windows and content.

[0082] By comprehensively collecting key information from multiple users in a multi-person conversation, we provide the foundational data for subsequent unified processing and presentation of this information. Accurately understanding the content and attributes of each user's communication facilitates more efficient and comprehensive information management and presentation, meeting the demands for multi-user information processing in multi-person conversations.

[0083] Displaying multiple users' chat windows in an orderly fashion at fixed or regularly defined locations on the interface allows users to simultaneously view chat content from multiple users within a multi-person conversation, improving the efficiency and convenience of information acquisition. Users can intuitively compare and track the dynamics of communication between different users, enhancing the interactivity and participation in multi-person conversations. Furthermore, personalized display settings allow the chat window display to better suit user habits and visual needs, improving the user experience.

[0084] In a possible embodiment, step 120 may specifically include the following steps:

[0085] displaying at least one non-muted chat window and at least one muted chat window;

[0086] The at least one non-silent chat window includes: a sign language animation window corresponding to the first user.

[0087] Unmuted chat window: In a multi-person conversation, a chat window that displays the content of a user's voice message and is not muted. In an unmuted chat window, the user's voice information is processed and displayed, allowing other users to access the information conveyed by the user.

[0088] Muted chat window: In a multiplayer chat, a chat window in which a user's voice is muted. Voice messages from muted users are not processed or displayed, but other information about the user may still be displayed.

[0089] like Figure 2b As shown, the chat interface includes a non-silent area 213 and a silent area 214. The non-silent area 213 includes at least one non-silent chat window, and the silent area 214 includes at least one silent chat window.

[0090] like Figure 2c As shown, in response to the moving input to the chat window D, the chat window D is moved to the non-silent area.

[0091] First, the voice status of each user in a multi-person conversation needs to be determined. This can be determined through user settings within the conversation or through the default settings. For non-muted users, the voice is processed based on their voice information and relevant display parameters, and then a corresponding non-muted chat window is generated and displayed on the interface. For muted users, a muted chat window is generated and displayed on the interface based on their user information to indicate their presence.

[0092] Because the first user's voice information has been captured and is not muted, the first user's voice information is processed and converted into a corresponding sign language animation using speech recognition and sign language animation generation technology. Then, according to the rules for displaying non-muted chat windows, the sign language animation window corresponding to the first user is placed in a set of at least one non-muted chat window for display. Simultaneously, based on display parameters related to the first user, the sign language animation window is personalized and displayed on the interface for other users to view.

[0093] The voice status of different users in a multi-person conversation is clearly distinguished, allowing other users to intuitively understand which users' voice information is being processed and displayed, and which users are muted. This distinction helps users better focus on the user who is speaking, improves information acquisition efficiency, and avoids the confusion caused by processing too many voice messages simultaneously. Furthermore, the display of the chat window of muted users also allows other users to be aware of their presence, maintaining the integrity of the conversation.

[0094] This allows the first user's voice message to be accurately displayed in the form of a sign language animation in a non-muted chat window. This allows hearing-impaired users or others who rely on sign language to understand information to promptly access the first user's voice content, promoting effective information transmission. By placing the first user's sign language animation window within the non-muted chat window collection, the first user's current speaking status is highlighted, allowing other users to focus on and understand the first user's message, thereby enhancing the relevance and effectiveness of information exchange in multi-person conversations.

[0095] In a possible embodiment, the following steps may also be included:

[0096] Collecting input content from a second user, where the input content includes at least one of the following: a sign language video and text information;

[0097] Based on the input content, a sign language animation window corresponding to the second user is displayed.

[0098] Second user: Another specific user other than the first user in a multi-person conversation scenario, who is the subject of this processing and attention, and is used to distinguish him from other users such as the first user.

[0099] Input content: The content provided by the second user to express information, including different forms such as sign language videos and text information. These contents are the basis for subsequent processing and display.

[0100] Sign language video: A video file generated by a second user through recording or real-time shooting of sign language movements, where the sign language movements are expressed according to specific sign language rules and are used to convey the user's intention and information.

[0101] Text information: content input by the second user in text form, such as a character sequence generated by keyboard, handwriting input, etc., used to express ideas and information clearly and accurately.

[0102] If the input content is a sign language video, the second user's sign language movements are captured in real time through a video capture device, converted into a video signal, and then encoded, stored, and processed. At the same time, video processing technology can be used to pre-process the sign language video, such as anti-shake and image quality enhancement, to facilitate subsequent accurate recognition and processing.

[0103] If the input content is text information, the character sequence input by the second user is received through the input device, converted into a computer-recognizable text format, and stored and initially formatted. Support for different input devices and collection of input content are achieved through corresponding device drivers and software programs.

[0104] like Figure 2d As shown, a sign language animation window 211 corresponding to the second user and a sign language animation window 214 corresponding to the second user are displayed.

[0105] When the input content is a sign language video, sign language recognition technology is used to analyze and identify the sign language movements in the video. This involves steps such as sign language movement feature extraction and movement pattern matching, converting the sign language movements into corresponding semantic information. Then, based on this semantic information and preset animation generation rules, a corresponding sign language animation is generated and displayed in the sign language animation window corresponding to the second user.

[0106] When the input content is text, the text is first understood and analyzed, such as through grammar checking and semantic parsing. Then, based on the semantics expressed in the text and using a pre-established mapping between text and sign language gestures, the text is converted into a corresponding sign language gesture sequence. The corresponding sign language animation is then generated and displayed in the sign language animation window. Simultaneously, the display style of the sign language animation window is set based on display parameters associated with the second user.

[0107] By collecting the second user's input content, it supports a variety of second user input methods, meeting the needs of different users to choose the appropriate input method based on their own habits and abilities. Whether users who are good at sign language expression input through sign language video or users who are more accustomed to text input can easily convey information to the user, improving the flexibility and convenience of user interaction.

[0108] Displaying the second user's input in an intuitive sign language animation format provides an effective communication method for hearing-impaired users or others who rely on sign language to understand information. This personalized sign language animation window clearly displays the second user's expression, promoting accurate information transmission and communication in multi-person conversations, enhancing information accessibility and inclusiveness, and improving the overall user experience and interactive effect.

[0109] In a possible embodiment, applied to an electronic device having a foldable screen, the foldable screen includes a first screen area and a second screen area. Step 120 may specifically include the following steps:

[0110] Displaying the sign language animation window in the first screen area according to the first voice information and the first display parameter;

[0111] This embodiment may further include the following steps:

[0112] A first chat window is displayed in the second screen area according to the first voice information and the first display parameter.

[0113] Electronic devices with foldable screens: These are electronic devices equipped with foldable screens, such as foldable phones and foldable tablets. These devices can offer different usage modes and display spaces in both the folded and unfolded states, providing users with diverse interactive experiences.

[0114] First screen area: a specific area divided out of the foldable screen, used to display specific content. In this embodiment, it is used to display the sign language animation window corresponding to the first user.

[0115] Second screen area: another specific area of the foldable screen, opposite to the first screen area, used to display the first chat window corresponding to the first user in this embodiment.

[0116] like Figure 3a As shown, the sign language animation window 211 is displayed in the first screen area, and the first chat window 212 is displayed in the second screen area according to the first voice information and the first display parameters.

[0117] First, a first voice message from a first user is obtained and first display parameters associated therewith are extracted. Then, using speech recognition technology, the first voice message is converted into semantic information. Based on a pre-established mapping relationship between semantic information and sign language movements, a corresponding sign language animation sequence is generated. Based on the window position, size, and other settings in the first display parameters, the specific display position and appearance of the sign language animation window are determined in the first screen area, and the generated sign language animation is displayed in the window.

[0118] Similarly, the first voice message and the first display parameter are obtained. The first voice message is processed and converted into a first text message using speech recognition technology. Based on the settings related to the chat window display in the first display parameter, the display style and position of the first chat window are determined in the second screen area. The converted first text message is filled into the first chat window according to a certain format and displayed. In this way, the first user's voice message is displayed in the chat window in the second screen area in the form of text for the user to view.

[0119] The first screen area of the foldable screen is used to display a sign language animation window, providing a clear, independent visual space for hearing-impaired users or those who rely on sign language to understand information, allowing them to focus on viewing the sign language animation and accurately understand the first user's voice content. At the same time, by setting the first display parameters, the window can be personalized to improve the user's visual experience and information acquisition efficiency. This partitioned display method fully utilizes the space advantage of the foldable screen and improves the device's information display capabilities in multi-person conversation scenarios.

[0120] The first chat window is displayed in the second screen area, so that the user can view the converted content of the first user's voice information in text form. This provides an effective way to obtain information for users who are more accustomed to reading text or have difficulty hearing voices in noisy environments. The partitioned display of the sign language animation window in the first screen area realizes the multimodal display of information, meets the diverse needs of different users, and further enhances the practicality and user experience of foldable screen electronic devices in multi-person conversations. At the same time, the application of the first display parameter also ensures that the display of the chat window can meet the user's personalized preferences and improves the overall interface friendliness.

[0121] In a possible embodiment, receiving a first input to the first chat window;

[0122] In response to the first input, the sign language animation window and the first chat window are displayed in the first screen area.

[0123] First input: the specific operation input performed by the user on the first chat window.

[0124] By monitoring the user's operation behavior in real time, when the user operates the first chat window, it is identified that this is an operation on the first chat window, thereby determining that the first input has been received.

[0125] like Figure 3b As shown, the sign language animation window and the first chat window 212 are displayed in the first screen area.

[0126] After receiving the first input, display parameters related to the first chat window and the sign language animation window are obtained. The display parameters may include the size, position, transparency, display style, etc. of the window. Then, the display space of the first screen area is rearranged and adjusted to accommodate the requirement of displaying the two windows simultaneously.

[0127] For the sign language animation window, a corresponding sign language animation is generated based on the first user's voice information and displayed in the primary screen area according to the parameter settings. For the first chat window, the existing text information is displayed in the same screen area according to the set format and style. Through a reasonable layout algorithm and display control, both windows are ensured to be displayed clearly and orderly in the primary screen area, making it easy for users to view.

[0128] This allows users to interact with the first chat window, providing trigger conditions for subsequent operations and information display. This interactive method increases the user's sense of control, allowing users to decide their actions based on their needs and operating habits, improving user participation and flexibility.

[0129] This meets the user's need to view sign language animation and text information simultaneously in certain situations. For example, while viewing the sign language animation to understand the content, a hearing-impaired user may also want to compare it with the text information to more accurately grasp the meaning; or an ordinary user may want to deepen their understanding through both text and sign language animation while understanding the voice information. Displaying the two windows simultaneously in the first screen area fully utilizes the screen space, making it easier for users to compare and comprehensively obtain information, improving the efficiency of information transmission and the user experience. At the same time, this method of dynamically adjusting the displayed content based on user input reflects the intelligence and personalization of the device, enhancing the user's favorability towards the device.

[0130] In an embodiment of the present application, by obtaining the first voice information and first user information of the first user in the multi-person conversation window, and by accurately separating the voice information and user information of the first user from the complex environment of the multi-person conversation, basic data is provided for subsequent personalized processing and display of the user. According to the first voice information and the first display parameter, the sign language animation window corresponding to the first user is displayed, and the first display parameter is associated with the first user information. The first display parameter includes at least one of the following: window color information, window shape information, window line style information, identification information and virtual image feature information. The voice information of the first user is displayed in a specific window in the form of a sign language animation, so that hearing-impaired people or other people who need to understand voice content through sign language can easily obtain the voice information of the first user in the multi-person conversation scenario, thereby improving the efficiency and inclusiveness of information acquisition.

[0131] The information display method provided in the embodiment of the present application can be executed by an information display device. In the embodiment of the present application, the information display device provided in the embodiment of the present application is described by taking the information display method executed by the information display device as an example.

[0132] Figure 4 4 is a block diagram of an information display device provided in an embodiment of the present application. The device 400 includes:

[0133] An acquisition module 410 is configured to acquire first voice information and first user information of a first user in a multi-person conversation window;

[0134] A display module 420 is configured to display a sign language animation window corresponding to the first user based on the first voice information and a first display parameter, where the first display parameter is associated with the first user information;

[0135] The first display parameter includes at least one of the following:

[0136] Window color information, window shape information, window line style information, logo information and avatar feature information.

[0137] In a possible embodiment, the apparatus 400 may further include:

[0138] a conversion module, configured to convert the first voice information into first text information;

[0139] The display module 420 is further configured to display a first chat window according to the first text information and the first display parameter.

[0140] In a possible embodiment, the acquisition module 410 is further configured to acquire voice information and user information of at least two users in the multi-user conversation window, where the at least two users include the first user;

[0141] The display module 420 is further configured to display the chat windows of the at least two users at a preset display position according to the voice information and user information of the at least two users.

[0142] In a possible embodiment, the display module 420 is further configured to display at least one non-muted chat window and at least one muted chat window;

[0143] The at least one non-silent chat window includes: a sign language animation window corresponding to the first user.

[0144] In a possible embodiment, the present invention is applied to an electronic device having a foldable screen, wherein the foldable screen includes a first screen area and a second screen area, and the display module 420 is specifically configured to:

[0145] Displaying the sign language animation window in the first screen area according to the first voice information and the first display parameter;

[0146] The display module 420 is further configured to display a first chat window in the second screen area according to the first voice information and the first display parameter.

[0147] In a possible embodiment, the apparatus 400 may further include:

[0148] A receiving module, configured to receive a first input to the first chat window;

[0149] The display module 420 is further configured to display the sign language animation window and the first chat window in the first screen area in response to the first input.

[0150] In an embodiment of the present application, by obtaining the first voice information and first user information of the first user in the multi-person conversation window, and by accurately separating the voice information and user information of the first user from the complex environment of the multi-person conversation, basic data is provided for subsequent personalized processing and display of the user. According to the first voice information and the first display parameter, the sign language animation window corresponding to the first user is displayed, and the first display parameter is associated with the first user information. The first display parameter includes at least one of the following: window color information, window shape information, window line style information, identification information and virtual image feature information. The voice information of the first user is displayed in a specific window in the form of a sign language animation, so that hearing-impaired people or other people who need to understand voice content through sign language can easily obtain the voice information of the first user in the multi-person conversation scenario, thereby improving the efficiency and inclusiveness of information acquisition.

[0151] The information display device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or a device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0152] The information display device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0153] The information display device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be described here.

[0154] Alternatively, as Figure 5 As shown, an embodiment of the present application also provides an electronic device 510, including a processor 511, a memory 512, and a program or instruction stored in the memory 512 and executable on the processor 511. When the program or instruction is executed by the processor 511, each step of any of the above-mentioned information display method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0156] Figure 6 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0157] The electronic device 600 includes but is not limited to components such as a radio frequency unit 601 , a network module 602 , an audio output unit 603 , an input unit 604 , a sensor 605 , a display unit 606 , a user input unit 607 , an interface unit 608 , a memory 609 , and a processor 610 .

[0158] Those skilled in the art will understand that the electronic device 600 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0159] The processor 610 is configured to obtain first voice information and first user information of a first user in a multi-person conversation window;

[0160] A display unit 606 is configured to display a sign language animation window corresponding to the first user based on the first voice information and a first display parameter, where the first display parameter is associated with the first user information;

[0161] The first display parameter includes at least one of the following:

[0162] Window color information, window shape information, window line style information, logo information and avatar feature information.

[0163] Optionally, the processor 610 is further configured to convert the first voice information to obtain first text information;

[0164] The display unit 606 is further configured to display a first chat window according to the first text information and the first display parameter.

[0165] Optionally, the processor 610 is further configured to obtain voice information and user information of at least two users in the multi-person conversation window, where the at least two users include the first user;

[0166] The display unit 606 is further configured to display the chat windows of the at least two users at a preset display position according to the voice information and user information of the at least two users.

[0167] Optionally, the display unit 606 is further configured to display at least one non-muted chat window and at least one muted chat window;

[0168] The at least one non-silent chat window includes: a sign language animation window corresponding to the first user.

[0169] Optionally, the display unit 606 is further configured to display the sign language animation window in the first screen area according to the first voice information and the first display parameter;

[0170] The display unit 606 is further configured to display a first chat window in the second screen area according to the first voice information and the first display parameters.

[0171] Optionally, the user input unit 607 is configured to receive a first input to the first chat window;

[0172] The display unit 606 is further configured to display the sign language animation window and the first chat window in the first screen area in response to the first input.

[0173] In an embodiment of the present application, by obtaining the first voice information and first user information of the first user in the multi-person conversation window, and by accurately separating the voice information and user information of the first user from the complex environment of the multi-person conversation, basic data is provided for subsequent personalized processing and display of the user. According to the first voice information and the first display parameter, the sign language animation window corresponding to the first user is displayed, and the first display parameter is associated with the first user information. The first display parameter includes at least one of the following: window color information, window shape information, window line style information, identification information and virtual image feature information. The voice information of the first user is displayed in a specific window in the form of a sign language animation, so that hearing-impaired people or other people who need to understand voice content through sign language can easily obtain the voice information of the first user in the multi-person conversation scenario, thereby improving the efficiency and inclusiveness of information acquisition.

[0174] It should be understood that in an embodiment of the present application, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes image data of a static picture or video image obtained by an image capture device (such as a camera) in a video image capture mode or an image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and at least one of other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an action stick, which will not be repeated here. The memory 609 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 610.

[0175] The memory 609 can be used to store software programs and various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 609 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0176] Processor 610 may include one or more processing units. Optionally, processor 610 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 610.

[0177] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information display method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0178] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0179] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0180] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0181] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned information display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0182] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0183] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0184] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. An information display method, characterized in that: The method comprises: Obtaining the first voice information and first user information of the first user in the multi-person conversation window; displaying a sign language animation window corresponding to the first user according to the first voice information and a first display parameter, wherein the first display parameter is associated with the first user information; The first display parameter includes at least one of the following: Window color information, window shape information, window line style information, logo information and avatar feature information.

2. The method according to claim 1, characterized in that The method further comprises: Converting the first voice information to obtain first text information; Display a first chat window according to the first text information and the first display parameter.

3. The method according to claim 1, characterized in that The method further comprises: Acquire voice information and user information of at least two users in the multi-person conversation window, where the at least two users include the first user; At a preset display position, chat windows of the at least two users are displayed according to the voice information and user information of the at least two users.

4. The method according to claim 1, wherein The method further comprises: displaying at least one non-muted chat window and at least one muted chat window; The at least one non-silent chat window includes: a sign language animation window corresponding to the first user.

5. The method according to claim 1, wherein Applicable to an electronic device having a foldable screen, the foldable screen including a first screen area and a second screen area, wherein displaying a sign language animation window corresponding to the first user according to the first voice information and the first display parameter comprises: Displaying the sign language animation window in the first screen area according to the first voice information and the first display parameter; The method further comprises: A first chat window is displayed in the second screen area according to the first voice information and the first display parameter.

6. The method according to claim 5, characterized in that The method further comprises: receiving a first input to the first chat window; In response to the first input, the sign language animation window and the first chat window are displayed in the first screen area.

7. An information display device, characterized in that: The device comprises: An acquisition module, configured to acquire first voice information and first user information of a first user in a multi-person conversation window; A display module, configured to display a sign language animation window corresponding to the first user according to the first voice information and a first display parameter, wherein the first display parameter is associated with the first user information; The first display parameter includes at least one of the following: Window color information, window shape information, window line style information, logo information and avatar feature information.

8. The device according to claim 7, characterized in that The device further comprises: a conversion module, configured to convert the first voice information into first text information; The display module is further used to display a first chat window according to the first text information and the first display parameter.

9. The device according to claim 7, characterized in that The acquisition module is further configured to acquire voice information and user information of at least two users in the multi-user conversation window, wherein the at least two users include the first user; The display module is further configured to display the chat windows of the at least two users at a preset display position based on the voice information and user information of the at least two users.

10. The device according to claim 7, characterized in that The display module is further configured to display at least one non-muted chat window and at least one muted chat window; The at least one non-silent chat window includes: a sign language animation window corresponding to the first user.

11. The device according to claim 7, characterized in that Applicable to an electronic device with a foldable screen, the foldable screen including a first screen area and a second screen area, the display module is specifically used to: Displaying the sign language animation window in the first screen area according to the first voice information and the first display parameter; The display module is further used to display the first chat window in the second screen area according to the first voice information and the first display parameter.

12. The device according to claim 11, characterized in that The device further comprises: A receiving module, configured to receive a first input to the first chat window; The display module is further configured to display the sign language animation window and the first chat window in the first screen area in response to the first input.

Images