Information display method and terminal equipment

Abstract

The invention relates to the technical field of augmented reality, and provides an information display method, which is applied to terminal equipment and comprises the following steps: receiving first information which is any one of a short message, a call request or a video request; obtaining first operation information, wherein the first operation information is used for indicating that a display mode of second information corresponding to the first information is switched from a preset display mode to a target display mode; and in response to the first operation information, displaying the second information in the target display mode. The method can solve the problem that the display mode of the XR equipment is single and cannot meet user requirements.

Description

Technical Field

[0001] The present application relates to the field of extended reality technology, and in particular to a method and terminal device for displaying information. Background Art

[0002] Extended Reality (XR or ER) refers to the use of computer technology and wearable devices to create an environment that combines the real and virtual and allows human-computer interaction; XR includes immersive technologies such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). In the XR scenario, the wearer of the XR device can receive text messages, calls, video calls and other information through the XR device (for example, the XR head display device), and can also initiate text messages, calls, video calls to other terminal devices. In the existing technology, the XR device has a relatively simple display method for the received text, video and other information, which cannot meet the needs of users. Summary of the invention

[0003] The present application provides a method and terminal device for displaying information, which can solve the problem that the display method of XR devices is single and cannot meet user needs.

[0004] In order to achieve the above objectives, this application adopts the following technical solutions:

[0005] In a first aspect, a method for displaying information is provided, the method comprising: receiving first information, the first information being any one of a text message, a call request or a video request; obtaining first operation information, the first operation information being used to indicate that a display method of second information corresponding to the first information is switched from a preset display method to a target display method; and in response to the first operation information, displaying the second information in a target display method.

[0006] The above method can be executed by a terminal device, or by a module (such as a processor, chip, or chip system, etc.) applied to the terminal device, or by a logical node, logical module or software that can realize all or part of the terminal device functions. In the prior art, after receiving the first information, the terminal device usually displays the second information in a preset display method, and the user (for example, the wearer of the XR device) cannot choose the display method according to his own needs. The present application provides users with optional target display methods, which can facilitate users to flexibly choose the display method of the second information according to their own needs. Correspondingly, the terminal device can also flexibly display the second information to the user through the target display method according to the user's first operation information, which can not only meet the user's needs but also improve the user experience.

[0007] In some embodiments, the method further includes: when the first information is a text message, the preset display mode is a text display mode, and the target display mode is one of a voice display mode, a digital human video display mode or a mixed display mode.

[0008] Compared with the prior art where SMS is usually displayed in text format, in the present application, the display method of SMS is not limited to text display method, but can also be displayed in other ways such as voice display method, digital human video display method, etc., which increases the diversity of SMS display forms, meets user needs, and improves user experience.

[0009] In some embodiments, the method further includes: when the first information is a call request, the preset display mode is a voice display mode, and the target display mode is one of a text display mode, a digital human video display mode or a mixed display mode.

[0010] Compared with the prior art in which voice calls are usually displayed in a voice display mode, in the present application, the display mode of voice calls is not limited to the voice display mode, and other display modes such as text display mode and digital human video display mode can also be selected. For example, the user can determine whether to choose a downgraded display mode (for example, a text display mode) or an upgraded display mode (for example, a digital human video display mode) according to the quality of the current call network. This method not only increases the diversity of voice call display forms, but also meets the special needs of users.

[0011] In some embodiments, the method further includes: when the first information is a video request, the preset display mode is a video display mode, and the target display mode is one of a text display mode, a voice display mode, a digital human video display mode or a mixed display mode.

[0012] Compared with the prior art where video calls are usually displayed using video display, in the present application, the display method of video calls is not limited to video display, and other display methods such as text display, mixed display, etc. can also be selected. For example, the XR wearer can determine whether to choose a downgraded display method (such as a text display method) or an upgraded display method (such as a mixed display method) based on the quality of the current call network. This method not only increases the diversity of video call display forms, but also meets the special needs of XR wearers.

[0013] In some embodiments, the mixed presentation mode is one of a text-voice presentation mode or a text-voice digital human presentation mode.

[0014] In this embodiment, the terminal device provides a mixed display mode to the user, which can display the second information corresponding to the first information in multiple aspects, which can not only improve the diversity of the display of the second information, but also improve the user experience.

[0015] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through a digital human other than the user image.

[0016] In this embodiment, the XR device displays the second information through a digital human with a non-user image (for example, a digital human with a cartoon image), which not only increases the fun of the information display but also improves the user experience.

[0017] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through a digital human of a user image.

[0018] XR devices display secondary information through a digital human of the user’s image (for example, a digital human with the XR wearer’s real facial expressions), which can simulate face-to-face communication scenarios and help improve the effectiveness of communication between the two parties.

[0019] In some embodiments, when the digital human video display method is a method of displaying the second information through a digital human with a user's image, the method also includes: sending authorization request information to the user terminal, the authorization request information is used to request whether the user agrees to display the second information through a digital human with his own image; receiving authorization reply information from the user terminal; when the authorization reply information indicates that the user agrees to display the second information through a digital human with his own image, displaying the second information through a digital human with the user's image; or, when the authorization reply information indicates that the user does not agree to display the second information through a digital human with his own image, displaying the second information through a digital human without the user's image.

[0020] In this embodiment, the terminal device sends an authorization request message to the user terminal to ask whether the other user agrees to exchange information with the wearer of the XR device using his or her own image, rather than directly using the other user's real image, thereby leaving room for choice for the other user, which can improve the user experience of both parties.

[0021] In some embodiments, the method further includes: the voice display method is a method of displaying the second information through simulated voice or real person voice.

[0022] In this embodiment, the terminal device provides a selectable voice presentation mode of simulated voice or real voice, which not only increases the diversity of the displayed second information, but also improves the user experience.

[0023] In some embodiments, the method also includes: obtaining third information, the third information is information on the terminal device; obtaining second operation information, the second operation information is used to indicate switching the third information from a preset display mode to a target display mode; in response to the second operation information, displaying the third information in the target display mode.

[0024] In this embodiment, the terminal device provides a variety of ways to display the third information, which not only increases the presentation methods of the third information but also improves the user experience.

[0025] In a second aspect, an embodiment of the present application provides a terminal device, the terminal device comprising a processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program from the memory, so that the terminal device executes any one of the methods in the first aspect.

[0026] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor executes any one of the methods in the first aspect.

[0027] In a fourth aspect, an embodiment of the present application provides a computer program product, the computer program product comprising: a computer program code, when the computer program code is executed by a terminal device, the terminal device executes any one of the methods in the first aspect.

[0028] In the fifth aspect, an embodiment of the present application provides a chip system, which includes a processing circuit and a storage medium, in which computer program instructions are stored; when the computer program instructions are executed by the processing circuit, the method described in the first aspect and various possible implementations of the first aspect is implemented.

[0029] Optionally, the processing circuit in the above chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system can also include a communication interface, and the communication interface is used to realize communication between the chip system and an external device.

[0030] The beneficial effects of the technical solutions in the second, third, fourth and fifth aspects of the present application are the same as the beneficial effects of the technical solution in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 A schematic diagram of the structure of a terminal device 100 provided in an embodiment of the present application;

[0032] Figure 2 A schematic diagram of the software structure of a terminal device 100 provided in an embodiment of the present application;

[0033] Figure 3 A schematic diagram of a virtual interface of an XR device provided in an embodiment of the present application;

[0034] Figure 4 A schematic diagram of the main interface of an XR device provided in an embodiment of the present application;

[0035] Figure 5A schematic diagram of a method for displaying information provided in an embodiment of the present application;

[0036] Figure 6 A schematic diagram of a call interface applicable to the present application provided in an embodiment of the present application;

[0037] Figure 7 A schematic diagram of a video interface applicable to the present application provided in an embodiment of the present application;

[0038] Figure 8 A schematic diagram of a call interface and a video interface applicable to the present application provided in an embodiment of the present application;

[0039] Fig. 9 A schematic diagram of another call interface and video interface applicable to the present application provided in the embodiment of the present application;

[0040] Fig.10 A schematic diagram of another call interface and video interface applicable to the present application provided in the embodiment of the present application;

[0041] Fig.11 A schematic diagram of another call interface and video interface applicable to the present application provided in the embodiment of the present application;

[0042] Fig.12 A schematic diagram of another call interface and video interface applicable to the present application provided in the embodiment of the present application;

[0043] Fig.13 A schematic diagram of a video call interface applicable to the present application provided in an embodiment of the present application;

[0044] Fig.14 A schematic diagram of another video call interface applicable to the present application provided in an embodiment of the present application;

[0045] Fig.15 A schematic diagram of another video call interface applicable to the present application provided in an embodiment of the present application;

[0046] Fig.16 A schematic diagram of a short message interface applicable to the present application provided in an embodiment of the present application;

[0047] Fig.17 A schematic diagram of another short message interface applicable to the present application provided in the embodiment of the present application;

[0048] Fig.18 A schematic diagram of an interface for creating a conference provided in an embodiment of the present application;

[0049] Fig.19 A schematic diagram of a conference interface provided in an embodiment of the present application;

[0050] Fig. 20 A schematic diagram of another conference interface provided in an embodiment of the present application;

[0051] Fig.21 A schematic diagram of another conference interface provided in an embodiment of the present application;

[0052] Fig. 22 A schematic diagram of the process steps of a method for displaying information on an XR device provided in an embodiment of the present application;

[0053] Fig.23 A schematic diagram of the process steps of another method for displaying information on an XR device provided in an embodiment of the present application;

[0054] Fig.24 A schematic diagram of the process steps of a method for displaying text messages on an XR device provided in an embodiment of the present application;

[0055] Fig.25 A schematic diagram of the process steps of a method for displaying a voice call on an XR device provided in an embodiment of the present application;

[0056] Fig.26 A schematic diagram of the process steps of a method for displaying a video call on an XR device provided in an embodiment of the present application;

[0057] Fig. 27 A schematic diagram of the interface process steps of a method for displaying information on an XR device provided in an embodiment of the present application;

[0058] Fig.28 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0060] Figure 1 A schematic structural diagram of a terminal device 100 is shown.

[0061] The terminal device 100 may include, but is not limited to, at least one of an augmented reality (AR) device, a virtual reality (VR) device, and an XR device. The embodiment of the present application does not impose any special restrictions on the specific type of the terminal device 100.

[0062] The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, an indicator 191, a subscriber identification module (SIM) card interface 192, Bluetooth 193, a positioning device 194 and a display screen 194, etc.

[0063] It is understandable that the structure shown in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include Figure 1 More or fewer components, or combining some components, or splitting some components, or different arrangements of components. Figure 1 The components in the present invention may be implemented in hardware, software, or a combination of software and hardware.

[0064] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0065] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0066] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that have been used or are frequently used by the processor 110. If the processor 110 needs to use the instruction or data, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0067] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The processor 110 may be connected to a touch sensor, an audio module, a wireless communication module, a display, a camera, and other modules through at least one of the above interfaces.

[0068] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0069] The USB connector 130 is an interface that complies with the USB standard specification and can be used to connect the terminal device 100 and peripheral devices. Specifically, it can be a Mini USB connector, a Micro USB connector, a USB Type C connector, etc. The USB connector 130 can be used to connect a charger to enable the charger to charge the terminal device 100, and can also be used to connect other terminal devices to enable data transmission between the terminal device 100 and other terminal devices. It can also be used to connect headphones to output audio stored in the terminal device through the headphones. The connector can also be used to connect other terminal devices, such as VR devices. In some embodiments, the standard specifications of the universal serial bus can be USB1.x, USB2.0, USB3.x and USB4.

[0070] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB connector 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. While the charging management module 140 is charging the battery 142, it may also power the terminal device through the power management module 141.

[0071] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display screen 194 and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0072] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0073] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0074] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0075] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0076] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0077] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other terminal devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0078] The terminal device 100 can realize the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0079] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card. Or files such as music and videos are transferred from the terminal device to the external memory card.

[0080] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (e.g., a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the terminal device 100 (e.g., audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the terminal device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0081] The terminal device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0082] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0083] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The terminal device 100 can listen to music or output an audio signal for a hands-free call through the speaker 170A.

[0084] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.

[0085] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal device 100 can be provided with at least one microphone 170C. In other embodiments, the terminal device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal device 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc.

[0086] The earphone interface 170D is used to connect a wired earphone and can be a USB connector 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0087] The sensor 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are used to convert various signals from the outside world into electrical signals or other required forms of information output.

[0088] The key 190 may include a power button, a volume button (for example, a user may adjust the volume of a broadcast message through the volume button), etc. The key 190 may be a mechanical key or a touch key. The terminal device 100 may receive a key input and generate a key signal input related to the user settings and function control of the terminal device 100.

[0089] The indicator 191 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate information (for example, the indicator light can indicate the broadcast information received by the Bluetooth application software through Bluetooth 193), missed calls, notifications, etc.

[0090] The SIM card interface 192 is used to connect a SIM card. The SIM card can be connected to and separated from the terminal device 100 by inserting it into the SIM card interface 192 or pulling it out from the SIM card interface 192. The terminal device 100 can support one or more SIM card interfaces 192. The SIM card interface 192 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 192 at the same time. The types of multiple cards can be the same or different. The SIM card interface 192 can also be compatible with different types of SIM cards. The SIM card interface 192 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0091] The terminal device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0092] The camera module 193 can be used to collect color image data and depth data of the photographed object, for example, the head portraits, facial expressions, etc. of the participants can be collected. The ISP can be used to process the color image data collected by the camera module 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera module 193.

[0093] In some embodiments, the camera module 193 may be composed of a color camera module and a 3D sensing module.

[0094] In some embodiments, the photosensitive element of the camera of the color camera module can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.

[0095] In some embodiments, the 3D sensing module may be a time of flight (TOF) 3D sensing module or a structured light 3D sensing module. Among them, structured light 3D sensing is an active depth sensing technology, and the basic components of the structured light 3D sensing module may include an infrared emitter, an IR camera module, etc. The working principle of the structured light 3D sensing module is to first emit a light spot of a specific pattern to the object being photographed, and then receive the light spot pattern coding (light coding) on ​​the surface of the object, and then compare the similarities and differences with the original projected light spot, and use the triangulation principle to calculate the three-dimensional coordinates of the object. The three-dimensional coordinates include the distance between the electronic device 100 and the object being photographed. Among them, TOF 3D sensing may be an active depth sensing technology, and the basic components of the TOF 3D sensing module may include an infrared emitter, an IR camera module, etc. The working principle of the TOF 3D sensing module is to calculate the distance (i.e., depth) between the TOF 3D sensing module and the object being photographed by the time when the infrared rays return to obtain a 3D depth map.

[0096] The structured light 3D sensing module can also be applied to face recognition, somatosensory game consoles, industrial machine vision inspection and other fields. The TOF 3D sensing module can also be applied to game consoles, augmented reality (AR) / virtual reality (VR) and other fields.

[0097] In other embodiments, the camera module 193 may also be composed of two or more cameras. The two or more cameras may include a color camera, which can be used to collect color image data of the photographed object. The two or more cameras may use stereo vision technology to collect depth data of the photographed object. Stereo vision technology is based on the principle of human eye parallax. Under natural light, two or more cameras are used to capture images of the same object from different angles, and then triangulation and other operations are performed to obtain the distance information between the electronic device 100 and the photographed object, that is, depth information.

[0098] In some embodiments, the electronic device 100 may include one or more camera modules 193. Specifically, the electronic device 100 may include one front camera module 193 and one rear camera module 193. The front camera module 193 may be used to collect color image data and depth data of the photographer facing the display screen 194, and the rear camera module may be used to collect color image data and depth data of the subject (such as a portrait and facial expression of a person) facing the photographer.

[0099] The display screen 194 is used to display data such as images, texts, and videos. For example, the display screen 194 can be used to display received text, audio, and video information. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or more display screens 194.

[0100] The above-mentioned terminal device 100 can also adopt other architectures. The embodiment of the present invention can also take the Harmony system as an example to exemplarily illustrate the software architecture of the terminal device 100.

[0101] Figure 2 It is a schematic diagram of the software structure of the terminal device 100 according to an embodiment of the present application.

[0102] In some implementations, the Harmony system includes four layers, namely, from bottom to top, a kernel layer, a system basic service layer, a framework layer, and an application layer.

[0103] The Harmony system adopts a multi-kernel design, optionally including the Linux kernel, Hongmeng microkernel and the lightweight IoT operating system kernel (Lite Operating System, LiteOS). Through this design, devices with different device capabilities can choose the appropriate system kernel. The kernel layer also includes the Kernal Abstract Layer, which provides basic kernel capabilities for other Harmony layers, such as process management, thread management, memory management, file system management, network management, and peripheral management.

[0104] The system basic service layer is the core capability set of the Harmony system, which supports the Harmony system to provide services to application services through the framework layer in the scenario of multi-device deployment. This layer can optionally include the following parts:

[0105] System basic capability subsystem set: provides basic capabilities for the operation, scheduling, migration and other operations of distributed applications on multiple devices in the Harmony system, and consists of distributed soft bus, distributed data management and file management, distributed task scheduling, Ark runtime, distributed security and privacy protection, etc. Among them, the Ark runtime provides C / C++ / JavaScript multi-language runtime and basic system class libraries, and also provides runtime for Java programs statically compiled using the Ark compiler (i.e., the part developed in Java language in the application or framework layer).

[0106] Basic software service subsystem set: Provides public and general software services for the Harmony system, and consists of subsystems such as graphics and images, distributed media, distributed AI, multi-mode input, mobile sensing platform (MSDP) & device virtualization technology (DV), event notification, telephone service, and design for product non-functional attributes (DFX). The basic software service subsystem set can be tailored according to the functional granularity based on the deployment environment of different device forms.

[0107] Enhanced software service subsystem set (see Figure 2 Enhanced software part (within the dotted line): Provides differentiated capability-enhanced software services for different devices for the Harmony system, and consists of subsystems such as tablet business software, smart screen business software, car business software, and Internet of Things (IoT) business software. The enhanced software service subsystem set can be tailored at the subsystem granularity according to the deployment environment of different device forms, and each subsystem can be tailored at the functional granularity.

[0108] Harmony Driver Foundation (HDF) and Hardware Abstraction Layer (HAL): are the foundation for the openness of the Harmony system hardware ecosystem, providing hardware capability abstraction to the hardware upward and providing a development framework and operating environment for various peripheral drivers downward.

[0109] Hardware service subsystem set: Provides common and adaptive hardware services for the Harmony system, and consists of hardware service subsystems such as pan-sensor, location, power, USB, biometrics, etc. The hardware service subsystem set can be tailored according to the functional granularity based on the deployment environment of different device forms.

[0110] Proprietary hardware service subsystem (see Figure 2 Proprietary hardware part (with dotted lines in the middle): Provides differentiated hardware services for different devices for the Harmony system, which may include tablet proprietary hardware services, car proprietary hardware services, wearable proprietary hardware services, IoT proprietary hardware services and other subsystems. The proprietary hardware service subsystem can be tailored according to the subsystem granularity, and each subsystem part can be tailored according to the functional granularity.

[0111] The framework layer provides the Harmony system's applications with a user program framework and meta-capability framework in multiple languages, such as Java / C / C++ / JavaScript, as well as a multi-language framework application programming interface (API) that opens up various software and hardware services to the outside world.

[0112] The application layer includes system applications and third-party applications (or extended applications), which can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth application software, music, video, short message, etc. Applications in the Harmony system are built based on atomic capabilities (AA) and feature capabilities (FA).

[0113] The following has Figure 1 and Figure 2 Taking the XR device (e.g., an XR head display device) of the structure shown as an example, combined with the method for displaying information provided in the present application, the workflow of the software system and the hardware system of the terminal device 100 is exemplarily described.

[0114] Figure 3 An application scenario suitable for this application is shown. Figure 3 The virtual user interface of the XR device is displayed in the area 301 shown in the figure. The wearer of the XR device (hereinafter referred to as the XR wearer) can directly log in or register an account to enter the main interface 401 of the XR device, such as Figure 4 As shown in (a); the main interface 401 displays some application software installed on the XR device, such as call applications, video applications, short message applications, conference applications, etc. Figure 4 As shown in 401, the call application is used for the XR wearer to establish a voice call with other users, the video application is used for the XR wearer to establish a video call with other users, the short message application is used for the XR wearer to communicate with other users via text messages, and the conference application is used for the XR wearer to create a multi-person virtual conference according to his own needs.

[0115] For example, the XR wearer can click on the call application on the main interface 401, select the contact M to whom he wants to call, and initiate a call request to the contact M, or receive call requests from other contacts. For example, taking the example that the XR wearer selects the text display method to display the call content of the call between himself and other contacts, after the XR device receives the call request from the contact Wang XX, the XR wearer can Figure 4 On the call interface 402 shown in (b) in the figure, the user selects any one of the text display mode, voice display mode, digital human video display mode and mixed display mode to display the content of the call between himself and Wang XX; if the XR wearer clicks the text display mode 403 on the call interface 402, as shown in Figure 4 As shown in (b) in the figure, the call application responds to the single-click operation and generates a text display start request; the call application sends the text display start request to the event notification management service subsystem of the framework layer through the application layer; the event notification management service subsystem generates an event for starting the text display mode according to the received text display start request, and then sends the event for starting the text display mode to the call driver module of the Hongmeng driver framework layer through the hardware abstraction layer; at this time, the call driver module generates an instruction for starting text display according to the event for starting the text display mode, and sends the instruction for starting text display to the call hardware module; the call hardware module starts the text display mode according to the instruction for starting the text display to display the call content during the call between the XR wearer and Wang XX.

[0116] It should be noted that the following embodiments of the present application will be based on Figure 1 and Figure 2 Taking the terminal device 100 of the structure shown as an example, the method for displaying information provided by the embodiment of the present application is specifically described in combination with the accompanying drawings and application scenarios. It should be understood that the terminal device to which this method is applicable is not limited to Figure 1 and Figure 2 The hardware and software structure shown in the figure can be adjusted according to the specific application scenario in actual application. Figure 1 and Figure 2 The hardware and software system architecture shown may be modified, and this application does not limit this.

[0117] Next, we still have Figure 1 and Figure 2 Taking the terminal device with the structure shown as an example, the method for displaying information provided by the present application is introduced in detail in combination with different embodiments.

[0118] As can be seen from the background technology, in the XR scenario, the XR wearer can receive information such as text messages, calls and video calls through the XR device (for example, the XR head display device). However, the XR device has a relatively simple display method for the received text and video information, which cannot meet the user's needs. Therefore, this application proposes a method for displaying information, such as Figure 4 As shown; this method can solve the problem that the XR device display method is single and cannot meet user needs.

[0119] Before introducing the method for displaying information provided by the present application, a brief description is first given of the execution subject involved in the embodiments of the present application. In the embodiments of the present application, a terminal device is used as an example to illustrate the method provided by the present application, but the present application does not limit the execution subject.

[0120] For example, the execution subject involved in the embodiments of the present application may be a terminal device, or a chip, a chip system, or a processor applied to the terminal device, or a logical node, a logical module, or software that can implement all or part of the functions of the terminal device.

[0121] For example, the terminal device may be one of an XR device, a VR device, or an AR device; for example, the XR device may be an XR head-mounted display device (e.g., XR smart glasses); the VR device may be a VR head-mounted display device (e.g., VR smart glasses); and the AR device may be an AR head-mounted display device (e.g., AR smart glasses).

[0122] The following embodiments are described using an XR device as an example in which the execution subject of the method 500 for displaying information is a virtual user interface, and the XR wearer can perform a series of operations on the virtual user interface, such as creating a call, answering a call, creating a meeting, selecting an information display method, etc.

[0123] like Figure 5 As shown, it is a flowchart of a method 500 for displaying information provided in an embodiment of the present application. The method 500 includes S501 to S503. These steps are described in detail below.

[0124] S501: The XR device receives first information, where the first information is one of a text message, a call request, and a video request.

[0125] The first information may be information sent by other user terminals. In other words, the user terminal refers to a terminal device that sends the first information, wherein the user terminal may include but is not limited to a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, a cellular phone, a personal digital assistant (personal digital assistant, PDA), an AR device, a VR device, an artificial intelligence (artificial intelligence, AI) device, a wearable device, a vehicle-mounted device, a smart home device, or at least one of a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the user terminal.

[0126] For example, taking the example of other contacts sending a call request to the XR wearer, the other contacts send the first information to the XR device through the user terminal, and correspondingly, the XR device receives the first information.

[0127] For another example, contact A can send a call request (or text message or video request) to the XR device through a mobile phone, or send a call request (or text message or video request) to the XR device through an AR device.

[0128] After receiving the first information, the XR device usually displays the first information on a virtual user interface so that the XR wearer can choose whether to respond to the first information.

[0129] For example, the first message received by the XR device is a text message, and the XR wearer can view and reply to the text message in different display modes; for example, the XR wearer can choose the voice display mode to view the text message sent by the other party; the XR wearer can also view the text message sent by the other party through the digital human video display mode, for example, the XR device will display the other party's text message to the XR wearer in the form of a digital human; the XR wearer can also view the text message sent by the other party through a mixed display mode, for example, the XR wearer chooses to view the text message through the text voice display mode, and the XR device will display the text message to the XR wearer through the text voice display mode. Among them, the detailed description of the mixed display mode can be referred to the following embodiment, which will not be repeated here.

[0130] S502: The XR device obtains first operation information, where the first operation information is used to instruct to switch a display mode of second information corresponding to the first information from a preset display mode to a target display mode.

[0131] Among them, the first operation information may refer to the operation information of the XR wearer obtained by the XR device from the virtual user interface; for example, the XR wearer selects the target display mode to be switched on the virtual user interface, and the virtual user interface responds to the selection operation of the XR wearer and generates the first operation information.

[0132] It should be noted that the XR wearer can select the target display mode to be switched on the virtual user interface by touch, or can select the target display mode to be switched by the operating handle of the XR device. This application does not limit this.

[0133] In some embodiments, when the XR device receives the first information, it determines the information type of the first information. For example, if the information type of the first information is a text message, the XR device determines that the data type of the second information is text data; when the information type of the first information received by the XR device is a call request, the XR device determines that the data type of the second information is voice data; when the information type of the first information received by the XR device is a video request, the XR device determines that the data type of the second information is video data.

[0134] It should be noted that, usually, text data can be displayed in text form, voice data can be displayed in voice form, and video data can be displayed in video form.

[0135] The preset display mode may be a display mode preset by the XR device according to the data type of the second information, wherein the preset display mode may be a text display mode, a voice display mode, or a video display mode.

[0136] For example, the first information is a text message, and the second information corresponding to the first information is text data. The XR device can pre-set the preset display mode (also called default display mode) of the second information as a text display mode.

[0137] For another example, the first information is a call request, and the second information corresponding to the first information is voice data. The XR device can pre-set the preset display mode of the second information to be a voice display mode.

[0138] For another example, the first information is a video request, and the second information corresponding to the first information is video data. The XR device can preset the display mode of the second information as a video display mode. It should be noted that the video display mode usually refers to a video call established between the XR wearer and other contacts.

[0139] The above-mentioned target display method may include a text display method, a voice display method, a digital human video display method or a mixed display method; among which, the text display method may refer to a method of displaying the second information in the form of text; the voice display method may refer to a method of displaying the second information in the form of voice; the digital human video display method may refer to a method of displaying the second information through a video formed by a digital human; the mixed display method may refer to a method of displaying the second information through a text-voice display method or a text-voice digital human display method.

[0140] For example, the mixed display mode is a text and voice display mode formed by a text display mode and a voice display mode; another example is a text and voice digital human display mode formed by a text display mode, a voice display mode and a digital human video display mode. The details can be understood in conjunction with the following interface embodiments, and will not be repeated here.

[0141] It should be noted that the target display mode is a display mode different from the preset display mode. For example, if the preset display mode is a text display mode, the target display mode may be a display mode other than the text display mode, for example, the target display mode may be a voice display mode, a digital human video display mode, or a mixed display mode. Similarly, if the preset display mode is a voice display mode (or a video display mode), the target display mode may be a display mode other than the voice display mode (or a video display mode), for example, the target display mode may be a text display mode, a digital human video display mode, or a mixed display mode (or the target display mode may be a text display mode, a voice display mode, a digital human video display mode, or a mixed display mode).

[0142] After receiving the first information, the XR device will display the first information on the virtual user interface; the XR wearer can select the target display method on the virtual user interface; the virtual user interface generates the first operation information in response to the operation of the XR wearer; the XR device obtains the first operation information from the virtual user interface, and determines the display method of the second information according to the first operation information. For example, the first information is a text message, and the XR device displays the received text message on the virtual user interface in the form of a message reminder, and displays the selectable target display method (for example, text display method, voice display method, digital human video display method, etc.) on the virtual user interface; the XR wearer can select a suitable target display method according to his own needs, for example, the XR wearer can select the voice display method to view the text message; the virtual user interface generates the first operation information X in response to the voice display method selected by the XR wearer; the XR device plays the text message to the XR wearer through the voice display method according to the first operation information X. For details, please refer to the following interface embodiment for understanding, which will not be repeated here.

[0143] It should be noted that the XR wearer may not select the target display mode, but view the short message to be viewed in a preset display mode. For example, the first message is a short message, and the second message is text data. The XR wearer may select the default display mode to view the short message; the XR device responds to the default display mode selected by the XR wearer and displays the second message to the XR wearer in a preset text display mode.

[0144] It should also be noted that, in some embodiments, the voice display method is a method of displaying the second information through simulated voice or real voice. The simulated voice can refer to the intelligent voice of a cartoon character, the intelligent voice of a robot, or the intelligent voice that simulates the timbre of a character; the real voice can refer to the real voice of the XR wearer and the contact.

[0145] For example, when the XR wearer chooses the real voice display mode to display the second information, the XR device will use the real voice of the XR wearer and the real voice of the contact to display the communication information between the two.

[0146] For another example, when the XR wearer selects the simulated voice display mode to display the second information, the XR device will display the communication information between the two in a preset simulated voice. It should be understood that the XR wearer can select the voice simulated by different character timbres.

[0147] In this embodiment, the XR device provides the XR wearer with a voice presentation mode of simulated voice or real voice that can be selected, which not only increases the diversity of the displayed second information, but also improves the user experience.

[0148] S503: The XR device displays the second information in a target display manner in response to the first operation information.

[0149] Exemplarily, the XR device responds to the first operation information, determines the target display mode according to the first operation information, and then displays the second information through the target display mode. For example, the first operation information indicates that the target display mode selected by the XR wearer is the digital human video display mode. The XR device switches the second information from the preset display mode to the digital human video display mode according to the first operation information, and displays the second information to the XR wearer through the digital human video display mode. For details, please refer to the interface embodiment below, which will not be repeated here.

[0150] To sum up, compared with the prior art, after the XR device receives the first information, it usually displays the second information in a preset display method, and the XR wearer cannot select the display method according to his own needs. The present application provides the XR wearer with an optional target display method, which can facilitate the XR wearer to flexibly select the display method of the second information according to his own needs. Correspondingly, the XR device can also flexibly display the second information to the XR wearer in a target display method according to the first operation information of the XR wearer, which can not only meet the needs of the XR wearer but also improve the XR wearer experience.

[0151] In some embodiments, when the first information is a text message, the preset display mode is a text display mode, and the target display mode is a voice display mode, a digital human video display mode, or a mixed display mode.

[0152] When the first information is a text message, it means that the XR device has received the text information. At this time, the second information corresponding to the first information is text data. Generally, the text data is displayed in a text display method, wherein the text display method includes but is not limited to a text dialog box display method, a text box display method, a graphic display method, and a text table display method.

[0153] For example, when the first information is a text message, the XR device displays the second information (for example, the content of the text message) through text display by default; when the XR wearer selects the target display method on the virtual user interface of the XR device, the XR device will display the second information according to the target display method; for example, when the XR wearer selects the voice display method (or the digital human video display method or the mixed display method) to view the text message, the XR device will display the second information to the XR wearer through voice playback (or the digital oral method or the mixed display method).

[0154] It should be noted that the voice display method can be voice playback or robot dictation; the digital human video display method can be a digital human display method of the user image (for example, real-life facial expressions) or a digital human display method of a non-user image (for example, a cartoon character); the mixed display method can be a text-voice display method or a text-voice digital human display method (wherein the digital human can be a digital human with a user image or a non-user image).

[0155] Compared with the prior art where SMS is usually displayed in text format, in the present application, the display method of SMS is not limited to text display method, but can also be displayed in other ways such as voice display method, digital human video display method, etc., which increases the diversity of SMS display forms, meets user needs, and improves user experience.

[0156] In some embodiments, when the first information is a call request, the preset display mode is a voice display mode, and the target display mode is a text display mode, a video display mode, or a combination of one or more digital human video display modes.

[0157] When the first information is a call request, it means that the XR device has received a voice call request from other contacts; the XR wearer can establish a voice call with other contacts; the data type of the second information during the voice call (for example, the voice call content) is voice data; generally, voice data can be displayed through voice display, for example, the XR device receives a voice call request from other contacts and establishes a voice call with the user terminal of the other contacts; the XR device can display the content of the voice call through the target display method selected by the XR wearer.

[0158] For example, when the network signal is poor, the XR wearer can choose to display the text to make voice calls with other contacts. For example, the voice calls between the XR wearer and other contacts are displayed in the form of a text dialog box.

[0159] For another example, when the network signal is good, the XR wearer can choose the digital human video display method to make voice calls with other contacts, for example, the voice calls between the XR wearer and other contacts are displayed in the form of cartoon digital human combined with dialog boxes, that is, the voice calls between the XR wearer and other contacts are displayed in the form of text digital human display. For details, please refer to the interface embodiment below, which will not be repeated here.

[0160] In this embodiment, compared with the prior art in which voice calls are usually displayed in a voice display mode, in the present application, the display mode of voice calls is not limited to the voice display mode, and other display modes such as text display mode and digital human video display mode can also be selected. For example, the XR wearer can determine whether to choose a downgraded display mode (for example, a text display mode) or an upgraded display mode (for example, a digital human video display mode) according to the quality of the current call network. This method not only increases the diversity of voice call display forms, but also meets the special needs of XR wearers.

[0161] In some embodiments, when the first information is a video request, the preset display mode is a video display mode, and the target display mode is a combination of one or more of a text display mode, a voice display mode, or a digital human video display mode.

[0162] When the first information is a video request, it means that the XR device has received a video call request from another contact; the XR wearer can establish a video call with other contacts; the data type of the second information during the video call (for example, the content of the video call) is video data; by default, the video data can be displayed through a video display method, for example, the XR device receives a video call request from another contact and establishes a video call with the user terminal of the other contact; the XR device can display the video call through the target display method selected by the XR wearer (for example, a text display method).

[0163] For example, when the network signal is poor, the XR wearer can choose to make video calls with other contacts in a text display mode, for example, displaying the video call between the XR wearer and other contacts in the form of a text dialog box.

[0164] For example, when the network signal is good, the XR wearer can choose a mixed display mode to make a video call with other contacts, for example, a video call between the XR wearer and other contacts can be displayed through a text, voice, and digital human video display mode. For details, please refer to the interface embodiment below, which will not be repeated here.

[0165] In this embodiment, compared with the prior art in which video calls are usually displayed using video display methods, in the present application, the display method of video calls is not limited to video display methods, and other display methods such as text display methods and mixed display methods can also be selected. For example, the XR wearer can determine whether to choose a downgraded display method (for example, a text display method) or an upgraded display method (for example, a mixed display method) based on the quality of the current call network. This method not only increases the diversity of video call display methods, but also meets the special needs of XR wearers.

[0166] It should be noted that, in some embodiments, the hybrid display mode is one of a text-speech display mode or a text-speech digital human display mode. The hybrid display mode includes a text-speech display mode and a text-speech digital human display mode. Among them, the text-speech display mode may refer to a display mode formed by combining a text display mode and a speech display mode; the text-speech digital human display mode may refer to a display mode formed by combining a text display mode, a speech display mode and a digital human video display mode.

[0167] In this embodiment, the XR device provides a hybrid display method to the XR wearer, which can display the second information corresponding to the first information in multiple directions. This not only improves the diversity of the display of the second information, but also improves the user experience.

[0168] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through a digital human other than the user image.

[0169] Among them, the non-user-image digital human can refer to a 3D digital human with a cartoon character's facial expression, a 3D digital human in the form of a robot, or a 3D digital human formed by a virtual character, and this application does not limit this.

[0170] When the target display method selected by the XR wearer is the digital human video display method, the XR device can display the second information to the user in the form of a digital human without the user's image; for example, the first information is a short message, and the second information is text data. The XR wearer can select a digital human with a cartoon character's facial expression to view the text message content. For details, please refer to the interface implementation example below, which will not be repeated here.

[0171] In this embodiment, the XR device displays the second information through a digital human with a non-user image (for example, a digital human with a cartoon image), which not only increases the fun of the information display but also improves the user experience.

[0172] In some embodiments, the digital human video display method is a method of displaying the second information through a digital human of a user image.

[0173] Among them, the digital human of the user's image can refer to a digital human with the user's real facial expressions (for example, a digital human with the real facial expressions of the XR wearer), or it can refer to a digital human with a real person's image (for example, a real-life full-body image of the XR wearer), and this application does not limit this.

[0174] When the target display method selected by the XR wearer is the digital human video display method, the XR device can display the second information to the user in the form of a digital human with the user's image; for example, the first information is voice, and the second information is voice data. The XR wearer can select a digital human with real facial expressions to display the content of the voice call. For details, please refer to the interface implementation example below, which will not be repeated here.

[0175] In this embodiment, the XR device displays the second information through a digital human of the user's image (for example, a digital human with the XR wearer's real facial expression), which can simulate a face-to-face communication scenario and help improve the effectiveness of communication between the two parties.

[0176] In some embodiments, when the digital human video display method is a method of displaying the second information through a digital human with a user image, method 500 also includes: the XR device sends authorization request information to the user terminal, and the authorization request information is used to request whether the user agrees to display the second information through a digital human with his own image; the XR device receives authorization reply information from the user terminal; when the authorization reply information indicates that the user agrees to display the second information through a digital human with his own image, the second information is displayed through the digital human with the user image; or, when the authorization reply information indicates that the user does not agree to display the second information through a digital human with his own image, the second information is displayed through a digital human other than the user image.

[0177] Among them, when the user sends the first information to the XR device through the user terminal, the XR wearer can select the target display method according to the first information. When the XR wearer selects the digital human video display method, he can further choose whether to display the second information corresponding to the first information through the digital human of the user image or to display the first information through the digital human of the non-user image. When the XR wearer chooses to display the second information through the digital human of the user image, the XR device will send an authorization request message to the user terminal to ask whether the other user agrees to communicate with the XR wearer in his own image; when the XR device receives the authorization reply message sent by the user terminal, the XR device will display the second information through the digital human of the user image; when the XR device receives the authorization reply message sent by the user terminal indicating that the user does not agree to display the second information through the digital human of his own image, the XR device can display the second information through the digital human of the non-user image.

[0178] In this embodiment, the XR device sends an authorization request message to the user terminal to ask whether the other user agrees to exchange information with the XR wearer in the form of his or her own image, rather than directly using the other user's real image, thus leaving room for choice for the other user, which can improve the user experience of both parties.

[0179] In some embodiments, the method also includes: the XR device obtains third information, the third information is information on the XR device; the XR device obtains second operation information, the second operation information is used to indicate switching the third information from a preset display mode to a target display mode; the XR device responds to the second operation information and displays the third information in the target display mode.

[0180] Among them, the third information can be file information stored locally on the XR device, or it can be web page content downloaded by the XR wearer through the XR device, or it can be historical meeting content, which is not limited in this application; please refer to the interface implementation example below for details, and no further details will be given here.

[0181] When the XR wearer wants to display file information stored locally on the XR device, he can select a target display method for displaying third information (for example, text information) on the virtual user interface. At this time, the virtual user interface generates second operation information in response to the XR wearer's operation; the XR device switches the display method of the third information from a preset display method to a target display method according to the target display method indicated by the second operation information; the XR device displays the third information to the XR wearer in the target display method.

[0182] For example, the XR device obtains third information (for example, historical meeting content); the XR wearer selects digital human video to display the third information on the virtual user interface. At this time, the virtual user interface generates second operation information and sends the second operation information to the XR device; the XR device receives the second operation information and displays the third information to the XR wearer through digital human video display according to the second operation information.

[0183] In this embodiment, the XR device provides a variety of ways to display the third information, which not only increases the presentation methods of the third information but also improves the user experience.

[0184] The method 500 and possible implementations are introduced in detail above. The method 500 and possible implementations are further explained below in conjunction with interface embodiments of different application scenarios.

[0185] like Figure 4 As shown, in Figure 4 The call interface 402 shown in (b) in FIG. 1 shows a call request from contact Wang XX; the XR wearer can click on the text display mode 403 to answer the voice call from Wang XX; when the XR wearer answers the voice call from Wang XX in the text display mode, as shown in FIG. Figure 6 As shown in (a) in the figure, a text display interface 601 may be displayed on the call interface 402; the call information (or call content) between the XR wearer and the contact Wang XX may be displayed in text form on the interface 601.

[0186] In some embodiments, the XR wearer can also Figure 6 In the target display mode shown in the interface 601 below (a), select a new target display mode, for example, select "digital human video display mode 602"; of course, you can also return to Figure 4 Reselect the target display mode on the call interface 402 shown in (b) in the figure, for example, select the digital human video display mode 404.

[0187] For example, when an XR wearer is Figure 6When "digital human video display mode 603" is selected on the call interface 402 shown in (b), a selection box 604 will pop up on the call interface 402; the XR wearer can select the desired display mode in the selection box 604, for example, select the display mode of the text digital human 605, and select the display mode of the non-user image 606; at this time, the XR device will jump from the call interface 402 to the video interface 701, and the XR device will display the call information between the XR wearer and the contact Wang XX through the text box 702 and the cartoon character 703, as shown in FIG. Figure 7 As shown in (a) in .

[0188] It should be noted that the XR wearer can also reselect a new target display mode on the video interface 701. At this time, the XR device can switch from the current display mode to the target display mode; for example, Figure 7 As shown in (a) of FIG. 7 , when the XR wearer reselects the voice display mode 704 on the video interface 701, in response to the XR wearer's selection, the XR device can switch from the text digital human display mode to the voice call interface 705, as shown in FIG. Figure 7 As shown in (b) in .

[0189] For example, Figure 8 As shown in (a) in FIG. 4 , when the XR wearer selects “digital human video display mode 603” on the call interface 402, a selection box 604 will pop up on the call interface 402; the XR wearer can select the voice digital human 801 and the non-user image 802 on the selection box 604; at this time, the XR device will jump from the call interface 402 to the video interface 701, and the XR device will display the call information between the XR wearer and the contact Wang XX orally in the form of a cartoon character 803 making a phone call, as shown in FIG. Figure 8 As shown in (b) in .

[0190] For example, Fig. 9 As shown in (a) in FIG. 6 , the XR wearer can select the display mode of the video digital human 901 and the display mode of the non-user image 902 in the selection box 604; at this time, the XR device jumps from the call interface 402 to the video interface 701, and the XR device displays the call information between the XR wearer and the contact Wang XX in the form of face-to-face communication between the cartoon characters 903 and 904, as shown in FIG. Fig. 9 As shown in (b) in .

[0191] In some embodiments, the XR wearer can Fig.10 Select the mixed display mode on the call interface 402 shown in (a) of FIG. 1 ; when the XR wearer Fig.10When "Mixed Display Mode 1001" is selected on the call interface 402 shown in (a) of FIG. 1 , a selection box 1002 will pop up on the call interface 402; the XR wearer can select text and speech 1003 and select a user image 1004 on the selection box 1002; at this time, Fig.10 As shown in (a), the XR device can jump from the call interface 402 to the video interface 701, and the XR device displays the call information between the XR wearer and the contact Wang XX in the form of a text box 1005 and a voice call 1006.

[0192] It should be noted that the XR wearer can also choose to switch to a new target display mode on the video interface 701, for example Fig.10 As shown in (b) in the figure, select voice display mode 1007.

[0193] In some embodiments, Fig.11 As shown, the XR wearer can also select the display mode of the text and voice digital human 1101 and the display mode of the non-user image 1102 in the selection box 1002, such as Fig.11 As shown in (a) in FIG. 1 ; the XR device jumps from the call interface 402 to the video interface 701, and the XR device displays the call information between the XR wearer and the contact Wang XX in the form of a cartoon character image 1103, a text box 1104, and a cartoon character image 1105 and a text box 1106 of the XR wearer, as shown in FIG. Fig.11 As shown in (b) in .

[0194] In some embodiments, the XR wearer selects the text-speech digital human display mode 1101 in the selection box 1002, and can also select the display mode of the user image 1201, such as Fig.12 As shown in (a) in the figure; at this time, the XR device will send an authorization request message to the user terminal used by Wang XX; when Wang XX agrees to display the call information of both parties through the digital human image of his own image, the XR device obtains the real image of Wang XX (for example, real facial expressions), for example, obtains the real image of the contact Wang XX from the local database; at the same time, the XR device will jump from the call interface 402 to the video interface 701, and the XR device will display the call information between the XR wearer and the contact Wang XX in the form of a digital human image 1202 with real facial expressions of Wang XX, a text box 1203, and a digital human image 1204 with real facial expressions of the XR wearer and a video of the content of the text box 1205, as shown in FIG. Fig.12 As shown in (b) in .

[0195] Fig.13 Another application scenario suitable for this application is shown. Fig.13 As shown, in Fig.13The video call interface 1301 shown in (a) in FIG. 1 shows a video request sent by contact Wang XX; the XR wearer can click on the text display mode 1302 to answer Wang XX's video call; after the XR wearer chooses to answer Wang XX's video call in text display mode, an online message interface 1303 in text display mode will be displayed on the video call interface 1301, such as Fig.13 As shown in (b) in FIG. 1303 ; the video call information (or video call content) between the XR wearer and the contact Wang XX will be displayed in text form on the interface 1303 ; the XR wearer can Fig.13 Enter the text to be sent in the text input box 1304 shown in (b).

[0196] It should be noted that XR wearers can also Fig.13 Reselect a new target display mode on the video call interface 1301 shown in (b) of FIG. 1304 , for example, select “video display mode 1305”; of course, you can also return to Fig.13 Reselect the target display mode on the video call interface 1301 shown in (a) of FIG. Fig.14 As shown in (a) in the figure, select "Video Display Mode 1401"; when the XR wearer chooses to answer Wang XX's video call in video display mode, a call window 1402 with Wang XX's real image 1403 will be displayed on the video call interface 1301, and the call window 1402 also displays the XR wearer's real image 1404, as shown in FIG. Fig.14 As shown in (b) in .

[0197] In some embodiments, the XR wearer can also Fig.15 Reselect the digital human video display mode 1502 on the video call interface 1301 shown in (a); when the XR wearer chooses to answer Wang XX's video call in the digital human video display mode 1502, a selection box 1503 will pop up on the video call interface 1301; the XR wearer can select the desired display mode in the selection box 1503, for example, select the display mode of the voice digital human 1504, and select the display mode of the non-user image 1505; the XR device will switch from the voice call window 1501 on the video call interface 1301 to the digital human face-to-face communication video interface 1506, as shown in FIG. Fig.15 As shown in (b) in the figure, the video interface 1506 includes a cartoon character image 1507 of the XR wearer and a cartoon character image 1508 of Wang XX.

[0198] Fig.16 Another application scenario suitable for this application is shown. Fig.16As shown, the XR device receives a short message (i.e., SMS) sent from the contact Wang XX using a mobile phone; at this time, the XR device will generate a message reminder text box on the short message interface 1601; the XR wearer can choose "not to view for now", or choose text display mode 1602, voice display mode 1603, etc. to view.

[0199] In some embodiments, if the XR wearer selects the text display mode 1602 to view the text message, the message viewing window 1608 will be displayed on the short message interface 1601, such as Fig.16 As shown in (b) in FIG. 1 , at this time, the XR wearer can see the text message content 1609 sent by Wang XX, and accordingly, can also reply in the text input box 1610 according to the text message content 1609 seen. It should be noted that the XR wearer can also choose to switch to a new target display mode on the short message interface 1601, for example, Fig.16 As shown in (b) in the figure, select voice presentation mode or mixed presentation mode (as shown in 1611).

[0200] In some embodiments, Fig.16 As shown in (a) of FIG. 1 , if the XR wearer selects the voice display mode 1603 to view the text message, then Fig.17 As shown in (a) of FIG. 1 , a message viewing window 1701 is displayed on the short message interface 1601; the XR wearer can listen to the text message content 1702 sent by Wang XX through voice playback in the window 1701. It should be noted that the XR wearer can also choose to switch to a new target display mode on the short message interface 1601, for example, Fig.16 As shown in (b) in the figure, select voice presentation mode or mixed presentation mode (as shown in 1612).

[0201] In some embodiments, Fig.16 As shown in (a) of FIG. 1 , if the XR wearer selects the mixed display mode 1604 to view the text message, and selects the non-user image 1607 and the text-speech digital human display mode 1606, then Fig.17 As shown in (b) of FIG. 1 , a cartoon character digital human video window 1703 is displayed on the short message interface 1601; wherein the video window 1703 includes a cartoon character image 1704 of Wang XX and a corresponding text box 1705, and a cartoon character image 1706 of the XR wearer and a corresponding text box 1707. The video window 1703 shows the information communication process between Wang XX and the XR wearer.

[0202] Fig.18 Another application scenario suitable for this application is shown. Fig.18As shown in (a) in FIG. 1 , the XR device provides a “Create Meeting 1801” option on the main interface 401. The XR wearer can select the “Create Meeting 1801” option on the main interface 401, and a selection box 1802 can pop up on the main interface 401. The XR wearer can select a presentation format for the meeting on the selection box 1802, for example, selecting “Text Presentation Mode 1803”. The XR device will switch from the main interface 401 to the meeting interface 1804, as shown in FIG. Fig.18 As shown in (b) in the figure; the XR wearer can select meeting participants in the contact area 1805, for example, select contact X1, contact X3, contact X5 and contact X7, and the selected contacts will be displayed in area 1806; the XR wearer clicks the "√" button, and the participants of this meeting will be displayed in the participant list 1807; because the XR wearer selects "text display mode", on the meeting content interface 1808, each participant has communicated the content of the meeting in text form.

[0203] It should be noted that the XR wearer can also reselect the target display mode to be switched in the display mode switching area 1809, for example, selecting "voice display mode 1810". Fig.19 As shown in (a) in the figure, the conference content interface 1808 will display an interface 1901 for each participant to communicate the conference content through voice.

[0204] For example, Fig.18 As shown in (a) of FIG. 1 , the XR wearer selects the conference presentation mode as text and voice presentation mode 1811 in the selection box 1802; the XR device switches from the main interface 401 to Fig.19 Similarly, the XR wearer can select meeting participants in the contact area 1805. Please refer to the above description, which will not be repeated here. Since the XR wearer selects "text and voice display mode", on the meeting content interface 1808, each participant can communicate the meeting content through voice 1902 and text form 1903, such as Fig.19 As shown in (b).

[0205] For example, Fig.18 As shown in (a) of FIG. 1 , the XR wearer selects the digital human video display mode 1812 as the conference display mode in the selection box 1802, and selects the non-user image 1813 for display; the XR device switches from the main interface 401 to the Fig. 20The conference interface 1804 shown in (a) of FIG. 1804; the method for the XR wearer to select the conference participants can refer to the above description, which will not be repeated here; because the XR wearer selects the "digital human video display method", therefore, on the conference content interface 1808, each participant can communicate the content of the conference through the virtual conference form 2001, such as Fig. 20 As shown in (a) in .

[0206] For example, Fig.18 As shown in (a) of FIG. 1 , the XR wearer selects the conference presentation mode as text-voice digital human presentation mode 1814 in the selection box 1802 and selects the non-user image 1813; the XR device switches from the main interface 401 to Fig. 20 The conference interface 1804 is shown in (b); the way in which the XR wearer selects the meeting participants can refer to the relevant description above and will not be repeated here; because the XR wearer selects the "text voice digital human display method", therefore, on the conference content interface 1808, each participant can communicate on the content of the meeting through the virtual conference form 2002 with text display.

[0207] Fig.21 Another application scenario suitable for the present application is shown. Fig.21 The application scenario shown is used to illustrate that the XR device can also display historical meeting content and local data through text display, voice display, etc.

[0208] For example, Fig.21 As shown in (a) of FIG. 1 , the XR wearer can select the content to be displayed in the display mode selection area 2101, for example, Fig.21 As shown in (a), select the "historical meeting materials" option 2102 to be displayed, and select the "text display method 2103"; the XR device responds to the selection of the XR wearer and displays the historical meeting content interface 2104 on the meeting interface 1804; the interface 2104 will display the previous meeting materials and the historical speech records of each participant.

[0209] For example, Fig.21 As shown in (b), the XR wearer can click the "local data 2105" option to be displayed in the display mode selection area 2101, and select the "digital human video display mode 2106"; the XR device responds to the selection of the XR wearer and displays the local data interface 2107 on the conference interface 1804; the local data will be displayed on the interface 2107, where the local data can be web page content, or local text files, voice files or video files, etc., which are not limited in this application.

[0210] For ease of understanding, the following Figure 22 to Figure 28 The specific embodiment shown further illustrates the method for displaying information proposed in the present application.

[0211] like Fig. 22 As shown, a process step of a method for displaying information by an XR device is shown; the XR device includes a voice conversion unit, a text conversion unit and a digital human rendering module, wherein the voice conversion unit is used to convert SMS data (also known as text data) and video data into voice data; the text transcription unit is used to convert voice data and video data into text data; the digital human rendering module is used to generate various non-user images (for example, cartoon character images); it should be noted that the voice data may refer to data generated during a voice call; the process step may include:

[0212] First, the XR device receives any one of a text message, a call request, or a video request.

[0213] Secondly, the XR device determines to call a specific conversion unit based on the type of data received and the target display method selected by the XR wearer. For example, if the XR device receives a text message and the XR wearer chooses voice display, the XR device calls the voice conversion unit to convert the text data corresponding to the text message into voice data, and displays it to the XR wearer in the form of voice playback.

[0214] For another example, when the XR device receives a text message, if the XR wearer chooses the voice digital human display mode, the XR device calls the voice conversion unit to convert the text data corresponding to the text message into voice data, and calls the digital human rendering module, and finally dictates the text message content to the XR wearer through the digital human voice dictation.

[0215] like Fig.23 As shown, the process steps of another method for displaying information by an XR device are shown:

[0216] First, the XR device receives first information, such as a text message, a call request, or a video request.

[0217] Secondly, the XR device generates an inquiry message on whether to switch the display mode; the XR wearer can choose whether to switch the display mode according to the inquiry message. If the XR wearer chooses to switch the display mode, the XR device displays the second information corresponding to the first information according to the target display mode; if the XR wearer chooses not to switch the display mode, the XR device displays the second information corresponding to the received first information according to the default display mode or the preset display mode. For example, the preset display mode for viewing text messages is the text display mode, the default display mode for voice calls is the voice display mode, and the default display mode for video calls is the video display mode. Among them, the video display mode is that the XR wearer and the other contact are displayed in the form of real people (for example, real facial expressions).

[0218] Again, the XR wearer selects a target display method on the virtual user interface, and the virtual user interface generates first operation information based on the selected target display method; the XR device obtains the first operation information from the virtual user interface. For example, the XR wearer can select text display method, voice display method, digital human video display method, etc. on the virtual user interface.

[0219] Finally, the XR device determines a method for displaying the second information according to the first operation information, and displays the second information according to the selected target display method.

[0220] like Fig.24 As shown, the specific process steps of a method for displaying text messages on an XR device are shown:

[0221] First, the XR device receives the text message.

[0222] Secondly, the XR device generates an inquiry message X1 for whether to switch the display mode based on the received SMS; the XR wearer can choose whether to switch the display mode based on the inquiry message X1. If the XR wearer chooses not to switch the display mode, the XR device displays the SMS content in the default text display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message X2 for whether to select the digital human display mode; the XR wearer can choose whether to use the digital human display mode based on the inquiry message X2; if the XR wearer chooses the digital human display mode, the XR wearer can further determine whether to select the text digital human display mode, the voice digital human display mode, or the text and voice digital human display mode; the XR device can display the SMS content according to the display mode selected by the XR wearer (for example, the voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the voice display mode to display the SMS content.

[0223] like Fig.25 As shown, the specific process steps of a method for displaying a voice call on an XR device are shown:

[0224] First, the XR device receives a call request.

[0225] Secondly, the XR device generates an inquiry message Y1 for whether to switch the display mode according to the call request; the XR wearer can choose whether to switch the display mode according to the inquiry message Y1. If the XR wearer chooses not to switch the display mode, the XR device displays the voice call content according to the default voice display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message Y2 for whether to select the digital human display mode; the XR wearer can determine whether to use the digital human display mode according to the inquiry message X2; if the XR wearer chooses the digital human display mode, the XR wearer can further choose whether to select the text digital human display mode, the voice digital human display mode or the text and voice digital human display mode; the XR device can display the voice call content according to the display mode selected by the XR wearer (for example, the voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the text display mode to display the voice call content.

[0226] like Fig.26 As shown, the process steps of a method for displaying a video call on an XR device are shown:

[0227] First, the XR device receives a video request.

[0228] Secondly, the XR device generates an inquiry message M1 for whether to switch the display mode according to the video request; the XR wearer can choose whether to switch the display mode according to the inquiry message M1. If the XR wearer chooses not to switch the display mode, the XR device displays the video call content according to the default video display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message M2 for whether to select the digital human display mode; the XR wearer can determine whether to use the digital human display mode according to the inquiry message M2; if the XR wearer chooses the digital human display mode, the XR wearer can further determine whether to select the text digital human display mode, the voice digital human display mode, or the text and voice digital human display mode; the XR device can display the video call content according to the display mode selected by the XR wearer (for example, the text and voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the text display mode or the voice display mode to display the video call content.

[0229] like Fig. 27 As shown, an interface process step of a method for displaying information by an XR device is shown; as Fig. 27As shown in (a) in the figure, the XR device includes but is not limited to a virtual user interface, and the virtual user interface includes but is not limited to an application screen, and the application screen displays first information, an information transcription module, and a digital human rendering module, wherein the information transcription module is used to control the conversion between text, voice, and video, such as text to voice, voice to text, and text to video; the digital human rendering module is used to render a digital human in scenarios such as text messages, voice calls, video calls, and conferences. For example, Fig. 27 As shown in (b) in the figure, when the XR device receives a text message, if the XR wearer selects the text digital human display mode in the digital human video display mode, the XR device will call the digital human rendering module to display the second information on the application screen through the text digital human display mode. For example, the application screen displays the digital human rendered by the digital human rendering module and the text information in the text box.

[0230] The above describes in detail an example of a method for processing broadcast information provided by the present application. It is understandable that, in order to implement the above functions, the terminal device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0231] The present application can divide the method for processing broadcast information into functional units according to the above method examples. For example, each function can be divided into each functional unit, or two or more functions can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0232] Fig.28 A schematic diagram of the structure of a terminal device provided by the present application is shown. Fig.28 The dotted line in the figure indicates that the unit or the module is optional. The terminal device 2800 can be used to implement the method described in the above method embodiment. The terminal device 2800 can be a server or a chip (system).

[0233] The terminal device 2800 includes one or more processors 2801, which can support the terminal device 2800 to implement Figure 5The method in the corresponding method embodiment. The processor 2801 can be a general-purpose processor or a special-purpose processor. For example, the processor 2801 can be a central processing unit (CPU). The CPU can be used to control the terminal device 2800, execute software programs, and process data of software programs. The terminal device 2800 can also include a communication unit 2805 to implement signal input (reception) and output (transmission).

[0234] The terminal device 2800 may be a chip (system) including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory to implement the methods shown in the above embodiments.

[0235] The communication unit 2805 may be an input and / or output circuit of the chip (system), or the communication unit 2805 may be a communication interface of the chip (system), and the chip (system) may be a component of the terminal device 2800 .

[0236] For another example, the communication unit 2805 may be a transceiver of the terminal device 2800 , or the communication unit 2805 may be a transceiver circuit of the terminal device 2800 .

[0237] The terminal device 2800 may include one or more memories 2802, on which a program 2804 is stored. The program 2804 can be executed by the processor 2801 to generate instructions 2803, so that the processor 2801 performs the method described in the above method embodiment according to the instructions 2803. Optionally, data may also be stored in the memory 2802. Optionally, the processor 2801 may also read the data stored in the memory 2802, and the data may be stored at the same storage address as the program 2804, or the data may be stored at a different storage address from the program 2804.

[0238] The processor 2801 and the memory 2802 may be provided separately or integrated together, for example, integrated on a system on chip (System On Chip, SOC) of the terminal device.

[0239] The specific manner in which the processor 2801 executes the method for displaying information can refer to the relevant description in the method embodiment.

[0240] It should be understood that each step of the above method embodiment can be completed by a hardware-based logic circuit or a software-based instruction in the processor 2801. The processor 2801 can be a CPU, a digital signal processor (DSP), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0241] The present application also provides a computer program product, which, when executed by the processor 2801, implements the method of any method embodiment in the present application.

[0242] The computer program product may be stored in the memory 2802 , for example, a program 2804 , which is converted into an executable target file that can be executed by the processor 2801 after preprocessing, compilation, assembly, and linking.

[0243] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method of any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

[0244] The computer-readable storage medium is, for example, a memory 2802. The memory 2802 may be a volatile memory or a nonvolatile memory, or the memory 2802 may include both a volatile memory and a nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SynchLinkDRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DRRAM).

[0245] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

[0246] In several embodiments provided in the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not executed. The device embodiments described above are merely schematic, and the splitting of the units is only a logical function splitting. There may be other splitting methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0247] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application is described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents, and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

[0248] Finally, the above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for displaying information, characterized in that: Applied to a terminal device, the method comprises: Receiving first information, where the first information is any one of a text message, a call request, or a video request; Acquire first operation information, where the first operation information is used to instruct to switch a display mode of second information corresponding to the first information from a preset display mode to a target display mode; In response to the first operation information, the second information is displayed in the target display manner.

2. The method according to claim 1, characterized in that: The method further comprises: When the first information is a text message, the preset display mode is a text display mode, and the target display mode is a voice display mode, a digital human video display mode, or a mixed display mode.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: When the first information is the call request, the preset display mode is a voice display mode, and the target display mode is a text display mode, a digital human video display mode, or a mixed display mode.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: When the first information is the video request, the preset display mode is a video display mode, and the target display mode is one of a text display mode, a voice display mode, a digital human video display mode, or a mixed display mode.

5. The method according to any one of claims 2 to 4, characterized in that The mixed display mode is one of a text-voice display mode and a text-voice digital human display mode.

6. The method according to any one of claims 1 to 5, characterized in that The method also includes: the digital human video display method is a method of displaying the second information through a digital human that is not a user image.

7. The method according to any one of claims 1 to 5, characterized in that The method also includes: the digital human video display method is a method of displaying the second information through a digital human with a user image.

8. The method according to claim 7, characterized in that When the digital human video display mode is a mode of displaying the second information through a digital human of a user image, the method further includes: Sending authorization request information to the user terminal, wherein the authorization request information is used to request whether the user agrees to display the second information through a digital person of the user's image; Receiving authorization reply information from the user terminal; When the authorization reply information indicates that the user agrees to display the second information through the digital human with his own image, the second information is displayed through the digital human with the user's image; or, when the authorization reply information indicates that the user does not agree to display the second information through the digital human with his own image, the second information is displayed through a digital human other than the user's image.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: The voice display method is a method of displaying the second information through simulated voice or real person voice.

10. The method according to any one of claims 1 to 9, characterized in that The method further comprises: Acquire third information, where the third information is information on the terminal device; Acquire second operation information, where the second operation information is used to instruct to switch the third information from the preset display mode to the target display mode; In response to the second operation information, the third information is displayed in the target display manner.

11. A terminal device, characterized in that: The terminal device comprises a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the terminal device executes the method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product is configured to, when running on a terminal device, cause the terminal device to execute the method according to any one of claims 1 to 10.

14. A chip system, characterized in that: The chip system includes a memory and a processor, and the processor is configured to execute a computer program stored in the memory to implement the method according to any one of claims 1 to 10.

Images