Method for displaying information and terminal device

Abstract

The present application relates to the technical field of extended reality, and provides a method for displaying information, which is applied to a terminal device. The method comprises: receiving first information, the first information being any one of a short message, a call request or a video request; acquiring first operating information, the first operating information being used for instructing switching the display mode of second information corresponding to the first information from a preset display mode to a target display mode; and, in response to the first operating information, displaying the second information in the target display mode. The method can solve the problem that the unitary display mode of XR devices cannot satisfy user requirements.

Description

Method and terminal device for displaying information

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 30, 2023, with application number 202311105613.7 and application name “Method and terminal device for displaying information”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of extended reality technology, and in particular to a method and terminal device for displaying information. Background Art

[0003] Extended Reality (XR or ER) refers to the use of computer technology and wearable devices to create an environment that combines the real and virtual and allows human-computer interaction. XR includes immersive technologies such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). In an XR scenario, the wearer of an XR device can receive text messages, calls, video calls, and other information through the XR device (for example, an XR headset), and can also initiate text messages, calls, and video calls to other terminal devices. In existing technologies, XR devices have a relatively simple display method for received text, video, and other information, which cannot meet user needs.

[0004] Summary of the Invention

[0005] The present application provides a method and terminal device for displaying information, which can solve the problem that the display method of XR devices is single and cannot meet user needs.

[0006] To achieve the above objectives, this application adopts the following technical solutions:

[0007] In a first aspect, a method for displaying information is provided, the method comprising: receiving first information, the first information being any one of a text message, a call request, or a video request; obtaining first operation information, the first operation information being used to instruct to switch the display mode of second information corresponding to the first information from a preset display mode to a target display mode; and displaying the second information in the target display mode in response to the first operation information.

[0008] The above method can be executed by a terminal device, or by a module (such as a processor, chip, or chip system, etc.) applied to the terminal device, or by a logical node, logical module or software that can realize all or part of the terminal device functions. In the prior art, after the terminal device receives the first information, it usually displays the second information in a preset display method. The user (for example, the wearer of the XR device) cannot choose the display method according to his or her own needs. The present application provides the user with an optional target display method, which can facilitate the user to flexibly select the display method of the second information according to his or her own needs. Accordingly, the terminal device can also flexibly display the second information to the user in a target display method based on the user's first operation information. This not only meets the user's needs but also improves the user experience.

[0009] In some embodiments, the method further includes: when the first information is a text message, the preset display mode is a text display mode, and the target display mode is one of a voice display mode, a digital human video display mode, or a mixed display mode.

[0010] Compared with the existing technology where SMS messages are usually displayed in text format, in this application, the display method of SMS messages is not limited to text display method, and other display methods such as voice display method, digital human video display method, etc. can also be selected, which increases the diversity of SMS display forms, meets user needs, and improves user experience.

[0011] In some embodiments, the method further includes: when the first information is a call request, the preset display mode is a voice display mode, and the target display mode is one of a text display mode, a digital human video display mode, or a mixed display mode.

[0012] Compared with the existing technology in which voice calls are usually displayed using voice display, in this application, the display method of voice calls is not limited to voice display, and other display methods such as text display, digital human video display, etc. can also be selected. For example, users can determine whether to choose a downgraded display method (for example, text display method) or an upgraded display method (for example, digital human video display method) based on the quality of the current call network. This method not only increases the diversity of voice call display forms, but also meets the special needs of users.

[0013] In some embodiments, the method further includes: when the first information is a video request, the preset display mode is a video display mode, and the target display mode is one of a text display mode, a voice display mode, a digital human video display mode or a mixed display mode.

[0014] Compared with the existing technology in which video calls are usually displayed using video display, in this application, the display method of video calls is not limited to video display, and other display methods such as text display and mixed display can also be selected. For example, the XR wearer can determine whether to choose a downgraded display method (for example, a text display method) or an upgraded display method (for example, a mixed display method) based on the quality of the current call network. This method not only increases the diversity of video call display forms, but also meets the special needs of XR wearers.

[0015] In some embodiments, the hybrid presentation mode is a text-speech presentation mode or a text-speech digital human presentation mode.

[0016] In this embodiment, the terminal device provides the user with a mixed display mode, which can display the second information corresponding to the first information in multiple directions. This not only improves the diversity of the second information display, but also improves the user experience.

[0017] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through a digital human that is not a user image.

[0018] In this embodiment, the XR device displays the second information through a digital human with a non-user image (for example, a digital human with a cartoon image), which not only increases the fun of the information display but also improves the user experience.

[0019] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through the digital human of the user image.

[0020] XR devices display secondary information through a digital human image of the user (for example, a digital human image of the XR wearer’s real facial expressions), which can simulate face-to-face communication scenarios and help improve the effectiveness of communication between the two parties.

[0021] In some embodiments, when the digital human video display method is a method of displaying the second information through a digital human with the user's image, the method also includes: sending authorization request information to the user terminal, the authorization request information is used to request whether the user agrees to display the second information through a digital human with his own image; receiving authorization reply information from the user terminal; when the authorization reply information indicates that the user agrees to display the second information through a digital human with his own image, the second information is displayed through the digital human with the user's image; or, when the authorization reply information indicates that the user does not agree to display the second information through a digital human with his own image, the second information is displayed through a digital human without the user's image.

[0022] In this embodiment, the terminal device sends an authorization request message to the user terminal to ask whether the other user agrees to communicate with the wearer of the XR device using his or her own image, rather than directly using the other user's real image, leaving the other user with room for choice, which can improve the user experience of both parties.

[0023] In some embodiments, the method further includes: the voice display method is a method of displaying the second information through simulated voice or real person voice.

[0024] In this embodiment, the terminal device provides a selectable voice presentation mode of simulated voice or real voice, which not only increases the diversity of the displayed second information but also improves the user experience.

[0025] In some embodiments, the method also includes: obtaining third information, the third information is information on the terminal device; obtaining second operation information, the second operation information is used to indicate switching the third information from a preset display mode to a target display mode; and in response to the second operation information, displaying the third information through the target display mode.

[0026] In this embodiment, the terminal device provides a variety of ways to display the third information, which not only increases the presentation methods of the third information but also improves the user experience.

[0027] In a second aspect, an embodiment of the present application provides a terminal device, which includes a processor and a memory, the memory being used to store computer programs, and the processor being used to call and run the computer programs from the memory, so that the terminal device executes any one of the methods in the first aspect.

[0028] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor executes any one of the methods in the first aspect.

[0029] In a fourth aspect, an embodiment of the present application provides a computer program product, which includes: a computer program code, and when the computer program code is executed by a terminal device, the terminal device executes any one of the methods in the first aspect.

[0030] In the fifth aspect, an embodiment of the present application provides a chip system, which includes a processing circuit and a storage medium, in which computer program instructions are stored; when the computer program instructions are executed by the processing circuit, the method described in the first aspect and various possible implementations of the first aspect is implemented.

[0031] Optionally, the processing circuit in the above chip system can be replaced by a processor, and the storage medium can be replaced by a memory. Optionally, the chip system can also include a communication interface, which is used to realize communication between the chip system and external devices.

[0032] The beneficial effects of the technical solutions in the second, third, fourth and fifth aspects of this application are the same as the beneficial effects of the technical solution in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] FIG1 is a schematic structural diagram of a terminal device 100 provided in an embodiment of the present application;

[0034] FIG2 is a schematic diagram of the software structure of a terminal device 100 provided in an embodiment of the present application;

[0035] FIG3 is a schematic diagram of a virtual interface of an XR device provided in an embodiment of the present application;

[0036] FIG4 is a schematic diagram of the main interface of an XR device provided in an embodiment of the present application;

[0037] FIG5 is a flow chart of a method for displaying information provided in an embodiment of the present application;

[0038] FIG6 is a schematic diagram of a call interface applicable to the present application provided in an embodiment of the present application;

[0039] FIG7 is a schematic diagram of a video interface applicable to the present application provided in an embodiment of the present application;

[0040] FIG8 is a schematic diagram of a call interface and a video interface applicable to the present application provided in an embodiment of the present application;

[0041] FIG9 is a schematic diagram of another call interface and video interface applicable to the present application provided in an embodiment of the present application;

[0042] FIG10 is a schematic diagram of another call interface and video interface applicable to the present application provided in an embodiment of the present application;

[0043] FIG11 is a schematic diagram of another call interface and video interface applicable to the present application provided in an embodiment of the present application;

[0044] FIG12 is a schematic diagram of another call interface and video interface applicable to the present application provided in an embodiment of the present application;

[0045] FIG13 is a schematic diagram of a video call interface applicable to the present application provided in an embodiment of the present application;

[0046] FIG14 is a schematic diagram of another video call interface applicable to the present application provided in an embodiment of the present application;

[0047] FIG15 is a schematic diagram of another video call interface applicable to the present application provided in an embodiment of the present application;

[0048] FIG16 is a schematic diagram of a short message interface applicable to the present application provided in an embodiment of the present application;

[0049] FIG17 is a schematic diagram of another short message interface applicable to the present application provided in an embodiment of the present application;

[0050] FIG18 is a schematic diagram of an interface for creating a conference provided in an embodiment of the present application;

[0051] FIG19 is a schematic diagram of a conference interface provided in an embodiment of the present application;

[0052] FIG20 is a schematic diagram of another conference interface provided in an embodiment of the present application;

[0053] FIG21 is a schematic diagram of another conference interface provided in an embodiment of the present application;

[0054] FIG22 is a schematic diagram of the process steps of a method for displaying information on an XR device provided in an embodiment of the present application;

[0055] FIG23 is a schematic diagram of the process steps of another method for displaying information on an XR device provided in an embodiment of the present application;

[0056] FIG24 is a schematic diagram of the process steps of a method for displaying text messages on an XR device provided in an embodiment of the present application;

[0057] FIG25 is a schematic diagram of the process steps of a method for displaying a voice call on an XR device provided in an embodiment of the present application;

[0058] FIG26 is a schematic diagram of the process steps of a method for displaying a video call on an XR device according to an embodiment of the present application;

[0059] FIG27 is a schematic diagram of the interface process steps of a method for displaying information on an XR device provided in an embodiment of the present application;

[0060] Figure 28 is a structural diagram of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0062] FIG1 shows a schematic structural diagram of a terminal device 100 .

[0063] The terminal device 100 may include, but is not limited to, at least one of an augmented reality (AR) device, a virtual reality (VR) device, and an XR device. The embodiment of the present application does not impose any particular limitation on the specific type of the terminal device 100.

[0064] The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, an indicator 191, a subscriber identification module (SIM) card interface 192, a camera module 193, a display screen 194 and a sensor 180, etc.

[0065] It is understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than those in Figure 1, or may combine or separate certain components, or may have different component arrangements. The components in Figure 1 may be implemented in hardware, software, or a combination of software and hardware.

[0066] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0067] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0068] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 may be a cache memory. This memory can store instructions or data that have been used or are frequently used by processor 110. When processor 110 needs to use the instruction or data, it can directly access it from this memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0069] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface. The processor 110 may be connected to modules such as a touch sensor, an audio module, a wireless communication module, a display, and a camera through at least one of the above interfaces.

[0070] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.

[0071] The USB connector 130 is an interface that complies with USB standard specifications and can be used to connect the terminal device 100 and peripheral devices. Specifically, it can be a Mini USB connector, a Micro USB connector, a USB Type C connector, etc. The USB connector 130 can be used to connect a charger to enable the charger to charge the terminal device 100, and can also be used to connect other terminal devices to enable data transmission between the terminal device 100 and other terminal devices. It can also be used to connect headphones to output audio stored in the terminal device through the headphones. The connector can also be used to connect other terminal devices, such as VR devices. In some embodiments, the standard specifications of the universal serial bus can be USB1.x, USB2.0, USB3.x and USB4.

[0072] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB connector 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also provide power to the terminal device via the power management module 141.

[0073] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the display 194, the wireless communication module 160, and the like. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0074] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0075] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0076] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0077] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0078] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0079] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other terminal devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0080] The terminal device 100 can implement display functions through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0081] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be saved on the external memory card or transferred from the terminal device to the external memory card.

[0082] The internal memory 121 can be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (for example, a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the terminal device 100 (for example, audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the terminal device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0083] The terminal device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0084] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0085] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or output audio signals for hands-free calls through the speaker 170A.

[0086] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 100 receives a call or voice message, the user can hear the voice by placing the receiver 170B close to the ear.

[0087] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal device 100 can be provided with at least one microphone 170C. In other embodiments, the terminal device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal device 100 can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and can also identify the source of sound, realize directional recording function, etc.

[0088] The headphone jack 170D is used to connect a wired headphone and can be a USB connector 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0089] The sensor 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which is used to convert various signals from the outside world into electrical signals or other required forms of information output.

[0090] The buttons 190 may include a power button, a volume button (e.g., a user may use the volume button to adjust the volume of a broadcast message), etc. The buttons 190 may be mechanical buttons or touch buttons. The terminal device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the terminal device 100.

[0091] The indicator 191 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate information (for example, the indicator light can indicate the broadcast information received by the Bluetooth application software via Bluetooth), missed calls, notifications, etc.

[0092] The SIM card interface 192 is used to connect a SIM card. The SIM card can be connected to and separated from the terminal device 100 by inserting it into the SIM card interface 192 or removing it from the SIM card interface 192. The terminal device 100 can support one or more SIM card interfaces 192. The SIM card interface 192 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 192 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 192 can also be compatible with different types of SIM cards. The SIM card interface 192 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0093] The terminal device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0094] The camera module 193 can be used to collect color image data and depth data of the subject. For example, it can collect the head portraits and facial expressions of the participants. The ISP can be used to process the color image data collected by the camera module 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera sensor. The light signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera module 193.

[0095] In some embodiments, the camera module 193 may be composed of a color camera module and a 3D sensing module.

[0096] In some embodiments, the photosensitive element of the camera of the color camera module can be a charge coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV.

[0097] In some embodiments, the 3D sensing module can be a time of flight (TOF) 3D sensing module or a structured light 3D sensing module. Structured light 3D sensing is an active depth sensing technology, and its basic components may include an infrared emitter, an IR camera module, and the like. The operating principle of a structured light 3D sensing module is to first emit a specific pattern of light spots at the object being photographed, then receive the light spot pattern coding on the object's surface, compare the similarities and differences with the original projected light spot, and calculate the object's three-dimensional coordinates using triangulation principles. These three-dimensional coordinates include the distance between the electronic device 100 and the object being photographed. TOF 3D sensing can be an active depth sensing technology, and its basic components may include an infrared emitter, an IR camera module, and the like. The operating principle of a TOF 3D sensing module is to calculate the distance (i.e., depth) between the TOF 3D sensing module and the object being photographed based on the time it takes for the infrared light to return, thereby generating a 3D depth map.

[0098] Structured light 3D sensing modules can also be used in facial recognition, motion-sensing game consoles, industrial machine vision inspection, and other fields. Time of Flight 3D sensing modules can also be used in game consoles, augmented reality (AR) and virtual reality (VR).

[0099] In other embodiments, the camera module 193 may also be composed of two or more cameras. The two or more cameras may include a color camera, which can be used to collect color image data of the object being photographed. The two or more cameras may use stereo vision technology to collect depth data of the object being photographed. Stereo vision technology is based on the principle of human eye parallax. Under natural light, two or more cameras are used to capture images of the same object from different angles, and then triangulation and other calculations are performed to obtain distance information between the electronic device 100 and the object being photographed, that is, depth information.

[0100] In some embodiments, the electronic device 100 may include one or more camera modules 193. Specifically, the electronic device 100 may include one front camera module 193 and one rear camera module 193. The front camera module 193 may generally be used to capture color image data and depth data of the user facing the display screen 194, while the rear camera module may be used to capture color image data and depth data of the subject (e.g., a portrait or facial expression) that the user is facing.

[0101] The display screen 194 is used to display data such as images, text, and video. For example, the display screen 194 can be used to display received text, audio, and video information. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or more display screens 194.

[0102] The above-mentioned terminal device 100 can also adopt other architectures. The embodiment of the present invention can also take the Harmony system as an example to exemplify the software architecture of the terminal device 100.

[0103] FIG2 is a schematic diagram of the software structure of the terminal device 100 according to an embodiment of the present application.

[0104] In some implementations, the Harmony system includes four layers, from bottom to top: the kernel layer, the system basic service layer, the framework layer, and the application layer.

[0105] The Harmony system uses a multi-kernel design, optionally including the Linux kernel, the Hongmeng microkernel, and the lightweight IoT operating system kernel (Lite Operating System, LiteOS). Through this design, devices with different device capabilities can choose the appropriate system kernel. The kernel layer also includes the Kernel Abstraction Layer, which provides basic kernel capabilities for other Harmony layers, such as process management, thread management, memory management, file system management, network management, and peripheral management.

[0106] The system basic service layer is the core capability set of the Harmony system, which supports the Harmony system to provide services to application services through the framework layer in the scenario of multi-device deployment. This layer optionally includes the following parts:

[0107] The system's basic capability subsystems provide fundamental capabilities for running, scheduling, and migrating distributed applications across multiple devices in the Harmony system. These subsystems comprise a distributed soft bus, distributed data and file management, distributed task scheduling, the Ark runtime, and distributed security and privacy protection. The Ark runtime provides a C / C++ / JavaScript multi-language runtime and basic system class libraries. It also provides a runtime for Java programs statically compiled using the Ark compiler (i.e., applications or frameworks developed in Java).

[0108] Basic Software Service Subsystem Set: This provides common, general-purpose software services for the Harmony system. It comprises subsystems such as graphics and imaging, distributed media, distributed AI, multimodal input, Mobile Sensing Development Platform (MSDP) & Device Virtualization (DV), event notification, phone services, and Design for X (DFX). The basic software service subsystem set can be tailored to the deployment environment of different device form factors, with each subsystem capable of being tailored to the granularity of functionality.

[0109] The enhanced software service subsystem set (see the enhanced software section outlined in the dashed line in Figure 2) provides the Harmony system with differentiated, device-specific, capability-enhancing software services. This subsystem consists of subsystems such as tablet business software, smart screen business software, vehicle-mounted computer business software, and Internet of Things (IoT) business software. The enhanced software service subsystem set can be tailored to the deployment environment of different device form factors at the subsystem level, and each subsystem can be tailored to the functional level within it.

[0110] Harmony Driver Foundation (HDF) and Hardware Abstraction Layer (HAL): They are the foundation of the open hardware ecosystem of the Harmony system, providing hardware capability abstraction to the hardware upward and providing a development framework and operating environment for various peripheral drivers downward.

[0111] Hardware Service Subsystem Set: This provides common, adaptive hardware services for the Harmony system and consists of hardware service subsystems such as general sensors, location, power, USB, and biometrics. The hardware service subsystem set can be tailored to the deployment environment of different device form factors, and each subsystem can be tailored to the functional granularity.

[0112] The proprietary hardware service subsystem (see the proprietary hardware section outlined by the dashed line in Figure 2) provides the Harmony system with differentiated hardware services for different devices. This subsystem optionally includes tablet proprietary hardware services, vehicle hardware services, wearable hardware services, and IoT hardware services. The proprietary hardware service subsystem can be tailored to the subsystem granularity, and each subsystem can be tailored to the functional granularity.

[0113] The framework layer provides the Harmony system's applications with a user program framework and meta-capability framework in multiple languages, such as Java / C / C++ / JavaScript, as well as a multi-language framework application programming interface (API) that opens up various software and hardware services.

[0114] The application layer includes system applications and third-party applications (or extended applications), including camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth applications, music, video, short messaging, etc. Applications in the Harmony system are built based on atomic capabilities (AA) and feature capabilities (FA).

[0115] Below, taking an XR device (e.g., an XR head-mounted display device) having the structure shown in Figures 1 and 2 as an example, combined with the method for displaying information provided in this application, the workflow of the software system and hardware system of the terminal device 100 is exemplarily explained.

[0116] Figure 3 shows an application scenario suitable for the present application. In the area 301 shown in Figure 3, the virtual user interface of the XR device is displayed. The wearer of the XR device (hereinafter referred to as the XR wearer) can directly log in or register an account to enter the main interface 401 of the XR device, as shown in Figure 4 (a); the main interface 401 displays some application software installed on the XR device, such as call applications, video applications, short message applications, conference applications and other software, as shown in Figure 4 401, among which the call application is used for the XR wearer to establish a voice call with other users, the video application is used for the XR wearer to establish a video call with other users, the short message application is used for the XR wearer to communicate with other users through text messages, and the conference application is used for the XR wearer to create a multi-person virtual conference according to his own needs.

[0117] For example, the XR wearer can click on the call application on the main interface 401, select the contact M to whom he wants to call, and initiate a call request to the contact M, or receive call requests from other contacts. For example, taking the example of the XR wearer selecting the text display method to display the content of the call between himself and other contacts, after the XR device receives the call request from the contact Wang XX, the XR wearer can select any one of the text display method, voice display method, digital human video display method and mixed display method on the call interface 402 shown in (b) of Figure 4 to display the content of the call between himself and Wang XX. If the XR wearer clicks the text display method 403 on the call interface 402, as shown in ( b), the call application responds to the single-click operation and generates a text display start request; the call application sends the text display start request to the event notification management service subsystem of the framework layer through the application layer; the event notification management service subsystem generates an event for starting the text display mode according to the received text display start request, and then sends the event for starting the text display mode to the call driver module of the Hongmeng driver framework layer through the hardware abstraction layer; at this time, the call driver module generates an instruction for starting text display according to the event for starting the text display mode, and sends the instruction for starting text display to the call hardware module; the call hardware module starts the text display mode according to the instruction for starting text display to display the call content during the call between the XR wearer and Wang XX.

[0118] It should be noted that the following embodiments of this application will use the terminal device 100 having the structure shown in Figures 1 and 2 as an example, and will specifically explain the method for displaying information provided in the embodiments of this application in conjunction with the accompanying drawings and application scenarios. It should be understood that the terminal device applicable to this method is not limited to the hardware and software structures shown in Figures 1 and 2. In actual applications, the hardware and software system architecture shown in Figures 1 and 2 can be modified according to specific application scenarios, and this application does not limit this.

[0119] Next, still taking the terminal device having the structure shown in FIG. 1 and FIG. 2 as an example, the method for displaying information provided by the present application is described in detail in combination with different embodiments.

[0120] As can be seen from the background technology, in XR scenarios, XR wearers can receive text messages, phone calls, video calls, and other information through XR devices (e.g., XR headsets). However, the XR devices display received text and video information in a relatively simple manner, which does not meet user needs. Therefore, this application proposes a method for displaying information, as shown in Figure 4; this method can solve the problem that XR devices have a single display method and cannot meet user needs.

[0121] Before introducing the information display method provided by this application, a brief description of the execution subject involved in the embodiment of this application is first given. In the embodiment of this application, a terminal device is used as an example to illustrate the method provided by this application, but this application does not limit the execution subject.

[0122] For example, the execution subject involved in the embodiments of the present application can be a terminal device, or a chip, chip system, or processor applied to the terminal device, or a logical node, logic module or software that can realize all or part of the functions of the terminal device.

[0123] For example, the terminal device can be one of an XR device, a VR device or an AR device; for example, the XR device can be an XR head-mounted display device (for example, XR smart glasses); the VR device can be a VR head-mounted display device (for example, VR smart glasses); and the AR device can be an AR head-mounted display device (for example, AR smart glasses).

[0124] The following embodiments are described using an XR device as an example in which the execution subject of the method 500 for displaying information is an XR device, wherein the XR device has a virtual user interface, and the XR wearer can perform a series of operations on the virtual user interface, such as creating a call, answering a call, creating a meeting, selecting an information display method, etc.

[0125] As shown in FIG5 , it is a flow chart of a method 500 for displaying information provided in an embodiment of the present application. The method 500 includes S501 to S503 , and these steps are described in detail below.

[0126] S501: The XR device receives first information, where the first information is one of a text message, a call request, and a video request.

[0127] The first information may be information sent by other user terminals. In other words, the user terminal refers to a terminal device that sends the first information, wherein the user terminal may include but is not limited to at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an AR device, a VR device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, or a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the user terminal.

[0128] For example, taking the example of another contact sending a call request to the XR wearer, the other contact sends a first message to the XR device through the user terminal, and accordingly, the XR device receives the first message.

[0129] For another example, contact A can send a call request (or text message or video request) to the XR device through a mobile phone, or send a call request (or text message or video request) to the XR device through an AR device.

[0130] After receiving the first information, the XR device usually displays the first information on a virtual user interface so that the XR wearer can choose whether to respond to the first information.

[0131] For example, if the first message received by the XR device is a text message, the XR wearer can view and reply to the text message in different display modes. For example, the XR wearer can choose to view the text message sent by the other party in voice display mode. The XR wearer can also view the text message sent by the other party in digital human video display mode. For example, the XR device will display the text message of the other party to the XR wearer in the form of a digital human. The XR wearer can also view the text message sent by the other party in a mixed display mode. For example, if the XR wearer chooses to view the text message in text and voice mode, the XR device will display the text message to the XR wearer in text and voice mode. The detailed description of the mixed display mode can be found in the following embodiments and will not be repeated here.

[0132] S502: The XR device obtains first operation information, where the first operation information is used to instruct to switch a display mode of second information corresponding to the first information from a preset display mode to a target display mode.

[0133] Among them, the first operation information may refer to the operation information of the XR wearer obtained by the XR device from the virtual user interface; for example, the XR wearer selects the target display mode to be switched on the virtual user interface, and the virtual user interface responds to the selection operation of the XR wearer and generates the first operation information.

[0134] It should be noted that the XR wearer can select the target display mode to be switched on the virtual user interface by touch, or can select the target display mode to be switched by operating the handle of the XR device. This application does not limit this.

[0135] In some embodiments, when the XR device receives the first information, it will determine the information type of the first information. For example, if the information type of the first information is a text message, the XR device will determine that the data type of the second information is text data; when the information type of the first information received by the XR device is a call request, the XR device will determine that the data type of the second information is voice data; when the information type of the first information received by the XR device is a video request, the XR device will determine that the data type of the second information is video data.

[0136] It should be noted that, generally, text data can be displayed in text form, voice data can be displayed in voice form, and video data can be displayed in video form.

[0137] The preset display mode may be a display mode pre-set by the XR device according to the data type of the second information, wherein the preset display mode may be a text display mode, a voice display mode, or a video display mode.

[0138] For example, the first information is a text message, and the second information corresponding to the first information is text data. The XR device can pre-set the preset display mode (also called default display mode) of the second information as a text display mode.

[0139] For another example, the first information is a call request, and the second information corresponding to the first information is voice data. The XR device can pre-set the preset display mode of the second information to be a voice display mode.

[0140] For example, if the first message is a video request and the second message corresponding to the first message is video data, the XR device can pre-set the display mode of the second message to be a video display mode. It should be noted that this video display mode usually refers to a video call established between the XR wearer and other contacts.

[0141] The above-mentioned target display method may include a text display method, a voice display method, a digital human video display method or a mixed display method; among which, the text display method may refer to a method of displaying the second information in the form of text; the voice display method may refer to a method of displaying the second information in the form of voice; the digital human video display method may refer to a method of displaying the second information through a video formed by a digital human; the mixed display method may refer to a method of displaying the second information through a text-voice display method or a text-voice-digital human display method.

[0142] For example, a hybrid display mode is a text-and-speech display mode formed by a text display mode and a voice display mode; another example is a text-and-speech digital human display mode formed by a text display mode, a voice display mode, and a digital human video display mode. The details can be understood in conjunction with the following interface embodiments and will not be repeated here.

[0143] It should be noted that the target display mode is a display mode different from the preset display mode. For example, if the preset display mode is a text display mode, the target display mode may be a display mode other than the text display mode, for example, the target display mode may be a voice display mode, a digital human video display mode, or a mixed display mode; similarly, if the preset display mode is a voice display mode (or a video display mode), the target display mode may be a display mode other than the voice display mode (or a video display mode), for example, the target display mode may be a text display mode, a digital human video display mode, or a mixed display mode (or the target display mode may be a text display mode, a voice display mode, a digital human video display mode, or a mixed display mode).

[0144] After receiving the first information, the XR device will display the first information on the virtual user interface; the XR wearer can select a target display method on the virtual user interface; the virtual user interface generates first operation information in response to the operation of the XR wearer; the XR device obtains the first operation information from the virtual user interface and determines the display method of the second information based on the first operation information. For example, the first information is a text message, and the XR device displays the received text message on the virtual user interface in the form of a message reminder, and displays the selectable target display method (for example, text display method, voice display method, digital human video display method, etc.) on the virtual user interface; the XR wearer can select a suitable target display method according to his or her own needs. For example, the XR wearer can select a voice display method to view the text message; the virtual user interface generates first operation information X in response to the voice display method selected by the XR wearer; the XR device plays the text message to the XR wearer through voice display according to the first operation information X. For details, please refer to the interface embodiment below, which will not be repeated here.

[0145] It should be noted that the XR wearer can also choose not to select a target display method and view the text message to be viewed using a preset display method. For example, if the first message is a text message and the second message is text data, the XR wearer can select the default display method to view the text message; the XR device will display the second message to the XR wearer using the preset text display method in response to the default display method selected by the XR wearer.

[0146] It should also be noted that in some embodiments, the voice display method is to display the second information through simulated voice or real voice. The simulated voice can refer to the intelligent voice of a cartoon character, the intelligent voice of a robot, or the intelligent voice that simulates the timbre of a character; the real voice can refer to the real voice of the XR wearer and the contact.

[0147] For example, when the XR wearer chooses the real-person voice display mode to display the second information, the XR device will use the real voice of the XR wearer and the real voice of the contact to display the communication information between the two.

[0148] For example, when the XR wearer selects the simulated voice display mode to display the second information, the XR device will display the communication information between the two in a pre-set simulated voice. It should be understood that the XR wearer can select the voice simulated with different character tones.

[0149] In this embodiment, the XR device provides the XR wearer with a voice display mode that can be selected from simulated voice or real voice, which not only increases the diversity of the displayed second information, but also improves the user experience.

[0150] S503: The XR device displays the second information in a target display manner in response to the first operation information.

[0151] Exemplarily, the XR device responds to the first operation information and determines the target display mode based on the first operation information, and then displays the second information using the target display mode. For example, if the first operation information indicates that the target display mode selected by the XR wearer is the digital human video display mode, the XR device will switch the second information from the preset display mode to the digital human video display mode based on the first operation information, and display the second information to the XR wearer using the digital human video display mode. For details, please refer to the interface examples below and will not be repeated here.

[0152] To sum up, compared with the existing technology, after the XR device receives the first information, it usually displays the second information in a preset display method, and the XR wearer cannot choose the display method according to his or her own needs. The present application provides the XR wearer with an optional target display method, which can facilitate the XR wearer to flexibly select the display method of the second information according to his or her own needs. Correspondingly, the XR device can also flexibly display the second information to the XR wearer in a target display method based on the first operation information of the XR wearer. This not only meets the needs of the XR wearer but also improves the XR wearer experience.

[0153] In some embodiments, when the first information is a text message, the preset display mode is a text display mode, and the target display mode is a voice display mode, a digital human video display mode, or a mixed display mode.

[0154] When the first information is a text message, it means that the XR device has received a text message. At this time, the second information corresponding to the first information is text data. Generally, the text data is displayed through a text display method, wherein the text display method includes but is not limited to a text dialog box display method, a text box display method, a graphic display method, and a text table display method.

[0155] For example, when the first information is a text message, the XR device defaults to displaying the second information (for example, the content of the text message) in a text display mode; when the XR wearer selects the target display mode on the virtual user interface of the XR device, the XR device will display the second information according to the target display mode; for example, when the XR wearer selects the voice display mode (or the digital human video display mode or the mixed display mode) to view the text message, the XR device will display the second information to the XR wearer through voice playback (or the digital human oral mode or the mixed display mode).

[0156] It should be noted that the voice display method can be voice playback or robot narration; the digital human video display method can be a digital human display method of the user image (for example, real-life facial expressions) or a digital human display method of a non-user image (for example, a cartoon character); the mixed display method can be a text-voice display method or a text-voice digital human display method (wherein the digital human can be a digital human with a user image or a non-user image).

[0157] Compared with the existing technology where SMS messages are usually displayed in text format, in this application, the display method of SMS messages is not limited to text display method, and other display methods such as voice display method, digital human video display method, etc. can also be selected, which increases the diversity of SMS display forms, meets user needs, and improves user experience.

[0158] In some embodiments, when the first information is a call request, the preset display mode is a voice display mode, and the target display mode is a text display mode, a video display mode, or a combination of one or more digital human video display modes.

[0159] When the first information is a call request, it means that the XR device has received a voice call request from another contact; the XR wearer can establish a voice call with the other contact; the data type of the second information during the voice call (for example, the content of the voice call) is voice data; generally, voice data can be displayed through voice display, for example, the XR device receives a voice call request from another contact and establishes a voice call with the user terminal of the other contact; the XR device can display the content of the voice call through the target display method selected by the XR wearer.

[0160] For example, when the network signal is poor, the XR wearer can choose to display the text to make voice calls with other contacts. For example, the voice calls between the XR wearer and other contacts are displayed in the form of a text dialog box.

[0161] For example, when the network signal is good, the XR wearer can choose to display the digital human video to make a voice call with other contacts. For example, the XR wearer can display the voice call with other contacts through the form of a cartoon digital human combined with a dialog box, that is, the XR wearer can display the voice call with other contacts through the text digital human display. For details, please refer to the interface examples below and will not be repeated here.

[0162] In this embodiment, compared with the prior art method of usually using voice display for displaying voice calls, in this application, the display method of voice calls is not limited to voice display, and other display methods such as text display, digital human video display, etc. can also be selected. For example, the XR wearer can determine whether to choose a downgraded display method (for example, a text display method) or an upgraded display method (for example, a digital human video display method) according to the quality of the current call network. This method not only increases the diversity of voice call display forms, but also meets the special needs of XR wearers.

[0163] In some embodiments, when the first information is a video request, the preset display mode is a video display mode, and the target display mode is a text display mode, a voice display mode, or a combination of one or more digital human video display modes.

[0164] When the first information is a video request, it means that the XR device has received a video call request from another contact; the XR wearer can establish a video call with other contacts; the data type of the second information during the video call (for example, the content of the video call) is video data; by default, the video data can be displayed through a video display method, for example, the XR device receives a video call request from another contact and establishes a video call with the user terminal of the other contact; the XR device can display the video call through the target display method selected by the XR wearer (for example, a text display method).

[0165] For example, when the network signal is poor, the XR wearer can choose to make video calls with other contacts in a text display mode, for example, displaying the video call between the XR wearer and other contacts in the form of a text dialog box.

[0166] For example, if the network signal is good, the XR wearer can choose a hybrid display mode to make a video call with other contacts, for example, by displaying the video call between the XR wearer and other contacts through a text-to-speech digital human video display mode. For details, please refer to the interface examples below and will not be repeated here.

[0167] In this embodiment, compared with the prior art method in which video calls are usually displayed using video display, in this application, the display method of video calls is not limited to video display, and other display methods such as text display, mixed display, etc. can also be selected. For example, the XR wearer can determine whether to choose a downgraded display method (for example, a text display method) or an upgraded display method (for example, a mixed display method) based on the quality of the current call network. This method not only increases the diversity of video call display forms, but also meets the special needs of XR wearers.

[0168] It should be noted that in some embodiments, the hybrid presentation mode is either a text-and-speech presentation mode or a text-and-speech digital human presentation mode. Hybrid presentation modes include text-and-speech presentation modes and text-and-speech digital human presentation modes. The text-and-speech presentation mode may refer to a presentation mode formed by combining text presentation mode and speech presentation mode; the text-and-speech digital human presentation mode may refer to a presentation mode formed by combining text presentation mode, speech presentation mode, and digital human video presentation mode.

[0169] In this embodiment, the XR device provides a hybrid display mode to the XR wearer, which can display the second information corresponding to the first information in multiple directions. This not only improves the diversity of the second information display, but also improves the user experience.

[0170] In some embodiments, the method further includes: the digital human video display method is a method of displaying the second information through a digital human that is not a user image.

[0171] Among them, the non-user-image digital human can refer to a 3D digital human with a cartoon character's facial expression, a 3D digital human in the form of a robot, or a 3D digital human formed by a virtual character, and this application does not limit this.

[0172] When the target display method selected by the XR wearer is the digital human video display method, the XR device can display the second information to the user in the form of a digital human that is not the user's image; for example, the first information is a text message, and the second information is text data. The XR wearer can select a digital human with a cartoon character's facial expression to view the text message content. For details, please refer to the interface embodiment below, which will not be repeated here.

[0173] In this embodiment, the XR device displays the second information through a digital human with a non-user image (for example, a digital human with a cartoon image), which not only increases the fun of the information display but also improves the user experience.

[0174] In some embodiments, the digital human video display method is a method of displaying the second information through a digital human of the user image.

[0175] Among them, the digital human of the user's image can refer to a digital human with the user's real facial expression (for example, a digital human with the real facial expression of the XR wearer), or it can refer to a digital human with a real image (for example, a real full-body image of the XR wearer). This application does not limit this.

[0176] When the target display method selected by the XR wearer is the digital human video display method, the XR device can display the second information to the user in the form of a digital human with the user's image; for example, the first information is voice, and the second information is voice data. The XR wearer can select a digital human with real facial expressions to display the content of the voice call. For details, please refer to the interface embodiment below, which will not be repeated here.

[0177] In this embodiment, the XR device displays the second information through a digital human of the user's image (for example, a digital human with the real facial expression of the XR wearer), which can simulate a face-to-face communication scenario and help improve the effectiveness of communication between the two parties.

[0178] In some embodiments, when the digital human video display method is a method of displaying the second information through a digital human with a user image, method 500 also includes: the XR device sends authorization request information to the user terminal, and the authorization request information is used to request whether the user agrees to display the second information through a digital human with his own image; the XR device receives authorization reply information from the user terminal; when the authorization reply information indicates that the user agrees to display the second information through a digital human with his own image, the second information is displayed through the digital human with the user image; or, when the authorization reply information indicates that the user does not agree to display the second information through a digital human with his own image, the second information is displayed through a digital human without the user image.

[0179] Among them, when the user sends the first information to the XR device through the user terminal, the XR wearer can select the target display method according to the first information. When the XR wearer selects the digital human video display method, he or she can further choose to display the second information corresponding to the first information through the digital human with the user's image or to display the first information through a digital human without the user's image. When the XR wearer chooses to display the second information through the digital human with the user's image, the XR device will send an authorization request message to the user terminal to solicit whether the other user agrees to communicate with the XR wearer in his or her own image; when the XR device receives the authorization reply message sent by the user terminal, the XR device will display the second information through the digital human with the user's image; when the XR device receives the authorization reply message sent by the user terminal indicating that the user does not agree to display the second information through the digital human with his or her own image, the XR device can display the second information through the digital human without the user's image.

[0180] In this embodiment, the XR device sends an authorization request message to the user terminal to ask whether the other user agrees to communicate with the XR wearer in his or her own image, instead of directly using the other user's real image, leaving the other user with room for choice, which can improve the user experience of both parties.

[0181] In some embodiments, the method also includes: the XR device obtains third information, the third information is information on the XR device; the XR device obtains second operation information, the second operation information is used to indicate that the third information is switched from a preset display mode to a target display mode; the XR device responds to the second operation information and displays the third information in the target display mode.

[0182] Among them, the third information can be file information stored locally on the XR device, or web page content downloaded by the XR wearer through the XR device, or historical meeting content. This application does not limit this. For details, please refer to the interface embodiment below and will not go into details here.

[0183] When the XR wearer wants to display file information stored locally on the XR device, he or she can select a target display method for displaying third information (for example, text information) on the virtual user interface. At this time, the virtual user interface generates second operation information in response to the XR wearer's operation; the XR device switches the display method of the third information from the preset display method to the target display method according to the target display method indicated by the second operation information; the XR device displays the third information to the XR wearer using the target display method.

[0184] For example, the XR device obtains third information (such as historical meeting content); the XR wearer selects the digital human video display method on the virtual user interface to display the third information. At this time, the virtual user interface will generate second operation information and send the second operation information to the XR device; the XR device receives the second operation information and displays the third information to the XR wearer through the digital human video display method based on the second operation information.

[0185] In this embodiment, the XR device provides a variety of ways to display the third information, which not only increases the presentation methods of the third information but also improves the user experience.

[0186] The method 500 and possible implementations are introduced in detail above. The method 500 and possible implementations are further explained below in conjunction with interface embodiments of different application scenarios.

[0187] As shown in Figure 4, the call request sent by the contact Wang XX is displayed on the call interface 402 shown in (b) of Figure 4; the XR wearer can click the text display mode 403 to answer Wang XX's voice call; when the XR wearer answers Wang XX's voice call in text display mode, as shown in (a) of Figure 6, a text display mode interface 601 can be displayed on the call interface 402; the call information (or call content) between the XR wearer and the contact Wang XX can be displayed in text form on this interface 601.

[0188] In some embodiments, the XR wearer can also reselect a new target display mode in the target display mode below the interface 601 shown in (a) in Figure 6, for example, select "digital human video display mode 602"; of course, he can also return to the call interface 402 shown in (b) in Figure 4 to reselect the target display mode, for example, select digital human video display mode 404.

[0189] For example, when the XR wearer selects "digital human video display mode 603" on the call interface 402 shown in (b) of Figure 6, a selection box 604 will pop up on the call interface 402; the XR wearer can select the required display mode in the selection box 604, for example, select the display mode of the text digital human 605, and select the display mode of the non-user image 606; at this time, the XR device will jump from the call interface 402 to the video interface 701, and the XR device will display the call information between the XR wearer and the contact Wang XX through the text box 702 and the cartoon character 703, as shown in (a) of Figure 7.

[0190] It should be noted that the XR wearer can also reselect a new target display mode on the video interface 701. At this time, the XR device can switch from the current display mode to the target display mode; for example, as shown in (a) in Figure 7, when the XR wearer reselects the voice display mode 704 on the video interface 701, in response to the XR wearer's selection, the XR device can switch from the text digital human display mode to the voice call interface 705, as shown in (b) in Figure 7.

[0191] For another example, as shown in (a) in FIG8 , when the XR wearer selects “digital human video display mode 603” on the call interface 402 , a selection box 604 will pop up on the call interface 402 ; the XR wearer can select the voice digital human 801 and the non-user image 802 in the selection box 604 ; at this time, the XR device will jump from the call interface 402 to the video interface 701 , and the XR device will display the call information between the XR wearer and the contact Wang XX orally in the form of a cartoon character 803 making a phone call, as shown in (b) in FIG8 .

[0192] For another example, as shown in (a) in FIG9 , the XR wearer can select the display method of the video digital human 901 and the display method of the non-user image 902 in the selection box 604; at this time, the XR device will jump from the call interface 402 to the video interface 701, and the XR device will display the call information between the XR wearer and the contact Wang XX in the form of face-to-face communication between the cartoon characters 903 and 904, as shown in (b) in FIG9 .

[0193] In some embodiments, the XR wearer can select a mixed display mode on the call interface 402 shown in (a) in Figure 10; when the XR wearer selects "mixed display mode 1001" on the call interface 402 shown in (a) in Figure 10, a selection box 1002 pops up on the call interface 402; the XR wearer can select text voice 1003 and select a user image 1004 in the selection box 1002; at this time, as shown in (a) in Figure 10, the XR device can jump from the call interface 402 to the video interface 701, and the XR device displays the call information between the XR wearer and the contact Wang XX in the form of a text box 1005 and a voice call 1006.

[0194] It should be noted that the XR wearer can also choose to switch to a new target display mode on the video interface 701, for example, as shown in (b) in Figure 10, select the voice display mode 1007.

[0195] In some embodiments, as shown in FIG11 , the XR wearer may also select a display method for the text-voice digital human 1101 and a display method for the non-user image 1102 in the selection box 1002 , as shown in (a) in FIG11 ; the XR device will jump from the call interface 402 to the video interface 701 , and the XR device will display the call information between the XR wearer and the contact Wang XX in the form of a cartoon character image 1103 , a text box 1104 , and a cartoon character image 1105 of the XR wearer and a text box 1106 , as shown in (b) in FIG11 .

[0196] In some embodiments, the XR wearer selects the text-voice digital human display mode 1101 on the selection box 1002, and can also select the display mode of the user image 1201, as shown in (a) in Figure 12; at this time, the XR device will send an authorization request message to the user terminal used by Wang XX; when Wang XX agrees to display the call information of both parties through the digital human with his own image, the XR device obtains Wang XX's real image (for example, real facial expression), for example, obtains the real image of the contact Wang XX from the local database; at the same time, the XR device jumps from the call interface 402 to the video interface 701, and the XR device displays the call information between the XR wearer and the contact Wang XX in the form of a digital human image 1202 with Wang XX's real facial expression, a text box 1203, and a digital human image 1204 with the XR wearer's real facial expression and a video of the content of the text box 1205, as shown in (b) in Figure 12.

[0197] Figure 13 shows another application scenario applicable to the present application. As shown in Figure 13, the video call interface 1301 shown in Figure 13 (a) displays a video request sent by contact Wang XX; the XR wearer can click the text display mode 1302 to answer Wang XX's video call; after the XR wearer chooses to answer Wang XX's video call in text display mode, a text display mode online message interface 1303 will be displayed on the video call interface 1301, as shown in Figure 13 (b); the video call information (or video call content) between the XR wearer and contact Wang XX will be displayed in text form on the interface 1303; the XR wearer can enter the text to be sent in the text input box 1304 shown in Figure 13 (b).

[0198] It should be noted that the XR wearer can also reselect a new target display mode on the video call interface 1301 shown in (b) of Figure 13, for example, select "video display mode 1305"; of course, it can also return to the video call interface 1301 shown in (a) of Figure 13 to reselect the target display mode, for example, as shown in (a) of Figure 14, select "video display mode 1401"; when the XR wearer chooses to answer Wang XX's video call in video display mode, a call window 1402 with Wang XX's real image 1403 will be displayed on the video call interface 1301, and the call window 1402 also displays the XR wearer's real image 1404, as shown in (b) of Figure 14.

[0199] In some embodiments, the XR wearer can also reselect the digital human video display mode 1502 on the video call interface 1301 shown in (a) of Figure 15; when the XR wearer chooses to answer Wang XX's video call in the digital human video display mode 1502, a selection box 1503 will pop up on the video call interface 1301; the XR wearer can select the required display mode in the selection box 1503, for example, select the display mode of the voice digital human 1504, and select the display mode of the non-user image 1505; the XR device will switch from the voice call window 1501 on the video call interface 1301 to the digital human face-to-face communication video interface 1506, as shown in (b) of Figure 15, wherein the video interface 1506 includes the cartoon character image 1507 of the XR wearer and the cartoon character image 1508 of Wang XX.

[0200] Figure 16 illustrates another application scenario applicable to this application. As shown in Figure 16 (a), the XR device receives a short message (i.e., SMS) from contact Wang XX via his mobile phone. At this point, the XR device generates a message reminder text box on the short message interface 1601. The XR wearer can choose to "not view it yet" or select text display mode 1602, voice display mode 1603, or other modes to view the message.

[0201] In some embodiments, if the XR wearer selects the text display mode 1602 to view the text message, a message viewing window 1608 will be displayed on the short message interface 1601, as shown in (b) of Figure 16. At this time, the XR wearer can see the text message content 1609 sent by Wang XX, and accordingly, can also reply in the text input box 1610 according to the text message content 1609. It should be noted that the XR wearer can also choose to switch to a new target display mode on the short message interface 1601, for example, as shown in (b) of Figure 16, select a voice display mode or a mixed display mode (as shown in 1611).

[0202] In some embodiments, as shown in FIG16(a), if the XR wearer selects the voice display mode 1603 to view the text message, a message viewing window 1701 will be displayed on the short message interface 1601, as shown in FIG17(a); the XR wearer can listen to the text message content 1702 sent by Wang XX through voice playback in the window 1701. It should be noted that the XR wearer can also choose to switch to a new target display mode on the short message interface 1601, for example, as shown in FIG16(b), select the voice display mode or the mixed display mode (as shown in 1612).

[0203] In some embodiments, as shown in FIG16(a), if the XR wearer selects the mixed display mode 1604 to view text messages and selects the non-user image 1607 and text-to-speech digital human display mode 1606, then as shown in FIG17(b), a cartoon digital human video window 1703 will be displayed on the short message interface 1601; wherein, the video window 1703 includes the cartoon character image 1704 of Wang XX and the corresponding text box 1705, and the cartoon character image 1706 of the XR wearer and the corresponding text box 1707. The video window 1703 displays the information communication process between Wang XX and the XR wearer.

[0204] FIG18 shows another application scenario applicable to the present application. As shown in (a) of Figure 18, the XR device provides a "Create Meeting 1801" option on the main interface 401. The XR wearer can select the "Create Meeting 1801" option on the main interface 401, and a selection box 1802 can pop up on the main interface 401; the XR wearer can select the display format of the meeting in the selection box 1802, for example, select "Text Display Mode 1803"; the XR device will switch from the main interface 401 to the meeting interface 1804, as shown in (b) of Figure 18; the XR wearer can select meeting participants in the contact area 1805, for example, select contact X1, contact X3, contact X5 and contact X7, and the selected contacts will be displayed in area 1806; the XR wearer clicks the "√" button, and the participants of this meeting will be displayed on the participant list 1807; because the XR wearer selects "Text Display Mode", on the meeting content interface 1808, each participant communicates the content of the meeting in text form.

[0205] It should be noted that the XR wearer can also reselect the target display mode to be switched in the display mode switching area 1809, for example, select "voice display mode 1810". At this time, as shown in (a) in Figure 19, the conference content interface 1808 will display an interface 1901 for each participant to communicate the conference content through voice.

[0206] For example, as shown in (a) in FIG18 , the XR wearer selects the text-to-voice display mode 1811 as the conference display mode in the selection box 1802; the XR device switches from the main interface 401 to the conference interface 1804 shown in (b) in FIG19 ; similarly, the XR wearer can select the meeting participants in the contact area 1805 , and can refer to the relevant description above, which will not be repeated here; because the XR wearer selects the “text-to-voice display mode”, on the conference content interface 1808, each participant can communicate the content of the meeting through voice 1902 and text 1903, as shown in (b) in FIG19 .

[0207] For another example, as shown in (a) in FIG18 , the XR wearer selects the digital human video display mode 1812 as the display mode of the meeting in the selection box 1802, and selects the non-user image 1813 for display; the XR device will switch from the main interface 401 to the meeting interface 1804 shown in (a) in FIG20 ; among them, the way in which the XR wearer selects the meeting participants can refer to the relevant description above and will not be repeated here; because the XR wearer selects the "digital human video display mode", on the meeting content interface 1808, each participant can communicate on the content of the meeting through the virtual meeting form 2001, as shown in (a) in FIG20 .

[0208] For another example, as shown in (a) in FIG18 , the XR wearer selects the text-voice digital human display mode 1814 as the conference display mode in the selection box 1802, and similarly selects the non-user image 1813; the XR device switches from the main interface 401 to the conference interface 1804 shown in (b) in FIG20 ; among them, the way in which the XR wearer selects the conference participants can refer to the relevant description above, which will not be repeated here; because the XR wearer selects the "text-voice digital human display mode", on the conference content interface 1808, each participant can communicate on the content of the conference through the virtual conference form 2002 with text display.

[0209] Figure 21 shows another application scenario applicable to this application. The application scenario shown in Figure 21 is used to illustrate that the XR device can also display historical meeting content and local data through text display, voice display, etc.

[0210] For example, as shown in (a) in Figure 21, the XR wearer can select the content to be displayed in the display mode selection area 2101, for example, as shown in (a) in Figure 21, select the "historical meeting materials" option 2102 to be displayed, and select the "text display mode 2103"; the XR device responds to the XR wearer's selection and displays the historical meeting content interface 2104 on the meeting interface 1804; the interface 2104 will display previous meeting materials and the historical speech records of each participant.

[0211] For another example, as shown in (b) of FIG21 , the XR wearer can click on the “local data 2105” option to be displayed in the display mode selection area 2101, and select the “digital human video display mode 2106”; the XR device responds to the selection of the XR wearer and displays the local data interface 2107 on the conference interface 1804; the local data will be displayed on the interface 2107, where the local data can be web page content, local text files, voice files, or video files, etc., and this application does not limit this.

[0212] For ease of understanding, the method for displaying information proposed in this application is further explained below in conjunction with the specific embodiments shown in Figures 22 to 28.

[0213] As shown in FIG22 , a process step of a method for displaying information on an XR device is shown. The XR device includes a voice conversion unit, a text conversion unit, and a digital human rendering module. The voice conversion unit is used to convert SMS data (also known as text data) and video data into voice data; the text transcription unit is used to convert voice data and video data into text data; and the digital human rendering module is used to generate various non-user images (e.g., cartoon characters). It should be noted that voice data may refer to data generated during a voice call. The process steps may include:

[0214] First, the XR device receives any of a text message, a call request, or a video request.

[0215] Secondly, the XR device determines the specific conversion unit to call based on the type of data received and the target display method selected by the XR wearer. For example, if the XR device receives a text message and the XR wearer selects the voice display method, the XR device calls the voice conversion unit to convert the text data corresponding to the text message into voice data, and displays it to the XR wearer in the form of voice playback.

[0216] For example, when the XR device receives a text message, if the XR wearer chooses the voice digital human display mode, the XR device calls the voice conversion unit to convert the text data corresponding to the text message into voice data, and calls the digital human rendering module. Finally, the text message content is dictated to the XR wearer through the digital human voice dictation.

[0217] FIG23 shows the process steps of another method for displaying information on an XR device:

[0218] First, the XR device receives a first message, such as a text message, a call request, or a video request.

[0219] Secondly, the XR device generates an inquiry message asking whether to switch the display mode; the XR wearer can choose whether to switch the display mode according to the inquiry message. If the XR wearer chooses to switch the display mode, the XR device displays the second information corresponding to the first information according to the target display mode; if the XR wearer chooses not to switch the display mode, the XR device displays the second information corresponding to the received first information according to the default display mode or the preset display mode. For example, the preset display mode for viewing text messages is the text display mode, the default display mode for voice calls is the voice display mode, and the default display mode for video calls is the video display mode. Among them, the video display mode is that the XR wearer and the other contact are displayed in the form of real people (for example, real facial expressions).

[0220] Again, the XR wearer selects the target display method on the virtual user interface, and the virtual user interface will generate the first operation information based on the selected target display method; the XR device obtains the first operation information from the virtual user interface. For example, the XR wearer can select text display method, voice display method, digital human video display method, etc. on the virtual user interface.

[0221] Finally, the XR device determines a method for displaying the second information based on the first operation information, and displays the second information according to the selected target display method.

[0222] As shown in FIG24 , the specific process steps of a method for displaying text messages on an XR device are shown:

[0223] First, the XR device receives the text message.

[0224] Secondly, the XR device generates an inquiry message X1 based on the received text message, asking whether to switch the display mode; the XR wearer can choose whether to switch the display mode based on the inquiry message X1. If the XR wearer chooses not to switch the display mode, the XR device displays the text message content in the default text display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message X2 asking whether to select the digital human display mode; the XR wearer can choose whether to use the digital human display mode based on the inquiry message X2; if the XR wearer chooses the digital human display mode, the XR wearer can further determine whether to select the text digital human display mode, the voice digital human display mode, or the text and voice digital human display mode; the XR device can display the text message content according to the display mode selected by the XR wearer (for example, the voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the voice display mode to display the text message content.

[0225] As shown in FIG25 , the specific process steps of a method for displaying a voice call on an XR device are shown:

[0226] First, the XR device receives a call request.

[0227] Secondly, the XR device generates an inquiry message Y1 asking whether to switch the display mode based on the call request; the XR wearer can choose whether to switch the display mode based on the inquiry message Y1. If the XR wearer chooses not to switch the display mode, the XR device displays the voice call content according to the default voice display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message Y2 asking whether to select the digital human display mode; the XR wearer can determine whether to use the digital human display mode based on the inquiry message X2; if the XR wearer chooses the digital human display mode, the XR wearer can further choose whether to select the text digital human display mode, the voice digital human display mode or the text and voice digital human display mode; the XR device can display the voice call content according to the display mode selected by the XR wearer (for example, the voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the text display mode to display the voice call content.

[0228] As shown in FIG26 , the process steps of a method for displaying a video call on an XR device are shown:

[0229] First, the XR device receives a video request.

[0230] Secondly, the XR device generates an inquiry message M1 asking whether to switch the display mode based on the video request; the XR wearer can choose whether to switch the display mode based on the inquiry message M1. If the XR wearer chooses not to switch the display mode, the XR device displays the video call content according to the default video display mode; if the XR wearer chooses to switch the display mode, the XR device generates an inquiry message M2 asking whether to select the digital human display mode; the XR wearer can determine whether to use the digital human display mode based on the inquiry message M2; if the XR wearer chooses the digital human display mode, the XR wearer can further determine whether to select the text digital human display mode, the voice digital human display mode, or the text and voice digital human display mode; the XR device can display the video call content according to the display mode selected by the XR wearer (for example, the text and voice digital human display mode); if the XR wearer does not choose the digital human display mode, the XR wearer can choose the text display mode or the voice display mode to display the video call content.

[0231] As shown in FIG27 , an interface process step of a method for displaying information on an XR device is shown; as shown in FIG27 (a), the XR device includes but is not limited to a virtual user interface, and the virtual user interface includes but is not limited to an application screen, on which the first information, the information transcription module, and the digital human rendering module are displayed, wherein the information transcription module is used to control the mutual conversion between text, voice, and video, such as text-to-speech, voice-to-text, text-to-video, etc.; the digital human rendering module is used to render the digital human in scenarios such as text messages, voice calls, video calls, and conferences. For example, as shown in FIG27 (b), when the XR device receives a text message, if the XR wearer selects the text digital human display mode in the digital human video display mode, the XR device will call the digital human rendering module to display the second information on the application screen using the text digital human display mode. For example, the application screen displays the digital human rendered by the digital human rendering module and the text information in the text box.

[0232] The above describes in detail an example of the method for processing broadcast information provided by the present application. It is understandable that, in order to implement the above functions, the terminal device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0233] The present application can divide the method for processing broadcast information into functional units based on the above method examples. For example, each function can be divided into individual functional units, or two or more functions can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units. It should be noted that the division of units in this application is schematic and is only a logical functional division. In actual implementation, other division methods may be used.

[0234] FIG28 shows a schematic diagram of the structure of a terminal device provided by the present application. The dotted lines in FIG28 indicate that the unit or module is optional. Terminal device 2800 can be used to implement the method described in the above method embodiment. Terminal device 2800 can be a server or a chip (system).

[0235] The terminal device 2800 includes one or more processors 2801, which can support the terminal device 2800 to implement the method in the method embodiment corresponding to Figure 5. The processor 2801 can be a general-purpose processor or a special-purpose processor. For example, the processor 2801 can be a central processing unit (CPU). The CPU can be used to control the terminal device 2800, execute software programs, and process data of the software programs. The terminal device 2800 can also include a communication unit 2805 to implement signal input (reception) and output (transmission).

[0236] The terminal device 2800 may be a chip (system) including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory to implement the methods shown in the above embodiments.

[0237] The communication unit 2805 may be an input and / or output circuit of the chip (system), or the communication unit 2805 may be a communication interface of the chip (system), and the chip (system) may serve as a component of the terminal device 2800 .

[0238] For another example, the communication unit 2805 may be a transceiver of the terminal device 2800 , or the communication unit 2805 may be a transceiver circuit of the terminal device 2800 .

[0239] The terminal device 2800 may include one or more memories 2802, on which a program 2804 is stored. The program 2804 can be executed by the processor 2801 to generate instructions 2803, so that the processor 2801 performs the method described in the above method embodiment according to the instructions 2803. Optionally, data may also be stored in the memory 2802. Optionally, the processor 2801 may also read data stored in the memory 2802. The data may be stored at the same storage address as the program 2804, or the data may be stored at a different storage address than the program 2804.

[0240] The processor 2801 and the memory 2802 may be provided separately or integrated together, for example, integrated on a system on chip (SOC) of a terminal device.

[0241] The specific manner in which the processor 2801 executes the method for displaying information can be found in the relevant description of the method embodiment.

[0242] It should be understood that each step of the above method embodiment can be completed by hardware logic circuits or software instructions in the processor 2801. The processor 2801 can be a CPU, a digital signal processor (DSP), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0243] The present application also provides a computer program product, which, when executed by the processor 2801, implements the method of any method embodiment in the present application.

[0244] The computer program product may be stored in the memory 2802 , for example, a program 2804 , which is converted into an executable target file that can be executed by the processor 2801 after undergoing preprocessing, compilation, assembly, and linking.

[0245] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a computer, implements any method embodiment of the present application. The computer program may be a high-level language program or an executable target program.

[0246] The computer-readable storage medium is, for example, memory 2802. Memory 2802 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SynchLink DRAM, SLDRAM), and direct RAM bus random access memory (DRRAM).

[0247] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

[0248] In several embodiments provided in this application, the disclosed systems, devices, and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not executed. The device embodiments described above are merely schematic, and the splitting of units is only a logical function splitting. There may be other splitting methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0249] The above embodiments are intended only to illustrate the technical solutions of the present application and are not intended to limit the same. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they may still modify the technical solutions described in the above embodiments or replace some of the technical features therein with equivalents, and that such modifications or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present application and are therefore intended to be included within the scope of protection of the present application.

[0250] Finally, the above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be covered by the scope of protection of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection of the claims.

Claims

1. A method for displaying information, characterized in that: Applied to a terminal device, the method comprises: Receiving first information, where the first information is any one of a text message, a call request, or a video request; Acquire first operation information, where the first operation information is used to instruct to switch a display mode of second information corresponding to the first information from a preset display mode to a target display mode; In response to the first operation information, the second information is displayed in the target display manner.

2. The method according to claim 1, characterized in that The method further comprises: When the first information is a text message, the preset display mode is a text display mode, and the target display mode is a voice display mode, a digital human video display mode, or a mixed display mode.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: When the first information is the call request, the preset display mode is a voice display mode, and the target display mode is a text display mode, a digital human video display mode, or a mixed display mode.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: When the first information is the video request, the preset display mode is a video display mode, and the target display mode is one of a text display mode, a voice display mode, a digital human video display mode, or a mixed display mode.

5. The method according to any one of claims 2 to 4, characterized in that The mixed display mode is one of a text-voice display mode and a text-voice digital human display mode.

6. The method according to any one of claims 1 to 5, characterized in that The method also includes: the digital human video display method is a method of displaying the second information through a digital human that is not a user image.

7. The method according to any one of claims 1 to 5, characterized in that The method also includes: the digital human video display method is a method of displaying the second information through a digital human with a user image.

8. The method according to claim 7, characterized in that When the digital human video display mode is a mode of displaying the second information through a digital human of a user image, the method further includes: Sending authorization request information to the user terminal, wherein the authorization request information is used to request whether the user agrees to display the second information through a digital person of the user's image; Receiving authorization reply information from the user terminal; When the authorization reply information indicates that the user agrees to display the second information through the digital human with his own image, the second information is displayed through the digital human with the user's image; or, when the authorization reply information indicates that the user does not agree to display the second information through the digital human with his own image, the second information is displayed through a digital human other than the user's image.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: The voice display method is a method of displaying the second information through simulated voice or real person voice.

10. The method according to any one of claims 1 to 9, characterized in that The method further comprises: Acquire third information, where the third information is information on the terminal device; Acquire second operation information, where the second operation information is used to instruct to switch the third information from the preset display mode to the target display mode; In response to the second operation information, the third information is displayed in the target display manner.

11. A terminal device, characterized in that: The terminal device comprises a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the terminal device executes the method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product is configured to, when running on a terminal device, cause the terminal device to execute the method according to any one of claims 1 to 10.

14. A chip system, characterized in that: The chip system includes a memory and a processor, and the processor is configured to execute a computer program stored in the memory to implement the method according to any one of claims 1 to 10.

Images