A data processing method and related apparatus

Abstract

A data processing method, the method comprising: acquiring data collected by an inertial sensor of a terminal, and a display state of the terminal; the display state is used to indicate that the terminal displays in at least one of the following manners: a landscape mode, a portrait mode, a folded state and an unfolded state; taking the data and the display state as inputs of a machine learning model, and identifying a target supporting manner of the terminal from a plurality of supporting manners through the machine learning model; the supporting manner comprises at least one of the following: being held by a left hand of a user, being held by a right hand of the user, and being held by both hands of the user. The application can identify a more accurate supporting manner of the terminal.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a data processing method and related apparatus. Background Technology

[0002] As smartphone screens continue to grow larger, one-handed operation has become a significant problem, as users find it difficult to reach certain areas of the screen when holding and operating the device with one hand. Furthermore, holding the phone can obstruct the antenna, affecting communication quality, and the extent of antenna obstruction varies depending on how the hand is positioned. In other words, different support methods (e.g., how the user holds the device) may require different control strategies for the terminal (e.g., different interface display methods or different antenna control methods).

[0003] Therefore, there is an urgent need for a method that can determine the support mode of the terminal. Summary of the Invention

[0004] This application provides a data processing method and related apparatus that can more accurately identify the support mode of the terminal.

[0005] In a first aspect, embodiments of this application provide a data processing method, the method comprising: acquiring data collected by an inertial sensor of a terminal, and the display state of the terminal; the display state being used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in a folded state, and in an unfolded state; using the data and the display state as input to a machine learning model, and identifying a target support method of the terminal from multiple support methods through the machine learning model; the support method including at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

[0006] For a terminal, different display states (e.g., landscape, portrait, folded, or unfolded) result in different support methods (e.g., left-hand, right-hand, or two-handed holding) even when the terminal is in the same motion state. For example, when the terminal is displayed in landscape mode, the user's hand is usually in contact with the terminal on the shorter side when held by the left or right hand. When the terminal is displayed in portrait mode, the user's hand is usually in contact with the terminal on the longer side when held by the left or right hand. The same principle applies to different unfolding methods (folded or unfolded). Therefore, to improve the accuracy of terminal support method recognition, this application also uses the terminal's display state as input to the model. This allows the model to use the terminal's display state as prior information when predicting the terminal's support method, thus enabling more accurate identification of the terminal's support method even under different display states.

[0007] In one possible implementation, the data includes data from the terminal at different times on multiple axes, where the axes are direction axes or rotation axes. The machine learning model includes a feature extraction network and a task network. Identifying the user's support method for the terminal through the machine learning model includes: processing the data through the feature extraction network to obtain a feature representation of the data; the feature representation includes the temporal correlation of data on different axes; and processing the feature representation through the task network to obtain the user's support method for the terminal.

[0008] This application can combine the correlation of data from different axes in the time dimension to improve the recognition accuracy and stability in complex environments.

[0009] In one possible implementation, the feature extraction network includes a convolutional network and a recurrent neural network; the step of processing the data through the feature extraction network to obtain a feature representation of the data includes: processing the data through the spatial feature extraction network to obtain a convolutional processing result; and processing the convolutional processing result through the time series network to obtain a feature representation of the data.

[0010] In this model, the spatial feature extraction network can be a convolutional network, and the time series network can be a recurrent neural network (RNN). The spatial feature extraction network is used to extract the variation features between different axes of the sensor; the time series network is used to extract the relative variation features of the sensor data over time. Spatial feature extraction networks and time series networks are two complementary feature modeling methods, modeling the spatial correlation and temporal dependence of data respectively. Spatial feature extraction networks can extract the spatial correlation features between different axes (dimensions) of the sensor, capturing the relative change patterns and spatial structure information of the data on each axis at the same moment. Time series networks can capture the dynamic change patterns of sensor data in the time dimension, extracting time-dependent features and long-term evolution patterns.

[0011] In one possible implementation, the support method further includes at least one of the following: being held by the user's hand while also supported by an object other than the hand (e.g., one side of the terminal is held by the user, and the other side is placed on a table); or being supported only by an object other than the hand (e.g., completely placed on a phone stand). This application embodiment reduces the false recognition rate under non-handheld or non-fully-handheld conditions by increasing the machine learning model's prediction of the terminal's support method type (non-handheld and non-fully-handheld).

[0012] In one possible implementation, the method further includes: identifying sub-components of the data; the sub-components indicating motion information of the user in the data that is unrelated to hand movements.

[0013] In this embodiment of the application, by eliminating signal features caused by non-handheld operation, noise or interference is reduced, thereby improving the recognition accuracy in complex environments.

[0014] In one possible implementation, the method further includes: displaying the interface of the terminal according to the support method, wherein the layout of the interface display is related to the support method.

[0015] In one possible implementation, the method further includes: selecting a target antenna as a working antenna from a plurality of antennas of the terminal according to the support method, wherein the position of the target antenna is related to the support method.

[0016] Secondly, this application provides a data processing apparatus, the apparatus comprising:

[0017] The acquisition module is used to acquire data collected by the terminal's inertial sensor and the terminal's display state; the display state is used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in a folded state, and in an unfolded state.

[0018] The prediction module is used to take the data and the display status as input to a machine learning model, and to identify the target support method of the terminal from multiple support methods through the machine learning model; the support method includes at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

[0019] In one possible implementation, the data includes data from the terminal at different times on multiple axes, where the axes are direction axes or rotation axes, and the prediction module is used to:

[0020] The data is processed by the feature extraction network to obtain a feature representation of the data; the feature representation includes the temporal correlation of data on different axes.

[0021] The feature representation is processed by the task network to obtain the user's support method for the terminal.

[0022] In one possible implementation, the feature extraction network comprises a convolutional network and a recurrent neural network; the prediction module is used for:

[0023] The data is processed by the spatial feature extraction network to obtain the convolutional processing result;

[0024] The convolutional processing results are processed by the time series network to obtain the feature representation of the data.

[0025] In one possible implementation, the support method further includes at least one of the following:

[0026] It is held by the user's hand and supported by other objects besides the hand;

[0027] It is supported only by objects other than the hand.

[0028] In one possible implementation, the acquisition module is further configured to;

[0029] Identify sub-components of the data; the sub-components indicate the user's motion information in the data that is unrelated to hand movements.

[0030] In one possible implementation, the device further includes:

[0031] The control module is used to display the terminal interface according to the support method, wherein the layout of the interface display is related to the support method.

[0032] In one possible implementation, the device further includes:

[0033] The control module is used to select a target antenna as the working antenna from multiple antennas of the terminal according to the support method, wherein the position of the target antenna is related to the support method.

[0034] Thirdly, this application provides a data processing apparatus, including: a processor, a memory, and a bus, wherein: the processor and the memory are connected via the bus;

[0035] The memory is used to store computer programs or instructions;

[0036] The processor is configured to call or execute programs or instructions stored in the memory to implement the steps described in the first aspect and any possible implementation thereof.

[0037] Fourthly, this application provides a computer storage medium including computer instructions that, when executed on an electronic device or server, perform the steps described in the first aspect and any possible implementation thereof.

[0038] Fifthly, this application provides a computer program product that, when run on an electronic device or server, performs the steps described in the first aspect and any possible implementation thereof.

[0039] Sixthly, this application provides a chip system including a processor for supporting a device in implementing the functions involved in the foregoing aspects, such as transmitting or processing data involved in the foregoing methods; or, information. In one possible design, the chip system further includes a memory for storing program instructions and data necessary for executing or training the device. This chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0040] To more clearly illustrate the technical methods of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly described below.

[0041] Figure 1 A schematic diagram of an application architecture provided for an embodiment of this application;

[0042] Figure 2 A schematic diagram of an application architecture provided for an embodiment of this application;

[0043] Figure 3 This is a schematic diagram of a data processing method provided in an embodiment of this application;

[0044] Figures 4 to 5 A schematic diagram of an interface provided for an embodiment of this application;

[0045] Figure 6 A schematic diagram of an apparatus provided in an embodiment of this application;

[0046] Figure 7 This is a schematic diagram of an apparatus provided in an embodiment of this application. Detailed Implementation

[0047] The embodiments of the present invention will now be described with reference to the accompanying drawings. The terminology used in the embodiments section is for illustrative purposes only and is not intended to limit the scope of the invention.

[0048] The embodiments of this application will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.

[0049] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not explicitly listed or inherent to those processes, methods, products, or apparatuses.

[0050] The terms “substantially,” “about,” and similar terms used herein are used as approximations rather than as terms of degree, and are intended to take into account the inherent biases of measurements or calculations known to those skilled in the art. Furthermore, the use of “may” in describing embodiments of the invention refers to “one or more possible embodiments.” The terms “use,” “using,” and “used” used herein are to be considered synonymous with the terms “utilize,” “utilizing,” and “utilized,” respectively. Additionally, the term “exemplary” is intended to refer to an instance or illustration.

[0051] For ease of understanding, the structure of the terminal 100 provided in the embodiments of this application will be illustrated below. See also Figure 1 , Figure 1 This is a schematic diagram of the structure of the terminal device provided in the embodiments of this application.

[0052] like Figure 1As shown, terminal 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0053] It is understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the terminal 100. In other embodiments of this application, the terminal 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0054] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0055] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0056] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0057] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0058] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the terminal 100.

[0059] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0060] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0061] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0062] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the shooting function of the terminal 100. The processor 110 and the display screen 194 communicate via the DSI interface to enable the display function of the terminal 100.

[0063] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0064] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge terminal 100, and can also be used for data transfer between terminal 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0065] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the terminal 100. In other embodiments of this application, the terminal 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0066] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the terminal 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0067] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0068] The wireless communication function of terminal 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0069] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0070] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G on the terminal 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0071] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0072] The wireless communication module 160 can provide solutions for wireless communication applications on the terminal 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0073] In some embodiments, antenna 1 of terminal 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling terminal 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0074] Terminal 100 implements display functions through a GPU, display screen 194, and application processor. The GPU is a microprocessor for page display, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. Specifically, one or more GPUs in processor 110 can perform image rendering tasks (such as the rendering tasks related to the image to be displayed in this application), and pass the rendering results to the application processor or other display driver, which triggers the display screen 194 to display video.

[0075] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Minied, MicroLED, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, terminal 100 may include one or N displays 194, where N is a positive integer greater than 1. The displays 194 can display the target video in the embodiments of this application. In one implementation, terminal 100 can run a camera-related application. When the camera-related application is opened on the terminal, display screen 194 can display a shooting interface, which may include a viewfinder, within which the target video can be displayed.

[0076] Terminal 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0077] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0078] Camera 193 is used to capture still images or videos.

[0079] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when terminal 100 selects a frequency point, the DSP can perform Fourier transforms on the frequency energy.

[0080] Video codecs are used to compress or decompress digital video. Terminal 100 may support one or more video codecs. Thus, terminal 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0081] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs can enable intelligent cognitive applications in terminals, such as image recognition, facial recognition, speech recognition, and text understanding.

[0082] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the terminal 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0083] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of terminal 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of terminal 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0084] Terminal 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0085] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0086] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal 100 can listen to music or make hands-free calls through the speaker 170A.

[0087] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the terminal 100 receives a phone call or voice message, the receiver 170B can be brought close to the listener's ear to hear the voice.

[0088] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Terminal 100 may have at least one microphone 170C. In some embodiments, terminal 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, terminal 100 may have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0089] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0090] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on the display screen 194 or the side edge of the terminal. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Terminal 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, terminal 100 detects the intensity of the touch operation based on pressure sensor 180A. Terminal 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands.

[0091] The electronic device has a screen and a mid-frame, with the screen fixed to the mid-frame.

[0092] In one embodiment, the electronic device has a side button on its mid-frame. A capacitive touch sensor or other touch sensor can be mounted on the surface of the side button to detect user touch gestures. In addition, the electronic device also has at least one pressure sensor 180A corresponding to the side button to sense pressure applied to it.

[0093] In another embodiment, at least a portion of the electronic device's frame can undergo micro-deformation under external force, and at least one pressure sensor is provided for this micro-deformable portion to sense the pressure. For touch recognition, a touch sensor can be placed on the micro-deformable portion to achieve touch detection, or optical ranging can be used. Optical ranging involves emitting light from a light source; when the light is blocked by a finger, the distance to the obstacle is measured, and the gesture and the swipe distance of the gesture are detected by detecting changes in distance.

[0094] In general, electronic devices can detect pressure and touch gestures applied to the bezel, which can be achieved by setting buttons on the bezel or by using the entire bezel as a button.

[0095] The gyroscope sensor 180B can be used to determine the motion attitude of the terminal 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the terminal 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal 100's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the terminal 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0096] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0097] The magnetic sensor 180D includes a Hall sensor. The terminal 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the terminal 100 is a flip phone, the terminal 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0098] The 180E accelerometer can detect the magnitude of acceleration of terminal 100 in various directions (typically three axes). When terminal 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices, and is applied to applications such as screen orientation switching and pedometers.

[0099] A distance sensor 180F is used to measure distance. The terminal 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, the terminal 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0100] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The terminal 100 emits infrared light outward through the LED. The terminal 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal 100. When insufficient reflected light is detected, the terminal 100 can determine that there is no object near the terminal 100. The terminal 100 may use the proximity sensor 180G to detect when a user holds the terminal 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and screen locking.

[0101] The ambient light sensor 180L is used to sense the ambient light intensity. The terminal 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the terminal 100 is in a pocket to prevent accidental touches.

[0102] The fingerprint sensor 180H is used to collect fingerprints. The terminal 100 can use the characteristics of the collected fingerprints to unlock the device, access application locks, take photos with fingerprints, and answer calls with fingerprints.

[0103] Temperature sensor 180J is used to detect temperature. In some embodiments, terminal 100 uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, terminal 100 reduces the performance of the processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is below another threshold, terminal 100 heats battery 142 to prevent abnormal shutdown of terminal 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, terminal 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0104] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of terminal 100, in a different position than display screen 194.

[0105] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0106] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Terminal 100 can receive button input and generate key signal inputs related to user settings and function control of terminal 100.

[0107] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0108] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0109] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the terminal 100. The terminal 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The terminal 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal 100 and cannot be separated from the terminal 100.

[0110] The software system of terminal 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of terminal 100.

[0111] Figure 2 This is a software structure block diagram of terminal 100 according to an embodiment of this disclosure.

[0112] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0113] The application layer can include a series of application packages.

[0114] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0115] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0116] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0117] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0118] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0119] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0120] The phone manager is used to provide communication functions for terminal 100. For example, it manages call status (including connection, hang-up, etc.).

[0121] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0122] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0123] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0124] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0125] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0126] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0127] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0128] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0129] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0130] A 2D graphics engine is a graphics engine for 2D drawing.

[0131] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0132] As smartphone screens continue to grow larger, one-handed operation has become a significant problem, as users find it difficult to reach certain areas of the screen when holding and operating the device with one hand. Furthermore, holding the phone can obstruct the antenna, affecting communication quality, and the extent of antenna obstruction varies depending on how the hand is positioned. In other words, different support methods (e.g., how the user holds the device) may require different control strategies for the terminal (e.g., different interface display methods or different antenna control methods).

[0133] Therefore, there is an urgent need for a method that can determine the support mode of the terminal.

[0134] To address the aforementioned problems, embodiments of this application provide a data processing method. For ease of understanding, the data processing method provided by embodiments of this application will be specifically described in conjunction with the accompanying drawings and application scenarios.

[0135] Reference Figure 3 , Figure 3 This is a flowchart illustrating a data processing method according to an embodiment of this application, which includes:

[0136] 301. Acquire data collected by the terminal's inertial sensor and the terminal's display state; the display state is used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in folded mode, and in unfolded mode.

[0137] Reference Figure 4 The embodiments of this application can be deployed on terminal devices, such as portable devices like candybar phones, foldable phones, and tablets. The system includes, but is not limited to, inertial sensors (e.g., accelerometers, gyroscopes, etc.), screens, computing units, and processing units built into the device. Figure 4 The system consists of a processor. The terminal records data through its built-in inertial sensors, and the system reads data such as the screen's display status in real time. Then, the processing unit transmits the above data to the computing unit, which calculates the current support status of the terminal.

[0138] Inertial sensors are a type of sensor based on the principle of inertia (Newtonian mechanics) used to measure the motion state and spatial attitude of an object. Their functions include sensing information such as the object's acceleration, angular velocity, and orientation.

[0139] In one possible implementation, data collected by the terminal's inertial sensors can be acquired. This data may include data from the terminal at different times along multiple axes, which can be direction axes or rotation axes, and the data types may include position, velocity, angular velocity, acceleration, etc.

[0140] For example, data can be collected using the accelerometer and gyroscope built into the terminal to obtain the state changes of the phone on the x, y, and z axes.

[0141] In one possible implementation, sub-components of the data can also be identified; these sub-components indicate motion information of the user (e.g., motion information of the user's body) that is unrelated to hand movements.

[0142] For example, after collecting motion data using inertial sensors (such as accelerometers and gyroscopes), data feature analysis, filtering algorithms, or machine learning models can be combined to remove motion information unrelated to the hand. For instance, time-domain filtering (such as high-pass filtering to remove low-frequency signals below 0.5Hz) and frequency-domain analysis (FFT spectrum to distinguish high-frequency hand movements from low-frequency body movements) can be used to separate the signal. Furthermore, hand-holding status can be identified through posture judgment (such as gravity direction stability and gyroscope rotation threshold), and regular non-hand movements (such as periodic vibrations during walking) can be filtered based on sliding window statistics (such as acceleration variance and motion period). Additionally, machine learning models (such as SVM / LSTM) can be used to train and classify hand and non-hand motion patterns to retain hand-related motion data.

[0143] In this embodiment of the application, by eliminating signal features caused by non-handheld operation, noise or interference is reduced, thereby improving the recognition accuracy in complex environments.

[0144] The display state can be used to indicate that the terminal is displayed in one of the following ways: in landscape mode, in portrait mode, in folded mode, or in unfolded mode.

[0145] In the technical implementation of terminal devices (such as mobile phones and foldable screen devices), the display state is usually used as an enumeration type or flag to indicate the current display mode of the device. Landscape mode is when the device screen width is greater than its height (aspect ratio > 1), and is usually used in immersive scenarios (such as video playback and games). Portrait mode is when the device screen height is greater than its width (aspect ratio < 1), and is the default state for most mobile phones.

[0146] For a terminal, different display states (e.g., landscape, portrait, folded, or unfolded) result in different support methods (e.g., left-hand, right-hand, or two-handed holding) even when the terminal is in the same motion state. For example, when the terminal is displayed in landscape mode, the contact point between the user's hand and the terminal is usually on the shorter side of the terminal when held by the user's left or right hand. When the terminal is displayed in portrait mode, the contact point between the user's hand and the terminal is usually on the longer side of the terminal when held by the user's left or right hand. The same principle applies to different unfolding methods (folded or unfolded).

[0147] Therefore, in order to improve the accuracy of terminal support mode recognition, this application also uses the terminal display state as the input of the model, so that when the model predicts the terminal support mode, it can use the terminal display state as prior information, and thus still be able to identify the terminal support mode more accurately under different terminal display states.

[0148] The machine learning model that identifies the terminal's support mode can be the same, rather than multiple. By using the same model to process the data collected by the inertial sensor and the terminal's display mode information, the model switching delay can be eliminated.

[0149] The display status of a device can be determined, but is not limited to, by detecting changes in screen orientation and size, as well as device characteristics. For example, landscape or portrait mode can be determined by comparing the screen aspect ratio (landscape if the width is greater than the height, and portrait if the width is less than the height), or by calling system APIs to monitor orientation changes in real time. Folded or unfolded mode (such as foldable phones) can be determined by combining changes in screen aspect ratio (folded mode is close to 1.7:1 for traditional phones, unfolded mode is close to 1:1), APIs (such as MultiWindowUtils), or by using hinge angle sensors or magnetic sensors to detect whether the device is in split-screen mode.

[0150] 302. Using the data and the display status as input to a machine learning model, the machine learning model identifies the target support method of the terminal from multiple support methods; the support method includes at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

[0151] In this embodiment of the application, the data and the display status can be used as input to a machine learning model, and the machine learning model can predict the support mode of the terminal.

[0152] In one possible implementation, the machine learning model includes a feature extraction network and a task network. The feature extraction network can then process the data to obtain a feature representation of the data. The feature representation includes the temporal correlation of data on different axes. Subsequently, the task network can process the feature representation to obtain the user's support method for the terminal.

[0153] This application can combine the correlation of data from different axes in the time dimension to improve the recognition accuracy and stability in complex environments.

[0154] In one possible implementation, the feature extraction network includes a convolutional network and a recurrent neural network; then, the data can be processed by the spatial feature extraction network to obtain the convolutional processing result; the convolutional processing result can be processed by the time series network to obtain the feature representation of the data.

[0155] In one possible implementation, the support method further includes at least one of the following: being held by the user's hand while also supported by an object other than the hand (e.g., one side of the terminal is held by the user, and the other side is placed on a table); or being supported only by an object other than the hand (e.g., completely placed on a phone stand). This application embodiment reduces the false recognition rate under non-handheld or non-fully-handheld conditions by increasing the machine learning model's prediction of the terminal's support method type (non-handheld and non-fully-handheld).

[0156] In one possible implementation, the terminal's interface display can also be based on the support method, with the interface layout related to the support method. For example, if the support method is determined to be left-handed, the interface layout can be positioned to the left; if the support method is determined to be right-handed, the interface layout can be positioned to the right; if the support method is determined to be two-handed, the interface layout can be the same as the normal layout. However, if the support method is determined to be non-handed or not fully handheld, the interface layout can be the same as the normal layout.

[0157] In one possible implementation, a target antenna can be selected as the working antenna from among the multiple antennas of the terminal, depending on the support method. The position of the target antenna is related to the support method. For example, to ensure that the signal of the working antenna is not blocked by a hand, the position of the target antenna as the working antenna can be avoided from the position where the hand would obstruct it.

[0158] Reference Figure 5 , Figure 5 This is a schematic diagram of an application architecture according to an embodiment of this application, wherein the data collected by the inertial sensor ( Figure 5The image shows the accelerometer and gyroscope, as well as the terminal's display status. Figure 5 The screen display orientation shown in the image can be used as a data stream input into the AI ​​model. Then, the support mode is obtained through the hand gesture output interface, and the support mode is then input into the upper-layer application.

[0159] This application also provides a data processing apparatus, which may be a terminal device, see reference. Figure 6 , Figure 6 This is a schematic diagram of the structure of a data processing apparatus provided in an embodiment of this application, such as... Figure 6 As shown in the figure, the data processing device 600 includes:

[0160] The acquisition module 601 is used to acquire data collected by the inertial sensor of the terminal and the display state of the terminal; the display state is used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in folded mode, and in unfolded mode.

[0161] The specific description of the acquisition module 601 can be referred to the description of step 301 in the above embodiment, and the similarities will not be repeated here.

[0162] The prediction module 602 is used to take the data and the display status as input to a machine learning model, and to identify the target support mode of the terminal from multiple support modes through the machine learning model; the support mode includes at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

[0163] The specific description of the prediction module 602 can be referred to the description of step 302 in the above embodiment, and the similarities will not be repeated here.

[0164] In one possible implementation, the data includes data from the terminal at different times on multiple axes, where the axes are direction axes or rotation axes, and the prediction module is used to:

[0165] The data is processed by the feature extraction network to obtain a feature representation of the data; the feature representation includes the temporal correlation of data on different axes.

[0166] The feature representation is processed by the task network to obtain the user's support method for the terminal.

[0167] In one possible implementation, the feature extraction network comprises a convolutional network and a recurrent neural network; the prediction module is used for:

[0168] The data is processed by the spatial feature extraction network to obtain the convolutional processing result;

[0169] The convolutional processing results are processed by the time series network to obtain the feature representation of the data.

[0170] In one possible implementation, the support method further includes at least one of the following:

[0171] It is held by the user's hand and supported by other objects besides the hand;

[0172] It is supported only by objects other than the hand.

[0173] In one possible implementation, the acquisition module is further configured to;

[0174] Identify sub-components of the data; the sub-components indicate the user's motion information in the data that is unrelated to hand movements.

[0175] In one possible implementation, the device further includes:

[0176] The control module is used to display the terminal interface according to the support method, wherein the layout of the interface display is related to the support method.

[0177] In one possible implementation, the device further includes:

[0178] The control module is used to select a target antenna as the working antenna from multiple antennas of the terminal according to the support method, wherein the position of the target antenna is related to the support method.

[0179] The following describes a terminal device provided in an embodiment of this application. The terminal device can be... Figure 6 For the data processing device in the middle, please refer to Figure 7 , Figure 7 This is a schematic diagram of a terminal device provided in an embodiment of this application. The terminal device 800 can specifically be a virtual reality (VR) device, a mobile phone, a tablet, a laptop computer, a smart wearable device, etc., and is not limited thereto. Specifically, the terminal device 800 includes: a receiver 801, a transmitter 802, a processor 803, and a memory 804 (wherein the terminal device 800 may have one or more processors 803). Figure 7 (Taking a processor as an example), the processor 803 may include an application processor 8031 ​​and a communication processor 8032. In some embodiments of this application, the receiver 801, transmitter 802, processor 803, and memory 804 may be connected via a bus or other means.

[0180] Memory 804 may include read-only memory and random access memory, and provides instructions and data to processor 803. A portion of memory 804 may also include non-volatile random access memory (NVRAM). Memory 804 stores processor and operation instructions, executable modules, or data structures, or subsets thereof, or extended sets thereof, wherein the operation instructions may include various operation instructions for implementing various operations.

[0181] The processor 803 controls the operation of the terminal device. In specific applications, the various components of the terminal device are coupled together through a bus system. This bus system includes not only the data bus but also power buses, control buses, and status signal buses. However, for clarity, all buses are referred to as the bus system in the diagram.

[0182] The methods disclosed in the embodiments of this application can be applied to or implemented by processor 803. Processor 803 can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above methods can be completed by integrated logic circuits in the hardware of processor 803 or by instructions in software form. Processor 803 can be a general-purpose processor, a digital signal processor (DSP), a microprocessor, or a microcontroller, and may further include application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. Processor 803 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can reside in a mature storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 804. Processor 803 reads the information in memory 804 and, in conjunction with its hardware, completes the steps of the above method. Specifically, processor 803 can read the information in memory 804 and, in conjunction with its hardware, complete the data processing-related steps in steps 301 to 302 of the above embodiments, as well as the data processing-related steps in steps 301 to 302 of the above embodiments.

[0183] Receiver 801 can be used to receive input digital or character information, and to generate signal inputs related to the settings and function control of the terminal device. Transmitter 802 can be used to output digital or character information through the first interface; transmitter 802 can also be used to send instructions to the disk group through the first interface to modify the data in the disk group; transmitter 802 may also include a display device such as a display screen.

[0184] This application also provides a computer program product that, when run on a computer, causes the computer to perform the functions described in the above embodiments. Figure 3 The steps of the data processing method described in the corresponding embodiments.

[0185] This application also provides a computer-readable storage medium storing a program for signal processing, which, when run on a computer, causes the computer to perform the steps of the data processing method as described in the foregoing embodiments.

[0186] The image display device provided in this application embodiment can specifically be a chip, which includes a processing unit and a communication unit. The processing unit can be, for example, a processor, and the communication unit can be, for example, an input / output interface, pins, or circuits. The processing unit can execute computer execution instructions stored in the storage unit to cause the chip in the execution device to execute the data processing method described in the above embodiments, or to cause the chip in the training device to execute the data processing method described in the above embodiments. Optionally, the storage unit can be a storage unit within the chip, such as a register or cache. Alternatively, the storage unit can be a storage unit located outside the chip within the wireless access device, such as a read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, such as random access memory (RAM).

[0187] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the device embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.

[0188] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0189] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product.

[0190] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

Claims

1. A data processing method, characterized in that, The method includes: The terminal acquires data collected by its inertial sensor and the terminal's display state; the display state is used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in a folded state, and in an unfolded state. The data and the display status are used as input to a machine learning model, which identifies the target support method of the terminal from multiple support methods. The support method includes at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

2. The method according to claim 1, characterized in that, The data includes data from the terminal at different times on multiple axes, where the axes are direction axes or rotation axes. The machine learning model includes a feature extraction network and a task network. Identifying the user's support method for the terminal using the machine learning model includes: The data is processed by the feature extraction network to obtain a feature representation of the data; the feature representation includes the temporal correlation of data on different axes. The feature representation is processed by the task network to obtain the user's support method for the terminal.

3. The method according to claim 2, characterized in that, The feature extraction network includes a spatial feature extraction network and a time series network; the spatial feature extraction network is used to extract the correlation of data along different axes, and the time series network is used to extract the temporal features of data along each axis. The process of processing the data through the feature extraction network to obtain the feature representation of the data includes: The data is processed by the spatial feature extraction network to obtain the convolutional processing result; The convolutional processing results are processed by the time series network to obtain the feature representation of the data.

4. The method according to any one of claims 1 to 3, characterized in that, The support method also includes at least one of the following: It is held by the user's hand and supported by other objects besides the hand; It is supported only by objects other than the hand.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes; Identify sub-components of the data; the sub-components indicate the user's motion information in the data that is unrelated to hand movements.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The terminal interface is displayed according to the support method, and the layout of the interface display is related to the support method.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: According to the support method, a target antenna is selected as the working antenna from multiple antennas of the terminal, and the position of the target antenna is related to the support method.

8. A data processing apparatus, characterized in that, The device includes: The acquisition module is used to acquire data collected by the terminal's inertial sensor and the terminal's display state; the display state is used to indicate that the terminal is displayed in at least one of the following ways: in landscape mode, in portrait mode, in a folded state, and in an unfolded state. The prediction module is used to take the data and the display status as input to a machine learning model, and to identify the target support method of the terminal from multiple support methods through the machine learning model; the support method includes at least one of the following: held by the user's left hand, held by the user's right hand, and held by the user's two hands.

9. The apparatus according to claim 8, characterized in that, The data includes data from the terminal at different times on multiple axes, where the axes are direction axes or rotation axes. The prediction module is used for: The data is processed by the feature extraction network to obtain a feature representation of the data; the feature representation includes the temporal correlation of data on different axes. The feature representation is processed by the task network to obtain the user's support method for the terminal.

10. The apparatus according to claim 9, characterized in that, The feature extraction network includes a convolutional network and a recurrent neural network; the prediction module is used for: The data is processed by the spatial feature extraction network to obtain the convolutional processing result; The convolutional processing results are processed by the time series network to obtain the feature representation of the data.

11. The apparatus according to any one of claims 8 to 10, characterized in that, The support method also includes at least one of the following: It is held by the user's hand and supported by other objects besides the hand; It is supported only by objects other than the hand.

12. The apparatus according to any one of claims 8 to 11, characterized in that, The acquisition module is also used for: Identify sub-components of the data; the sub-components indicate the user's motion information in the data that is unrelated to hand movements.

13. The apparatus according to any one of claims 8 to 12, characterized in that, The device further includes: The control module is used to display the terminal interface according to the support method, wherein the layout of the interface display is related to the support method.

14. The apparatus according to any one of claims 8 to 12, characterized in that, The device further includes: The control module is used to select a target antenna as the working antenna from multiple antennas of the terminal according to the support method, wherein the position of the target antenna is related to the support method.

15. A computer storage medium, characterized in that, The computer storage medium stores one or more instructions that, when executed by one or more computers, cause the one or more computers to perform the operation of the method according to any one of claims 1 to 7.

16. A computer program product, characterized in that, Includes computer-readable instructions that, when executed on a computer device, cause the computer device to perform the method as described in any one of claims 1 to 7.

17. A system, characterized in that, It includes at least one processor and at least one memory; the processor and the memory are connected via a communication bus and communicate with each other. The at least one memory is used to store code; The at least one processor is used to execute the code to perform the method as described in any one of claims 1 to 7.

18. A chip, characterized in that, It includes at least one processing unit and an interface circuit, the interface circuit being used to provide program instructions or data to the at least one processing unit, the at least one processing unit being used to execute the program instructions to implement the method of any one of claims 1 to 7.

Images