Interaction method and smart watch

Abstract

The invention provides an interaction method and a smart watch, and the interaction method is used for the smart watch, and comprises the steps: obtaining sensor data; according to the sensor data, detecting a first twisting event of a user on a dial plane of the smart watch; and in response to the first twisting event, triggering a first event or entering an adjusting state of a first parameter or entering the adjusting state of the first parameter and adjusting the first parameter. Through the technical scheme provided by the embodiment of the invention, the interaction mode between the user and the smart watch can be expanded, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic devices, and more specifically, to an interaction method and a smart watch. Background Art

[0002] With the development of electronic technology, the functions of smart watches are becoming more and more comprehensive, and more users are getting convenient services by wearing smart watches.

[0003] Users generally interact with smart watches through touch screen or rotating crown, but the screen of smart watches is small, and when interacting through touch screen, problems such as fingers blocking the view and difficulty in accurate clicks may occur. Rotating crowns may not be set on all smart watches due to stacking and other reasons. Summary of the Invention

[0004] The present application provides an interaction method and a smart watch, which can expand the interaction methods between users and smart watches and enhance the user experience.

[0005] In a first aspect, an interaction method is provided, which is applied to a smart watch and is characterized in that it includes: acquiring sensor data; detecting a first twisting event of the user on the dial plane of the smart watch based on the sensor data; in response to the first twisting event, triggering a first event or entering an adjustment state of a first parameter or entering an adjustment state of the first parameter and adjusting the first parameter.

[0006] In this embodiment, by detecting the first twisting event of the user on the dial plane of the smart watch, triggering the first event or entering the adjustment state of the first parameter or entering the adjustment state of the first parameter and adjusting the first parameter, the interaction mode of the smart watch can be increased, and some functions or instructions located in a deeper menu interface through touch screen can be conveniently called through the twisting event.

[0007] In combination with the first aspect, in some implementations of the first aspect, the method further includes: obtaining a wearing state of the smart watch, wherein obtaining sensor data includes: obtaining the sensor data when the smart watch is in a wearing state.

[0008] By acquiring sensor data to determine the first twisting event only when the smartwatch is worn, the system can reduce false positives. For example, if the watch is in a bag and its posture changes with the user's movements, it could be mistakenly identified as a twisting event. Furthermore, this reduces power consumption during twisting event determination.

[0009] With reference to the first aspect, in some implementations of the first aspect, the method further includes: obtaining a contact state of the user with a plurality of preset regions on the smart watch; and wherein the obtaining the sensor data includes: obtaining the sensor data when the contact state of the plurality of preset regions satisfies a preset condition.

[0010] Since the user twists the smart watch, the user usually needs to contact several regions of the smart watch to be able to exert a corresponding force on the smart watch to cause the smart watch to twist. When the contact state of the region satisfies a preset condition, the sensor data is obtained to reduce the possibility of misjudgment and the judgment power consumption.

[0011] With reference to the first aspect, in some implementations of the first aspect, when the smart watch enters the adjustment state of the first parameter in response to the first twist event of the smart watch on the dial plane or enters the adjustment state of the first parameter and adjusts the first parameter, the method further includes: detecting a second twist event of the smart watch on the dial plane, a time interval between a start time of the second twist event and an end time of the first twist event being less than a first preset time length, the second twist event including a single twist operation; and in response to the second twist event, triggering a second event, the second event being a type of adjustment of the first parameter.

[0012] In this embodiment, the first parameter adjustment state can be entered through the first twist event, and the first parameter can be adjusted through the second twist event thereafter, so that the adjustment process of the first parameter can be completed through the twist event. Or the first parameter is adjusted directly through the first twist event, and the first parameter is adjusted through the second twist event, which simplifies the complexity of the operation of adjusting the first parameter.

[0013] With reference to the first aspect, in some implementations of the first aspect, the second event is used for stepwise adjustment of the first parameter.

[0014] With reference to the first aspect, in some implementations of the first aspect, the second event is used for stepless adjustment of the first parameter, and an adjustment amount of the first parameter by the second event is positively correlated with a twist angle of the second twist event.

[0015] With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to the second twist event, displaying a first interface, the first interface being used to prompt the user about the adjustment of the first parameter.

[0016] In some embodiments, the user interface can also be displayed when entering the adjustment state of the first parameter in response to the first twist event or when entering the adjustment state of the first parameter and adjusting the first parameter, and the user interface can prompt the user about the adjustment of the first parameter.

[0017] With reference to the first aspect, in some implementations of the first aspect, the first twist event includes a plurality of twist operations in the same direction, and a time interval between two adjacent twist operations is less than a second preset time length.

[0018] When the first twist event is a plurality of twist operations, the possibility of system misjudgment can be reduced compared with a single twist operation.

[0019] With reference to the first aspect, in some implementations of the first aspect, the sensor data is obtained by a plurality of sensors, and the plurality of sensors include an acceleration sensor, a gyroscope sensor, and a magnetic sensor.

[0020] With reference to the first aspect, in some implementations of the first aspect, the first event includes any one of the following: time announcement, weather announcement, answering a call, hanging up a call, turning on mute, turning off mute, turning off an alarm, turning on a second device, turning off the second device, controlling the second device, temperature announcement, heart rate announcement.

[0021] With reference to the first aspect, in some implementations of the first aspect, the first parameter includes any one of the following: volume, brightness, audio / video playback progress, selected item.

[0022] The second aspect provides a smart watch, including a processor and a memory; the memory stores a computer program; the processor is configured to invoke the computer program stored in the memory to execute the method in the first aspect or any one of the implementations of the first aspect.

[0023] The third aspect provides a computer storage medium, the computer readable storage medium includes a computer program, when the computer program runs on a terminal, the terminal executes the method in the first aspect or any one of the implementations of the first aspect.

[0024] The fourth aspect provides a computer program product, when a terminal reads and executes the computer program product, the terminal executes the method in the first aspect or any one of the implementations of the first aspect.

[0025] The fifth aspect provides a chip, the chip is connected with a memory, and is configured to read and execute a software program stored in the memory to realize the method in the first aspect or any one of the implementations of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 Fig. 1 is a hardware structure schematic diagram of a smart watch provided by an embodiment of the present application.

[0027] Figure 2 Fig. 2 is a software structure block diagram of a smart watch provided by an embodiment of the present application.

[0028] Figure 3 Fig. 3 is a schematic flow chart of an interaction method provided by an embodiment of the present application.

[0029] Figure 4 Fig. 4 is a schematic diagram of a twist operation provided by an embodiment of the present application.

[0030] Figure 5 Fig. 5 is a schematic diagram of acceleration data and angular velocity data provided by an embodiment of the present application.

[0031] Figure 6 Fig. 6 is an image user interface provided by an embodiment of the present application.

[0032] Figure 7 Fig. 7 is an image user interface provided by an embodiment of the present application.

[0033] Figure 8 Fig. 8 is a schematic diagram of a contact area provided by an embodiment of the present application.

[0034] Figure 9 Fig. 9 is a schematic block diagram of an electronic device provided by an embodiment of the present application.

[0035] Figure 10 Fig. 10 is a schematic block diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0036] The technical solutions in the embodiments of the present application will be described below with reference to the drawings.

[0037] The terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting of the present application. As used in the specification and the appended claims of the application, the singular forms "a," "an" and "the" are intended to include both the singular and the plural forms, unless the context clearly indicates otherwise. It will be further understood that the terms "at least one," "one or more," as used in the following embodiments, mean one, two, or more than two. The term "and / or", used to describe the association relationship of the associated objects, means that there can be three relationships; for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects.

[0038] Reference within this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrase "in one embodiment" or "in some embodiments" within various places in the specification are not necessarily all referring to the same embodiment, however, are meant to signify that "one or more, but not all embodiments" of the application so described are possible. The terms "including," "comprising," "having" and variations thereof herein are meant to be broad and encompass the terms "consisting of" and "consisting essentially of." Unless otherwise defined, all terms of art used herein including scientific and technical terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an overly literal or overly formal sense unless expressly so defined herein.

[0039] Exemplary, Figure 1 A structural diagram of the smart watch 100 is shown. The smart watch 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0040] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the smart watch 100. In some other embodiments of the present application, the smart watch 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0041] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0042] The controller can be the nerve center and command center of the smart watch 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of instruction fetching and instruction execution.

[0043] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0044] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0045] The wireless communication function of the smart watch 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0046] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the smart watch 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0047] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied on the smart watch 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0048] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the loudspeaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 110, and arranged in the same device as the mobile communication module 150 or other functional modules.

[0049] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the smart watch 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0050] In some embodiments, the antenna 1 and the mobile communication module 150 of the smart watch 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the smart watch 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0051] The smart watch 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0052] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-OLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the smart watch 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0053] The smart watch 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0054] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0055] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the smart watch 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0056] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the smart watch 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0057] The video codec is used to compress or decompress digital video. The smart watch 100 can support one or more video codecs. In this way, the smart watch 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0058] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the smart watch 100 can realize intelligent cognitive applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0059] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smart watch 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.

[0060] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the smart watch 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the smart watch 100 (such as audio data, a phonebook, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0061] The smart watch 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0062] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functions of the audio module 170 can be disposed in the processor 110.

[0063] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The smart watch 100 can listen to music or a hands-free call through the speaker 170A.

[0064] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the smart watch 100 answers a call or a voice message, the receiver 170B can be held close to a person's ear to listen to the voice.

[0065] The microphone 170C, also referred to as a "microphone", "sound transducer", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user can speak into the microphone 170C through the mouth to input a sound signal into the microphone 170C. The smart watch 100 can be provided with at least one microphone 170C. In other embodiments, the smart watch 100 can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be achieved. In other embodiments, the smart watch 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, and can also identify the source of the sound, and achieve directional recording functions, etc.

[0066] The barometric pressure sensor 180A is configured to sense the pressure of the external air pressure on the sensor surface, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. Through the barometric pressure sensor 180A, the smart watch can achieve functions such as weather prediction, altitude measurement, etc.

[0067] In addition to the above-mentioned sensors, other sensors such as a fingerprint sensor can also be provided on the smart watch, which will not be described here.

[0068] The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 together form a touch screen, also referred to as a "touch screen". The touch sensor 180K is configured to detect a touch operation acting on or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the touch event type. The display screen 194 can provide visual output related to the touch operation. In other embodiments, the touch sensor 180K can also be disposed on the surface of the smart watch 100, which is different from the position of the display screen 194.

[0069] The software system of the smart watch 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The smart watch 100 can not be limited to running or other operating systems. Embodiments of the present application take the Android system with a layered architecture as an example to illustrate the software structure of the smart watch 100.

[0070] Figure 2 is a software structure block diagram of the smart watch 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer. The application layer can include a series of application packages.

[0071] As shown in Figure 2 , the application layer can include a camera, settings, third-party applications, etc. Among them, the third-party applications can include a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, a video, a short message, etc.

[0072] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer can include some pre-defined functions.

[0073] As shown in Figure 2 , the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0074] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen, etc. The content provider is used to store and obtain data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, a phonebook, etc.

[0075] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc., such as the indication information for prompting the virtual shutter key in embodiments of the present application, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0076] The telephony manager is used to provide the communication function of the smart watch 100. For example, the management of the call state (including the connection, hang-up, etc.).

[0077] The resource manager provides various resources for the application program, such as the localized string, the icon, the picture, the layout file, the video file, etc.

[0078] The notification manager enables the application program to display the notification information in the status bar, which can be used to convey the notification type of message, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, the message reminder, etc. The notification manager can also be the notification in the form of the chart or the scroll bar text appearing in the top status bar of the system, for example, the notification of the application program running in the background, and can also be the notification in the form of the dialogue window appearing on the screen. For example, the text information is prompted in the status bar, the prompt sound is emitted, the smart watch is vibrated, the indicator light is blinked, etc.

[0079] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0080] The core library contains two parts: one part is the function function required to be called by the java language, and the other part is the core library of the Android.

[0081] The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java file of the application program layer and the application program framework layer into the binary file. The virtual machine is used to execute the management of the object life cycle, the stack management, the thread management, the security and the exception management, and the garbage collection, etc.

[0082] The system library can include multiple function modules. For example: the surface manager, the media library, the three-dimensional graphics processing library (for example: OpenGL ES), the 2D graphics engine (for example: SGL), etc.

[0083] The surface manager is used to manage the display subsystem, and provides the fusion of the 2D and 3D layers for multiple application programs.

[0084] The media library supports the playback and recording of multiple commonly used audio, video formats, and static image files, etc. The media library can support multiple audio and video coding formats, for example: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0085] The three-dimensional graphics processing library is used to realize the three-dimensional graphics drawing, the image rendering, the synthesis, and the layer processing, etc.

[0086] The 2D graphics engine is the drawing engine of the 2D drawing.

[0087] In addition, the system library can further include a state monitoring service module, such as a physical state identification module, for analyzing and identifying a user gesture; and a sensor service module, for monitoring sensor data uploaded by various sensors in the hardware layer, to determine a physical state of the smart watch 100.

[0088] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0089] The hardware layer can include various sensors, such as Figure 1 The various sensors introduced above, and the acceleration sensor, the gyroscope sensor, and the touch sensor involved in the embodiments of the present application.

[0090] Since the screen of the smart watch is small, if a user only interacts with the smart watch through the screen, the user's operation will be very inconvenient. In some smart watches provided with a rotating crown, a user can interact with the smart watch through the rotating crown. However, due to the cost and stacking of the rotating crown, the rotating crown cannot be provided on all smart watches.

[0091] The embodiments of the present application provide an interaction method, which can expand the interaction mode between a user and a smart watch, and improve the user experience.

[0092] Figure 3 A schematic flowchart of an interaction method provided by the embodiments of the present application is shown, which is applied to a smart watch, such as Figure 3 As shown in the figure, the method includes the following steps.

[0093] S310, acquiring sensor data.

[0094] S320, detecting, according to the sensor data, a first twist event of a user on a dial plane of the smart watch.

[0095] S330, in response to the first twist event, triggering a first event or entering an adjustment state of a first parameter or entering the adjustment state of the first parameter and adjusting the first parameter.

[0096] The smart watch of the embodiments of the present application can be a watch, a bracelet, or other electronic devices that can be worn on a wrist or the like by a user.

[0097] The sensor data mentioned in the embodiments of this application may be obtained from an inertial measurement unit (IMU). For example, an IMU may include an accelerometer, a gyroscope, and a magnetometer. In some embodiments, the IMU in a smartwatch may include only an accelerometer and a gyroscope.

[0098] Alternatively, the sensor data may be obtained from at least one of an acceleration sensor, a gyro sensor, and a magnetic sensor.

[0099] Among them, the accelerometer can be used to measure the linear acceleration of the current device on three orthogonal axes, so as to calculate the speed and displacement; the gyroscope sensor is used to detect the change in angular velocity of the current device around three orthogonal axes, and provide information about the rotational motion of the current device; the magnetic sensor can also be called a magnetometer, geomagnetometer, etc., which is used to sense the strength and direction of the magnetic field, and can sense the angle between the current device and the four directions of east, south, west and north. The data of the magnetic sensor can be fused with the data of the accelerometer and gyroscope sensor, thereby improving the system's accuracy in direction positioning (heading), especially in static or low-speed dynamic environments.

[0100] In an embodiment of the present application, the sensor data may include three-axis acceleration data obtained from an accelerometer and three-axis angular velocity data obtained from a gyroscope. In some embodiments, the sensor data may also include angular velocity data, acceleration data, and data obtained from a magnetic sensor, thereby more accurately determining a twisting operation. Alternatively, the sensor data may include only acceleration data or angular velocity data, thereby reducing data processing overhead.

[0101] In an embodiment of the present application, by acquiring corresponding sensor data for analysis, twisting events of the smart watch on the dial plane can be detected, and each twisting event can include one or more twisting operations.

[0102] like Figure 4As shown, in one embodiment, when the smart watch is in a wearing state, if the user pinches the two sides of the watch face with fingers and applies a force to the smart watch to make the watch face rotate in a direction (for example, clockwise), the watch face can rotate a certain angle under the action of the force, and when the force is removed, due to the interaction force between the watch band of the smart watch and the user's wrist, the watch face can rotate a certain angle in the opposite direction (for example, counterclockwise) of the direction, and the time interval between the rotation and the rotation can be less than a preset time length, so as to be able to distinguish the combination of the two operations of the positive direction rotation and the reverse direction rotation, the interval between the rotation and the rotation can be understood as the time difference between the time when the rotation reaches the maximum angle and the time when the rotation starts, for example, the preset time length can be less than 0.5s, for example, 0.3s, 0.2s, 0.1s or other values, which are not limited in the present application.

[0103] In order to reduce the misjudgment of the twisting operation, in some embodiments, the twisting operation can be determined when the rotation and the rotation are both greater than a preset threshold, for example, the preset threshold can be 0.5°, 1° or other values, which are not limited in the present application.

[0104] It should be understood that the rotation and the rotation in the twisting operation can have a certain difference, for example, the rotation angle can be greater than, less than or equal to the rotation angle, and the axis during the rotation or the rotation can be the normal line of the watch face plane passing through the center of the watch face, or can deviate from the center of the watch face, which is not limited in the present application.

[0105] For the twisting operation, the rotation angle during the rotation can be defined as the twisting angle of the twisting operation, and if a twisting event includes a single twisting operation, the twisting angle can also be referred to as the twisting angle of the twisting event.

[0106] In the twisting operation, the user needs to apply a certain force to the smart watch during the force-affected rotation, and the force can be removed after a certain angle is rotated, so that the watch face can rotate under the action of the force between the watch band and the wrist. In some embodiments, the user can also apply a force in the opposite direction to the rotation during the rotation, so as to facilitate the smooth progress of the rotation of the smart watch. In this case, the rotation angle can be greater than or less than the rotation angle.

[0107] According to the direction of the rotation during the twisting, the twisting operation can be divided into clockwise twisting operation and counterclockwise twisting operation, the clockwise twisting operation rotates clockwise and rotates counterclockwise, and the counterclockwise twisting operation rotates counterclockwise and rotates clockwise.

[0108] In the embodiments of the present application, the twisting operation can be the twisting of the entire watch face, and at this time the rotation in the twisting operation is mainly triggered by the interaction force between the watch band and the user's wrist.

[0109] Optionally, the twist operation can also be a twist of a part of the watch face. For example, a ring can be arranged around the screen of the watch face. The ring can have a stable state. When the ring is rotated by a certain angle under force, it can rotate back to the initial stable state position in the opposite direction. Thus, the sensor for determining the twist operation of the ring can be a sensor for monitoring the twist of the ring. The main technical solutions of the embodiments of the present application are mainly described below by taking the twist of the entire watch face as an example.

[0110] One twist event can include one twist operation or multiple twist operations in the same direction. The twist event can be divided into a clockwise twist event and a counterclockwise twist event according to the direction of the twist operation included in the twist event.

[0111] In order to distinguish between a twist event including multiple twist operations and two twist events, a second preset time length can be set. When the interval between two twist operations is less than the second preset time length, the two twist operations are regarded as twist operations of the same twist event. When the interval between two twist operations is greater than or equal to the second preset time length, the two twist operations are regarded as twist operations of different twist events. The interval between two adjacent twist operations can be understood as the time interval between the end time of the previous twist operation and the start time of the next twist operation. The second preset time length can be set according to requirements. For example, the second preset time length can be 1s, 2s, 3s or other values, which are not limited in the present application. It can also be understood as the interval between the start times or the interval between the end times of two adjacent twist operations, which are not limited in the present application.

[0112] For example, assuming that the second preset time length is 2s and there are three twist operations, the time interval between the first twist operation and the second twist operation is 1s, and the time interval between the second twist operation and the third twist operation is 3s. The first twist operation and the second twist operation are twist operations of the same twist event, and the third twist operation is a twist operation of another twist event.

[0113] In S320, the smart watch detects a first twist event of the watch face plane according to the sensor data.

[0114] In an embodiment, the determination of a twist event in the embodiments of the present application can be performed using a pre-trained model. The model can be a machine learning model, such as a random forest model or a support vector machine model, or can be a deep learning model, such as a neural network model. The model can be used to detect twist operations, and whether different twist operations are twist operations of the same twist event can be determined by the smart watch according to the second preset time period described above. Alternatively, both the twist operations and whether different twist operations are twist operations of the same twist event can be determined by the model. The present application does not limit this.

[0115] Details of the determination of twist operations by the model will be described below using acceleration data and angular velocity data as an example. Twist operations can also be determined only by acceleration data and angular velocity data, or by acceleration data, angular velocity data, and data of a magnetic sensor in combination, which is not limited by the present application.

[0116] Figure 5 is a schematic diagram of data collected by a gyroscope sensor and an acceleration sensor when a twist operation is performed according to an embodiment of the present application. Figure 5 (a) of is a graph of angular velocity of the gyroscope sensor, where gx, gy, and gz are angular velocities around the x-axis, the y-axis, and the z-axis, respectively. The z-axis is perpendicular to the plane of the watch face, the x-axis is in the plane of the watch face and parallel to the line connecting three o'clock and nine o'clock (or parallel to the row direction of the text arrangement on the watch face), and the y-axis is in the plane of the watch face and parallel to the line connecting six o'clock and twelve o'clock (i.e., parallel to the column direction of the text display), and the x-axis, the y-axis, and the z-axis are perpendicular to each other.

[0117] As shown in (a) of Figure 5 When a twist operation is performed, a relatively obvious maximum peak and minimum peak will appear on the graph of angular velocity around the z-axis for each twist operation, as shown in (a) of Figure 5 In (a) of, V1-P1 and V2-P2 can correspond to one counterclockwise twist, respectively. V1 and V2 correspond to the counterclockwise rotation processes of the two twist operations, and P1 and P2 correspond to the clockwise rotation processes of the two twist operations. During the rotation and rotation processes, the angular velocity (absolute value) around the z-axis first increases and then decreases.

[0118] Similarly, Figure 5 In (b) of, lx, ly, and lz are accelerations along the x-axis, the y-axis, and the z-axis, respectively. Similar peaks will appear on the acceleration images along the x-axis and the y-axis, which can correspond to the rotation process and the rotation process of the twist, and details are not described again.

[0119] It should be understood that due to various user actions while wearing a smart watch, some peaks that do not belong to twisting operations may be formed on the acceleration graph or angular velocity graph, such as some particularly wide, particularly narrow or particularly small peaks. These peaks need to be eliminated when determining twisting operations.

[0120] From the above introduction, we can see that twisting operations can be identified by the characteristic peaks in the acceleration image or angular velocity image. These features can be learned and trained through the model, and the trained model can be used to identify twisting operations.

[0121] In schematic form, the sensor data obtained by different users performing twisting operations and the sensor data obtained by some other operations (non-twisting operations) can be input into the model to be trained as a training set, and the output result can be a determination result on whether it is a twisting operation, for example, the possibility of a twisting operation can be output. After obtaining a trained model through training with a large amount of data, the model can be compressed, for example, by model distillation, so as to facilitate setting the model on a smart watch. When using the model to judge a twisting operation, the sensor data can be processed according to the data requirements of the model and then input into the model, thereby outputting the possibility that the sensor data includes a twisting operation. For example, it can be set that when the output possibility is greater than a threshold, it is determined that a twisting operation is detected.

[0122] Determining the twisting operation through sensor data may schematically include the following steps:

[0123] S502: Acquire sensor data.

[0124] The sensor data may include data obtained from at least one of a gyro sensor, an acceleration sensor, and a magnetic sensor.

[0125] S504: Preprocess the sensor data.

[0126] The data preprocessing may include at least one of downsampling processing and filtering processing (high-pass filtering processing and / or low-pass filtering processing).

[0127] In an embodiment of the present application, the acceleration data is taken as an example, and in the embodiment, the acceleration data can be down-sampled by taking one acceleration data from each of a plurality of acceleration data, for example, one acceleration data can be taken from every four acceleration data. In another embodiment, the plurality of acceleration data can be formed into one acceleration data by linear fitting or averaging, for example, four adjacent acceleration data can be fitted to obtain one acceleration data, or the four acceleration data can be averaged to obtain one acceleration data. Through the down-sampling process, the amount of data to be processed can be reduced, for example, the sampling frequency of the original acceleration data obtained from the acceleration sensor is 100 Hz, and through the down-sampling process, the sampling frequency can be reduced to 50 Hz or 25 Hz.

[0128] The high-pass filtering process can filter out the low-frequency or direct-current component in the acceleration data and allow the high-frequency component to pass. Through the high-pass filtering process, the gravity component and the slowly changing background noise can be filtered out, and the dynamic acceleration signal of the fast-changing or high-frequency part is retained.

[0129] The low-pass filtering process can filter out the high-frequency component in the acceleration data and allow the low-frequency or direct-current component to pass. Through the low-pass filtering process, the high-frequency noise and the fast-changing disturbance part can be removed, for example, the high-frequency noise can include power supply noise, thermal noise, electromagnetic interference, etc.

[0130] The preprocessing process can also be performed after the data is put into the sliding window, or the above-mentioned preprocessing process can not be performed.

[0131] S506, the data is put into the sliding window.

[0132] The sliding window can have a fixed length, and when the model is used to determine a single twist operation, the length of the sliding window can be slightly larger than the length of the single twist, for example, the length of the sliding window can be 100, that is, the sliding window includes 100 data.

[0133] S508, the wave peaks and wave troughs of the data are obtained.

[0134] The wave peaks and wave troughs can be characteristics of the twist operation.

[0135] S510, filter the wave peaks and wave troughs that do not meet the conditions.

[0136] These filtered wave peaks and wave troughs can be too narrow, too wide or too small. When detecting the wave peaks, the corresponding wave peaks and wave troughs can not be considered.

[0137] S512, align the data according to the wave peaks and wave troughs.

[0138] The middle point of the peak and the valley can be calculated as the alignment point, so that the sensor data is aligned to the middle of the sliding window. Specifically, when aligning, the middle point of a peak-valley pair that meets certain conditions can be moved to the center of the sliding window, so that the subsequent model can determine whether the peak-valley pair corresponds to a twist operation. The certain conditions can mean that the time between adjacent peaks and valleys does not exceed a preset threshold, for example, the preset threshold can be slightly greater than half of the average total duration of the twist operation, and the average total duration of the twist operation can be determined by, for example, statistical methods. For Figure 5 For the angular velocity image of (a), the peak detection can detect four peaks V1, P1, V2 and P2, and since the time between adjacent V1 and P1 does not exceed the preset threshold, the middle point of V1 and P1 can be used as the alignment point to align the middle position of the sliding window.

[0139] Optionally, data alignment can also be achieved by aligning the peak position, the valley position or any other position with the middle position of the window, the 1 / 3 position of the window, the 1 / 4 position, etc. The application does not limit the way of data alignment.

[0140] S514, extracting features of the data in the sliding window.

[0141] The features can include the maximum value, the minimum value (max), the average value (min), the standard deviation (sd), the variance (var), the skewness (skewness), the kurtosis (kurtosis), etc.

[0142] S516, merging the features with the completed data.

[0143] S518, inputting the merged data into the model to obtain an output result.

[0144] The output result can include whether a twist operation is detected, or can include the possibility of detecting a twist operation.

[0145] For example, 1 and 0 can be used to represent whether a twist operation is detected, and a percentage can be used to indicate the possibility of detecting a twist operation.

[0146] Different sensors can obtain data, and the above steps S504 to S518 can be performed separately, so that the processed data of different sensors can be input into the model respectively.

[0147] It should be understood that different models can be used to output results for different sensor data when processing different sensor data, and the determination of the twist operation can be made by combining the results output by different models. Different sensor data can also be input into the same model, and the model outputs the determination result of the twist operation obtained by combining different sensor data.

[0148] S520, determining whether the twist operation is detected according to the output result.

[0149] When the output is the possibility of the twist operation, a threshold value can be set, when the output result is greater than the threshold value, it is determined that the twist operation is detected, and when the output result is less than or equal to the threshold value, it is determined that the twist operation is not detected. For example, when the possibility of the twist operation is greater than 60%, it can be determined that the twist operation is detected, and when it is less than or equal to 60%, it is determined that the twist operation is not detected.

[0150] When the determination results of the twist operation for different sensor data are output by different models, the determination of the twist operation can be combined with different results. For example, when the determination results of the twist operation possibility output by different sensor data are all greater than the threshold value, it is determined that the twist operation is detected, otherwise, it is determined that the twist operation is not detected. Or when the sum of the determination results of the twist operation possibility output by different sensor data is greater than the threshold value, it is determined that the twist operation is detected, otherwise, it is determined that the twist operation is not detected.

[0151] It should be understood that the above processing process of the data is only illustrative, for example, the processing process of the sensor data in steps S504 to S516 can be put into the model, and the model can include a corresponding processing module for executing the above steps. When these processes are completed, the subsequent processing can be performed, that is, the data model is output, and then the subsequent processing is continued.

[0152] For another example, the length of the sliding window can also be the data in the preset time length, for example, when the sampling rate is 50Hz, the length of the data amount of 3s can be used as the length of the sliding window. In this way, the model can further output the number of twist operations in the sliding window data, and the present application does not limit this.

[0153] For another example, if the data input to the model during training is data that has not been processed by the above steps S504 to S516 (or S506 to S516), the original data or the data processed by filtering and the like after the original data can be used as the training set, that is, without performing wave peak detection, alignment and the like in advance, but directly making the sliding window slide according to the preset step length, and inputting the data in the window at each step of the sliding to the model, and the model judges the twist operation or the twist event, and when using the trained model, the original data or the data processed by S504 can also be directly input to the trained model. In this case, the data processing overhead can be reduced.

[0154] The training can be performed in a supervised manner. For example, when the model output is a twist operation, the model can be trained using a training set including at least one of acceleration data, angular velocity data, and magnetic sensor data, and prior results of whether the data includes a twist operation. The prior results are used to adjust the parameters of the model, and the model parameters are continuously updated to obtain a final trained model.

[0155] In an embodiment, the data used for training can be fixed-length data. For example, when the sensor data includes angular velocity data, the collected acceleration data within, for example, 3 seconds or 2 seconds can be used as training data. The training data can include data including a twist operation or data not including a twist operation. The processing of the training data before inputting into the model is similar to the above steps S504 to S516. However, since the length of the training data is fixed, when the training data is aligned with the center of the window, a data completion operation may be required. For example, when the middle point of a wave peak and a wave trough in the training data is close to the left side of the training data, after aligning the data with the center of the window, there may be missing data at the left side of the window. In this case, the length of the data in the window can be made to meet the requirements by, for example, zero padding.

[0156] Of course, the data used for training can also be continuously collected data. In this case, the data can be processed according to the above steps S504 to S516 before inputting into the model.

[0157] In an embodiment, when the first twist event includes multiple twist operations in the same direction, the first twist event can also be directly determined by the model.

[0158] In this case, the first twist event can be determined using the first model. After determining the first twist event, if it is necessary to continue to determine a second twist event including a single twist operation based on the first twist event, the second model can be used.

[0159] The model used for determining a twist event including multiple twist operations is similar to the model used for determining a single twist operation in terms of data processing. However, the length of the sliding window can be different. For example, when the first model is used to determine a first twist event including two twist operations in the same direction, the length of the sliding window can be slightly greater than the average length (or the maximum length, etc.) of a twist event including two twist operations. When two wave peaks and a wave trough satisfying a certain condition are detected, the middle points of the two twist operations can be aligned with the middle position of the sliding window. The condition can be that the time difference between the first wave peak and the last wave trough (or the time difference between the first wave trough and the last wave peak) is less than a predetermined threshold. Other steps can refer to the embodiment in which the first twist event is a single twist operation, and will not be described here.

[0160] Of course, in addition to the twist operation or twist event determination by the model, the twist operation or twist event can also be determined by a corresponding algorithm.

[0161] In S330, in response to the first twist event, a first event is triggered or a first parameter enters an adjustment state or a first parameter enters an adjustment state and is adjusted.

[0162] In the embodiments of the present application, in order to reduce misjudgment, the first twist event that triggers the first event or enters the adjustment state of the first parameter can include multiple same-direction twist operations, for example, the first twist event can include two same-direction twist operations, three same-direction twist operations, the first twist event can be a clockwise twist event or a counterclockwise twist event, which is not limited in the present application. Alternatively, the first twist event can also include a single twist operation.

[0163] The first event can be a discrete event, for example, the first event can be any one of the following: time broadcast, weather broadcast, answering a call, playing music, turning on mute, turning off mute, turning on an alarm, turning off an alarm, turning on a second device (the second device can be other devices different from the smart watch), turning off the second device, controlling the second device, temperature broadcast, heart rate detection, etc.

[0164] That is, the smart watch will respond to the first twist event, for example, time broadcast, weather broadcast, etc. The operation interface of the smart watch is small, and the entry of the above operation can be deep, so that the user may need to perform multiple steps of operation when calling the above function through touch screen operation. Through the first twist event to trigger the above first event, it can be convenient for the user to call the related function.

[0165] In one embodiment, when the first event is triggered, the smart watch can also display a user interface to the user, so as to facilitate the user to prompt related information through the user interface or facilitate the user to further interact through the user interface.

[0166] For example, the first event is playing music, as shown in Figure 6 When the smart watch detects the first twist event, the display interface 610 on the watch is displayed, the interface 610 includes the song basic information control 611 (song name: music 1), the song control control 612 (previous song, next song and start / pause), the song play mode control 613 (random play, sequential play, list cycle, etc.), the volume control control 614, the more options control 615, Figure 6 Only the possible control form on the interface is shown, and the actual interface can have more or less controls, which is not limited in the present application.

[0167] When the first event is other than playing music, a corresponding interface can also be displayed according to a corresponding requirement, so as to facilitate displaying corresponding content to the user or facilitating the user to control through the interface. The type of the first event and the form of the corresponding interface are not described herein again.

[0168] The first parameter can be any of the following: volume, audio / video playing progress, selected item, etc. In the adjustment state of the first parameter, in an embodiment, the user can adjust the first parameter through a conventional control mode of the smart watch such as touch screen, rotating crown, button, etc.

[0169] In an embodiment of the present application, the second event can be triggered again by the second twist event, and the second event is a kind of adjustment mode of the first parameter, for example, the adjustment mode of the first parameter can be increasing the first parameter or decreasing the first parameter. The interval between the second twist event and the first twist event can be less than the first preset time length, for example, the first preset time length can be 2s, 3s, 4s, 5s or other values, which are not limited in the present application.

[0170] If the second twist event is not detected within the first preset time length, no other operation can be performed or a corresponding event can be triggered.

[0171] In an embodiment of the present application, the second twist event can be a single twist event, and the direction of the second twist event can be used to distinguish different adjustment modes of the first parameter. For example, when the second twist event is a clockwise twist event, the first parameter is increased, and when the second twist event is a counterclockwise twist event, the first parameter is decreased; or when the second twist event is a clockwise twist event, the first parameter is decreased, and when the second twist event is a counterclockwise twist event, the first parameter is increased.

[0172] Taking the first parameter as the volume as an example, when the first twist event is detected, the volume adjustment state can be entered. At this time, the user can be prompted that the volume can be continuously adjusted through a display interface or voice prompt. If the second twist event is detected within the first preset time length from the first twist event, the volume can be adjusted according to the second twist event. For example, when the second twist event is a clockwise twist event, the second event can be increasing the volume, and when the second twist event is a counterclockwise twist event, the second event can be decreasing the volume.

[0173] In the embodiments of the present application, when the second twist event is detected, a user interface can be displayed on the screen of the smart watch, and the user interface is used to provide the user with the adjustment result of the first parameter. For example, after entering the volume adjustment state, when the second twist event is detected within the first preset time length, the volume can be increased and the adjustment result of the volume can be prompted to the user in the form of a control on the interface. If the second twist event is detected again within the first preset time length from the last second twist event, the volume can be increased again and the adjustment result of the volume can be prompted to the user in the form of a control on the interface, that is, the first twist event can be followed by multiple second twist events, and each second twist event can trigger the first parameter to be adjusted accordingly.

[0174] In one embodiment, the adjustment amount of each second twist event can be consistent, that is, the second twist event can trigger the first parameter to be adjusted in steps, for example, each second twist event can cause the first parameter to be increased by a constant step, or each second twist event can cause the first parameter to be decreased by a constant step. In another embodiment, the adjustment amount of each second twist event can be positively correlated with the rotation angle of the second twist event.

[0175] Taking the first parameter as the volume and the volume being adjusted in steps as an example, Figure 7 a graphical user interface provided by the embodiments of the present application is shown. When the first second twist event is detected after the first twist event, the control 711 can be displayed on the interface as shown in (a) of Figure 7 When the second second twist event is detected, the control 711 can become as shown in (b) of Figure 7 It is assumed that the control 711 grows into a whole ring when the maximum volume is 100%, and one second twist event can trigger the volume to be increased by 12.5%. The second twist event can be triggered to adjust the volume in steps, and the present application does not limit this.

[0176] It should be understood that Figure 7 the control displayed when the volume is adjusted in the embodiments of the present application is only schematically displayed in the form of a progress bar, and the control can also be a text control, a bar chart, etc. In addition, Figure 8 the watch interface of the smart watch on the interface in the embodiments of the present application can actually display any interface on the screen of the smart watch when the volume is adjusted, and the present application does not limit this. Moreover, the adjustment result of the volume can also be displayed in the form of an animation, that is, the progress bar can grow from the initial volume to the volume at the end of the second twist event along with the twist operation of the user, thereby bringing better visual experience to the user.

[0177] Optionally, the second twist event can also include multiple twist operations, and details of the adjustment of the first parameter by the second twist event can refer to the embodiment in which the second twist event includes a single twist operation, and will not be described herein.

[0178] In the embodiments of the present application, the first twist event can also trigger the entering of the adjustment state of the first parameter and the adjustment of the first parameter, and the subsequent continuous adjustment of the first parameter can be triggered by the second twist event. Taking the first parameter as the volume for example, when the first twist event is detected, the volume can be directly adjusted, and if the second twist event meeting the condition is detected, the volume can be continuously adjusted. When adjusting, the volume can be adjusted in stages, for example, when the first twist event includes two twist operations, the volume can be adjusted twice, and when the second twist event including a single twist operation is detected, the volume can be adjusted once again, and the amplitude of each volume adjustment can be the same. Similar to the triggering of the entering of the adjustment state of the first parameter by the first twist event, the smart watch can also display a corresponding interface to prompt the user of the adjustment state of the first parameter. Related details can refer to the foregoing description, and will not be described herein.

[0179] In the foregoing, the acquisition of the sensor data by the smart watch and the judgment of the twist event or the twist operation can be continuous, that is, the sensor can always collect corresponding data, and the data can always be analyzed to judge the twist operation. In some embodiments, in order to reduce the power consumption of data analysis, the analysis and judgment of the twist operation / event can be performed only when a predetermined condition is met, that is, the foregoing steps S310 to S330 can be executed only when a certain condition is met. Specifically, two cases can be included, one is that the data collection by the foregoing sensor is triggered only when a predetermined condition is met; or the sensor data can always be collected to facilitate the use of the smart watch including the twist operation / event analysis and judgment and other functions that need to use the sensor data, but the module or unit responsible for the twist operation / event judgment and analysis can perform the twist operation / event analysis and judgment only when a corresponding condition is met.

[0180] In one embodiment, the wearing state of the smart watch can be acquired in real time, and when it is determined according to the wearing state that the smart watch is in a wearing state, the sensor data can be acquired and the twist operation / event analysis and judgment can be performed. For example, when the watch is put into a bag or placed on a table, etc., the twist operation or twist event judgment can not be performed. Among them, the wearing state can include the case that the smart watch is worn on the wrist or other body parts of the user.

[0181] For the detection of the wearing state, the sensors of the watch can be used. For example, since a human has a body temperature and a heart rate, if the data collected by the heart rate sensor and the temperature sensor are similar to the body temperature and the heart rate range of a human, it can be determined that the wearable device is in the wearing state at this time. In addition, if the user wears the wearable device, the part of the wearable device in contact with the skin of the user is in a low ambient brightness, for example, the back of the smart watch or the bracelet will detect a darker ambient brightness due to the shielding of the wrist of the user. The wearing state of the wearable device can also be predicted through the analysis of the light sensor. There are many existing solutions for the determination of the wearing state, which will not be described here.

[0182] Alternatively, the wearing state can also include, for example, the case where the user uses a separate wrist-like component (such as a support component for displaying a smart watch, a prosthetic limb, etc.) to fix the smart watch, in which case more sensor data can be required for the determination of the wearing state to reduce the possibility of errors, which will not be described in detail.

[0183] In an embodiment, since the twisting operation requires the user to contact the periphery of the dial with the hand to provide the force required for the twisting, a plurality of contact areas can be pre-set on the smart watch, and when the contact of the user with the plurality of contact areas meets the pre-set condition, the corresponding sensor data is acquired and the analysis and determination of the twisting operation are performed. The contact area can be realized by detecting the touch action through a technology similar to the touch screen, and the related details will not be expanded here.

[0184] As shown in Figure 9 , four contact areas can be sequentially arranged around the dial, including a first contact area 810, a second contact area 820, a third contact area 830, and a fourth contact area 840. When the user performs a twisting operation on the watch, the user generally tends to contact the first contact area 810 and the third contact area 830 with two fingers at the same time, or contact the second contact area 820 and the fourth contact area 840 at the same time. The smart watch can detect the contact state of the above-mentioned areas, and when the first contact area 810 and the third contact area 830 are in the contact state or the second contact area 820 and the fourth contact area 840 are in the contact state, the sensor data is acquired to analyze and determine the twisting operation / event.

[0185] It should be understood that when the user performs a twisting operation, the user can not be limited to simultaneously contacting the first contact area 810 and the third contact area 830, or simultaneously contacting the second contact area 820 and the fourth contact area 840, but can also simultaneously contact the first contact area 810 and the fourth contact area 840, or simultaneously contact the second contact area 820 and the third contact area 830.

[0186] In a specific implementation, the area, position and number of the contact areas can be set according to requirements. For example, when the dial of the smart watch is not circular, the position and number of the contact areas can be different from when the dial of the smart watch is circular.

[0187] In a specific implementation of the embodiments of the present application, the detection of the wearing state can be performed separately from the detection of the contact state of the contact area, or can be performed simultaneously. For example, when the smart watch is in the wearing state and the contact state of the contact area meets the preset condition, the sensor data is acquired and the analysis of the twist event is performed.

[0188] In the embodiments of the present application, when the sensor data is acquired for the analysis of the twist operation / event and the analysis and judgment of the twist operation / event are performed when the contact state of the contact area meets the preset condition, the analysis and judgment of the twist operation / event can not be performed by the trained model, but can be performed by performing threshold processing, filtering processing and obtaining features (maximum value, minimum value, average value, etc.) on the sensor data according to similar steps and then performing the analysis and judgment of the twist operation / event by using a corresponding algorithm. Since the twist event is more likely to occur when the contact state of the contact area meets the preset condition, the processing overhead of the corresponding data can be greatly reduced compared to the real-time judgment of the twist operation. When the analysis and judgment of the twist operation / event are performed by using the corresponding algorithm, the overhead of the smart watch can be reduced and the energy consumption can be saved.

[0189] Of course, in this case, the embodiments of the present application do not limit the analysis of the twist event to be performed by the model. Alternatively, in any case, the analysis and judgment of the twist operation / event can be performed by using a corresponding algorithm, rather than by using a pre-trained model, which is not limited by the present application.

[0190] It should be understood that the execution of the second twist event described above can not be performed in the first parameter adjustment state entered by the first twist event. For example, at this time, the adjustment of the first parameter by the second twist event can be equivalent to the first event described above. For example, the detection of the twist event can be performed when it is detected that the contact state of the contact area of the smart watch meets the preset condition. If it is detected that the user twists the dial of the smart watch clockwise, the interface shown in FIG. 7 can be displayed to display the adjustment result of the volume or to display the process of the adjustment of the volume by the second twist event.

[0191] Figure 10 A schematic block diagram of an electronic device 900 provided by an embodiment of the present application is shown, which can be a smart watch. The electronic device 900 includes

[0192] Specifically, the electronic device 900 includes an acquisition unit 910 configured to acquire sensor data, and a processing unit 920 configured to: detect, according to the sensor data, a first twisting event of a user on a dial plane of the smart watch; and in response to the first twisting event, trigger a first event or enter an adjustment state of a first parameter or enter the adjustment state of the first parameter and adjust the first parameter.

[0193] Optionally, the acquisition unit 910 is further configured to acquire a wearing state of the smart watch, and the acquisition unit 910 is configured to: acquire the sensor data when the smart watch is in a wearing state.

[0194] Optionally, the acquisition unit 910 is further configured to acquire a contact state of a user with a plurality of preset regions on the smart watch, and the acquisition unit 910 is configured to: acquire the sensor data when the contact state of the plurality of preset regions meets a preset condition.

[0195] Optionally, the processing unit 920 is further configured to: detect a second twisting event of the smart watch on the dial plane, a time interval between a start time of the second twisting event and an end time of the first twisting event being less than a first preset time length, the second twisting event including a single twisting operation; and in response to the second twisting event, trigger a second event, the second event being a type of adjustment of the first parameter.

[0196] Optionally, the second event is configured to adjust the first parameter in steps.

[0197] Optionally, the second event is configured to adjust the first parameter without steps, and an adjustment amount of the first parameter by the second event is positively correlated with a twisting angle of the second twisting event.

[0198] Optionally, the processing unit 920 is further configured to: in response to the second twisting event, display a first interface, the first interface being configured to prompt a user about an adjustment of the first parameter.

[0199] Optionally, the first twisting event includes a plurality of twisting operations in the same direction, and a time interval between two adjacent twisting operations is less than a second preset time length.

[0200] Optionally, the sensor data is obtained by a plurality of sensors, and the plurality of sensors include: an acceleration sensor, a gyroscope sensor, and a magnetic sensor.

[0201] Optionally, the first event includes any one of the following: time announcement, weather announcement, answering a call, hanging up a call, opening a mute, closing a mute, closing an alarm, opening a second device, closing the second device, controlling the second device, temperature announcement, and heart rate announcement.

[0202] Optionally, the first parameter comprises any of the following: volume, brightness, audio / video playing progress, selected item.

[0203] Figure 10 A schematic block diagram of an electronic device 1000 is shown. Figure 1 The electronic device 1000 shown can correspond to the electronic device described above. Specifically, the electronic device 1000 can be a specific example of the electronic device in Figure 10 The electronic device 1000 includes a processor 1020. In embodiments of the present application, the processor 1020 is configured to implement various control management operations of the corresponding electronic device. For example, the processor 1020 is configured to support the electronic device 1000 to perform the methods or operations or functions of the above-described embodiments. Optionally, the electronic device 1000 can further include a memory 1010 and a communication interface 1030. The processor 1020, the communication interface 1030 and the memory 1010 can be connected to each other or connected through a bus 1040. The communication interface 1030 is configured to support the electronic device to communicate with other devices, etc. The memory 1010 is configured to store program codes and data of the electronic device. The processor 1020 invokes the codes or data stored in the memory 1010 to implement corresponding operations. The memory 1010 can be coupled with the processor or not. The coupling in embodiments of the present application is indirect coupling or communication connection between electronic devices, units or modules, which can be electrical, mechanical or other forms, for information interaction between electronic devices, units or modules.

[0204] The processor 1020 can be a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic device, transistor logic, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in connection with the present disclosure. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, digital signal processor and microprocessor combinations, etc. The communication interface 1030 can be a transceiver, circuit, bus, module or other type of communication interface. The bus 1040 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, ​ In the figure, only one thick line is used to represent, but not only one bus or one type of bus.

[0205] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0206] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0207] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the above-described device embodiments are merely schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0208] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0209] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically independently, or two or more units can be integrated into one unit.

[0210] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0211] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An interaction method, the method being applied to a smart watch, characterized in that, The method comprises: obtaining sensor data; detecting, according to the sensor data, a first twist event of a user on a dial plane of the smart watch; in response to the first twist event, triggering a first event or entering an adjustment state of a first parameter or entering the adjustment state of the first parameter and adjusting the first parameter.

2. The method of claim 1, wherein, The method further comprises obtaining a wearing state of the smart watch, wherein the obtaining sensor data comprises: when the smart watch is in a wearing state, obtaining the sensor data.

3. The method according to claim 1 or 2, characterized in that, The method further comprises obtaining a contact state of a user with a plurality of preset regions on the smart watch, wherein the obtaining sensor data comprises: when the contact state of the plurality of preset regions meets a preset condition, obtaining the sensor data.

4. The method according to any one of claims 1 to 3, characterized in that, When, in response to the first twist event of the smart watch on the dial plane, the adjustment state of the first parameter is entered or the adjustment state of the first parameter is entered and the first parameter is adjusted, the method further comprises: detecting a second twist event of the smart watch on the dial plane, a time interval between a start time of the second twist event and an end time of the first twist event being less than a first preset time length, the second twist event comprising a single twist operation; in response to the second twist event, triggering a second event, the second event being a type of adjustment of the first parameter.

5. The method of claim 4, wherein, The second event is used for stepwise adjustment of the first parameter.

6. The method of claim 4, wherein, The second event is used for stepless adjustment of the first parameter, an adjustment amount of the first parameter by the second event being positively correlated with a twist angle of the second twist event.

7. The method according to any one of claims 4 to 6, characterized in that, The method further comprises, in response to the second twist event, displaying a first interface, the first interface being used for prompting an adjustment situation of the first parameter to the user.

8. The method according to any one of claims 1 to 7, characterized in that, The first twist event comprises a plurality of twist operations in the same direction, an interval between two adjacent twist operations being less than a second preset time length.

9. The method according to any one of claims 1 to 7, characterized in that, The sensor data is obtained by at least one of a plurality of sensors, the plurality of sensors comprising an acceleration sensor, a gyroscope sensor and a magnetic sensor.

10. The method according to any one of claims 1 to 9, characterized in that, The first event comprises any one of the following: time announcement, weather announcement, answering a call, hanging up a call, opening a mute, closing a mute, closing an alarm, opening a second device, closing the second device, controlling the second device, temperature announcement, heart rate announcement.

11. The method according to any one of claims 1 to 10, characterized in that, The first parameter comprises any one of the following: volume, brightness, audio / video playing progress, selected item.

12. A smart watch, characterized by The terminal comprises a processor and a memory; The memory stores a computer program; The processor is configured to invoke the computer program stored in the memory to execute the method according to any one of claims 1 to 11.

13. A computer storage medium, characterized in that The computer readable storage medium comprises a computer program, when the computer program runs on the terminal, the terminal executes the method according to any one of claims 1 to 11.

14. A computer program product, characterised in that, When the terminal reads and executes the computer program product, the terminal executes the method according to any one of claims 1 to 11.

15. A chip, characterized by The chip is connected to a memory for reading and executing a software program stored in the memory to implement the method of any one of claims 1 to 11.

Images