Control method and device for extended screen, equipment and storage medium

Abstract

The invention provides an extended screen control method, terminal equipment, wearable equipment and a computer readable storage medium, and relates to the technical field of intelligent terminals. The method comprises the following steps: acquiring control information corresponding to the extended screen according to a motion type of the terminal equipment; wherein the motion type of the terminal equipment is determined according to motion data collected by the terminal equipment; and controlling the extended screen according to the control information. According to the embodiment of the invention, the control of the extended screen of the terminal equipment can be realized, and the convenience and applicability of screen control are improved.

Description

Technical Field

[0001] The present application relates to the field of smart terminal technology, and in particular to a method for controlling an extended screen, a device for controlling an extended screen, a terminal device, a wearable device, and a computer-readable storage medium. Background Art

[0002] With the continuous development of terminal technology, it brings more and more convenience to people's daily life, and users' requirements for the screens of terminal devices are gradually increasing. Among them, terminal devices not only include existing display screens, but the extended screens of terminal devices have also become a development trend of terminal devices.

[0003] However, in the related art, for the display screen of the terminal device, the user needs to control the display of the screen by touching. For the extended screen of the terminal device, since the extended screen is a virtual screen, the user cannot control the display of the screen by touching. Therefore, for the extended screen of the terminal device, no corresponding method is proposed in the related art to realize the control of the extended screen. Summary of the invention

[0004] The present application provides a control method for an extended screen, a control device for an extended screen, a terminal device, a wearable device and a computer-readable storage medium, aiming to enable control of the extended screen of a terminal device and improve the convenience and applicability of screen control.

[0005] To achieve the above object, the present application provides a method for controlling an extended screen, which is applied to a wearable device, and the method includes:

[0006] According to the motion type of the terminal device, acquiring control information corresponding to the extended screen; wherein the motion type of the terminal device is determined according to the motion data collected by the terminal device;

[0007] The extended screen is controlled according to the control information.

[0008] In addition, to achieve the above purpose, the present application also provides a method for controlling an extended screen, which is applied to a terminal device, and the method includes:

[0009] Acquiring motion data collected by a motion collection device in the terminal device;

[0010] Determining a motion type corresponding to the terminal device according to the motion data;

[0011] The exercise type is sent to the wearable device, so that the wearable device determines the control information corresponding to the extended screen according to the exercise type, and controls the extended screen according to the control information.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides a control device for an extended screen, which is applied to a wearable device, and the control device for an extended screen includes:

[0013] A motion type determination module, used to obtain control information corresponding to the extended screen according to the motion type of the terminal device; wherein the motion type of the terminal device is determined according to the motion data collected by the terminal device;

[0014] The extended screen control module is used to control the extended screen according to the control information.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a terminal device, the extended screen of the terminal device is provided by a wearable device, and the terminal device includes: a memory and a processor; wherein the memory is connected to the processor for storing programs, and the processor is used to implement any one of the control methods for the extended screen of the terminal device provided in the embodiments of the present application by running the programs stored in the memory.

[0016] In addition, to achieve the above-mentioned purpose, the present application also provides a wearable device, which is used to provide an extended screen for a terminal device, and the wearable device includes: a memory and a processor; wherein the memory is connected to the processor for storing programs, and the processor is used to implement the control method for the extended screen of the wearable device provided in the embodiment of the present application by running the program stored in the memory.

[0017] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor enables the processor to implement any one of the control methods for an extended screen applied to a terminal device or the control method for an extended screen applied to a wearable device provided in the embodiments of the present application.

[0018] The embodiments of the present application disclose a control method for an extended screen, a terminal device, a wearable device, and a computer-readable storage medium. The motion type of the terminal device is determined according to the motion data collected by the motion collection device in the terminal device, and the control information corresponding to the extended screen is obtained according to the motion type of the terminal device; the extended screen is controlled according to the control information. In this way, the control of the extended screen of the terminal device can be realized, and an intuitive and simple interaction method is provided for the AR extended display of the terminal device, and the convenience of using the AR extended display of the terminal device is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 It is a flowchart of a control method for an extended screen of a terminal device provided in an embodiment of the present application;

[0021] Figure 2 It is a structural diagram of a terminal device provided in an embodiment of the present application;

[0022] Figure 3 This is a schematic diagram of an application scenario of a method for controlling an extended screen provided in an embodiment of the present application;

[0023] Figure 4 It is a flowchart of a control method for an extended screen of a wearable device provided in an embodiment of the present application;

[0024] Figure 5 is a flow chart of another method for controlling an extended screen of a wearable device provided in an embodiment of the present application;

[0025] Figure 6 is a flow chart of another method for controlling an extended screen of a wearable device provided in an embodiment of the present application;

[0026] Figure 7 is a schematic block diagram of a control device for extending a screen provided in an embodiment of the present application;

[0027] Figure 8 is a schematic block diagram of a wearable device provided in an embodiment of the present application;

[0028] Fig. 9 It is a schematic block diagram of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0030] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0031] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0032] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0033] To facilitate understanding of the embodiments of the present application, some backgrounds involved in the embodiments of the present application are briefly described below.

[0034] At present, the size of terminal devices such as smartphones has evolved to the limit of convenient one-handed operation. The development of candy-bar phones has reached a bottleneck. Folding-screen phones have become a potential demand and a new direction for industry development.

[0035] Taking mobile phones as an example, the expansion of the physical screen display area is positively correlated with the cost. The larger the display area of ​​the mobile phone screen, the higher the cost. In the case that the process technology of folding mobile phones cannot achieve leapfrog development, the larger the display area required for the folding screen of the mobile phone, the larger the volume of the folded mobile phone will be, which cannot bring a good user experience. The display area of ​​the mobile phone screen cannot exceed the display outside the screen, which will prevent mobile-based content products from achieving more information expansion and interactive expansion.

[0036] See also Figure 1 , Figure 1 1 is a flow chart of a method for controlling an extended screen provided in an embodiment of the present application. In this embodiment, the method for controlling an extended screen can be applied to a terminal device or a wearable device.

[0037] Among them, the terminal device can be a terminal device that can perform screen display functions such as a camera, a mobile phone, a computer, and a robot, which is not specifically limited here. The wearable device can be a device that can be used to display the AR extended screen display, such as smart glasses or AR helmets, which is not specifically limited here. The wearable device can be AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, or any other glasses that can be used to display the content displayed on the AR extended screen, which is not specifically limited here.

[0038] Exemplarily, the extended screen can be a virtual extended screen projected on the periphery of the terminal device through a wearable device. When the system or third-party application in the terminal device needs to expand the display range beyond the terminal device screen, the system / application of the terminal device sends an instruction to call up the AR extended screen to the client of the wearable device, and at the same time sends the content displayed on the AR extended screen to the client of the wearable device. After receiving the content, the client of the wearable device can display it in the specified user interface; the client of the wearable device can also display its own content in the specified user interface. It can be understood that the extended screen can display the content of the terminal device or the content of the wearable device. After the wearable device identifies and tracks the position of the terminal device, the user interface of the AR extended screen is anchored to the posture of the terminal device and becomes an extended display outside the physical screen of the terminal device.

[0039] Exemplarily, the control method of the extended screen provided in the embodiment of the present application is described below by taking the extended screen control method applied to a wearable device, and the wearable device is a smart glasses as an example. The extended screen of the terminal device is provided by the wearable device.

[0040] like Figure 1 As shown, the control method for the extended screen of the wearable device includes steps S101 to S102.

[0041] S101. Acquire control information corresponding to an extended screen of the terminal device according to a motion type of the terminal device; wherein the motion type of the terminal device is determined according to motion data collected by the terminal device.

[0042] Among them, the motion acquisition device can be a data acquisition device for collecting motion data of the terminal device, such as a gyroscope or an accelerometer, and the motion data can include data such as angular velocity and acceleration. The motion type can include left / right jog (around the z-axis), left / right jog (around the y-axis), up / down jog (around the x-axis), tapping, etc. Specifically, both jog and tapping can be defined as single, double or multiple times. The control information can be used to control the screen content of the extended screen, such as controlling the icon pre-selection cursor of the extended screen to jump to the icon on the left side of the current icon; it can also be a selection icon, an open icon, a close icon or a switch icon, etc. The icon can be a virtual program of the extended screen in the terminal device. The number of extended screens corresponding to the terminal device can be set according to specific needs, such as the number of the extended screens can be one or more, and the size of each extended screen can be the same or different.

[0043] It should be noted that the steps corresponding to "determining the exercise type corresponding to the terminal device based on the exercise data" and "determining the control information corresponding to the extended screen of the terminal device based on the exercise type" can be implemented on the terminal device or on the wearable device, and no specific limitation is made here.

[0044] S102: Control the extended screen according to the control information.

[0045] Specifically, a wearable device such as smart glasses can control the extended screen to display corresponding screen content according to the control information.

[0046] For example, if the control information is used to control the extended screen to perform a selection action, the smart glasses can display the screen content corresponding to the selection action on the extended screen according to the control information. For example, when the content displayed on the extended screen is a photo album, the selection action can be to select one of the photos.

[0047] The embodiment of the present application provides a control method for an extended screen, which determines the motion type of the terminal device according to the motion data collected by the motion collection device in the terminal device, obtains the control information corresponding to the extended screen according to the motion type of the terminal device, and controls the extended screen according to the control information. In this way, the extended screen of the terminal device can be controlled, and an intuitive and simple interaction method is provided for the AR extended display of the terminal device, and the convenience of using the AR extended display of the terminal device is improved.

[0048] The following description takes the wearable device as smart glasses and the terminal device as a mobile phone as an example.

[0049] In an embodiment of the present application, when a user is operating a terminal device, the terminal device can detect changes in the device state, and the motion data corresponding to the movement of the terminal device can be collected through the motion collection device of the terminal device, thereby accurately collecting the corresponding motion data.

[0050] For example, when the user manipulates the terminal device to move left / right (around the z-axis), the gyroscope of the terminal device can collect the corresponding angular velocity data when the terminal device moves, thereby accurately collecting the corresponding angular velocity data, that is, the angular velocity data can be used to detect changes in the device state of the terminal device. The device state may include the terminal device state reflected by events such as moving or tapping the terminal device.

[0051] For example, when a user taps a terminal device, the accelerometer of the terminal device can collect the corresponding acceleration data when the terminal device moves, thereby accurately collecting the corresponding acceleration data. At this time, the acceleration data can be used to determine whether the device state of the terminal device has changed.

[0052] like Figure 2As shown, for example, taking the terminal device as a mobile phone, the user can control the mobile phone to move left / right (around the z-axis), control the mobile phone to move left / right (around the y-axis), control the mobile phone to move up / down (around the x-axis) or tap the mobile phone. Among them, the above user operations all correspond to motion types.

[0053] In some embodiments, the data type is determined according to the motion data; and according to the data type, the motion data is calculated to obtain the motion type corresponding to the terminal device. The embodiment of the present application can accurately determine the data type, and can specifically and accurately calculate the motion type corresponding to the terminal device according to the data type.

[0054] The data types may include angular velocity data, acceleration data and other types.

[0055] Exemplarily, the data type can be determined by detecting the type of motion acquisition device. For example, if the motion data is obtained from a gyroscope, the data type of the motion data can be determined to be angular velocity data; if the motion data is obtained from an accelerometer, the data type of the motion data can be determined to be acceleration data.

[0056] Exemplarily, the data type may also be determined by detecting data features such as numerical features or change curves of the data, which is not specifically limited here.

[0057] In some embodiments, if the data type is angular velocity data, the rotation angle of the terminal device is determined by the angular velocity data, and the motion type corresponding to the terminal device is determined according to the rotation angle; if the data type is acceleration data, the acceleration slope corresponding to the acceleration data is determined, and the motion type corresponding to the terminal device is determined according to the acceleration slope. The embodiment of the present application can use corresponding algorithms to calculate the acquired data according to different data types, so as to accurately calculate the motion type corresponding to the terminal device.

[0058] The rotation angle of the terminal device is the angle at which the terminal device rotates in a certain direction within a period of time; and the acceleration slope may be the slope between two consecutive acceleration samples.

[0059] Exemplarily, if the data type is angular velocity data, the rotation angle of the terminal device in the rotation phase and the return phase is calculated using the angular velocity data, and the jog type corresponding to the terminal device is determined based on the rotation angle in the rotation phase and the return phase.

[0060] The rotation phase is a process in which the terminal device rotates in a first direction, and the return phase is a process in which the terminal device rotates in a direction opposite to the first direction. The first direction can be any direction, such as left, right, up, and down.

[0061] Exemplarily, if the data type is acceleration data, the acceleration slope corresponding to two consecutive acceleration data is determined, and the tapping type corresponding to the terminal device is determined according to the acceleration slope.

[0062] It should be noted that the angular velocity data and the acceleration data can be collected simultaneously by the motion collection device in the terminal device, and the angular velocity data and the acceleration data can be calculated specifically at the same time, which is not specifically limited here.

[0063] Therefore, the present application can determine that the data type includes angular velocity data and / or acceleration data by analyzing the motion data; for the angular velocity data and acceleration data, the present application proposes a corresponding algorithm to calculate the angular velocity data and acceleration data, so as to determine the motion type corresponding to the terminal device.

[0064] The following description is given by taking an example where the wearable device is a smart glasses, the terminal device is a mobile phone, and the motion data collected by the motion collection device is angular velocity data.

[0065] In some embodiments, angular velocity data corresponding to a first time period is obtained, the angular velocity data including an angular velocity component and an angular velocity modulus; if the angular velocity component and / or angular velocity modulus corresponding to the first time period exceeds the respective corresponding preset angular velocity thresholds, the angular velocity component and / or angular velocity modulus corresponding to the first time period is processed to obtain a first rotation angle; if the first rotation angle is within a preset angle range, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is processed to obtain a second rotation angle; the motion type corresponding to the terminal device is determined according to the first rotation angle and the second rotation angle. The embodiments of the present application can accurately determine the first rotation angle and the second rotation angle, thereby accurately determining the motion type corresponding to the terminal device according to the first rotation angle and the second rotation angle.

[0066] Among them, the angular velocity data includes angular velocity components and angular velocity modulus. The angular velocity components may include three-axis angular velocity components, namely, the angular velocity components corresponding to the x-axis, y-axis and z-axis; the angular velocity modulus may be an absolute value calculated by the three-axis angular velocity components. The preset angular velocity threshold may be any angular velocity value, which is specifically set by the user and is not specifically limited here. The first time period is the time period corresponding to the rotation phase of the terminal device, and the second time period is the time period corresponding to the return phase of the terminal device. The first rotation angle may be the angle at which the terminal device rotates in the first time period, and the second rotation angle may be the angle at which the terminal device rotates in the second time period. The preset angle range may be any angle, which is specifically set by the user and is not specifically limited here.

[0067] It should be noted that each angular velocity component and angular velocity modulus has a corresponding preset angular velocity threshold. If any angular velocity component or angular velocity modulus exceeds its corresponding preset angular velocity threshold, the angular velocity component and / or angular velocity modulus that exceeds its corresponding preset angular velocity threshold can be processed to obtain the first rotation angle.

[0068] Exemplarily, if the angular velocity component corresponding to the x-axis exceeds its corresponding preset angular velocity threshold, the angular velocity component corresponding to the x-axis may be processed to obtain the first rotation angle.

[0069] In the embodiment of the present application, the three-axis angular velocity components can be obtained by the gyroscope, that is, (ω x ,ω y ,ω z ), the corresponding angular velocity modulus can be calculated through the three-axis angular velocity components.

[0070] Exemplarily, the formula for calculating the angular velocity modulus value may be:

[0071]

[0072] Among them, |ω| is the angular velocity modulus, ω x is the angular velocity component corresponding to the x-axis, ω y is the angular velocity component corresponding to the y-axis, ω z is the angular velocity component corresponding to the z-axis.

[0073] If the angular velocity component and / or angular velocity modulus corresponding to the first time period exceeds their respective corresponding preset angular velocity thresholds, the specific motion axis of the gyroscope is identified, and the angular velocity component corresponding to the motion axis in the first time period is subjected to Euler integration to obtain a first rotation angle; if the angular velocity component and angular velocity modulus corresponding to the first time period do not exceed the preset angular velocity threshold, it is determined that the terminal device is not in the rotation stage.

[0074] The motion axis may be an axis along which the gyroscope detects the movement of the terminal device.

[0075] For example, if the preset angular velocity threshold is 5° / s, if ω x is 10°, ω y is 0°, ω z is 0°, and the angular velocity modulus is also 10°. It can be determined that the angular velocity component and angular velocity modulus corresponding to the first time period exceed the preset angular velocity threshold, and the specific movement axis of the gyroscope is identified as the x-axis. The angular velocity component corresponding to the x-axis in the first time period is Euler integrated to obtain the first rotation angle.

[0076] It should be noted that if it is identified that the specific movement axes of the gyroscope are multiple axes, such as the x-axis and the y-axis, it is necessary to perform Euler integration on the angular velocity components corresponding to the x-axis and the y-axis in the first time period respectively to obtain the first rotation angles corresponding to the x-axis and the y-axis.

[0077] Specifically, the formula for calculating the rotation angle can be expressed as:

[0078]

[0079] Among them, θ is the rotation angle within the time period, which can be the first rotation angle or the second rotation angle; t1 is the starting time of the rotation around the calculated axis, and t2 is the end time of the rotation around the calculated axis; ω(t) is the angular velocity component corresponding to the moving axis at time t.

[0080] If the first rotation angle is within the preset angle range, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is Euler integrated to obtain the second rotation angle. If the first rotation angle is not within the preset angle range, it can be determined that the terminal device has not entered the return phase.

[0081] For example, if the preset angle range is [15°, 45°] and the first rotation angle is 30°, it can be determined that the first rotation angle is within the preset angle range, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is Euler integrated to obtain the second rotation angle.

[0082] In some embodiments, after obtaining the first rotation angle, the first angular velocity component and the second angular velocity component in the first time period are obtained; the angular velocity slope is determined according to the first angular velocity component and the corresponding timestamp information and the second angular velocity component and the corresponding timestamp information; if the first rotation angle is within a preset angle range and the angular velocity slope is greater than the preset angular velocity slope, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is processed to obtain the second rotation angle. The embodiment of the present application can accurately calculate the second rotation angle through the angular velocity component.

[0083] The first angular velocity component and the second angular velocity component may be two consecutive angular velocity components within a first time period; the timestamp information is used to record the timestamps corresponding to the first angular velocity component and the second angular velocity component; the angular velocity slope may be a slope between two consecutive angular velocity samples. The preset angular velocity slope may be any angular velocity slope and may be set according to actual conditions, and is not specifically limited here.

[0084] Specifically, the angular velocity slope is determined based on the first angular velocity component and the corresponding timestamp information and the second angular velocity component and the corresponding timestamp information; if the first rotation angle is within the preset angle range and the angular velocity slope is greater than the preset angular velocity slope, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is processed to obtain the second rotation angle; if the first rotation angle is not within the preset angle range or the angular velocity slope is not greater than the preset angular velocity slope, it can be determined that the terminal device has not entered the return stage.

[0085] Exemplarily, the formula for calculating the angular velocity slope can be expressed as:

[0086]

[0087] Among them, slopeω(t) is the angular velocity slope, ω3 is the first angular velocity component, ω4 is the second angular velocity component, t3 is the timestamp information corresponding to the first angular velocity component, and t4 is the timestamp information corresponding to the second angular velocity component.

[0088] In some embodiments, the difference between the first rotation angle and the second rotation angle is determined; if the difference between the first rotation angle and the second rotation angle is less than a preset angle threshold, the motion type corresponding to the terminal device is determined to be inching. The embodiment of the present application can accurately determine the motion type corresponding to the terminal device by comparing the first rotation angle and the second rotation angle.

[0089] The preset angle threshold may be any angle, which is determined by actual conditions and is not specifically limited here.

[0090] It should be noted that after determining that the motion type corresponding to the terminal device is inching, the specific inching type can be determined by the motion axis and motion direction read by the gyroscope. For example, if the motion axis read by the gyroscope is the x-axis and the motion direction is clockwise (for example, the acceleration value detected is positive), it can be considered that the motion type corresponding to the terminal device is inching to the right around the x-axis. The motion axis can also be determined by the angular velocity component and its corresponding preset angular velocity threshold. If the angular velocity component corresponding to the x-axis exceeds its corresponding preset angular velocity threshold, it can be considered that the motion axis includes the x-axis.

[0091] Specifically, the difference between the first rotation angle and the second rotation angle is determined; if the difference between the first rotation angle and the second rotation angle is less than a preset angle threshold, it is determined that the movement type corresponding to the terminal device is inching; if the difference between the first rotation angle and the second rotation angle is greater than or equal to the preset angle threshold, it is determined that the movement type corresponding to the terminal device is not inching.

[0092] For example, if the first rotation angle is 30°, the second rotation angle is 20°, and the preset angle threshold is 20°, it can be determined that the difference between the first rotation angle and the second rotation angle is 10°; and if it is determined that the difference between the first rotation angle and the second rotation angle is less than the preset angle threshold, then the movement type corresponding to the terminal device is determined to be inching.

[0093] The above is an explanation of how to determine the motion type corresponding to the terminal device by taking the motion data collected by the motion collection device as angular velocity data as an example.

[0094] The following description is given by taking an example where the wearable device is a smart glasses, the terminal device is a mobile phone, and the motion data collected by the motion collection device is acceleration data.

[0095] In some embodiments, acceleration data corresponding to multiple moments are obtained, the acceleration data including acceleration components and acceleration modulus values; if the acceleration component and / or acceleration modulus value corresponding to the first moment exceeds the respective corresponding preset acceleration thresholds, the acceleration component and / or acceleration modulus value corresponding to the first moment and its adjacent moments are processed to obtain a first acceleration slope; if the first acceleration slope exceeds the preset slope threshold, it is determined that the motion type corresponding to the terminal device is a single tap. The embodiments of the present application can accurately determine that the motion type corresponding to the terminal device is a single tap through acceleration data.

[0096] Among them, the acceleration data includes acceleration components and acceleration modulus values. The acceleration components may include three-axis acceleration components, namely, acceleration components corresponding to the x-axis, y-axis, and z-axis; the acceleration modulus value may be an absolute value calculated by the three-axis acceleration components. The preset acceleration threshold value may be any angular velocity value, which is specifically set by the user and is not specifically limited here. The first moment and its adjacent moments may be two consecutive moments among multiple moments; the first acceleration slope is the acceleration slope corresponding to the first moment and its adjacent moments; the preset slope threshold value may be any acceleration slope value, which is specifically set by the user and is not specifically limited here.

[0097] It should be noted that each acceleration component and acceleration modulus has a corresponding preset acceleration threshold. If any acceleration component or acceleration modulus in the first moment exceeds its corresponding preset acceleration threshold, the acceleration components and / or acceleration modulus corresponding to the first moment and its adjacent moments can be processed to obtain the first acceleration slope.

[0098] Exemplarily, if the acceleration component corresponding to the x-axis in the first moment exceeds its corresponding preset acceleration threshold, the acceleration component corresponding to the x-axis in the first moment and its adjacent moment (second moment) can be processed to obtain the first acceleration slope.

[0099] In the embodiment of the present application, the three-axis acceleration components (a x , a y , a z ), the corresponding acceleration modulus can be calculated through the three-axis acceleration components.

[0100] For example, the formula for calculating the acceleration modulus value may be:

[0101]

[0102] Among them, |a| is the acceleration modulus, a x is the acceleration component corresponding to the x-axis, a y is the acceleration component corresponding to the y-axis, a z is the acceleration component corresponding to the z-axis.

[0103] If the acceleration component and / or acceleration modulus corresponding to the first moment exceeds the preset acceleration threshold, the acceleration components corresponding to the first moment and its adjacent moments are processed to obtain a first acceleration slope; if the acceleration component and acceleration modulus corresponding to the first moment do not exceed the preset acceleration threshold, it is determined that the terminal device has not detected the tapping.

[0104] For example, if the preset acceleration threshold is 1 m / s 2 , if ω x 2m / s 2 ,ω y 0m / s 2 ,ω z 0m / s 2 , at this time the angular velocity modulus is also 2m / s 2 , it can be determined that the angular velocity component and the angular velocity modulus corresponding to the first time period exceed the preset angular velocity threshold, and the slope between two consecutive acceleration samples is calculated to obtain the first acceleration slope.

[0105] It should be noted that if the accelerometer detects that the acceleration components corresponding to multiple axes exceed the preset acceleration threshold, such as the x-axis and the y-axis, it is necessary to calculate the slopes of the acceleration components corresponding to the x-axis and the y-axis at the first moment respectively to obtain the first acceleration slopes corresponding to the x-axis and the y-axis.

[0106] Specifically, the formula for calculating the acceleration slope can be expressed as:

[0107]

[0108] Among them, slope(t n ) is the slope between two consecutive acceleration samples; t n and t (n-1)are the time between two consecutive acceleration samplings; a(t n ) is the time t n The acceleration of the axis calculated at time.

[0109] Exemplarily, determine whether the first acceleration slope exceeds a preset slope threshold; if the first acceleration slope exceeds the preset slope threshold, it can be determined that the motion type corresponding to the terminal device is a single tap; if the first acceleration slope does not exceed the preset slope threshold, it can be determined that the terminal device did not detect the tap.

[0110] In some embodiments, after determining that the motion type corresponding to the terminal device is a single tap, determine whether the acceleration component and acceleration modulus corresponding to the second moment exceed their respective corresponding preset acceleration thresholds; if the acceleration component and / or acceleration modulus corresponding to the second moment exceed the preset acceleration threshold, process the acceleration component and / or acceleration modulus corresponding to the second moment and its adjacent moments to obtain a second acceleration slope; if the second acceleration slope exceeds the preset slope threshold, determine the difference between the second moment and the first moment; if the difference between the second moment and the first moment is less than the preset time threshold, determine that the motion type corresponding to the terminal device is multiple taps. The embodiments of the present application can accurately determine whether the motion type corresponding to the terminal device is multiple taps, thereby accurately determining the motion type corresponding to the terminal device.

[0111] The second moment and its adjacent moment may be two consecutive moments among the multiple moments, and the time of the second moment is later than the time of the second moment. The second acceleration slope is the acceleration slope corresponding to the second moment and its adjacent moment. The preset time threshold may be any time value, such as 5s, which is not specifically limited here.

[0112] Specifically, if it is determined that the second acceleration slope exceeds the preset slope threshold, the difference between the second moment and the first moment is determined; if the difference between the second moment and the first moment is less than the preset time threshold, the motion type corresponding to the terminal device is determined to be multiple taps; if the difference between the second moment and the first moment is not less than the preset time threshold, the motion type corresponding to the terminal device is determined to be a single tap.

[0113] For example, if the first moment is 15:10:05, the second moment is 15:10:12, and the preset time threshold is 10s, then it is determined that the difference between the second moment and the first moment is 7s. It can be determined that the difference between the second moment and the first moment is less than the preset time threshold, and thus it can be determined that the motion type corresponding to the terminal device is multiple taps.

[0114] The above is an explanation of how to determine the motion type corresponding to the terminal device by taking the motion data collected by the motion collection device as acceleration data as an example.

[0115] It should be noted that the above embodiments are all for explaining how to determine the type of motion corresponding to the terminal device, and the above embodiments can be executed separately or simultaneously.

[0116] In some embodiments, a mapping relationship between a preset motion type and control information is obtained, and it is determined whether the motion type of the terminal device is the preset motion type; if the motion type of the terminal device is the preset motion type, the control information corresponding to the motion type of the terminal device is determined according to the mapping relationship. The embodiment of the present application can accurately determine the corresponding control information according to the motion type, so as to display the corresponding screen content in the extended screen.

[0117] The mapping relationship between the preset motion type and the control information is used to indicate the corresponding relationship between each preset control information and each screen content. The preset motion type may include moving leftward around the x-axis, moving leftward around the y-axis, tapping, etc. The control information may be used to control the screen content of the extended screen. The icon may be a virtual icon of the extended screen in the terminal device.

[0118] Exemplarily, if it is determined that the movement type of the terminal device is a left-click around the x-axis, it can be determined whether the movement type of the terminal device is the preset movement type; if it is determined that the movement type of the terminal device is the preset movement type, then according to the mapping relationship between the preset movement type and the control information, the control information corresponding to the left-click around the x-axis is determined, for example, the control information is used to control the extended screen to perform a selection action.

[0119] In some embodiments, the control information includes at least one of the following: controlling the extended screen to execute an open instruction; or, controlling the extended screen to execute a select instruction; or, controlling the extended screen to execute a close instruction; or, controlling the extended screen to execute a switch instruction; or, controlling the extended screen to execute a zoom-in instruction; or, controlling the extended screen to execute a zoom-out instruction.

[0120] Among them, the control of the extended screen to execute the opening instruction is used to instruct the extended screen to open the corresponding icon or open the screen content of the corresponding page; the control of the extended screen to execute the selection instruction is used to instruct the extended screen to select the corresponding icon or select the screen content of the corresponding page; the control of the extended screen to execute the closing instruction is used to instruct the extended screen to close the corresponding icon or close the screen content of the corresponding page; the control of the extended screen to execute the switching instruction is used to instruct the extended screen to switch the corresponding icon or switch the screen content of the corresponding page; the control of the extended screen to execute the enlargement instruction is used to instruct the extended screen to enlarge the corresponding icon or enlarge the screen content of the corresponding page; the control of the extended screen to execute the reduction instruction is used to instruct the extended screen to reduce the corresponding icon or reduce the screen content of the corresponding page. The icon can be the icon corresponding to the application displayed on the extended screen, such as when the WeChat application is displayed in the extended screen, the icon is the WeChat icon, and the icon can be used to distinguish different applications; the icon can also be the icon of the related content displayed in the extended screen, through which the page can be switched, or certain content can be selected.

[0121] Exemplarily, the control information corresponds to a preset motion type. For example, the instruction to open the corresponding icon on the extended screen corresponds to a left click around the x-axis; the instruction to close the corresponding icon on the extended screen corresponds to a single tap, etc. The mapping relationship between the preset motion type and the control information can be set according to actual conditions, and is not specifically limited here.

[0122] like Figure 3 As shown, exemplarily, the screen content of the extended screen may include a selection action, a cancel action, an action of moving a cursor up, down, left, or right, etc. The extended screen may be displayed on the left and right sides and the top space of the terminal device.

[0123] For example, the upward / downward jog (around the x-axis) and the left / right jog (around the z-axis) of the terminal device can be set in advance to respectively associate the cursor with moving up, down, left, and right. When jogging to the left, since the movement is small, the position of the extended screen content does not change at this time, and the cursor is only moved to the left to the icon to the left of the current cursor position. If a single tap and a double tap are respectively associated with selection and cancellation, then when a single tap is detected, the content of the icon where the cursor is located can be selected.

[0124] For example, taking the terminal device as a mobile phone, the action of holding the mobile phone and the action of expanding the screen content can be defined by yourself, such as gently shaking the mobile phone screen (equivalent to continuously clicking left and right around the x-axis) is associated with a multi-component selection action, lightly lifting the top of the mobile phone (equivalent to clicking left around the z-axis) is associated with a confirmation action & an open action, lightly lifting the left side of the mobile phone (equivalent to clicking left around the x-axis) is associated with a return action & a close action; lightly lifting the right side of the mobile phone (equivalent to clicking right around the x-axis) is associated with a switching action, etc. The specific settings can be made in advance by the user and the corresponding mapping relationship can be stored in the wearable device or terminal device.

[0125] For example, taking the terminal device as a mobile phone, if the extended screen displays the corresponding screen content, when the extended screen changes with the tilt angle of the mobile phone's gravity sensor (i.e., the amplitude of the inching type), the extended screen can also present effects such as size enlargement and transparent gradient; or after the extended screen is selected to confirm the operation, the extended screen can also present the effect of component enlargement, so as to show more detailed content; or when closing & exiting the current component, the extended screen can also present the effect of component reduction and return to the original extended display area; or when switching the extended screen, the extended screen can also present the effect of dynamic gradual enlargement or reduction. This can be achieved by setting the mapping relationship between the tilt angle of the mobile phone and the control information.

[0126] In some embodiments, the control method for the extended screen provided in the embodiment of the present application is described below by taking the application of the control method for the extended screen to a terminal device as an example, wherein the extended screen of the terminal device is provided by a wearable device.

[0127] like Figure 4 As shown, the control method for the extended screen applied to the terminal device includes steps S201 to S203.

[0128] S201, acquiring motion data collected by a motion collection device in the terminal device;

[0129] S202, determining a sport type corresponding to the terminal device according to the sport data;

[0130] S203: Send the exercise type to the wearable device, so that the wearable device determines control information corresponding to the extended screen according to the exercise type, and controls the extended screen according to the control information.

[0131] It is understandable that "determining the type of exercise corresponding to the terminal device according to the exercise data" and "determining the control information corresponding to the extended screen of the terminal device according to the type of exercise" can be implemented on the terminal device or on the wearable device. The specific embodiments corresponding to the above steps have been described above and will not be repeated here.

[0132] The embodiment of the present application provides a control method for an extended screen, which obtains motion data collected by a motion collection device in a terminal device; determines the motion type corresponding to the terminal device according to the motion data; and sends the motion type to a wearable device, so that the wearable device determines the control information corresponding to the extended screen according to the motion type, and controls the extended screen according to the control information. In this way, the step of "determining the motion type corresponding to the terminal device according to the motion data" can be implemented on the terminal device, and the step of "determining the control information corresponding to the extended screen of the terminal device according to the motion type" can be implemented on the wearable device to balance the amount of computing data of the terminal device and the wearable device, thereby realizing the control of the extended screen of the terminal device, providing an intuitive and simple interaction method for the AR extended display of the terminal device, and improving the convenience of using the AR extended display of the terminal device.

[0133] The following will demonstrate the control methods of the extended screen in various application scenarios.

[0134] See also Figure 5 , Figure 5 It is a flow chart of another method for controlling an extended screen provided in an embodiment of the present application.

[0135] like Figure 5 As shown, the control method for the extended screen applied to the terminal device includes steps S301 to S304.

[0136] S301: Acquire motion data collected by a motion collection device in the terminal device.

[0137] S302: Determine the exercise type corresponding to the terminal device according to the exercise data.

[0138] S303: Determine control information corresponding to the extended screen according to the motion type.

[0139] S304: Send the control information to the wearable device, so that the wearable device controls the extended screen according to the control information.

[0140] The embodiment of the present application provides a control method for an extended screen, which obtains motion data collected by a motion collection device in a terminal device; determines the motion type corresponding to the terminal device according to the motion data; and sends the motion type to a wearable device, so that the wearable device determines the control information corresponding to the extended screen according to the motion type, and controls the extended screen according to the control information. In this way, the steps of "determining the motion type corresponding to the terminal device according to the motion data" and "determining the control information corresponding to the extended screen of the terminal device according to the motion type" can be implemented on the terminal device, reducing the amount of computing data of the wearable device and reducing the computing burden of the wearable device, thereby realizing the control of the extended screen of the terminal device, providing an intuitive and simple interaction method for the AR extended display of the terminal device, and improving the convenience of using the AR extended display of the terminal device.

[0141] See also Figure 6 , Figure 6 It is a flow chart of another method for controlling an extended screen provided in an embodiment of the present application.

[0142] like Figure 6 As shown, the control method for the extended screen applied to the terminal device includes steps S401 to S402.

[0143] S401: Acquire motion data collected by a motion collection device in the terminal device.

[0144] S402. Send the motion data to the wearable device, so that the wearable device determines the motion type corresponding to the terminal device according to the motion data; and determines the control information corresponding to the extended screen according to the motion type, and controls the extended screen according to the control information.

[0145] It should be noted that the specific embodiments corresponding to the steps of "determining the motion type corresponding to the terminal device based on the motion data" and "determining the control information corresponding to the extended screen of the terminal device based on the motion type" have been described above and will not be repeated here.

[0146] The embodiment of the present application provides a control method for an extended screen, which obtains motion data collected by a motion collection device in a terminal device; determines the motion type corresponding to the terminal device according to the motion data; and sends the motion type to a wearable device, so that the wearable device determines the control information corresponding to the extended screen according to the motion type, and controls the extended screen according to the control information. In this way, the steps of "determining the motion type corresponding to the terminal device according to the motion data" and "determining the control information corresponding to the extended screen of the terminal device according to the motion type" can be implemented on the wearable device, reducing the amount of computing data of the terminal device and reducing the computing burden of the terminal device, thereby realizing the control of the extended screen of the terminal device, providing an intuitive and simple interaction method for the AR extended display of the terminal device, and improving the convenience of using the AR extended display of the terminal device.

[0147] See also Figure 7 , Figure 7 is a schematic block diagram of a control device for an extended screen of a wearable device provided in an embodiment of the present application. Figure 7 As shown, the control device 500 for extending the screen includes: a type determination module 501 and a screen control module 502 .

[0148] A type determination module 501, configured to obtain control information corresponding to the extended screen according to the motion type of the terminal device; wherein the motion type of the terminal device is determined according to the motion data collected by the terminal device;

[0149] The screen control module 502 is used to control the extended screen according to the control information.

[0150] In some embodiments, the type determination module 501 is further used to determine a data type according to the motion data; and calculate the motion data according to the data type to obtain a motion type corresponding to the terminal device.

[0151] In some embodiments, the type determination module 501 is also used to determine the rotation angle of the terminal device through the angular velocity data if the data type is angular velocity data, and determine the motion type corresponding to the terminal device based on the rotation angle; if the data type is acceleration data, determine the acceleration slope corresponding to the acceleration data, and determine the motion type corresponding to the terminal device based on the acceleration slope.

[0152] In some embodiments, the type determination module 501 is also used to obtain angular velocity data corresponding to a first time period, wherein the angular velocity data includes an angular velocity component and an angular velocity modulus; if the angular velocity component and / or angular velocity modulus corresponding to the first time period exceeds their respective corresponding preset angular velocity thresholds, the angular velocity component and / or angular velocity modulus corresponding to the first time period is processed to obtain a first rotation angle; if the first rotation angle is within a preset angle range, the angular velocity component corresponding to the second time period is obtained, and the angular velocity component corresponding to the second time period is processed to obtain a second rotation angle; the motion type corresponding to the terminal device is determined according to the first rotation angle and the second rotation angle.

[0153] In some embodiments, the type determination module 501 is also used to obtain the first angular velocity component and the second angular velocity component within the first time period; determine the angular velocity slope according to the first angular velocity component and the corresponding timestamp information and the second angular velocity component and the corresponding timestamp information; if the first rotation angle is within the preset angle range and the angular velocity slope is greater than the preset angular velocity slope, then obtain the angular velocity component corresponding to the second time period, and process the angular velocity component corresponding to the second time period to obtain the second rotation angle.

[0154] In some embodiments, the type determination module 501 is also used to determine the difference between the first rotation angle and the second rotation angle; if the difference between the first rotation angle and the second rotation angle is less than a preset angle threshold, the movement type corresponding to the terminal device is determined to be inching.

[0155] In some embodiments, the type determination module 501 is also used to obtain acceleration data corresponding to multiple moments, wherein the acceleration data includes acceleration components and acceleration moduli; if the acceleration components and / or acceleration moduli corresponding to the first moment exceed their respective corresponding preset acceleration thresholds, the acceleration components and / or acceleration moduli corresponding to the first moment and its adjacent moments are processed to obtain a first acceleration slope; if the first acceleration slope exceeds the preset slope threshold, it is determined that the motion type corresponding to the terminal device is a single tap.

[0156] In some embodiments, the type determination module 501 is also used to determine whether the acceleration component and acceleration modulus corresponding to the second moment exceed their respective preset acceleration thresholds; if the acceleration component and / or acceleration modulus corresponding to the second moment exceed the preset acceleration threshold, the acceleration component and / or acceleration modulus corresponding to the second moment and its adjacent moments are processed to obtain a second acceleration slope; if the second acceleration slope exceeds the preset slope threshold, the difference between the second moment and the first moment is determined; if the difference between the second moment and the first moment is less than the preset time threshold, it is determined that the motion type corresponding to the terminal device is multiple taps.

[0157] In some embodiments, the type determination module 501 is also used to obtain a mapping relationship between a preset motion type and control information, and determine whether the motion type of the terminal device is the preset motion type; if the motion type of the terminal device is the preset motion type, the control information corresponding to the motion type of the terminal device is determined according to the mapping relationship.

[0158] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0159] The method and apparatus of the present application can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices.

[0160] See also Figure 8 , Figure 8 A schematic block diagram of the structure of a wearable device 600 provided in an embodiment of the present application.

[0161] like Figure 8 As shown, the wearable device 600 may include a processor 601 and a memory 602, and the processor 601 and the memory 602 are connected via a bus 603, such as an I2C (Inter-integrated Circuit) bus.

[0162] In an exemplary embodiment, the processor 601 can be used to provide computing and control capabilities to support the operation of the entire terminal device. The processor 601 can be a central processing unit (CPU), and the processor 601 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0163] Specifically, the memory 602 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0164] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a partial structure related to the embodiment of the present application, and does not constitute a limitation on the terminal device to which the embodiment of the present application is applied. The specific server may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0165] Among them, the processor 601 is used to run the computer program stored in the memory, and implement any one of the control methods for the extended screen of the wearable device provided in the embodiments of the present application when executing the computer program.

[0166] In one embodiment, the processor 601 is used to run a computer program stored in a memory, and implement the following steps when executing the computer program: obtaining control information corresponding to the extended screen according to the movement type of the terminal device; wherein the movement type of the terminal device is determined according to the movement data collected by the terminal device; and controlling the extended screen according to the control information.

[0167] In one embodiment, the processor 601 is further configured to: determine a data type according to the motion data; and calculate the motion data according to the data type to obtain a motion type corresponding to the terminal device.

[0168] In one embodiment, the processor 601 is also used to implement: if the data type is angular velocity data, then determining the rotation angle of the terminal device through the angular velocity data, and determining the motion type corresponding to the terminal device according to the rotation angle; if the data type is acceleration data, then determining the acceleration slope corresponding to the acceleration data, and determining the motion type corresponding to the terminal device according to the acceleration slope.

[0169] In one embodiment, the processor 601 is also used to implement: obtaining angular velocity data corresponding to a first time period, the angular velocity data including an angular velocity component and an angular velocity modulus; if the angular velocity component and / or angular velocity modulus corresponding to the first time period exceeds their respective corresponding preset angular velocity thresholds, processing the angular velocity component and / or angular velocity modulus corresponding to the first time period to obtain a first rotation angle; if the first rotation angle is within a preset angle range, obtaining the angular velocity component corresponding to the second time period, and processing the angular velocity component corresponding to the second time period to obtain a second rotation angle; determining the motion type corresponding to the terminal device according to the first rotation angle and the second rotation angle.

[0170] In one embodiment, the processor 601 is also used to implement: obtaining a first angular velocity component and a second angular velocity component within the first time period; determining an angular velocity slope according to the first angular velocity component and the corresponding timestamp information and the second angular velocity component and the corresponding timestamp information; if the first rotation angle is within a preset angle range and the angular velocity slope is greater than the preset angular velocity slope, obtaining the angular velocity component corresponding to the second time period, and processing the angular velocity component corresponding to the second time period to obtain a second rotation angle.

[0171] In one embodiment, the processor 601 is also used to implement: determining the difference between the first rotation angle and the second rotation angle; if the difference between the first rotation angle and the second rotation angle is less than a preset angle threshold, determining that the movement type corresponding to the terminal device is inching.

[0172] In one embodiment, the processor 601 is also used to implement: obtaining acceleration data corresponding to multiple moments, the acceleration data including acceleration components and acceleration modulus values; if the acceleration component and / or acceleration modulus value corresponding to the first moment exceeds their respective corresponding preset acceleration threshold values, processing the acceleration component and / or acceleration modulus value corresponding to the first moment and its adjacent moments to obtain a first acceleration slope; if the first acceleration slope exceeds the preset slope threshold value, determining that the motion type corresponding to the terminal device is a single tap.

[0173] In one embodiment, the processor 601 is also used to implement: determining whether the acceleration component and acceleration modulus corresponding to the second moment exceed their respective corresponding preset acceleration thresholds; if the acceleration component and / or acceleration modulus corresponding to the second moment exceed the preset acceleration threshold, processing the acceleration component and / or acceleration modulus corresponding to the second moment and its adjacent moments to obtain a second acceleration slope; if the second acceleration slope exceeds the preset slope threshold, determining the difference between the second moment and the first moment; if the difference between the second moment and the first moment is less than the preset time threshold, determining that the motion type corresponding to the terminal device is multiple taps.

[0174] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the wearable device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0175] See also Fig. 9 , Fig. 9 A schematic block diagram of the structure of a terminal device 700 provided in an embodiment of the present application.

[0176] like Fig. 9 As shown, the terminal device 700 may include a processor 701 and a memory 702, and the processor 701 and the memory 702 are connected via a bus 703, such as an I2C (Inter-integrated Circuit) bus.

[0177] In an exemplary embodiment, the processor 701 can be used to provide computing and control capabilities to support the operation of the entire terminal device. The processor 701 can be a central processing unit (CPU), and the processor 701 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0178] Specifically, the memory 702 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0179] Those skilled in the art will understand that Fig. 9 The structure shown in the figure is only a block diagram of a partial structure related to the embodiment of the present application, and does not constitute a limitation on the terminal device to which the embodiment of the present application is applied. The specific server may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0180] Among them, the processor 701 is used to run the computer program stored in the memory, and implement any one of the control methods for the extended screen of the terminal device provided in the embodiments of the present application when executing the computer program.

[0181] In one embodiment, the processor 701 is used to run a computer program stored in a memory, and implement the following steps when executing the computer program: obtaining motion data collected by a motion collection device in the terminal device; determining a motion type corresponding to the terminal device based on the motion data; sending the motion type to the wearable device, so that the wearable device determines control information corresponding to the extended screen based on the motion type, and controls the extended screen based on the control information.

[0182] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the terminal device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0183] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any one of the control methods for an extended screen of a terminal device or the control method for an extended screen of a wearable device provided in the embodiment of the present application is implemented.

[0184] The computer-readable storage medium may be an internal storage unit of the wearable device described in the foregoing embodiment, such as a memory of the wearable device. The computer-readable storage medium may also be an external storage device of the wearable device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the wearable device.

[0185] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like.

[0186] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for controlling an extended screen, characterized in that: Applied to a wearable device, the method comprises: According to the motion type of the terminal device, acquiring control information corresponding to the extended screen; wherein the motion type of the terminal device is determined according to the motion data collected by the terminal device; The extended screen is controlled according to the control information.

2. The method according to claim 1, characterized in that The motion type of the terminal device is determined according to the motion data collected by the terminal device, including: determining a data type according to the motion data; The motion data is calculated according to the data type to obtain the motion type corresponding to the terminal device.

3. The method according to claim 2, characterized in that The calculating the motion data according to the data type to obtain the motion type corresponding to the terminal device includes: If the data type is angular velocity data, determining the rotation angle of the terminal device through the angular velocity data, and determining the motion type corresponding to the terminal device according to the rotation angle; If the data type is acceleration data, the acceleration slope corresponding to the acceleration data is determined, and the motion type corresponding to the terminal device is determined according to the acceleration slope.

4. The method according to claim 3, characterized in that Determining the rotation angle of the terminal device by using the angular velocity data, and determining the motion type corresponding to the terminal device according to the rotation angle includes: Acquire angular velocity data corresponding to the first time period, wherein the angular velocity data includes an angular velocity component and an angular velocity modulus; If the angular velocity component and / or the angular velocity modulus corresponding to the first time period exceeds the respective corresponding preset angular velocity thresholds, processing the angular velocity component and / or the angular velocity modulus corresponding to the first time period to obtain a first rotation angle; If the first rotation angle is within the preset angle range, acquiring the angular velocity component corresponding to the second time period, and processing the angular velocity component corresponding to the second time period to obtain a second rotation angle; The motion type corresponding to the terminal device is determined according to the first rotation angle and the second rotation angle.

5. The method according to claim 4, characterized in that The angular velocity data also includes timestamp information. If the angular velocity component and / or the angular velocity modulus corresponding to the first time period exceeds a preset angular velocity threshold, the angular velocity component corresponding to the first time period is processed to obtain the first rotation angle, and further includes: Acquire a first angular velocity component and a second angular velocity component within the first time period; Determining an angular velocity slope according to the first angular velocity component and the corresponding timestamp information and the second angular velocity component and the corresponding timestamp information; If the first rotation angle is within a preset angle range and the angular velocity slope is greater than a preset angular velocity slope, an angular velocity component corresponding to a second time period is acquired, and the angular velocity component corresponding to the second time period is processed to obtain a second rotation angle.

6. The method according to claim 4, characterized in that The determining the motion type corresponding to the terminal device according to the first rotation angle and the second rotation angle includes: determining a difference between the first rotation angle and the second rotation angle; If the difference between the first rotation angle and the second rotation angle is less than a preset angle threshold, it is determined that the motion type corresponding to the terminal device is inching.

7. The method according to claim 3, characterized in that The determining the acceleration slope corresponding to the acceleration data, and determining the motion type corresponding to the terminal device according to the acceleration slope, includes: Acquire acceleration data corresponding to a plurality of moments, wherein the acceleration data includes acceleration components and acceleration modulus values; If the acceleration component and / or acceleration modulus corresponding to the first moment exceeds the respective corresponding preset acceleration thresholds, the acceleration component and / or acceleration modulus corresponding to the first moment and its adjacent moments are processed to obtain a first acceleration slope; If the first acceleration slope exceeds a preset slope threshold, it is determined that the motion type corresponding to the terminal device is a single tap.

8. The method according to claim 7, characterized in that If the acceleration slope exceeds the preset slope threshold, after determining that the motion type corresponding to the terminal device is a single tap, the method further includes: Determining whether the acceleration component and the acceleration modulus corresponding to the second moment exceed the preset acceleration threshold; If the acceleration component and / or acceleration modulus corresponding to the second moment exceeds the respective corresponding preset acceleration thresholds, the acceleration component and / or acceleration modulus corresponding to the second moment and its adjacent moments are processed to obtain a second acceleration slope; If the second acceleration slope exceeds the preset slope threshold, determining a difference between the second moment and the first moment; If the difference between the second moment and the first moment is less than a preset time threshold, it is determined that the motion type corresponding to the terminal device is multiple taps.

9. The method according to claim 1, characterized in that: The acquiring control information corresponding to the extended screen of the terminal device according to the motion type of the terminal device includes: Acquire a mapping relationship between a preset motion type and control information, and determine whether the motion type of the terminal device is the preset motion type; If the motion type of the terminal device is the preset motion type, control information corresponding to the motion type of the terminal device is determined according to the mapping relationship.

10. The method according to claim 1, characterized in that The control information includes at least one of the following: Controlling the extended screen to execute an opening instruction; or, controlling the extended screen to execute a selected instruction; or, Controlling the extended screen to execute a close instruction; or, controlling the extended screen to execute a switching instruction; or, controlling the extended screen to execute a zoom-in instruction; or, The extended screen is controlled to execute a zoom-out instruction.

11. A method for controlling an extended screen, characterized in that: Applied to a terminal device, the method comprises: Acquiring motion data collected by a motion collection device in the terminal device; Determining a motion type corresponding to the terminal device according to the motion data; The exercise type is sent to the wearable device, so that the wearable device determines the control information corresponding to the extended screen according to the exercise type, and controls the extended screen according to the control information.

12. A control device for extending a screen, characterized in that: Applied to a wearable device, the control device for the extended screen includes: A motion type determination module, used to obtain control information corresponding to the extended screen according to the motion type of the terminal device; wherein the motion type of the terminal device is determined according to the motion data collected by the terminal device; The extended screen control module is used to control the extended screen according to the control information.

13. A wearable device, characterized in that: The wearable device is used to provide an extended screen for a terminal device, and the wearable device includes: a memory and a processor; wherein the memory is connected to the processor and is used to store a program, and the processor is used to implement any one of the control methods for an extended screen applied to a wearable device as described in claims 1 to 10 by running the program stored in the memory.

14. A terminal device, characterized in that: The extended screen of the terminal device is provided by a wearable device, and the terminal device includes: a memory and a processor; wherein the memory is connected to the processor for storing programs, and the processor is used to implement a control method for an extended screen applied to a terminal device as described in claim 11 by running the programs stored in the memory.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed by a processor, enables the processor to implement any one of the control methods for an extended screen applied to a wearable device as described in any one of claims 1 to 10 or a control method for an extended screen applied to a terminal device as described in claim 11.

Images