A method and related equipment for realizing electronic sand table using sequence frames

Abstract

The embodiment of the present application provides a method and related equipment for realizing an electronic sand table using a sequence frame, the method comprising: collecting first information of a first gesture for the electronic sand table; decomposing the first information of the first gesture to obtain a first displacement of the first gesture in a first direction and a second displacement of the first gesture in a second direction; determining a third displacement according to the first displacement and determining a fourth displacement according to the second displacement, the third displacement being N times the first displacement, and the fourth displacement being N times the second displacement; adjusting the display orientation of the electronic sand table according to the third displacement and the fourth displacement. The embodiment of the present application can be used to view the electronic sand table at different heights, so that the electronic sand table has the visual effect of a three-dimensional digital sand table.

Description

Technical Field

[0001] The present application relates to the field of visual presentation technology, and in particular to a method for realizing an electronic sandbox using sequence frames and related equipment. Background Art

[0002] With the development of science and technology, users have an increasing demand for technology that displays electronic sand tables on electronic screens. Usually, the electronic sand table rotates at a fixed height, and the user's field of view for observing the electronic sand table is the range of rotation of the horizontal plane at the fixed height. When the electronic sand table rotates at a fixed height, a video or picture sequence frame mode is used to display the horizontal rotation effect at a fixed height, but when rotating in the horizontal direction, the user can only see the content of the electronic sand table 360° on the horizontal plane at a fixed height. The electronic sand table cannot meet the demand for viewing the sand table content at different heights, which reduces the user's experience and efficiency in observing the electronic sand table. Usually, the physical sand table has the effect of three-dimensional viewing, but the cost is relatively high. Summary of the invention

[0003] The embodiment of the present application discloses a method and related equipment for realizing an electronic sand table using sequence frames, which can view the electronic sand table at different heights, so that the electronic sand table has the visual effect of a three-dimensional digital sand table.

[0004] In a first aspect, an embodiment of the present application provides a method for implementing an electronic sandbox using sequence frames, characterized in that it includes:

[0005] Collecting first information of a first gesture for the electronic sandbox;

[0006] Decomposing the first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction;

[0007] Determine a third displacement amount according to the first displacement amount and determine a fourth displacement amount according to the second displacement amount, wherein the third displacement amount is N times of the first displacement amount and the fourth displacement amount is N times of the second displacement amount;

[0008] The display orientation of the electronic sandbox is adjusted according to the third displacement amount and the fourth displacement amount.

[0009] In the above method, by collecting information on the user's gesture, the third displacement of the electronic sand table in the first direction (horizontal direction) and the fourth displacement in the second direction (vertical direction) are obtained according to the first information of the first gesture, so that the electronic sand table can be moved at different vertical heights and rotated in the horizontal direction. Instead of using a physical three-dimensional sand table to achieve the three-dimensional effect of viewing the sand table at different angles and heights, this method can achieve the three-dimensional effect of viewing the electronic sand table at different angles at different heights on a two-dimensional electronic sand table screen, thereby improving the user's experience and efficiency in observing the electronic sand table and saving costs at the same time.

[0010] It should be noted that the electronic sand table is displayed in the form of sequence frames during the change process. The sequence frames represent the images of the video frame by frame during the activity of the electronic sand table. The stuttering phenomenon caused by reading files and decoding during video display is smoother than using sequence frames (pictures) to display the changes of the electronic sand table. In other words, the display orientation (adjusted display orientation) of the electronic sand table is adjusted according to the third displacement and the fourth displacement, and the display orientation of the electronic sand table is changed from the initial display orientation of the electronic sand table to the adjusted display orientation of the electronic sand table, and the change process of the electronic sand table is described using sequence frames (pictures).

[0011] It should be noted that the third displacement of the electronic sand table in the first direction (horizontal direction) is the displacement of the electronic sand table rotating around the center of the electronic sand table. It can be understood that if the electronic sand table is circular, the third displacement is the length of the arc rotating around the center of the electronic sand table; the fourth displacement of the electronic sand table in the second direction (vertical direction) is the height of the electronic sand table rising or falling in the vertical direction.

[0012] In yet another optional solution of the first aspect, after decomposing the first information of the first gesture to obtain a first displacement of the gesture in the first direction and a second displacement in the second direction, and before adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement, the method further includes:

[0013] Determine a first preset value in a first direction, and determine a second preset value in a second direction, wherein the first preset value is used to represent a minimum displacement amount in the first direction that can adjust the display orientation of the electronic sand table, and the second preset value is used to represent a minimum displacement amount in the second direction that can adjust the display orientation of the electronic sand table;

[0014] If the first displacement reaches the first preset value, and the second displacement reaches the second preset value, the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement is performed.

[0015] In the above method, by determining a first preset value in a first direction (horizontal direction) and a second preset value in a second direction (vertical direction), a first displacement less than the first preset value and a second displacement less than the second preset value are screened out. That is, if the first displacement decomposed by the information of the user's gesture in the first direction is less than the first preset value, indicating that the first displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the first direction, the first displacement is removed (no displacement or the displacement is regarded as 0); if the second displacement decomposed by the information of the user's gesture in the second direction is less than the second preset value, indicating that the second displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the second direction, the second displacement is removed (no displacement or the displacement is regarded as 0). This method can more accurately obtain the sliding intention of the user's gesture information, remove the sliding deviation caused by the unstable user gesture or other situations, more accurately analyze the displacement of the user's gesture information in the first direction and the second direction, and improve the accuracy and efficiency of controlling the electronic sand table.

[0016] In yet another optional solution of the first aspect, the method further includes:

[0017] collecting second information of a second gesture for the electronic sandbox, where the second gesture is used to represent other gestures except the first gesture;

[0018] Decomposing the second information of the second gesture to obtain a fifth displacement amount of the gesture in the first direction and a sixth displacement amount in the second direction;

[0019] determining a seventh displacement amount according to the fifth displacement amount and determining an eighth displacement amount according to the sixth displacement amount, wherein the seventh displacement amount is N times the fifth displacement amount and the eighth displacement amount is N times the sixth displacement amount;

[0020] After adjusting the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount, the method further includes:

[0021] The display orientation of the electronic sandbox is adjusted according to the seventh displacement amount and the eighth displacement amount.

[0022] In the above method, the first information corresponding to the first gesture of the user on the electronic sand table causes the electronic sand table to move. If the user then performs a second sliding gesture on the electronic sand table, the second information of the second gesture can also cause the electronic sand table to move. That is, while or after adjusting the display position of the electronic sand table by the third displacement and the fourth displacement corresponding to the first information, the display position of the electronic sand table can also be adjusted by the seventh displacement and the eighth displacement corresponding to the second information. In other words, the final display position of the electronic sand table is the result of comprehensive adjustment of multiple information corresponding to multiple gestures. This method can comprehensively consider the impact of multiple gesture information on the electronic sand table, making the angle and height of the electronic sand table more accurate, and improving the user's experience of using multiple gestures to adjust the electronic sand table.

[0023] In yet another optional solution of the first aspect, the electronic sand table includes a target reference point, the displacement of the target reference point in the first direction is the third displacement amount, and the displacement of the target reference point in the second direction is the fourth displacement amount. It should be noted that when the display orientation of the electronic sand table is adjusted according to the information corresponding to the user's first gesture, the entire electronic sand table will move the third movement distance in the first direction or the fourth movement distance in the second direction, and a target reference point on the electronic sand table is selected to explain the movement of the electronic sand table in the first direction or the second direction.

[0024] In another optional solution of the first aspect, the target reference point is an edge point of the electronic sand table. It should be noted that, when the third displacement amount and the fourth displacement amount are equal in magnitude, if the target reference point is closer to the edge of the electronic sand table, the corresponding movement amplitude of the electronic sand table is smaller; if the target reference point is closer to the center of the electronic sand table, the corresponding movement amplitude of the electronic sand table is larger. For electronic sand tables of different shapes and sizes, the electronic sand table with a large shape rotates less than the electronic sand table with a small shape at the same distance. Therefore, the movement distance corresponding to the outer edge point of the electronic sand table can usually better reflect the rotation amplitude corresponding to the size of the electronic sand table. In other words, selecting the edge point as the target reference point can improve the accuracy of rotating the electronic sand table.

[0025] In yet another optional solution of the first aspect, the method further includes: collecting third information of a third gesture for the electronic sandbox, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold;

[0026] The target reference point is updated to a point close to the center position of the electronic sandbox, wherein the larger the sliding distance of the third information of the third gesture is, the closer the updated target reference point is to the center position of the electronic sandbox.

[0027] In the above method, when the target reference point is selected as an edge point, if the shape of the electronic sandbox is too large, the electronic sandbox will move a small amplitude when the user's gesture amplitude is large. At this time, the user takes a third gesture for the electronic sandbox, and the similarity between the motion trajectory of the third gesture and the motion trajectory of the first gesture is higher than the preset threshold, indicating that the user continues to enhance the third gesture on the basis of the first gesture, so that the electronic sandbox continues to move in the direction of movement of the electronic sandbox corresponding to the first gesture. This adjustment method indicates that the movement amplitude of the electronic sandbox corresponding to the first gesture may be too small, and it is necessary to add a third gesture to make the electronic sandbox continue to move. At this time, the target reference point is updated to a point close to the center position of the electronic sandbox. When the third displacement and the fourth displacement are equal, the movement amplitude of the electronic sandbox is larger than that of the target reference point being an edge point. After adjusting the target reference point, the user may not need to add a third gesture, which improves the user experience and the efficiency of rotating the electronic sandbox.

[0028] It should be noted that the greater the sliding distance of the third information of the third gesture, the closer the updated target reference point is to the center of the electronic sand table. It can be understood that the greater the sliding distance of the third gesture, the greater the amplitude of the electronic sand table that needs to be moved on the basis of the movement of the electronic sand table corresponding to the first gesture. Therefore, the closer the set target reference point is to the center, the greater the amplitude of the electronic sand table that can move when the third displacement and the fourth displacement are equal.

[0029] In yet another optional solution of the first aspect, the method further includes:

[0030] Dividing the electronic sandbox into a plurality of blocks on the plane area in the first direction;

[0031] Selecting a plurality of moving points on the electronic sand table according to the plurality of blocks, wherein the plurality of moving points are overlapping points of the electronic sand table and the plurality of blocks;

[0032] Calculating a pathfinding evaluation value for each of the plurality of moving points, wherein the pathfinding evaluation value is used to represent the sum of an actual moving distance and an estimated distance;

[0033] The following steps are executed repeatedly until the new moving point of the target reference point is the target moving point:

[0034] The moving point with the smallest path-finding evaluation value is selected as a new moving point of the target reference point, and the target reference point is moved toward the new moving point.

[0035] In the above method, if the user needs to set the electronic sand table to automatically move from the initial state to the target moving state without making a gesture, the path finding evaluation value of the moving point during the movement of the target point can be calculated according to the path finding algorithm, and the moving path corresponding to the moving point with the smallest path finding evaluation value (i.e., the sum of the actual moving distance and the estimated distance) is selected as the moving path for the electronic sand table to move to the target moving state. This method can move the electronic sand table from the initial state to the target moving state by the shortest path, thereby improving the efficiency of movement.

[0036] In a second aspect, an embodiment of the present application provides a device for implementing an electronic sandbox using a sequence frame, characterized in that it includes:

[0037] A first collecting unit, used to collect first information of a first gesture for the electronic sandbox;

[0038] a first decomposition unit, configured to decompose the first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction;

[0039] a first determining unit, configured to determine a third displacement amount according to the first displacement amount and to determine a fourth displacement amount according to the second displacement amount, wherein the third displacement amount is N times of the first displacement amount and the fourth displacement amount is N times of the second displacement amount;

[0040] The first adjustment unit is used to adjust the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount.

[0041] It can be seen that by collecting the information of the user's gesture, the third displacement of the electronic sand table in the first direction (horizontal direction) and the fourth displacement in the second direction (vertical direction) are obtained according to the first information of the first gesture, so that the electronic sand table can be moved at different vertical heights and rotated in the horizontal direction. Instead of using a physical three-dimensional sand table to achieve the three-dimensional effect of viewing the sand table at different angles and heights, this method can achieve the three-dimensional effect of viewing the electronic sand table at different angles at different heights on the two-dimensional electronic sand table screen, thereby improving the user's experience and efficiency in observing the electronic sand table and saving costs at the same time.

[0042] It should be noted that the electronic sand table is displayed in the form of sequence frames during the change process. The sequence frames represent the images of the video frame by frame during the activity of the electronic sand table. The stuttering phenomenon caused by reading files and decoding during video display is smoother than using sequence frames (pictures) to display the changes of the electronic sand table. In other words, the display orientation (adjusted display orientation) of the electronic sand table is adjusted according to the third displacement and the fourth displacement, and the display orientation of the electronic sand table is changed from the initial display orientation of the electronic sand table to the adjusted display orientation of the electronic sand table, and the change process of the electronic sand table is described using sequence frames (pictures).

[0043] It should be noted that the third displacement of the electronic sand table in the first direction (horizontal direction) is the displacement of the electronic sand table rotating around the center of the electronic sand table. It can be understood that if the electronic sand table is circular, the third displacement is the length of the arc rotating around the center of the electronic sand table; the fourth displacement of the electronic sand table in the second direction (vertical direction) is the height of the electronic sand table rising or falling in the vertical direction.

[0044] In an optional solution of the second aspect, the device further includes:

[0045] A second determining unit is configured to determine a first preset value in the first direction and a second preset value in the second direction after decomposing the first information of the first gesture to obtain a first displacement amount in the first direction and a second displacement amount in the second direction of the gesture, and before adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount, wherein the first preset value is used to represent a minimum displacement amount in the first direction by which the display orientation of the electronic sand table can be adjusted, and the second preset value is used to represent a minimum displacement amount in the second direction by which the display orientation of the electronic sand table can be adjusted;

[0046] A judgment unit is used to execute the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement if the first displacement reaches the first preset value and the second displacement reaches the second preset value.

[0047] It can be seen that by determining the first preset value in the first direction (horizontal direction) and the second preset value in the second direction (vertical direction), the first displacement less than the first preset value and the second displacement less than the second preset value are screened out. That is, if the first displacement decomposed by the information of the user's gesture in the first direction is less than the first preset value, indicating that the first displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the first direction, then the first displacement is removed (no displacement or the displacement is regarded as 0); if the second displacement decomposed by the information of the user's gesture in the second direction is less than the second preset value, indicating that the second displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the second direction, then the second displacement is removed (no displacement or the displacement is regarded as 0). This method can more accurately obtain the sliding intention of the user's gesture information, remove the sliding deviation caused by the unstable user gesture or other situations, more accurately analyze the displacement of the user's gesture information in the first direction and the second direction, and improve the accuracy and efficiency of controlling the electronic sand table.

[0048] In yet another optional solution of the second aspect, the device further includes:

[0049] A second collecting unit, used to collect second information of a second gesture for the electronic sandbox, where the second gesture is used to represent other gestures except the first gesture;

[0050] a second decomposition unit, configured to decompose the second information of the second gesture to obtain a fifth displacement amount of the gesture in the first direction and a sixth displacement amount in the second direction;

[0051] a second determining unit, configured to determine a seventh displacement amount according to the fifth displacement amount and to determine an eighth displacement amount according to the sixth displacement amount, wherein the seventh displacement amount is N times the fifth displacement amount and the eighth displacement amount is N times the sixth displacement amount;

[0052] The second adjustment unit is configured to adjust the display orientation of the electronic sand table according to the seventh displacement amount and the eighth displacement amount after adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount.

[0053] It can be seen that the first information corresponding to the user's first gesture on the electronic sand table makes the electronic sand table move. If the user slides the second gesture on the electronic sand table again, the second information of the second gesture can also make the electronic sand table move. That is, while or after adjusting the display position of the electronic sand table by the third displacement and the fourth displacement corresponding to the first information, the display position of the electronic sand table can also be adjusted by the fifth displacement and the sixth displacement corresponding to the second information. In other words, the final display position of the electronic sand table is the result of the comprehensive adjustment of multiple information corresponding to multiple gestures. This method can comprehensively consider the impact of multiple gesture information on the electronic sand table, making the angle and height of the electronic sand table more accurate, and improving the user's experience of using multiple gestures to adjust the electronic sand table.

[0054] In yet another optional solution of the second aspect, the electronic sand table includes a target reference point, the displacement of the target reference point in the first direction is the third displacement amount, and the displacement of the target reference point in the second direction is the fourth displacement amount. It should be noted that when the display orientation of the electronic sand table is adjusted according to the information corresponding to the user's first gesture, the entire electronic sand table will move the third movement distance in the first direction or the fourth movement distance in the second direction, and a target reference point on the electronic sand table is selected to explain the movement of the electronic sand table in the first direction or the second direction.

[0055] In another optional solution of the second aspect, the target reference point is an edge point of the electronic sand table. It should be noted that, when the third displacement amount and the fourth displacement amount are equal in magnitude, if the target reference point is closer to the edge of the electronic sand table, the corresponding movement amplitude of the electronic sand table is smaller; if the target reference point is closer to the center of the electronic sand table, the corresponding movement amplitude of the electronic sand table is larger. For electronic sand tables of different shapes and sizes, the electronic sand table with a large shape rotates less than the electronic sand table with a small shape at the same distance. Therefore, the movement distance corresponding to the outer edge point of the electronic sand table can usually better reflect the rotation amplitude corresponding to the size of the electronic sand table. In other words, selecting the edge point as the target reference point can improve the accuracy of rotating the electronic sand table.

[0056] In yet another optional solution of the second aspect, the device further includes:

[0057] A third collecting unit is used to collect third information of a third gesture for the electronic sandbox, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold;

[0058] An updating unit is used to update the target reference point to a point close to the center position of the electronic sandbox, wherein the larger the sliding distance of the third information of the third gesture is, the closer the updated target reference point is to the center position of the electronic sandbox.

[0059] It can be seen that when the target reference point is selected as an edge point, if the shape of the electronic sandbox is too large, the electronic sandbox will move a small amplitude when the user's gesture amplitude is large. At this time, the user takes a third gesture for the electronic sandbox, and the similarity between the motion trajectory of the third gesture and the motion trajectory of the first gesture is higher than the preset threshold. The user continues to enhance the third gesture, and on the basis of the movement of the first gesture of the electronic sandbox, the electronic sandbox continues to move in the direction of movement of the electronic sandbox corresponding to the first gesture, indicating that the movement amplitude of the electronic sandbox corresponding to the first gesture may be too small, and it is necessary to add a third gesture to make the electronic sandbox continue to move. At this time, the target reference point is updated to a point close to the center of the electronic sandbox. When the third displacement and the fourth displacement are equal, the movement amplitude of the electronic sandbox is larger than that of the target reference point being an edge point. After adjusting the target reference point, the user may not need to add a third gesture, which improves the user experience and the efficiency of rotating the electronic sandbox.

[0060] It should be noted that the greater the sliding distance of the third information of the third gesture, the closer the updated target reference point is to the center of the electronic sand table. It can be understood that the greater the sliding distance of the third gesture, the greater the amplitude of the electronic sand table that needs to be moved on the basis of the movement of the electronic sand table corresponding to the first gesture. Therefore, the closer the set target reference point is to the center, the greater the amplitude of the electronic sand table that can move when the third displacement and the fourth displacement are equal.

[0061] In a third aspect, an embodiment of the present application provides an electronic device, including a transceiver, a processor and a memory, wherein the memory is used to store a computer program, and the processor calls the computer program to execute the first aspect of the embodiment of the present application or any one of the methods of implementing an electronic sandbox using sequence frames in the first aspect.

[0062] In a fourth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the first aspect of the embodiment of the present application or any one of the methods of implementing an electronic sandbox using sequence frames in the first aspect.

[0063] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device executes the first aspect of the embodiment of the present application or any one of the methods of implementing an electronic sandbox using sequence frames in the first aspect.

[0064] In a sixth aspect, an embodiment of the present application provides an electronic device, the electronic device comprising a method or device for executing any of the embodiments of the present application. The electronic device is, for example, a chip.

[0065] It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of features or beneficial effects means that specific technical features, technical solutions or beneficial effects are included in at least one embodiment. Therefore, the description of technical features, technical solutions or beneficial effects in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in the present embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be realized without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in a specific embodiment that does not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] The following is an introduction to the drawings used in the embodiments of the present application.

[0067] Figure 1 A device 10 for implementing an electronic sandbox method using sequence frames provided in an embodiment of the present application;

[0068] Figure 2 A flow diagram of a method for implementing an electronic sandbox using sequence frames provided in an embodiment of the present application;

[0069] Figure 3 A schematic diagram of a scenario in which first information of a first gesture acts on a target reference point provided by an embodiment of the present application;

[0070] Figure 4 A schematic diagram of a scenario for obtaining a first displacement and a second displacement of first information of a first gesture provided in an embodiment of the present application;

[0071] Figure 5 A schematic diagram of a scenario for decomposing first information in a first direction and a second direction provided in an embodiment of the present application;

[0072] Figure 6 A schematic diagram of a scenario in which first information is decomposed in a first direction to obtain a first displacement provided by an embodiment of the present application;

[0073] Figure 7 A schematic diagram of adjusting the display orientation of an electronic sand table according to a third displacement amount and a fourth displacement amount provided in an embodiment of the present application;

[0074] Figure 8 A schematic diagram of adjusting the display orientation of an electronic sand table according to a third displacement amount and a fourth displacement amount provided in an embodiment of the present application;

[0075] Fig. 9A schematic diagram of a scenario in which the second information of a second gesture provided in an embodiment of the present application acts on a target reference point;

[0076] Fig.10 A schematic diagram of a scenario of adjusting an electronic sandbox according to second information of a second gesture provided in an embodiment of the present application;

[0077] Fig.11 A schematic diagram of a scene of a moving point in a pathfinding process provided by an embodiment of the present application;

[0078] Fig.12 A schematic diagram of a scenario for automatically adjusting the display direction of an electronic sandbox according to a pathfinding evaluation value provided in an embodiment of the present application;

[0079] Fig.13 A schematic diagram of a scenario for adjusting the position of a target reference point according to a third gesture provided in an embodiment of the present application;

[0080] Fig.14 A structural diagram of an apparatus 1400 for implementing an electronic sandbox using sequence frames provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] The technical solutions in the embodiments of the present application will be described more clearly below in conjunction with the accompanying drawings. The terms used in the implementation method of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0082] See also Figure 1 , Figure 1It is a device 10 for implementing a method of an electronic sand table using a sequence frame provided in an embodiment of the present application. The device 10 includes a processor 101, a memory 102, a screen 103, and a sequence frame state machine 104. The memory 102 stores a computer program or data. The processor calls the computer program or data stored in the memory 102 to perform operations of switching electronic sand tables of different heights and angles through different sequence frame displays. The screen 103 includes an electronic sand table, which can be understood as the electronic sand table being displayed in a two-dimensional form on the screen 103. The electronic sand table is displayed in the form of a sequence frame (picture). When a first gesture of the user is received, the first gesture is input into the sequence frame state machine 104, and first information about the first gesture is obtained. The first information of the first gesture is decomposed into a first direction (horizontal The sequence frame state machine 104 obtains the third displacement of the electronic sand table in the first direction and the fourth displacement in the second direction according to the first displacement and the second displacement, and then adjusts the display orientation of the electronic sand table according to the third displacement and the fourth displacement, so that the electronic sand table can move in both the horizontal direction and the vertical direction. For example, the distance of the curve rotating around the electronic sand table is the third displacement, and the distance the electronic sand table rises or falls in the vertical direction is the fourth displacement, which can achieve the three-dimensional effect of viewing the electronic sand table at different angles at different heights on the two-dimensional electronic sand table screen. The method is described below:

[0083] See also Figure 2 , Figure 2 is a flow diagram of a method for implementing an electronic sandbox using sequence frames provided in an embodiment of the present application. The method can be based on Figure 1 The method is implemented by the device 10 shown in the figure, or is implemented based on other architectures, and the method includes but is not limited to the following steps:

[0084] S201: Collecting first information of a first gesture for the electronic sandbox;

[0085] The user's sliding gesture on the electronic sandbox is collected and input into the sequence frame state machine 104 to obtain first information of the first gesture, which is used to characterize the movement information of the gesture. The first information can indirectly control the movement of the electronic sandbox in the first direction and the second direction.

[0086] It should be noted that the user's sliding gesture on the electronic sand table can be a sliding gesture on the screen of an external device, which controls the movement of the electronic sand table in screen 103 by sliding the gesture on the screen of the external device. It can also be sliding in the air, and the movement of the electronic sand table in screen 103 is determined by sliding the corresponding gesture in the air. It can also be other forms, which are not limited to the embodiments of the present application. The embodiments of the present application take the user's sliding gesture in the air to control the movement of the electronic sand table in screen 103 as an example for analysis.

[0087] In some embodiments, a target reference point of an electronic sand table is selected. It should be noted that, when the size of the first information corresponding to the first gesture is equal, if the target reference point is closer to the edge point of the electronic sand table, the smaller the movement amplitude of the corresponding electronic sand table; if the target reference point is closer to the center of the electronic sand table, the larger the movement amplitude of the corresponding electronic sand table. For electronic sand tables of different shapes and sizes, the electronic sand table with a larger shape rotates less than the electronic sand table with a smaller shape at the same distance. Therefore, the moving distance corresponding to the outer edge point of the electronic sand table can usually better reflect the rotation amplitude corresponding to the size of the electronic sand table. In other words, selecting an edge point as the target reference point can improve the accuracy of rotating the electronic sand table. Other points can also be selected as target reference points. In the embodiment of the present application, the edge point of the electronic sand table is selected as the target reference point to illustrate the embodiment of the present application.

[0088] In some embodiments, the first information of the first gesture for the electronic sand table is collected, and the influence of the first information on the electronic sand table is explained using the target reference point on the electronic sand table, that is, the specific movement distance of the electronic sand table in the first direction and the second direction is explained. Specifically, assuming that the user slides in the air to make a sliding gesture for the electronic sand table on the screen 103, the first gesture of the sliding gesture is input into the sequence frame state machine 104, and the first information of the first gesture is obtained, such as Figure 3 As shown, Figure 3 A schematic diagram of a scenario in which the first information of a first gesture acts on a target reference point provided in an embodiment of the present application. Target point A1 (edge ​​point) is selected as the target reference point, and the force of the sliding gesture on the electronic sand table is explained through target point A1 (edge ​​point). The first information A1B of the first gesture acts on target point A1 on the electronic sand table. After receiving the first information of the first gesture, the electronic sand table will produce a moving effect, that is, the target point A1 in the electronic sand table will produce a moving effect after receiving the first information. It should be noted that in the embodiments of the present application, the movement of the gesture on the electronic sand table is explained through target point A1 (edge ​​point).

[0089] The following is a description of the specific movement effect of the target point A1 (edge ​​point) under the first gesture:

[0090] S202: Decompose first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction;

[0091] It should be noted that the electronic sandbox may be circular, elliptical, or other shapes. The embodiment of the present application uses the case where the electronic sandbox is circular for illustration.

[0092] It should be noted that the first direction points to the horizontal direction, and the second direction points to the vertical direction. The electronic sandbox can realize rotation at different angles in the horizontal plane where the first direction is located, and can also realize rising or falling movements at different heights in the second direction.

[0093] In some embodiments, the first information of the first gesture will decompose the projection of the first information on the horizontal plane on the plane where the first direction is located, and the first information of the first gesture will decompose the projection of the first information on the vertical plane on the plane where the second direction (vertical) is located. Since the displacement mode of the electronic sand table in the first direction is the displacement rotating around the center of the electronic sand table, it can be understood that the displacement of the electronic sand table (circular) in the first direction is the arc length, so the projection length of the first information decomposed on the horizontal plane needs to be further decomposed according to the line connecting the target point and the center of the circle and the tangent of the target point, and the decomposition amount of the horizontal projection of the first information in the tangent direction of the horizontal plane where the first direction is located is the first displacement; since the movement mode of the electronic sand table in the second direction is vertical ascent or vertical descent, it can be understood that the electronic sand table moves upward or downward as a whole in the second direction, so the projection of the first information of the first gesture on the vertical plane where the second direction is located is the second displacement.

[0094] Specifically, Figure 4 As shown, Figure 4 A schematic diagram of a scenario for obtaining a first displacement and a second displacement of first information of a first gesture provided in an embodiment of the present application. Figure 4 The x in the figure belongs to the horizontal axis of the decomposed coordinates on the plane where the first direction is located, and the y belongs to the vertical axis of the decomposed coordinates on the plane where the second direction is located. The x horizontal axis is perpendicular to the y vertical axis, forming a decomposed reference coordinate system xy. The first information A1B of the first gesture acts on the target point A1 of the electronic sandbox. The first information A1B of the first gesture will decompose the projection A1C of the first information on the horizontal plane on the plane where the first direction is located, and the first information A1B of the first gesture will decompose the projection A1D of the first information on the vertical plane on the plane where the second direction is located. The specific decomposition method of the projection is as follows: Figure 5 As shown, Figure 5 A schematic diagram of a scenario for decomposing first information in a first direction and a second direction provided in an embodiment of the present application, Figure 5 The decomposed reference coordinates xy and Figure 4 The decomposed reference coordinate system xy in is consistent, and the first direction (horizontal) and the second direction (vertical) are 90° apart, and the projection A1C of the first information in the first direction (i.e., the first displacement A1C) and the projection A1D of the first information in the second direction (i.e., the second displacement A1D) are obtained. Since the displacement mode of the electronic sand table in the first direction is the displacement rotating around the center N of the electronic sand table, it can be understood that the displacement of the electronic sand table (circular) in the first direction is the arc length, such as Figure 6 As shown, Figure 6 A schematic diagram of a scenario in which a first information is decomposed in a first direction to obtain a first displacement is provided in an embodiment of the present application. The projection length A1C of the first information decomposed on the horizontal plane needs to be further decomposed according to the line A1N connecting the target point A1 and the center of the circle N and the tangent line L of the target point. The tangent line L is 90° to the straight line A1N. The decomposition amount A1M1 (that is, the first displacement A1M1) of the horizontal projection A1C in the tangent direction of the horizontal plane where the first direction is located is obtained as follows: Figure 4 The first displacement A1M1 is shown. It should be noted that the decomposition of the horizontal projection A1C on the line A1N connecting the target point A1 and the center of the circle N is A1M2, which can be understood as the centripetal force and has no effect on the arc length of the target point A1 moving in the direction of the tangent line L, so the decomposition A1M2 can be ignored;

[0095] Specifically, since the electronic sand table moves in the second direction in a vertical ascending or descending manner, it can be understood that the electronic sand table moves upward or downward as a whole in the second direction. Figure 5 As shown, the projection A1D of the first information A1B of the first gesture on the vertical plane where the second direction is located is as follows Figure 4 The second displacement A1D is shown.

[0096] S203: determining a third displacement amount according to the first displacement amount and determining a fourth displacement amount according to the second displacement amount;

[0097] The decomposition amount of the first information of the first gesture in the horizontal plane where the first direction is located along the tangent L direction of the electronic sand table (circle) is the first displacement amount, and the decomposition amount of the first information of the first gesture in the vertical plane where the second direction is located is the second displacement amount. The first displacement amount represents the influence of the first gesture on the displacement amount of the electronic sand table in the first direction, the second displacement amount represents the influence of the first gesture on the electronic sand table in the second direction, the third displacement amount represents the displacement amount of the electronic sand table in the first direction under the action of the first gesture, and the fourth displacement amount is used to represent the displacement amount of the electronic sand table in the second direction under the action of the first gesture;

[0098] In some embodiments, the third displacement is N times the first displacement, and the fourth displacement is N times the second displacement, wherein N can be a positive number, wherein the positive number can include a decimal less than 1 (e.g., 0.5), indicating that the third displacement is smaller than the first displacement, and the fourth displacement is smaller than the second displacement; the fourth displacement can also be a positive number greater than 1 (e.g., 2 or 2.5, etc.), which can be understood as the third displacement is N times the first displacement, indicating that the third displacement is larger than the first displacement, and the fourth displacement is larger than the second displacement. It should be noted that the ratio of the third displacement to the first displacement and the ratio of the fourth displacement to the second displacement can be equal or unequal, and the embodiment of the present application does not limit this. In the embodiment of the present application, the equal situation is selected for analysis, that is, the third displacement is N times the first displacement, the fourth displacement is N times the second displacement, and the two Ns are the same N.

[0099] It should be noted that the third displacement is used to characterize the displacement of the electronic sand table in the first direction, and the fourth displacement is used to characterize the displacement of the electronic sand table in the second direction. Since the displacement of the electronic sand table in the first direction is a rotational displacement around the center of the electronic sand table, it can be understood that the displacement of the electronic sand table (circular) in the first direction is the arc length; since the movement of the electronic sand table in the second direction is vertical ascent or vertical descent, it can be understood that the displacement of the electronic sand table as a whole moving upward or downward in the second direction is a straight-line distance.

[0100] Specifically, Figure 4 As shown, when N is a positive number greater than 1, assuming that the target point A1 moves in the first direction is F1, the target point A1 moves in the second direction is G, and the third displacement A1F1 (arc length) is N times the first displacement A1M1, then the third displacement A1F1 (arc length) is larger than the first displacement A1M1, that is, the displacement A1F1 (arc length) of the electronic sandbox in the first direction is larger than the first displacement A1M1 of the first gesture in the first direction; the fourth displacement A1G is N times the second displacement A1D, then the fourth displacement A1G is larger than the second displacement A1D, that is, the displacement A1G of the electronic sandbox in the second direction is larger than the second displacement A1D of the first gesture in the second direction.

[0101] Specifically, Figure 4As shown, when N is a positive number less than 1, assuming that the target point A1 moves in the first direction is F2, the target point A1 moves in the second direction is S, and the third displacement A1F2 (arc length) is N times the first displacement A1M1, then the third displacement A1F2 (arc length) is smaller than the first displacement A1M1, that is, the displacement A1F2 (arc length) of the electronic sandbox in the first direction is smaller than the first displacement A1M1 of the first gesture in the first direction; the fourth displacement A1S is N times the second displacement A1D, then the fourth displacement A1S is larger than the second displacement A1D, that is, the displacement A1S of the electronic sandbox in the second direction is smaller than the second displacement A1D of the first gesture in the second direction.

[0102] It should be noted that when N is a decimal less than 1 (for example, 0.5), it indicates that the first displacement of the first information of the first gesture in the first direction is larger than the third displacement of the electronic sand table in the first direction, and the second displacement of the first information of the first gesture in the second direction is larger than the fourth displacement of the electronic sand table in the first direction, indicating that the user gesture slides with a large amplitude at this time, and the displacement of the electronic sand table in the first direction or the second direction is very small, which is used in the case where the sequence frame of the electronic sand table changes slowly; when N is a positive number greater than 1 (for example, 2.5), it indicates that the first displacement of the first information of the first gesture in the first direction is larger than the third displacement of the electronic sand table in the first direction, and the second displacement of the first information of the first gesture in the second direction is larger than the fourth displacement of the electronic sand table in the first direction, indicating that the user gesture slides with a small amplitude at this time, and the displacement of the electronic sand table in the first direction or the second direction is very large, which is used in the case where the sequence frame of the electronic sand table changes quickly.

[0103] In some embodiments, a first preset value in a first direction is determined, and a second preset value in a second direction is determined, wherein the first preset value is used to characterize the minimum displacement amount in the first direction by which the display orientation of the electronic sand table can be adjusted, and the second preset value is used to characterize the minimum displacement amount in the second direction by which the display orientation of the electronic sand table can be adjusted; if the first displacement reaches the first preset value, and the second displacement reaches the second preset value, the step of adjusting the display orientation of the electronic sand table according to the third displacement and the fourth displacement is performed. It can be understood that after obtaining the first displacement and the second displacement, it is necessary to compare the first displacement with the first preset value, and to compare the second displacement with the second preset value. If the first displacement decomposed by the information of the user's gesture in the first direction is less than the first preset value, indicating that the first displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the first direction, the first displacement is removed (regarded as no displacement or as 0); if the second displacement decomposed by the information of the user's gesture in the second direction is less than the second preset value, indicating that the second displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the second direction, the second displacement is removed (regarded as no displacement or as 0).

[0104] If the first displacement amount decomposed by the user's gesture information in the first direction is greater than the first preset value, it indicates that the first displacement amount is greater than the minimum displacement amount that can adjust the display orientation of the electronic sand table in the first direction, the first displacement amount is retained, and the step of adjusting the display orientation of the electronic sand table according to the third displacement amount is performed; if the second displacement amount decomposed by the user's gesture information in the second direction is greater than the second preset value, it indicates that the second displacement amount is greater than the minimum displacement amount that can adjust the display orientation of the electronic sand table in the second direction, the second displacement amount is retained, and the step of adjusting the display orientation of the electronic sand table according to the fourth displacement amount is performed.

[0105] For example, it can be understood that if the first displacement is greater than the first preset value and the second displacement is greater than the second preset value, the step of adjusting the display orientation of the electronic sand table according to the third displacement and the fourth displacement is performed; if the first displacement is less than the first preset value and the second displacement is greater than the second preset value, the step of adjusting the display orientation of the electronic sand table according to the fourth displacement is performed; if the first displacement is greater than the first preset value and the second displacement is less than the second preset value, the step of adjusting the display orientation of the electronic sand table according to the third displacement is performed; if the first displacement is less than the first preset value and the second displacement is less than the second preset value, the display orientation of the electronic sand table is not adjusted. This method can more accurately obtain the sliding intention of the user's gesture information, remove the sliding deviation caused by the unstable user gesture or other situations, more accurately analyze the displacement of the user's gesture information in the first direction and the second direction, and improve the accuracy and efficiency of controlling the electronic sand table.

[0106] Specifically, Figure 4 As shown, the first displacement of the electronic sandbox in the first direction is A1M1 and the second displacement in the second direction is A1D. Assuming that the user's first gesture is moving from bottom to top in the vertical direction, during the user's first gesture, due to the user's unstable gesture or other circumstances causing deviations in the user's gesture moving from bottom to top, the first information of the user's first gesture is as follows Figure 4 The A1B situation shown is not a vertical movement. At this time, assuming that the first displacement A1M1 is small enough and less than the first preset value in the first direction, and the second displacement A1D is greater than the second preset value in the second direction, the first displacement A1M1 is removed, that is, the first displacement A1M1 is regarded as 0, and only adjusted in the direction of the second displacement, that is, the display orientation of the electronic sandbox is adjusted only according to the fourth displacement corresponding to the second displacement. After setting the first preset value and the second preset value, even if the user's gesture is unstable or other circumstances cause the user's first gesture to deviate from the user's own gesture intention, after setting the preset value, the displacement corresponding to the gesture less than the preset value (minimum displacement) can be removed, and the displacement corresponding to the gesture greater than the preset value (minimum displacement) can be retained, thereby improving the accuracy and efficiency of controlling the electronic sandbox. It should be noted that the first preset value in the first direction and the second preset value in the second direction may be equal or unequal, and the embodiment of the present application does not limit this.

[0107] It should be noted that if Figure 4 As shown, in an embodiment of the present application, the situation where the first displacement A1M1 is greater than the first preset value in the first direction and the second displacement A1D is greater than the second preset value in the second direction is selected for analysis, and the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement is performed.

[0108] S204: adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount.

[0109] The adjustment of the third displacement amount in the first direction and the fourth displacement amount in the second direction of the electronic sandbox is performed simultaneously, and the adjustment of the third displacement amount in the first direction and the adjustment of the fourth displacement amount in the second direction do not affect each other, and the final display orientation of the electronic sandbox for the first gesture is the sum of the third displacement amount in the first direction and the fourth displacement amount in the second direction.

[0110] It should be noted that the electronic sand table is displayed in the form of sequence frames during the change process. The sequence frames represent the images of the video frame by frame during the activity of the electronic sand table. The stuttering phenomenon caused by reading files and decoding during video display is smoother than using sequence frames (pictures) to display the changes of the electronic sand table. In other words, the display orientation (adjusted display orientation) of the electronic sand table is adjusted according to the third displacement and the fourth displacement, and the display orientation of the electronic sand table is changed from the initial display orientation of the electronic sand table to the adjusted display orientation of the electronic sand table, and the change process of the electronic sand table is described using sequence frames (pictures).

[0111] In some embodiments, the first display orientation of the electronic sand table (the sequence frame picture of the initial display orientation) represents the picture of the electronic sand table corresponding to the sequence frame of the starting state, and the second display orientation of the electronic sand table (the sequence frame picture of the final display orientation) represents the picture of the electronic sand table corresponding to the sequence frame of the final state. The electronic sand table is transformed from the first display orientation (the picture corresponding to a sequence frame of the initial display orientation) to the second display orientation of the electronic sand table (the picture corresponding to a sequence frame of the final display orientation). The transformation process also includes multiple sequence frames (multiple pictures). The switching angle between each sequence frame (which can be understood as the speed) can be changed by setting the number of sequence frames in the first direction and the number of sequence frames in the second direction, which can also be understood as the number of sequence frame pictures within 1 second.

[0112] Specifically, the number of sequence frames can be understood as affecting the switching angle between two adjacent sequence frames, that is, the angle of switching from one sequence frame (picture) to an adjacent sequence frame (picture). For example, if the number of sequence frames in the first direction is set to 120 frames, it can be understood that when the electronic sandbox in the first direction rotates 360° horizontally, each sequence frame rotates 3°; for another example, if the number of sequence frames in the first direction is set to 60 frames, it can be understood that when the electronic sandbox in the first direction rotates 360° horizontally, each sequence frame rotates 6°. Compared with the switching angle between two adjacent sequence frames corresponding to 60 frames in the first direction, the switching angle between two adjacent sequence frames corresponding to 120 frames is 3°, and the transformation angle between two adjacent sequence frames is smaller, and the speed of switching sequence frame pictures is faster.

[0113] Specifically, the number of sequence frames can also be understood as the number of sequence frames within 1 second. For example, the number of sequence frames in the first direction is set to 15 frames, which indicates that the number of sequence frames in 1 second is 15 picture sequence frames; for another example, the number of sequence frames in the first direction is set to 25 frames, which indicates that the number of sequence frames in 1 second is 25 picture sequence frames. Compared with 15 sequence frames in 1 second, when there are 25 sequence frames in 1 second, the switching speed between sequence frame pictures is faster.

[0114] In the embodiment of the present application, the number of sequence frames is selected to represent the number of switches within 1 second for analysis, that is, the number of sequence frames within 1 second is set in the first direction and the second direction, respectively, so as to set the switching speed of the sequence frames in the first direction and the switching speed of the sequence frames in the second direction, respectively. In the embodiment of the present application, the number of sequence frames within 1 second in the first direction is 10 frames and the number of sequence frames within 1 second in the second direction is 15 frames as an example for analysis. It should be noted that the number of sequence frames within 1 second in the first direction and the number of sequence frames within 1 second in the second direction may be the same or different, and the embodiment of the present application does not limit this. In the embodiment of the present application, different situations are selected for analysis.

[0115] In some embodiments, if N is a positive number greater than (or equal to) 1, the display position of the electronic sand table is adjusted according to the third displacement amount and the fourth displacement amount. The following takes the target point on the electronic sand table as an example to illustrate the adjustment process of the display position of the electronic sand table. Figure 4 As shown, when N is a positive number greater than (can be equal to) 1, assuming that the target point A1 moves in the first direction to F1, and the target point A1 moves in the second direction to G, the third displacement A1F1 (arc length) is greater than the first displacement A1M1, that is, the displacement A1F1 (arc length) of the electronic sandbox in the first direction is greater than the first displacement A1M1 of the first gesture in the first direction, and the fourth displacement A1G is greater than the second displacement A1D, that is, the displacement A1G of the electronic sandbox in the second direction is greater than the second displacement A1D of the first gesture in the second direction. The display orientation of the electronic sandbox is adjusted according to the third displacement A1F1 and the fourth displacement A1G. The specific process is as follows: Figure 7 As shown, Figure 7 A schematic diagram of adjusting the display orientation of an electronic sand table according to a third displacement and a fourth displacement provided in an embodiment of the present application. In the first display orientation of the electronic sand table (a sequence frame image of the initial display orientation), the first display orientation of the electronic sand table includes a target point A1, and the target point A1 is adjusted according to the third displacement A1F1 and the fourth displacement A1G to adjust to the second display orientation of the electronic sand table (a sequence frame image of the final display orientation), and the second display orientation includes a target point A2, which is the final target point after the target point A1 is moved by the third displacement and the fourth displacement of the first gesture. The changes in the electronic sand table as a whole can be explained by the above changes in the target point A2, which will not be repeated.

[0116] In some embodiments, if N is a positive number less than 1, the display position of the electronic sand table is adjusted according to the third displacement amount and the fourth displacement amount. The following takes the target point on the electronic sand table as an example to illustrate the adjustment process of the display position of the electronic sand table. Specifically, Figure 4As shown, when N is a positive number less than 1, assuming that the target point A1 moves in the first direction to F2, and the target point A1 moves in the second direction to S, the third displacement A1F2 (arc length) is smaller than the first displacement A1M1, that is, the displacement A1F2 (arc length) of the electronic sandbox in the first direction is smaller than the first displacement A1M1 of the first gesture in the first direction, and the fourth displacement A1S is larger than the second displacement A1D, that is, the displacement A1S of the electronic sandbox in the second direction is smaller than the second displacement A1D of the first gesture in the second direction. The display orientation of the electronic sandbox is adjusted according to the third displacement A1F2 and the fourth displacement A1S. The specific adjustment process is as follows: Figure 8 As shown, Figure 8 Another schematic diagram of adjusting the display orientation of an electronic sand table according to a third displacement and a fourth displacement is provided for an embodiment of the present application. In the first display orientation of the electronic sand table (a sequence frame image of the initial display orientation), the first display orientation of the electronic sand table includes a target point A1, and the target point A1 is adjusted according to the third displacement A1F2 and the fourth displacement A1S, and displayed as the second display orientation of the electronic sand table (a sequence frame image of the final display orientation). The second display orientation includes a target point A3, which is the final target point after the target point A1 is moved by the third displacement and the fourth displacement of the first gesture. The changes in the electronic sand table as a whole can be explained by the above changes in the target point A3, and no further details are given.

[0117] It should be noted that in Figure 7 or Figure 8 In the picture shown, the first display orientation of the electronic sandbox is a sequence frame in the initial state, and the second display orientation of the electronic sandbox is a sequence frame in the final state. When switching from the initial state to the final state, multiple sequence frames are also transformed, and the multiple sequence frames include multiple sequence frames in the first direction and multiple sequence frames in the second direction. For example, the transformation process includes 20 sequence frames in the first direction and 45 sequence frames in the second direction. The speed of switching sequence frames is set. For example, the number of sequence frames in 1 second in the first direction is 10 frames, and the number of sequence frames in 1 second in the second direction is 15 frames, which indicates that the speed of switching multiple sequence frames in the first direction is 10 frames in 1 second, and the speed of switching multiple sequence frames in the second direction is 15 frames in 1 second. The switching time in the first direction is 2 seconds, and the switching time in the second direction is 3 seconds. It should be noted that the sequence frame transformation in the first direction and the sequence frame transformation in the second direction do not affect each other, that is, while the sequence frames in the first direction are transformed, the sequence frames in the second direction can also be transformed.

[0118] In some embodiments, second information of a second gesture for the electronic sand table is collected, and the second gesture is used to characterize the remaining gestures except the first gesture; the second information of the second gesture is decomposed to obtain the fifth displacement of the gesture in the first direction and the sixth displacement in the second direction, and the seventh displacement is determined according to the fifth displacement and the eighth displacement is determined according to the sixth displacement, the seventh displacement is N times the fifth displacement, and the eighth displacement is N times the sixth displacement. After adjusting the display orientation of the electronic sand table according to the third displacement and the fourth displacement corresponding to the first gesture, the display orientation of the electronic sand table can also be adjusted according to the seventh displacement and the eighth displacement.

[0119] It should be noted that after adjusting the electronic sand table according to the first information of the first gesture, if there is the second information of the second gesture, the display orientation of the electronic sand table can continue to be adjusted according to the second information of the second gesture; while adjusting the electronic sand table according to the first information of the first gesture, if there is the second information of the second gesture, the display orientation of the electronic sand table can be adjusted according to the second information of the second gesture at the same time. It can be understood that the first information of the first gesture and the second information of the second gesture do not affect each other. In the embodiment of the present application, the case where the second gesture exists after the first information of the first gesture is selected for analysis.

[0120] In some embodiments, the second information of the second gesture for the electronic sand table is collected, and the influence of the second information on the electronic sand table is interpreted using the target reference point on the electronic sand table. Specifically, assuming that the user slides in the air to make a sliding gesture for the electronic sand table on the screen 103, the second gesture of the sliding gesture is input into the sequence frame state machine 104, and the second information of the second gesture is obtained, such as Fig. 9 As shown, Fig. 9 A schematic diagram of a scenario in which the second information of a second gesture acts on a target reference point provided in an embodiment of the present application. Target point A1 is selected as the target reference point, and the force of the sliding gesture on the electronic sand table is explained through target point A1. The fifth displacement of the second information PT of the second gesture is PT, and the sixth displacement is 0 (no displacement in the vertical direction). The seventh displacement of the electronic sand table in the first direction is obtained according to the fifth displacement PT, and the eighth displacement of the electronic sand table in the second direction is obtained according to the sixth displacement (displacement value is 0) (corresponding to 0), and the target point A1 on the electronic sand table is adjusted according to the seventh displacement and the eighth displacement. After receiving the second information of the second gesture, the electronic sand table will produce a moving effect, that is, the target point A1 in the electronic sand table will produce a moving effect after receiving the second information. It should be noted that in the embodiment of the present application, the movement of the electronic sand table by the gesture is explained through target point A1.

[0121] Specifically, Fig.10 As shown, Fig.10A schematic diagram of a scene for adjusting an electronic sand table according to the second information of a second gesture provided in an embodiment of the present application. When N is a positive number greater than 1, the third displacement corresponding to the first information of the first gesture causes the target point A1 to shift to F1 in the first direction, that is, the third displacement is A1F1. At this time, the fifth displacement corresponding to the second information PT of the second gesture is PT, and the arc length of F1 continuing to move along the first direction (the seventh displacement) is N times the fifth displacement PT, for example, moving to F3, which can be understood as the seventh displacement of the electronic sand table corresponding to the fifth displacement PT is F1F3. The specific process of obtaining the seventh displacement of the electronic sand table in the first direction according to the fifth displacement PT in the second information PT of the second gesture is consistent with the step of obtaining the third displacement and the fourth displacement of the electronic sand table through the first displacement and the second displacement of the first information of the first gesture, and will not be repeated. Since the sixth displacement corresponding to the second information PT of the second gesture is 0, the eighth displacement of the second information of the second gesture on the electronic sand table is also 0, that is, the second gesture does not change in the vertical direction. After the first information PT of the first gesture is applied, the target point A1 is adjusted to the target point A2 according to the third displacement and the fourth displacement of the first information of the first gesture. After the second information PT of the second gesture is applied, the target point A1 is adjusted to the target point A4 according to the seventh displacement and the eighth displacement of the second information of the second gesture. At this time, the target point A4 is the final display position of the electronic sandbox.

[0122] The above process is to adjust the display orientation of the electronic sand table according to the user's first gesture or second gesture on the sand table, so that the electronic sand table can be rotated at different heights and different angles, and realize the three-dimensional effect of viewing the electronic sand table at different angles at different heights on the two-dimensional electronic sand table screen. In other applications, the user does not perform gesture sliding on the electronic sand table, but sets the starting point and the end point of the electronic sand table, finds the shortest sand table rotation path, and the electronic sand table automatically rotates from the starting point to the end point in the form of a sequence frame, realizing the automatic switching visual effect of the electronic sand table, which is specifically described as follows:

[0123] In some embodiments, the electronic sandbox is divided into multiple blocks in a plane area in a first direction; multiple moving points on the electronic sandbox are selected based on the multiple blocks, wherein the multiple moving points are the overlapping points of the electronic sandbox and the multiple blocks; a pathfinding evaluation value is calculated for each of the multiple moving points, wherein the pathfinding evaluation value is used to represent the sum of the actual moving distance and the estimated distance; the following steps are looped until the new moving point of the target reference point is the target moving point: the moving point with the smallest pathfinding evaluation value is selected as the new moving point of the target reference point, and the mobile point is moved toward the new moving point.

[0124] It should be noted that, since the electronic sandbox in the horizontal plane where the first direction is located rotates around the center, the rotation direction can be clockwise or counterclockwise, so it is necessary to calculate the path finding evaluation value of the moving point and select the path corresponding to the smallest path finding evaluation value for automatic movement; since the electronic sandbox in the vertical plane where the second direction is located is placed vertically and moves upward or downward, and the moving distance is a straight-line distance, in the embodiment of the present application, the path corresponding to the smallest evaluation value in the second direction can be understood as vertical upward or downward movement, and therefore no calculation is required.

[0125] Specifically, pathfinding is performed in the first direction. Fig.11 As shown, Fig.11 A schematic diagram of a scene about moving points in the pathfinding process provided for an embodiment of the present application. The final target point of target point A1 is A5, target point A1 is the target point in the initial state, target point A5 is the target point finally set to move in the plane where the first direction is located, the displacement in the second direction (vertical) is 0, and the pathfinding evaluation value is only used in the first direction to calculate the optimal direction of movement. The specific analysis is as follows: the electronic sandbox is divided into multiple blocks in the plane area in the first direction, and multiple moving points are the coincidence points of the electronic sandbox and the multiple blocks as multiple moving points on the electronic sandbox, and the pathfinding evaluation F=G+H of each of the multiple moving points is calculated, where G represents the actual moving distance of the moving point, and the actual moving distance can be understood as the number of square grids corresponding to the movement of the block, and H represents the estimated distance of the moving point. The estimated distance is usually expressed in Manhattan length, which is the sum of the number of square grids in the horizontal and vertical directions of the distance between the initial target point and the moving point, such as Fig.11 As shown, if the target point A1 moves along the second routing direction (counterclockwise rotation), the routing evaluation value of the J1 moving point is F=G+H=2+2=4, the routing evaluation value of the J2 moving point is F=G+H=12+7=19, the routing evaluation value of the J3 moving point is F=G+H=12+7=19, and so on. The routing evaluation value of the J4 moving point (target point A5) is F=G+H=31+6=37. The specific process will not be repeated here. If the target point A1 moves along the first routing direction (clockwise rotation), the R1 moving point routing evaluation value F=G+H=1+1=2, the R2 moving point routing evaluation value F=G+H=2+2=4, the R3 moving point routing evaluation value F=G+H=3+3=6, the R4 moving point routing evaluation value F=G+H=4+4=8, the R5 moving point routing evaluation value F=G+H=5+5=10, the R6 moving point routing evaluation value F=G+H=6+5=11, and the R7 moving point (target point A5) routing evaluation value F=G+H=8+6=14.

[0126] It can be understood that when the target point A1 selects a new moving point, the J1 moving point path finding evaluation value F=G+H=2+2=4 is compared with the R1 moving point path finding evaluation value F=G+H=1+1=2, and the R1 moving point with a smaller path finding evaluation value is selected as the new moving point, that is, the first path finding direction (clockwise direction) is used as the moving direction of the target point A1. The first path finding direction (counterclockwise rotation) is obtained as the optimal solution through the calculation of the path finding evaluation value. Therefore, when the target point A1 is set to automatically reach the final target point A5, the sand table is set to automatically rotate clockwise.

[0127] like Fig.12 As shown, Fig.12 A schematic diagram of a scenario for automatically adjusting the display direction of an electronic sand table according to a path finding evaluation value provided in an embodiment of the present application. In the above hypothetical situation, it is assumed that the displacement in the second direction (vertical) is 0, and the path finding evaluation value is used only to move the target point A1 in the first direction, the target point A1 is the target point in the initial state, and the target point A5 is the target point finally set to move in the plane where the first direction is located. According to the minimum path finding evaluation value, the target point A1 reaches the target point A5 in the first path finding direction (clockwise rotation), and the electronic sand table automatically rotates from the starting point to the end point in the form of a sequence frame, realizing the automatic switching visual effect of the electronic sand table.

[0128] Specifically, Fig.12 As shown, if the final target point of target point A1 is A6. Assuming that in the process of the electronic sandbox automatically rotating from the starting point to the end point in the form of a sequence frame, it automatically moves in the first direction and the second direction, then the calculation of the path finding evaluation value in the first direction and the calculation of the path finding evaluation value in the second direction do not affect each other. The calculation of the path finding evaluation value in the first direction will not be repeated. Fig.12 As shown, in the plane where the first direction is located, the target point A1 is the target point in the initial state, and the target point A5 is the target point finally set to move in the plane where the first direction is located. Assuming that the displacement in the second direction (vertical) is A1G, after or at the same time as the target point A1 moves to the target point A5 in the first path-finding direction, it is necessary to automatically rise vertically A1G in the second direction to reach the target point A6, that is, the target point A6 is the final target point.

[0129] In some embodiments, third information of a third gesture for an electronic sandbox is collected, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold; and a target reference point is updated to a point close to a center position of the electronic sandbox, wherein a greater sliding distance of the third information of the third gesture is, a closer the updated target reference point is to the center position of the electronic sandbox.

[0130] It should be noted that when the target reference point is selected as an edge point, if the shape of the electronic sandbox is too large, the user's gesture will be large and the electronic sandbox will move very little. At this time, the user takes a third gesture for the electronic sandbox, and the similarity between the motion trajectory of the third gesture and the motion trajectory of the first gesture is higher than the preset threshold, indicating that the user continues to enhance the third gesture on the basis of the first gesture, so that the electronic sandbox continues to move in the moving direction of the electronic sandbox corresponding to the first gesture.

[0131] Understandably, this adjustment method indicates that the movement amplitude of the electronic sand table corresponding to the first gesture may be too small, and a third gesture needs to be added to make the electronic sand table continue to move. Then, when the third displacement amount and the fourth displacement amount are equal, the target reference point is updated to a point close to the center position of the electronic sand table. Compared with the target reference point being an edge point, the movement amplitude of the electronic sand table is larger at this time. After adjusting the target reference point, the user may not need to add the third gesture, which improves the user experience and the efficiency of rotating the electronic sand table.

[0132] It can be understood that the method of obtaining the third information of the third gesture is consistent with the method of obtaining the first information of the first gesture and the second information of the second gesture, and the embodiments of the present application will not be described in detail.

[0133] It can be understood that since the electronic sandbox rotates around the center of the electronic sandbox in the first direction and rises or falls vertically in the second direction, the selection of the target reference point only affects the movement in the first direction, and the embodiment of the present application analyzes the first direction.

[0134] Specifically, Figure 3 As shown, the target point A1 (edge ​​point) is selected as the target reference point. Under the effect of the first information A1B of the first gesture, for example Figure 7 As shown in , if N is a positive number greater than 1, the third displacement of the target point A1 in the first direction is A1F1 (arc). Fig.13 As shown, Fig.13A schematic diagram of a scenario for adjusting the position of a target reference point according to a third gesture provided in an embodiment of the present application. Within the preset threshold range of the first gesture, if the third information KB of the third gesture exists at this time, it can be understood that the similarity between the motion trajectory of the third gesture and the motion trajectory of the first gesture is higher than the preset threshold, indicating that the motion trajectory of the third gesture is within the preset threshold range corresponding to the motion trajectory of the first gesture. For example, it can be understood that the first gesture selects edge point A1 as the target reference point. At this time, the movement amplitude of the electronic sand table is too small, and the user adds a third gesture in the direction within the preset threshold, indicating that the user adds the third gesture on the basis of the movement amplitude of the electronic sand table corresponding to the first gesture, so that the electronic sand table continues to increase the movement amplitude. Therefore, the solution can be to adjust the target point A1 to the target point A7, so that the movement amplitude of the electronic sand table corresponding to the first gesture is large, so there is no need to add a third gesture to make the movement amplitude of the electronic sand table large, and the specific description is as follows:

[0135] Specifically, at this time, the target reference point is adjusted from target point A1 (edge ​​point) to target point A7. The displacement of target point A7 in the first direction is also A1F1 (arc). Therefore, target point A7 is selected as the target reference point. In the first direction, target point A7 will move to Fig.13 The length of F4, i.e. A1F1 (arc), is equal to the length of A7F4 (arc), but with target point A7 as the target reference point, the movement range of the electronic sandbox is larger at this time.

[0136] For example, taking target point A1 as the reference point, the outermost circle of the electronic sand table in the first direction moves to point F1, and taking target point A7 as the reference point, the outermost circle of the electronic sand table in the first direction moves to point F5, and the movement range of the electronic sand table is significantly increased.

[0137] It should be noted that the greater the sliding distance of the third information of the third gesture, the closer the updated target reference point is to the center of the electronic sand table. It can be understood that the greater the sliding distance of the third gesture, the greater the amplitude of the electronic sand table that needs to be moved on the basis of the movement of the electronic sand table corresponding to the first gesture. Therefore, the closer the set target reference point is to the center, the greater the amplitude of the electronic sand table that can move when the third displacement and the fourth displacement are equal.

[0138] exist Figure 2In the method shown, by collecting information about the user's gesture, the third displacement of the electronic sand table in the first direction (horizontal direction) and the fourth displacement in the second direction (vertical direction) are obtained according to the first information of the first gesture, so that the electronic sand table can be moved at different vertical heights and rotated in the horizontal direction. Instead of using a physical three-dimensional sand table to achieve the three-dimensional effect of viewing the sand table at different angles and heights, this method can achieve the three-dimensional effect of viewing the electronic sand table at different angles at different heights on a two-dimensional electronic sand table screen.

[0139] It should be noted that the electronic sand table is displayed in the form of sequence frames during the change process. The sequence frames represent the images of the video frame by frame during the activity of the electronic sand table. The stuttering phenomenon caused by reading files and decoding during video display is smoother than using sequence frames (pictures) to display the changes of the electronic sand table. In other words, the display orientation (adjusted display orientation) of the electronic sand table is adjusted according to the third displacement and the fourth displacement, and the display orientation of the electronic sand table is changed from the initial display orientation of the electronic sand table to the adjusted display orientation of the electronic sand table, and the change process of the electronic sand table is described using sequence frames (pictures).

[0140] It should be noted that the third displacement of the electronic sand table in the first direction (horizontal direction) is the displacement of the electronic sand table rotating around the center of the electronic sand table. It can be understood that if the electronic sand table is circular, the third displacement is the length of the arc rotating around the center of the electronic sand table; the fourth displacement of the electronic sand table in the second direction (vertical direction) is the height of the electronic sand table rising or falling in the vertical direction.

[0141] At the same time, by determining a first preset value in the first direction (horizontal direction) and a second preset value in the second direction (vertical direction), the first displacement that is less than the first preset value and the second displacement that is less than the second preset value are screened out. That is, if the first displacement decomposed by the information of the user's gesture in the first direction is less than the first preset value, indicating that the first displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the first direction, then the first displacement is removed (no displacement or the displacement is regarded as 0); if the second displacement decomposed by the information of the user's gesture in the second direction is less than the second preset value, indicating that the second displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the second direction, then the second displacement is removed (no displacement or the displacement is regarded as 0). This method can more accurately obtain the sliding intention of the user's gesture information, remove the sliding deviation caused by the unstable user gesture or other situations, more accurately analyze the displacement of the user's gesture information in the first direction and the second direction, and improve the accuracy and efficiency of controlling the electronic sand table.

[0142] A method for realizing an electronic sandbox using sequence frames is introduced above, and a device for the method is introduced below.

[0143] like Fig.14 As shown, Fig.14 A structural diagram of a device 1400 for implementing a method of an electronic sand table using a sequence frame provided in an embodiment of the present application, the device 1400 includes: a first acquisition unit 1401, a first decomposition unit 1402, a first determination unit 1403, and a first adjustment unit 1404. The device 1400 can be the above-mentioned device or a device or module in the device. The above-mentioned units (or modules) are functional modules divided according to functions. In a specific implementation, some functional blocks may be subdivided into more small functional modules, and some functional modules may also be combined into one functional module. However, regardless of whether these functional modules are subdivided or combined, the general process executed in the process of viewing the electronic sand table at different heights using a sequence frame so that the electronic sand table has the visual effect of a three-dimensional digital sand table is the same. Generally, each functional module corresponds to its own program code (i.e., a computer program stored in the memory of the device). When the program codes corresponding to each of these functional modules are run on the processor, the functional module executes the corresponding process to realize the corresponding function. The description of each unit is as follows:

[0144] The first collecting unit 1401 is used to collect first information of a first gesture for the electronic sandbox;

[0145] A first decomposition unit 1402, configured to decompose the first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction;

[0146] A first determining unit 1403, configured to determine a third displacement amount according to the first displacement amount and to determine a fourth displacement amount according to the second displacement amount, wherein the third displacement amount is N times of the first displacement amount and the fourth displacement amount is N times of the second displacement amount;

[0147] The first adjustment unit 1404 is configured to adjust the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount.

[0148] It can be seen that by collecting the information of the user's gesture, the third displacement of the electronic sand table in the first direction (horizontal direction) and the fourth displacement in the second direction (vertical direction) are obtained according to the first information of the first gesture, so that the electronic sand table can be moved at different vertical heights and rotated in the horizontal direction. Instead of using a physical three-dimensional sand table to achieve the three-dimensional effect of viewing the sand table at different angles and heights, this method can achieve the three-dimensional effect of viewing the electronic sand table at different angles at different heights on the two-dimensional electronic sand table screen, thereby improving the user's experience and efficiency in observing the electronic sand table and saving costs at the same time.

[0149] It should be noted that the electronic sand table is displayed in the form of sequence frames during the change process. The sequence frames represent the images of the video frame by frame during the activity of the electronic sand table. The stuttering phenomenon caused by reading files and decoding during video display is smoother than using sequence frames (pictures) to display the changes of the electronic sand table. In other words, the display orientation (adjusted display orientation) of the electronic sand table is adjusted according to the third displacement and the fourth displacement, and the display orientation of the electronic sand table is changed from the initial display orientation of the electronic sand table to the adjusted display orientation of the electronic sand table, and the change process of the electronic sand table is described using sequence frames (pictures).

[0150] It should be noted that the third displacement of the electronic sand table in the first direction (horizontal direction) is the displacement of the electronic sand table rotating around the center of the electronic sand table. It can be understood that if the electronic sand table is circular, the third displacement is the length of the arc rotating around the center of the electronic sand table; the fourth displacement of the electronic sand table in the second direction (vertical direction) is the height of the electronic sand table rising or falling in the vertical direction.

[0151] In a possible implementation, the device 1400 further includes:

[0152] A second determining unit is configured to determine a first preset value in the first direction and a second preset value in the second direction after decomposing the first information of the first gesture to obtain a first displacement amount in the first direction and a second displacement amount in the second direction of the gesture, and before adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount, wherein the first preset value is used to represent a minimum displacement amount in the first direction by which the display orientation of the electronic sand table can be adjusted, and the second preset value is used to represent a minimum displacement amount in the second direction by which the display orientation of the electronic sand table can be adjusted;

[0153] A judgment unit is used to execute the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement if the first displacement reaches the first preset value and the second displacement reaches the second preset value.

[0154] It can be seen that by determining the first preset value in the first direction (horizontal direction) and the second preset value in the second direction (vertical direction), the first displacement less than the first preset value and the second displacement less than the second preset value are screened out. That is, if the first displacement decomposed by the information of the user's gesture in the first direction is less than the first preset value, indicating that the first displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the first direction, then the first displacement is removed (no displacement or the displacement is regarded as 0); if the second displacement decomposed by the information of the user's gesture in the second direction is less than the second preset value, indicating that the second displacement is less than the minimum displacement that can adjust the display orientation of the electronic sand table in the second direction, then the second displacement is removed (no displacement or the displacement is regarded as 0). This method can more accurately obtain the sliding intention of the user's gesture information, remove the sliding deviation caused by the unstable user gesture or other situations, more accurately analyze the displacement of the user's gesture information in the first direction and the second direction, and improve the accuracy and efficiency of controlling the electronic sand table.

[0155] In a possible implementation, the apparatus 1400 further includes:

[0156] A second collecting unit, used to collect second information of a second gesture for the electronic sandbox, where the second gesture is used to represent other gestures except the first gesture;

[0157] a second decomposition unit, configured to decompose the second information of the second gesture to obtain a fifth displacement amount of the gesture in the first direction and a sixth displacement amount in the second direction;

[0158] determining a seventh displacement amount according to the fifth displacement amount and determining an eighth displacement amount according to the sixth displacement amount, wherein the seventh displacement amount is N times the fifth displacement amount and the eighth displacement amount is N times the sixth displacement amount;

[0159] After adjusting the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount, the device 1300 further includes:

[0160] The second adjustment unit is configured to adjust the display orientation of the electronic sand table according to the seventh displacement amount and the eighth displacement amount after adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount.

[0161] It can be seen that the first information corresponding to the user's first gesture on the electronic sand table makes the electronic sand table move. If the user slides the second gesture on the electronic sand table again, the second information of the second gesture can also make the electronic sand table move. That is, while or after adjusting the display position of the electronic sand table by the third displacement and the fourth displacement corresponding to the first information, the display position of the electronic sand table can also be adjusted by the fifth displacement and the sixth displacement corresponding to the second information. In other words, the final display position of the electronic sand table is the result of the comprehensive adjustment of multiple information corresponding to multiple gestures. This method can comprehensively consider the impact of multiple gesture information on the electronic sand table, making the angle and height of the electronic sand table more accurate, and improving the user's experience of using multiple gestures to adjust the electronic sand table.

[0162] In a possible implementation manner, the electronic sandbox includes a target reference point, a displacement of the target reference point in a first direction is the third displacement amount, and a displacement of the target reference point in a second direction is the fourth displacement amount.

[0163] It can be seen that when the display orientation of the electronic sand table is adjusted according to the information corresponding to the user's gesture, the entire electronic sand table will move in the first direction or the second direction, and a target reference point on the electronic sand table is selected to explain the movement of the electronic sand table in the first direction or the second direction.

[0164] In another optional solution of the first aspect, the target reference point is an edge point of the electronic sand table. It should be noted that, when the third displacement amount and the fourth displacement amount are equal in magnitude, if the target reference point is closer to the edge of the electronic sand table, the corresponding movement amplitude of the electronic sand table is smaller; if the target reference point is closer to the center of the electronic sand table, the corresponding movement amplitude of the electronic sand table is larger. For electronic sand tables of different shapes and sizes, the electronic sand table with a large shape rotates less than the electronic sand table with a small shape at the same distance. Therefore, the movement distance corresponding to the outer edge point of the electronic sand table can usually better reflect the rotation amplitude corresponding to the size of the electronic sand table. In other words, selecting the edge point as the target reference point can improve the accuracy of rotating the electronic sand table.

[0165] In an optional solution, the device 1400 further includes:

[0166] A third collecting unit is used to collect third information of a third gesture for the electronic sandbox, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold;

[0167] An updating unit is used to update the target reference point to a point close to the center position of the electronic sandbox, wherein the larger the sliding distance of the third information of the third gesture is, the closer the updated target reference point is to the center position of the electronic sandbox.

[0168] It can be seen that when the target reference point is selected as an edge point, if the shape of the electronic sandbox is too large, the electronic sandbox will move a small amplitude when the user's gesture amplitude is large. At this time, the user takes a third gesture for the electronic sandbox, and the similarity between the motion trajectory of the third gesture and the motion trajectory of the first gesture is higher than the preset threshold, indicating that the user continues to enhance the third gesture on the basis of the first gesture, so that the electronic sandbox continues to move in the direction of movement of the electronic sandbox corresponding to the first gesture. This adjustment method indicates that the movement amplitude of the electronic sandbox corresponding to the first gesture may be too small, and it is necessary to add a third gesture to make the electronic sandbox continue to move. At this time, the target reference point is updated to a point close to the center of the electronic sandbox. When the third displacement and the fourth displacement are equal, the movement amplitude of the electronic sandbox is larger than that of the target reference point being an edge point. After adjusting the target reference point, the user may not need to add a third gesture, which improves the user experience and the efficiency of rotating the electronic sandbox.

[0169] It should be noted that the greater the sliding distance of the third information of the third gesture, the closer the updated target reference point is to the center of the electronic sand table. It can be understood that the greater the sliding distance of the third gesture, the greater the amplitude of the electronic sand table that needs to be moved on the basis of the movement of the electronic sand table corresponding to the first gesture. Therefore, the closer the set target reference point is to the center, the greater the amplitude of the electronic sand table that can move when the third displacement and the fourth displacement are equal.

[0170] In a possible implementation, the apparatus 1400 further includes:

[0171] A first dividing unit, used for dividing the electronic sandbox into a plurality of blocks on a plane area in the first direction;

[0172] A third determining unit is used to select a plurality of moving points on the electronic sand table according to the plurality of blocks, wherein the plurality of moving points are overlapping points of the electronic sand table and the plurality of blocks;

[0173] A calculation unit, used to calculate a path finding evaluation value for each of the plurality of moving points, wherein the path finding evaluation value is used to represent the sum of an actual moving distance and an estimated distance;

[0174] The following steps are executed repeatedly until the new moving point of the target reference point is the target moving point:

[0175] The moving point with the smallest path-finding evaluation value is selected as a new moving point of the target reference point.

[0176] It can be seen that if the user needs to set the electronic sand table to automatically move from the initial state to the target moving state without making gestures, the pathfinding evaluation value of the moving point during the movement of the target point can be calculated according to the pathfinding algorithm, and the moving path corresponding to the moving point with the smallest pathfinding evaluation value (i.e., the sum of the actual moving distance and the estimated distance) is selected as the moving path for the electronic sand table to move to the target moving state. This method can move the electronic sand table from the initial state to the target moving state by the shortest path, thereby improving the efficiency of movement.

[0177] The present application also provides a computer-readable storage medium in which a computer program is stored. When the computer-readable storage medium is executed on a processor, Figure 2 The method flow is shown.

[0178] The embodiment of the present invention further provides a computer program product, which, when executed on a processor, implements Figure 2 The method flow is shown.

[0179] In summary, by implementing the embodiments of the present application, by collecting the information of the user's gesture, the third displacement of the electronic sandbox in the first direction (horizontal direction) and the fourth displacement in the second direction (vertical direction) are obtained according to the first information of the first gesture, so that the electronic sandbox can be moved at different vertical heights and rotated in the horizontal direction, instead of using a physical three-dimensional sandbox to achieve the three-dimensional effect of viewing the sandbox at different angles and heights. This method can achieve the three-dimensional effect of viewing the electronic sandbox at different angles at different heights on a two-dimensional electronic sandbox screen. A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be implemented by a computer program to the hardware related to the computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: various media that can store computer program codes, such as read-only storage memory ROM or random storage memory RAM, magnetic disk or optical disk.

Claims

1. A method for realizing an electronic sandbox using sequence frames, characterized in that: include: Collecting first information of a first gesture for the electronic sandbox; Decomposing the first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction; Determine a third displacement amount according to the first displacement amount and determine a fourth displacement amount according to the second displacement amount, wherein the third displacement amount is N times of the first displacement amount and the fourth displacement amount is N times of the second displacement amount; adjusting the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount; The electronic sand table includes a target reference point, the displacement of the target reference point in the first direction is the third displacement amount, and the displacement of the target reference point in the second direction is the fourth displacement amount; Collecting third information of a third gesture for the electronic sandbox, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold; The target reference point is updated to a point close to the center position of the electronic sandbox, wherein the larger the sliding distance of the third information of the third gesture is, the closer the updated target reference point is to the center position of the electronic sandbox.

2. The method according to claim 1, characterized in that After decomposing the first information of the first gesture to obtain a first displacement amount of the gesture in the first direction and a second displacement amount of the gesture in the second direction, and before adjusting the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount, the method further includes: Determine a first preset value in a first direction, and determine a second preset value in a second direction, wherein the first preset value is used to represent a minimum displacement amount in the first direction that can adjust the display orientation of the electronic sand table, and the second preset value is used to represent a minimum displacement amount in the second direction that can adjust the display orientation of the electronic sand table; If the first displacement reaches the first preset value, and the second displacement reaches the second preset value, the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement is performed.

3. The method according to claim 2, characterized in that The method further comprises: collecting second information of a second gesture for the electronic sandbox, where the second gesture is a gesture other than the first gesture; Decomposing the second information of the second gesture to obtain a fifth displacement amount of the gesture in the first direction and a sixth displacement amount in the second direction; determining a seventh displacement amount according to the fifth displacement amount and determining an eighth displacement amount according to the sixth displacement amount, wherein the seventh displacement amount is N times the fifth displacement amount and the eighth displacement amount is N times the sixth displacement amount; After adjusting the display orientation of the electronic sandbox according to the third displacement amount and the fourth displacement amount, the method further includes: The display orientation of the electronic sandbox is adjusted according to the seventh displacement amount and the eighth displacement amount.

4. The method according to claim 1, characterized in that: The target reference point is an edge point of the electronic sandbox.

5. A device for realizing an electronic sandbox using sequence frames, characterized in that: include: A first collecting unit, used to collect first information of a first gesture for the electronic sandbox; a first decomposition unit, configured to decompose the first information of the first gesture to obtain a first displacement amount of the first gesture in the first direction and a second displacement amount of the first gesture in the second direction; a first determining unit, configured to determine a third displacement amount according to the first displacement amount and to determine a fourth displacement amount according to the second displacement amount, wherein the third displacement amount is N times of the first displacement amount and the fourth displacement amount is N times of the second displacement amount; A first adjustment unit, configured to adjust a display position of the electronic sandbox according to the third displacement amount and the fourth displacement amount; The electronic sand table includes a target reference point, the displacement of the target reference point in the first direction is the third displacement amount, and the displacement of the target reference point in the second direction is the fourth displacement amount; A third collecting unit is used to collect third information of a third gesture for the electronic sandbox, wherein a similarity between a motion trajectory of the third gesture and a motion trajectory of the first gesture is higher than a preset threshold; An updating unit is used to update the target reference point to a point close to the center position of the electronic sandbox, wherein the larger the sliding distance of the third information of the third gesture is, the closer the updated target reference point is to the center position of the electronic sandbox.

6. The device according to claim 5, characterized in that The device also includes: A second determining unit is configured to determine a first preset value in the first direction and a second preset value in the second direction after decomposing the first information of the first gesture to obtain a first displacement amount in the first direction and a second displacement amount in the second direction of the gesture, and before adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount, wherein the first preset value is used to represent a minimum displacement amount in the first direction by which the display orientation of the electronic sand table can be adjusted, and the second preset value is used to represent a minimum displacement amount in the second direction by which the display orientation of the electronic sand table can be adjusted; A judgment unit is used to execute the step of adjusting the display orientation of the electronic sandbox according to the third displacement and the fourth displacement if the first displacement reaches the first preset value and the second displacement reaches the second preset value.

7. The device according to claim 6, characterized in that The device also includes: A second collecting unit, used to collect second information of a second gesture for the electronic sandbox, where the second gesture is used to represent other gestures except the first gesture; a second decomposition unit, configured to decompose the second information of the second gesture to obtain a fifth displacement amount of the gesture in the first direction and a sixth displacement amount in the second direction; a second determining unit, configured to determine a seventh displacement amount according to the fifth displacement amount and to determine an eighth displacement amount according to the sixth displacement amount, wherein the seventh displacement amount is N times the fifth displacement amount and the eighth displacement amount is N times the sixth displacement amount; The second adjustment unit is configured to adjust the display orientation of the electronic sand table according to the seventh displacement amount and the eighth displacement amount after adjusting the display orientation of the electronic sand table according to the third displacement amount and the fourth displacement amount.

8. The device according to claim 5, characterized in that The target reference point is an edge point of the electronic sandbox.

9. An electronic device, characterized in that: The method comprises a transceiver, a processor and a memory, wherein the memory is used to store a computer program, and the processor calls the computer program to execute the method according to any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 4 is performed.

Images