Method and related device for simulating interaction of mobile equipment

Abstract

The embodiment of the invention discloses a method for simulating interaction of mobile equipment and a related device, and provides a simulator capable of simulating the running environment of the mobile equipment and executing a complex interaction function, and after an application program running through the simulator is displayed, the target operation for the application program is obtained in response to the target operation. And generating an analog signal according to the target operation, and controlling an application program operated through the simulator to execute an interaction function corresponding to the analog signal. Therefore, according to the simulator provided by the invention, the signal collected by the sensor is simulated and generated based on the target operation belonging to the preset operation through the corresponding relationship between the preset operation and the analog signal, and the complex interactive operation is converted into logic of an application level, so that the hardware limitation between mobile equipment and non-mobile equipment is broken through; a complex interaction function is realized, the interaction limitation of the simulator is broken, the hardware dependence is reduced, the user experience is improved, and the development and test efficiency of the simulator is also improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method and related apparatus for simulating mobile device interaction. Background Art

[0002] As technology develops and user needs change, the same application will be developed for multiple devices. For example, the same application can be used not only on mobile devices such as smartphones, but also on non-mobile devices such as desktop computers.

[0003] However, in the related art, due to the limitations of technology, cost and other factors, some applications can only be used in mobile devices and cannot be used in non-mobile devices. Moreover, even if these applications can be used in non-mobile devices through simulators developed by third parties, the hardware differences between mobile devices and non-mobile devices will lead to a poor user experience. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a method and related apparatus for simulating mobile device interaction, which are used to solve the problem of poor user experience due to hardware differences between mobile devices and non-mobile devices.

[0005] The embodiments of the present application disclose the following technical solutions:

[0006] In one aspect, an embodiment of the present application provides a method for simulating mobile device interaction, the method comprising:

[0007] Displaying an application program running through a simulator, wherein the simulator is used to simulate an operating environment of a mobile device;

[0008] In response to obtaining a target operation for the application, generating a simulation signal according to the target operation, the simulation signal is used to simulate a signal acquired by a sensor in the mobile device, the target operation being an operation matching a preset operation;

[0009] The application is controlled to execute an interactive function corresponding to the analog signal.

[0010] On the other hand, an embodiment of the present application provides a device for simulating mobile device interaction, the device comprising: a display unit, a generation unit, and a control unit;

[0011] The display unit is used to display the application program running through the simulator, and the simulator is used to simulate the running environment of the mobile device;

[0012] The generating unit is configured to generate a simulation signal according to the target operation in response to acquiring the target operation for the application, wherein the simulation signal is used to simulate a signal acquired based on a sensor in the mobile device, and the target operation is an operation matching a preset operation;

[0013] The control unit is used to control the application to execute the interactive function corresponding to the analog signal.

[0014] On the other hand, an embodiment of the present application provides a computer device, the computer device comprising a processor and a memory:

[0015] The memory is used to store a computer program and transmit the computer program to the processor;

[0016] The processor is configured to execute the method described in the above aspects according to the instructions in the computer program.

[0017] On the other hand, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the method described in the above aspects.

[0018] On the other hand, an embodiment of the present application provides a computer program product including a computer program, which, when executed on a computer device, enables the computer device to execute the method described in the above aspects.

[0019] It can be seen from the above technical solution that the present application provides a new simulator, which can not only simulate the operating environment of a mobile device, so that the application used in the mobile device can be used in a non-mobile device, but also the simulator can perform complex interactive functions, that is, by establishing a correspondence between a preset operation (i.e., a preset operation) and a simulated signal, it can generate a signal for simulating the acquisition of a sensor in a mobile device based on the preset operation, i.e., a simulated signal, so as to respond to the acquisition of a target operation for the application, the target operation is an operation matching the preset operation, so as to determine the simulated signal corresponding to the target operation according to the correspondence between the preset operation and the simulated signal, and control the application running through the simulator to perform the interactive function corresponding to the simulated signal. In other words, the simulator provided by the present application, through the correspondence between the preset operation and the simulated signal, can simulate and generate a signal collected by the sensor based on the target operation, convert the complex interactive operation into the logic at the application level, thereby breaking through the hardware limitations between mobile devices and non-mobile devices, realizing complex interactive functions, breaking the limitations of simulator interaction, reducing hardware dependence, not only improving the user experience, but also improving the development and testing efficiency of the simulator. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 A schematic diagram of an application scenario of a method for simulating mobile device interaction provided in an embodiment of the present application;

[0022] Figure 2 A schematic diagram of an application in a mobile device provided in an embodiment of the present application;

[0023] Figure 3 A flowchart of a method for simulating mobile device interaction provided in an embodiment of the present application;

[0024] Figure 4 A schematic diagram of a simulator operation provided in an embodiment of the present application;

[0025] Figure 5 A schematic diagram of performing multiple displacement operations within a corresponding page of an application provided in an embodiment of the present application;

[0026] Figure 6 A schematic diagram of performing multiple displacement operations during the period when an application is selected provided by an embodiment of the present application;

[0027] Figure 7 A schematic diagram of a control application program performing multiple displacement operations provided in an embodiment of the present application;

[0028] Figure 8 A schematic diagram of drawing a preset rule symbol in a corresponding page of a simulator provided in an embodiment of the present application;

[0029] Fig. 9 A schematic diagram of drawing a preset rule symbol in a corresponding page of an application provided in an embodiment of the present application;

[0030] Fig.10 A schematic diagram of a simulator running an application provided in an embodiment of the present application;

[0031] Fig.11 A schematic diagram of a simulator provided in an embodiment of the present application running multiple applications at the same time;

[0032] Fig.12 A schematic diagram of a simulator provided in an embodiment of the present application running multiple applications at the same time;

[0033] Fig.13 A schematic diagram of multiple applications executing the same interactive function provided in an embodiment of the present application;

[0034] Fig.14 A schematic diagram of a plurality of applications performing different interactive functions provided in an embodiment of the present application;

[0035] Fig.15 A schematic diagram of a method for simulating mobile device interaction provided in an embodiment of the present application;

[0036] Fig.16 A schematic diagram of the structure of a device for simulating mobile device interaction provided in an embodiment of the present application;

[0037] Fig.17 A schematic diagram of the structure of a server provided in an embodiment of the present application;

[0038] Fig.18 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The embodiments of the present application are described below in conjunction with the accompanying drawings.

[0040] In the related technology, some applications can only be used in mobile devices and cannot be used in non-mobile devices. There are cross-platform interaction barriers and the following technical problems exist.

[0041] (1) With the development of technology and the change of user needs, sensors will be added to mobile devices. For example, mobile devices have built-in accelerometers and gyroscopes to sense the motion state and direction changes of mobile devices to achieve functions such as automatic screen rotation and game control. Among them, users are objects that use content applications, such as humans, robots, virtual humans, etc., and this application does not make specific restrictions on this.

[0042] That is to say, in applications suitable for mobile devices, many complex interactive functions (such as the "shake" interactive function and the tapping screenshot function, etc.) rely on the sensors in the mobile device, while most non-mobile devices generally do not have sensors. Therefore, even if the application is implemented in a non-mobile device through a simulator developed by a third party, due to hardware limitations, the non-mobile device cannot capture the signals generated by these complex interactive functions, and thus the complex interactive functions cannot be implemented in the non-mobile device, that is, the user cannot enjoy all the interactive experiences on the mobile device on the non-mobile device, and the experience is poor.

[0043] (2) For simulator testing, complex interactive functions such as the “shake” interactive function cannot be implemented in the simulator or are difficult to implement. During the testing process, each example needs to be tested (i.e., case by case). As a result, the development and testing efficiency of the simulator is low due to the complexity of software integration.

[0044] Based on this, the embodiments of the present application provide a method and related devices for simulating the interaction of mobile devices. The simulator provided by the present application can not only simulate the operating environment of the mobile device, but also perform complex interactive functions. Through the correspondence between the target operation and the simulated signal, it can simulate the generation of signals collected by sensors and convert complex interactive operations into application-level logic, thereby breaking through the hardware limitations between mobile devices and non-mobile devices, realizing complex interactive functions, breaking the limitations of simulator interaction, and reducing hardware dependence, which not only improves the user experience, but also improves the development and testing efficiency of the simulator.

[0045] The method for simulating mobile device interaction provided in the present application can be applied to computer devices capable of simulating mobile device interaction, such as terminal devices and servers.

[0046] Among them, the terminal devices can specifically be desktop computers, laptops, smart phones, tablets, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The smart car-mounted devices can be car-mounted navigation terminals and car-mounted computers, etc. The portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc., but are not limited to these.

[0047] The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server or server cluster that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. The terminal device and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in this application.

[0048] It is understandable that mobile devices and non-mobile devices are another way of classification, such as smartphones can be mobile devices, desktop computers and servers can be non-mobile devices, etc.

[0049] To facilitate understanding of the method for simulating mobile device interaction provided in an embodiment of the present application, the following uses a terminal device as an example in which the execution subject of the method for simulating mobile device interaction is an example to exemplarily introduce the application scenario of the method for simulating mobile device interaction.

[0050] See also Figure 1 , which is a schematic diagram of an application scenario of a method for simulating mobile device interaction provided by an embodiment of the present application. Figure 1 As shown, the application scenario includes a terminal device 110, which is a non-mobile device and is used to execute the method for simulating mobile device interaction provided in the present application.

[0051] The terminal device 110 is installed with a simulator provided in an embodiment of the present application. Two main functions of the simulator are described below.

[0052] Function 1: The simulator can simulate the operating environment of a mobile device, so that applications used in mobile devices can be used in non-mobile devices.

[0053] See also Figure 2 , which is a schematic diagram of an application in a mobile device provided by an embodiment of the present application. Figure 2 Some applications in may not be suitable for non-mobile devices, such as X applications.

[0054] In actual application, the user can open the simulator in the terminal device 110, which can simulate the operating environment of the mobile device so that the application suitable for the mobile device can be used in the non-mobile device, that is, in response to the opening operation of the simulator, multiple pending applications that can be run through the simulator are displayed, such as Figure 1 As shown in the figure (A), it is the page after the simulator is opened in the non-mobile device. The page corresponding to the simulator includes multiple pending applications that can be run, such as AA application, A game, etc., and also includes X application that cannot be run on the non-mobile device.

[0055] In response to a selection operation for an application from a plurality of pending applications, the application running through the simulator is displayed. Figure 1 As shown in the middle (B) figure, the user clicks the X application with the mouse, that is, after selecting the X application from multiple pending applications, a page for running the X application is displayed, and the X application is run through the simulator.

[0056] Function 2: The simulator can perform complex interactive functions.

[0057] In the simulator, a correspondence between a preset operation (hereinafter referred to as preset operation for convenience of explanation) and a simulation signal is established. The preset operation can be a pre-set operation, such as shaking the mouse, drawing a preset rule symbol, etc. The simulation signal is a signal collected by a sensor in a simulated mobile device, such as a shake signal.

[0058] In response to obtaining a target operation for an application, the target operation is an operation that matches a preset operation, so according to the correspondence between the preset operation and the simulation signal, a simulation signal corresponding to the target operation can be generated, thereby controlling the application running through the simulator to perform an interactive function corresponding to the simulation signal. Figure 1 As shown in Figure (C) in the figure, you can click the title bar with the mouse and then shake the mouse in the direction indicated by the arrow. This target operation is similar to the shake operation of a mobile device, thereby generating a corresponding shake signal, and controlling the X application to execute the interactive function corresponding to the shake signal according to the shake signal, that is, jumping to the setting page, as shown in Figure 1. Figure 1 As shown in Figure (D).

[0059] That is to say, the simulator provided in the present application can simulate the generation of signals collected by sensors through the correspondence between preset operations and simulated signals, and convert complex interactive operations into application-level logic, thereby breaking through the hardware limitations between mobile devices and non-mobile devices, and can realize complex interactive functions, breaking the limitations of simulator interaction, and reducing hardware dependence, which not only improves the user experience, but also improves the development and testing efficiency of the simulator.

[0060] The method for simulating mobile device interaction provided in the embodiment of the present application can be executed by the terminal device. However, in other embodiments of the present application, the server can also have similar functions as the terminal device, thereby executing the method for simulating mobile device interaction provided in the embodiment of the present application, or the terminal device and the server can jointly execute the method for simulating mobile device interaction provided in the embodiment of the present application, and this embodiment does not limit this.

[0061] The method for simulating mobile device interaction provided in this application can be applied to various scenarios, including but not limited to cloud games, live broadcasts, social networking, entertainment, etc. For example, by opening the corresponding application for live broadcasts through the simulator in a non-mobile device, live broadcasts can be recorded and shared, which is convenient and fast. For another example, when playing games with friends, the two people's mobile devices do not have the same operating system and cannot play together. At this time, the corresponding application of the game can be opened through the simulator in the non-mobile device, thereby realizing cross-platform games through non-mobile devices.

[0062] The simulator in the above scenario not only provides the convenience of simulating mobile devices for various non-mobile devices, but also performs the aforementioned complex interactive functions, further improving the user experience and making the simulator have a high user retention rate. For example, in the mobile application development and testing scenario, the functions of the mobile application can be tested through the simulator in the non-mobile device through target operations. For another example, in the cross-platform usage scenario of mobile applications, users can use applications suitable for mobile devices in non-mobile devices through similar operations. For another example, in the desktop scenario of mobile applications, users can set favorite preset operations for commonly used mobile applications (i.e., applications suitable for mobile devices), optimize the desktop layout of non-mobile devices, and improve operating efficiency.

[0063] It should be noted that the above application scenarios are only examples, and the method for simulating mobile device interaction provided in this embodiment can also be applied to other scenarios, which are not limited here.

[0064] A method for simulating mobile device interaction provided by the present application is described in detail below through a method embodiment.

[0065] See also Figure 3 , which is a flow chart of a method for simulating mobile device interaction provided in an embodiment of the present application. For ease of description, the following embodiments are still introduced by taking the execution subject of the method for simulating mobile device interaction as a terminal device as an example. Figure 3 As shown, the method for simulating mobile device interaction includes S301-S303.

[0066] S301: Displaying an application program running through the simulator.

[0067] The embodiment of the present application provides a new simulator, which has at least two functions, namely, function one: being able to simulate the operating environment of a mobile device, and function two: being able to execute complex interactive functions. Function one is first described below.

[0068] Function 1: The simulator is used to simulate the operating environment of a mobile device.

[0069] Mobile devices generally have an operating system installed, which provides applications (such as Figure 2 The simulator can simulate the operating system and thus the operating environment of the mobile device, so that applications suitable for mobile devices can also be run on non-mobile devices, similar to the desktop client running on non-mobile devices. For example, the application of a mobile game can only be used on a smartphone, but after using the simulator, the application of the mobile game can be experienced on a desktop computer.

[0070] Taking the Android emulator as an example, the main function of the Android emulator is to simulate the Android system on mobile devices such as smartphones on non-mobile devices such as desktop computers. Through the Android emulator, users can run applications for the Android system on non-mobile devices and experience the various functions of the application. In addition, the Android emulator also supports the installation, use and uninstallation of Android applications, allowing users to perform various operations without a mobile device.

[0071] That is to say, through the function one of the simulator, an application running in the operating environment of a mobile device can be run in a non-mobile device, thereby achieving cross-platform compatibility.

[0072] See also Figure 4 , which is a schematic diagram of the operation of a simulator provided in an embodiment of the present application. Figure 4 The page shown is a page after the simulator is opened in the non-mobile device. The page corresponding to the simulator includes multiple pending applications that can be run, and includes X application that can only be run on the mobile device, or in other words, X application cannot be run on the non-mobile device without the simulator.

[0073] S302: In response to acquiring a target operation for an application, generating a simulation signal according to the target operation.

[0074] In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0075] After introducing function one, function two of the simulator will be explained below.

[0076] Function 2: Able to perform complex interactive functions.

[0077] Complex interactive functions refer to functions that are implemented based on signals collected by sensors in mobile devices, such as shake interaction function and tap screenshot function. Among them, the shake interaction function is implemented based on the shake signal (i.e., the three-axis acceleration data collected by the acceleration sensor in the mobile device), and the tap screenshot function is implemented based on the tap signal (i.e., the vibration frequency and acceleration data collected by the gravity sensor in the mobile device).

[0078] As can be seen from the foregoing, non-mobile devices generally do not have relevant sensor hardware and cannot implement complex interactive functions. Based on this, in the embodiment of the present application, a corresponding relationship between a preset operation and a simulation signal is pre-established in the simulator.

[0079] Among them, the correspondence between the preset operation and the analog signal is used to describe which preset operation corresponds to which analog signal, so that after obtaining the target operation, it is identified which preset operation the target operation is, and then according to the correspondence between the preset operation and the analog signal, the analog signal corresponding to the target operation is simulated and generated.

[0080] The embodiment of the present application does not specifically limit the correspondence between the preset operation and the simulation signal, and those skilled in the art can set it according to actual needs, and the user can also make personalized settings through the simulator. The following three cases are used as examples for explanation.

[0081] In case one, different preset operations may correspond to the same analog signal, so that multiple preset operations may realize the same interactive function, so that the user may realize an interactive function based on multiple target operations.

[0082] In the second case, the same preset operation can correspond to different analog signals. For example, the same preset operation corresponds to the same analog signal in the same application, and the same preset operation corresponds to different analog signals in different applications. For example, after application A and application B recognize the target operation belonging to preset operation A, the same analog signal will be generated. After application C recognizes the target operation belonging to preset operation A, another analog signal will be generated, which is different from the analog signals generated for application A and application B.

[0083] In case three, different preset operations correspond to different analog signals, so that users can realize different interactive functions based on different preset operations, avoid confusion, improve the accuracy of realizing interactive functions after users perform target operations, and improve user experience.

[0084] The target operation is a pre-set operation that can be recognized by the non-mobile device. In the embodiment of the present application, one or more pre-set operations can be pre-set, such as shaking the mouse, drawing a pre-set rule symbol, etc. The analog signal is used to simulate the signal collected by the sensor in the mobile device, such as a shake signal, a tap signal, etc.

[0085] The embodiment of the present application does not specifically limit the identification method of the target operation. For example, in response to obtaining the target operation for the application, if there is only one preset operation, then based on the movement trajectory and movement speed corresponding to the target operation, it is identified whether the target operation is the preset operation, and then based on the movement trajectory and movement speed, it is determined which preset operation the target operation belongs to, which will not be repeated here.

[0086] If there are multiple preset operations, it is also necessary to identify which preset operation the target operation belongs to, so as to simulate and generate an analog signal corresponding to the preset operation to which the target operation belongs based on the correspondence between the preset operations and the analog signals.

[0087] For example, if the user shakes the mouse, in response to obtaining multiple displacement operations for the application, the multiple displacement operations are the target operation, and they correspond to the preset shake operation. For another example, if the user draws a preset rule symbol, in response to obtaining the preset rule symbol drawn for the application, drawing the preset rule symbol is the target operation, and it corresponds to the preset drawing gesture operation (i.e., drawing the preset rule symbol by sliding on the screen, etc.).

[0088] That is, the signal that the non-mobile device cannot obtain is converted into a target operation that the non-mobile device can obtain, and then after identifying which preset operation the target operation is, based on the correspondence between the preset operation and the analog signal, the analog signal corresponding to the target operation is simulated and generated, so that the application suitable for the mobile device can realize the corresponding interactive function simulated by the analog signal and based on the signal collected by the sensor in the mobile device after obtaining the analog signal. For example, if the analog signal simulates a tapping signal, the corresponding interactive function, that is, the screenshot operation, can be executed based on the analog signal.

[0089] Therefore, by establishing a correspondence between preset operations and simulated signals, signals that cannot be recognized by non-mobile equipment are converted into recognizable target operations, and based on the correspondence, simulated signals recognizable by the application are generated based on the target operation simulation, so as to implement corresponding interactive functions based on the simulated signals, and then implement corresponding control of the application in the simulator.

[0090] In addition, applications are generally developed by third parties, and the correspondence between signals and interactive functions is set up inside the application. It is difficult to invade the application and write the required correspondence between signals and interactive functions.

[0091] Based on this, the embodiment of the present application uses two corresponding relationships, namely, the corresponding relationship between the preset operation and the analog signal, and the corresponding relationship between the analog signal and the interactive function. Through the two corresponding relationships, the corresponding interactive function can be realized based on the preset operation. Specifically, after obtaining the target operation, the interactive function corresponding to the analog signal can be realized based on which preset operation the target operation is. By simulating the signal actually generated by the mobile device based on the analog signal, that is, using the analog signal as an intermediary, there is no need to invade the internal part of the application, which reduces the difficulty of modification and is convenient and quick.

[0092] It should be noted that by setting the correspondence between multiple preset operations and analog signals, as well as the correspondence between multiple analog signals and interactive functions, it is possible to achieve different interactive functions based on different target operations, that is, different target operations are which preset operations realize different interactive functions, thereby improving the convenience of user operation.

[0093] S303: Control the application program to execute an interactive function corresponding to the analog signal.

[0094] Interactive functions are used to describe functions that interact with applications, such as switching pages, triggering specific functions (such as triggering random events in game applications, achieving relationship matching in social applications), etc.

[0095] Therefore, after the non-mobile device recognizes the target operation, it generates an analog signal based on the target operation, and controls the application to execute the interactive function corresponding to the analog signal based on the analog signal. For the application, it obtains the analog signal, which is equivalent to obtaining the signal through the sensor, and then executes the corresponding interactive function according to the signal, thereby achieving non-intrusion into the application, and realizing the control of the application suitable for the mobile device to execute the corresponding interactive function based on the preset operation in the non-mobile device.

[0096] It can be seen from the above technical solution that the present application provides a new simulator, which can not only simulate the operating environment of a mobile device, so that the application used in the mobile device can be used in a non-mobile device, but also the simulator can perform complex interactive functions, that is, by establishing a correspondence between a preset operation (i.e., a preset operation) and a simulated signal, it can generate a signal for simulating the acquisition of a sensor in a mobile device based on the preset operation, i.e., a simulated signal, so as to respond to the acquisition of a target operation for the application, the target operation is an operation matching the preset operation, so as to determine the simulated signal corresponding to the target operation according to the correspondence between the preset operation and the simulated signal, and control the application running through the simulator to perform the interactive function corresponding to the simulated signal. In other words, the simulator provided by the present application, through the correspondence between the preset operation and the simulated signal, can simulate and generate a signal collected by the sensor based on the target operation, convert the complex interactive operation into the logic at the application level, thereby breaking through the hardware limitations between mobile devices and non-mobile devices, realizing complex interactive functions, breaking the limitations of simulator interaction, reducing hardware dependence, not only improving the user experience, but also improving the development and testing efficiency of the simulator.

[0097] The embodiments of the present application do not specifically limit the execution scope of the target operation, and those skilled in the art can set it according to actual needs.

[0098] For example, the target operation is performed in the page corresponding to the simulator. The scope of the page corresponding to the simulator is larger, so the execution scope of the target operation is larger, which is convenient for users to operate. For another example, the target operation is performed in the page corresponding to the application. If the simulator runs multiple applications at the same time, the target operation is performed in the page corresponding to the application. Although the execution scope of the target operation is smaller, the target operation is more targeted and can better clarify the user's execution target, improve recognition accuracy, and improve user experience.

[0099] It should be noted that if only one application is running in the corresponding page of the simulator, the target operation can be performed in the corresponding page of the simulator or in the corresponding page of the application. Regardless of the scope in which the target operation is performed, it is for the running application and will not cause confusion.

[0100] If multiple applications are running simultaneously in the corresponding page of the simulator, one or more applications must be selected before the target operation can be performed in the corresponding page of the simulator to clarify which application or applications the target operation is performed on. Alternatively, if no application is selected, the target operation must be performed in the corresponding page of the application to clarify which application the target operation is performed on. The embodiments of the present application do not specifically limit the selection of the corresponding operation, such as long pressing or long clicking the title bar of the application, circling the desired application, and clicking the application while holding down the ctrl key.

[0101] For another example, if multiple applications are running simultaneously in the corresponding page of the simulator, and in order to expand the execution scope of the target operation, the target operation can be allowed to be executed in the corresponding page of the simulator, then a preset number of applications can be determined as the applications targeted by the target operation according to a preset policy. Among them, the preset policy can be the first one or more (determined according to a preset number) applications whose time of executing the operation on the application is closest to the current time, so as to clarify the pertinence of the target operation while expanding the execution scope of the target operation and improve the user experience.

[0102] The embodiment of the present application does not specifically limit the target operation. The specific implementation method of S302, that is, the specific implementation method of generating an analog signal according to the target operation in response to obtaining the target operation for the application, is described below using four methods as examples.

[0103] Method 1: The target operation is to perform multiple displacement operations on the application.

[0104] In response to acquiring multiple displacement operations for the application, an analog signal is generated according to the multiple displacement operations, wherein the multiple displacement operations for the application are target operations for the application, the multiple displacement operations are operations performed more than a threshold number of times, and the displacement operations are operations that generate displacements.

[0105] For example, shaking the mouse produces a regular shaking, such as moving the mouse to the left, then to the right, then to the back, etc. Another example is sliding a finger produces a regular sliding, such as sliding the finger to the right, then to the left, then to the right, etc.

[0106] The embodiment of the present application does not specifically limit the targeting method of the application, for example, multiple displacement operations are performed in the page corresponding to the application. For another example, after the application is selected, multiple displacement operations are performed during the period when the application is selected.

[0107] See also Figure 5 , which is a schematic diagram of performing multiple displacement operations within a corresponding page of an application provided by an embodiment of the present application. Figure 5 In the example, the cursor can be controlled to move first to the left, then to the right, and finally to the left in the page 400 corresponding to the application, which is equivalent to the cursor shaking regularly through three consecutive displacement operations. Moreover, during the multiple displacement operations, the cursor is always located in the page 400 corresponding to the application, so that it is clear that the multiple displacement operations performed this time are for the application corresponding to the page, which is more targeted.

[0108] See also Figure 6 , which is a schematic diagram of performing multiple displacement operations during the period when an application is selected, provided by an embodiment of the present application. Figure 6 In the application, the border of the corresponding page of the application is bolded to indicate the selection effect. After the application is selected, multiple displacement operations can be performed at any position of the display interface during the application selection period, such as Figure 6 In the example, the user moves from outside the application corresponding page to inside the application corresponding page, and then performs the reverse operation, and then performs the reverse operation again for the reverse operation, so that the multiple displacement operations performed this time are clearly targeted at the application corresponding to the page through the selection operation, which is more targeted. Through the selection operation, the number of targeted applications can be increased, and the user's execution efficiency can be improved.

[0109] Thus, by performing multiple displacement operations on the application, the shake operation of the mobile device can be simulated to generate a signal for simulating a shake signal for the shake operation. Thus, a similar interaction method is provided for the same application on mobile devices and non-mobile devices, reducing the interaction barriers existing across platforms, facilitating users to quickly use the application through the simulator, improving the user experience and improving the user retention rate of the simulator.

[0110] Method 2: The target operation is to control the application to perform multiple displacement operations.

[0111] In response to the control application executing multiple displacement operations, an analog signal is generated according to the multiple displacement operations. The control application executing multiple displacement operations is a target operation for the application. The control application executing multiple displacement operations is when the number of displacement operations executed by the control application is greater than a number threshold.

[0112] For example, multiple displacement operations are performed by dragging the page corresponding to the application. Among them, the application can be dragged by clicking the title bar of the application with the mouse without releasing it. For another example, the application can be dragged by long pressing the title bar of the application with a finger. This application does not specifically limit the method of dragging the application.

[0113] See also Figure 7 , which is a schematic diagram of a control application program performing multiple displacement operations provided by an embodiment of the present application. Figure 7 In the embodiment of the present invention, you can long press the title bar 600 of the application with the cursor to drag the application to perform multiple displacement operations, such as dragging to the left, then dragging to the right, and finally dragging to the left, etc., so as to drag the application to shake, that is, to perform multiple displacement operations on the application in a targeted manner.

[0114] It should be noted that if the simulator runs multiple applications at the same time, it can control multiple applications to perform multiple displacement operations together, thereby increasing the number of targeted applications and improving the user's execution efficiency.

[0115] It should be noted that different analog signals can also be generated based on different forms of displacement operations. For example, different forms of multiple displacement operations can be combined based on factors such as the number of consecutive displacement operations and the direction of the displacement operations, so as to generate different analog signals, thereby realizing different interactive functions, improving the richness of the interaction, and improving the user experience.

[0116] Therefore, by controlling the application to perform multiple displacements, not only can the interactive function be realized through an interactive method similar to that of a mobile device (i.e., a shake operation), but the interactive application can also be made more targeted, avoiding conflicts with existing shortcut operations, etc., thereby improving the accuracy of interactive control and facilitating users to quickly use the application through the simulator, thereby improving the user experience and the user retention rate of the simulator.

[0117] Method 3: The target operation is to draw a preset rule symbol for the application.

[0118] In response to obtaining a preset rule symbol drawn in a page corresponding to the simulator or in a page corresponding to the application, a simulation signal is generated according to the preset rule symbol, wherein the preset rule symbol is a target operation for the application.

[0119] The drawing method may be to use a mouse or a finger to touch the screen so that the cursor draws a preset regular symbol, and this application does not make any specific limitation on this.

[0120] The preset rule symbol is a pre-set graphic with a shape, such as a zigzag, a triangle, a circle, etc., which is not specifically limited in this application. Different preset rule symbols can be used to control the corresponding application to perform different interactive operations. For example, the corresponding relationship between multiple preset rule symbols and analog signals, and the corresponding relationship between multiple analog signals and interactive functions are set, so as to realize different interactive functions through different preset rule symbols, thereby expanding the implementation methods of interactive functions and improving user experience.

[0121] See also Figure 8 , which is a schematic diagram of drawing a preset rule symbol in a corresponding page of a simulator provided by an embodiment of the present application. Figure 8 In the example, a Z-shaped shape 820 is drawn in the corresponding page 810 of the simulator, and the Z-shaped shape 820 is a preset rule symbol.

[0122] See also Fig. 9 , which is a schematic diagram of drawing a preset rule symbol in a corresponding page of an application provided by an embodiment of the present application. Fig. 9 In the example, a circle 920 is drawn in the corresponding page 910 of the application, and the circle 920 is the preset rule symbol.

[0123] Therefore, by drawing preset rule symbols for applications, the interactive functions of applications are realized, which expands the ways in which users can realize interactive functions and improves the user experience. Moreover, compared with the relatively single type of multiple displacement operations, the types of preset rule symbols are richer, so the number of interactive functions realized based on preset rule symbols is greater, and then users can realize more interactive functions based on a larger number of preset rule symbols, which is convenient and fast, and improves the user experience.

[0124] It should be noted that multiple displacement operations on the application and preset rule symbols can be used as a quick way to implement interactive functions, thereby further improving the richness of interactive functions and enhancing user experience.

[0125] Method 4: The target operation is a shortcut command for an application.

[0126] In response to obtaining a shortcut instruction for an application from a peripheral device, a simulation signal is generated according to the shortcut instruction, wherein the shortcut instruction is a target operation for the application.

[0127] Peripheral devices refer to devices used to expand the functions of non-mobile devices, such as displays, keyboards, numeric keypads, mice, speakers, printers, scanners, cameras, microphones, digital drawing tablets, etc. Shortcut commands are commands input based on peripheral devices, such as shortcut key commands input through keyboards, voice commands input through microphones, etc., and this application does not make specific restrictions on this.

[0128] Therefore, for mobile devices, interactive functions are generally performed through the mobile device itself without the need for peripheral devices, while non-mobile devices generally have peripheral devices installed. For example, desktop computers generally have keyboards installed. In this case, inputting shortcut commands for applications through peripheral devices is more suitable for non-mobile devices. Compared with mobile devices, the same interactive function can be implemented in more diverse ways. Users can choose the target operation that is more suitable for them to implement the interactive function, thereby improving the user experience.

[0129] The embodiment of the present application does not specifically limit the number of applications that can be simultaneously run by the execution simulator, and two cases are used as examples for illustration below.

[0130] Case 1: The simulator runs an application.

[0131] In response to obtaining an opening operation for the simulator, a plurality of pending applications that can be run through the simulator are displayed. In response to obtaining a selection operation for an application from the plurality of pending applications, an application that can be run through the simulator is displayed.

[0132] The application is one of the multiple pending applications, that is, one of the multiple pending applications can be selected as the application, so that interaction is subsequently performed on the application. The pending application is an application that can be run through the simulator.

[0133] See also Fig.10 , which is a schematic diagram of a simulator provided by an embodiment of the present application running an application. Fig.10 In the embodiment, an opening operation such as clicking or double-clicking is performed on the simulator on the display screen 1010 of the non-mobile device. In response to obtaining the opening operation on the simulator, multiple pending applications that can be run through the simulator are displayed, such as displaying multiple pending applications such as AA applications and BB applications in a simulator corresponding page 1020. When the user selects an X application from the multiple pending applications, in response to obtaining the selection operation for the X application from the multiple pending applications, the X application running through the simulator is displayed, and the page corresponding to the X application is shown in 1030.

[0134] It should be noted that the application running through the simulator is run through the application container, or in other words, one application container corresponds to one pending application. When the user selects the pending application, the application container corresponding to the pending application is activated, and thus the application corresponding to the application container is activated, thereby realizing the running of the application through the simulator. Compared with running applications on mobile devices, running applications through application containers allows the application container to be resized in the corresponding page of the simulator, which is convenient for users to use on demand. Therefore, the number of application containers can be displayed according to user needs within the limited display range of the corresponding page of the simulator, improving the user experience.

[0135] Therefore, by installing a simulator in a non-mobile device and simulating the operating environment of the mobile device through the simulator, it is possible to run applications used in mobile devices in non-mobile devices, and the simulator can provide a richer user experience, such as realizing various interactive functions through target operations, adjusting the size of the application display range, etc., thereby improving the user experience.

[0136] Case 2: The simulator runs multiple applications.

[0137] In response to obtaining an opening operation for the simulator, K pending applications that can be run through the simulator are displayed, and in response to obtaining a selection operation for M applications from among the K pending applications, the M applications that can be run through the simulator are displayed.

[0138] The application is one of the multiple pending applications, K is an integer greater than 1, and M is an integer less than or equal to K. That is, some or all of the pending applications can be selected from the multiple pending applications as the application, so that the interaction is subsequently performed for the multiple applications.

[0139] It should be noted that M applications can be selected from the K pending applications, or one application can be opened and then another application can be opened until M applications are opened, that is, the embodiment of the present application does not specifically limit the selection method of M applications. The types of the M applications can be the same or different, such as opening multiple applications of the same type and logging in to different accounts to realize the multi-opening function, thereby improving the user's usage efficiency.

[0140] See also Fig.11 , which is a schematic diagram of a simulator provided by an embodiment of the present application running multiple applications at the same time. Fig.11In the embodiment, an opening operation such as clicking or double-clicking is performed on the simulator on the display screen 1110 of the non-mobile device. In response to obtaining the opening operation on the simulator, multiple pending applications that can be run through the simulator are displayed, such as displaying multiple pending applications such as AA application, BB application, etc. in the simulator corresponding page 1120. When the user selects two applications from the multiple pending applications (such as clicking the two applications respectively while holding down the ctrl key), in response to obtaining the selection operation for the two applications from the multiple pending applications, the two applications running through the simulator are displayed, and the pages corresponding to the two applications are shown in 1130 and 1140.

[0141] See also Fig.12 , which is a schematic diagram of a simulator provided by an embodiment of the present application running multiple applications at the same time. Fig.12 In the embodiment, an opening operation such as clicking or double-clicking is performed on the simulator on the display screen 1210 of the non-mobile device. In response to obtaining the opening operation on the simulator, multiple pending applications that can be run through the simulator are displayed, such as displaying multiple pending applications, such as AA application, BB application, etc., in the simulator corresponding page 1220. When the user selects two applications from the multiple pending applications (such as by controlling the cursor to move from the upper left corner to the opposite corner of the rectangle), in response to obtaining the selection operation for the two applications from the multiple pending applications, the two applications running through the simulator are displayed, and the pages corresponding to the two applications are shown in 1230 and 1240.

[0142] Therefore, through the simulator, multiple applications can be selected to run simultaneously. The multiple applications can be of the same type or different types, thereby improving the user's interaction efficiency. For example, by subsequently performing a target operation on multiple applications, thereby achieving interaction with multiple applications, users are more willing to use the simulator, thereby improving the simulator's user retention rate.

[0143] The embodiment of the present application does not specifically limit whether multiple applications execute the same interactive function after executing the target operation on multiple applications, which is explained below separately.

[0144] The first one: perform the same interactive function.

[0145] In response to obtaining a selection operation for N applications among M applications, the selection effects for the N applications are displayed. During the process of N applications being selected, in response to obtaining a target operation for the N applications, a simulation signal is generated according to the target operation, and the N applications are controlled to respectively execute interactive functions corresponding to the simulation signal.

[0146] The selection effect is used to distinguish between selected applications and unselected applications in the applications running in the simulator. The present application embodiment does not specifically limit the selection effect, such as thickening the border of the application, highlighting the title bar of the application with other colors, etc. N is a positive integer less than M.

[0147] The preset operation corresponds to the analog signal one by one, that is, one preset operation corresponds to one correspondence, and multiple applications share the same correspondence, so that the same target operation is executed for multiple applications to achieve the same interactive function.

[0148] See also Fig.13 , which is a schematic diagram of a method in which multiple applications perform the same interactive function provided by an embodiment of the present application. Fig.13 In the example, three applications are run together through the simulator, that is, the corresponding pages of each application in the simulator corresponding to page 1310 are 1320, 1330 and 1340 respectively. Moreover, two applications are selected among the three applications, and the borders of the corresponding pages of the applications are bolded as the selection effect, such as the borders of 1320 and 1330 are bolded. In the process of selecting these two applications, if a target operation is obtained, the target operation is performed on these two applications, and although the target operation is for the two applications, a simulation signal is generated, and the simulation signal is used to indicate an interactive function, such as jumping to a function setting page.

[0149] Therefore, when the simulator runs multiple applications at the same time, the selected application can be displayed through the selection effect, and multiple applications share the same correspondence, that is, the correspondence between preset operations and analog signals, and the correspondence between analog signals and interactive functions. Therefore, when the same target operation is performed on multiple selected applications, it is identified which preset operation the target operation is, so that the same interactive function can be implemented for multiple applications based on the preset operation, helping users to quickly realize interaction with multiple applications and improving user efficiency.

[0150] The second type: performing different interactive functions.

[0151] In response to a selection operation on N applications out of M applications, the selection effects on the N applications are displayed. During the process of selecting the N applications, in response to obtaining a target operation on the N applications, analog signals corresponding to the N applications are generated according to the target operation, and the N applications are controlled to respectively execute corresponding interactive functions of the corresponding analog signals.

[0152] Among them, the same target operation may correspond to different analog signals. Specifically, a preset operation has a corresponding relationship with multiple analog signals, that is, a preset operation corresponds to multiple corresponding relationships, and multiple applications may no longer share the same corresponding relationship. For example, the same type of application shares the same corresponding relationship, and different types of applications do not share the same corresponding relationship. For another example, type A application and type B application share the same corresponding relationship, and type A application and type C application use different corresponding relationships. Therefore, the same target operation is executed for multiple applications, which may realize different interactive functions.

[0153] See also Fig.14 , which is a schematic diagram of a plurality of applications performing different interactive functions provided by an embodiment of the present application. Fig.14 In the example, three applications are run together through the simulator, that is, the corresponding pages of each application in the simulator corresponding to page 1410 are 1420, 1430 and 1440 respectively. Moreover, two applications are selected among the three applications, and the borders of the corresponding pages of the applications are bolded as the selection effect, such as the borders of 1420 and 1430 are bolded. In the process of selecting these two applications, if a target operation is obtained, the target operation is performed on these two applications, and a first analog signal is generated for one of the applications, and a second analog signal is generated for the other application. The first analog signal indicates that the application jumps to the function setting page, and the second analog signal indicates that the application jumps to the homepage of the application, thereby realizing the same target operation for multiple applications and realizing different interactive functions.

[0154] As a possible implementation method, the correspondence between preset operations and analog signals can be set based on a simulator, and the correspondence between analog signals and interactive functions can be set based on applications, thereby achieving non-intrusion to applications and reducing the difficulty of modification.

[0155] Therefore, when the simulator runs multiple applications at the same time, the selected application can be displayed through the selection effect, and at least two applications do not share the same corresponding relationship, so that the same target operation is performed on the selected multiple applications, but different simulation signals are generated, and different interactive functions are implemented for multiple applications, helping users to quickly realize interaction with multiple applications and improve user efficiency.

[0156] The following is an explanation of the embodiments of the present application from the perspective of an operating system.

[0157] The operating system in non-mobile devices is generally Windows Server TM , Mac OS X TM, Unix TM ,Linux TM , FreeBSD TM Etc. The operating systems in mobile devices are generally Android, IOS, etc. Installing an emulator in a non-mobile device allows the operating system of the mobile device to be simulated in the operating system in the non-mobile device, thereby enabling the use of applications suitable for mobile devices in the non-mobile device, i.e., achieving cross-system operation.

[0158] The embodiments of the present application do not specifically limit the manner in which the operating system in the non-mobile device interacts with the operating system in the simulated mobile device (i.e., the simulated mobile device operating system). Four manners are described below as examples.

[0159] (1) Interaction is achieved through the simulator interface.

[0160] The interface can map the peripheral devices of the non-mobile device to the simulated mobile device operating system. For example, by clicking the display screen of the simulator with the mouse of a desktop computer, or inputting text in the simulator using the keyboard, the simulator will map the operations from the current non-mobile device to the simulated mobile device operating system.

[0161] In addition, the interface can also interact by dragging and dropping content such as files or text into the simulator window (or display screen).

[0162] (2) Use Android debug bridge (ADB) to achieve interaction.

[0163] Taking the simulated mobile device operating system as an Android system as an example, after obtaining a touch event or a key event, it can be sent through ADB.

[0164] Touch event: The ADB command can be used to simulate the operation of touching the screen. The ADB command can be adb shell input tap <x> <y>,in, <x>and <y>The coordinates on the screen corresponding to the touch event.

[0165] Key events: The ADB command can be used to simulate key operations. The ADB command can be adb shell inputkeyevent <keycode>,in, <keycode>It is the key code defined in the Android system.

[0166] (3) Use third-party tools to achieve interaction.

[0167] The third-party tool may be an automated scripting tool or an automated testing framework, etc.

[0168] Automation scripting tools: Using scripting tools such as AutoHotkey for Windows operating systems or AppleScript for macOS operating systems, you can write scripts to automatically simulate click operations and key operations.

[0169] Automated testing framework: Open source automated testing tools such as Appium and Robot Framework can be used to write test scripts to control the simulator and implement click operations, sliding operations, etc.

[0170] (4) Use custom applications.

[0171] Custom applications can be developed, such as a personal computer (PC) application that communicates with the application in the simulator through socket communications, Hypertext Transfer Protocol (HTTP) requests, or other network protocols, thereby controlling the interaction in the simulator.

[0172] Through the above methods, cross-system interaction between interactive clicks on the PC side and simulated mobile device operating systems can be achieved. These methods can be flexibly selected and combined according to specific needs and scenarios.

[0173] See also Fig.15 , which is a schematic diagram of a method for simulating mobile device interaction provided in an embodiment of the present application.

[0174] The operating system in the non-mobile device has three modules, namely, a detection module 1501, a target operation identification module 1502, and a mapping module 1503. The operating system of the mobile device simulated by the non-mobile device (i.e., the simulated mobile device operating system described above) has three modules, namely, a sensor simulation module 1504, a signal identification module 1505, and an event processing module 1506. Each of them is described below.

[0175] (1) Detection module 1501, used to detect the position of a preset point.

[0176] For example, the position of a preset point within a preset time is detected, where the preset point is a point in a cursor or a corresponding page of an application, such as detecting events such as mouse movement or click operations, drag operations, and sliding operations performed on a touch screen.

[0177] (2) The target operation identification module 1502 is used to identify whether it is a target operation based on the position of the preset point. The following is an example of one method.

[0178] According to the position of the preset point within the preset time, the moving track and the moving speed of the preset point are determined. According to the moving track and the moving speed, the operation performed by the detected preset point can be determined, thereby obtaining the target operation for the application.

[0179] For example, based on the moving trajectory, it can be determined whether multiple displacement operations corresponding to shaking occur, or whether preset rule symbols appear. The moving speed is calculated by dividing the position of the preset point by the time, and the acceleration is the rate of change of speed. When it is detected that the moving speed exceeds the speed threshold, or the acceleration exceeds the acceleration threshold, and the moving trajectory matches the trajectory corresponding to multiple displacement operations, or the moving trajectory matches the preset rule symbol, it is identified which preset operation the target operation matches.

[0180] (3) A mapping module 1503 , used to generate a simulation signal according to the target operation and send it to the sensor simulation module 1504 .

[0181] As can be seen from the foregoing, the same target operation can generate the same type of analog signal or different types of analog signals, and this application does not make any specific limitation on this.

[0182] (4) The sensor simulation module 1504 is used to collect the signal after receiving the simulation signal, which is equivalent to the signal collected by the sensor in the mobile device.

[0183] (5) A signal identification module 1505, which is used to determine the interactive kinetic energy corresponding to the analog signal according to the corresponding relationship between the analog signal and the interactive function.

[0184] (6) Event processing module 1506, executed according to the interactive function.

[0185] It is understandable that the sensor simulation module 1504, the signal recognition module 1505 and the event processing module 1506 are equivalent to the modules inside the application program, and the embodiment of the present application does not need to improve them, and only needs to construct the detection module 1501, the target operation recognition module 1502 and the mapping module 1503, thereby reducing the difficulty of improvement and improving the user experience.

[0186] Therefore, through the above method, the simulator can achieve interactive functions such as shaking through software simulation without hardware such as sensors, providing users with a novel and convenient interactive method. It improves the richness and personalized settings of the user experience, simplifies the technical implementation process, and enables users to enjoy a similar interactive experience on non-mobile devices as on mobile devices, improving the convenience and innovation of the user experience.

[0187] With respect to the method for simulating mobile device interaction described above, the present application also provides a corresponding device for simulating mobile device interaction, so that the method for simulating mobile device interaction described above can be applied and implemented in practice.

[0188] See also Fig.16 , which is a schematic diagram of the structure of a device for simulating mobile device interaction provided in an embodiment of the present application. Fig.16 As shown, the device 1600 for simulating mobile device interaction includes: a display unit 1601, a generation unit 1602 and a control unit 1603;

[0189] The display unit 1601 is used to display the application program running through the simulator, and the simulator is used to simulate the operating environment of the mobile device;

[0190] The generating unit 1602 is configured to generate a simulation signal according to the target operation in response to obtaining the target operation for the application, wherein the simulation signal is used to simulate a signal acquired by a sensor in the mobile device, and the target operation is an operation matching a preset operation;

[0191] The control unit 1603 is used to control the application to execute the interactive function corresponding to the analog signal.

[0192] It can be seen from the above technical solution that the present application provides a new simulator, which can not only simulate the operating environment of a mobile device, so that the application used in the mobile device can be used in a non-mobile device, but also the simulator can perform complex interactive functions, that is, by establishing a correspondence between a preset operation (i.e., a preset operation) and a simulated signal, it can generate a signal for simulating the acquisition of a sensor in a mobile device based on the preset operation, i.e., a simulated signal, so as to respond to the acquisition of a target operation for the application, the target operation is an operation matching the preset operation, so as to determine the simulated signal corresponding to the target operation according to the correspondence between the preset operation and the simulated signal, and control the application running through the simulator to perform the interactive function corresponding to the simulated signal. In other words, the simulator provided by the present application, through the correspondence between the preset operation and the simulated signal, can simulate and generate a signal collected by the sensor based on the target operation, convert the complex interactive operation into the logic at the application level, thereby breaking through the hardware limitations between mobile devices and non-mobile devices, realizing complex interactive functions, breaking the limitations of simulator interaction, reducing hardware dependence, not only improving the user experience, but also improving the development and testing efficiency of the simulator.

[0193] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0194] In response to acquiring a plurality of shift operations for the application, the analog signal is generated according to the plurality of shift operations, wherein the plurality of shift operations for the application are target operations for the application.

[0195] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0196] In response to controlling the application to perform multiple shift operations, the analog signal is generated according to the multiple shift operations, and the controlling the application to perform multiple shift operations is a target operation for the application.

[0197] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0198] In response to acquiring a preset rule symbol drawn in a page corresponding to the simulator or in a page corresponding to the application, a simulation signal is generated according to the preset rule symbol, and drawing the preset rule symbol is a target operation for the application.

[0199] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0200] In response to obtaining a shortcut instruction for the application from a peripheral device, the simulation signal is generated according to the shortcut instruction, where the shortcut instruction is a target operation for the application.

[0201] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0202] In response to obtaining a target operation from a page corresponding to the simulator or a page corresponding to the application, the simulation signal is generated according to the target operation.

[0203] As a possible implementation, the display unit 1601 is specifically used for:

[0204] In response to obtaining an opening operation for the simulator, displaying a plurality of pending application programs that can be run through the simulator;

[0205] In response to obtaining a selection operation for the application from among the plurality of pending applications, the application running through the simulator is displayed, the application being one of the plurality of pending applications.

[0206] As a possible implementation manner, if the number of the plurality of pending applications is K, and K is an integer greater than 1, the display unit 1601 is specifically configured to:

[0207] In response to obtaining an opening operation for the simulator, displaying K pending application programs that can be run through the simulator;

[0208] In response to obtaining a selection operation for M of the applications from the K pending applications, the M applications running through the simulator are displayed, the application being one of the plurality of pending applications, and M being an integer less than or equal to K.

[0209] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0210] In response to obtaining a selection operation for N of the M applications, displaying a selection effect for the N applications, where N is a positive integer less than M;

[0211] In the process of selecting the N applications, in response to obtaining target operations for the N applications, generating a simulation signal according to the target operations;

[0212] The control unit 1603 is specifically used for:

[0213] The N application programs are controlled to respectively execute interactive functions corresponding to the analog signals.

[0214] As a possible implementation manner, the generating unit 1602 is specifically configured to:

[0215] In response to a selection operation on N of the M applications, displaying a selection effect on the N applications, where N is a positive integer less than M;

[0216] In the process of selecting the N applications, in response to obtaining target operations for the N applications, generating analog signals corresponding to the N applications respectively according to the target operations;

[0217] The control unit 1603 is specifically used for:

[0218] The N application programs are controlled to respectively execute corresponding interactive functions of corresponding analog signals.

[0219] As a possible implementation manner, the device further includes a target operation identification unit, which is used to:

[0220] Detecting a position of a preset point within a preset time, wherein the preset point is a cursor or a point within a corresponding page of the application;

[0221] Determining a moving trajectory of the preset point and a moving speed of the preset point according to the position of the preset point within a preset time;

[0222] A target operation targeting the application and matching the preset operation is determined according to the movement trajectory and the movement speed.

[0223] The present application also provides a computer device, which may be a server or a terminal device. The following will introduce the computer device provided by the present application from the perspective of hardware entity. Fig.17 The following is a schematic diagram of the server structure. Fig.18 Shown is a schematic diagram of the structure of the terminal equipment.

[0224] See also Fig.17 , which is a schematic diagram of a server structure provided in an embodiment of the present application. The server 1700 may have relatively large differences due to different configurations or performances, and may include one or more processors 1722, such as central processing units (CPU), memory 1732, and one or more application programs 1742 or storage media 1730 (such as one or more mass storage devices) for data 1744. Among them, the memory 1732 and the storage medium 1730 may be temporary storage or permanent storage. The program stored in the storage medium 1730 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the processor 1722 may be configured to communicate with the storage medium 1730 and execute a series of instruction operations in the storage medium 1730 on the server 1700.

[0225] The server 1700 may also include one or more power supplies 1726, one or more wired or wireless network interfaces 1750, one or more input and output interfaces 1758, and / or one or more operating systems 1741, such as Windows Server 2000. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0226] The steps performed by the server in the above embodiment can be based on the Fig.17 The server structure shown.

[0227] The processor 1722 is used to perform the following steps:

[0228] Displaying an application program running through a simulator, wherein the simulator is used to simulate an operating environment of a mobile device;

[0229] In response to obtaining a target operation for the application, generating a simulation signal according to the target operation, the simulation signal is used to simulate a signal acquired by a sensor in the mobile device, the target operation being an operation matching a preset operation;

[0230] The application is controlled to execute an interactive function corresponding to the analog signal.

[0231] Optionally, the processor 1722 may also execute method steps of any specific implementation of the method for simulating mobile device interaction in the embodiments of the present application.

[0232] See also Fig.18 , which is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. Taking the terminal device as a smart phone as an example, Fig.18 The block diagram of the partial structure of the smart phone is shown, and the smart phone includes: a radio frequency (RF) circuit 1810, a memory 1820, an input unit 1830, a display unit 1840, a sensor 1850, an audio circuit 1860, a wireless fidelity (WiFi) module 1870, a processor 1880, and a power supply 1890. Those skilled in the art can understand that Fig.18 The structure of the smartphone shown in the figure does not constitute a limitation of the smartphone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0233] Combine the following Fig.18 A detailed introduction to the various components of a smartphone:

[0234] The RF circuit 1810 may be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information from the base station, it is sent to the processor 1880 for processing; in addition, the designed uplink data is sent to the base station.

[0235] The memory 1820 may be used to store software programs and modules. The processor 1880 implements various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 1820 .

[0236] The input unit 1830 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smartphone. Specifically, the input unit 1830 may include a touch panel 1831 and other input devices 1832. The touch panel 1831, also known as a touch screen, can collect user touch operations on or near it and drive the corresponding connection device according to a pre-set program. In addition to the touch panel 1831, the input unit 1830 may also include other input devices 1832. Specifically, other input devices 1832 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0237] The display unit 1840 may be used to display information input by the user or information provided to the user and various menus of the smartphone. The display unit 1840 may include a display panel 1841, and the display panel 1841 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0238] The smartphone may also include at least one sensor 1850, such as a light sensor, a motion sensor, and other sensors. As for other sensors that may be configured in the smartphone, such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., they will not be described in detail here.

[0239] The audio circuit 1860, the speaker 1861, and the microphone 1862 can provide an audio interface between the user and the smartphone. The audio circuit 1860 can transmit the received audio data to the speaker 1861 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 1862 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1860 and converted into audio data, and then the audio data is output to the processor 1880 for processing, and then sent to another smartphone through the RF circuit 1810, or the audio data is output to the memory 1820 for further processing.

[0240] The processor 1880 is the control center of the smartphone, and uses various interfaces and lines to connect various parts of the entire smartphone, and executes various functions of the smartphone and processes data by running or executing software programs and / or modules stored in the memory 1820, and calling data stored in the memory 1820. Optionally, the processor 1880 may include one or more processing units.

[0241] The smart phone also includes a power supply 1890 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1880 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption management.

[0242] Although not shown, the smartphone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0243] In the embodiment of the present application, the memory 1820 included in the smart phone can store a computer program and transmit the computer program to the processor.

[0244] The processor 1880 included in the smart phone can execute the method for simulating mobile device interaction provided in the above embodiment according to the instructions in the computer program.

[0245] The embodiment of the present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute the method for simulating mobile device interaction provided in the above embodiment.

[0246] The embodiment of the present application also provides a computer program product including a computer program, which, when executed on a computer device, enables the computer device to execute the method of simulating mobile device interaction provided in various optional implementations of the above aspects.

[0247] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the above program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the above storage medium can be at least one of the following media: read-only memory (English: Read-Only Memory, abbreviated: ROM), RAM, magnetic disk or optical disk, etc. Various media that can store computer programs.

[0248] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0249] All data collected by this application (such as target operations, application account information, etc.) are collected with the consent and authorization of the object to which the data belongs (such as users, institutions or enterprises), and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions.

[0250] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0251] It should be noted that each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, in which the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0252] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a technician familiar with the technical field within the technical scope disclosed in the present application should be included in the protection scope of the present application. Based on the implementation methods provided in the above aspects, the present application can also be further combined to provide more implementation methods. Therefore, the protection scope of the present application should be based on the protection scope of the claims.< / keycode> < / keycode> < / y> < / x> < / y> < / x>

Claims

1. A method for simulating mobile device interaction, characterized in that: The method comprises: Displaying an application program running through a simulator, wherein the simulator is used to simulate an operating environment of a mobile device; In response to obtaining a target operation for the application, generating a simulation signal according to the target operation, the simulation signal is used to simulate a signal acquired by a sensor in the mobile device, the target operation being an operation matching a preset operation; The application is controlled to execute an interactive function corresponding to the analog signal.

2. The method according to claim 1, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to acquiring a plurality of shift operations for the application, the analog signal is generated according to the plurality of shift operations, wherein the plurality of shift operations for the application are target operations for the application.

3. The method according to claim 1, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to controlling the application to perform multiple shift operations, the analog signal is generated according to the multiple shift operations, and the controlling the application to perform multiple shift operations is a target operation for the application.

4. The method according to claim 1, characterized in that: In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to acquiring a preset rule symbol drawn in a page corresponding to the simulator or in a page corresponding to the application, a simulation signal is generated according to the preset rule symbol, and drawing the preset rule symbol is a target operation for the application.

5. The method according to claim 1, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to obtaining a shortcut instruction for the application from a peripheral device, the simulation signal is generated according to the shortcut instruction, where the shortcut instruction is a target operation for the application.

6. The method according to claim 1, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to obtaining a target operation from a page corresponding to the simulator or a page corresponding to the application, the simulation signal is generated according to the target operation.

7. The method according to claim 1, characterized in that The display of the application running through the simulator includes: In response to obtaining an opening operation for the simulator, displaying a plurality of pending application programs that can be run through the simulator; In response to obtaining a selection operation for the application from among the plurality of pending applications, the application running through the simulator is displayed, the application being one of the plurality of pending applications.

8. The method according to claim 1, characterized in that If the number of the plurality of pending applications is K, where K is an integer greater than 1, then displaying the applications running through the simulator includes: In response to obtaining an opening operation for the simulator, displaying K pending application programs that can be run through the simulator; In response to obtaining a selection operation for M of the applications from the K pending applications, the M applications running through the simulator are displayed, the application being one of the plurality of pending applications, and M being an integer less than or equal to K.

9. The method according to claim 8, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to obtaining a selection operation for N of the M applications, displaying a selection effect for the N applications, where N is a positive integer less than M; In the process of selecting the N applications, in response to obtaining target operations for the N applications, generating a simulation signal according to the target operations; The controlling the application to execute the interactive function corresponding to the analog signal includes: The N application programs are controlled to respectively execute interactive functions corresponding to the analog signals.

10. The method according to claim 8, characterized in that In response to acquiring a target operation for the application, generating a simulation signal according to the target operation includes: In response to a selection operation on N of the M applications, displaying a selection effect on the N applications, where N is a positive integer less than M; In the process of selecting the N applications, in response to obtaining target operations for the N applications, generating analog signals corresponding to the N applications respectively according to the target operations; The controlling the application to execute the interactive function corresponding to the analog signal includes: The N application programs are controlled to respectively execute corresponding interactive functions of corresponding analog signals.

11. The method according to any one of claims 1 to 10, characterized in that: The method further comprises: Detecting a position of a preset point within a preset time, wherein the preset point is a cursor or a point within a corresponding page of the application; Determining a moving trajectory of the preset point and a moving speed of the preset point according to the position of the preset point within a preset time; A target operation targeting the application and matching the preset operation is determined according to the movement trajectory and the movement speed.

12. A device for simulating mobile device interaction, characterized in that: The device comprises: a display unit, a generating unit and a control unit; The display unit is used to display the application program running through the simulator, and the simulator is used to simulate the running environment of the mobile device; The generating unit is configured to generate a simulation signal according to the target operation in response to obtaining a target operation for the application, wherein the simulation signal is used to simulate a signal acquired based on a sensor in the mobile device, and the target operation is an operation matching a preset operation; The control unit is used to control the application to execute the interactive function corresponding to the analog signal.

13. A computer device, characterized in that: The computer device comprises a processor and a memory: The memory is used to store a computer program and transmit the computer program to the processor; The processor is configured to execute the method according to any one of claims 1 to 11 according to the computer program.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and the computer program is used to execute the method according to any one of claims 1 to 11.

15. A computer program product comprising a computer program, characterized in that When the method is executed on a computer device, the computer device is enabled to execute the method according to any one of claims 1 to 11.

Images