Mobile terminal scene reproduction method, device, system and equipment

Abstract

The invention discloses a mobile terminal scene reproduction method, which comprises the following steps of: establishing remote connection with mobile equipment through a remote server, and acquiring and displaying a real-time screen projection picture of the mobile equipment transmitted through the remote server; receiving a detection result of whether the mobile equipment is in an idle state, and when the mobile equipment is in the idle state, issuing a scene reproduction request comprising a target application program identifier and target scene information to the mobile equipment; after a corresponding adb instruction executed by the mobile device according to the scene reproduction request is obtained, a target application program is awakened, and a target scene is opened; and viewing and controlling the scene interface of the received target scene to realize the reproduction of the target scene corresponding to the mobile equipment at the PC end. Effective reproduction and real-time supervision of a specific scene of a mobile terminal can be realized at a PC terminal.

Description

Technical Field

[0001] The present invention relates to the field of Internet technology, and in particular to a mobile terminal scene reproduction method, device, system and equipment. Background Art

[0002] In today's digital age, the rapid development of mobile Internet has promoted changes in all areas of society. With the popularization of portable smart devices such as smartphones and tablets, and the continuous upgrading of high-speed mobile network technology, mobile Internet has become the main channel for people to obtain information, enjoy services, and interact. However, with the widespread use and complexity of mobile applications, how to effectively regulate and reproduce mobile scenarios has become a major challenge facing relevant departments.

[0003] The traditional scene reproduction method mainly relies on the browser, and the corresponding page is opened through the URL for viewing and operation. However, this method has many inapplicability on the mobile terminal. First, in order to provide a better user experience, mobile developers often use their own APPs instead of the traditional Web form, which makes it impossible to open the required page through a simple URL. Secondly, many mobile applications have restricted various simulators for security reasons, making it impossible to use mobile applications normally on the PC simulator. Furthermore, the target scene in the mobile application often requires multiple layers of search and click jump to enter, which is cumbersome and inconvenient. Finally, for scenes that cannot be viewed through the browser, the traditional method can only rely on scene screenshots. This method can only show the scene status at a certain moment in the past, and cannot be verified in real time, thereby limiting the accuracy and effectiveness of supervision. Summary of the invention

[0004] In view of this, the purpose of the present invention is to propose a mobile scene reproduction method, device and equipment, aiming to solve the problems of how to overcome the inapplicability and operational limitations of traditional scene reproduction methods on mobile terminals, so as to realize effective reproduction and real-time supervision of specific scenes on mobile terminals on the PC side.

[0005] To achieve the above object, the present invention provides a mobile terminal scene reproduction method, the method comprising:

[0006] Establishing a remote connection with a mobile device through a remote server, acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server;

[0007] receiving a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, sending a scene reproduction request including a target application identifier and target scene information to the mobile device;

[0008] After obtaining the mobile device to execute the corresponding adb command according to the scene reproduction request, wake up the target application and open the target scene;

[0009] The received scene interface of the target scene is viewed and manipulated to reproduce the target scene corresponding to the mobile device on the PC side.

[0010] Preferably, establishing a remote connection with a mobile device through a remote server, and acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server, includes:

[0011] Deploy a remote service in the remote server and establish a connection with the mobile device through a USB port;

[0012] Obtain the video stream of the current screen of the mobile device, and push the video stream to the remote server via the websocket protocol;

[0013] The video stream transmitted by the remote server is received by the front-end browser on the PC to realize the real-time screen projection of the mobile device, and the mouse events are captured to complete the control of the mobile device.

[0014] Preferably, the receiving a detection result of whether the mobile device is in an idle state comprises:

[0015] Determine whether the mobile device is connected, and if so, determine whether the target application is running on the mobile device, and if not, determine that the mobile device is in an idle state.

[0016] Preferably, the method further comprises:

[0017] Preconfiguring the mobile device; the preconfiguration process includes:

[0018] Performing reverse analysis on the target application in the mobile device to obtain the protocol short link, the called Intent, and the passed-in parameters;

[0019] According to different target applications and different target scenarios, different calling methods are configured;

[0020] Design an interface for remote control of the mobile device and set the login and permissions of the mobile device.

[0021] Preferably, the reverse analysis of the target application in the mobile device to obtain the protocol short link, the called Intent and the passed-in parameters includes:

[0022] Decompile the target application using the apktool tool to obtain source code and resource files corresponding to the target application;

[0023] Searching and parsing the configuration file based on the source code and resource file to extract key information of the target application, wherein the key information includes scheme information, host information and path information;

[0024] By performing logical analysis on the source code, searching and identifying the processing logic of the Intent, the specific behavior mode and parameter transfer method of the target application when processing the Intent are determined;

[0025] By using the Frida tool to execute a custom script in the running environment of the target application, the custom script is used to trigger the deep link operation of the target application, and the protocol short link, the called Intent and the passed-in parameters of the target application are obtained.

[0026] Preferably, different calling modes are configured according to different target applications and different target scenarios, including:

[0027] Building call templates according to different types of target applications and different target scenarios;

[0028] Extracting and analyzing the URL address related to the target application using the Frida tool, determining the parameter name and parameter value used to identify the page or data in the URL address, and converting the parameter value of the URL address into a placeholder value in the call template according to a preset regular expression;

[0029] Different call links of the target application and the target scenario are constructed based on the call template and the placeholder value.

[0030] To achieve the above object, the present invention further provides a mobile terminal scene reproduction device, the device comprising:

[0031] A connection establishing unit, used to establish a remote connection with a mobile device through a remote server, and obtain and display a real-time projection screen of the mobile device transmitted through the remote server;

[0032] a request unit, configured to receive a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, send a scene reproduction request including a target application identifier and target scene information to the mobile device;

[0033] A wake-up unit, configured to wake up a target application and open a target scene after the mobile device executes a corresponding adb instruction according to the scene reproduction request;

[0034] The scene reproduction unit is used to view and manipulate the received scene interface of the target scene to achieve the reproduction of the target scene corresponding to the mobile device on the PC side.

[0035] To achieve the above object, the present invention further provides a mobile terminal scene reproduction system, the system comprising:

[0036] The PC end is used to send a scene reproduction request to the mobile device management end, and view and manipulate the received target scene, and the PC end is installed with a remote access tool for remotely accessing and operating the mobile device;

[0037] A mobile device management terminal, connected to the mobile device, for reproducing the request configuration corresponding to the calling mode according to different scenarios, and managing and monitoring all the connected mobile devices;

[0038] A mobile application control terminal connected to the mobile device, used to parse and execute the adb command in the scene reproduction request, and control the mobile device to open the target scene;

[0039] A mobile device is configured to wake up a target application and open a target scene, wherein the mobile device is installed with a remote access tool for remote access.

[0040] In order to achieve the above objectives, the present invention also proposes a mobile scene reproduction device, including a processor, a memory and a computer program stored in the memory, wherein the computer program is executed by the processor to implement the steps of a mobile scene reproduction method as described in the above embodiment.

[0041] Beneficial effects:

[0042] The above solution, by integrating remote connection, idle state detection, adb command execution, scene viewing and control, etc., realizes the effective reproduction and real-time supervision of specific scenes on the mobile terminal on the PC side, providing strong support for the supervision work of relevant departments. In addition, the solution does not rely on the browser and can open scenes that the browser cannot open directly. It breaks through the limitations of traditional browsers in mobile application access, allowing users to access more and more complex mobile application scenes, thereby improving the breadth and depth of supervision; the solution uses real mobile devices to open scenes instead of simulators, which avoids the restrictions on simulators and allows users to experience the same scenes and operations as real users, thereby improving the accuracy and scope of supervision; the solution can directly wake up the mobile device and open the specific scene of the application through the remote interface without multiple steps to enter, which greatly simplifies the operation process and improves the operation efficiency. It only needs to send a scene reproduction request on the PC side to directly open the required scene on the mobile device without manual operation or waiting for multiple steps to be completed.

[0043] The above scheme further refines the implementation methods of remote connection and real-time screen projection. By deploying remote services, USB port connection, websocket protocol streaming transmission, etc., it ensures that the real-time screen projection of mobile devices can be stably and efficiently transmitted to the PC, thereby improving the stability and compatibility of the system.

[0044] The above scheme determines whether the mobile device is in an idle state by judging whether the mobile device is connected and whether the target application is running on the mobile device, thereby improving the accuracy of scene reproduction and avoiding interference and conflicts that may be caused by sending scene reproduction requests when the mobile device is in use.

[0045] The above solution achieves comprehensive configuration and remote control of mobile devices by reverse analyzing the target application, configuring different calling methods, and designing remote control interfaces, improving the flexibility and scalability of the system and providing strong support for subsequent scene reproduction. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0047] Figure 1 A flowchart of a mobile terminal scene reproduction method provided by an embodiment of the present invention.

[0048] Figure 2 A schematic structural diagram of a mobile scene reproduction device provided in one embodiment of the present invention.

[0049] The realization of the purpose, functional features and advantages of the invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the invention claimed for protection, but merely represents the selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0051] The content of the present invention is described in detail below with reference to embodiments.

[0052] Reference Figure 1 The figure is a flow chart of a mobile terminal scene reproduction method provided by an embodiment of the present invention.

[0053] In this embodiment, the method includes:

[0054] S11, establishing a remote connection with a mobile device through a remote server, acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server.

[0055] Furthermore, in step S11, establishing a remote connection with a mobile device through a remote server, acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server, includes:

[0056] Deploy a remote service in the remote server and establish a connection with the mobile device through a USB port;

[0057] Obtain the video stream of the current screen of the mobile device, and push the video stream to the remote server via the websocket protocol;

[0058] The video stream transmitted by the remote server is received by the front-end browser on the PC to realize the real-time screen projection of the mobile device, and the mouse events are captured to complete the control of the mobile device.

[0059] Furthermore, the method is implemented based on a scene reproduction system. The scene reproduction system includes a PC terminal, a mobile application control terminal, and a mobile device; wherein,

[0060] The PC end is used to send a scene reproduction request to the mobile device management end, and view and manipulate the received target scene, and the PC end is installed with a remote access tool for remotely accessing and operating the mobile device;

[0061] A mobile device management terminal, connected to the mobile device, for reproducing the request configuration corresponding to the calling mode according to different scenarios, and managing and monitoring all the connected mobile devices;

[0062] A mobile application control terminal connected to the mobile device, used to parse and execute the adb command in the scene reproduction request, and control the mobile device to open the target scene;

[0063] A mobile device is configured to wake up a target application and open a target scene, wherein the mobile device is installed with a remote access tool for remote access.

[0064] In this embodiment, a remote service is deployed in a remote server, and a mobile device is connected through a USB port; the mobile device management end obtains the video stream (such as an h264 video stream) of the mobile device, and pushes the stream to the remote server through the websocket protocol; the web interface of the mobile device management end is accessed through the front-end browser in the PC end (such as http: / / localhost:8000 or a specific IP address), the mobile device management end is opened, the screen projection display of the mobile device is realized by pulling the stream, and the mouse events are captured to complete the control of the mobile device end.

[0065] A business application calling module is provided in the PC end, which is the initiator of the scene reproduction request in the system operated by the customer. A remote access tool for remote access and operation of the mobile device is installed in the PC end. The mobile device management end and the mobile application control end are both connected to the mobile device, wherein the mobile device management end is used to configure and manage the newly added scene reproduction request, that is, to realize the configurability of the calling method of different applications and different scenes, so as to facilitate the realization of new requests by modifying the database configuration without modifying the system, and to manage and monitor the use of multiple mobile devices at the same time; the mobile application control end provides an access interface for docking with specific scenes on the mobile device, that is, it is responsible for directly executing adb instructions and controlling the mobile device to open the specified scene. The mobile device is installed with a remote access tool and a security control tool, which is used to display the reproduction scene by pre-installing applications that support scene reproduction, and strictly controls the installation and deletion permissions, hiding non-essential applications and system applications.

[0066] S12, receiving a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, sending a scene reproduction request including a target application identifier and target scene information to the mobile device.

[0067] Further, in step S12, the receiving of the detection result of whether the mobile device is in an idle state includes:

[0068] Determine whether the mobile device is connected, and if so, determine whether the target application is running on the mobile device, and if not, determine that the mobile device is in an idle state.

[0069] In this embodiment, the mobile device management terminal is used to determine whether the mobile device is in use. If it is in use, other mobile devices are switched to avoid multiple users operating a mobile device at the same time, which may cause functional confusion. If it is not in use, it is considered to be in an idle state and the next step is continued. That is, the mobile device management terminal is opened through the front-end browser, and instructions (such as Runtime.getRuntime().exec(cmdShell), where cmdshell is a specific instruction) are sent by clicking on the mobile phone management to open the page or refresh the page, and the code (such as adb devices to determine whether the mobile device is connected; "adb shell pidof XXXX" to determine whether the application process exists, and the following com.example.myapp represents the process name corresponding to the app) is called to call the adb instruction to determine whether the mobile device is connected, and adb shell pidof com.example.myapp is used to determine whether the app application is running on the mobile device, so that the status of the mobile device can be monitored in real time.

[0070] S13, after obtaining the corresponding adb instruction executed by the mobile device according to the scene reproduction request, the target application is awakened and the target scene is opened.

[0071] S14, viewing and manipulating the received scene interface of the target scene to reproduce the target scene corresponding to the mobile device on the PC side.

[0072] In this embodiment, when a specific scene needs to be reproduced, such as opening a live broadcast room, the business application call module is opened through the front-end browser, and one of the data to be reproduced (such as information about a live broadcast room, such as this data will contain fields such as user name, user region, user id, encryption id, live broadcast room room_id, etc.) is found, and an instruction including a deep link (such as adb shell am start-d "snssdk1128: / / webcast_room?room_id={room_id}" and specific parameters such as room_id) is sent. The code executes the replacement of the parameter room_id and forwards it to the mobile device (this process realizes the instruction transmission from the PC to the mobile device). The mobile application control end receives the request initiated by the business application call module, executes the corresponding adb instruction, operates the mobile device, and the code executes Runtime.getRuntime().exec(cmdShell) to send the adb instruction to the mobile device, such as:

[0073] Process processStartApp=Runtime.getRuntime().exec(cmdShell);

[0074] processStartApp.waitFor()

[0075] The command is sent to the mobile device, and the mobile device receives the deep link scheme, determines and opens the specific page of the specific application (such as the live broadcast room).

[0076] The mobile device wakes up the target application and opens a specific scene according to the received adb command. For example, the mobile device opens the app through the scheme and opens the corresponding live broadcast room page according to the parameters in the command (such as room_id). At the same time, the mobile application control end captures the push stream of the mobile device in real time and completes the preview of the mobile device on the browser.

[0077] Furthermore, the method further comprises:

[0078] S10, pre-configuring the mobile device; the pre-configuration process includes:

[0079] S10-1, reverse analysis is performed on the target application in the mobile device to obtain the protocol short link, the called Intent, and the passed-in parameters;

[0080] S10-2, configuring different calling methods according to different target applications and different target scenarios;

[0081] S10-3, designing an interface for remotely controlling the mobile device and setting the login and permissions of the mobile device.

[0082] Furthermore, in step S10-1, the target application in the mobile device is reversely analyzed to obtain the protocol short link, the called Intent, and the passed-in parameters, including:

[0083] Decompile the target application using the apktool tool to obtain source code and resource files corresponding to the target application;

[0084] Searching and parsing the configuration file based on the source code and resource file to extract key information of the target application, wherein the key information includes scheme information, host information and path information;

[0085] By performing logical analysis on the source code, searching and identifying the processing logic of the Intent, the specific behavior mode and parameter transfer method of the target application when processing the Intent are determined;

[0086] By using the Frida tool to execute a custom script in the running environment of the target application, the custom script is used to trigger the deep link operation of the target application, and the protocol short link, the called Intent and the passed-in parameters of the target application are obtained.

[0087] In this embodiment, the app is reverse analyzed to view and parse the app's code and resources, and obtain the short link of the app's specific protocol to open the corresponding page and the intent called in the app and the parameters passed in when opening a certain scene of the app. Specifically:

[0088] (1) Use the apktool tool to decompile the app and execute the following command: apktool dapp_name.apk -ooutput_dir to view the code and resources;

[0089] (2) Find the AndroidManifext.xml configuration file in the decompiled output directory output_dir and search <intent-filter>In <data>Tags, get the key information such as the app's specific protocol scheme, host name host and path path. For example:

[0090] <intent-filter>

[0091] <action android:name="android.intent.action.VIEW" / >

[0092] <category android:name="android.intent.category.DEFAULT" / >

[0093] <category android:name="android.intent.category.BROWSABLE" / >

[0094] <data android:scheme="myapp"android:host="example.com" / >

[0095]

[0096] The key information fields include the scheme name defined by android:scheme:, android:host and android:path: to further define the URL matching rules.

[0097] (3) Search for keyword strings (such as : / / or scheme) in the resource file res / values ​​or decompiled code;

[0098] (4) Analyze the code logic, including searching for Intent or related processing logic in the code, such as:

[0099] Intent intent=new Intent(Intent.ACTION_VIEW,Uri.parse("myapp: / / example.com"));

[0100] startActivity(intent);

[0101] In the above code, a custom scheme ("myapp: / / ") is used through the URI, and the resource path ("example.com") is specified; then, an Activity associated with the Intent is started through the startActivity method.

[0102] Scheme processing usually involves the Uri.parse and setData() methods. That is, when processing an Intent with a custom scheme, the Uri.parse method is used to parse a string into a Uri object, and the setData method can be used to set the Data property of the Intent, i.e., the Uri.

[0103] By using dynamic analysis tools such as frida to capture the parameters carried by intent. Frida scripts such as:

[0104]

[0105] Run the above script to trigger a deep link in your app, which usually involves launching an Intent with a custom scheme; inspect the captured requests and the output of the Frida script for links containing "myapp: / / ". This will show the URI information carried in the Intent each time a deep link was triggered.

[0106] Furthermore, in step S10-2, different calling modes are configured according to different target applications and different target scenarios, including:

[0107] Building call templates according to different types of target applications and different target scenarios;

[0108] Extracting and analyzing the URL address related to the target application using the Frida tool, determining the parameter name and parameter value used to identify the page or data in the URL address, and converting the parameter value of the URL address into a placeholder value in the call template according to a preset regular expression;

[0109] Different call links of the target application and the target scenario are constructed based on the call template and the placeholder value.

[0110] In this embodiment, based on the results of reverse analysis, different apps and scenarios are divided to design a flexible calling method. Specifically, it includes:

[0111] Step 1: Based on the extracted scheme link, open the scheme link on the mobile device through the adb shell am start –d command to observe and analyze the behavior of the corresponding app. For example, Table 1 shows three different apps (app1, app2, app3; such as Taobao, JD.com, Douyin, Xiaohongshu, etc.), their corresponding scenarios (users, products, live broadcast rooms), and how to start a specific page in the app through adb shell commands combined with scheme links and parameters (such as sec_shop_id, promotion_id, room_id). The parameters here are placeholders and need to be replaced with specific values ​​when actually used. For example, to open a user details page, you need to pass in sec_shop_uid, and to open a live broadcast room, you need to pass in room_id.

[0112]

[0113] Table 1

[0114] Step 2: By operating on the app, combined with the frida tool, extract the relevant URL address (such as using the frida tool to open the live broadcast room, user information, product store and other data, and extract the detailed URL address), and analyze the parameter name and parameter value in the URL address, and perform parameter mapping when necessary, such as converting id to sec_uid or room_id. Table 2 shows the actual URL addresses extracted from the app application by the Frida tool, which correspond to the different scenarios mentioned in step 1. By analyzing the URL address, the URL format here is different from the scheme in step 1, that is, it can be judged that the sec_uid and room_id described in step 1 may not appear in the detailed address with this name, because they are directly extracted from the application, and may contain more information (such as the complete domain name and path) and different parameter names (such as id instead of sec_uid or room_id), so a layer of mapping is needed to convert id to sec_uid and room_id.

[0115]

[0116] Table 2

[0117] Furthermore, you can write code to match the id in the URL address according to the regular expression and convert it to sec_uid or room_id. Table 3 shows that regular expressions are provided for different applications, scenarios, and parameters to extract id values ​​from URL addresses (i.e., extracting app application-related ID information from a string in a specific format). At the same time, Table 3 also implies a conversion process, which is to convert the extracted id value into the corresponding parameter name (such as sec_shop_id, promotion_id, room_id). This process is necessary because the id in the URL extracted in step 2 may not directly correspond to the parameter name used in step 1.

[0118]

[0119] Table 3

[0120] Next, in order to effectively manage and monitor mobile devices, a mobile device management terminal is designed to facilitate the management and monitoring of mobile device usage. By opening the mobile device option through the designed mobile device management terminal, the mobile device connected to the remote server can be viewed and managed in the page window. In addition, a mobile application control interface is designed to allow the application on the mobile device to be directly awakened and the specified scene page to be opened through the interface that passes in specific parameters; this control interface is written by the business application call module, processes the scene reproduction request, and forwards a link in a specific format (such as the link snssdk1128: / / webcast_room?room_id=7234561362163141437) to the mobile device to wake up the corresponding application and open the specified scene page. The control interface code is as follows:

[0121]

[0122] Finally, to ensure the security of mobile devices, perform pre-login and security permission control. This includes installing an app with device owner permissions on the mobile device and using adb shell commands (adb shell dpm set-device-owner<package_name> / <receiver_name> ) Grant permissions to the app on the PC. The app that has obtained permissions can hide the apps on the mobile device, specify whether the apps can be uninstalled, and prohibit the use of the camera, screenshots, and other operations, thereby preventing abnormalities caused by misoperation and illegal operations. The code is as follows:

[0123]

[0124] Through the above pre-configuration steps for mobile devices, the flexibility, security and convenience of scene reproduction on mobile devices have been significantly improved, providing strong support for scenarios such as supervision of applications in mobile devices.

[0125] Reference Figure 2 Shown is a structural schematic diagram of a mobile scene reproduction device provided by an embodiment of the present invention.

[0126] In this embodiment, the device 20 includes:

[0127] A connection establishing unit 21 is used to establish a remote connection with a mobile device through a remote server, and obtain and display a real-time projection screen of the mobile device transmitted through the remote server;

[0128] A request unit 22, configured to receive a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, send a scene reproduction request including a target application identifier and target scene information to the mobile device;

[0129] A wake-up unit 23, configured to wake up a target application and open a target scene after the mobile device executes a corresponding adb instruction according to the scene reproduction request;

[0130] The scene reproduction unit 24 is used to view and manipulate the received scene interface of the target scene to achieve the reproduction of the target scene corresponding to the mobile device on the PC side.

[0131] Furthermore, the device 20 further includes:

[0132] A preconfiguration unit, configured to preconfigure the mobile device; the preconfiguration unit comprises:

[0133] A reverse analysis unit, used to perform reverse analysis on the target application in the mobile device to obtain a protocol short link, a called Intent, and an incoming parameter;

[0134] A first configuration unit, configured to configure different calling modes according to different target applications and different target scenarios;

[0135] The second configuration unit is used to design an interface for remotely controlling the mobile device and to set the login and authority of the mobile device.

[0136] Each unit module of the device 20 can respectively execute the corresponding steps in the above method embodiment, so each unit module will not be described in detail here. Please refer to the description of the above corresponding steps for details.

[0137] The embodiment of the present invention further provides a mobile terminal scene reproduction device, the device comprising the mobile terminal scene reproduction device as described above, wherein the mobile terminal scene reproduction device can adopt Figure 2 The structure of the embodiment can be executed accordingly. Figure 1 The technical solution of the method embodiment shown has similar implementation principles and technical effects. For details, please refer to the relevant records in the above embodiments, which will not be repeated here.

[0138] The device includes: a mobile phone, a digital camera, a computer, or other devices with a camera function, or a device with an image processing function, or a device with an image display function. The device may include components such as a memory, a processor, an input unit, a display unit, and a power supply.

[0139] Among them, the memory can be used to store software programs and modules, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as an image playback function, etc.), etc.; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory may also include a memory controller to provide the processor and the input unit with access to the memory.

[0140] The input unit can be used to receive input digital or character or image information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit of this embodiment includes not only a camera, but also a touch-sensitive surface (such as a touch display) and other input devices.

[0141] The display unit can be used to display information input by the user or information provided to the user and various graphical user interfaces of the device, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit may include a display panel, and optionally, the display panel may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface may cover the display panel, and when the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor to determine the type of touch event, and then the processor provides a corresponding visual output on the display panel according to the type of touch event.

[0142] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, equipment embodiment and storage medium embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0143] Furthermore, in this document, the terms "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device that includes a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of additional identical elements in the process, method, article, or device that includes the element.

[0144] The above description shows and describes the preferred embodiments of the present invention. It should be understood that the present invention is not limited to the form disclosed herein, and should not be regarded as excluding other embodiments, but can be used in various other combinations, modifications and environments, and can be modified within the scope of the invention, through the above teachings or the technology or knowledge of the relevant field. The changes and modifications made by those skilled in the art shall not depart from the spirit and scope of the present invention, and shall be within the scope of protection of the claims attached to the present invention.< / data>

Claims

1. A mobile terminal scene reproduction method, characterized in that: The method comprises: Establishing a remote connection with a mobile device through a remote server, acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server; receiving a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, sending a scene reproduction request including a target application identifier and target scene information to the mobile device; After obtaining the mobile device to execute the corresponding adb command according to the scene reproduction request, wake up the target application and open the target scene; The received scene interface of the target scene is viewed and manipulated to reproduce the target scene corresponding to the mobile device on the PC side.

2. A mobile terminal scene reproduction method according to claim 1, characterized in that: The step of establishing a remote connection with a mobile device through a remote server, and acquiring and displaying a real-time projection screen of the mobile device transmitted through the remote server, includes: Deploy a remote service in the remote server and establish a connection with the mobile device through a USB port; Obtain the video stream of the current screen of the mobile device, and push the video stream to the remote server via the websocket protocol; The video stream transmitted by the remote server is received by the front-end browser on the PC to realize the real-time screen projection of the mobile device, and the mouse events are captured to complete the control of the mobile device.

3. A mobile terminal scene reproduction method according to claim 1, characterized in that: The receiving a detection result of whether the mobile device is in an idle state includes: Determine whether the mobile device is connected, and if so, determine whether the target application is running on the mobile device, and if not, determine that the mobile device is in an idle state.

4. A mobile terminal scene reproduction method according to claim 1, characterized in that: The method further comprises: Preconfiguring the mobile device; the preconfiguration process includes: Performing reverse analysis on the target application in the mobile device to obtain the protocol short link, the called Intent, and the passed-in parameters; According to different target applications and different target scenarios, different calling methods are configured; Design an interface for remote control of the mobile device and set the login and permissions of the mobile device.

5. A mobile terminal scene reproduction method according to claim 4, characterized in that: The reverse analysis of the target application in the mobile device to obtain the protocol short link, the called Intent and the passed-in parameters includes: Decompile the target application using the apktool tool to obtain source code and resource files corresponding to the target application; Searching and parsing the configuration file based on the source code and resource file to extract key information of the target application, wherein the key information includes scheme information, host information and path information; By performing logical analysis on the source code, searching and identifying the processing logic of the Intent, the specific behavior mode and parameter transfer method of the target application when processing the Intent are determined; By using the Frida tool to execute a custom script in the running environment of the target application, the custom script is used to trigger the deep link operation of the target application, and the protocol short link, the called Intent and the passed-in parameters of the target application are obtained.

6. A mobile terminal scene reproduction method according to claim 5, characterized in that: According to different target applications and different target scenarios, different calling modes are configured, including: Building call templates according to different types of target applications and different target scenarios; Extracting and analyzing the URL address related to the target application using the Frida tool, determining the parameter name and parameter value used to identify the page or data in the URL address, and converting the parameter value of the URL address into a placeholder value in the call template according to a preset regular expression; Different call links of the target application and the target scenario are constructed based on the call template and the placeholder value.

7. A mobile scene reproduction device, characterized in that: The device comprises: A connection establishing unit, used to establish a remote connection with a mobile device through a remote server, and obtain and display a real-time projection screen of the mobile device transmitted through the remote server; a request unit, configured to receive a detection result of whether the mobile device is in an idle state, and when the mobile device is in an idle state, send a scene reproduction request including a target application identifier and target scene information to the mobile device; A wake-up unit, configured to wake up a target application and open a target scene after the mobile device executes a corresponding adb instruction according to the scene reproduction request; The scene reproduction unit is used to view and manipulate the received scene interface of the target scene to achieve the reproduction of the target scene corresponding to the mobile device on the PC side.

8. A mobile scene reproduction system, characterized in that: The system comprises: The PC end is used to send a scene reproduction request to the mobile device management end, and view and manipulate the received target scene, and the PC end is installed with a remote access tool for remotely accessing and operating the mobile device; A mobile device management terminal, connected to the mobile device, for reproducing the request configuration corresponding to the calling mode according to different scenarios, and managing and monitoring all the connected mobile devices; A mobile application control terminal connected to the mobile device, used to parse and execute the adb command in the scene reproduction request, and control the mobile device to open the target scene; A mobile device is configured to wake up a target application and open a target scene, wherein the mobile device is installed with a remote access tool for remote access.

9. A mobile scene reproduction device, characterized in that: It includes a processor, a memory and a computer program stored in the memory, wherein the computer program is executed by the processor to implement the steps of a mobile terminal scene reproduction method as described in any one of claims 1 to 6.

Images