Data acquisition method and related equipment

Abstract

The embodiment of the invention discloses a data acquisition method and related equipment. According to the embodiment of the invention, when it is detected that a first application calls a local multimedia collection device of a collection terminal, the local multimedia collection device is controlled to collect original environment data, data configuration information used by the local multimedia collection device to collect the original environment data is obtained, and the first application is installed in the collection terminal; when the first application is in the state of being remotely controlled by the target terminal, a multimedia collection instruction is sent to the target terminal, and the multimedia collection instruction is used for indicating target multimedia collection equipment of the target terminal to collect target environment data; and processing the target environment data based on the data configuration information to obtain updated target environment data, and replacing the original environment data acquired by the local multimedia acquisition equipment with the updated target environment data. The accuracy of data acquisition can be improved.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a data acquisition method and related equipment. The related equipment may include a data acquisition device, a computer device, a storage medium and computer software. Background Art

[0002] When operating the real machine through the web page on the cloud testing platform, when the APP in the real machine uses the camera to shoot scenes such as face recognition, ID card scanning, code scanning and other operations, because the real machine is in the cabinet of the computer room, the picture captured by the camera can only be the scene where the cabinet is located, rather than the on-site scene desired by the user, resulting in inaccurate collected data. Summary of the invention

[0003] The embodiments of the present application provide a data collection method and related equipment. The related equipment may include a data collection device, a computer device, a storage medium and computer software, which can improve the accuracy of data collection.

[0004] The present application provides a data collection method, including:

[0005] When it is detected that the first application calls the local multimedia acquisition device of the acquisition terminal, the local multimedia acquisition device is controlled to acquire the original environment data, and the data configuration information used by the local multimedia acquisition device to acquire the original environment data is obtained, and the first application is installed in the acquisition terminal;

[0006] When the first application is in a state of being remotely controlled by the target terminal, sending a multimedia acquisition instruction to the target terminal, wherein the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data;

[0007] Based on the data configuration information, the target environment data is processed to obtain updated target environment data, and the original environment data collected by the local multimedia collection device is replaced with the updated target environment data.

[0008] The present application also provides a data acquisition device, including:

[0009] an acquisition unit, configured to, when detecting that a first application calls a local multimedia acquisition device of the acquisition terminal, control the local multimedia acquisition device to acquire original environment data, and acquire data configuration information used by the local multimedia acquisition device to acquire original environment data, wherein the first application is installed in the acquisition terminal;

[0010] a sending unit, configured to send a multimedia acquisition instruction to the target terminal when the first application is in a state of being remotely controlled by the target terminal, wherein the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data;

[0011] The response unit is used to process the target environment data based on the data configuration information to obtain updated target environment data, and replace the original environment data collected by the local multimedia collection device with the updated target environment data.

[0012] The present application also provides a data collection method, including:

[0013] When receiving the multimedia acquisition instruction returned by the acquisition terminal, based on the multimedia acquisition instruction, calling the target multimedia acquisition device of the target terminal to collect the target environment data, wherein the acquisition terminal sends the multimedia acquisition instruction to the target terminal when detecting that the first application calls the local multimedia acquisition device of the acquisition terminal and determining that the first application is in a state of being remotely controlled by the target terminal;

[0014] The target environment data is returned to the collection terminal.

[0015] The present application also provides a data acquisition device, including:

[0016] The collecting unit is used for, when receiving the multimedia collecting instruction returned by the collecting terminal, calling the target multimedia collecting device of the target terminal to collect the target environment data based on the multimedia collecting instruction, wherein the collecting terminal sends the multimedia collecting instruction to the target terminal when detecting that the first application calls the local multimedia collecting device of the collecting terminal and determining that the first application is in a state of being remotely controlled by the target terminal;

[0017] A returning unit is used to return the target environment data to the collection terminal.

[0018] An embodiment of the present application also provides a computer device, including a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps in any one of the data acquisition methods provided in the embodiments of the present application.

[0019] The embodiment of the present application also provides a computer-readable storage medium, which stores a plurality of instructions, and the instructions are suitable for a processor to load to execute the steps in any one of the data acquisition methods provided in the embodiment of the present application.

[0020] The embodiment of the present application also provides a computer software, including a computer program / instruction, which implements the steps of any data acquisition method provided in the embodiment of the present application when the computer program / instruction is executed by a processor.

[0021] In an embodiment of the present application, when the present application detects that the first application calls the local multimedia acquisition device of the acquisition terminal, the present application first controls the local multimedia acquisition device to acquire original environmental data, and obtains the data configuration information used by the local multimedia acquisition device to acquire the original environmental data. Then, after determining that the first application is in a state of being remotely controlled by the target terminal, the present application sends a multimedia instruction to the target terminal to enable the target terminal to acquire environmental data. Since the first application is remotely controlled by the target terminal, the environmental data at the target terminal is the real environmental data that needs to be acquired, and the acquired real environmental data needs to be used at the acquisition device. Therefore, the data configuration information of the original environmental data acquired by the local multimedia acquisition device is the data configuration that needs to be satisfied. Therefore, based on the data configuration information, the target environmental data is processed to obtain updated target environmental data, and the original environmental data acquired by the local multimedia acquisition device is replaced with the updated target environmental data, so that the acquisition terminal can not only acquire updated target environmental data that can reflect the real environmental data, but also meet the configuration and use requirements of the acquisition terminal, thereby improving the accuracy of data acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1a It is a schematic diagram of a scenario in which the data collection method provided in an embodiment of the present application is applied to a collection terminal side;

[0024] Figure 1b It is a flow chart of the data collection method provided in the embodiment of the present application applied on the collection terminal side;

[0025] Figure 2 It is a flowchart of the data collection method provided in the embodiment of the present application applied on the target terminal side;

[0026] Figure 3a It is a flow chart of the application of the data collection method provided in the embodiment of the present application to the bilateral interaction;

[0027] Figure 3b This is a class diagram of the camera usage system interface provided in an embodiment of the present application;

[0028] Figure 3c It is a terminal interaction diagram for establishing a point-to-point transmission channel provided in an embodiment of the present application;

[0029] Figure 3d is a schematic diagram of locally adding target video data provided by an embodiment of the present application;

[0030] Figure 3e is a schematic diagram of video data exchange provided by an embodiment of the present application;

[0031] Figure 3f is a schematic diagram of the structure of a remote test application provided in an embodiment of the present application;

[0032] Figure 4 This is a schematic diagram of the first structure of the data acquisition device provided in the embodiment of the present application;

[0033] Figure 5 It is a second structural schematic diagram of the data acquisition device provided in an embodiment of the present application;

[0034] Figure 6 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0036] The embodiments of the present application provide a data acquisition method and related equipment, and the related equipment may include a data acquisition device, a computer device, a storage medium and computer software.

[0037] It is understandable that in the specific implementation of this application, related data such as environmental data is involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0038] The data acquisition device can be integrated into an electronic device, which can be a terminal, a server, or other equipment. The terminal can be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop, or a personal computer (PC); the server can be a single server or a server cluster consisting of multiple servers.

[0039] In some embodiments, the data acquisition device may also be integrated into multiple electronic devices. For example, the data acquisition device may be integrated into multiple servers, and the data acquisition method of the present application may be implemented by multiple servers.

[0040] In some embodiments, the server may also be implemented in the form of a terminal.

[0041] For example, refer to Figure 1a When the electronic device S detects that the first application calls the local multimedia acquisition device of the acquisition terminal, it can first control the local multimedia acquisition device to acquire the original environment data, and obtain the data configuration information used by the local multimedia acquisition device to acquire the original environment data. Then, after determining that the first application is in a state of being remotely controlled by the target terminal, the electronic device S sends a multimedia instruction to the target terminal to enable the target terminal to acquire the environment data. Since the first application is remotely controlled by the target terminal, the environment data at the target terminal is the real environment data that needs to be acquired, and the acquired real environment data needs to be used at the acquisition device. Therefore, the data configuration information of the original environment data acquired by the local multimedia acquisition device is the data configuration that needs to be satisfied. Therefore, based on the data configuration information, the target environment data is processed to obtain the updated target environment data, and the original environment data acquired by the local multimedia acquisition device is replaced with the updated target environment data, so that the acquisition terminal can not only acquire the updated target environment data that can reflect the real environment data, but also meet the configuration and use requirements of the acquisition terminal, and improve the accuracy of data acquisition.

[0042] It should be noted that the serial numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

[0043] In this embodiment, a data collection method is provided, which is applied to a collection terminal, such as Figure 1b As shown, the specific process of the data collection method can be as follows:

[0044] 101. When it is detected that a first application calls a local multimedia acquisition device of a collection terminal, the local multimedia acquisition device is controlled to collect original environment data, and data configuration information used by the local multimedia acquisition device to collect the original environment data is obtained.

[0045] The acquisition terminal is a terminal used to test the first application. For example, the acquisition terminal can be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a desktop computer, a smart car, and other devices.

[0046] For example, in order for different testers to use the same acquisition terminal, the acquisition terminal can be placed in a cabinet in a computer room so that each tester can access and use the acquisition terminal. Since the cabinet is a closed environment, the external environment where the acquisition terminal is located may not meet the test requirements. The cabinet may include multiple models of acquisition terminals to test the performance of the first application running in different acquisition terminals.

[0047] The first application is installed on the acquisition terminal. The first application refers to an application that is in the testing phase of the software development cycle. For example, the first application can be a mobile application (such as a banking application, a business application, a social media application, etc.), a web application (such as an e-commerce website, a social networking platform, an online banking system), an embedded application (such as an application in a smart home device, an application in a car entertainment system, an application in a medical device), and so on.

[0048] In the embodiment of the present application, the local multimedia acquisition device refers to a multimedia acquisition device provided or carried by the acquisition terminal. For example, the local multimedia acquisition device can be a camera, a microphone, etc. provided or carried by the acquisition terminal.

[0049] In an embodiment of the present application, when a data collection request initiated by a first application is detected, the collection terminal collects raw environmental data. Specifically, when a data collection request of a local multimedia collection device of the collection terminal is detected when the first application calls the collection terminal, the local multimedia collection device is controlled to collect raw environmental data. Raw environmental data refers to environmental data of the external environment of the collection terminal collected by calling the local multimedia collection device when the first application is running. For example, raw environmental data can be images or video data captured by the camera of the collection terminal, or sounds detected by the microphone of the collection terminal, and so on.

[0050] In some embodiments, in order to remotely test the first application, a remote use instruction for the media acquisition function of the first application sent by the target terminal is received; according to the remote use instruction, the first application is triggered to initiate a data acquisition request to call the local multimedia acquisition device of the acquisition terminal, and when the data acquisition request of the first application is detected, it is determined whether the first application is in a state of being remotely controlled by the target terminal.

[0051] The target terminal is a terminal used by the first application deployed in the remote control acquisition terminal. For example, the target terminal can be a personal computer (such as a desktop, a laptop, etc.), a mobile device (such as a smart phone, a tablet, etc.), a virtual terminal, a cloud platform, etc.

[0052] The media acquisition function refers to the ability of the first application to support the capture and processing of various forms of environmental data. For example, the media acquisition function can be an audio acquisition function (such as voice recognition, voice calls, online conferences, etc.), a video acquisition function (such as face recognition, video recording, etc.), an image acquisition function (such as scanning, code scanning, etc.), and so on.

[0053] The remote use instruction is a command sent by the target terminal to the acquisition terminal, and is used to control the first application to start its media acquisition function.

[0054] In some embodiments, in order to quickly detect the call of the first application to the local multimedia acquisition device during the running process of the first application, when it is detected that the first application calls the data acquisition request of the local multimedia acquisition device of the acquisition terminal, the local multimedia acquisition device is controlled to collect the original environment data, including:

[0055] Detecting a target event in which the first application calls a control interface of a local multimedia acquisition device;

[0056] If the target event is detected, the local multimedia acquisition device is controlled to collect the original environmental data.

[0057] The control interface refers to the interface for communicating and controlling the local multimedia acquisition device.

[0058] For example, if the local multimedia acquisition device is a camera, the control interface can be the Camera1 class, which is used to control the device's camera. The control interface provides camera control methods such as opening the camera, configuring camera parameters (such as resolution, focus mode, etc.), starting and stopping preview, taking pictures, and releasing camera resources. The control interface can also be the Camera2 class, which is a more powerful and complex control interface designed to better utilize the capabilities of modern camera hardware. The Camera2 control interface provides more fine-grained control methods, including control methods for sensor frame rate, exposure, focus, etc.

[0059] The target event is an event in which the first application calls the control interface of the local multimedia acquisition device.

[0060] For example, if the local multimedia acquisition device is a camera, the target event may be an event that calls the Camera1 class, or an event that calls the Camera2 class, and so on.

[0061] In the embodiment of the present application, the first application is deployed in the acquisition terminal, and the operation of the first application in the acquisition terminal is remotely controlled by the target terminal, then it can be determined that the first application is in a state of being remotely controlled by the target terminal.

[0062] In an embodiment of the present application, the data configuration information includes a data structure format and / or acquisition configuration parameters. The data structure format is the format used by the acquisition terminal to encapsulate the original environmental data. The acquisition configuration parameters are the configuration parameters set when the local multimedia acquisition device acquires the original environmental data.

[0063] In an embodiment of the present application, the local multimedia acquisition device and the target multimedia acquisition device are image acquisition devices, the original environment data and the target environment data are video data, the data structure format is a video format, and the acquisition configuration parameters include at least one of the image color space format, resolution, and video frame timestamp.

[0064] 102. When the first application is in a state of being remotely controlled by the target terminal, send a multimedia acquisition instruction to the target terminal.

[0065] The multimedia acquisition instruction is used to instruct the target terminal to collect target environment data and return it.

[0066] The multimedia acquisition instruction is used to instruct the target terminal to start the target multimedia acquisition device it carries to collect environmental data.

[0067] The target multimedia acquisition device refers to a multimedia acquisition device provided or carried by the target terminal. For example, the target multimedia acquisition device may be a camera, a microphone, etc. provided or carried by the target terminal.

[0068] In the embodiment of the present application, when it is detected that the first application calls a data collection request of the local multimedia collection device of the collection terminal, it is determined whether the first application is in a state of being remotely controlled by the target terminal. When the first application is in a state of being remotely controlled by the target terminal, a multimedia collection instruction is sent to the target terminal.

[0069] In the embodiment of the present application, whether the first application is in a state of being remotely controlled by the target terminal can be obtained through detection.

[0070] In some embodiments, in order to send instructions to the target terminal in real time, reliably, securely and flexibly, sending a multimedia acquisition instruction to the target terminal includes:

[0071] Based on the target scene information, establish a command transmission channel with the target terminal;

[0072] Based on the command transmission channel, multimedia acquisition commands are sent to the target terminal.

[0073] Among them, the instruction transmission channel is used for communication between the acquisition terminal and the target terminal. The acquisition terminal can send multimedia acquisition instructions to the target terminal through the instruction transmission channel.

[0074] In some embodiments, in order to realize communication between the acquisition terminal and the target terminal, even if they are located in different network environments, a channel needs to be established so that the acquisition terminal can directly communicate with the target terminal across network barriers, and establish a command transmission channel with the target terminal, including:

[0075] Initiating a communication connection request for the target terminal to the target server, so that the target server forwards the communication connection request to the target terminal;

[0076] Based on the communication connection request, receiving response information returned by the target terminal through the target server;

[0077] Based on the response information, an instruction transmission channel is established via the target server and the target terminal.

[0078] Among them, the target server is used to solve the problem that the acquisition terminal and the target terminal cannot communicate directly, and the target server can also implement security authentication and authorization mechanisms to ensure the legitimacy and security of communication.

[0079] For example, the target server can be a signaling server, a relay server, a proxy server, and so on.

[0080] A communication connection request is a signaling message sent to a target server during the process of establishing a communication session to request a communication connection with a target terminal. This request usually contains information identifying the target terminal and possible connection parameters and settings so that the target server can correctly process and forward the request.

[0081] The response information is the information returned by the target terminal in response to the communication connection request. For example, the response information may include information such as acceptance or rejection by the target terminal, as well as communication parameters.

[0082] For example, if the response information indicates that the target terminal accepts the communication connection request, a command transmission channel passing through the acquisition terminal-target server-target terminal is established.

[0083] In a specific embodiment, when the first application is in a state of being remotely controlled by the target terminal, it is determined whether the local multimedia acquisition device of the acquisition terminal and the target multimedia acquisition device of the target terminal are the same device. If the local multimedia acquisition device of the acquisition terminal and the target multimedia acquisition device of the target terminal are not the same device, a multimedia acquisition instruction is sent to the target terminal.

[0084] 103. Based on the data configuration information, the target environment data is processed to obtain updated target environment data, and the original environment data collected by the local multimedia collection device is replaced with the updated target environment data.

[0085] In an embodiment of the present application, the data configuration information includes a data structure format and / or acquisition configuration parameters, the data structure format is the format used by the acquisition terminal to encapsulate the original environment data, and the acquisition configuration parameters are the configuration parameters set when the local multimedia acquisition device acquires the original environment data; based on the data configuration information, the target environment data is processed to obtain updated target environment data, including: based on the data structure format, format conversion processing of the target environment data, and / or based on the acquisition configuration parameters, configuration parameter adjustment of the target environment data.

[0086] The local multimedia acquisition device and the target multimedia acquisition device are image acquisition devices, the original environment data and the target environment data are video data, the data structure format is a video format, and the acquisition configuration parameters include at least one of image color space format, resolution, and video frame timestamp.

[0087] It can be understood that if it is necessary to remotely test the face recognition function in the media acquisition function of the first application, in order to make the video stream or picture involved in face recognition meet the test requirements, the original environmental data collected by the acquisition terminal is replaced with the target environmental data collected by the target terminal, so that the environmental data used to finally execute the face recognition task meets the test requirements.

[0088] Specifically, a test result returned by the first application based on the target environment data is obtained, and it is determined whether the test result matches a preset result. If the test result matches the preset result, it is determined that the first application has passed the test.

[0089] In an embodiment of the present application, target environment data sent by a target terminal is received, and a first application is tested based on the target environment data sent by the target terminal.

[0090] In some embodiments, in order to achieve a low-latency, high-quality real-time communication experience, receiving target environment data sent by a target terminal includes:

[0091] Establish a point-to-point transmission channel with the target terminal;

[0092] Based on the point-to-point transmission channel, the target environment data sent by the target terminal is received.

[0093] Among them, the point-to-point transmission channel is a communication channel that is directly connected to the target terminal without passing through the server, which reduces the server bandwidth and processing burden and improves transmission efficiency.

[0094] In some embodiments, in order to enable the acquisition terminal to communicate with the target terminal in a point-to-point manner, a point-to-point transmission channel is established between the acquisition terminal and the target terminal, including:

[0095] Sending a session description protocol proposal to a target terminal via a target server;

[0096] receiving a session description protocol response to a session description protocol proposal returned by the target terminal through the target server;

[0097] Based on the session description protocol proposal, the session description protocol response is verified to obtain a verification result;

[0098] Based on the verification results, a point-to-point transmission channel is established with the target terminal.

[0099] The session description protocol proposal is a proposal initiated by the acquisition terminal to establish point-to-point communication with the target terminal, and may include information such as the codec, media type, address and port number supported by the acquisition terminal.

[0100] The Session Description Protocol response is information generated and returned by the target terminal in response to the received Session Description Protocol proposal. This information can adjust the Session Description Protocol proposal to adapt to the hardware and software capabilities of the target terminal. The Session Description Protocol response may include information such as codecs not supported by the target terminal and codecs supported by both parties, media types, addresses, and port numbers.

[0101] The verification result refers to the conclusion obtained by analyzing and comparing the session description protocol proposal and the session description protocol response.

[0102] For example, if the parameters in the session description protocol proposal (such as codec, media type, etc.) are compatible with the parameters in the session description protocol response and meet the preset communication requirements, the verification result is successful and a point-to-point transmission channel with the target terminal is established.

[0103] If the parameters in the Session Description Protocol Proposal are partially the same as those in the Session Description Protocol Response, but can still be established after adjustments or compromises, such as the proposal may contain multiple codec options, and the target terminal selects one of the formats that both parties can support. In this case, the verification result may be partially successful, but the point-to-point transmission channel with the target terminal is still allowed to be established, but it will be carried out according to the adjusted parameters.

[0104] If the parameters in the session description protocol proposal are incompatible with the parameters in the session description protocol response, the verification result is failure, and a point-to-point transmission channel cannot be established with the target terminal.

[0105] In some embodiments, in order to allow the target environment data collected by the target terminal to replace the original environment data to meet the testing requirements, the first application is tested based on the target environment data sent by the target terminal, including: processing the target environment data based on the data configuration information used by the collection terminal to collect the original environment data to obtain updated target environment data; and testing the first application based on the updated target environment data.

[0106] The data configuration information is the data format used by the original environment data. For example, the data configuration information may include the format used by the acquisition terminal to encapsulate the original environment data collected by the local multimedia acquisition device, and the configuration parameters (such as resolution, color space format, timestamp, other additional information, etc.) used by the local multimedia acquisition device to collect the original environment data, etc.

[0107] The updated target environment data has the same data format as the original environment data, thereby ensuring that the first application can normally process the updated data.

[0108] It can be understood that if it is necessary to remotely test the face recognition function in the media acquisition function of the first application, in order to make the video stream or picture involved in face recognition meet the test requirements, the original environmental data collected by the acquisition terminal is replaced with the target environmental data collected by the target terminal, so that the environmental data used to finally execute the face recognition task meets the test requirements.

[0109] In some embodiments, in order to ensure that the target environment data can replace the original environment data and be processed by the first application, the data configuration information includes a data structure format and acquisition configuration parameters, the data structure format is the format used to encapsulate the original environment data, and the acquisition configuration parameters are the configuration parameters set when the local multimedia acquisition device acquires the original environment data; based on the data configuration information used by the acquisition terminal to acquire the original environment data, the target environment data is processed, including: based on the data structure format, format conversion processing of the target environment data, and / or based on the acquisition configuration parameters, configuration parameter adjustment of the target environment data.

[0110] In a specific embodiment, based on the data structure format, the target environment data is format converted to obtain updated target environment data.

[0111] In another specific embodiment, based on the collected configuration parameters, the configuration parameters of the target environment data are adjusted to obtain updated target environment data.

[0112] In another specific embodiment, based on the data structure format, the target environment data is format converted to obtain the target environment data after format conversion; based on the acquisition configuration parameters, the configuration parameters of the target environment data after format conversion are adjusted to obtain the updated target environment data.

[0113] The data structure format is the format used by the acquisition terminal to encapsulate the original environmental data.

[0114] The acquisition configuration parameters are configuration parameters used by the local multimedia acquisition device when the first application calls the local multimedia acquisition device to acquire environmental data. For example, the acquisition configuration parameters may be resolution, frame rate, color space, focus mode, and the like.

[0115] The target environment data after format conversion is the environment data that can be processed by the collection terminal after the target environment data is format converted.

[0116] For example, when the data structure format of the target environment data indicates that the target environment data is a real-time communication media stream (RTCMediaStream), the data structure format used by the acquisition terminal to encapsulate the original environment data is a media sample buffer reference (CMSampleBufferRef), which is used to encapsulate and manage a single media sample, that is, the target environment data is converted from the RTCMediaStream format to the CMSampleBufferRef format that the acquisition terminal can receive, and the target environment data after format conversion is obtained.

[0117] The updated target environment data is environment data that can be processed by the collection terminal and has the same collection conditions as the original environment data.

[0118] In some embodiments, in order to replace the original environment data with the updated target environment data, the data collection method includes: adding the updated target environment data to the data processing interface of the collection terminal; based on the data processing interface of the collection terminal, rendering the updated target environment data, and displaying the updated target environment data in a preset area instead of the original environment data.

[0119] The data processing interface is used to process and display the environmental data collected by the local multimedia collection device.

[0120] The preset area is the area that needs to be displayed after rendering the environment data set by the preset.

[0121] For example, the updated target environment data is introduced into the data processing interface of the local multimedia acquisition device for processing. Since the updated target environment data and the original environment data share the same timestamp, they will prevent the data processing interface from processing the original environment data. Then, the updated target environment data is rendered and displayed in a predetermined area to replace the display of the original environment data.

[0122] In this embodiment, a data collection method is provided, which is applied to a target terminal, such as Figure 2 As shown, the specific process of the data collection method can be as follows:

[0123] 201. When a multimedia acquisition instruction returned by a collection terminal is received, based on the multimedia acquisition instruction, a target multimedia acquisition device of a target terminal is called to collect target environment data.

[0124] When the acquisition terminal detects that the first application calls the local multimedia acquisition device of the acquisition terminal and determines that the first application is in a state of being remotely controlled by the target terminal, the acquisition terminal sends a multimedia acquisition instruction to the target terminal.

[0125] In an embodiment of the present application, the target terminal sends a remote use instruction for the media acquisition function of the first application to the acquisition terminal, so that the acquisition terminal calls the local multimedia acquisition device of the acquisition terminal to collect original environmental data according to the remote use instruction, and returns the multimedia acquisition instruction when the first application is in a state where the target terminal is remotely controlled.

[0126] In some embodiments, in order to control the collection of environmental data after receiving the multimedia collection instruction, based on the multimedia collection instruction, calling the target multimedia collection device of the target terminal to collect the target environmental data includes:

[0127] (1) Based on the multimedia acquisition instruction, the target multimedia acquisition device is called to obtain a call authorization prompt.

[0128] The authorization prompt is used to prompt the user in front of the target terminal to provide the corresponding credentials for permission verification to ensure the legitimacy of environmental data collection. For example, the authorization prompt can be a user name and password, fingerprint scanning, facial recognition, etc.

[0129] (2) Obtain the information to be verified according to the authorization prompt.

[0130] The information to be verified is the information required for verification provided by the user in front of the target terminal according to the authorization prompt. For example, the information to be verified can be an input password, fingerprint information, facial information, etc.

[0131] (3) When the information to be verified passes the authority verification, the target multimedia acquisition device is controlled to collect the target environment data.

[0132] Furthermore, when the information to be verified passes the authority verification, the use authority information of the target multimedia acquisition device is obtained; and according to the use authority information and the multimedia acquisition instruction, the target multimedia acquisition device is controlled to acquire the target environment data.

[0133] The usage permission information is the relevant permission and authorization information for accessing and controlling the target multimedia acquisition device when receiving the multimedia acquisition instruction. For example, the usage permission information may include access permission, operation permission, time limit, security authentication, etc.

[0134] For example, when the usage permission information indicates that the target multimedia acquisition device can be called, the target multimedia acquisition device is controlled to acquire the target environment data according to the multimedia acquisition instruction.

[0135] 202. Return the target environment data to the collection terminal.

[0136] In the embodiment of the present application, the target environment data is returned to the acquisition terminal so that the first application uses the target environment data instead of the original environment data to execute the task that the original environment data needs to participate in.

[0137] As can be seen from the above, the embodiment of the present application can collect target environment data based on the multimedia collection instruction when receiving the multimedia collection instruction returned by the collection terminal, wherein the collection terminal sends the multimedia collection instruction to the target terminal when detecting the data collection request of the first application and judging that the first application is in a state of being remotely controlled by the target terminal; and returns the target environment data to the collection terminal. Since the environment where the target terminal for remotely controlling the first application is located can be effectively controlled, the target environment data collected by the target terminal according to the multimedia collection instruction can meet the test conditions, the collection terminal receives the target environment data sent by the target terminal, and tests the first application based on the target environment data sent by the target terminal to meet the test requirements, and seamlessly integrates into the normal operation process of the first application, so that the application program can be fully and effectively tested, and the data collection effect is improved.

[0138] In this embodiment, the method of the embodiment of the present application is described in detail by taking the target terminal as a web page (Web terminal), the acquisition terminal as a real machine equipped with an iOS system, the multimedia acquisition device as a camera, and the target server as a signaling server as an example.

[0139] like Figure 3a As shown, a specific process of a data collection method is as follows:

[0140] 301. A target terminal sends a remote use instruction for a media acquisition function of a first application to a acquisition terminal.

[0141] For example, when the real machine is in the cabinet of the computer room, the camera can only capture the scene of the cabinet, not the on-site environment required for testing the first application. When the Web end uses the camera shooting function in the first application in the real machine, such as face recognition, ID card scanning, code scanning, etc., a remote use instruction for the media collection function of the first application is sent to the real machine.

[0142] 302. The acquisition terminal triggers the first application to call a local multimedia acquisition device according to the received remote use instruction.

[0143] 303. The acquisition terminal uses the camera interception plug-in module to detect a target event in which the first application calls a control interface of a local multimedia acquisition device.

[0144] For example, the camera interception plug-in module will be placed in the first application of the real device in a non-invasive manner to detect the target event of the first application using the camera. In detail, the camera interception plug-in module detects the call of relevant system classes and methods in the control interface of the first application using the camera.

[0145] 304. The camera interception plug-in module in the acquisition terminal determines the target scene information that the first application is in remote control of the target terminal, and based on the target scene information, the camera interception plug-in module initiates a communication connection request for a long connection to the target terminal to the target server, so that the target server forwards the communication connection request to the target terminal, and then initiates a multimedia acquisition instruction to the target terminal to start the target multimedia acquisition device.

[0146] In some embodiments, the detection (hook) module not only hooks the instance method of the system class, but also hooks the protocol method followed by the system class. The hooked classes and methods are all system classes, protocols and methods, ensuring the universality of the camera interception plug-in module.

[0147] like Figure 3b As shown, the functions of the specific classes and methods are as follows:

[0148] 1) Video data output class (AVCaptureVideoDataOutput class):

[0149] AVCaptureVideoDataOutput is part of the high-level framework (AVFoundation framework) for processing audio and video in iOS, and is usually used to obtain and process video frames from the camera. It is a specific subclass that can be used to process uncompressed or compressed frames captured by the video.

[0150] The purpose of this class is to generate video frames suitable for processing using other media interfaces. Applications can use the delegate method (captureOutput:didOutputSampleBuffer:fromConnection:) to process video frames transmitted from capture output devices (such as cameras).

[0151] The hook method is:

[0152] Set the sample buffer proxy and queue method (setSampleBufferDelegate:queue:), which is used to set the delegate object that receives the capture buffer and the dispatch queue that calls the delegate method. The delegate object needs to follow the video data output sample buffer proxy protocol (AVCaptureAudioDataOutputSampleBufferDelegate protocol).

[0153] 2) The hook method of the AVCaptureAudioDataOutputSampleBufferDelegate protocol is:

[0154] Capture output: output sample buffer from the connection (captureOutput:didOutputSampleBuffer:fromConnection), this method is called when the output captures and outputs new video. The delegate can use the provided video frame in conjunction with other interfaces for further processing.

[0155] 3) The capture video preview layer (AVCaptureVideoPreviewLayer) is a Core Animation layer subclass used to preview the visual output of the capture session object (AVCaptureSession).

[0156] You can create an AVCaptureVideoPreviewLayer instance using the initWithSession method and pass in the capture session you want to preview.

[0157] The hook method initWithSession: creates an AVCaptureVideoPreviewLayer instance and passes in the capture session to be previewed.

[0158] For example, when the first application in the real machine calls the camera function as indicated in step 302, the camera use event callback of the camera interception plug-in module will be triggered, and the camera call class and the callback method for collecting video streams will be hooked, including:

[0159] 304-1. The initWithSession method of the AVCaptureVideoPreviewLayer class is used to create a video preview layer based on the provided capture session, so that the video content captured by the camera can be displayed in real time on the interface.

[0160] 304-2. The setSampleBufferDelegate:queue: method of the AVCaptureVideoDataOutput class is used to set the video data output delegate object and the corresponding call queue to receive and process the captured video data.

[0161] The purpose of this class is to generate video frames suitable for processing using other media interfaces. Applications can use the captureOutput:didOutputSampleBuffer:fromConnection: proxy method to process video frames transmitted from a capture output device (such as a camera).

[0162] 304-3. The captureOutput:didOutputSampleBuffer:fromConnection: method in the AVCaptureVideoDataOutputSampleBufferDelegate protocol is a callback method called when video data is output. When a video capture session generates a new video frame, the capture output: output sample buffer from the connection method will be called. You can process the received video frame data in this method, such as image processing, encoding, or saving to a file. This callback is called on the specified queue (set by setting the sample buffer proxy and queue method).

[0163] 305. The camera interception plug-in module in the acquisition terminal performs handshake communication with the target server, thereby opening the use permission information of the target multimedia acquisition device in the target terminal, and using the target multimedia acquisition device of the target terminal to collect environmental data.

[0164] 306. A point-to-point transmission channel is established between the camera interception plug-in module and the target terminal through the signaling server, and the target environment data collected by the target multimedia collection device is transmitted to the collection terminal, and then transmitted to the camera interception plug-in module.

[0165] Among them, the point-to-point transmission technology can realize the active streaming of the camera interception plug-in module and the active streaming of the Web end.

[0166] like Figure 3c As shown, after handshaking, the camera interception plug-in module in the acquisition terminal and the target terminal exchange configuration information through a session description protocol proposal sent to the target terminal and a session description protocol response returned by the target terminal to achieve the establishment of a point-to-point transmission channel.

[0167] 307. After acquiring the target environment data, the camera interception plug-in module converts and cuts the target environment data so that the updated target environment data meets the requirements of the local multimedia acquisition device used by the first application in the acquisition terminal to acquire environment data.

[0168] This application has the following technical advantages or innovations in the video format conversion algorithm:

[0169] (i) Dynamically set the image color space format, that is, convert the video data format. Commonly used image color space formats for video data include YUV and RGBA. Different business scenarios will set different image space formats when calling the iOS camera to meet the needs of subsequent image processing. The image space format shot by the Web camera is a fixed one. This application can dynamically convert the image space level format of the received Web video data according to the image space format set by the original business scenario to meet business needs.

[0170] (ii) Dynamically set the resolution, that is, crop the video frames in the video data. The video frames obtained by the Web end are horizontal images with a resolution of 640x480, while vertical images are often used in iOS services. This solution can dynamically crop the video frames as needed, so that the video stream frames are cropped according to the original iOS camera image acquisition setting parameters, so that the image will not be stretched or squeezed.

[0171] (iii) Dynamically set additional information of video data, especially in scenarios such as scanning QR codes, the brightness, timestamp, color space and other additional information of the camera scan are often used, but the information in the video stream information transmitted by the Web camera is inconsistent with that of the iOS native camera. This solution obtains the additional information in the video stream of the original iOS camera, adds it to the video stream of the Web camera, and then performs some compatibility processing, so that this application meets the scenarios such as scanning codes that require the use of additional information of video data, greatly expanding the scope and usage rate of this solution.

[0172] 308. The camera interception plug-in module adds the updated target environment data to the data processing interface of the local multimedia acquisition device.

[0173] In some embodiments, the updated target environment data is handed over to the intercepted camera for use and execution in the control interface of the video stream acquisition callback.

[0174] For example, add the video data that meets the requirements to the data processing interface of the real camera for execution.

[0175] like Figure 3dAs shown, in some embodiments, the real machine includes a video stream replacement module, which is responsible for handing over the target video data to the usage module of the real machine camera.

[0176] 309. Based on the data processing interface of the local multimedia acquisition device, the updated target environment data is rendered so that the updated target environment data replaces the original environment data and is displayed in the preset area.

[0177] For example, the target video data stream from the Web end is rendered and displayed on the real device original shooting preview canvas.

[0178] Method to replace the local video data shot by the real device with the target video data on the Web:

[0179] The hook process uses the runtime mechanism of Object C language to exchange the addresses of the custom method A' and the system method A of the hook module. In this way, when the camera data processing interface method A is originally triggered during use, it will be executed to the custom method A'. After the required parameters are processed in A', the data processing interface method A will be executed. This will intercept the camera system interface and modify the parameters before continuing to execute according to the original interface.

[0180] like Figure 3e As shown, the specific process is:

[0181] 309-1. The preview view of the hook is counted as player (player), the video data output class is counted as data output (dataOutPut), the delegate object is counted as sampleBufferDelegate, the local video data obtained by the video frame callback method is counted as sampleBuffer, and the updated target video data is counted as mtpSampleBuffer.

[0182] 309-2. When the method of setting the delegate object according to the hook video stream output class is triggered, the delegate object sampleBufferDelegate is obtained.

[0183] 309-3. The delegate object sampleBufferDelegate is a video stream callback method implementation class that complies with the AVCaptureAudioDataOutputSampleBufferDelegate protocol. The implemented method is the video stream callback method.

[0184] 309-4. When the hook's video stream callback method captureOutput:didOutputSampleBuffer:fromConnection: is triggered, the local video data captured by the real device can be obtained, counted as sampleBuffer, and the auxiliary information of sampleBuffer can be obtained accordingly.

[0185] 309-5. At the same time, the target video data from the web camera is transmitted through the point-to-point transmission channel (WebRTC), and the target video data is converted and cropped, and the auxiliary information of the sampleBuffer obtained in step 309-4 is added to form the updated target video data mtpSampleBuffer. Then, mtpSampleBuffer is used as a parameter to execute the video stream callback method through the obtained delegate object sampleBufferDelegate, so that the video data is replaced.

[0186] For example, the real device native camera call directly passes the camera video acquisition session to the custom view to preview the camera image. After the camera is cut off, the session will no longer exist and preview will not be possible. The camera interception plug-in module extracts the updated target video data and previews the video in the custom view.

[0187] 310. The first application executes the tasks required by the original environment data based on the target environment data.

[0188] Specifically, the first application executes the tasks required by the original environment data based on the updated target environment data.

[0189] For example, the video stream data collected by the Web camera and the video stream data collected by the real machine camera have been transplanted, and the real machine can use the target video data function.

[0190] like Figure 3f As shown, the main purpose of this application is that when the tester uses the cloud testing platform, when the real machine uses the camera function, he can open the camera on the Web side to collect video data. The tester can replace the video shot by the real machine with the video shot by the Web side to meet the normal operation of the business function in the first application on the real machine. In the camera usage scenario, using the cloud testing platform can achieve the same effect as directly using the real machine.

[0191] The beneficial effects of this application include:

[0192] 1. When the tester uses the cloud testing platform and encounters the camera function of the real device, he can open the camera on the Web side to collect video data. The tester can replace the video shot by the real device with the video shot by the Web side to ensure the normal operation of the first application business function in the real device. In the camera usage scenario, using the cloud testing platform can achieve the same effect as directly using the real device. This function is not currently met in all cloud testing platforms.

[0193] 2. Video data is transmitted through the efficient point-to-point transmission protocol (WebRTC protocol), making the target video data transmission smoother and more stable.

[0194] 3. The hook technology is used to hook not only the sample methods of the system class, but also the protocol methods followed by the system class. This can achieve zero intrusion on the business code and camera call module code. This function can be used without any changes to the business code and camera call module code, greatly reducing the access cost.

[0195] In order to better implement the above method, the embodiment of the present application also provides a data acquisition device, which can be integrated in a computer device, and the computer device can be a terminal, a server, etc. Among them, the terminal can be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop, a personal computer, etc.; the server can be a single server or a server cluster composed of multiple servers.

[0196] For example, in this embodiment, the method of the embodiment of the present application will be described in detail by taking the data acquisition device specifically integrated in a computer device as an example.

[0197] For example, Figure 4 As shown, the data acquisition device may include an acquisition unit 401, a sending unit 402, and a response unit 403, as follows:

[0198] (i) Acquisition unit 401.

[0199] The acquisition unit 401 is used to determine whether the first application is in a state of being remotely controlled by a target terminal when a data collection request of the first application is detected.

[0200] (ii) Sending unit 402.

[0201] The sending unit 402 is used to send a multimedia collection instruction to the target terminal when the first application is in a state of being remotely controlled by the target terminal, where the multimedia collection instruction is used to instruct the target terminal to collect target environment data and return it.

[0202] (iii) Response unit 403.

[0203] The responding unit 403 is configured to test the first application based on the target environment data sent by the target terminal.

[0204] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can refer to the previous method embodiments, which will not be repeated here.

[0205] For example, Figure 5 As shown, the data acquisition device may include an acquisition unit 501 and a return unit 502, as follows:

[0206] (a) Collection unit 501.

[0207] The collection unit 501 is used to call the target multimedia collection device of the target terminal to collect target environment data based on the multimedia collection instruction when receiving the multimedia collection instruction returned by the collection terminal. When the collection terminal detects that the first application calls the local multimedia collection device of the collection terminal and determines that the first application is in a state of being remotely controlled by the target terminal, it sends the multimedia collection instruction to the target terminal.

[0208] (ii) Return to unit 502.

[0209] The returning unit 502 is used to return the target environment data to the collection terminal.

[0210] The embodiment of the present application also provides a computer device, which may be a terminal, a server, etc. The terminal may be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a personal computer, etc. The server may be a single server or a server cluster composed of multiple servers, etc.

[0211] In some embodiments, the data acquisition device may also be integrated into multiple computer devices. For example, the data acquisition device may be integrated into multiple servers, and the data acquisition method of the present application may be implemented by multiple servers.

[0212] In this embodiment, the computer device of this embodiment is a server as an example for detailed description. Figure 6 It shows a schematic diagram of the structure of the server involved in the embodiment of the present application, specifically:

[0213] The server may include one or more processing core processors 601, one or more computer-readable storage media memories 602, a power supply 603, an input module 604, and a communication module 605. Those skilled in the art will appreciate that Figure 6The server structure shown does not constitute a limitation on the server, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0214] The processor 601 is the control center of the server, and uses various interfaces and lines to connect various parts of the entire server. It executes various functions of the server and processes data by running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602. In some embodiments, the processor 601 may include one or more processing cores; in some embodiments, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0215] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the server, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0216] The server also includes a power supply 603 for supplying power to various components. In some embodiments, the power supply 603 may be logically connected to the processor 601 through a power management system, so that the power management system can manage charging, discharging, power consumption, and other functions. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0217] The server may further include an input module 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0218] The server may further include a communication module 605. In some embodiments, the communication module 605 may include a wireless module. The server may perform short-range wireless transmission through the wireless module of the communication module 605, thereby providing wireless broadband Internet access for the user. For example, the communication module 605 may be used to help the user send and receive emails, browse web pages, and access streaming media.

[0219] Although not shown, the server may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 601 in the server will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602, thereby realizing various functions, as follows:

[0220] When it is detected that the first application calls the local multimedia acquisition device of the acquisition terminal, the local multimedia acquisition device is controlled to acquire the original environment data, and the data configuration information used by the local multimedia acquisition device to acquire the original environment data is obtained, and the first application is installed in the acquisition terminal;

[0221] When the first application is in a state of being remotely controlled by the target terminal, a multimedia acquisition instruction is sent to the target terminal, where the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data;

[0222] Based on the data configuration information, the target environment data is processed to obtain updated target environment data, and the original environment data collected by the local multimedia collection device is replaced with the updated target environment data.

[0223] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0224] From the above, we can see that the accuracy of data collection is improved.

[0225] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0226] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the data acquisition methods provided in the embodiments of the present application. For example, the instructions can execute the following steps:

[0227] When it is detected that the first application calls the local multimedia acquisition device of the acquisition terminal, the local multimedia acquisition device is controlled to acquire the original environment data, and the data configuration information used by the local multimedia acquisition device to acquire the original environment data is obtained, and the first application is installed in the acquisition terminal;

[0228] When the first application is in a state of being remotely controlled by the target terminal, a multimedia acquisition instruction is sent to the target terminal, where the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data;

[0229] Based on the data configuration information, the target environment data is processed to obtain updated target environment data, and the original environment data collected by the local multimedia collection device is replaced with the updated target environment data.

[0230] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0231] According to one aspect of the present application, a computer software is provided, the computer program including a computer program / instruction, the computer program / instruction being stored in a computer-readable storage medium. A processor of an electronic device reads the computer program / instruction from the computer-readable storage medium, and the processor executes the computer program / instruction, so that the electronic device executes the method provided in various optional implementations of the data collection aspect provided in the above embodiments.

[0232] Since the instructions stored in the storage medium can execute the steps in any data collection method provided in the embodiments of the present application, the beneficial effects that can be achieved by any data collection method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0233] The above is a detailed introduction to a data acquisition method and related equipment provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data collection method, characterized in that: Applied to acquisition terminals, including: When it is detected that the first application calls the local multimedia acquisition device of the acquisition terminal, the local multimedia acquisition device is controlled to acquire the original environment data, and the data configuration information used by the local multimedia acquisition device to acquire the original environment data is obtained, and the first application is installed in the acquisition terminal; When the first application is in a state of being remotely controlled by the target terminal, sending a multimedia acquisition instruction to the target terminal, wherein the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data; Based on the data configuration information, the target environment data is processed to obtain updated target environment data, and the original environment data collected by the local multimedia collection device is replaced with the updated target environment data.

2. The data collection method according to claim 1, characterized in that: The data configuration information includes a data structure format and / or acquisition configuration parameters, wherein the data structure format is a format used by the acquisition terminal to encapsulate the original environment data, and the acquisition configuration parameters are configuration parameters set when the local multimedia acquisition device acquires the original environment data; The processing of the target environment data based on the data configuration information to obtain updated target environment data includes: Based on the data structure format, the target environment data is format converted. And / or based on the acquisition configuration parameters, adjusting the configuration parameters of the target environment data.

3. The data collection method according to claim 2, characterized in that: The local multimedia acquisition device and the target multimedia acquisition device are image acquisition devices, the original environment data and the target environment data are video data, the data structure format is the video format, and the acquisition configuration parameters include at least one of image color space format, resolution, and video frame timestamp.

4. The data collection method according to claim 1, characterized in that: The replacing the original environment data collected by the local multimedia collection device with the updated target environment data includes: Adding the updated target environment data to the data processing interface of the acquisition terminal; Based on the data processing interface of the acquisition terminal, the updated target environment data is rendered, and the updated target environment data is displayed in a preset area instead of the original environment data.

5. The data collection method according to claim 1, characterized in that: The sending of the multimedia acquisition instruction to the target terminal includes: Establishing a command transmission channel with the target terminal; Based on the instruction transmission channel, a multimedia acquisition instruction is sent to the target terminal.

6. The data collection method according to claim 5, characterized in that: The establishing of the command transmission channel with the target terminal includes: Initiating a communication connection request for the target terminal to a target server, so that the target server forwards the communication connection request to the target terminal; Based on the communication connection request, receiving response information returned by the target terminal through the target server; Based on the response information, an instruction transmission channel is established via the target server and connected to the target terminal.

7. The data collection method according to claim 1, characterized in that: The data collection method comprises: Establishing a point-to-point transmission channel with the target terminal; Based on the point-to-point transmission channel, the target environment data sent by the target terminal is received.

8. The data collection method according to claim 7, characterized in that: The establishing of a point-to-point transmission channel with the target terminal includes: Sending a session description protocol proposal to the target terminal through the target server; receiving a session description protocol response to the session description protocol proposal returned by the target terminal through the target server; Based on the session description protocol proposal, verify the session description protocol response to obtain a verification result; Based on the verification result, a point-to-point transmission channel is established with the target terminal.

9. A data collection method, characterized in that: Applied to target terminals, including: When receiving the multimedia acquisition instruction returned by the acquisition terminal, based on the multimedia acquisition instruction, calling the target multimedia acquisition device of the target terminal to collect the target environment data, wherein the acquisition terminal sends the multimedia acquisition instruction to the target terminal when detecting that the first application calls the local multimedia acquisition device of the acquisition terminal and determining that the first application is in a state of being remotely controlled by the target terminal; The target environment data is returned to the collection terminal.

10. The data collection method according to claim 9, characterized in that: The step of calling a target multimedia acquisition device of the target terminal to acquire target environment data based on the multimedia acquisition instruction includes: Based on the multimedia acquisition instruction, calling the target multimedia acquisition device, and obtaining a calling authorization prompt; According to the call authorization prompt, obtain the information to be verified; When the information to be verified passes the authority verification, the target multimedia acquisition device is controlled to acquire target environment data.

11. A data acquisition device, characterized in that: include: an acquisition unit, configured to, when detecting that a first application calls a local multimedia acquisition device of the acquisition terminal, control the local multimedia acquisition device to acquire original environment data, and acquire data configuration information used by the local multimedia acquisition device to acquire original environment data, wherein the first application is installed in the acquisition terminal; a sending unit, configured to send a multimedia acquisition instruction to the target terminal when the first application is in a state of being remotely controlled by the target terminal, wherein the multimedia acquisition instruction is used to instruct a target multimedia acquisition device of the target terminal to collect target environment data; The response unit is used to process the target environment data based on the data configuration information to obtain updated target environment data, and replace the original environment data collected by the local multimedia collection device with the updated target environment data.

12. A data acquisition device, characterized in that: include: The collecting unit is used for, when receiving the multimedia collecting instruction returned by the collecting terminal, calling the target multimedia collecting device of the target terminal to collect the target environment data based on the multimedia collecting instruction, wherein the collecting terminal sends the multimedia collecting instruction to the target terminal when detecting that the first application calls the local multimedia collecting device of the collecting terminal and determining that the first application is in a state of being remotely controlled by the target terminal; A returning unit is used to return the target environment data to the collection terminal.

13. A computer device, characterized in that: It comprises a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps in the data acquisition method according to any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the data acquisition method according to any one of claims 1 to 10.

15. Computer software, comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps in the data collection method according to any one of claims 1 to 10 are implemented.

Images