Data acquisition control system, data acquisition method, medium and program product

Abstract

The invention relates to the technical field of data acquisition, and discloses a data acquisition control system, a data acquisition method, a medium and a program product. The mobile terminal equipment module not only can automatically collect live broadcast audio and video stream data of any target live broadcast room in any target live broadcast APP in operation, but also can automatically collect live broadcast interaction information of the target live broadcast room at the same time, so that comprehensive collection of live broadcast content is realized, the types of collected data are greatly enriched, and the user experience is improved. Therefore, the collected data is more complete, and the actual situation in the live broadcasting room can be reflected more comprehensively. Therefore, by implementing the method and the device, the condition of low collection efficiency in the past is changed, and the required comprehensive live broadcast related data can be more timely and efficiently collected for the work of market supervision and the like.

Description

Technical Field

[0001] The present invention relates to the technical field of data acquisition, and in particular to a data acquisition control system and a data acquisition method, medium and program product. Background Art

[0002] With the rapid development of mobile Internet, mobile live broadcast apps are becoming more and more popular, and their market share in advertising and commodity trading is increasing. Therefore, for the relevant functional departments of market supervision, how to achieve effective supervision of live broadcast apps urgently requires a technological breakthrough.

[0003] Existing technologies for collecting content from live streaming apps mainly involve screen recording and crawler collection of live streaming history data. These technologies are inefficient and can only collect live streaming video data, but cannot collect interactive information during the live streaming process, such as pop-ups, likes data, subtitle information, product list information, etc. Summary of the invention

[0004] In view of this, the present invention provides a data acquisition control system and a data acquisition method, medium and program product to solve the problem that the existing technology for collecting content of live broadcast APP is mainly screen recording and crawler collection of live broadcast history data, which is inefficient and can only collect live broadcast video data, but cannot collect interactive information during the live broadcast process, such as pop-ups, likes data, subtitle information, product list information, etc.

[0005] In a first aspect, the present invention provides a data acquisition control system, the system comprising: a mobile terminal device module, an intelligent control module and a storage module; The intelligent control module is used to obtain the queue of tasks to be collected and send control instructions to the mobile terminal device module based on the queue of tasks to be collected; the mobile terminal device module is used to run the target live broadcast APP and collect the live audio and video stream data set and live broadcast interaction information set of the target live broadcast room in the target live broadcast APP based on the control instructions; the storage module is used to receive and store the live audio and video stream data set and live broadcast interaction information set sent by the mobile terminal device module.

[0006] The data acquisition and control system provided by the present invention, by receiving the control instructions sent by the intelligent control module, the mobile terminal device module can not only automatically collect the live audio and video stream data of any target live broadcast room in any target live broadcast APP in operation, but also automatically collect the live broadcast interaction information of the target live broadcast room at the same time, thereby realizing the comprehensive collection of live broadcast content, greatly enriching the types of collected data, making the collected data more complete, and being able to more comprehensively reflect the actual situation in the live broadcast room. Therefore, by implementing the present invention, the task queue to be collected is obtained through the intelligent control module, and the mobile terminal device module is commanded to collect data in an orderly manner, and then stored by the storage module, which changes the previous situation of low collection efficiency, and can collect the comprehensive live broadcast related data required for market supervision and other work in a more timely and efficient manner, which helps the relevant functional departments to better carry out effective supervision of live broadcast APPs from a technical level.

[0007] In an optional implementation, the mobile terminal device module includes: The automatic control submodule is used to start the target live broadcast APP based on the control instructions, and enter the target live broadcast room based on the control instructions when the target live broadcast APP is started; the automatic control submodule is also used to collect the live broadcast interaction information set and the live broadcast audio and video data set when entering the target live broadcast room.

[0008] The data acquisition and control system provided by the present invention can automatically start the target live broadcast APP and accurately enter the target live broadcast room through the control instruction, without manual operation one by one, which greatly improves the automation of the operation. Further, after entering the target live broadcast room, the automatic control submodule can be used to automatically collect the live broadcast interaction information set and the live broadcast audio and video data set, ensuring the continuity of data collection, avoiding the problem of data omission or untimely collection due to poor connection of operation steps, so that all kinds of key data in the live broadcast process, whether it is audio and video data reflecting the live broadcast content, or interactive information data reflecting the audience interaction situation, can be completely and continuously collected. Therefore, by implementing the present invention, the relevant data in the target live broadcast room can be efficiently and accurately obtained.

[0009] In an optional implementation, the mobile terminal device module further includes: The audio and video encoding push submodule is used to receive the live audio and video data set sent by the automatic control submodule, and digitally encode the live audio and video data set to obtain the live audio and video stream data set.

[0010] The data acquisition and control system provided by the present invention performs digital encoding processing on the live audio and video data set collected by the automatic control submodule through the audio and video encoding and pushing submodule, and can standardize the original audio and video data format, and can reduce the size of the data while ensuring the integrity of the core content of the data, thereby providing support for the subsequent improvement of the efficiency of the storage module to store data. Furthermore, it can also avoid problems such as transmission obstruction or storage failure caused by incompatible data formats.

[0011] In an optional embodiment, the storage module includes: The streaming media storage service submodule is used to receive and store the live audio and video stream data set sent by the audio and video encoding push submodule; the live information storage service submodule is used to receive the live interaction information set sent by the automatic control submodule and perform structured storage on the live interaction information set.

[0012] The data acquisition and control system provided by the present invention realizes classified storage of different types of data through the streaming media storage service submodule and the live broadcast information storage service submodule, avoids data loss or damage caused by problems in the storage link, ensures the integrity of various types of data collected from the live broadcast room, and improves the efficiency and accuracy of data management.

[0013] In an optional implementation, the intelligent control module includes: The task queue management submodule is used to obtain the task queue to be collected, parameter configuration requirements and task scheduling rules, and based on the parameter configuration requirements, schedule the target collection task in the task queue to be collected according to the task scheduling rules, and generate control instructions based on the target collection task.

[0014] The data acquisition control system provided by the present invention accurately schedules the target acquisition tasks according to the parameter configuration requirements and task scheduling rules, and the task queue management submodule avoids data redundancy and waste of resources caused by indiscriminate and disorderly acquisition. Furthermore, the control instructions are generated in combination with the target acquisition tasks, which ensures the scientificity and rationality of the control instructions, thereby providing support for the subsequent improvement of data acquisition quality and efficiency.

[0015] In an optional implementation, the intelligent control module further includes: a mobile terminal control interface submodule, which is used to receive control instructions and send the control instructions to the mobile terminal device module.

[0016] The data acquisition control system provided by the present invention can accurately send control instructions to the mobile terminal device module through the mobile terminal control interface submodule, thereby providing support for ensuring the orderly implementation of subsequent data acquisition operations.

[0017] In an optional implementation, the mobile terminal control interface submodule is connected to the mobile terminal device module via a TCP / IP network.

[0018] The data acquisition and control system provided by the present invention establishes a connection between the mobile terminal control interface submodule and the mobile terminal device module through the TCP / IP network, can fully utilize the reliable transmission mechanism of the TCP / IP protocol, and ensures the stability and reliability of control instruction transmission.

[0019] In a second aspect, the present invention provides a data acquisition method for use in a data acquisition control system of the first aspect or any corresponding embodiment thereof; the method comprises: The intelligent control module is used to obtain the task queue to be collected and send control instructions to the mobile terminal device module based on the task queue to be collected; based on the control instructions, the mobile terminal device module is used to collect the live audio and video stream data set and the live interaction information set of the target live room in the target live APP; the mobile terminal device module is used to send the live audio and video stream data set and the live interaction information set to the storage module for storage.

[0020] The data collection method provided by the present invention performs data collection through a data collection control system, thereby realizing comprehensive collection of live broadcast content, greatly enriching the types of collected data, making the collected data more complete, and being able to more comprehensively reflect the actual situation in the live broadcast room.

[0021] In a third aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the data collection method provided in the second aspect.

[0022] In a fourth aspect, the present invention provides a computer program product, comprising computer instructions, wherein the computer instructions are used to enable a computer to execute the data collection method provided in the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0024] Figure 1 is a structural block diagram of a data acquisition control system according to an embodiment of the present invention; Figure 2 is a flow chart of a data collection method according to an embodiment of the present invention; Figure 3It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0026] The embodiment of the present invention provides a data acquisition control system, which obtains a task queue to be collected through an intelligent control module, and orderly directs a mobile terminal device module to collect data, which is then stored by a storage module to achieve the effect of comprehensive collection of live content.

[0027] In this embodiment, a data acquisition control system is provided. Figure 1 As shown, the data acquisition and control system 1 includes: a mobile terminal device module 11 , an intelligent control module 12 and a storage module 13 .

[0028] Optionally, the intelligent control module 12 is used to obtain a queue of tasks to be collected, and send a control instruction to the mobile terminal device module 11 based on the queue of tasks to be collected.

[0029] The intelligent control module 12 includes a task queue management submodule 121 and a mobile terminal control interface submodule 122 .

[0030] Specifically, the task queue management submodule 121 can be used to obtain the task queue to be collected, parameter configuration requirements and task scheduling rules, and based on the parameter configuration requirements, the target collection task can be scheduled in the task queue to be collected according to the task scheduling rules, and a control instruction can be generated based on the target collection task.

[0031] Among them, the task queue to be collected represents the list of target live broadcast rooms on the target live broadcast APP to be collected; the parameter configuration requirements may include the specified live broadcast APP that needs to be collected, the live broadcast room on the APP, and the collection time and other requirements.

[0032] Furthermore, the task scheduling rules can include different rules such as random collection, designated collection, and continuous collection. For example, the random collection rule means that a live broadcast room can be randomly selected from the live broadcast room list to start the collection task; the designated collection rule is to collect data according to a pre-set specific live broadcast room order or condition; the continuous collection rule is applicable to long-term, uninterrupted data collection of certain live broadcast rooms. Furthermore, different rules will use different methods to schedule collection tasks from the queue, providing support for more efficient completion of large-scale collection tasks in the future.

[0033] First, the task queue management submodule 121 can sort the collection task queue (i.e., the target live broadcast room list) according to the information such as the live broadcast room start time. For example, the live broadcast rooms are arranged in the order of the start time, so that the live broadcast rooms that are about to start broadcasting or have just started broadcasting are arranged at the front of the queue, which is convenient for the subsequent collection work to be carried out in order, ensuring that the collection tasks can keep up with the live broadcast progress of the live broadcast room in time.

[0034] Secondly, if a random collection rule is adopted, the task queue management submodule 121 can randomly select a live broadcast room from the sorted or unsorted task queue to be collected as a target collection task. For example, among many live broadcast rooms to be collected, a number of live broadcast rooms are selected by a random algorithm and marked as the target live broadcast rooms for data collection next, without considering other features or order of the live broadcast rooms.

[0035] Furthermore, if a specified collection rule is adopted, the target collection task is determined strictly according to the pre-set conditions. For example, if the parameter configuration requirements clearly specify that the collection is to be carried out on a live broadcast platform with more than X million fans and a promotional activity, then the task queue management submodule 121 can accurately select the live broadcast room that meets these conditions in the entire task queue to be collected, and determine it as the target collection task.

[0036] Furthermore, for the continuous collection rule, if it is required to conduct long-term continuous data collection on several key live broadcast rooms, the task queue management submodule 121 can continuously mark these live broadcast rooms as target collection tasks. As long as the live broadcast room is in the broadcasting state, the collection work will be arranged periodically to ensure that the data changes of these live broadcast rooms over a longer period of time can be fully obtained.

[0037] Finally, after determining the specific target collection task, the task queue management submodule 121 can generate corresponding control instructions for each target collection task. Further, the control instruction can include specific operation information such as allowing the mobile terminal automatic control module to enter the target live broadcast room, time limit information for data collection according to the collection time in the parameter configuration requirements, etc., so that after receiving the instruction, the mobile terminal device module 11 clearly knows the specific requirements such as which live broadcast room to be in, how long to collect, and what aspects of data to collect, so that the live broadcast room data collection work can be carried out in an orderly manner.

[0038] Therefore, through the above process, according to the parameter configuration requirements and task scheduling rules, the task queue management submodule accurately schedules the target acquisition task, avoiding data redundancy and waste of resources caused by indiscriminate and disordered acquisition. Furthermore, the control instructions are generated in combination with the target acquisition task, ensuring the scientificity and rationality of the control instructions, thereby providing support for the subsequent improvement of data acquisition quality and efficiency.

[0039] Furthermore, the mobile terminal control interface submodule 122 may be used to send control instructions to the mobile terminal device module 11 .

[0040] The mobile terminal control interface submodule 122 is connected to the mobile terminal device module 11 via a TCP / IP network. Furthermore, the TCP / IP (Transmission Control Protocol / Internet Protocol) network represents the Transmission Control Protocol / Internet Protocol.

[0041] First, the mobile terminal control interface submodule 122 can establish a TCP connection with the mobile terminal device module 11 through the TCP / IP network. For example, a specific source IP address can be assigned to the mobile terminal control interface submodule 122, and the target IP address corresponding to the mobile terminal device module 11 can be obtained at the same time, and a one-to-one TCP connection link can be established between the two through a suitable port (such as a common specific port for data transmission communication).

[0042] Secondly, after the TCP connection is successfully established, the mobile control interface submodule 122 can package the control instructions generated by the task queue management submodule 121, add necessary header information (including source address, destination address, sequence number, confirmation number, etc. for data transmission security) according to the format and rules specified by the TCP / IP network protocol, and then send these control instructions to the mobile terminal device module 11 through the established TCP connection.

[0043] Optionally, the mobile terminal device module 11 is used to run the target live broadcast APP and collect the live audio and video stream data set and the live broadcast interaction information set of the target live broadcast room in the target live broadcast APP based on the control instruction.

[0044] The mobile terminal device module 11 includes: an automatic control submodule 111 and an audio and video encoding push submodule 112 .

[0045] First, the automatic control submodule 111 can be used to start the target live broadcast APP based on the control instruction, and when the target live broadcast APP is started, the target live broadcast room can be entered based on the control instruction.

[0046] Specifically, the control instruction may include specific operation information such as allowing the mobile terminal automatic control module to enter the target live broadcast room, time limit information for data collection according to the collection duration in the parameter configuration requirements, etc. Therefore, when the automatic control sub-module 111 receives the control instruction, it can start the target live broadcast APP based on the API call of the device system (such as Android system or IOS system, etc.) of the mobile terminal device corresponding to the mobile terminal device module 11 by opening the APP method.

[0047] Exemplarily, the automatic control submodule 111 can trigger the relevant functional modules responsible for starting the application program in the mobile terminal device system by interacting with the bottom layer of the mobile terminal device, so that the automatic control submodule 111 can automatically complete the startup process of the target live broadcast APP without manual click operation. For example, in the Android system, the automatic control submodule 111 can send a request to the system and call a method such as "startActivity" to successfully start the target live broadcast APP, just like the system automatically helps the user complete the action of clicking the APP icon to start the application.

[0048] Furthermore, when the target live broadcast APP is successfully started, the automatic control submodule 111 can further automatically control the APP interface to search for and navigate to the target live broadcast room entrance according to the live broadcast room name specified in the acquisition instruction.

[0049] Furthermore, in this process, the automatic control submodule 111 can simulate the user's operating behavior on the APP interface, such as automatically entering the keywords corresponding to the live broadcast room name in the search bar of the live broadcast APP, and then triggering the search operation (such as by calling the click, input and other operational methods of the corresponding elements of the APP interface, these methods are also based on the interaction mechanism between the Android system API and the APP itself).

[0050] Furthermore, after searching for the target live broadcast room, the automatic control sub-module 111 can continue to automatically trigger a click operation by identifying the interface elements (such as buttons, etc.) corresponding to the live broadcast room entrance, thereby smoothly navigating into the target live broadcast room. The entire process is fully automated and does not require human intervention, ensuring that the target live broadcast room required by the control instructions can be entered accurately and quickly.

[0051] Secondly, when entering the target live broadcast room, the automatic control submodule 111 can be used to collect the live broadcast interaction information set and the live broadcast audio and video data set.

[0052] Among them, the live broadcast interaction information set may include the content of controls such as text, pictures, pop-up windows, etc. presented on the target live broadcast room interface.

[0053] Specifically, after entering the target live broadcast room, the automatic control submodule 111 can collect various types of text content presented on the target live broadcast room interface. For example, the barrage comments sent by the audience can be identified by identifying the regional elements used to display the barrage in the live broadcast room interface (the text attributes of the specific view components of the interface can be obtained by using the mobile terminal device system API, etc.), and then the newly appeared barrage text content is captured at a certain frequency (such as every certain time interval), and it is sorted and recorded to form a collection of text information related to the barrage. At the same time, the text descriptions displayed by the anchor in the live broadcast room when introducing the product, the rules of the live broadcast room activities, and other fixed or dynamic text information can also be identified and collected in a similar way to ensure that all kinds of valuable text interaction information in the live broadcast room are covered.

[0054] Furthermore, for pictures that appear on the target live broadcast room interface, such as product pictures displayed when the anchor recommends products, live broadcast room background pictures, or pop-up prompt boxes with pictures in some interactive activities, etc. The automatic control submodule 111 can first locate the interface position where these pictures are located (by analyzing the interface layout and the view components corresponding to the pictures, etc., and obtaining relevant information with the help of the system mobile terminal device system), and then use image acquisition related technical means (can be by calling the screenshot function of the mobile terminal device system or directly obtaining the original data of the picture resources, etc., depending on the implementation mechanism of the live broadcast APP and the system support) to obtain these picture contents, and store and organize them accordingly, and include them in the live broadcast interaction information set to fully record the interactive elements in the form of pictures in the live broadcast room.

[0055] Furthermore, when various pop-up windows appear in the target live broadcast room, such as lottery activity pop-up windows, product discount reminder pop-up windows, etc., the automatic control sub-module 111 can monitor the appearance of pop-up windows on the interface in real time (by listening to change events of interface elements and using the mobile terminal device system API to detect newly appeared pop-up view components).

[0056] Furthermore, once a pop-up window appears, the automatic control submodule 111 can extract the text description, picture display and information carried by related buttons and other controls contained in the pop-up window (such as prize details in the lottery pop-up window, button text for participating in the lottery, etc.), and parse and record these contents to ensure that all interactive content presented in the form of pop-up windows and other controls in the live broadcast room can be accurately collected into the live broadcast interaction information set, thereby fully reflecting the interactive situation in the live broadcast room.

[0057] Through the above process, the automatic control submodule 111 can collect and form a live broadcast interaction information set of the target live broadcast room.

[0058] Furthermore, the automatic control submodule 111 can also work in collaboration with the audio acquisition module of the mobile terminal device (such as hardware devices such as microphones and corresponding drivers, operating system audio processing modules, etc.), and then can start the audio acquisition function by calling the relevant audio acquisition interface to obtain real-time sound information being played in the target live broadcast room, including the host's commentary sound, background music, the sound of the audience's microphone, and other sound data transmitted through the audio channel to form a live audio data set.

[0059] Furthermore, for video data, the automatic control submodule 111 can also use the video acquisition function of the mobile terminal device (cooperating with hardware such as the camera and the video processing related modules of the operating system). Furthermore, by calling the video acquisition interface of the mobile terminal device system, the automatic control submodule 111 can capture the video screen being played on the live broadcast room interface, and perform screen acquisition at a certain frame rate (such as 30 frames or 60 frames per second, etc., depending on the acquisition standard) to form a live video data set, which then forms a complete live audio and video data set together with the live audio data set, and can fully record the audio-visual content of the live broadcast room.

[0060] Finally, the audio and video encoding push submodule 112 can be used to receive the live audio and video data set sent by the automatic control submodule 111, and digitally encode the live audio and video data set to obtain a live audio and video stream data set.

[0061] Specifically, after receiving the live audio and video data set sent by the automatic control submodule 111, the audio and video encoding push submodule 112 can interact with the built-in video encoding function of the mobile terminal device itself, call the corresponding encoding interface and start the video encoding process.

[0062] Furthermore, H.264 encoding can be selected as the standard when encoding. H.264 encoding represents a widely used and efficient video encoding standard, which compresses and encodes the original video picture data through a series of complex algorithms. For example, the video picture can be divided into different macroblocks, and the key elements such as pixel information and motion vectors in each macroblock can be analyzed and encoded. By removing spatial redundancy (such as similar color areas, etc.) and temporal redundancy (similar picture content between adjacent frames, etc.) in the picture, the amount of video data can be effectively reduced, while ensuring that the video quality is within an acceptable range.

[0063] Furthermore, the audio and video encoding push submodule 112 may perform encoding operations on the video data frame by frame according to the specification of the above H.264 encoding standard, and convert the original video picture data into an encoded data form that complies with the standard.

[0064] Furthermore, the audio data part of the live audio and video data set can also be encoded using an audio encoding algorithm that is compatible with it. At the same time, although the video encoding uses H.264, the audio encoding can generally use a standard that works well with the video encoding and has efficient compression and sound quality assurance, such as AAC (Advanced Audio Coding) and other common audio encoding formats.

[0065] Furthermore, the audio and video encoding push submodule 112 can call the audio encoding related function module of the mobile terminal device, analyze and encode the sampling points, channel information, etc. in the audio data according to the selected audio encoding standard, and convert the original audio data into compressed encoded audio data suitable for network transmission.

[0066] Furthermore, after encoding the video and audio in the live audio and video data set respectively, the audio and video encoding push submodule 112 can integrate the encoded video and audio data according to a specific format specification to form a ts (Transport Stream) video stream, i.e., a live audio and video stream data set.

[0067] Among them, the ts video stream has a good encapsulation format, which can multiplex different types of data such as video and audio, so that it can be transmitted on the network in the form of a unified data stream, and supports the multiplexing and transmission of multiple programs (here it can be compared to the content of multiple live broadcast rooms, etc.), which facilitates data distribution in complex network environments.

[0068] Optionally, the storage module 13 is used to receive and store the live audio and video stream data set and the live interaction information set sent by the mobile terminal device module 11.

[0069] The storage module 13 includes a streaming media storage service submodule 131 and a live broadcast information storage service submodule 132 .

[0070] Optionally, the streaming media storage service submodule 131 is used to receive and store the live audio and video stream data set sent by the audio and video encoding push submodule 112.

[0071] Specifically, the streaming media storage service submodule 131 will first be in a listening waiting state, ready to receive the live audio and video stream data set sent from the audio and video encoding and pushing submodule 112. Among them, since one or more mobile terminal devices may simultaneously collect data and push audio and video stream data, the streaming media storage service submodule 131 has a corresponding network communication interface and data receiving mechanism, and can accurately identify and receive audio and video stream data from different sources.

[0072] For example, in a communication environment based on a network protocol (such as the TCP / IP protocol), the streaming media storage service submodule 131 can monitor connection requests from mobile terminal devices through a specific port. When the audio and video encoding push submodule 112 initiates a push operation, it establishes a connection with it and starts to receive a continuous stream of live audio and video stream data sets.

[0073] Furthermore, for the received live audio and video stream data set, the streaming media storage service submodule 131 can process it in a fragmented packaging manner.

[0074] Among them, fragment packaging means dividing the continuous audio and video stream data into multiple data pieces according to certain rules (such as time interval, data volume, etc.).

[0075] For example, a data slice is divided every minute or every time the data volume reaches a certain number of bytes, and then each data slice is packaged and the corresponding identification information is added (such as the starting timestamp of the data slice, the source terminal device number, the data slice sequence number, etc.). In this way, the originally large and continuous audio and video stream data can be organized into clearly identified and easy-to-manage data packets, which facilitates indexing, querying, and data recovery operations in the subsequent storage process.

[0076] Furthermore, the streaming media storage service submodule 131 can store the data packets after the fragmentation and packaging processing into the corresponding storage medium (such as disk array, cloud storage and other storage devices). Furthermore, when storing, it can be stored according to the preset storage structure and path rules, for example, folders are created according to the date, and the audio and video stream data of different live broadcast rooms collected at different time periods of the day are stored in the corresponding subfolders respectively, and the storage location information of each data packet will be recorded in the database or index file, so that the required audio and video stream data can be found quickly and accurately later, and the storage process of the entire live audio and video stream data set is completed to ensure the integrity and accessibility of the data.

[0077] Optionally, the live broadcast information storage service submodule 132 is used to receive the live broadcast interaction information set sent by the automatic control submodule 111, and perform structured storage on the live broadcast interaction information set.

[0078] Specifically, after receiving the live broadcast interaction information set sent by the automatic control submodule 111 in one or more mobile terminal devices, the live broadcast information storage service submodule 132 can perform structured storage on the live broadcast interaction information set.

[0079] Among them, for text information, the text encoding format can be unified (such as uniformly adopting UTF-8 encoding), unnecessary spaces, line breaks and other messy formats can be removed, and the information can be organized according to a certain structure (such as taking JSON format as an example, different types of text information can be classified into different fields such as barrage text and product introduction text); for image information, it can be converted into a unified image format (such as JPEG format, etc.), and the key attribute information of the image (such as image size, resolution, etc.) can be extracted and stored in a structured manner together with the image data; for pop-up window and other control information, the key elements contained therein (such as pop-up window title, button text, trigger conditions, etc.) can be parsed out and organized in a standardized structure, so that the originally disorganized various interactive information can be organized into a clear format that is easy to query and analyze.

[0080] Furthermore, after completing the formatting process, the live broadcast information storage service submodule 132 can store the sorted live broadcast interaction information set in a suitable storage medium (such as a relational database, a non-relational database or a file system, etc., depending on the overall architecture and requirements of the mobile terminal device system). Taking a relational database as an example, a corresponding table structure can be created (such as setting fields such as "live broadcast room ID", "information type (text, picture, etc.)", "specific content", and "collection time"), and different live broadcast rooms and different types of interaction information can be inserted into the corresponding table records according to their respective attributes to achieve structured storage.

[0081] The data acquisition and control system provided by the present embodiment, by receiving the control instructions sent by the intelligent control module, the mobile terminal device module can not only automatically collect the live audio and video stream data of any target live broadcast room in any target live broadcast APP in operation, but also automatically collect the live broadcast interaction information of the target live broadcast room at the same time, thereby realizing the comprehensive collection of live broadcast content, greatly enriching the types of collected data, making the collected data more complete, and being able to more comprehensively reflect the actual situation in the live broadcast room. Therefore, by implementing the present invention, the task queue to be collected is obtained through the intelligent control module, and the mobile terminal device module is commanded to collect data in an orderly manner, and then stored by the storage module, which changes the previous situation of low collection efficiency, and can collect the comprehensive live broadcast related data required for market supervision and other work in a more timely and efficient manner, which helps the relevant functional departments to better carry out effective supervision of live broadcast APPs from a technical level.

[0082] According to an embodiment of the present invention, a data collection method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0083] In this embodiment, a data acquisition method is provided, which can be used in the data acquisition control system 1 provided in the above embodiment of the present invention. Figure 2 is a flow chart of a data collection method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps: Step S201: using the intelligent control module to obtain the task queue to be collected and sending a control instruction to the mobile terminal device module based on the task queue to be collected.

[0084] For the specific process, reference may be made to the functional description and interaction process description of the intelligent control module 12 and the mobile terminal device module 11 in the data acquisition and control system 1 in the above embodiment, which will not be repeated here.

[0085] Step S202, based on the control instruction, using the mobile terminal device module to collect the live audio and video stream data set and the live interaction information set of the target live room in the target live APP.

[0086] The specific process can refer to the functional description of the mobile terminal device module 11 in the data acquisition and control system 1 in the above embodiment, which will not be repeated here.

[0087] Step S203: Use the mobile terminal device module to send the live audio and video stream data set and the live interaction information set to the storage module for storage.

[0088] For the specific process, reference may be made to the functional description and interaction process description of the mobile terminal device module 11 and the storage module 13 in the data acquisition and control system 1 in the above embodiment, which will not be repeated here.

[0089] The data collection method provided in this embodiment performs data collection through a data collection control system, thereby realizing comprehensive collection of live broadcast content, greatly enriching the types of collected data, and making the collected data more complete and able to more comprehensively reflect the actual situation in the live broadcast room.

[0090] The embodiment of the present invention also provides a computer device for executing the above Figure 2 The data collection method shown.

[0091] See also Figure 3 , Figure 3 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 3 As shown, the computer device comprises: one or more processors 10, memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components utilize different buses to communicate with each other, and can be installed on a common mainboard or installed in other ways as required. The processor can process the instructions executed in the computer device, including instructions stored in the memory or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories. Equally, multiple computer devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 3 A processor 10 is taken as an example.

[0092] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0093] The memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiment.

[0094] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0095] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0096] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0097] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0098] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0099] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A data acquisition control system, characterized in that: The system comprises: a mobile terminal device module, an intelligent control module and a storage module; The intelligent control module is used to obtain the task queue to be collected, and send a control instruction to the mobile terminal device module based on the task queue to be collected; The mobile terminal device module is used to run the target live broadcast APP and collect the live broadcast audio and video stream data set and the live broadcast interaction information set of the target live broadcast room in the target live broadcast APP based on the control instruction; The storage module is used to receive and store the live audio and video stream data set and the live interaction information set sent by the mobile terminal device module.

2. The system according to claim 1, characterized in that The mobile terminal device module comprises: An automatic control submodule, used to start the target live broadcast APP based on the control instruction, and enter the target live broadcast room based on the control instruction when the target live broadcast APP is started; The automatic control submodule is also used to collect the live broadcast interaction information set and the live broadcast audio and video data set when entering the target live broadcast room.

3. The system according to claim 2, characterized in that The mobile terminal device module also includes: The audio and video encoding push submodule is used to receive the live audio and video data set sent by the automatic control submodule, and digitally encode the live audio and video data set to obtain the live audio and video stream data set.

4. The system according to claim 3, characterized in that The storage module comprises: A streaming media storage service submodule, used for receiving and storing the live audio and video stream data set sent by the audio and video encoding push submodule; The live broadcast information storage service submodule is used to receive the live broadcast interaction information set sent by the automatic control submodule and perform structured storage on the live broadcast interaction information set.

5. The system according to claim 1, characterized in that The intelligent control module comprises: The task queue management submodule is used to obtain the task queue to be collected, parameter configuration requirements and task scheduling rules, and based on the parameter configuration requirements, schedule the target collection task in the task queue to be collected according to the task scheduling rules, and generate the control instruction based on the target collection task.

6. The system according to claim 5, characterized in that The intelligent control module also includes: The mobile terminal control interface submodule is used to receive the control instruction and send the control instruction to the mobile terminal device module.

7. The system according to claim 6, characterized in that The mobile terminal control interface submodule is connected to the mobile terminal device module via a TCP / IP network.

8. A data collection method, characterized in that: Used for the data acquisition control system according to any one of claims 1 to 7; the method comprises: Using the intelligent control module to obtain the task queue to be collected and sending a control instruction to the mobile terminal device module based on the task queue to be collected; Based on the control instruction, the mobile terminal device module is used to collect a live audio and video stream data set and a live interaction information set of a target live broadcast room in a target live broadcast APP; The mobile terminal device module is used to send the live audio and video stream data set and the live interactive information set to the storage module for storage.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the data collection method described in claim 8.

10. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions are used to cause a computer to execute the data collection method according to claim 8.

Images