Distributed audio and video recording system and method

Abstract

The invention relates to a distributed audio and video recording system and method. Comprising a mobile phone processing unit, an external storage unit and at least one audio and video acquisition unit, and the audio and video acquisition unit comprises a wearable audio and video acquisition unit and / or a fixed point location type audio and video acquisition unit; the mobile phone processing unit is in wireless communication connection with the audio and video acquisition unit, and the external storage unit is in communication connection with the mobile phone processing unit through a data interface; the mobile phone processing unit establishes one-to-many connection with the plurality of audio and video acquisition units through a wireless network; the audio and video acquisition unit performs audio and video acquisition and data transmission; and the mobile phone processing unit stores the audio and video data acquired by the audio and video acquisition unit to the built-in storage module or the external storage unit. Through the two-stage storage module of the mobile phone, the problem that a traditional acquisition device is limited in storage is solved, the requirement for storing a large amount of video and audio data for a long time can be met, and the data is stored in a unified mode and convenient to manage.

Description

Technical Field

[0001] This invention relates to the field of audio and video recording technology, and in particular to a distributed audio and video recording system and method. Background Technology

[0002] With the increasing demand for audio and video recording, traditional recording methods are gradually revealing many limitations. Currently, common audio and video recording devices such as recorders, action cameras, and fixed camcorders mostly operate in a standalone mode, requiring each device to handle storage, encoding / decoding, and management independently. This mode presents the following problems: 1. Limited storage resources: The built-in storage capacity of a single recording device is limited. If long-term or high-definition recording is required, insufficient storage may occur. Furthermore, the storage expansion method is relatively cumbersome, and it is difficult to manage the storage data of different devices in a unified manner.

[0003] 2. Insufficient computing power: In pursuit of miniaturization and low power consumption, most acquisition devices have weak computing power and cannot complete complex tasks such as audio and video encoding and decoding, image content recognition, classification and retrieval. As a result, the data needs to be exported to professional equipment for processing, which is inconvenient and inefficient.

[0004] 3. Poor device coordination: In scenarios requiring multi-view and multi-directional recording, if multiple independent recording devices are used, the devices cannot automatically connect and work together. Data must be exported separately and then integrated, which is not only cumbersome but may also lead to data loss and time synchronization issues.

[0005] 4. Inconvenient management: Each independent recording device requires separate parameter configuration and status monitoring. When there are many devices, the management difficulty increases significantly, and it is difficult to grasp the working status of all devices in real time. Summary of the Invention

[0006] This invention provides a distributed audio and video recording system and method, which uses a mobile phone as the storage and computing core. It achieves distributed acquisition of audio and video data through multi-form acquisition units, and then uses WLAN to transmit the data to the mobile phone for unified processing and management, effectively improving the flexibility, efficiency and convenience of audio and video recording.

[0007] The technical solution of the present invention is as follows: A distributed audio and video recording system, comprising a mobile phone processing unit, an external storage unit, and at least one audio and video acquisition unit, wherein the audio and video acquisition unit includes a wearable audio and video acquisition unit and / or a fixed-point audio and video acquisition unit; The mobile phone processing unit is wirelessly connected to the audio and video acquisition unit, and the external storage unit is wirelessly connected to the mobile phone processing unit through a data interface. The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data. The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data; The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

[0008] Furthermore, the audio and video acquisition unit includes: a wireless communication module, an audio and video acquisition module, and a status monitoring module, wherein the audio and video acquisition module and the status monitoring module are connected by the wireless communication module; The audio and video acquisition module is used to acquire video and audio, the wireless communication module is used to perform wireless communication, and the status monitoring module is used to monitor the status of the audio and video acquisition unit.

[0009] Furthermore, the mobile phone processing unit includes: a processing module, a wireless communication module, and a built-in storage module; The processing module can execute an application management program and install an application program for controlling the audio and video acquisition unit. The wireless communication module is used for wireless communication, and the built-in storage module is used to store the audio and video data acquired by the audio and video acquisition unit.

[0010] Furthermore, the application includes the following functions: Automatic discovery and connection: Automatically scans for surrounding audio and video acquisition units. After user confirmation, the mobile phone processing unit and the audio and video acquisition units establish a one-to-many communication connection through a wireless network. Parameter configuration: Based on the user's actual needs, configure the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data; Data encoding and decoding: Receive audio and video data collected by the audio and video acquisition unit, encode and decode the audio and video data, and store the processed audio and video data in the built-in storage module or external storage unit; Data Management: Displays a list of audio and video data in the built-in storage module or external storage unit, allowing users to view, play, delete, back up, and export the audio and video data; Audio and video analysis: Based on the computing power of mobile phones, it performs content recognition, content classification, and content retrieval on encoded and decoded audio and video data.

[0011] Furthermore, the content recognition includes: identifying people, objects, and scenes in the video frame using an image recognition algorithm, and identifying speech in the audio using an audio recognition algorithm.

[0012] Furthermore, the content classification includes: automatically classifying audio and video data according to scene type and / or content theme based on the recognition results.

[0013] Furthermore, the content retrieval includes: users quickly retrieving categorized audio and video data using keywords.

[0014] Another technical solution of the present invention is as follows: a distributed audio and video recording method, applied to any of the above-described distributed audio and video recording systems, comprising: The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data. The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data.

[0015] The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

[0016] The beneficial effects of this invention are: The storage capacity of this invention is greatly improved: by using the two-level storage module of the mobile phone (built-in storage + external storage), the problem of limited storage of traditional acquisition devices is solved, which can meet the storage needs of long-term and large-scale audio and video data, and the unified storage of data makes it easy to manage.

[0017] Efficient utilization of computing power: Using the mobile phone as the computing core, it fully utilizes the powerful processor and AI computing capabilities of the mobile phone to achieve unified encoding and decoding and intelligent analysis (recognition, classification, retrieval) of multi-source audio and video data. It does not require a professional computer and is convenient and efficient to operate.

[0018] Strong device collaboration: It supports one-to-many connection between mobile phones and multiple acquisition devices, realizing distributed acquisition from multiple perspectives and directions. Data is transmitted to mobile phones in real time for centralized processing, avoiding the problems of data dispersion and integration difficulties of traditional independent devices. At the same time, all devices can be managed in a unified manner through management applications, reducing management difficulty.

[0019] Flexibility and wide applicability: The acquisition device supports multiple forms (wearable cameras, fixed cameras, etc.), and the appropriate acquisition device can be selected according to different scenarios (sports, meetings, security). The mobile phone is convenient to carry as the core device and is suitable for various indoor and outdoor environments.

[0020] User experience optimization: The management application provides a visual operation interface, supports functions such as automatic connection discovery, real-time status monitoring, and intelligent search, which simplifies the user's operation process, reduces manual intervention, and improves the user's convenience and intelligent experience. Attached Figure Description

[0021] Figure 1 This is a schematic diagram of the structure of the present invention. Detailed Implementation

[0022] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments. The described embodiments are merely some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0023] In one technical solution of the present invention, Figure 1 This is a structural diagram illustrating the specific structure of a distributed audio and video recording system according to the present invention, as shown below. Figure 1 As shown, the present invention includes: It includes a mobile phone processing unit, an external storage unit, and at least one audio and video acquisition unit, wherein the audio and video acquisition unit includes a wearable audio and video acquisition unit and / or a fixed-point audio and video acquisition unit.

[0024] The mobile phone processing unit is wirelessly connected to the audio and video acquisition unit, and the external storage unit is connected to the mobile phone processing unit via a data interface.

[0025] The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data.

[0026] The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data.

[0027] The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

[0028] The mobile phone processing unit establishes a one-to-many connection with the audio and video acquisition unit to capture video recordings from multiple perspectives and store them in the built-in storage module or external storage unit. The use of external storage can effectively expand the storage capacity, solving the problem of limited storage in traditional acquisition devices. It can meet the storage needs of long-term, large-volume audio and video data, and the unified storage of data facilitates management.

[0029] In one embodiment of this technical solution, the audio and video acquisition unit includes: a wireless communication module, an audio and video acquisition module, and a status monitoring module, wherein the audio and video acquisition module and the status monitoring module are connected by the wireless communication module; The audio and video acquisition module is used to acquire video and audio, the wireless communication module is used to perform wireless communication, and the status monitoring module is used to monitor the status of the audio and video acquisition unit.

[0030] The audio and video acquisition module includes an image sensor and an audio sensor for acquiring video and audio data. The image sensor supports video acquisition at different resolutions (720P, 1080P, 4K) and frame rates (24fps, 30fps, 60fps), while the audio sensor supports audio acquisition at different sampling rates (44.1kHz, 48kHz) and number of channels (mono, stereo).

[0031] The wireless communication module uses WLAN communication, specifically Wi-Fi 5, Wi-Fi 6, or other wireless communication technologies that conform to the IEEE 802.11 standard, to transmit the collected audio and video data to the mobile phone processing unit in real time, and at the same time receive control commands (parameter configuration commands, status query commands) sent by the mobile phone processing unit.

[0032] Status monitoring module: Includes power sensor, storage status sensor, operating temperature sensor, etc., used to monitor the power, remaining storage space, operating temperature and other status information of the acquisition device in real time, and feed it back to the mobile phone processing unit through WLAN communication module.

[0033] In one embodiment of this technical solution, the mobile phone processing unit includes: a processing module, a wireless communication module, and a built-in storage module.

[0034] The processing module can execute an application management program and install an application program for controlling the audio and video acquisition unit. The wireless communication module is used for wireless communication, and the built-in storage module is used to store the audio and video data acquired by the audio and video acquisition unit.

[0035] The processing module is the core processor of the mobile phone, the wireless communication module adopts WLAN communication, specifically Wi-Fi 5, Wi-Fi 6 or other wireless communication technologies that conform to the IEEE 802.11 standard, and the built-in storage module is a flash memory chip or a ROM chip.

[0036] The application includes the following functions: Automatic discovery and connection: Automatically scans for surrounding audio and video acquisition units. After user confirmation, the mobile phone processing unit and the audio and video acquisition units establish a one-to-many communication connection through a wireless network. Parameter configuration: Based on the user's actual needs, configure the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data; Data encoding and decoding: Receive audio and video data collected by the audio and video acquisition unit, encode and decode the audio and video data, and store the processed audio and video data in the built-in storage module or external storage unit; Data Management: Displays a list of audio and video data in the built-in storage module or external storage unit, allowing users to view, play, delete, back up, and export the audio and video data; Audio and video analysis: Based on the computing power of mobile phones, it performs content recognition, content classification, and content retrieval on encoded and decoded audio and video data.

[0037] The content recognition includes: identifying people, objects, and scenes in video footage using image recognition algorithms, and identifying speech in audio using audio recognition algorithms. The content classification includes: automatically classifying audio and video data according to scene type and / or content theme based on the recognition results. The content retrieval includes: allowing users to quickly retrieve classified audio and video data using keywords.

[0038] The mobile phone processing unit is a smartphone with a dedicated management application installed. As the storage core, computing core, and management core of the entire system, it has the following functional modules: WLAN communication module: Matches the WLAN communication module of the audio and video acquisition unit, supports one-to-many communication connections, and can establish stable wireless connections with multiple audio and video acquisition units at the same time to realize the reception of audio and video data and the transmission of control commands.

[0039] Encoding / decoding module: Based on the phone's own processor, it performs unified encoding and decoding processing on the received multi-source audio and video data; it supports mainstream audio and video encoding formats and can automatically adjust encoding parameters according to storage requirements and network bandwidth, so as to reduce data storage space and transmission bandwidth consumption while ensuring audio and video quality.

[0040] Two-tier storage module: including built-in storage submodule and external storage submodule; the built-in storage submodule utilizes the phone's own storage space for temporary storage of real-time received audio and video data and key data after encoding and decoding; the external storage submodule supports connection to external storage devices (such as portable hard drives) via OTG interface for long-term storage of large amounts of audio and video data. When the remaining space in the built-in storage submodule is lower than a preset threshold, the data is automatically migrated to the external storage submodule to avoid data loss due to insufficient storage.

[0041] Audio / Video Analysis Module: Leveraging the AI ​​computing capabilities of mobile phones, this module performs content recognition, classification, and retrieval on encoded and decoded audio / video data; specifically including: Content recognition: Identifies people, objects, and scenes (such as people, vehicles, landscapes, and indoor scenes) in video footage using image recognition algorithms, and identifies speech in audio using audio recognition algorithms; Content Classification: Based on the recognition results, the audio and video data are automatically classified according to scene type and content theme (such as sports, travel, food); Intelligent search: It allows users to quickly search categorized audio and video data using keywords (such as "traffic lights" or "cars") without having to manually browse large amounts of data.

[0042] Management Application Module: Provides a visual user interface for dedicated applications installed on the phone, with the following functions: Automatic discovery and connection: When the audio and video acquisition unit is turned on and within the WLAN signal coverage area of ​​the mobile phone, the management application can automatically scan and discover the surrounding acquisition devices. After the user confirms, a connection can be established; it supports remembering the acquisition devices that have been connected, and can automatically reconnect the next time it is turned on. Status monitoring: Real-time display of status information such as battery level, remaining storage space, working mode (e.g., recording, standby), and operating temperature of connected data acquisition devices; when the battery level of the data acquisition device is lower than the preset threshold or the storage space is insufficient, a reminder notification will be issued. Parameter configuration: It supports users to configure the audio and video acquisition parameters (resolution, frame rate, audio sampling rate) and transmission parameters (transmission bandwidth, compression ratio) of the acquisition device in a unified or individual manner. The configuration command is sent to the audio and video acquisition unit through the WLAN communication module. Data Management: Displays a list of audio and video data in the phone's two-level storage modules, allowing users to view, play, delete, export, and back up the data.

[0043] The workflow of this invention is as follows: Device startup and connection: Start the management application on the mobile phone and each audio and video acquisition unit. The management application automatically scans and discovers the surrounding acquisition devices. After user confirmation, the mobile phone and the acquisition device establish a one-to-many communication connection via WLAN. Parameter configuration: Users can configure the audio and video acquisition parameters, transmission parameters, and working modes of each acquisition device through the mobile management application according to actual needs, and send configuration commands to the corresponding acquisition device. Audio and video acquisition and transmission: The acquisition device starts the audio and video acquisition module according to the configuration parameters, acquires video and audio data, and transmits the real-time data to the mobile phone core unit through the WLAN communication module; Data processing and storage: After the WLAN communication module of the mobile phone core unit receives multi-source audio and video data, the encoding and decoding module performs unified encoding and decoding processing; the processed data is first stored in the built-in storage sub-module, and when the built-in storage space is insufficient, it is automatically migrated to the external storage sub-module; Audio and video analysis and management: The audio and video analysis module performs content recognition and classification on the encoded and decoded data. Users can find the data they need through the intelligent search function of the management application, and can also view, play, back up and export the data. Status monitoring and alerts: Throughout the entire operation, the mobile management application receives real-time status information from the data acquisition device. When abnormal situations such as low battery or insufficient storage space occur, timely alerts are issued, and users can take appropriate actions based on the alerts.

[0044] In another technical solution of the present invention, a distributed audio and video recording method is provided, applied to any of the above-described distributed audio and video recording systems, comprising: The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data. The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data; The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

[0045] When using this invention, the specific steps are as follows: Step 1: Device Deployment and Connection Install the management app on your mobile phone and connect it to an external hard drive via OTG; place multiple data acquisition devices in the preset locations, power them on, and enable WLAN. Open the management app, which will automatically scan and discover the data acquisition devices. Select and confirm to complete the connection, and the status will display "Connected".

[0046] Step 2: Parameter Configuration and Recording Start Access the parameter configuration function of the management application, set the resolution to 1080P, frame rate to 30fps, and working mode to "manual recording," then click "application configuration" to synchronize the command. After configuration, click "start recording," and the three acquisition devices will simultaneously collect audio and video data, transmitting it to the mobile phone in real time via WLAN.

[0047] Step 3: Data Processing and Status Monitoring The mobile phone's codec module processes the received data, generates standard video files, prioritizes storing them in the internal storage, and automatically migrates them to an external hard drive when insufficient, without interrupting recording. The management application displays the acquisition device's battery level and storage capacity in real time, and pops up a reminder when the battery level is below 20% or storage is insufficient; when the external hard drive is disconnected, it automatically switches to internal storage and prompts an error, and data is migrated after the external hard drive is restored.

[0048] Step 4: Stop Recording and Manage Data Clicking "Stop Recording" will stop the recording device, allowing the phone to complete the remaining data processing and storage. When the system is idle and the battery is fully charged, the audio and video data will be automatically analyzed and identified in the background. The "Data Management" interface allows you to play, export / backup, share, or delete data; you can also quickly find target segments using keyword searches.

[0049] Step 5: System shutdown and storage In the management application, select "Disconnect All Connections" to put the data acquisition device into low-power standby mode. Disconnect the phone from the external hard drive and organize the accessories.

[0050] Finally, it should be noted that the above specific embodiments are only used to illustrate the technical solutions of the present invention and not to limit it. Although the present invention has been described in detail with reference to examples, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A distributed audio and video recording system, characterized in that, It includes a mobile phone processing unit, an external storage unit, and at least one audio and video acquisition unit, wherein the audio and video acquisition unit includes a wearable audio and video acquisition unit and / or a fixed-point audio and video acquisition unit; The mobile phone processing unit is wirelessly connected to the audio and video acquisition unit, and the external storage unit is wirelessly connected to the mobile phone processing unit through a data interface. The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data. The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data; The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

2. The distributed audio and video recording system as described in claim 1, characterized in that, The audio and video acquisition unit includes: a wireless communication module, an audio and video acquisition module, and a status monitoring module, wherein the audio and video acquisition module and the status monitoring module are connected by the wireless communication module. The audio and video acquisition module is used to acquire video and audio, the wireless communication module is used to perform wireless communication, and the status monitoring module is used to monitor the status of the audio and video acquisition unit.

3. The distributed audio and video recording system as described in claim 1, characterized in that, The mobile phone processing unit includes: a processing module, a wireless communication module, and a built-in storage module; The processing module can execute an application management program and install an application program for controlling the audio and video acquisition unit. The wireless communication module is used for wireless communication, and the built-in storage module is used to store the audio and video data acquired by the audio and video acquisition unit.

4. The distributed audio and video recording system as described in claim 3, characterized in that, The application includes the following functions: Automatic discovery and connection: Automatically scans for surrounding audio and video acquisition units. After user confirmation, the mobile phone processing unit and the audio and video acquisition units establish a one-to-many communication connection through a wireless network. Parameter configuration: Based on the user's actual needs, configure the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data; Data encoding and decoding: Receive audio and video data collected by the audio and video acquisition unit, encode and decode the audio and video data, and store the processed audio and video data in the built-in storage module or external storage unit; Data Management: Displays a list of audio and video data in the built-in storage module or external storage unit, allowing users to view, play, delete, back up, and export the audio and video data; Audio and video analysis: Based on the computing power of mobile phones, it performs content recognition, content classification, and content retrieval on encoded and decoded audio and video data.

5. The distributed audio and video recording system as described in claim 4, characterized in that, The content recognition includes: identifying people, objects, and scenes in video footage using image recognition algorithms, and identifying speech in audio using audio recognition algorithms.

6. The distributed audio and video recording system as described in claim 4, characterized in that, The content classification includes: automatically classifying audio and video data according to scene type and / or content theme based on the recognition results.

7. The distributed audio and video recording system as described in claim 4, characterized in that, The content retrieval includes: users quickly searching categorized audio and video data using keywords.

8. A distributed audio and video recording method, characterized in that, The distributed audio and video recording system according to any one of claims 1-7 includes: The mobile phone processing unit establishes a one-to-many connection with multiple audio and video acquisition units through a wireless network, and configures the audio and video acquisition parameters, transmission parameters, and working modes of each audio and video acquisition unit to form corresponding configuration data. The audio and video acquisition unit performs audio and video acquisition and data transmission according to the configuration data; The mobile phone processing unit stores the audio and video data collected by the audio and video acquisition unit into the built-in storage module or the external storage unit.

Images