Audio data storage method and device for multiple camera devices and electronic device

Abstract

The invention provides an audio data storage method and device for multiple camera devices and an electronic device, and relates to the technical field of camera shooting, and the method comprises the steps: obtaining first audio data collected by each camera device located in the same region; determining a first similarity between every two pieces of first audio data; determining at least two pieces of reference audio data based on each first similarity, and determining camera equipment corresponding to each piece of reference audio data as reference camera equipment; determining first audio quality of each reference audio data; and determining target audio data based on each first audio quality, and correspondingly storing the storage path of the target audio data and the identifier of each reference camera device. According to the invention, only the target audio data is associated with the identifier of each reference camera device and then is stored, and the audio data collected by each reference camera device does not need to be stored, so that the storage space occupied by the repeated audio data is effectively reduced, and the storage resources are saved.

Description

Technical Field

[0001] The present invention relates to the field of video camera technology, and in particular to an audio data storage method, device and electronic equipment for multiple video camera devices. Background Art

[0002] Video surveillance is an important part of the security system. At the intersection of road traffic monitoring, multiple cameras are usually deployed for different monitoring purposes. Or in a home environment, multiple cameras are deployed in one space to ensure that there are no blind spots in the monitoring. Usually, the camera is connected to a cloud service platform or NVR (network video recorder). The camera stores the collected audio and video data in the storage medium of the cloud service platform or NVR for later viewing.

[0003] In the related art, the audio data collected by each camera is usually stored in a storage medium respectively.

[0004] However, for cameras that are close or in the same space, the collected audio data is basically the same, and separately storing the audio data collected by each camera will cause a waste of storage resources. Summary of the invention

[0005] In view of the problems existing in the prior art, the embodiments of the present invention provide an audio data storage method and device for a multi-camera device and an electronic device.

[0006] The present invention provides an audio data storage method for a multi-camera device, comprising:

[0007] Acquire first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0008] Determine a first similarity between every two of the first audio data;

[0009] Determine at least two reference audio data based on each of the first similarities, and determine the camera device corresponding to each of the reference audio data as a reference camera device;

[0010] determining a first audio quality of each of the reference audio data;

[0011] Target audio data is determined based on each of the first audio qualities, and storage paths of the target audio data are stored correspondingly to identifiers of each of the reference camera devices.

[0012] The present invention also provides an audio data storage device for a multi-camera device, comprising:

[0013] A first acquisition unit is used to acquire first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0014] A first determining unit, configured to determine a first similarity between every two of the first audio data;

[0015] A second determining unit, configured to determine at least two reference audio data based on each of the first similarities, and determine a camera corresponding to each of the reference audio data as a reference camera device;

[0016] A third determining unit, configured to determine a first audio quality of each of the reference audio data;

[0017] The first storage unit is used to determine target audio data based on each of the first audio qualities, and store the storage paths of the target audio data in correspondence with the identifiers of the reference camera devices.

[0018] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, an audio data storage method for a multi-camera device as described above is implemented.

[0019] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the audio data storage method of the multi-camera device as described in any one of the above is implemented.

[0020] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method for storing audio data of a multi-camera device as described above is implemented.

[0021] The audio data storage method, device and electronic device for multiple camera devices provided by the present invention obtain the first audio data collected by each camera device located in the same area, determine at least two reference audio data based on the first similarity between each two first audio data, determine the camera device corresponding to each reference audio data as the reference camera device, determine the first audio quality of each reference audio data, determine the target audio data based on each first audio quality, and finally store the storage path of the target audio data in correspondence with the identification of each reference camera device. It can be seen that the present invention determines the reference camera device corresponding to the similar audio data based on the first audio data collected by each camera device in the same area, and then determines the final target audio data based on the audio quality of the reference audio data collected by each reference camera device. The target audio data only needs to be associated with the identification of each reference camera device and then stored, and there is no need to store the audio data collected by each reference camera device, which effectively reduces the storage space occupied by repeated audio data and saves storage resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 This is one of the flow charts of the audio data storage method of a multi-camera device provided by an embodiment of the present invention;

[0024] Figure 2 This is a second flow chart of the audio data storage method of a multi-camera device provided by an embodiment of the present invention;

[0025] Figure 3 This is a third flow chart of the audio data storage method of a multi-camera device provided by an embodiment of the present invention;

[0026] Figure 4 This is a fourth flow chart of the audio data storage method of a multi-camera device provided by an embodiment of the present invention;

[0027] Figure 5 is a schematic diagram of the structure of an audio data storage device for a multi-camera device provided by an embodiment of the present invention;

[0028] Figure 6 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] Video surveillance is an important part of the security system. At the monitoring intersection of road traffic, multiple cameras are usually deployed to monitor different targets. Or in a home environment, multiple cameras are deployed in one space to ensure that there are no blind spots in the monitoring. Usually, the cameras are connected to the cloud service platform or NVR (network video recorder), and the cameras store the collected audio and video data in the storage medium of the cloud service platform or NVR for subsequent review. When storing, the audio and video data collected by each camera are usually stored separately in the storage medium. However, for cameras that are close or in the same space, it is reasonable to store their video data separately because the monitoring positions are different. However, the audio data collected by cameras that are close or in the same space are basically the same, and each camera stores its collected audio data separately, resulting in a waste of storage resources. Although audio data is smaller than video data, the longer the monitoring system works continuously, the more space the audio data occupies. And the more cameras there are in the same space, the more space similar audio data occupies.

[0031] Based on this, an embodiment of the present invention provides an audio data storage method for multiple camera devices. Based on the first audio data collected by each camera device in the same area, the reference camera device corresponding to the similar audio data is determined, and then the final target audio data is determined based on the audio quality of the reference audio data collected by each reference camera device. Only the target audio data needs to be associated with the identifier of each reference camera device and then stored. There is no need to store the audio data collected by each reference camera device, thereby saving storage resources.

[0032] Combine the following Figure 1-Figure 4 The audio data storage method of the multi-camera apparatus of the present invention is described.

[0033] The execution subject of the method can be an electronic device such as a computer, NVR, server, cloud server or server cluster, or an audio data storage device of a multi-camera device set in the electronic device, and the audio data storage of the multi-camera device can be implemented by software, hardware or a combination of the two. The method can be applied to any scenario where audio data needs to be stored, for example, in a scenario where multiple cameras are deployed at a monitoring intersection of road traffic, or in other scenarios where multiple cameras are deployed in the same area.

[0034] Figure 1 FIG. 1 is a flow chart of an audio data storage method for a multi-camera device provided by an embodiment of the present invention. Figure 1 As shown, the audio data storage method of the multi-camera device includes the following steps:

[0035] Step 101: Acquire first audio data collected by various camera devices located in the same area; each of the first audio data is audio data of the same time period.

[0036] For example, the same area refers to the same intersection or the same room, and the deployment positions of the cameras in the same area are close. After the camera is registered with the electronic device and goes online, the camera can be grouped on the electronic device. Specifically, the grouping can be achieved in the following two ways. In the first way, the user manually manages the cameras connected to the electronic device in groups, and the cameras in the same area are grouped together; in the second way, the deployment position of the corresponding camera is obtained through the built-in positioning module in the camera, and the distance between each two deployment positions is determined. The camera corresponding to the distance less than the preset distance is determined as the camera in the same area, and is grouped together. The identifier of each camera in the same group is added to the corresponding camera list. The audio data collected by each camera in the same area may be similar. Therefore, the present invention obtains the first audio data of the same time period collected by each camera located in the same area to analyze each first audio data. The same time period means that the start time of collecting audio is the same and the end time of collecting audio is also the same. For example, the first audio data is a section of audio data from 2:10 to 2:10:10.

[0037] As shown in Table 1, assuming that the same area includes 5 cameras, and the identifications of the 5 cameras are IPC1, IPC2, IPC3, IPC4 and IPC5 respectively, IPC1, IPC2, IPC3 and IPC4 are classified into group G1, and IPC5 is classified into group G2, that is, the camera list stores the correspondence between the group identification G1 and the camera identification IPC1, the camera identification IPC2, the camera identification IPC3 and the camera identification IPC4, and the camera list stores the correspondence between the group identification G2 and the camera identification IPC5.

[0038] Table 1

[0039] Group ID Camera equipment identification <![CDATA[G1]]> <![CDATA[IPC1]]> <![CDATA[G1]]> <![CDATA[IPC2]]> <![CDATA[G1]]> <![CDATA[IPC3 <!-- 3 -->]]> <![CDATA[G1]]> <![CDATA[IPC4]]> <![CDATA[G2]]> <![CDATA[IPC5]]>

[0040] It should be noted that all the camera devices in the same area are camera devices that have audio data storage requirements, that is, each camera device has an audio collection function turned on.

[0041] Step 102: Determine a first similarity between every two of the first audio data.

[0042] For example, when the first audio data of the same time period collected by the camera devices in the same area are obtained, the first similarity between each two first audio data can be determined based on the audio similarity algorithm. The audio similarity algorithm can be a dynamic time warping algorithm (Dynamic Time Warping, DTW) or an algorithm such as Euclidean distance, which is not limited in the present invention.

[0043] It should be noted that when the audio encoding formats and / or sampling rates of the various camera devices are different, it is necessary to first process the first audio data, convert the sampling rate and audio encoding format, and then perform similarity calculation after obtaining audio data with consistent sampling rate and audio encoding format.

[0044] Step 103: Determine at least two reference audio data based on each of the first similarities, and determine a camera device corresponding to each of the reference audio data as a reference camera device.

[0045] For example, after determining each first similarity, each first similarity is compared with a preset similarity, and the first audio data corresponding to the first similarity greater than or equal to the preset similarity is determined as the reference audio data, and the camera corresponding to each reference audio data is determined as the reference camera. The storage path of each reference audio data is stored in the audio similarity list La in correspondence with the identifier of the corresponding reference camera; taking the grouping in Table 1 as an example, for example, if the audio data collected by IPC1, IPC2 and IPC3 calculated in this time are consistent or relatively similar, then IPC1 and the corresponding reference audio data, IPC2 and the corresponding reference audio data, and IPC3 and the corresponding reference audio data are stored in the audio similarity list La.

[0046] Step 104: Determine the first audio quality of each reference audio data.

[0047] For example, audio quality evaluation calculation is performed on each reference audio data in the audio similarity list La to obtain the first audio quality of each reference audio data. The audio quality evaluation algorithm may be POSQE or P.563.

[0048] Step 105: Determine target audio data based on each of the first audio qualities, and store the storage paths of the target audio data in correspondence with the identifiers of the reference camera devices.

[0049] For example, after determining the first audio quality of each reference audio data, each first audio quality is compared; preferably, the reference audio data corresponding to the first audio quality with the highest audio quality is determined as the target audio data; of course, if the audio quality requirement is not high, the reference audio data corresponding to the first audio quality with the second highest audio quality can also be determined as the target audio data, and the present invention is not limited to this.

[0050] When the target audio data is obtained, the storage path of the target audio data is stored correspondingly to the identifier of each reference camera device, that is, all reference camera devices correspond to the same audio data.

[0051] The audio data storage method for multiple camera devices provided by the present invention obtains the first audio data collected by each camera device located in the same area, determines at least two reference audio data based on the first similarity between each two first audio data, determines the camera device corresponding to each reference audio data as the reference camera device, determines the first audio quality of each reference audio data, determines the target audio data based on each first audio quality, and finally stores the storage path of the target audio data in correspondence with the identification of each reference camera device. It can be seen that the present invention determines the reference camera device corresponding to the similar audio data based on the first audio data collected by each camera device in the same area, and then determines the final target audio data based on the audio quality of the reference audio data collected by each reference camera device, and only stores the target audio data after associating it with the identification of each reference camera device, which effectively reduces the storage space occupied by repeated audio data, and there is no need to store the audio data collected by each reference camera device, thereby saving storage resources, so that more different audio data can be stored in the same storage space, and more effective audio data can be stored.

[0052] In one embodiment, in the above step 105, the storage paths of the target audio data are stored correspondingly to the identifiers of the reference camera devices, which can be specifically implemented in the following manner:

[0053] The corresponding relationship between the storage path of the target audio data, the device type of the first reference camera device corresponding to the target audio data, and the identifier of the first reference camera device is stored in the audio storage association table; the device type of the first reference camera device is the main camera device type;

[0054] The correspondence between the storage path of the target audio data, the device type of a second reference camera device other than the first reference camera device, and the identifier of the second reference camera device is stored in an audio storage association table; the device type of the second reference camera device is a slave camera device type.

[0055] For example, taking the audio similarity list La storing IPC1 and the corresponding reference audio data, IPC2 and the corresponding reference audio data, and IPC3 and the corresponding reference audio data as an example, assuming that from the reference audio data corresponding to IPC1, the reference audio data corresponding to IPC2 and the reference audio data corresponding to IPC3, it is determined that the audio quality of the reference audio data corresponding to IPC1 is the highest, then the reference audio data corresponding to IPC1 is determined as the target audio data, that is, the reference audio data corresponding to IPC1 is determined as the audio data to be stored, the camera device corresponding to IPC1 is determined as the main camera device, the reference audio data corresponding to IPC2 and the reference audio data corresponding to IPC3 are discarded, and the camera device corresponding to IPC2 and the camera device corresponding to IPC3 are both determined as slave camera devices, and the audio storage association table shown in Table 2 is obtained.

[0056] Table 2

[0057]

[0058] It should be noted that in Table 2, the audio start time and the audio end time are determined based on the audio data that the camera device actually needs to store. If the audio data is always being stored, the audio end time can be empty, and Table 2 uses - to indicate that the audio end time is empty.

[0059] It should be noted that, in order to ensure the continuity of audio data storage, when the target audio data to be stored is not screened out, the audio data collected by each camera device can be stored. Even when the target audio data to be stored is determined, the audio data of each camera device is still collected normally, and the collected audio data is uploaded to the electronic device, which is responsible for how to store the received audio data.

[0060] It should be noted that when the target audio data is determined as the audio data shared by each reference camera device, for each second reference camera device, that is, for each slave camera device, if the first audio data collected by the second reference camera device is very similar to the target audio data but not completely the same, the difference between the first audio data collected by the second reference camera device and the target audio data can also be stored in correspondence with the identifier of the second reference camera device to ensure the integrity of the audio data corresponding to the second reference camera device. In addition, after the audio storage association table is updated, the difference data between the audio data can also be stored in correspondence, which will not be repeated in detail in the present invention.

[0061] In this embodiment, the correspondence between the storage path of the target audio data, the device type of the first reference camera device corresponding to the target audio data, and the identification of the first reference camera device is stored in an audio storage association table, and the correspondence between the storage path of the target audio data, the device type of the second reference camera device other than the first reference camera device, and the identification of the second reference camera device is stored in the audio storage association table, so that the user can know the device type and storage path of each camera device through the audio storage association table, thereby realizing unified management of each reference camera device in the same area, and the corresponding audio data can be obtained subsequently based on the audio storage association table.

[0062] Considering that the cameras in the same area may be deleted, or the audio collection function may be turned off, or they may be offline, or powered off, and new cameras may be added to the same area, when the cameras in the same area are changed, it is necessary to confirm whether to update the audio storage association table or reselect the source of the audio data.

[0063] In one embodiment, the target audio data is audio data corresponding to a first audio quality with the highest audio quality; Figure 2 FIG. 2 is a flow chart of the audio data storage method of a multi-camera device provided by an embodiment of the present invention. Figure 2 As shown, after step 105, the audio data storage method of the multi-camera device further includes the following steps:

[0064] Step 106. When the first reference camera device satisfies the first trigger condition, the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the identifier of the new first reference camera device is stored in the audio storage association table; the first trigger condition includes one of the following: deletion, offline, turning off the audio collection function or powering off; the new first reference camera device is the second reference camera device corresponding to the first audio quality with the second highest audio quality, or the new first reference camera device is determined based on the second audio data collected in real time by each of the second reference cameras; each of the second audio data is audio data of the same time period.

[0065] For example, when the main camera in the camera device list is deleted, offline, has its audio acquisition function disabled, or is powered off, a new first reference camera device, that is, a new main camera device, needs to be re-determined. The determination of the new main camera device can be achieved in the following two ways:

[0066] The first method is that when calculating the audio quality of each audio data, the audio qualities can be sorted in descending order. When the first reference camera device with the highest audio quality is deleted, offline, has its audio acquisition function turned off, or is powered off, the second reference camera device corresponding to the first audio quality with the second highest audio quality can be determined as the new first reference camera device, that is, determined as the new main camera device, thereby avoiding re-triggering the similarity calculation of the audio data and the audio quality evaluation steps, and improving the efficiency of determining the new main camera device.

[0067] The second method is to re-trigger the steps of similarity calculation of audio data and audio quality evaluation, that is, to obtain the second audio data collected by each second reference camera device in real time, determine the similarity between each two second audio data, determine the audio data corresponding to the similarity greater than the preset similarity as new reference audio data, determine the audio quality of each new reference audio data, and determine the reference camera device corresponding to the new reference audio data with the highest audio quality as the new first reference camera device, that is, as the new main camera device.

[0068] Step 107: Store the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of other second reference camera devices except the new first reference camera device, and the identifier of the other second reference camera device in the audio storage association table.

[0069] For example, when determining a new first reference camera device, the corresponding relationship between the storage path of the audio data collected by the new first reference camera device in real time, the device type of the new first reference camera device, and the identifier of the new first reference camera device is stored in the audio storage association table. And the corresponding relationship between the storage path of the audio data collected by the new first reference camera device in real time, the device type of other second reference camera devices except the new first reference camera device, and the identifier of other second reference camera devices is stored in the audio storage association table.

[0070] Table 3 is an updated audio storage association table when the first reference camera device meets the first trigger condition. As shown in Table 3, assuming that IPC1 is deleted, offline, the audio acquisition function is turned off or the power is turned off at 2:20, the second audio data is the audio data collected from 2:20, and the identifier of the new main camera device is determined to be IPC2. The storage path of the second audio data collected by the camera device corresponding to IPC2 is / disk / storage / audio1 / , and the device type corresponding to IPC2 is set to the main camera device type, that is, Table 3 stores the corresponding relationship of IPC2, / disk / storage / audio1 / , the main camera device type, and the audio start time of 2:20. At this time, if the camera device corresponding to IPC2 is in continuous acquisition, the audio end time can be empty, and the corresponding relationship of IPC3, / disk / storage / audio1 / , the slave camera device type, and the audio start time of 2:20 is stored, thereby realizing the update of the audio storage association table when the first reference camera device meets the first trigger condition. The camera device corresponding to IPC3 is the other second reference camera device.

[0071] Table 3

[0072]

[0073]

[0074] It should be noted that when the first reference camera device is deleted, that is, when the main camera device is deleted, the records associated with the first reference camera device in the audio storage association table can be deleted. For example, if the main camera device in Table 3 is identified as IPC1, the first row of records in Table 3 can be deleted; of course, if the storage space is large enough, the records associated with the first reference camera device may not be deleted, and the present invention is not limited to this.

[0075] In this embodiment, when the main camera device is deleted, offline, the audio acquisition function is turned off, or the power is turned off, a new main camera device is re-determined and the audio storage association table is updated in time, thereby achieving real-time maintenance of the audio storage association table to ensure that the stored audio data is the optimal audio data, while ensuring the integrity of the monitored audio data.

[0076] In one embodiment, Figure 3 FIG. 3 is a flow chart of the audio data storage method of a multi-camera device provided by an embodiment of the present invention. Figure 3 As shown, after step 105, the audio data storage method of the multi-camera device further includes the following steps:

[0077] Step 108. When the second target reference camera device meets the second trigger condition, the correspondence between the storage path of the audio data collected in real time by the first reference camera device, the device type of the first reference camera device, and the identifier of the first reference camera device is stored in the audio storage association table; the second trigger condition includes one of the following: deletion, offline, turning off the audio capture function, or powering off.

[0078] Step 109: Store the corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of other second reference camera devices except the second target reference camera device, and the identifier of the other second reference camera devices in the audio storage association table.

[0079] For example, when the camera is deleted from the camera list, is offline, has its audio acquisition function turned off, or is powered off, only the audio storage association table needs to be updated. The specific update method is as follows:

[0080] The corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of the first reference camera device, and the identifier of the first reference camera device is stored in the audio storage association table. The corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of other second reference camera devices except the second target reference camera device, and the identifier of other second reference camera devices is stored in the audio storage association table.

[0081] Table 4 is an updated audio storage association table when the second target reference camera device meets the second trigger condition. As shown in Table 4, assuming that the identifier of the second target reference camera device is IPC2, at 2:20, IPC2 is deleted, offline, the audio acquisition function is turned off, or the power is turned off, the audio data collected in real time by the first reference camera device is the audio data collected starting from 2:20, and the storage path of the audio data collected in real time by the first reference camera device IPC1 is / disk / storage / audio / . Then, Table 4 stores the corresponding relationship between IPC1, / disk / storage / audio / , the main camera device type, and the audio start time of 2:20. At this time, if the camera device corresponding to IPC1 is in continuous acquisition, the audio end time can be empty; and stores the corresponding relationship between IPC3, / disk / storage / audio / , the slave camera device type, and the audio start time of 2:20, thereby realizing the update of the audio storage association table when the second target reference camera device meets the second trigger condition. The camera device corresponding to IPC3 is the other second reference camera device.

[0082] Table 4

[0083]

[0084] It should be noted that when the second target reference camera device is deleted, that is, when it is deleted from the camera device, the record associated with the second target reference camera device in the audio storage association table can be deleted. For example, the identifier of the second target reference camera device in Table 4 is IPC2, then the second row of records in Table 4 can be deleted; of course, if the storage space is large enough, the record associated with the second target reference camera device can be omitted, and the present invention is not limited to this.

[0085] In this embodiment, when the audio acquisition function is deleted from the camera device, offline or turned off, the audio storage association table is updated in time, thereby achieving real-time maintenance of the audio storage association table to ensure that the stored audio data is the optimal audio data and at the same time ensure the integrity of the monitored audio data.

[0086] In one embodiment, Figure 4 FIG. 4 is a flow chart of the audio data storage method of a multi-camera device provided in an embodiment of the present invention. Figure 4 As shown, after step 105, the audio data storage method of the multi-camera device further includes the following steps:

[0087] Step 110: When a third trigger condition is met, obtain the third audio data collected by the target camera device in real time and the fourth audio data collected by the current first reference camera device in real time; the target camera device includes a camera device that is back online or a new camera device; the third trigger condition is that any camera device in the same area is back online or a new camera device is added to the same area; the third audio data and the fourth audio data are audio data of the same time period.

[0088] Among them, any camera device in the same area coming back online means that any camera device in the same area is deleted and then online, or any camera device in the same area is offline and then online, or any camera device in the same area turns off the audio collection function and then turns on the audio collection function, or any camera device in the same area is powered off and then powered on.

[0089] For example, when the target camera device in the same area meets the third trigger condition, that is, when any camera device in the same area comes back online or a new camera device is added in the same area, the third audio data collected in real time by the target camera device and the fourth audio data collected in real time by the current first reference camera device are obtained. The fourth audio data collected in real time by the current first reference camera device is also the audio data collected by the current main camera device.

[0090] Step 111: Determine a second similarity between the third audio data and the fourth audio data.

[0091] For example, when the third audio data and the fourth audio data are obtained, the similarity between the third audio data and the fourth audio data is determined, and specifically, the second similarity between the third audio data and the fourth audio data can be determined based on an audio similarity algorithm. The audio similarity algorithm can be an algorithm such as DTW or Euclidean distance, which is not limited in the present invention.

[0092] Step 112: When it is determined that the second similarity is greater than or equal to a preset similarity, determine a second audio quality of the third audio data and a third audio quality of the fourth audio data.

[0093] For example, when the second similarity is calculated, the second similarity is compared with the preset similarity. When it is determined that the second similarity is less than the preset similarity, it means that the third audio data collected by the target camera device and the fourth audio data collected by the current first reference camera device are not similar, and are not suitable for sharing the same audio data; when it is determined that the second similarity is greater than or equal to the preset similarity, it means that the third audio data collected by the target camera device and the fourth audio data collected by the current first reference camera device are consistent or relatively similar, and are suitable for sharing the same audio data. Therefore, it is necessary to further judge the audio quality of the third audio data and the fourth audio data.

[0094] Step 113. When it is determined that the second audio quality is greater than or equal to the third audio quality, the target camera device is determined as a new first reference camera device, the current first reference camera device is determined as a second reference camera device, and the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the correspondence between the identification of the new first reference camera device are stored in the audio storage association table; the storage path of the audio data collected in real time by the new first reference camera device, the device type of the second reference camera device, and the correspondence between the identification of the second reference camera device are stored in the audio storage association table.

[0095] For example, when it is determined that the second audio quality of the third audio data is greater than or equal to the third audio quality of the fourth audio data, it means that the quality of the audio data collected by the target camera device is greater than the quality of the audio data collected by the current main camera device. At this time, the target camera device can be used as a new first reference camera device, that is, as a new main camera device, and the former first reference camera device can be used as the second reference camera device, that is, the current main camera device can be used as a slave camera device. At this time, the slave cameras in the same area include the current first reference camera device and other second reference camera devices.

[0096] Table 5 is an updated audio storage association table when the target camera device is a newly added camera device in the same area and it is determined that the second audio quality of the third audio data is greater than or equal to the third audio quality of the fourth audio data. As shown in Table 5, assuming that the target camera device is a new camera device, the identification of the new camera device is IPC6, assuming that the new camera device is online at 2:20, the audio data collected by the new camera device in real time is the audio data collected from 2:20, and the storage path of the audio data collected by the new camera device in real time is / disk / storage / audio2 / , then IPC6, / disk / storage / audio2 / , the main camera device, and the audio data are stored in Table 5. The correspondence between the device type and the audio start time is 2:20. At this time, if the camera device corresponding to IPC6 is in continuous acquisition, the audio end time can be empty, and the correspondence between IPC1, / disk / storage / audio2 / , the camera device type, and the audio start time is 2:20, the correspondence between IPC2, / disk / storage / audio2 / , the camera device type, and the audio start time is 2:20, and the correspondence between IPC3, / disk / storage / audio2 / , the camera device type, and the audio start time is 2:20. This realizes the update of the audio storage association table when the third trigger condition is met.

[0097] Table 5

[0098]

[0099] Table 6 is an updated audio storage association table when any camera device in the same area is back online and it is determined that the second audio quality of the third audio data is greater than or equal to the third audio quality of the fourth audio data. As shown in Table 6, it is assumed that the identifier of any camera device is IPC1, and the camera device corresponding to IPC1 is back online at 2:30, the audio data collected in real time by the camera device corresponding to IPC1 is the audio data collected starting from 2:30, and the storage path of the audio data collected in real time by the camera device corresponding to IPC1 is / disk / storage / audio / , Table 6 stores the corresponding relationship between IPC1, / disk / storage / audio / , main camera device type, and audio start time of 2:30. At this time, if the camera device corresponding to IPC1 is in continuous acquisition, the audio end time can be empty. It also stores the corresponding relationship between IPC2, / disk / storage / audio / , slave camera device type, and audio start time of 2:30, and the corresponding relationship between IPC3, / disk / storage / audio / , slave camera device type, and audio start time of 2:30.

[0100] Table 6

[0101]

[0102]

[0103] Step 114. When it is determined that the second audio quality is less than the third audio quality, the target camera device is determined as the second reference camera device, and the corresponding relationship between the storage path of the fourth audio data, the identifier of the current first reference camera device, and the device type of the current first reference camera device is stored in the audio storage association table; the corresponding relationship between the storage path of the fourth audio data, the device type of the second reference camera device, and the identifier of the second reference camera device is stored in the audio storage association table.

[0104] For example, when it is determined that the second audio quality of the third audio data is less than the third audio quality of the fourth audio data, it means that the quality of the audio data captured by the target camera device is less than the quality of the audio data captured by the current main camera device. At this time, the target camera device is used as the second reference camera device, that is, the target camera device is used as the slave camera device, and the main camera device remains unchanged.

[0105] Table 7 is an updated audio storage association table when the target camera device is a newly added camera device in the same area and it is determined that the second audio quality of the third audio data is less than the third audio quality of the fourth audio data. As shown in Table 7, assuming that the target camera device is a new camera device, the identifier of the new camera device is IPC6, assuming that the new camera device is online at 2:20, the identifier of the current first reference camera device is IPC1, the audio data collected in real time by the current first reference camera device is the audio data collected from 2:20, and the storage path of the audio data collected in real time by the current first reference camera device is / disk / storage / audio / , then IPC1, / disk / stora are stored in Table 7. The corresponding relationship between IPC2, / disk / storage / audio / , the main camera device type, and the audio start time is 2:20. At this time, if the camera device corresponding to IPC1 is in continuous acquisition, the audio end time can be empty, and the corresponding relationship between IPC2, / disk / storage / audio / , the slave camera device type, and the audio start time is 2:20, the corresponding relationship between IPC3, / disk / storage / audio / , the slave camera device type, and the audio start time is 2:20, and the corresponding relationship between IPC6, / disk / storage / audio / , the slave camera device type, and the audio start time is 2:20. This realizes the update of the audio storage association table when the third trigger condition is met.

[0106] Table 7

[0107]

[0108] Table 8 is an updated audio storage association table when the target camera device is any camera device in the same area that is back online and it is determined that the second audio quality of the third audio data is less than the third audio quality of the fourth audio data. As shown in Table 8, assuming that the identifier of any camera device is IPC2, the camera device corresponding to IPC2 is back online at 2:30, and the main camera device at this time is still the camera device corresponding to IPC1. The audio data collected in real time by the camera device corresponding to IPC1 is the audio data collected starting from 2:30, and the storage path of the audio data collected in real time by the camera device corresponding to IPC1 is / disk / storage / audio / , then Table 8 stores the corresponding relationship between IPC1, / disk / storage / audio / , main camera device type, and audio start time of 2:30. At this time, if the camera device corresponding to IPC1 is in continuous acquisition, the audio end time can be empty, and stores the corresponding relationship between IPC2, / disk / storage / audio / , slave camera device type, and audio start time of 2:30, and the corresponding relationship between IPC3, / disk / storage / audio / , slave camera device type, and audio start time of 2:30, thereby realizing the update of the audio storage association table when the third trigger condition is met.

[0109] Table 8

[0110]

[0111]

[0112] In this embodiment, when any camera device in the same area comes back online or a new camera device is added to the same area, the audio storage association table is updated in a timely manner, thereby achieving real-time maintenance of the audio storage association table to ensure that the stored audio data is the optimal audio data, while ensuring the integrity of the monitored audio data.

[0113] In one embodiment, the audio storage association table further stores an audio start time and an audio end time corresponding to the identifier of the first reference camera device, and an audio start time and an audio end time corresponding to the identifier of each of the second reference camera devices; the method further includes:

[0114] When the first reference camera device meets the first trigger condition, the audio end time of the first reference camera device in the audio storage association table is set to the current time; the first trigger condition includes one of the following: deletion, offline, closing the audio acquisition function or powering off.

[0115] For example, in the above Tables 2 to 8, the audio start time and audio end time corresponding to the identification of each camera device are stored. When the first reference camera device is deleted, offline, the audio acquisition function is turned off, or the power is turned off, that is, when the main camera device is deleted, offline, the audio acquisition function is turned off, or the power is turned off, since the main camera device disconnects the audio data collection, the audio end time of the main camera device can be set to the current time at this time to ensure that the first reference camera device that meets the first trigger condition, when acting as the main camera device, the collected audio data can correspond to the video data collected by the main camera device based on the audio start time and the audio end time.

[0116] When the second target reference camera device meets the second trigger condition, the audio end time of the second target reference camera device in the audio storage association table is set to the current time; the second trigger condition includes one of the following: deletion, offline, turning off the audio acquisition function or powering off.

[0117] For example, when the second target reference camera device is deleted, goes offline, has its audio acquisition function turned off, or is powered off, that is, when the slave camera device is deleted, goes offline, has its audio acquisition function turned off, or is powered off, since the slave camera device disconnects the acquisition of audio data, the audio end time of the slave camera device can be set to the current time at this time to ensure that the second target reference camera device that meets the second trigger condition, when acting as a slave camera device, the audio data shared with the main camera device can correspond to the video data collected by the slave camera device based on the audio start time and the audio end time.

[0118] It should be noted that since each camera device is connected to the management platform of the electronic device, the time of each camera device needs to be synchronized. If it is determined that the time of each camera device is not synchronized, the time of each camera in the group is synchronized through the management platform to ensure that the time of each camera is consistent, thereby avoiding the problem of audio and video synchronization caused by subsequent time asynchrony. Specifically, the time synchronization of each camera device can be achieved based on the Network Time Protocol (NTP).

[0119] In this embodiment, the audio end time of the camera device that meets the first trigger condition or the second trigger condition is set as the current time to ensure that the audio data can correspond to the video data based on the audio start time and the audio end time.

[0120] In one embodiment, after the above step 105, the audio data storage method of the multi-camera device further includes the following steps:

[0121] Receive an audio acquisition request sent by a terminal device; the audio acquisition request includes a target time period; obtain audio data corresponding to the target time period in the audio storage association table; and send the audio data corresponding to the target time period to the terminal device.

[0122] For example, when a user needs to view historically monitored audio data, the user can enter the target time period on the terminal device and click the historical data acquisition button to send a historical data acquisition instruction to the terminal device, so that the terminal device responds to the historical data acquisition instruction and sends an audio acquisition request including the target time period to the electronic device. The electronic device searches the audio storage path corresponding to the target time period in the audio storage association table, obtains the corresponding audio data based on the found audio storage path, and sends the audio data to the terminal device.

[0123] Furthermore, each camera device can also send the collected video data to an electronic device. For each camera device, the electronic device stores the video data sent by the camera device in correspondence with the corresponding time period. When the electronic device receives an audio acquisition request, it can also obtain the corresponding video data based on the target time period, and merge the video data and audio data of the target time period and send them to the terminal device; of course, the video data and audio data of the target time period can also be transmitted separately to the terminal device, and the present invention is not limited to this.

[0124] In this embodiment, when an audio acquisition request sent by a terminal device is obtained, the corresponding audio data can be searched in the audio storage association table based on the target time period included in the audio acquisition request, and the audio data corresponding to the target time period can be sent to the terminal device to ensure that the user can view the historically monitored audio data.

[0125] In one embodiment, determining the first audio quality of each reference audio data may be specifically implemented in the following manner:

[0126] When all the first audio data are silent data, the fifth audio data collected by each of the cameras are obtained; each of the fifth audio data is audio data of the same time period; when at least one of the fifth audio data is non-silent data, the third similarity between every two of the fifth audio data is determined; at least two of the reference audio data are updated based on each of the third similarities; and the first audio quality of each updated reference audio data is determined.

[0127] The fifth audio data is audio data collected after the first audio data.

[0128] For example, since there may be no sound in the space when the camera is online, the determined reference audio data may be inaccurate. In order to improve the accuracy of the determined reference audio data, it is necessary to trigger a sound similarity detection again when at least one of the fifth audio data collected by each camera in the same area is non-silent data, that is, determine the third similarity between every two fifth audio data, and the fifth audio data corresponding to the third similarity greater than or equal to the preset similarity can be determined as the reference audio data, thereby updating the previous reference audio data and making the obtained audio similarity list La more accurate.

[0129] It should be noted that if the sound can be detected when the camera is online, there is no need to execute the process in this embodiment. Of course, since the phenomenon of no sound is still suitable for multiple camera devices to share the same audio data, this solution is also applicable.

[0130] In this embodiment, when all first audio data are silent data, it is necessary to re-acquire the fifth audio data collected by each camera device and trigger the sound similarity detection again to update the previously determined reference audio data so that the obtained audio similarity list is more accurate.

[0131] The audio data storage device of the multi-camera device provided by the present invention is described below. The audio data storage device of the multi-camera device described below and the audio data storage method of the multi-camera device described above can be referred to each other.

[0132] Figure 5 FIG. 1 is a schematic diagram of the structure of an audio data storage device for a multi-camera device provided by an embodiment of the present invention. Figure 5 As shown, the audio data storage device 500 of the multi-camera device includes a first acquisition unit 501, a first determination unit 502, a second determination unit 503, a third determination unit 504 and a first storage unit 505; wherein:

[0133] The first acquisition unit 501 is used to acquire first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0134] A first determining unit 502, configured to determine a first similarity between every two of the first audio data;

[0135] A second determining unit 503 is configured to determine at least two reference audio data based on each of the first similarities, and determine a camera corresponding to each of the reference audio data as a reference camera;

[0136] A third determining unit 504, configured to determine a first audio quality of each of the reference audio data;

[0137] The first storage unit 505 is used to determine target audio data based on each of the first audio qualities, and store the storage paths of the target audio data in correspondence with the identifiers of the reference camera devices.

[0138] The audio data storage device for multiple camera devices provided by the present invention obtains the first audio data collected by each camera device located in the same area, determines at least two reference audio data based on the first similarity between each two first audio data, determines the camera device corresponding to each reference audio data as the reference camera device, determines the first audio quality of each reference audio data, determines the target audio data based on each first audio quality, and finally stores the storage path of the target audio data in correspondence with the identification of each reference camera device. It can be seen that the present invention determines the reference camera device corresponding to the similar audio data based on the first audio data collected by each camera device in the same area, and then determines the final target audio data based on the audio quality of the reference audio data collected by each reference camera device, and only needs to associate the target audio data with the identification of each reference camera device and then store it, which effectively reduces the storage space occupied by repeated audio data, and there is no need to store the audio data collected by each reference camera device, thereby saving storage resources.

[0139] Based on any of the above embodiments, the first storage unit 505 is specifically used for:

[0140] The corresponding relationship between the storage path of the target audio data, the device type of the first reference camera device corresponding to the target audio data, and the identifier of the first reference camera device is stored in the audio storage association table; the device type of the first reference camera device is the main camera device type;

[0141] The correspondence between the storage path of the target audio data, the device type of a second reference camera device other than the first reference camera device, and the identifier of the second reference camera device is stored in an audio storage association table; the device type of the second reference camera device is a slave camera device type.

[0142] Based on any of the above embodiments, the target audio data is audio data corresponding to a first audio quality with the highest audio quality; the audio data storage device 500 of the multi-camera device further includes:

[0143] A second storage unit is used to store the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the identifier of the new first reference camera device in the audio storage association table when the first reference camera device meets the first trigger condition; the first trigger condition includes one of the following: deletion, offline, turning off the audio collection function or power off; the new first reference camera device is the second reference camera device corresponding to the first audio quality with the second highest audio quality, or the new first reference camera device is determined based on the second audio data collected in real time by each of the second reference camera devices; each of the second audio data is audio data of the same time period;

[0144] The third storage unit is used to store the correspondence between the storage path of the audio data collected in real time by the new first reference camera device, the device type of other second reference camera devices except the new first reference camera device, and the identifier of the other second reference camera devices in the audio storage association table.

[0145] Based on any of the above embodiments, the audio data storage device 500 of the multi-camera device further includes:

[0146] A fourth storage unit is used to store the corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of the first reference camera device, and the identifier of the first reference camera device in the audio storage association table when the second target reference camera device meets the second trigger condition; the second trigger condition includes one of the following: deletion, offline, closing the audio collection function or powering off;

[0147] The fifth storage unit is used to store the correspondence between the storage path of the audio data collected in real time by the first reference camera device, the device type of other second reference camera devices except the second target reference camera device, and the identifiers of the other second reference camera devices in the audio storage association table.

[0148] Based on any of the above embodiments, the audio data storage device 500 of the multi-camera device further includes:

[0149] The second acquisition unit is used to acquire the third audio data collected in real time by the target camera device and the fourth audio data collected in real time by the current first reference camera device when a third trigger condition is met; the target camera device includes a camera device that is back online or a new camera device; the third trigger condition is that any camera device in the same area is back online or a new camera device is added to the same area; the third audio data and the fourth audio data are audio data of the same time period;

[0150] a fourth determining unit, configured to determine a second similarity between the third audio data and the fourth audio data;

[0151] a fifth determining unit, configured to determine a second audio quality of the third audio data and a third audio quality of the fourth audio data when it is determined that the second similarity is greater than or equal to a preset similarity;

[0152] A sixth storage unit is used to, when it is determined that the second audio quality is greater than or equal to the third audio quality, determine the target camera device as a new first reference camera device, determine the current first reference camera device as a second reference camera device, and store the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the identifier of the new first reference camera device in the audio storage association table; and store the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the second reference camera device, and the identifier of the second reference camera device in the audio storage association table;

[0153] The seventh storage unit, when determining that the second audio quality is less than the third audio quality, determines the target camera device as the second reference camera device, and stores the corresponding relationship between the storage path of the fourth audio data, the identifier of the current first reference camera device, and the device type of the current first reference camera device in the audio storage association table; and stores the corresponding relationship between the storage path of the fourth audio data, the device type of the second reference camera device, and the identifier of the second reference camera device in the audio storage association table.

[0154] Based on any of the above embodiments, the audio storage association table further stores the audio start time and audio end time corresponding to the identifier of the first reference camera device, and the audio start time and audio end time corresponding to the identifier of each of the second reference camera devices; the audio data storage device 500 of the multi-camera device also includes:

[0155] A first setting unit is used to set the audio end time of the first reference camera device in the audio storage association table to the current time when the first reference camera device meets a first trigger condition; the first trigger condition includes one of the following: deletion, offline, closing the audio acquisition function or powering off;

[0156] The second setting unit sets the audio end time of the second target reference camera device in the audio storage association table to the current time when the second target reference camera device meets the second trigger condition; the second trigger condition includes one of the following: deletion, offline, closing the audio acquisition function or powering off.

[0157] Based on any of the above embodiments, the audio data storage device 500 of the multi-camera device further includes:

[0158] A receiving unit, configured to receive an audio acquisition request sent by a terminal device; the audio acquisition request includes a target time period;

[0159] A third acquisition unit, configured to acquire the audio data corresponding to the target time period in the audio storage association table;

[0160] A sending unit is used to send the audio data corresponding to the target time period to the terminal device.

[0161] Based on any of the foregoing embodiments, the third determining unit 504 is specifically configured to:

[0162] In the case that each of the first audio data is silent data, obtaining fifth audio data collected by each of the camera devices; each of the fifth audio data is audio data of the same time period;

[0163] In a case where at least one of the fifth audio data is non-silent data, determining a third similarity between every two of the fifth audio data;

[0164] updating at least two of the reference audio data based on each of the third similarities;

[0165] The first audio quality of each updated reference audio data is determined.

[0166] Figure 6 is a schematic diagram of the physical structure of an electronic device provided by an embodiment of the present invention, such as Figure 6 As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630 and a communication bus 640, wherein the processor 610, the communication interface 620 and the memory 630 communicate with each other through the communication bus 640. The processor 610 may call the logic instructions in the memory 630 to execute the audio data storage method of multiple camera devices, the method comprising: obtaining first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0167] Determine a first similarity between every two of the first audio data;

[0168] Determine at least two reference audio data based on each of the first similarities, and determine the camera device corresponding to each of the reference audio data as a reference camera device;

[0169] determining a first audio quality of each of the reference audio data;

[0170] Target audio data is determined based on each of the first audio qualities, and storage paths of the target audio data are stored correspondingly to identifiers of each of the reference camera devices.

[0171] In addition, the logic instructions in the above-mentioned memory 630 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0172] On the other hand, the present invention further provides a computer program product, the computer program product includes a computer program, the computer program can be stored in a non-transitory computer-readable storage medium, when the computer program is executed by a processor, the computer can execute the audio data storage method of multiple camera devices provided by the above methods, the method comprising: obtaining first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0173] Determine a first similarity between every two of the first audio data;

[0174] Determine at least two reference audio data based on each of the first similarities, and determine the camera device corresponding to each of the reference audio data as a reference camera device;

[0175] determining a first audio quality of each of the reference audio data;

[0176] Target audio data is determined based on each of the first audio qualities, and storage paths of the target audio data are stored correspondingly to identifiers of each of the reference camera devices.

[0177] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method for storing audio data of multiple camera devices provided by the above methods is implemented, the method comprising: obtaining first audio data collected by each camera device located in the same area; each of the first audio data is audio data of the same time period;

[0178] Determine a first similarity between every two of the first audio data;

[0179] Determine at least two reference audio data based on each of the first similarities, and determine the camera device corresponding to each of the reference audio data as a reference camera device;

[0180] determining a first audio quality of each of the reference audio data;

[0181] Target audio data is determined based on each of the first audio qualities, and storage paths of the target audio data are stored correspondingly to identifiers of each of the reference camera devices.

[0182] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0183] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0184] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for storing audio data of a multi-camera device, characterized in that: include: Acquire first audio data collected by each camera device located in the same area; Each of the first audio data is audio data of the same time period; Determine a first similarity between every two of the first audio data; Determine at least two reference audio data based on each of the first similarities, and determine the camera device corresponding to each of the reference audio data as a reference camera device; determining a first audio quality of each of the reference audio data; Target audio data is determined based on each of the first audio qualities, and storage paths of the target audio data are stored correspondingly to identifiers of each of the reference camera devices.

2. The audio data storage method of a multi-camera device according to claim 1, characterized in that: The storing the storage paths of the target audio data in correspondence with the identifiers of the reference camera devices respectively includes: The corresponding relationship between the storage path of the target audio data, the device type of the first reference camera device corresponding to the target audio data, and the identifier of the first reference camera device is stored in the audio storage association table; the device type of the first reference camera device is the main camera device type; The correspondence between the storage path of the target audio data, the device type of a second reference camera device other than the first reference camera device, and the identifier of the second reference camera device is stored in an audio storage association table; the device type of the second reference camera device is a slave camera device type.

3. The audio data storage method of a multi-camera device according to claim 2, characterized in that: The target audio data is audio data corresponding to a first audio quality with the highest audio quality; the method further includes: In the case where the first reference camera device satisfies the first trigger condition, the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the identifier of the new first reference camera device is stored in the audio storage association table; the first trigger condition includes one of the following: deletion, offline, turning off the audio collection function or powering off; the new first reference camera device is the second reference camera device corresponding to the first audio quality with the second highest audio quality, or the new first reference camera device is determined based on the second audio data collected in real time by each of the second reference camera devices; each of the second audio data is audio data of the same time period; The corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of other second reference camera devices except the new first reference camera device, and the identifier of the other second reference camera devices is stored in the audio storage association table.

4. The method for storing audio data of a multi-camera device according to claim 2, characterized in that: The method further comprises: When the second target reference camera device meets the second trigger condition, the corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of the first reference camera device, and the identifier of the first reference camera device is stored in the audio storage association table; the second trigger condition includes one of the following: deletion, offline, closing the audio collection function or powering off; The corresponding relationship between the storage path of the audio data collected in real time by the first reference camera device, the device type of other second reference camera devices except the second target reference camera device, and the identifier of the other second reference camera devices is stored in the audio storage association table.

5. The audio data storage method of a multi-camera device according to claim 2, characterized in that: The method further comprises: When a third trigger condition is met, third audio data collected in real time by a target camera device and fourth audio data collected in real time by a current first reference camera device are obtained; the target camera device includes a camera device that is back online or a new camera device; the third trigger condition is that any camera device in the same area is back online or a new camera device is added to the same area; the third audio data and the fourth audio data are audio data of the same time period; determining a second similarity between the third audio data and the fourth audio data; In a case where it is determined that the second similarity is greater than or equal to a preset similarity, determining a second audio quality of the third audio data and a third audio quality of the fourth audio data; In the case where it is determined that the second audio quality is greater than or equal to the third audio quality, the target camera device is determined as a new first reference camera device, the current first reference camera device is determined as a second reference camera device, and the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the new first reference camera device, and the identifier of the new first reference camera device is stored in the audio storage association table; the corresponding relationship between the storage path of the audio data collected in real time by the new first reference camera device, the device type of the second reference camera device, and the identifier of the second reference camera device is stored in the audio storage association table; When it is determined that the second audio quality is less than the third audio quality, the target camera device is determined as the second reference camera device, and the correspondence between the storage path of the fourth audio data, the identifier of the current first reference camera device, and the device type of the current first reference camera device is stored in the audio storage association table; the correspondence between the storage path of the fourth audio data, the device type of the second reference camera device, and the identifier of the second reference camera device is stored in the audio storage association table.

6. The method for storing audio data of a multi-camera device according to any one of claims 2 to 5, characterized in that: The audio storage association table also stores the audio start time and the audio end time corresponding to the identifier of the first reference camera device, and the audio start time and the audio end time corresponding to the identifier of each of the second reference camera devices; The method further comprises: When the first reference camera device meets a first trigger condition, the audio end time of the first reference camera device in the audio storage association table is set to the current time; the first trigger condition includes one of the following: deletion, offline, closing the audio acquisition function or powering off; When the second target reference camera device meets the second trigger condition, the audio end time of the second target reference camera device in the audio storage association table is set to the current time; the second trigger condition includes one of the following: deletion, offline, turning off the audio acquisition function or powering off.

7. The audio data storage method of a multi-camera device according to claim 6, characterized in that: The method further comprises: Receiving an audio acquisition request sent by a terminal device; the audio acquisition request includes a target time period; Acquire the audio data corresponding to the target time period in the audio storage association table; The audio data corresponding to the target time period is sent to the terminal device.

8. The method for storing audio data of a multi-camera device according to any one of claims 2 to 5, characterized in that: The determining the first audio quality of each of the reference audio data comprises: In the case that each of the first audio data is silent data, obtaining fifth audio data collected by each of the camera devices; each of the fifth audio data is audio data of the same time period; In a case where at least one of the fifth audio data is non-silent data, determining a third similarity between every two of the fifth audio data; updating at least two of the reference audio data based on the third similarities; The first audio quality of each updated reference audio data is determined.

9. An audio data storage device for a multi-camera device, characterized in that: include: A first acquisition unit, used to acquire first audio data collected by various camera devices located in the same area; Each of the first audio data is audio data of the same time period; A first determining unit, configured to determine a first similarity between every two of the first audio data; A second determining unit, configured to determine at least two reference audio data based on each of the first similarities, and determine a camera corresponding to each of the reference audio data as a reference camera device; A third determining unit, configured to determine a first audio quality of each of the reference audio data; The first storage unit is used to determine target audio data based on each of the first audio qualities, and store the storage paths of the target audio data in correspondence with the identifiers of the reference camera devices.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the audio data storage method of the multi-camera device according to any one of claims 1 to 8 is implemented.

Images