Network camera and data processing method thereof

Abstract

The invention discloses a network camera and a data processing method thereof. The network camera comprises a storage circuit and a processing circuit. The processing circuit is electrically connected to the storage circuit, and the processing circuit accesses the storage circuit to execute the first operation system, the second operation system and the point-to-point agent module. The first operation system collects a plurality of data, the point-to-point proxy module operates under the first operation system, and the second operation system is configured to serve as a virtual network card for connecting an external network. The first operation system comprises a first virtual network connection port, the second operation system comprises a second virtual network connection port, and the first virtual network connection port is connected with the second virtual network connection port.

Description

Technical Field

[0001] The present invention relates to a networking device and a data processing method thereof, and in particular to a network camera and a data processing method thereof. Background Art

[0002] Current network cameras can be categorized as either single-OS devices or dual-OS devices. Single-OS devices require the Linux operating system to run all network camera functions. Dual-OS devices use both the Linux and IoT operating systems, with the Linux operating system responsible for collecting and processing audio and video data, while the IoT operating system handles network transmission.

[0003] A proprietary protocol is defined between the Linux operating system and the IoT operating system. Through this proprietary protocol, the Linux operating system transmits the collected audio and video data to the IoT operating system. A peer-to-peer agent program, executed within the IoT operating system, then transmits the audio and video data to the cloud network. This allows mobile devices connected to the cloud network to receive the audio and video data from the network camera.

[0004] Since the IoT operating system is a niche operating system, there are fewer maintenance personnel and correspondingly fewer libraries provided by third parties, making the development of the IoT operating system relatively difficult. Summary of the Invention

[0005] The technical problem to be solved by the present invention is to provide a network camera and a data processing method thereof in view of the deficiencies in the prior art.

[0006] To solve the aforementioned technical problems, one of the technical solutions employed by the present invention is to provide a network camera. The network camera includes a storage circuit and a processing circuit. The processing circuit is electrically connected to the storage circuit and accesses the storage circuit to execute a first operating system, a second operating system, and a peer-to-peer proxy module. The first operating system collects multiple data sets, the peer-to-peer proxy module runs under the first operating system, and the second operating system is configured as a virtual network card for connecting to an external network. The first operating system includes a first virtual network port, the second operating system includes a second virtual network port, and the first virtual network port is connected to the second virtual network port.

[0007] To address the aforementioned technical issues, another technical solution employed by the present invention is to provide a data processing method for a network camera. The data processing method includes: configuring a processing circuit to access a storage circuit to: execute a first operating system, a second operating system, and a peer-to-peer proxy module, wherein the peer-to-peer proxy module runs under the first operating system; collecting multiple data records from the first operating system; configuring a first virtual network port in the first operating system; configuring the second operating system to function as a virtual network card for connecting to an external network; configuring a second virtual network port in the second operating system; and connecting the first virtual network port to the second virtual network port.

[0008] One of the benefits of the present invention is that the network camera and data processing method provided herein do not require additional proprietary protocols between the first and second operating systems, allowing for bidirectional data transmission between the first and second operating systems. Because the point-to-point proxy module does not run within the second operating system, the second operating system is solely responsible for network card functions. This clarifies the division of labor between the first and second operating systems, reducing development complexity and shortening development cycles.

[0009] To further understand the features and technical contents of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are only for reference and illustration and are not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 FIG. 1 is a schematic diagram of a network camera according to a first embodiment of the present invention.

[0011] Figure 2 FIG. 4 is a schematic diagram of a network camera according to a second embodiment of the present invention.

[0012] Figure 3A and Figure 3B FIG. 4 is a flow chart of a data processing method for a network camera according to a first embodiment of the present invention.

[0013] Figure 4A and Figure 4B FIG. 4 is a flow chart of a data processing method for a network camera according to a second embodiment of the present invention. DETAILED DESCRIPTION

[0014] The following is an explanation of the implementation of the "network camera and its data processing method" disclosed in the present invention through specific embodiments. Those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and the details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are only simple schematic illustrations and are not depicted according to actual size. Please note in advance. The following embodiments will further explain the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the scope of protection of the present invention.

[0015] It should be understood that although terms such as "first," "second," and "third" may be used herein to describe various components or signals, these components or signals should not be limited by these terms. These terms are primarily used to distinguish one component from another, or one signal from another. In addition, the term "or" as used herein may include any one or more combinations of the associated listed items, depending on the actual situation.

[0016] Figure 1 FIG is a schematic diagram of a network camera according to a first embodiment of the present invention. Figure 1 Web camera A includes an image sensor 1, a processing circuit 2, a storage circuit 3, and a voice sensor 4. Image sensor 1 is, for example, a charge coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor. Processing circuit 2 is, for example, a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and a system-on-a-chip (SoC), or any combination thereof. Storage circuit 3 is, for example, an editable read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a flash memory. Voice sensor 4 is, for example, an omnidirectional microphone or a bidirectional microphone.

[0017] The image sensor 1 is electrically connected to the processing circuit 2 , and the image sensor 1 is configured to pick up a plurality of image data D1 .

[0018] The storage circuit 3 and the voice sensor 4 are electrically connected to the processing circuit 2 , and the voice sensor 4 is configured to pick up a plurality of voice data D2 .

[0019] Processing circuit 2 is electrically connected to storage circuit 3. Processing circuit 2 accesses storage circuit 3 to execute a first operating system 5, a second operating system 6, a peer-to-peer agent module 7, an image processing module 8, and a voice processing module 9. First operating system 5 is, for example, a Linux operating system, and second operating system 6 is, for example, an IoT operating system. IoT operating systems include FreeRTOS, UCOS, RT-Thread, or Zephyr, but the present invention is not limited thereto.

[0020] A peer-to-peer proxy module 7 runs on a first operating system 5, while a second operating system 6 is configured as a virtual network card for connecting to an external network N. A remote device R is connected to the external network N. Remote device R can be, for example, a mobile communication device, a laptop, or a cloud server. In addition to receiving data from network camera A, remote device R can also issue control commands to activate or deactivate network camera A or command it to rotate in a specified direction.

[0021] The first operating system 5 includes a first virtual network port 51 , and the specification of the first virtual network port 51 is, for example, secure digital input / output (SDIO), universal serial bus (USB) or serial peripheral interface (SPI), but the invention is not limited thereto.

[0022] The first operating system 5 is configured to collect multiple sets of image data D1. The image processing module 8 runs under the first operating system 5 to perform image processing on the multiple sets of image data D1. Image processing includes one or any combination of image enhancement, image encoding and decoding, image wavelet processing, resolution processing, color processing, and object recognition.

[0023] The first operating system 5 is configured to collect multiple voice data sets D2. The voice processing module 9 runs under the first operating system 5 to perform voice processing on the multiple voice data sets D2. Voice processing may include, but is not limited to, voice quantization, voice encoding and decoding, normalization, frame selection, endpoint detection, and noise filtering, or any combination thereof.

[0024] The second operating system 6 includes a second virtual network port 61 . The specification of the second virtual network port 61 is the same as that of the first virtual network port 51 and the second virtual network port 61 is connected to the first virtual network port 51 .

[0025] By connecting the first virtual network port 51 and the second virtual network port 61 , the first operating system 5 and the second operating system 6 can transmit data bidirectionally without being restricted by a proprietary protocol.

[0026] When the second operating system 6 receives the plurality of image data D1 and the plurality of voice data D2 from the first operating system 5 , the second operating system 6 is configured to split the plurality of image data D1 and the plurality of voice data D2 .

[0027] Specifically, the first operating system 5 and the second operating system 6 correspond to different network locations. The storage circuit 3 stores a preset image type F1 and a preset audio type F2. The preset image type F1 may be, for example, BMP, GIF, JPEG, PNG, WMF, or SVG, and the preset audio type F2 may be, for example, WAV, MP3, MP4, FLAC, APE, or ALAC, but the present invention is not limited thereto.

[0028] The second operating system 6 further includes a virtual bridge node 62. The virtual bridge node 62 is configured to determine whether the type of each piece of image data D1 matches a predetermined image type F1. When the type of the image data D1 matches the predetermined image type F1, the virtual bridge node 62 transmits the image data D1 to the second operating system 6. When the type of the image data D1 does not match the predetermined image type F1, the virtual bridge node 62 transmits the image data D1 to the external network N. When the image data D1 is transmitted to the external network N, the remote device R can receive the image data D1.

[0029] The virtual bridge node 62 is configured to determine whether the type of each piece of voice data D2 matches the preset voice type F2. When the type of the voice data D2 matches the preset voice type F2, the virtual bridge node 62 transmits the voice data D2 to the second operating system 6. When the type of the voice data D2 does not match the preset voice type F2, the virtual bridge node 62 transmits the voice data D2 to the external network N. When the voice data D2 is transmitted to the external network N, the remote device R can receive the voice data D2.

[0030] Data diversion is achieved by determining the image and voice data types. For example, BMP images have larger bytes and higher quality, while JPEG images have smaller bytes and lower quality. The default image type F1 is set to BMP. When image data D1 matches the JPEG type, the virtual bridge node 62 transmits image data D1 to the remote device R. Because JPEG images have smaller bytes, the remote device R can receive image data D1 more quickly.

[0031] For example, WAV-type voice has a smaller byte count and lower sound quality, while MP3-type voice has a larger byte count and higher sound quality. The default voice type F2 is set to MP3. When the voice data D2 matches the WAV type, the virtual bridge node 62 transmits the voice data D2 to the remote device R. Because WAV-type voice has a smaller byte count, the remote device R can receive the voice data D2 more quickly.

[0032] Figure 2 FIG is a schematic diagram of a network camera according to a second embodiment of the present invention. Figure 2 Network cameras with Figure 1 The differences between network cameras are as follows.

[0033] The first operating system 5 and the second operating system 6 correspond to the same network location. Each piece of image data D1 and each piece of voice data D2 has its own connection port number. The connection port number is usually represented by a 16-bit number, but is not limited to this. The storage circuit 3 stores the agreed connection port number F3.

[0034] The second operating system 6 is configured to determine whether the connection port number of each piece of image data D1 matches the agreed-upon connection port number F3. If the connection port number of the image data D1 matches the agreed-upon connection port number F3, the image data D1 is transmitted to the second operating system 6. If the connection port number of the image data D1 does not match the agreed-upon connection port number F3, the second operating system 6 transmits the image data D1 to the external network N.

[0035] The second operating system 6 is configured to determine whether the connection port number of each piece of voice data D2 matches the agreed-upon connection port number F3. If the connection port number of the voice data D2 matches the agreed-upon connection port number F3, the voice data D2 is transmitted to the second operating system 6. If the connection port number of the voice data D2 does not match the agreed-upon connection port number F3, the second operating system 6 transmits the voice data D2 to the external network N.

[0036] Figure 3A and Figure 3B Flowchart of the data processing method of the network camera according to the first embodiment of the present invention. The data processing method includes configuring the processing circuit 2 to access the storage circuit 3 to perform the following steps. Figure 3A In step S301 , the first operating system 5 , the second operating system 6 and the peer-to-peer proxy module 7 are executed, wherein the peer-to-peer proxy module 7 runs under the first operating system 5 .

[0037] In step S302 , a first virtual network port 51 is configured on the first operating system 5 .

[0038] In step S303 , the second operating system 6 is configured to serve as a virtual network card for connecting to the external network N.

[0039] In step S304 , a second virtual network port 61 is configured on the second operating system 6 .

[0040] In step S305 , the first virtual network connection port 51 is connected to the second virtual network connection port 61 .

[0041] In step S306 , the image sensor 1 picks up a plurality of image data D1 .

[0042] In step S307 , the voice sensor 4 picks up a plurality of voice data D2 .

[0043] In step S308, the image processing module 8 is executed in the first operating system 5 to perform image processing on the plurality of image data D1. Image processing includes one or any combination of image enhancement, image encoding and decoding, image wavelet processing, resolution processing, color processing, and object recognition.

[0044] In step S309, the voice processing module 9 is executed in the first operating system 5 to perform voice processing on the plurality of voice data D2. Voice processing includes one or any combination of voice quantization, voice encoding and decoding, normalization, frame selection, endpoint detection, and noise filtering.

[0045] See also Figure 3B In step S310 , a virtual bridge node 62 is configured on the second operating system 6 .

[0046] In step S311 , the virtual bridge node 62 determines whether the type of each piece of image data D1 meets the preset image type F1 .

[0047] When the type of the image data D1 matches the preset image type F1, the process proceeds to step S312.

[0048] When the type of the image data D1 does not conform to the preset image type F1, the process proceeds to step S313.

[0049] In step S312 , the virtual bridge node 62 transmits the image data D1 to the second operating system 6 .

[0050] In step S313 , the virtual bridge node 62 transmits the image data D1 to the external network N.

[0051] In step S314 , the virtual bridge node 62 determines whether the type of each voice data D2 meets the preset voice type F2 .

[0052] When the type of the voice data D2 matches the preset voice type F2, the process proceeds to step S315.

[0053] When the type of the voice data D2 does not conform to the preset voice type F2, the process proceeds to step S316.

[0054] In step S315 , the virtual bridge node 62 transmits the voice data D2 to the second operating system 6 .

[0055] In step S316 , the virtual bridge node 62 transmits the voice data D2 to the external network N.

[0056] Figure 4A and Figure 4B Flowchart of the data processing method of the network camera according to the second embodiment of the present invention. The data processing method includes configuring the processing circuit 2 to access the storage circuit 3 to perform the following steps. Figure 4A In step S401 , the first operating system 5 , the second operating system 6 and the peer-to-peer proxy module 7 are executed, wherein the peer-to-peer proxy module 7 runs under the first operating system 5 .

[0057] In step S402 , a first virtual network port 51 is configured on the first operating system 5 .

[0058] In step S403 , the second operating system 6 is configured to serve as a virtual network card for connecting to the external network N.

[0059] In step S404 , a second virtual network port 61 is configured on the second operating system 6 .

[0060] In step S405 , the first virtual network connection port 51 is connected to the second virtual network connection port 61 .

[0061] In step S406 , the image sensor 1 picks up a plurality of image data D1 .

[0062] In step S407 , the voice sensor 4 picks up a plurality of voice data D2 .

[0063] In step S408 , the image processing module 8 is executed in the first operating system 5 to perform image processing on the plurality of image data D1 .

[0064] See also Figure 4B In step S409 , the voice processing module 9 is executed in the first operating system 5 to perform voice processing on the plurality of voice data D2 .

[0065] In step S410 , the second operating system 6 determines whether the connection port number of each piece of image data D1 matches the agreed connection port number F3 .

[0066] When the connection port number of the image data D1 matches the agreed connection port number F3, the process proceeds to step S411.

[0067] When the connection port number of the image data D1 does not match the agreed connection port number F3, the process proceeds to step S412.

[0068] In step S411 , the image data D1 is transmitted to the second operating system 6 .

[0069] In step S412 , the second operating system 6 transmits the image data D1 to the external network N.

[0070] In step S413 , the second operating system 6 determines whether the connection port number of each voice data D2 matches the agreed connection port number F3 .

[0071] When the connection port number of the voice data D2 matches the agreed connection port number F3, the process proceeds to step S414.

[0072] When the connection port number of the voice data D2 does not match the agreed connection port number F3, the process proceeds to step S415.

[0073] In step S414 , the voice data D2 is transmitted to the second operating system 6 .

[0074] In step S415 , the second operating system 6 transmits the voice data D2 to the external network N.

[0075] [Beneficial Effects of Embodiments]

[0076] One of the benefits of the present invention is that the network camera and data processing method provided herein do not require additional proprietary protocols between the first and second operating systems, allowing for bidirectional data transmission between the first and second operating systems. Because the point-to-point proxy module does not run within the second operating system, the second operating system is solely responsible for network card functions. This clarifies the division of labor between the first and second operating systems, reducing development complexity and shortening development cycles.

[0077] The contents disclosed above are only preferred feasible embodiments of the present invention and do not limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made by applying the contents of the description and drawings of the present invention are included in the scope of the patent application of the present invention.

[0078]

Explanation of symbols

[0079] A: Network camera

[0080] 1: Image sensor

[0081] 2: Processing circuit

[0082] 3: Storage circuit

[0083] 4: Voice sensor

[0084] 5: First operating system

[0085] 51: First virtual network connection port

[0086] 6: Second operating system

[0087] 61: Second virtual network connection port

[0088] 62: Virtual bridge node

[0089] 7: Peer-to-peer proxy module

[0090] 8: Image processing module

[0091] 9: Voice processing module

[0092] D1: Image data

[0093] D2: Voice data

[0094] F1: Preset image type

[0095] F2: Preset voice type

[0096] F3: Agreed connection port number

[0097] N: External network

[0098] R: Remote device

[0099] S301~S316, S401~S415: steps.

Claims

1. A network camera, comprising: a storage circuit; as well as a processing circuit electrically connected to the storage circuit, the processing circuit accessing the storage circuit to execute a first operating system, a second operating system, and a peer-to-peer proxy module, the first operating system collecting a plurality of data, the peer-to-peer proxy module running under the first operating system, and the second operating system configured to function as a virtual network card for connecting to an external network; The first operating system includes a first virtual network connection port, the second operating system includes a second virtual network connection port, and the first virtual network connection port is connected to the second virtual network connection port.

2. The network camera according to claim 1, wherein The specification of the first virtual network connection port is a secure digital input / output port, a universal serial bus (USB), or a serial peripheral port (SPI). The specification of the second virtual network connection port is the same as that of the first virtual network connection port.

3. The network camera according to claim 1, wherein The processing circuit further accesses the storage circuit to execute an image processing module. The image processing module runs under the first operating system to perform image processing on the plurality of data.

4. The network camera according to claim 3, wherein: The image processing includes one or any combination of image enhancement, image encoding and decoding, image wavelet processing, resolution processing, color processing and object recognition.

5. The network camera according to claim 1, wherein The processing circuit further accesses the storage circuit to execute a voice processing module. The voice processing module runs under the first operating system to perform voice processing on the plurality of data. The network camera according to claim 5 , wherein: The speech processing includes one or any combination of speech quantization, speech encoding and decoding, normalization, audio frame selection, endpoint detection, and noise filtering.

7. The network camera according to claim 1, wherein The second operating system further includes a virtual bridge node, which is configured to determine whether the type of each data meets a preset type; when the type of the data meets the preset type, the virtual bridge node transmits the data to the second operating system; when the type of the data does not meet the preset type, the virtual bridge node transmits the data to the external network.

8. The network camera according to claim 7, wherein: The first operating system and the second operating system correspond to different network addresses respectively.

9. The network camera according to claim 1, wherein The second operating system is configured to determine whether the connection port number of each data meets an agreed connection port number; when the connection port number meets the agreed connection port number, the data is transmitted to the second operating system; when the connection port number does not meet the agreed connection port number, the second operating system transmits the data to the external network.

10. A data processing method for a network camera, comprising: A processing circuit is configured to access a storage circuit to: executing a first operating system, a second operating system, and a peer-to-peer proxy module, wherein the peer-to-peer proxy module runs under the first operating system; The first operating system collects a plurality of data; configuring a first virtual network connection port on the first operating system; configuring the second operating system to function as a virtual network card for connecting to an external network; configuring a second virtual network port on the second operating system; and Connect the first virtual network connection port to the second virtual network connection port.

Images