Electronic device for performing automatic firmware update and control method therefor

Abstract

Disclosed is an electronic device. The electronic device according to the present disclosure comprises: a camera including a communication circuit; and an artificial intelligence processor operatively connected to the camera through an intranet, wherein the camera is configured to transmit, to the artificial intelligence processor, firmware data for updating the artificial intelligence processor when the firmware data is received from an external device through the intranet, and the artificial intelligence processor can update firmware of the artificial intelligence processor without stopping the operation of the camera.

Description

Electronic device performing automatic firmware update and method of controlling the same

[0001] The present disclosure relates to an electronic device that performs automatic firmware updates and a method for controlling the same.

[0002] With the widespread adoption of video processing devices (e.g., CCTV), most buildings are equipped with them. By inputting video acquired through these devices into artificial intelligence models for analysis, abnormal objects (e.g., intruders) can be identified. Generally, since these AI models are installed on servers outside the building, video processing devices face the inconvenience of having to transmit acquired video externally. Consequently, there is a concern regarding data leakage, and there was an unnecessary issue in compliance with the Personal Information Processing Act.

[0003] Accordingly, there was a continuous demand for the development of an intranet-based image processing system capable of overcoming the limitations of the aforementioned technology, and an intranet-based image processing system was developed.

[0004] Meanwhile, in the case of intranet-based image processing systems, image analysis devices (hereinafter referred to as AI processors) may be installed within a building. Consequently, there has been an inconvenience in that the AI ​​processors must be physically removed to perform firmware updates. Therefore, there is a continuous demand for the development of an automatic firmware update method that can overcome the limitations of the aforementioned technology.

[0005] The background description of the invention is provided to facilitate a better understanding of the present invention. The matters described in the background description should not be construed as an acknowledgment that they exist as prior art.

[0006] Meanwhile, to solve the aforementioned problem, the inventors of the present invention intended to develop an electronic device that transmits data for firmware updates to an artificial intelligence processor through a camera.

[0007] In addition, the inventors of the present invention sought to develop an electronic device capable of updating the firmware of an artificial intelligence processor without stopping the operation of the camera during the time the artificial intelligence processor is being updated.

[0008] In particular, the inventors of the present invention recognized that by combining a camera with an artificial intelligence processor and using the camera as an intranet-based communication interface, the limitation of a user having to directly access the artificial intelligence processor could be overcome.

[0009] In addition, the inventors of the present invention recognized that by temporarily storing the video captured by the camera in real time in memory while the artificial intelligence processor is being updated, they could overcome the limitation in which all functions of the electronic device are interrupted while the firmware update of the conventional electronic device is being performed.

[0010] As a result, the inventors of the present invention have developed an electronic device capable of remotely updating firmware without stopping the operation of the camera, without physically separating the artificial intelligence processor from the camera, and without direct access.

[0011] Therefore, the problem that the present invention aims to solve is to enable the selective updating of only the components requiring firmware updates among a plurality of components included in an electronic device by configuring the camera to transmit firmware data to an artificial intelligence processor via an intranet.

[0012] The problems of the present invention are not limited to those mentioned above, and other unmentioned problems will be clearly understood by those skilled in the art from the description below.

[0013] An electronic device according to the present disclosure includes a camera including a communication circuit and an artificial intelligence processor operably connected to the camera via an intranet, wherein the camera is configured to transmit firmware data to the artificial intelligence processor when firmware data for updating the artificial intelligence processor is received via the intranet from an external device, and the artificial intelligence processor may be configured to perform a firmware update of the artificial intelligence processor without stopping the operation of the camera.

[0014] The camera is configured to switch the artificial intelligence processor to an update mode and start an update of the artificial intelligence processor when it receives the firmware data and completes the authentication procedure, and the update mode may be a mode in which the artificial intelligence processor can receive the firmware data and perform an update while the camera is operating.

[0015] In addition, the above authentication procedure may be a procedure for switching the artificial intelligence processor to the update mode when the decryption of the firmware data is completed by the camera authenticating the hash value and key included in the firmware data.

[0016] Additionally, the above authentication procedure may be a procedure in which, if the authentication of the hash value and key included in the firmware data fails, the camera discards the firmware data and stops the update of the artificial intelligence processor.

[0017] In addition, the camera may be configured to store the tasks of the camera in real time in the memory included in the camera during the time when the firmware update of the artificial intelligence processor is performed.

[0018] When the firmware update of the artificial intelligence processor is completed, the camera transmits the task stored in the memory to the artificial intelligence processor, and the artificial intelligence processor may include an FTP server.

[0019] In addition, the artificial intelligence processor and the camera may be connected via a first cable capable of TCP / IP protocol and a second cable which is a serial cable separate from the first cable, and the image captured by the camera may be transmitted through the first cable and the firmware data may be transmitted through the second cable.

[0020] A method for controlling an electronic device including a camera and an artificial intelligence processor operably connected to the camera via an intranet, wherein when the camera receives firmware data for updating the artificial intelligence processor, the method comprises the steps of transmitting the firmware data to the artificial intelligence processor and performing a firmware update of the artificial intelligence processor without stopping the operation of the camera, and wherein the camera may include a communication circuit.

[0021] In a non-transient computer-readable recording medium that stores one or more instructions executed by a processor of an electronic device to perform an operation, the electronic device including a camera and an artificial intelligence processor operably connected to the camera via an intranet, wherein the operation includes the steps of transmitting the firmware data to the artificial intelligence processor when the camera receives firmware data for updating the artificial intelligence processor, and performing the firmware update of the artificial intelligence processor without stopping the operation of the camera, and the camera may include a communication circuit.

[0022] The present invention provides a new remote control system for an electronic device, thereby enabling the firmware of an artificial intelligence processor to be updated while physically connected to a camera.

[0023] Accordingly, user inconvenience can be reduced by performing a firmware update remotely without removing the AI ​​processor from the camera.

[0024] Furthermore, the present invention is configured to allow a camera to transmit firmware data to an artificial intelligence processor via an intranet, thereby enabling the selective updating of only the components requiring firmware updates among the multiple components included in the electronic device. Accordingly, updates to the artificial intelligence processor can be performed without stopping the operation of the electronic device, thus preventing security gaps.

[0025] The effects according to the present invention are not limited to those exemplified above, and various other effects are included in this specification.

[0026] FIG. 1 is a drawing for explaining the operation of an electronic device according to at least one embodiment of the present disclosure.

[0027] FIGS. 2 and FIGS. 3 are schematic block diagrams of an image processing device according to at least one embodiment of the present disclosure.

[0028] FIG. 4 is a schematic block diagram of a server embedded in a camera according to at least one embodiment of the present disclosure.

[0029] FIGS. 5A and FIGS. 5B are drawings for illustrating the appearance of an electronic device according to at least one embodiment of the present disclosure.

[0030] FIGS. 6a and 6b are drawings for illustrating the connection of each component included in an electronic device according to at least one embodiment of the present disclosure.

[0031] FIG. 7 is a flowchart illustrating the operation of an electronic device according to at least one embodiment of the present disclosure.

[0032] FIG. 8 is a flowchart illustrating the process of performing a firmware update of an artificial intelligence processor according to at least one embodiment of the present disclosure.

[0033] FIG. 9 is a diagram showing data processing of a camera while an artificial intelligence processor according to at least one embodiment of the present disclosure is performing a firmware update.

[0034] FIG. 10 is a drawing for illustrating a user interface (UI) of a device manager according to at least one embodiment of the present disclosure.

[0035] FIG. 11 is a drawing for explaining that a plurality of external cameras are connected to an electronic device according to at least one embodiment of the present disclosure.

[0036] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols are assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the invention.

[0037] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0038] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0039] A singular expression includes a plural expression unless the context clearly indicates otherwise.

[0040] In embodiments of the present invention, terms such as "comprising" or "having" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not excluding in advance the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0041] Additionally, in embodiments of the present invention, at least one of the plurality of components refers to all of the plurality of components, as well as each of the plurality of components excluding the remainder, or any combination thereof. Furthermore, "configured to" may be used interchangeably with, depending on the context, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." "Configured to" does not necessarily mean only that which is "specifically designed to" in hardware. Instead, in some situations, the expression "device configured to" may mean that the device is "capable of" together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in a memory device.

[0042] In the present invention, the term "image" is used to encompass discontinuous video, still image, and MJPEG.

[0043] Additionally, for the understanding of the present invention, reference numerals have been indicated in the preferred embodiments illustrated in the drawings, and specific terms have been used to describe the embodiments; however, the present invention is not limited by said specific terms, and the present invention may include all components that are conventionally conceivable by those skilled in the art.

[0044] The present invention may be represented by functional block configurations and various processing steps. These functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the present invention may employ direct circuit configurations such as memory, processing, logic, look-up tables, etc., which can execute various functions by the control of one or more microprocessors or other control devices. Similar to how the components of the present invention may be implemented as software programming or software elements, the present invention may be implemented in programming or scripting languages ​​such as C, C++, Java, assembler, etc., including various algorithms implemented as combinations of data structures, processes, routines, or other programming configurations. Functional aspects may be implemented as algorithms executed on one or more processors. Additionally, the present invention may employ prior art for electronic configuration, signal processing, and / or data processing, etc. Terms such as "mechanism," "element," "means," and "configuration" may be used broadly and are not limited to mechanical and physical configurations. The above terms may include the meaning of a series of software processes (routines) in conjunction with processors, etc.

[0045] The specific embodiments described in this invention are examples and do not limit the scope of the invention in any way. For the sake of brevity of the specification, descriptions of prior electronic configurations, control systems, software, and other functional aspects of said systems may be omitted. Additionally, the connections of lines or connecting members between components shown in the drawings are illustrative of functional connections and / or physical or circuit connections, and may be replaced or additionally represented as various functional connections, physical connections, or circuit connections in actual devices. Furthermore, unless specifically stated as "essential," "importantly," etc., a component may not be strictly necessary for the application of the invention.

[0046] In the specification of the present invention (particularly in the claims), the use of the term "above" and similar descriptive terms may be in both singular and plural. Furthermore, where a range is described in the present invention, it is implied to include an invention applying individual values ​​belonging to said range (unless otherwise stated), and is equivalent to describing each individual value constituting said range in the detailed description of the invention. Finally, regarding the steps constituting the method according to the present invention, unless explicitly stated or otherwise stated, said steps may be performed in a suitable order. The present invention is not necessarily limited by the order in which said steps are described.

[0047] In the following description, the configuration and operation of an electronic device according to the present disclosure will be specifically explained.

[0048] FIG. 1 is a drawing for explaining the operation of an electronic device according to at least one embodiment of the present disclosure.

[0049] Referring to FIG. 1, the electronic device (100) according to the present disclosure may be a device configured by combining a camera (101) and an artificial intelligence processor (102). The electronic device (100) according to the present disclosure is distinguished from a system including a conventional SaaS (Software as a Service)-based artificial intelligence processing server. A system including a conventional SaaS-based artificial intelligence processing server has a configuration in which the image from the camera is transmitted to a server equipped with an artificial intelligence model via an external network. Accordingly, personal information without consent may be leaked to the outside, and security may be vulnerable. However, the electronic device (100) according to the present disclosure, which will be described specifically below, has a configuration in which the camera (101) operates as a gateway that simultaneously functions as a router, and the artificial intelligence processor (102) is located on an internal network. Accordingly, personal information without consent is not leaked to the outside, and security may be enhanced.

[0050] Meanwhile, more specifically, the artificial intelligence processor (102) may be a device that identifies and analyzes objects included in the image. For example, the artificial intelligence processor (102) may receive an image acquired through the camera (101) and analyze the image. The image analysis through the aforementioned camera (101) and artificial intelligence processor (102) is connected via an intranet, so that the image analysis can be performed inside the building without transmitting data outside the network.

[0051] The electronic device (100) may be attached to a specific area inside the building. The specific area may include, but is not limited to, the central part of the ceiling and may include various locations such as the left wall and the right wall inside the building.

[0052] The electronic device (100) can receive firmware data for a firmware update of an artificial intelligence processor (102) through a camera (101). In one embodiment, the electronic device (100) can communicate with an external device (e.g., a desktop, 200) to receive firmware data uploaded to the external device (200).

[0053] The electronic device (100) can perform a firmware update of the artificial intelligence processor (102) based on the received data. At this time, the camera (101) can continue to operate without stopping while the firmware update of the artificial intelligence processor (102) is in progress.

[0054] Therefore, since the camera (101) can continuously take photos without interruption, there is an effect that no gaps occur during the security surveillance process.

[0055] The configuration of the electronic device (100) and the operation for firmware update will be described later.

[0056] FIGS. 2 and FIGS. 3 are schematic block diagrams of an image processing device according to at least one embodiment of the present disclosure.

[0057] In one embodiment, the image processing device may be a camera (101). The camera (101) may be an IP camera or a network camera. The camera (101) may acquire an image, compress the acquired image, and transmit it to an external device using a predetermined transmission protocol. For example, the camera (101) may acquire an image, analyze the acquired image in real time to detect / identify / track / analyze / search for a target or moving object, and provide appropriate information or functions to the user.

[0058] Referring to FIGS. 2 and FIGS. 3, the camera (101) may include a sensing unit (1010), a data processing unit (1030), and a communication unit (1050).

[0059] The sensor unit (1010) may be a sensing means including an optical system (110) and an image sensor (120).

[0060] The optical system (110) can optically process light from a subject. The optical system (110) may include at least one lens, such as a zoom lens that controls the field of view to narrow or widen according to the focal length, and a focus lens that focuses. In one embodiment, the lens may include at least one glass lens and / or at least one liquid lens. A liquid lens is a lens that can control zoom and focus by controlling the thickness (shape (curvature) of the liquid lens) using a fluid liquid. Using a liquid lens has the advantage of reducing the number of lenses and the size of the lens module, and also allows for fast focusing at a desired focal length.

[0061] The optical system (110) may further include an optical low-pass filter (OLPF), an infrared cut filter (IRCF), an iris for controlling light intensity, etc.

[0062] The image sensor (120) can perform the function of capturing a surveillance area to acquire an image. In one embodiment, the image sensor (120) can be implemented as a CCD (Charge-Coupled Device) sensor, a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, etc. The image sensor (120) can convert an optical signal transmitted through the optical system (110) into an electrical signal.

[0063] The data processing unit (1030) may be an information processing means implemented with various number of hardware or / and software configurations that execute specific functions. For example, the data processing unit (1030) may refer to a data processing device embedded in hardware having a physically structured circuit to perform a function expressed by code or instructions included in a program. The data processing device embedded in hardware may include, for example, a microprocessor, a central processing unit (CPU), an image signal processor (ISP), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), and other processing devices, but the scope of the present invention is not limited thereto. The data processing unit (1030) may be implemented with at least two of the above-described processing devices and processors as a single integrated configuration (e.g., a single chip), or each as an independent configuration (e.g., multiple chips).

[0064] In one embodiment, the data processing unit (1030) may further include a neural processing unit (NPU). In one embodiment, the neural processing unit may be included in the data processing unit (1030) in a form inherent within the aforementioned processing unit and processor. The neural processing unit is a processor specialized in processing artificial intelligence models, and the artificial intelligence model may be generated through machine learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may additionally or substantially include a software structure.

[0065] In one embodiment, the artificial intelligence model can be trained by collecting and labeling suitable training data for determining object detection / classification / recognition, etc., and applying it to an artificial neural network. The trained artificial intelligence model can be mounted on a camera (101) and used for inference operations such as object detection / classification / recognition through a neural network processing device of the camera (101) or the aforementioned data processing device.

[0066] In one embodiment, the artificial intelligence model can be further trained using a cloud server to suit the monitoring environment or user requirements even after being installed on the camera (101), and the newly trained model can be redeployed to the camera (101) for use.

[0067] A neural network processing unit may be mounted on the camera (101) in the form of at least one hardware chip. For example, the neural network processing unit may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or may be manufactured as part of a general-purpose processor (CPU) or a graphics-dedicated processor (GPU) and mounted on the camera (101). Additionally, the neural network processing unit may be implemented as a software module. If the neural network processing unit is implemented as a software module (or a program module containing instructions), the software module may be stored on a non-transitory computer-readable media. In this case, at least one software module may be provided by an operating system (OS) or by an application. The data processing unit (1030) may include an image processing unit (130), a streaming unit (140), an analysis unit (150), an event unit (160), a system management unit (170), and a camera control unit (180).

[0068] The image processing unit (130) can improve image quality by adjusting the brightness, contrast, color amount, contrast ratio, sharpness, etc. of the image. Each parameter value for image quality improvement can be fixed as an initial value or adjusted by the user and pre-set. The image processing unit (130) can perform image signal processing for image quality improvement, such as noise reduction, gamma correction, color filter array interpolation, color matrix, color correction, and color enhancement. The image processing unit (130) can apply various methods for image quality improvement, such as edge enhancement algorithms, histogram-based image quality improvement algorithms such as histogram equalization or histogram stretching, and hue control algorithms. In one embodiment, the image processing unit (130) may be an image signal processor (ISP). The image processing unit (130) may include an exposure control unit (1311), a backlight correction unit (1312), a balance correction unit (1313), a gamma correction unit (1314), a sharpness control unit (1315), a shake correction unit (1316), a focus control unit (1317), a zoom control unit (1318), a filter control unit (1319), an OSD control unit (1320), and a noise control unit (1321).

[0069] The exposure control unit (1311) can control the brightness of the image by controlling the amount of light entering the image sensor (120) using at least one of a shutter, an iris, and gain or ISO sensitivity. The exposure control unit (1311) can control the amount of light by adjusting the shutter speed. The exposure control unit (1311) can control the amount of light by adjusting the degree of opening and closing of the iris. The exposure control unit (1311) can control the degree of light amplification by adjusting the gain or ISO sensitivity. In one embodiment, the exposure control unit (1311) can control the shutter, the iris, and the gain / ISO sensitivity according to user settings. In one embodiment, when the function is set, the exposure control unit (1311) can perform an auto exposure algorithm according to the illuminance of the environment in which the camera is installed.

[0070] The backlight correction unit (1312) can improve the quality of an image by applying a backlight correction algorithm to the image so that dark areas are clearly visible when the image is too bright overall. The backlight correction algorithm may include a Back Light Compensation (BLC) algorithm, a Wide Dynamic Range (WDR) algorithm, a Digital Wide Dynamic Range (D-WDR) algorithm, and a High Dynamic Range (HDR) algorithm. The backlight correction unit (1312) can increase the dynamic range using the WDR algorithm, the D-WDR algorithm, and the HDR algorithm, thereby enabling both bright and dark areas in the image to be clearly visible simultaneously. In one embodiment, the backlight correction unit (1312) can block backlighting in a specific area to make the image of other areas appear brighter. For example, when car headlights shine strongly at a dark parking lot entrance or a gas station entrance at night, only the headlight light can be blocked to identify the vehicle license plate. The function of the backlight correction unit (1312) can be set by the user (on / off).

[0071] The balance correction unit (1313) can improve the color identification ability of an image by adjusting the white balance of the image to correct color differences according to the light source (illumination). In one embodiment, the balance correction unit (1313) can adjust the white balance appropriately for the selected light source according to user settings. In one embodiment, the balance control unit (1313) can perform an Auto White Balance algorithm according to the environment around the camera when its function is set. In one embodiment, the balance control unit (1313) can adjust the white balance of the image to a white balance value manually set by the user.

[0072] The gamma correction unit (1314) can increase visibility by changing the contrast of the image through gamma correction.

[0073] The sharpness control unit (1315) can increase the resolution by adjusting the sharpness of the subject boundary (contour).

[0074] The shake correction unit (1316) can stabilize the image by applying a shake correction algorithm to the image to correct image shake caused by camera shake. The shake correction algorithm may include an Optical Image Stabilization (OIS) algorithm, an Electronic Image Stabilization (EIS) algorithm, and a Digital Image Stabilization (DIS) algorithm.

[0075] The focus control unit (1317) can control the focus of the camera using a focus control algorithm. In one embodiment, the focus control unit (1317) can move the position of the focus lens by controlling the focus motor according to a control signal for focus control. The focus control algorithm may include known autofocus algorithms such as a hill climbing method. For example, the focus control unit (1317) can move the position of the focus lens from a near distance to a far distance (infinity) in real time, compare the focus values ​​before and after to check the increase or decrease in the focus value, the tilt, and the change in the tilt, determine the peak point with the largest focus value as the in-focus position, and control the driving of the focus motor to move the focus lens to the in-focus position. In one embodiment, the focus control unit (1317) can control the focus by controlling the curvature of the liquid lens according to a control signal for focus control.

[0076] The zoom control unit (1318) can perform optical zoom and / or digital zoom functions according to a control signal for controlling the zoom magnification. In one embodiment, the zoom control unit (1318) can adjust the zoom magnification by moving the position of the zoom lens to zoom in or zoom out. In one embodiment, the zoom control unit (1318) can control the zoom magnification by controlling the curvature of the liquid lens. In one embodiment, the zoom control unit (1318) can provide a more magnified image through digital zoom exceeding the optical zoom. The angle of view or field of view of the camera can be controlled by the zoom magnification.

[0077] The filter control unit (1319) can improve image identification capabilities during the day and night by adjusting the infrared cut filter (IRCF). The filter control unit (1319) can block infrared rays and allow visible light to pass through by positioning the infrared cut filter (IRCF) in front of the image sensor (120). The filter control unit (1319) can allow infrared rays to pass through in addition to visible light by removing the infrared cut filter (IRCF). The filter control unit (1319) can perform a day / night mode function by automatically turning the infrared cut filter (IRCF) on / off according to the ambient light level.

[0078] The OSD (On-screen display) control unit (1320) can overlay a mask of text and / or polygons on the image. For example, the OSD (On-screen display) control unit (1320) can display the date, time, manufacturer, etc. at a predetermined location on the image.

[0079] The noise control unit (1321) can perform a digital noise reduction algorithm to reduce color noise in an image captured in a low-light environment. The noise reduction algorithm may include 2D-NR (Noise Reduction) and 3D-NR.

[0080] The streaming unit (140) can compress the video received from the video processing unit (130) and provide it to an external device via a network. The streaming unit (140) may include an encoder (1411), an audio processing unit (1412), and an RTSP server (1413).

[0081] The encoder (1411) can encode the image and compress the image. The encoder (1411) can compress the raw image input from the image sensor (120) or the image processed by the image processing unit (130). In one embodiment, the raw image may be used for artificial intelligence (AI) algorithms, etc.

[0082] The encoder (1411) can compress video using an intra-frame compression method and / or an inter-frame compression method. Depending on the network environment or monitoring purpose, the encoder (1411) can compress video into compression formats such as H.264, H.265 (HEVC (High Efficiency Video Coding)), JPEG, and MPEG-4.

[0083] The encoder (1411) can compress video according to encoding settings to generate at least one video stream. Encoding settings may include compression format, video quality (high quality / medium quality / low quality), resolution, bit rate, frame rate, etc. The encoder (1411) may compress video using a constant bit rate (CBR) or a variable bit rate (VBR). A profile of the video stream may be determined according to the encoding settings. The profile may represent the specifications of the video stream transmitted from the camera (101) to an external device. The profile may include setting values ​​such as compression format, video quality (high quality / medium quality / low quality), resolution, frame rate, bit rate, etc. For example, the profile may include setting values ​​such as "MJPEG, low quality, 640X480, 5fps, 2Mbps". In one embodiment, a profile of a video stream output from an encoder (1411) may be pre-set according to the network environment and the video receiving device (external device). For example, a profile suitable for streaming purposes may be pre-set, such as a profile for a video stream for storage, a profile for a video stream for monitoring screen output, a profile for a video stream for a mobile device, or a profile for a video stream for a web viewer. The encoder (1411) can compress the video using the setting values ​​of the selected profile.

[0084] The audio processing unit (1412) includes an audio codec and can generate at least one audio stream by processing and compressing audio input from an audio sensor and / or a stored sound source. Depending on the microphone structure, the audio sensor may be a dynamic microphone, a condenser microphone, a ribbon microphone, etc., and depending on the directionality, a directional microphone, an omnidirectional microphone, a super-directional microphone, etc., may be used. The audio sensor may be provided separately from the image sensor (120) or integrally, such as being embedded in the image sensor (120).

[0085] The RTSP server (1413) may be a server operated for real-time video streaming. The RTSP server (1413) may transmit video streams and audio streams to external devices connected to the RTSP port via a network according to the Real-time Streaming Protocol (RTSP).

[0086] The analysis unit (150) can analyze the image processed by the image processing unit (130) in real time. The analysis unit (150) can perform background area detection, foreground and object detection, object counting, camera tampering detection, face detection, etc. Additionally, the analysis unit (150) can calculate brightness, color, texture, and shape information of the image. The analysis unit (150) can analyze audio input from an audio sensor in real time. The results of image and / or audio analysis can be generated as metadata. In one embodiment, the analysis unit (150) can detect / recognize / identify objects using artificial intelligence (AI) based technology.

[0087] The analysis unit (150) may include a motion detection unit (1511), an audio detection unit (1512), an audio classification unit (1513), a tempering detection unit (1514), and a defocus detection unit (1515).

[0088] The motion detection unit (1511) can detect the motion of an object within an image. The motion detection unit (1511) can detect the motion of an object from an image using a motion detection (MD) algorithm. In one embodiment, the motion detection unit (1511) can detect motion using an artificial neural network (ANN).

[0089] The audio detection unit (1512) can detect audio input from the audio sensor.

[0090] The audio classification unit (1513) can classify the detected audio. In one embodiment, the audio can be classified into vocal, which is a sound produced from a person's throat, and non-vocal, which is other sounds. For example, vocal can be classified into conversation, scream, crying, etc., and non-vocal can be classified into footsteps, glass breaking, explosion, crash, gunshot, etc. It goes without saying that vocal and non-vocal are not limited to the types mentioned above and can be set in various ways depending on the monitoring area and system design. In one embodiment, the audio classification unit (1513) can learn audio features and classify the audio using an Artificial Neural Network (ANN).

[0091] The tempering detection unit (1514) can detect camera movement or camera obstruction situations that last for a predetermined period of time. For example, the tempering detection unit (1514) can detect situations where spray is applied to the lens, where the lens is covered, etc.

[0092] The defocus detection unit (1515) can detect focus distortion.

[0093] The event unit (160) may receive video and / or audio from the analysis unit (150). The event unit (160) may receive metadata indicating the analysis results of the video and / or audio from the analysis unit (150). The event unit (160) may detect an event based on the metadata and notify the detection of the event. The event unit (160) may generate an event rule to perform an action on the device when a specific event occurs. The event rule may include conditions and actions. The conditions may be detailed rules for detecting the event. The actions may be operations performed when the occurrence of the event is determined. The event unit (160) may associate an action to be taken in response to the occurrence of the event. In one embodiment, the event conditions and the action associated with the event may be predefined by the user.

[0094] The event unit (160) may include an event generation unit (1611), a handover unit (1612), an alarm unit (1613), an FTP upload unit (1614), a storage control unit (1615), and an MQTT unit (1616).

[0095] The event generation unit (1611) can generate conditions by combining various situations detected as a result of analyzing video and / or audio. The event generation unit (1611) can detect events based on conditions set according to the type of event.

[0096] In one embodiment, the event generating unit (1611) may generate a video event when the analysis result of the video satisfies a set event condition. Here, the video event may include the appearance and / or disappearance of an object within the screen, the occurrence of a specific image (e.g., the appearance of a face that cannot be recognized) by the user, the change in screen color, the detection of motion of an object, the detection of motion by the user within a specific area, the detection of motion by the user in a specific direction, the turning off of the video, tampering, the distortion of focus, etc.

[0097] In one embodiment, the event generating unit (1611) may generate an audio event when the result of analyzing the audio satisfies a set event occurrence condition. The audio event may include events set by the user, such as the occurrence of a specific audio signal such as conversation, scream, crying, or shouting; the occurrence of abnormal audio signals such as footsteps, alarm, crash, car tire skid, glass breaking sound, explosion, or gunshot; or the occurrence of a voice exceeding a threshold value.

[0098] In one embodiment, the event generation unit (1611) may generate an event when a combination of video analysis results and / or audio analysis results satisfies a set event occurrence condition. It goes without saying that video events and audio events are not limited to the types described above and can be set in various ways depending on the monitoring area and system design.

[0099] The handover unit (1612) can transmit the generated event or event generation conditions to another camera, or receive the event or event generation conditions from another camera, so that the camera (101) can perform a set action when an event occurs, such as panning, tilting, zooming, or automatic object tracking.

[0100] The alarm unit (1613) can output an alarm signal when an event occurs. The alarm unit (1613) can trigger input from various sensors outside the camera or output to an actuator to output an alarm signal. The alarm unit (1613) can notify of the occurrence of an event through audio playback, email transmission, etc.

[0101] The FTP upload unit (1614) can upload the video and / or audio in which the event is detected to a File Transfer Protocol (FTP) server on the network when an event occurs. The video may include still images and video images. In one embodiment, the FTP upload unit (1614) can upload the video and / or audio in which the event is detected to an FTP server at a set upload period and a set upload speed when an event occurs.

[0102] The storage control unit (1615) can store (record) video and / or audio in a storage device. In one embodiment, the storage control unit (1615) can store video and / or audio and metadata received from the analysis unit (150) in a storage device. The metadata may include object information (movement, sound, intrusion into a designated area, etc.), object identification information (person, car, license plate, face, hat, clothing, etc.) detected from the video and / or audio, and detected location information (coordinates, size, etc.). In one embodiment, when an event occurs, the storage control unit (1615) can store video and / or audio and metadata for a predetermined period of time before and after the event in a storage device. The storage control unit (1615) can store video according to a set profile.

[0103] The storage device can store various programs and data required for the operation of the camera (101). Data reading, recording, modification, deletion, and updating can be performed by each component including the image processing unit (130) of the storage device. Additionally, the storage device can store a neural network model (e.g., a deep learning model) generated through a learning algorithm for data recognition / classification. The storage device may include internal memory and / or external storage media such as an SD card. The storage device may include a Video Management System (VMS), a Network Video Recorder (NVR), etc. The storage device may include a Network-Attached Storage (NAS) and a Storage Area Network (SAN), such as web storage and a cloud server, which perform storage functions over the Internet.

[0104] The MQTT unit (1616) can transmit (notify) events or receive notifications of event occurrences using the MQTT (Message Queuing Telemetry Transport) protocol. In one embodiment, the MQTT unit (1616) includes an MQTT client and can transmit events in real time by publishing MQTT messages to an MQTT broker (server) using the MQTT protocol through the MQTT client. In one embodiment, the MQTT unit (1616) can subscribe to MQTT messages published to the MQTT broker (server) to receive notifications of event occurrences in real time and start video recording.

[0105] The system management unit (170) may include a firmware upgrade unit (1711), a system information management unit (1712), a power management unit (1713), an RTC management unit (1714), and a network management unit (1715).

[0106] The firmware upgrade unit (1711) can upgrade the firmware (F / W) of the camera. The firmware upgrade unit (1711) can upgrade the old version firmware by receiving new firmware (F / W) from the firmware server via wired or wireless connection.

[0107] The system information management department (1712) can manage product information such as the camera model name and serial number.

[0108] The power management unit (1713) can convert AC or DC power supplied from an external power source into power required for the operation of each component of the camera. The power management unit (1713) may include an auxiliary power source, such as a rechargeable built-in or replaceable battery. The power management unit (1713) can manage power according to the class of the Ethernet Power over Ethernet (PoE). The power management unit (1713) can manage and control the auxiliary power source and the external power source in maximum power mode and low power mode.

[0109] The RTC management unit (1714) can manage the camera's internal time by synchronizing with a server such as NTP.

[0110] The network management unit (1715) can manage general network functions such as IP address settings, port settings, and DDNS server settings.

[0111] The camera control unit (180) can control the camera's posture by moving the camera to a physical position corresponding to the Pan / Tilt / Rotate / ZoomFocus value according to the object's motion information, user input, or preset. The camera control unit (180) may include a pan control unit (1811), a tilt control unit (1812), a rotation control unit (1813), a preset control unit (1814), and a sequence action control unit (1815).

[0112] The fan control unit (1811) can control the rotation of the camera in the horizontal direction. In one embodiment, the fan control unit (1811) can rotate the camera in the horizontal direction by controlling the driving of the fan motor based on the fan value.

[0113] The tilt control unit (1812) can control the rotation of the camera in the vertical direction. In one embodiment, the tilt control unit (1812) can rotate the camera in the vertical direction by controlling the driving of the tilt motor based on the tilt value.

[0114] The rotation control unit (1813) can control the rotation of the camera in a clockwise or counterclockwise direction of the image. The rotation control unit (1813) can rotate the lens in a clockwise or counterclockwise direction of the image with the center of the camera as the axis.

[0115] The preset control unit (1814) can quickly move the camera to a physical position corresponding to a pre-specified Pan / Tilt / Rotate / ZoomFocus value (preset). The preset control unit (1814) can change the camera's orientation by moving or rotating the camera according to at least one specified preset.

[0116] The sequence action control unit (1815) can control the camera's operation repeatedly by scheduling operations that are pre-specified, such as presets.

[0117] The communication unit (1050) may be an interface that transmits streams by connecting to an external server and an external device for wired or wireless communication. The communication unit (1050) may be configured to include TCP / IP, HTTP(S) / RTP / RTSP, FTP, MQTT protocols, etc. The communication unit (1050) may include an FTP server (2011), but is not limited thereto and may include various servers. Details regarding servers will be described later based on FIG. 4.

[0118] To prevent the features of the present embodiment from being obscured, only the components related to the present embodiment are illustrated. Accordingly, it can be understood by those skilled in the art related to the present embodiment that other general components may be included in addition to the components illustrated in FIGS. 2 and FIGS. 3.

[0119] FIG. 4 is a schematic block diagram of a server embedded in a camera according to at least one embodiment of the present disclosure.

[0120] Referring to FIG. 4, a server (2000) according to one embodiment may include an FTP server (2011), a web server (2013), an authentication server (2015), etc. The server (2000) may be provided independently on a network separate from the camera or embedded in the camera, but in this disclosure, it is described as being embedded in the camera (101).

[0121] The FTP server (2011) can receive video and / or audio in which an event is detected from the FTP upload unit (1614) of the video processing device when an event occurs. Additionally, the FTP server (2011) can store firmware data uploaded by a user for firmware updates.

[0122] The web server (2013) can provide HTTP(S) access to the image processing device and external device, or be embedded in the image processing device or server to provide HTTP(S) access to external device.

[0123] The authentication server (2015) can perform user authentication when attempting to connect to an external device's image processing device using RTP / RTSP / HTTP / TCP, etc.

[0124] FIG. 5a is a drawing for explaining the appearance of an electronic device according to at least one embodiment of the present disclosure.

[0125] Referring to FIG. 5a, the electronic device (100) may include a camera (101) and an artificial intelligence processor (102) operably connected to the camera (101) via an intranet. The camera (101) and the artificial intelligence processor (102) may be physically connected by a communication cable (12). A specific example of the communication cable (12) will be described later based on FIG. 6a.

[0126] However, the connection status of both configurations is not limited to a physical connection, and both configurations may also be connected via wireless communication such as Wi-Fi and Bluetooth.

[0127] The artificial intelligence processor (102) and camera (101) can be connected via a first cable (13-1) capable of TCP / IP protocol and a second cable (13-2) which is a serial cable separate from the first cable (13-1).

[0128] For example, referring to FIG. 6a, a data processing unit (1030) and a communication unit (1050) may be connected to the inside of the camera (101) of the electronic device (100) via a first cable (13-1), and a data processing unit (1030) and an artificial intelligence processor (102) may be connected via the first cable (13-1) and a second cable (13-2).

[0129] As described above, the data processing unit (1030) is an information processing means implemented with various number of hardware or / and software configurations that execute specific functions, and may include a central processing unit (e.g., CPU). Additionally, the communication unit (1050) may be an interface that performs communication between the electronic device (100) and an external device. Since a detailed description of the data processing unit (1030) and the communication unit (1050) has been described above, a redundant description is omitted.

[0130] The first cable (13-1) may include a cable capable of TCP / IP protocol. Specifically, the first cable (13-1) may be a cable that has been modified from a UTP cable to reduce its size so that it can be contained within the camera (101). However, it is not limited thereto, and the first cable (13-1) may include a UTP cable and a similar network transmission cable. For example, the first cable (13-1) may include at least one of a Shielded Twisted Pair (STP) cable, a Foiled Twisted Pair (FTP) cable, a Screened UTP (S / UTP) cable, a Foiled UTP (F / UTP) cable, and a Screened FTP (S / FTP) cable. Additionally, the first cable (13-1) may include at least one of a Cat5 cable, a Cat5e cable, a Cat6 cable, a Cat6a cable, a Cat7 cable, a Cat7a cable, and a Cat8 cable. Furthermore, the first cable (13-1) may include at least one of a coaxial cable, a fiber optic cable, or a power line communication cable. Accordingly, the first cable (13-1) may be used to connect the sensor unit (1010) and the data processing unit (1030) inside the camera (101). Additionally, the first cable (13-1) may be used to connect the camera (101) and the artificial intelligence processor (102). An image captured by the camera (102) may be transmitted through the first cable.

[0131] The second cable (13-2) may include a serial cable. The second cable (13-2) may include a serial cable and can transmit and receive control signals between devices by sequentially transmitting data one bit at a time. The second cable (13-2) may be, for example, a data cable based on the USB protocol. Furthermore, the second cable (13-2) may include at least one of an RS-232 cable, an RS-485 cable, and an RS-422 cable. In addition, the second cable (13-2) may include at least one of a Thunderbolt cable. At least some of the control data may be transmitted through the second cable. The control data may include firmware data. That is, the firmware data may be transmitted through the second cable.

[0132] The electronic device (100) can receive firmware data through the communication unit (1050) and transmit the data to the data processing unit (1030) through the second cable (13-2). For example, the electronic device (100) can receive firmware data using various protocols (e.g., SFTP / FTP / HTTP / HTTPS).

[0133] In addition, the first cable (13-1) and the second cable (13-2) may be Ethernet cables or USB cables.

[0134] Meanwhile, an SSD (103) for storing or overwriting firmware data may be installed in a part of the computational processing unit (102). Additionally, the communication cable (12) described above based on FIG. 5a may include a first cable (13-1) and a second cable (13-2). However, the communication cable (12) is not limited thereto and may include an Ethernet cable or a USB cable, etc.

[0135] Meanwhile, the electronic device (100) of the present disclosure is not limited to the form in which the camera (101) and the artificial intelligence processor (102) described based on FIGS. 5a and 6a are each installed on a wall surface in a form connected by a cable. Other forms of the appearance of the electronic device (100) will be described based on FIG. 5b.

[0136] Referring to FIG. 5b, the present disclosure may exist in the form of an integrated electronic device (100a) in which a camera (101a) and an artificial intelligence processor (102a) are located inside a single housing.

[0137] The internal configuration of the integrated electronic device (100a) may include the same configuration as described in FIG. 6a. Specifically, the data processing unit (1030), communication unit (1050), and artificial intelligence processor (102) of FIG. 6a may correspond to the data processing unit (1030a), communication unit (1050a), and artificial intelligence processor (102a) of FIG. 6b. In addition, the first cable (13-1) and the second cable (13-2) of FIG. 6a may correspond to the first cable (13-1a) and the second cable (13-2a) of FIG. 6b, respectively. Furthermore, it goes without saying that an SSD (103a) may also be installed in the integrated electronic device (100a).

[0138] In one embodiment, the integrated electronic device (100a) includes a plurality of camera lenses so as to acquire an image with a minimized blind spot. For example, the plurality of camera lenses may be arranged in an omnidirectional manner to minimize the blind spot.

[0139] In one embodiment, the components included in the integrated electronic device (100a) may exist in a stacked form. For example, a data processing unit (1030a), a communication unit (1050a), and an artificial intelligence processor (102a) may be connected by multiple wires and exist in a stacked structure inside the housing of the integrated electronic device (100a). Such a stacked structure can reduce the device volume by minimizing unnecessary empty space in the integrated electronic device (100a).

[0140] In addition, the aforementioned artificial intelligence processor (102, 102a) may exist in a detachable structure. In one embodiment, the artificial intelligence processor (102, 102a) can be mounted and detached without tools through a mounting bracket inside the housing and a one-touch connector, and the electronic device (100) or the integrated electronic device (100a) can recognize the detached state of the artificial intelligence processor (102, 102a) and control the switching of the artificial intelligence analysis mode. According to this configuration, rapid recovery may be possible simply by replacing the module even in the event of a failure of the artificial intelligence processor (102, 102a). In addition, an upgrade can be easily performed by easily replacing it with a higher specification module according to processing performance requirements.

[0141] FIG. 7 is a flowchart illustrating the operation of an electronic device according to at least one embodiment of the present disclosure.

[0142] In operation S710, the electronic device (100) can receive firmware data to update the artificial intelligence processor (102) from an external device.

[0143] Specifically, the electronic device (100) can receive firmware data from an external device through a camera (101). At this time, the firmware data may be stored in the external device.

[0144] As described above, the camera (101) of the electronic device (100) may include a communication circuit and a server (2000). For example, the camera (101) of the electronic device (100) may include a server function or a client function and may transmit or receive firmware data through communication with an external device.

[0145] When an external device stores firmware data for an update, it can transmit the firmware data to the electronic device (100). In one embodiment, the firmware data stored in the external device may be data manually uploaded by the user. Alternatively, the external device may check the current firmware version, determine whether a firmware update is possible, and then automatically download and store the data from an external server.

[0146] In operation S710-Y, S720, the electronic device (100) can transmit firmware data to the artificial intelligence processor (102).

[0147] The description of operation S720 is based on Fig. 8.

[0148] In operation S810, when the electronic device (100) receives firmware data and completes the authentication procedure, it can switch the artificial intelligence processor (102) to update mode.

[0149] The firmware data received by the electronic device (100) may be in an encrypted state. The electronic device (100) can decrypt the encrypted firmware data through an authentication process.

[0150] Specifically, the authentication procedure may be a procedure in which the camera (101) authenticates the hash value and key included in the firmware data, and when the decryption of the firmware data is completed, the artificial intelligence processor (102) is switched to update mode.

[0151] The electronic device (100) may be a procedure for determining whether an access request from an external device to a camera (101) is made by a legitimate device or user through an authentication procedure. For example, when an external device attempts to connect to a server (e.g., FTP server) included in the electronic device (100), the authentication procedure may be performed based on an ID and password input, an API key, an authentication token, or a digital certificate. This authentication procedure may be performed through an authentication server (2015) located inside the electronic device (100), but is not limited thereto and may be performed through various methods.

[0152] The update mode may be a mode in which the artificial intelligence processor (102) can receive firmware data and perform an update while the camera (101) is operating.

[0153] Specifically, when the artificial intelligence processor (102) is switched to update mode, it can be switched to a state where it can receive firmware data through a communication cable (e.g., second cable (13-2)) connected to the camera (101).

[0154] When the artificial intelligence processor (102) receives firmware data after switching to update mode, it can proceed with rebooting to perform the update.

[0155] Meanwhile, in operation S810-N, S840, if the electronic device (100) fails the authentication procedure, it may discard the received firmware data and not proceed with the update.

[0156] Specifically, if the electronic device (100) fails to authenticate the hash value and key included in the firmware data, the camera (101) can discard the firmware data and stop updating the artificial intelligence processor (102).

[0157] In operation S730, the electronic device (100) can perform a firmware update of the artificial intelligence processor (102) without stopping the operation of the camera (101).

[0158] As described above, even if the artificial intelligence processor (102) switches to update mode, the camera (101) can perform operations without interruption.

[0159] In one embodiment, when the artificial intelligence processor (102) is switched to update mode, the operation of the artificial intelligence processor (102) may be stopped. Accordingly, the electronic device (100) can store the task of the camera (101) in real time in the memory included in the camera (101) during the time when the firmware update of the artificial intelligence processor (102) is performed.

[0160] For example, the tasks (91-94) of the camera (101) can be stored in the memory (1615) of the camera (101) in a queue structure.

[0161] A queue refers to a data structure that operates such that data stored first is processed first, and data stored later is processed later. Accordingly, tasks generated by the camera (101) can be processed in chronological order.

[0162] For example, referring to FIG. 9, the first task (94) that occurs is at the front of the queue, and the next tasks (93), (92), and (91) that occur next may be placed in the next order.

[0163] When the firmware update of the artificial intelligence processor (102) is completed, the electronic device (100) can sequentially transmit tasks stored in the memory to the artificial intelligence processor (102).

[0164] At this time, the first task (94) that occurs is transmitted first, and the remaining tasks (93~91) can also be transmitted in order according to the stored order.

[0165] Based on FIGS. 1 to 9, by the operation of the aforementioned electronic device (100), the user can automatically perform a firmware update without removing the artificial intelligence processor (102) from the camera (101).

[0166] Meanwhile, as described above, the electronic device (100) can automatically perform a firmware update if firmware data is stored in the external device (200) in advance. The user can upload firmware data through the "device manager" of the external device (200). The device manager is executed on the external device (e.g., user terminal device) and may include a function to upload a firmware file and manage connected equipment by communicating with the camera (101).

[0167] FIG. 10 is a drawing for illustrating a user interface (UI) of a device manager according to at least one embodiment of the present disclosure.

[0168] The external device (200) can classify and store other devices located on the same network as the camera (101) by category, and through this, the user can efficiently manage currently connected devices by type, thereby improving management convenience.

[0169] Additionally, the external device (200) can search for and register other devices installed on the same network as the camera (101). Alternatively, the user may manually register devices that are not found to the external device (200).

[0170] When an external device (200) receives input for a button (202) on the device manager, it can display a list of registered devices on the display. When a user selects a specific device from the list, the external device (200) can display the current connection status (203) of the selected device, the firmware version and update availability (204), the IP address (206), and a password (207) for accessing the device on the device manager screen. Additionally, as described above, an input field (205) for uploading a firmware file to be updated by the user may also be provided. Furthermore, when an external device (200) receives input for a network diagnostic button (208), it can check the current connection status of the device and run a management wizard that supports troubleshooting in the event of a network error. Additionally, when an input for a device setting change button (209) is received, it can display a setting UI on the display that provides detailed settings of the electronic device (100) to the user.

[0171] Accordingly, users can manage multiple devices installed on the network more conveniently and efficiently through the device manager.

[0172] In a separate embodiment, the integrated electronic device (100a) can receive and analyze images from a plurality of cameras connected to the same network. This is explained based on FIG. 11.

[0173] Referring to FIG. 11, the integrated electronic device (100a) can be connected to the same network as multiple cameras (300-1 to 300-n) located inside the same building. At this time, the multiple cameras (300-1 to 300-n) can be connected via wired communication (e.g., Ethernet, USB, etc.) and can also be connected via wireless communication (e.g., Wi-Fi, Bluetooth, Zigbee, etc.). Additionally, unlike the electronic device (100) or the integrated electronic device (100a), the multiple cameras (300-1 to 300-n) may be cameras that perform only shooting functions without including an artificial intelligence processor (102, 102a).

[0174] The integrated electronic device (100a) can perform updates of the artificial intelligence processor (102a) without stopping the operation of the multiple cameras (300-1 to 300-n) even when the multiple cameras (300-1 to 300-n) are connected. Specific details regarding this are as described above in FIGS. 7 to 9. Although various embodiments have been described above, each embodiment is not necessarily implemented individually, and may be combined with at least one other embodiment, either wholly or partially, to be implemented together in a single product. Furthermore, it is understood that not only the electronic device (100) but also the integrated electronic device (100a) can perform the operations of FIGS. 1 to 11.

[0175] Meanwhile, embodiments of the present disclosure may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include computer storage media and communication media. Computer storage media include both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data. Communication media may typically include other data of modulated data signals, such as computer-readable instructions, data structures, or program modules.

[0176] Additionally, computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.

[0177] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0178] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0179] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

1. In an electronic device, A camera including a communication circuit; and It includes an artificial intelligence processor operably connected to the above camera via an intranet, The camera is configured to transmit firmware data to the artificial intelligence processor when firmware data for updating the artificial intelligence processor is received via an intranet from an external device. The above artificial intelligence processor is an electronic device configured to perform a firmware update of the artificial intelligence processor without stopping the operation of the camera.

2. In Paragraph 1, The above camera is configured to switch the artificial intelligence processor to update mode and start updating the artificial intelligence processor when it receives the firmware data and completes the authentication procedure. The above update mode is an electronic device in which the artificial intelligence processor can receive the firmware data and perform an update while the camera is operating.

3. In Paragraph 2, The above authentication procedure is, An electronic device that switches the artificial intelligence processor to the update mode when the decryption of the firmware data is completed by the camera authenticating the hash value and key included in the firmware data.

4. In Paragraph 3, The above authentication procedure is, An electronic device in which, if authentication of the hash value and key included in the above firmware data fails, the camera discards the above firmware data and stops updating the artificial intelligence processor.

5. In Paragraph 1, The above camera is an electronic device configured to store the task of the camera in real time in a memory included in the camera during the time when the firmware update of the artificial intelligence processor is performed.

6. In Paragraph 5, The above camera is an electronic device that transmits a task stored in the memory to the artificial intelligence processor when the firmware update of the artificial intelligence processor is completed.

7. In Paragraph 1, The above artificial intelligence processor is an electronic device including an FTP server.

8. In Paragraph 1, An electronic device configured such that the artificial intelligence processor and the camera are connected by a first cable capable of TCP / IP protocol and a second cable which is a serial cable separate from the first cable, and that an image captured by the camera is transmitted through the first cable and firmware data is transmitted through the second cable.

9. A method for controlling an electronic device comprising a camera and an artificial intelligence processor operably connected to the camera via an intranet, wherein When the camera receives firmware data for updating the artificial intelligence processor from an external device via an intranet, the step of transmitting the firmware data to the artificial intelligence processor; and The method includes the step of performing a firmware update of the artificial intelligence processor without stopping the operation of the camera; The above camera is a control method including a communication circuit.

10. In Paragraph 9, When the camera receives the firmware data and completes the authentication procedure, the step of switching the artificial intelligence processor to update mode; and Further including the step of initiating an update of the above artificial intelligence processor; The above update mode is a control method in which the artificial intelligence processor can receive the firmware data and perform an update while the camera is operating.

11. In Paragraph 10, The step of switching the artificial intelligence processor to update mode when the above authentication procedure is completed; A control method comprising the step of switching the artificial intelligence processor to the update mode when the decryption of the firmware data is completed by the camera authenticating the hash value and key included in the firmware data.

12. In Paragraph 11, A control method further comprising the step of, if authentication of the hash value and key included in the firmware data fails, the camera discarding the firmware data and stopping the update of the artificial intelligence processor.

13. In Paragraph 9, The step of performing a firmware update of the above artificial intelligence processor is, A control method comprising the step of saving the task of the camera in real time during the time when the firmware update of the artificial intelligence processor is performed.

14. In Paragraph 13, A control method further comprising the step of transmitting the stored task to the artificial intelligence processor when the firmware update of the artificial intelligence processor is completed.

15. In Paragraph 9, The above artificial intelligence processor is a control method including an FTP server.

16. In Paragraph 9, A control method wherein the artificial intelligence processor and the camera are connected by a first cable capable of TCP / IP protocol and a second cable which is a serial cable separate from the first cable, and wherein an image captured by the camera is transmitted through the first cable and firmware data is transmitted through the second cable.

17. A non-transient computer-readable recording medium storing one or more instructions executed by a processor of an electronic device to perform an operation, wherein the electronic device including a camera and an artificial intelligence processor operably connected to the camera via an intranet, said operation, said operation, When the camera receives firmware data for updating the artificial intelligence processor from an external device via an intranet, the step of transmitting the firmware data to the artificial intelligence processor; and The method includes the step of performing a firmware update of the artificial intelligence processor without stopping the operation of the camera; The above camera is a recording medium including a communication circuit.

18. In Paragraph 17, When the camera receives the firmware data and completes the authentication procedure, the step of switching the artificial intelligence processor to update mode; and Further including the step of initiating an update of the above artificial intelligence processor; The above update mode is a recording medium in which the artificial intelligence processor can receive the firmware data and perform an update while the camera is operating.

19. In Paragraph 18, The step of switching the artificial intelligence processor to update mode when the above authentication procedure is completed; A recording medium comprising: a step of switching the artificial intelligence processor to the update mode when the decryption of the firmware data is completed by the camera authenticating the hash value and key included in the firmware data.

20. In Paragraph 17, The step of performing a firmware update of the above artificial intelligence processor is, A step of saving the task of the camera in real time during the time when the firmware update of the artificial intelligence processor is performed; and A recording medium comprising the step of transmitting the stored task to the artificial intelligence processor when the firmware update of the artificial intelligence processor is completed.

Images