Image capturing apparatus and profile setting method thereof

Abstract

The present specification relates to profile setting of an image capturing apparatus. The image capturing apparatus, upon receiving a selection input for any one of profile options, generates and displays on a display a plurality of preview images on the basis of profile attribute values of a plurality of comparison profiles related to the selected profile option and on the basis of each of the comparison profiles. The apparatus then sets parameters of an image signal processing unit on the basis of a profile attribute value of a profile selected in response to a user selection signal for selecting any one of the plurality of displayed comparison profiles. The apparatus has an effect of enabling a user to easily set a profile by providing a plurality of exemplary preview images for the profile option selected by the user.

Description

Video recording device and method for setting its profile

[0001] This specification relates to the profile setting of an image capturing device.

[0002] Before video footage captured by a surveillance camera is transmitted to a video management device, it is captured and acquired according to a camera profile set by the user. A single profile is determined by setting values ​​for various attributes, such as video quality, video data capacity, video transmission bandwidth, video frame rate, and video resolution. However, from the user's perspective, although they determine and apply each setting value by reading the manual regarding the video profile, unless they are experts, it is difficult to know how the settings entered by the user affect the video, and similarly, there is a problem in that it is difficult to know the resulting video output based on the settings entered by the user.

[0003] In addition, with the proliferation of various video recording devices such as smartphones, action cams, in-vehicle video recorders, and video drones in addition to surveillance cameras, the need for appropriate profile settings is increasing depending on the type of device and the purpose of recording.

[0004] The above description is intended solely to aid in understanding the background technology regarding the technical concepts of the present invention, and therefore, it should not be understood as prior art known to those skilled in the art of the present invention.

[0005] This specification is intended to solve the aforementioned problems, and one embodiment of this specification aims to enable a user to easily set an image profile by recommending a profile desired by the user.

[0006] In addition, it aims to provide personalized recommendations by learning the user's shooting or viewing patterns, and to recommend the optimal profile in real time in situations such as changes in the shooting environment or PTZ operation control.

[0007] The problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned problems will be clearly understood by a person skilled in the art from the description below.

[0008] The present specification provides an image capturing device capable of setting a profile to achieve the purpose described above. The image capturing device comprises: at least one processor; a memory storing instructions to be executed by the processor and a plurality of comparison profiles having different profile attribute values ​​for each profile option; and an input / output interface configured to transmit data to a display, receive a user selection signal, and transmit a setting signal. When the instructions are executed by the processor, the processor may: receive an image frame generated by an image signal processing unit; when a selection for any one of the profile options is input through the input / output interface, read a plurality of comparison profiles associated with the selected profile option from the memory and transmit the profile attribute values ​​of each comparison profile to the display through the input / output interface; generate a plurality of preview images according to each of the comparison profiles and transmit them to the display through the input / output interface; and, in response to a user selection signal received through the input / output interface, set parameters of the image signal processing unit based on the profile attribute values ​​of the selected profile among the comparison profiles.

[0009] In addition, the present specification provides a profile setting device for setting a profile for generating image frames of a camera, comprising a display, a memory, and at least one processor to achieve the purpose described above. The profile setting device comprises: the memory storing a plurality of comparison profiles having different profile attribute values ​​for each profile option; the processor receiving an image frame from the camera; displaying a user interface for selecting a profile option on the display; and when a selection for any one of the profile options is input, reading a plurality of comparison profiles associated with the selected profile option from the memory and displaying the profile attribute values ​​of each comparison profile on the display through the user interface; generating a plurality of preview images according to each of the comparison profiles and displaying them on the display through the user interface; and transmitting a setting signal including the attribute values ​​of the selected comparison profile to the camera in response to a user selection input selecting any one of the comparison profiles.

[0010] The above image capturing device, the above profile setting device, and other embodiments may include the following features.

[0011] According to an embodiment, the preview images may be generated from image frames received from the image signal processing unit based on the profile attribute values ​​of each of the comparison profiles.

[0012] According to an embodiment, the preview images may also be generated in advance so that image features according to the difference in profile attribute values ​​are distinguished based on the profile attribute values ​​of each of the comparison profiles.

[0013] According to an embodiment, the processor may also calculate image data information including storage capacity information or bandwidth information of an image frame according to each of the comparison profiles, and transmit the image data information together with the corresponding profile to the display through the input / output interface.

[0014] According to an embodiment, the processor further transmits a user interface screen to the display through the input / output interface, the user interface screen comprising a first area for displaying the profile options and a second area for displaying two or more comparison profiles related to the profile option selected in the first area and a preview image generated by the two or more comparison profiles, and when a selection input for the profile option in the first area is input from the user through the user interface screen, the processor outputs the profile attribute value of each of the comparison profiles to the second area and transmits the preview images for each of the comparison profiles to the display through the input / output interface so that they are output in the second area.

[0015] According to an embodiment, the processor may further transmit a user interface screen to the display through the input / output interface, the screen including a third area for displaying a preview image according to a currently set profile, two or more comparison profiles related to the selected profile option, and a fourth area for displaying a plurality of preview images generated by the two or more comparison profiles, and transmit a control signal to the display through the input / output interface so that the plurality of preview images are sequentially switched and output to the fourth area in response to a user input signal in the fourth area received through the input / output interface.

[0016] According to an embodiment, the processor may also control the plurality of preview images to be simultaneously output to the fourth area, control the selected preview image to be output to the third area in response to a user selection signal for one of the plurality of preview images simultaneously output to the fourth area, and transmit a control signal to the display through the input / output interface so that a preview image different from the unselected preview image among the plurality of preview images is output to the fourth area.

[0017] According to an embodiment, the processor may also set profile attribute values ​​of the comparison profiles related to the profile options based on the importance when the importance for each of the profile options is input from a user through the input / output interface.

[0018] According to an embodiment, the processor may also derive a user preference based on at least one of a user's video shooting pattern, video viewing pattern, and video search pattern, and generate a comparison profile based further on the derived user preference.

[0019] In addition, the present specification provides a profile setting method for a profile setting device executed by a processor to achieve the aforementioned purpose. The profile setting method may include: receiving a video frame from a video source; receiving a selection input of one of profile options; outputting a profile attribute value of a plurality of comparison profiles associated with the selected profile option and a plurality of preview images according to the comparison profiles; and setting the profile of the video source to a profile selected by a user among the plurality of comparison profiles.

[0020] The above profile setting method and other embodiments may include the following features.

[0021] According to an embodiment, the image source may include at least one of an image signal processing unit of an image capturing device integrated with the profile setting device or an image capturing device connected via a network.

[0022] According to an embodiment, the preview images may be generated from image frames received from the image signal processing unit based on the profile attribute values ​​of each of the comparison profiles.

[0023] According to an embodiment, the preview images may also be generated in advance so that image features according to the difference in profile attribute values ​​are distinguished based on the profile attribute values ​​of each of the comparison profiles.

[0024] According to an embodiment, the profile setting method may further include: a step of calculating image data information including storage capacity information or bandwidth information of an image frame according to each of the comparison profiles; and a step of outputting the image data information together with the preview image.

[0025] According to an embodiment, the profile setting method may further include the step of sequentially switching and outputting the plurality of preview images in response to the user input signal when a user input signal is received selecting any one of the profile options through a user interface screen.

[0026] According to an embodiment, the profile setting method may further include the step of simultaneously outputting the plurality of preview images through a user interface screen, and when a user selection for one of the plurality of preview images is input, outputting the selected preview image and other preview images not displayed on the user interface screen in a continuous arrangement so as to be comparable.

[0027] According to an embodiment, the profile setting method may further include the step of deriving user preferences based on at least one of a user's shooting pattern, viewing pattern, and search pattern, and generating the comparison profile based further on the derived user preferences.

[0028] The embodiments disclosed in this specification have the effect of allowing the user to easily set the image profile by recommending a profile desired by the user.

[0029] In addition, the embodiments disclosed in this specification are applicable to various devices and have the effect of ensuring customized image quality by reflecting the individual preferences of the user.

[0030] In addition, the embodiments disclosed in this specification have the effect of improving the efficiency of profile settings for video recording through automatic recommendations based on changes in situation or environment, and maximizing user convenience by providing an intuitive preview user interface that allows users to check the video to be recorded in advance by applying the recommended profile.

[0031] Meanwhile, the effects obtainable from the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present invention belongs from the description below.

[0032] The following drawings attached to this specification illustrate preferred embodiments of the present invention and serve to further enhance understanding of the technical concept of the present invention along with specific details for implementing the invention; therefore, the present invention should not be interpreted as being limited only to the matters described in such drawings.

[0033] FIG. 1 is a schematic diagram showing an image capturing system in which a device capable of setting a profile of an image capturing device surveillance camera according to one embodiment of the present specification is used.

[0034] Figure 2 is a block diagram schematically showing the configuration of the image capturing device illustrated in Figure 1.

[0035] FIG. 3 is a diagram illustrating an AI processing unit applied to the profile setting of an image capturing device according to an embodiment of the present invention.

[0036] Figure 4 is a block diagram schematically showing the configuration of the image management server illustrated in Figure 1.

[0037] FIG. 5 is a block diagram of an image capturing device according to one embodiment.

[0038] Figure 6 is a detailed block diagram of the image capturing device shown in Figure 5.

[0039] FIG. 7 is a functional block diagram of a profile setting module that executes a profile setting method according to one embodiment of the present invention.

[0040] FIG. 8 is an example of a user interface for setting a profile in an image capturing device or image management server according to one embodiment.

[0041] FIG. 9 illustrates an example of a user interface for outputting a comparison profile and a preview screen for profile settings.

[0042] FIGS. 10 and 11 illustrate other examples of a user interface for outputting a comparison profile and a preview screen for profile settings.

[0043] FIG. 12 is a drawing illustrating a profile setting method according to one embodiment.

[0044] The technology disclosed in this specification may be applied to profile settings of image capturing devices, such as smartphones, vehicle image recording devices, and surveillance camera systems. However, the technology disclosed in this specification is not limited thereto and may be applied to all devices and methods to which the technical concept of the technology can be applied.

[0045] It should be noted that technical terms used in this specification are used merely to describe specific embodiments and are not intended to limit the scope of the technology disclosed herein. Furthermore, unless specifically defined otherwise in this specification, technical terms used in this specification shall be interpreted in the sense generally understood by those skilled in the art to which the technology disclosed herein belongs, and shall not be interpreted in an overly broad or overly narrow sense. Additionally, if a technical term used in this specification is an incorrect technical term that fails to accurately express the concept of the technology disclosed herein, it shall be understood as being replaced by a technical term that can be correctly understood by those skilled in the art to which the technology disclosed herein belongs. Furthermore, general terms used in this specification shall be interpreted according to their prior definitions or according to the context, and shall not be interpreted in an overly narrow sense.

[0046] Terms including ordinal numbers, such as first, second, etc., as used in this specification may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component.

[0047] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components are given the same reference number regardless of the drawing symbols, and redundant descriptions thereof will be omitted.

[0048] Furthermore, in describing the technology disclosed in this specification, detailed descriptions of related prior art are omitted if it is determined that such descriptions could obscure the essence of the technology disclosed in this specification. Additionally, it should be noted that the attached drawings are intended merely to facilitate an understanding of the concept of the technology disclosed in this specification, and should not be interpreted as limiting the concept of the technology.

[0049] An image or video according to one embodiment of the present invention includes both still images and video images unless otherwise specifically limited.

[0050] Throughout the specification, the device or terminal includes a communication terminal or a communication device capable of wired or wireless communication with a server or other device. The device or terminal may take various forms, such as a mobile phone, smartphone, smartpad, laptop computer, desktop computer, smart TV, wearable device, mirror-type display device, smart mirror, etc. Wearable devices may take various forms, such as a watch-type terminal, a glass-type terminal, an HMD, etc. Additionally, the terminal may not be limited to these forms and may be implemented as various electronic devices. Furthermore, the device may also be implemented in the form of a server.

[0051] In a video recording system, profile setting for a video recording device may mean creating and saving a profile by combining setting values ​​for various attributes of the video recording device to obtain optimal video according to the environment or purpose in which the individual video recording device is recording, and recalling it as needed to use for the settings of the video recording device.

[0052] When the video recording device is a surveillance camera, users can obtain the best video by setting optimal exposure, image quality, and color tone according to various shooting environments—such as bright daytime, dark nighttime, indoors, and outdoors—through the camera's profile settings. Additionally, an efficient surveillance system can be established by pre-setting necessary video resolution, frame rate, and area settings for various shooting purposes, such as intrusion detection, face recognition, and license plate recognition. Furthermore, in the case of a system equipped with multiple surveillance cameras, consistent video can be obtained by managing multiple cameras with the same settings, and time can be saved by applying setting changes to all cameras simultaneously.

[0053] The items included in the profile settings for a video recording device may include image quality settings, exposure settings, lens settings, area settings, and alarm settings. Image quality settings may include various settings that affect image quality, such as resolution, frame rate, bitrate, and compression method. Exposure settings may include settings that adjust the brightness and color tone of the image, such as brightness, contrast, and color temperature. Lens settings may include settings that control the amount of light entering through the lens and focus, such as focal length, aperture value, and shutter speed. Area settings may include settings that enable intensive monitoring of specific areas by defining regions of interest, such as motion detection areas, face recognition areas, and vehicle license plate detection areas. Alarm settings may include settings that enable immediate response in the event of abnormal situations by configuring various alarm conditions, such as alarms upon motion detection or specific object detection.

[0054] Various profiles can be created by configuring the aforementioned profile setting items as needed. The video recording device can set different profiles to obtain optimal video depending on the shooting environment, such as bright daytime, dark nighttime, indoors, or outdoors. Furthermore, the video recording device can build an efficient surveillance system by setting different video resolutions, frame rates, and area settings according to various surveillance purposes, such as intrusion detection, face recognition, and license plate recognition. Additionally, applying different profiles based on the time of day can improve energy efficiency and prevent unnecessary video storage. Moreover, when a specific event (e.g., motion detection) occurs, the device can automatically switch to a different profile to secure more detailed video.

[0055] Meanwhile, there are factors to consider when setting up various profiles. First, since setting up too many profiles makes management difficult, it is advisable to set only the necessary number. Additionally, clear distinctions in video status must be established between each profile to effectively utilize surveillance footage. Furthermore, automatic profile switching rules should be clearly defined to ensure that the desired profile is applied at the desired time.

[0056] In addition, the profile setting device needs to determine the user's preference for video profiles using the video recording device and recommend profiles based on the user's preference, thereby enabling the user to easily select a profile according to their preference.

[0057] In addition, the profile setting device needs to assist the user in selecting a profile by generating preview videos for each recommended profile and displaying them to the user through an easy-to-compare user interface, so that the user can accurately judge the characteristics of the video when the recommended profile is applied to the video.

[0058] Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings.

[0059] FIG. 1 is a schematic diagram illustrating an image capturing system capable of setting a profile of an image capturing device according to one embodiment of the present specification.

[0060] FIG. 1 illustrates an example of a video recording system (10) in which a video recording device (100) communicates with a video management server (200) via a network (N). A device for setting the profile of the video recording device (100) may be implemented as a separate device from the video recording device (100) and the video management server (200), or a profile setting device according to an embodiment of the present invention may be included in at least one of the configurations of the video recording device (100) or the video management server (200).

[0061] Referring to FIG. 1, an image capturing system (10) according to one embodiment of the present specification may include an image capturing device (100) and an image management server (200) that receives and processes an image captured by the image capturing device (100) and controls the image capturing device (100).

[0062] The image capturing device (100) may be an electronic device for capturing that is placed at a fixed position in a specific location, an electronic device for capturing that can move automatically or manually along a certain path, or an electronic device for capturing that can be moved by a person or a robot, etc. Specifically, the image capturing device (100) may be a surveillance camera.

[0063] If the video recording device (100) is an IP camera or network camera used by connecting to a wired or wireless internet, the video recording device (100) may be a PTZ camera having pan, tilt, and zoom functions. The video recording device (100) may have the function of recording the monitored area or taking a picture. The video recording device (100) may have the function of recording sound occurring in the monitored area. The video recording device (100) may have the function of generating an alert or performing recording or taking a picture when a change such as movement or sound occurs in the monitored area.

[0064] The image management server (200) may be a device that receives and stores the image itself captured through the image capturing device (100) and / or an image obtained by editing the image. The image management server (200) may analyze the received image to correspond to the intended use of the received image. For example, the image management server (200) may detect objects using an object detection algorithm to detect objects in the image and predict the movement of the objects. The object detection algorithm may be an AI-based algorithm, and may detect objects by applying a pre-trained artificial neural network model. For example, a Kalman filter may be used to predict the movement of objects.

[0065] Meanwhile, the image management server (200) may store various artificial intelligence-based learning models suitable for the purpose of image analysis. The learning models may include an object classification function. The object classification function may include a gender classification function, such as whether the recognized object is a person, and if it is a person, whether it is female or male. Additionally, the learning models may include a function to distinguish whether the whole body of the person is detected when the recognized object is a person. Additionally, the object classification function may determine whether the recognized object is a car. Furthermore, if the recognized object is a car, the learning models may determine the type of car and the size of the car.

[0066] Additionally, the video management server (200) can analyze the received video to generate metadata and index information for the metadata. The video management server (200) can analyze the video information and / or audio information included in the received video together or separately to generate metadata and index information for the metadata.

[0067] The image management server (200) corresponds to at least one processor or may include at least one processor. Accordingly, the image management server (200) may be operated in a form included in other hardware devices, such as a microprocessor or a general-purpose computer system.

[0068] The video recording system (10) may further include a storage device (not shown) capable of performing wired or wireless communication with the video recording device (100) and / or the video management server (200). The storage device may receive data of the entire or partial video by transmitting an information provision request signal to the video recording device (100) and / or the video management server (200) to request the provision of the entire or partial video. The received data of the entire or partial video may be stored in a provided storage medium and may be transmitted back to the video management server (200) upon the request of the video management server (200). The storage device may transmit an information provision request signal to the video management server (200) requesting the existence of an object, the classification result of an object, etc., based on the video analysis result, and an information provision request signal requesting metadata obtained by analyzing the video and / or index information for the metadata; and may receive and store the data regarding the existence of an object, the classification result of an object, and the metadata obtained by analyzing the video and / or index information for the metadata based on the received video analysis result.

[0069] The video recording system (10) may further include a communication network (N), which is a wired or wireless communication path between a video recording device (100) and a video management server (200). The communication network (N) may include wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), and ISDNs (Integrated Service Digital Networks), or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communication, but the scope of this specification is not limited thereto.

[0070] Figure 2 is a block diagram schematically showing the configuration of the image capturing device illustrated in Figure 1.

[0071] Referring to FIG. 2, the image capturing device (100) is described as a surveillance network camera connected to a network to generate a surveillance video signal for a surveillance area, but the operation of the image capturing system according to the embodiment of the present invention is not necessarily limited to this.

[0072] The image capturing device (100) may be configured to include an image sensor (110), a communication unit (120), a control unit (130), and an AI processing unit (150).

[0073] The image sensor (110) performs the function of capturing a surveillance area to acquire an image, and can be implemented, for example, as a CCD (Charge-Coupled Device) sensor, a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, etc. The image sensor (110) may also be called an image acquisition unit or an image acquisition device.

[0074] The communication unit (120) transmits the video data, audio data, still images, and / or metadata to the video management server (200). According to one embodiment, the communication unit (120) can transmit the video data, audio data, still images, and / or metadata to the video management server (200) in real time. The communication unit (120) can perform at least one communication function among wired / wireless LAN (Local Area Network), Wi-Fi, ZigBee, Bluetooth, and Near Field Communication. The video management server (200) may include a video security solution such as a DVR, CMS, NVR, VMS, or a display unit.

[0075] The control unit (130) can control all overall operations and other components related to the functions of the image capturing device (100) or process data input to and output to said components. The components of the control unit (130) may include an image signal processing unit (131), a memory (132), and a PTZ control unit (133).

[0076] The image signal processing unit (131) can perform the operation of encoding the image acquired through the image sensor (110) into a digital signal.

[0077] The image signal processing unit (131) can improve image quality by adjusting the brightness, contrast, color amount, contrast ratio, sharpness, etc. of the image. Each parameter value for image quality improvement can be fixed as an initial value or adjusted by the user and pre-set. The image signal processing unit (131) can perform image signal processing for image quality improvement, such as noise reduction, gamma correction, color filter array interpolation, color matrix, color correction, and color enhancement. The image signal processing unit (131) can apply various methods for image quality improvement, such as edge enhancement algorithms, histogram-based image quality improvement algorithms such as histogram equalization or histogram stretching, and hue control algorithms. In one embodiment, the image signal processing unit (131) may be an image signal processor (ISP). The image signal processing unit (131) can perform the functions of an Image Signal Processor (ISP), including exposure control, backlight correction, balance correction, gamma correction, sharpness control, shake correction, focus control, zoom control, filter control, OSD control, and noise control.

[0078] The image signal processing unit (131) can control the brightness of the image by controlling the amount of light entering the image sensor (110) using at least one of a shutter, an iris, and gain or ISO sensitivity. The image signal processing unit (131) can control the amount of light by adjusting the shutter speed. The image signal processing unit (131) can control the amount of light by adjusting the degree of opening and closing of the iris. The image signal processing unit (131) can control the degree of light amplification by adjusting the gain or ISO sensitivity. In one embodiment, the image signal processing unit (131) can adjust the shutter, the iris, and the gain / ISO sensitivity according to user settings. In one embodiment, when the function is set, the image signal processing unit (131) can perform an auto exposure algorithm according to the illuminance of the environment where the camera is installed.

[0079] The video signal processing unit (131) can improve the quality of the video by applying a backlight compensation algorithm to the video so that dark areas are clearly visible when the video is too bright overall. The backlight compensation algorithm may include a Back Light Compensation (BLC) algorithm, a Wide Dynamic Range (WDR) algorithm, a Digital Wide Dynamic Range (D-WDR) algorithm, and a High Dynamic Range (HDR) algorithm. The video signal processing unit (131) can increase the dynamic range using the WDR algorithm, the D-WDR algorithm, and the HDR algorithm, thereby enabling both bright and dark areas in the video to be clearly visible simultaneously. In one embodiment, the video signal processing unit (131) can block backlighting in a specific area to make the video of other areas appear brighter. For example, when car headlights shine strongly at a dark parking lot entrance or a gas station entrance at night, only the headlight light can be blocked to identify the vehicle license plate. The function of the video signal processing unit (131) can be set by the user (on / off).

[0080] The image signal processing unit (131) can improve the color identification ability of the image by adjusting the white balance of the image to correct color differences according to the light source (illumination). In one embodiment, the image signal processing unit (131) can adjust the white balance appropriately for the light source selected according to user settings. In one embodiment, the image signal processing unit (131) can perform an Auto White Balance algorithm according to the environment around the camera when the function is set. In one embodiment, the image signal processing unit (131) can adjust the white balance of the image to a white balance value manually set by the user.

[0081] The image signal processing unit (131) can increase visibility by changing the contrast of the image through gamma correction.

[0082] The image signal processing unit (131) can increase the resolution by adjusting the sharpness of the subject boundary (contour).

[0083] The image signal processing unit (131) can stabilize the image by applying a shake correction algorithm to the image to correct image shake caused by camera shake. The shake correction algorithm may include an Optical Image Stabilization (OIS) algorithm, an Electronic Image Stabilization (EIS) algorithm, and a Digital Image Stabilization (DIS) algorithm.

[0084] The image signal processing unit (131) can control the focus of the camera using a focus control algorithm. In one embodiment, the image signal processing unit (131) can move the position of the focus lens by controlling the focus motor according to a control signal for focus control. The focus control algorithm may include known autofocus algorithms such as a hill climbing method. For example, the image signal processing unit (131) can move the position of the focus lens from a near distance to a far distance (infinity) in real time, compare the focus values ​​before and after to check the increase or decrease in the focus value, the tilt, and the change in the tilt, determine the peak point with the largest focus value as the in-focus position, and control the driving of the focus motor to move the focus lens to the in-focus position. In one embodiment, the image signal processing unit (131) can control the focus by controlling the curvature of the liquid lens according to a control signal for focus control.

[0085] The video signal processing unit (131) can perform a digital noise reduction algorithm to reduce color noise in a video captured in a low-light environment. The noise reduction algorithm may include 2D-NR (Noise Reduction) and 3D-NR.

[0086] The video signal processing unit (131) can compress video using an intra-frame compression method and / or an inter-frame compression method. Depending on the network environment or monitoring purpose, the video signal processing unit (131) can compress video into compression formats such as H.264, H.265 (HEVC (High Efficiency Video Coding), JPEG, and MPEG-4.

[0087] The video signal processing unit (131) can generate at least one video stream by compressing the video according to the encoding settings. The encoding settings may include a compression format, video quality (high quality / medium quality / low quality), resolution, bit rate, frame rate, etc. The video signal processing unit (131) may compress the video using a constant bit rate (CBR) or a variable bit rate (VBR). A profile of the video stream may be determined according to the encoding settings. The profile may represent the specifications of the video stream transmitted from the video capturing device (100) to an external device. The profile may include setting values ​​such as a compression format, video quality (high quality / medium quality / low quality), resolution, frame rate, bit rate, etc. For example, the profile may include setting values ​​such as "MJPEG, low quality, 640X480, 5fps, 2Mbps". In one embodiment, a profile of a video stream output from a video signal processing unit (131) may be pre-set according to a network environment and a video receiving device (external device). For example, a profile suitable for streaming purposes may be pre-set, such as a profile of a video stream for storage, a profile of a video stream for monitoring screen output, a profile of a video stream for a mobile device, or a profile of a video stream for a web viewer. The video signal processing unit (131) may compress the video using the setting value of the selected profile.

[0088] The video signal processing unit (131) can generate a surveillance video by processing a video signal input in real time. The surveillance video is a video that captures the surveillance area of ​​the camera, and may include a predetermined thumbnail video information corresponding to the surveillance area and video information of an event captured in the surveillance area.

[0089] The memory (132) can store a program for the operation of the control unit (130) and can temporarily store input / output data.

[0090] Additionally, the memory (132) can store image data, audio data, still images, metadata, etc. generated by the image signal processing unit (131). As previously mentioned, the metadata may be data including object detection information (movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (person, car, face, hat, clothing, etc.), and detected location information (coordinates, size, etc.). Additionally, the still image is generated together with the metadata and stored in the memory (132), and may be generated by capturing image information for a specific analysis area among the image analysis information. For example, the still image may be implemented as a JPEG image file. For example, the still image may be generated by cropping a specific area of ​​image data determined to be an identifiable object among the image data of the surveillance area detected during a specific area and a specific period, and this may be transmitted in real time together with the metadata.

[0091] In addition, the memory (132) can perform the role of storing and managing information unique to the image capturing device (e.g., camera ID), camera location information, etc.

[0092] The PTZ control unit (133) can perform the role of changing the PTZ coordinates of the video recording device according to the set preset information. The preset information can be set by an administrator, for example, through a video management server (200), and the administrator can control the position, direction, zoom level, etc. of the video recording device by changing the PTZ coordinates using the preset information of the video recording device. To this end, the video recording device (100) may be equipped with a driving device capable of controlling pan, tilt, and zoom.

[0093] The control unit (130) may be implemented as at least one processor, and the processor may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor, i.e., the control unit (130), by memory (132). For example, the control unit (130) may be configured to execute instructions received according to program code stored in a recording device such as memory (132). Here, the control unit (130) may be implemented to execute instructions according to the operating system code contained in memory (132) and at least one program code. At this time, the components within the control unit (130), namely the image signal processing unit (131) and the PTZ control unit (133), may be understood as distinguishing and representing different functions performed by the control unit (130) according to the control instructions provided by the program code stored in memory (132).

[0094] The AI ​​processing unit (150) is designed to process images based on artificial intelligence and to perform learning and inference necessary for setting the profile of the image capturing device. According to one embodiment of the present specification, it can apply object detection and object tracking algorithms based on a deep learning model learned from images acquired through an image capturing system, and can learn the user's shooting patterns for profile recommendation, learn about captured scenes, learn video viewing patterns, learn video search patterns, learn PTZ operation patterns, etc., and can infer the user's preference for image features during video shooting or viewing using the learning results, and can recommend a profile to the user using the inference results. The AI ​​processing unit (150) may be implemented as a module independent of the control unit (130) that controls the image capturing device (100) throughout the system as illustrated, or it may be implemented as a single module included in the control unit (130). Additionally, the AI ​​processing unit (150) may be implemented as a separate module or device, etc., separated from the image capturing device (100).

[0095] FIG. 3 is a diagram illustrating an AI processing unit applied to the profile setting of an image capturing system according to an embodiment of the present invention.

[0096] Referring to FIG. 3, the AI ​​processing unit (150) may include an electronic device including an AI module capable of performing AI processing or a server including an AI module. Additionally, the AI ​​processing unit (150) may be configured to perform at least a part of the AI ​​processing process of each device together with the image capturing device of FIG. 1 and 2, as well as the image management server of FIG. 4 and the image capturing device of FIG. 5 and 6, which will be described later.

[0097] The AI ​​processing process may include all operations related to the processor or control unit of the video recording device or video management server. For example, the video recording device or video management server may perform processing / judgment and control signal generation operations by AI processing the acquired video signal.

[0098] The AI ​​processing unit (150) may be a client device that directly uses the AI ​​processing results, or a device in a cloud environment that provides the AI ​​processing results to other devices. The AI ​​processing unit (150) is a computing device capable of training a neural network and can be implemented as various electronic devices such as an AI chip, an AI module, a server, a desktop PC, a laptop PC, a tablet PC, a smartpad, etc.

[0099] The AI ​​processing unit (150) may include an AI processor (151), memory (155), and a communication unit (157).

[0100] The AI ​​processor (151) can train a neural network using a program stored in memory (155). In particular, the AI ​​processor (151) can train a neural network for recognizing relevant data of an image capturing device. Here, the neural network for recognizing relevant data of an image capturing device can be designed to simulate the structure of the human brain on a computer and may include multiple network nodes having weights that simulate neurons of a human neural network. Multiple network modes can exchange data according to their respective connection relationships to simulate the synaptic activity of neurons exchanging signals through synapses. Here, the neural network may include a deep learning model that has evolved from a neural network model. In the deep learning model, multiple network nodes can be located in different layers and exchange data according to convolutional connection relationships. Examples of neural network models include various deep learning techniques such as Deep Neural Networks (DNN), Convolutional Deep Neural Networks (CNN), Recurrent Neural Networks (RNN), Restricted Boltzmann Machines (RBM), Deep Belief Networks (DBN), and Deep Q-Networks, and can be applied in fields such as computer vision (CV), speech recognition, natural language processing, and speech / signal processing.

[0101] Meanwhile, an AI processor that performs the functions described above may be a general-purpose processor (e.g., CPU), but may also be an AI-dedicated processor for artificial intelligence learning (e.g., GPU).

[0102] The memory (155) can store various programs and data required for the operation of the AI ​​processing unit (150). The memory (155) can be implemented as non-volatile memory, volatile memory, flash memory, hard disk drive (HDD), or solid-state drive (SDD). The memory (155) is accessed by the AI ​​processor (151), and the reading / writing / modification / deletion / updating of data by the AI ​​processor (151) can be performed. In addition, the memory (155) can store a neural network model (e.g., deep learning model (156)) generated through a learning algorithm for data classification / recognition according to an embodiment of the present invention.

[0103] Meanwhile, the AI ​​processor (151) may include a data learning unit (152) that learns a neural network for data classification / recognition. The data learning unit (152) can learn criteria regarding which training data to use to determine data classification / recognition, and how to classify and recognize data using the training data. The data learning unit (152) can learn a deep learning model by acquiring training data to be used for learning and applying the acquired training data to a deep learning model.

[0104] The data learning unit (152) may be manufactured in the form of at least one hardware chip and mounted on the AI ​​processing unit (150). For example, the data learning unit (152) may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or may be manufactured as part of a general-purpose processor (CPU) or a dedicated graphics processor (GPU) and mounted on the AI ​​processing unit (150). Additionally, the data learning unit (152) may be implemented as a software module. If implemented as a software module (or a program module containing instructions), the software module may be stored on a non-transitory computer-readable media. In this case, at least one software module may be provided by an operating system (OS) or by an application.

[0105] The data learning unit (152) may include a learning data acquisition unit (153) and a model learning unit (154).

[0106] The learning data acquisition unit (153) can acquire learning data required for a neural network model for classifying and recognizing data.

[0107] The model learning unit (154) can learn to have a judgment criterion regarding how a neural network model classifies a predetermined data using acquired training data. At this time, the model learning unit (154) can train the neural network model through supervised learning, which uses at least a portion of the training data as a judgment criterion. Alternatively, the model learning unit (154) can train the neural network model through unsupervised learning, which discovers a judgment criterion by learning on its own using training data without supervision. Additionally, the model learning unit (154) can train the neural network model through reinforcement learning using feedback on whether the result of the situation judgment based on learning is correct. Furthermore, the model learning unit (154) can train the neural network model using a learning algorithm including error back-propagation or gradient descent.

[0108] When the neural network model is trained, the model training unit (154) can store the trained neural network model in memory (155). Additionally, the model training unit (154) can store the trained neural network model in memory of a server connected to the AI ​​processing unit (150) via a wired or wireless network.

[0109] The data learning unit (152) may further include a learning data preprocessing unit (not shown) and a learning data selection unit (not shown) to improve the analysis results of the recognition model or to save resources or time required for the creation of the recognition model.

[0110] The learning data preprocessing unit can preprocess the acquired data so that the acquired data can be used for learning to make situational judgments. For example, the learning data preprocessing unit can process the acquired data into a pre-set format so that the model learning unit (154) can use the acquired learning data for learning to recognize images.

[0111] Additionally, the training data selection unit may select data required for training from among the training data obtained from the training data acquisition unit (153) or the training data preprocessed from the preprocessing unit. The selected training data may be provided to the model training unit (154).

[0112] Additionally, the data learning unit (152) may further include a model evaluation unit (not shown) to improve the analysis results of the neural network model.

[0113] The model evaluation unit inputs evaluation data into a neural network model, and if the analysis result output from the evaluation data does not satisfy a predetermined standard, it may cause the model learning unit (22) to learn again. In this case, the evaluation data may be predefined data for evaluating a recognition model. For example, the model evaluation unit may evaluate that the predetermined standard is not satisfied if, among the analysis results of the recognition model learned for the evaluation data, the number or ratio of evaluation data for which the analysis result is inaccurate exceeds a preset threshold.

[0114] The communication unit (157) can transmit the AI ​​processing results by the AI ​​processor (151) to an external electronic device. For example, the external electronic device may include a surveillance camera, a Bluetooth device, an autonomous vehicle, a robot, a drone, an AR device, a mobile device, a home appliance, etc.

[0115] Meanwhile, although the illustrated AI processing unit (150) has been described by functionally separating it into an AI processor (151), memory (155), and communication unit (157), it should be noted that the aforementioned components may be integrated into a single module and referred to as an AI module.

[0116] In this specification, one or more of a surveillance camera, a management device, an image analysis device, a user terminal, and a server may be linked with an artificial intelligence module, a robot, an augmented reality (AR) device, a virtual reality (VT) device, a device related to communication services, etc.

[0117] Figure 4 is a block diagram schematically showing the configuration of the image management server illustrated in Figure 1.

[0118] Referring to FIG. 4, the image management server (200) includes a server communication unit (210), a user interface device (220), a display unit (230), a storage unit (240), a server control unit (250), and a system memory (260). Additionally, the image management server (200) further includes the aforementioned AI processing unit (150).

[0119] The server communication unit (210) can transmit and receive signals between the video management server (200) and the video capturing device (see 100 in FIG. 1) through a network.

[0120] The user interface device (220) receives user input for controlling the operations of the entire image management server (200) or the server control unit (250). The user interface device (220) may include a key pad, a dome switch, a touch pad (pressure / capacitive), a jog wheel, a jog switch, a finger mouse, etc.

[0121] The display unit (230) operates in response to the control of the server control unit (250). The display unit (230) displays information processed by the image management server (200) or the server control unit (250). For example, the display unit (230) can display an image according to the control of the server control unit (250). The display unit (230) can receive and display a live view image captured by the image capturing device (100 in FIG. 1) or an image stored in the camera memory (132 in FIG. 1). In addition, the display unit (230) can display various setting screens for controlling the image capturing device (100). For example, the display unit (150) according to the present embodiment can display a captured image and a user interface screen related to the profile settings of the image capturing device.

[0122] The storage unit (240) may be at least one of flash memory, hard disk, solid state disk type (SSD), multimedia card memory, random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The storage unit (240) is configured to write and read data in response to the control of the server control unit (250).

[0123] The server control unit (250) may include either a general-purpose or dedicated processor and controls the operations of the server communication unit (210), user interface device (220), display unit (230), storage unit (240), and system memory (260).

[0124] The server control unit (250) may include a server image signal processing unit (251). The server image signal processing unit (251) can decode image data encoded as a digital signal in the image signal processing unit (131 in FIG. 2) and restore it to an image signal. This may follow, for example, H.264, H.265, MPEG (Moving Picture Experts Group), M-JPEG (Motion Joint Photographic Experts Group) standards, etc.

[0125] The server video signal processing unit (251) can process video data encoded into a digital signal in the video signal processing unit (131 in FIG. 2) so that it can be output from the display unit (230).

[0126] The server control unit (250) is configured to load program codes containing commands that provide various functions when executed from the storage unit (240) into the system memory (260) and to execute the loaded program codes. The server control unit (250) can load a video monitoring module (261) containing commands and / or program codes from the storage unit (240) into the system memory (260) and execute the loaded video monitoring module (261). The video monitoring module (261) can display images and / or video received from the video capturing device (100) on the display unit (230) and detect related user input. Additionally, the video monitoring module (261) can visualize an additional user interface on the display unit (230) and detect user input through it.

[0127] System memory (260) may be provided as working memory of the server control unit (250). In the drawing, system memory (260) is shown as a separate component from the server control unit (250), but this is exemplary and at least a portion of system memory (260) may be integrated within the server control unit (250). System memory (260) may include at least one of Random Access Memory (RAM), Read Only Memory (ROM), and other types of computer-readable storage media.

[0128] The video management server (200) may further include an AI processing unit (150 in FIG. 3), and the AI ​​processing unit may process the input video using a pre-trained artificial intelligence model either alone or in collaboration with the server control unit (250). Additionally, the AI ​​processing unit may be operated in a form included in the server control unit (250). The video surveillance module (261) may be an artificial intelligence model trained by the AI ​​processing unit.

[0129] The server control unit (250) can implement all functions of the profile setting of the video recording device described later and all processes of the profile setting method of the video recording device through the video monitoring module (261) or through a program loaded from the storage unit (240).

[0130] The description of the AI ​​processing unit (150) is omitted here because it includes the functions of the AI ​​processing unit of FIG. 3 described above.

[0131] FIG. 5 is a block diagram of an image capturing device according to one embodiment.

[0132] Referring to FIG. 5, the image capturing device (300) includes a display unit (315), a control unit (350), and a communication unit (307).

[0133] The display unit (315) outputs a screen or captured image provided by the control unit (350). Through this screen, the display unit (315) can output a user interface for setting a profile for the camera unit of the image capturing device.

[0134] The communication unit (307) enables receiving communication signals from the outside or communicating with an external device.

[0135] According to one embodiment, the communication unit (307) can transmit and receive data with an external device using at least one of Wi-Fi, Bluetooth, Bluetooth Low Energy (BLE), or infrared communication.

[0136] According to an embodiment, the communication unit (307) can connect to an external server using at least one of 3G, 3GPP, 4G, 5G, 6G, and Wi-Fi to transmit or receive data.

[0137] The control unit (350) controls the entire components of the image capturing device (300), including the display unit (315) and the communication unit (307). The control unit (350) may include RAM, which is used as a storage area corresponding to various tasks performed by the image capturing device (300) or for storing signals or data input from outside the image capturing device (300), ROM, which stores a control program for controlling peripheral devices, and a processor. The processor may be implemented as a System On Chip (SoC) integrating a core (not shown) and a GPU (not shown). Additionally, the processor may include a plurality of processors.

[0138] Figure 6 is a detailed block diagram of the image capturing device shown in Figure 5.

[0139] Although not illustrated in FIG. 6, the video recording device (300) may further include, depending on the embodiment, a USB port to which a USB connector can be connected, various external input ports for connecting to various external terminals such as a headset, mouse, LAN, etc., a DMB chip for receiving and processing DMB (Digital Multimedia Broadcasting) signals, various sensors, etc. Furthermore, depending on the embodiment, the names of the components of the video recording device (300) may differ, some components may be omitted, or additional components may be included.

[0140] The communication unit (307) includes a mobile communication unit (301) and a sub-communication unit (302).

[0141] The mobile communication unit (301) can perform broadband network communication according to various communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), 6G (6th Generation).

[0142] The sub-communication unit (302) can communicate with other nearby devices using short-range communication protocols such as Bluetooth, Wi-Fi, NFC (Near Field Communication), infrared communication, and laser beam communication.

[0143] The A / V processing unit (303) can process audio data and video data included in content received from the outside or content stored in memory (360). The A / V processing unit (303) can perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on video data. Additionally, the A / V processing unit (303) can perform various processing such as decoding, amplification, and noise filtering on audio data. When a playback application for multimedia content is executed, the control unit (350) can drive the A / V processing unit (303) to play the content. A speaker (not shown) included in the input / output unit (310) outputs an audio signal received from the A / V processing unit (303).

[0144] The camera unit (304) includes lenses and optical elements for taking photos or videos. Although FIG. 6 is illustrated as having two cameras, depending on the embodiment, one camera may be included or three or more cameras may be included.

[0145] The sensor unit (305) may include a gravity sensor that detects the movement of the video recording device (300), an illuminance sensor that detects the brightness of light, a proximity sensor that detects the proximity of a person, a motion sensor that detects the movement of a person, etc.

[0146] The GPS receiver (306) receives GPS signals from artificial satellites. Various services can be provided to the user using these GPS signals.

[0147] The input / output unit (310) provides an interface with an external device or person and may include a button, microphone, speaker, vibration motor, connector, keypad, etc., although not specifically illustrated.

[0148] The display unit (315) includes a touchscreen controller (317) and a touchscreen (318).

[0149] The touch screen (318) receives touch input from the user. The touch input here is detected by various gestures such as pinch, spread, drag, and tap. The display panel (not shown) of the touch screen can be implemented as various types of displays such as LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes) display, AM-OLED (Active-Matrix Organic Light-Emitting Diode), PDP (Plasma Display Panel), etc., and can be implemented as flexible, transparent, or wearable.

[0150] The touch screen controller (317) transmits the touch input received through the touch screen (318) to the control unit (350).

[0151] The power supply unit (319) includes an interface for connecting to a battery and / or an external power source to supply power required for the video recording device (300).

[0152] The memory (360) can store an operating system, various programs (applications), and data used for the operation of the video recording device (300), and may include at least one of an internal memory and an external memory.

[0153] The embedded memory may include, for example, at least one of volatile memory (e.g., DRAM (Dynamic RAM), SRAM (Static RAM), SDRAM (Synchronous Dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (One Time Programmable ROM), PROM (Programmable ROM), EPROM (Erasable and Programmable ROM), EEPROM (Electrically Erasable and Programmable ROM), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid-state drive (SSD). The control unit (350) may load commands or data received from at least one of the non-volatile memory or other components into the volatile memory for processing. Additionally, the control unit (350) may store data received from or generated from other components in the non-volatile memory. External memory may include at least one of, for example, CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD (extreme Digital), and Memory Stick.

[0154] Programs (applications) stored in memory (360) can be classified into multiple modules according to their functions, such as a mobile communication module (361), a Wi-Fi module (362), a Bluetooth module (363), a DMB module (364), a camera module (365), a sensor module (366), a GPS module (367), a profile setting module (368), a video playback module (369), an audio playback module (370), a database (371), etc. Each module includes commands for performing various functions provided by the video recording device, and since the functions of the modules can be intuitively inferred by a person skilled in the art from their names, only the profile setting module (368) will be described here according to the embodiments.

[0155] According to one embodiment, the profile setting module (368) receives a video frame from the camera unit (304), and when a selection for one of the profile options is input from the memory (360) which stores a plurality of comparison profiles having different profile attribute values ​​for each profile option through the input / output unit (310), the module reads a plurality of comparison profiles related to the selected profile option from the memory (360), transmits the profile attribute value of each comparison profile to the display unit (316) through the input / output unit (310), generates a plurality of preview images equal to the number of comparison profiles and transmits them to the display unit (316) through the input / output unit, and in response to a user selection signal received through the input / output unit (310), transmits a setting signal including the profile attribute value of the selected profile among the comparison profiles to the camera unit (304) to set parameters for generating a video frame. The camera module (365) may include commands for controlling the camera unit (304) in relation to video shooting.

[0156] The control unit (350) controls the units illustrated in FIG. 6 by executing programs (applications) stored in memory (360) and provides various services to the user. The control unit (350) may include at least one of RAM, ROM, and GPU in addition to the CPU. RAM, ROM, CPU, and GPU may be connected to each other via a bus. The CPU accesses memory (360) and performs booting using the operating system stored in memory (360). Then, it performs various functions using various programs, content, data, etc. stored in memory (360). A set of instructions for system booting is stored in ROM. For example, when power is supplied to the video recording device (300), the CPU can copy the operating system stored in memory (360) to RAM according to instructions stored in ROM, and execute the operating system to boot the system. When booting is completed, the CPU copies various programs stored in memory (360) to RAM (360) and executes the programs copied to RAM (360) to perform various operations.

[0157] The concepts of the above-described embodiments may be applied to any integrated circuit comprising a signal processor configured to perform the above-described operations. Additionally, the concepts of the above embodiments may be applied to any wireless communication unit. Furthermore, for example, the concepts of the above embodiments may be adopted in stand-alone devices such as signal processors, Application-Specific Integrated Circuits (ASICs), microcontrollers, and / or other subsystem elements.

[0158] Examples of specific devices that can be used as video recording devices (300) include various devices with video recording functions, such as smartphones, action cams, vehicle video recording devices, video recording drones, and surveillance cameras.

[0159] The embodiment disclosed in this specification provides two or more comparison profiles for a selected method through a Web UI as a user interface, while displaying a profile loading window for a profile selected by the user. For example, if the user selects a video profile prioritizing image quality among the profile options, the user can pre-test an arbitrary number (N) of profiles by adjusting various values ​​for QP, video compression, frame rate, or bitrate. At this time, for the N tested videos, the user is provided with information regarding the video, bitrate, and other profiles, and N or more preview videos may be provided. At this time, the user can select a profile from the provided options.

[0160] Regarding the Image Signal Processing (ISP) functions of the video recording device, the degree of image change desired by the user can be provided as a preview video from a non-expert perspective. For example, example images corresponding to values ​​for the degree of sharpness can be displayed, and the preferred sharpness level can be input. In this way, for all functions with degree values ​​such as Noise Reduction Level, Contrast Level, and Brightness Level, images corresponding to each setting value for the corresponding attribute can be provided to the user as a preview, and the preferred attribute value can be input.

[0161] When a video profile is configured to provide better visibility of specific areas, such as people, objects, or the foreground, ISP functions can also be automatically configured to operate in a manner friendly to those areas. For example, if an object-centric profile is configured, weights are applied based on the object to ensure that various functions operate with a focus on that specific area.

[0162] Meanwhile, the device according to the embodiment not only recommends a profile based on the response received after querying the user regarding the setting of profile attributes, but may also automatically recommend a profile suitable at a specific point in time during camera operation. The specific point in time when the device recommends a profile to the user may be as follows. For example, if the video recording device is a PTZ camera, when the camera repeatedly moves to a specific coordinate by operating the Pan / Tilt / Zoom function by the user, the accumulated images captured at the moved specific coordinate are learned to analyze the profile applied to the image. After the analysis is completed, if a command to move to the PTZ coordinate stored in the preset for moving to the specific coordinate is input, an alarm recommending a profile can be displayed through the user interface. Additionally, if there is an analyzed recommended profile, a profile recommendation alarm can be displayed to the user when entering the settings screen for setting the preset.

[0163] The specific timing for repeated PTZ movement may be when the camera's own functions, such as Preset, Tour, or Swing, are activated, or it may also include cases where commands controlling the camera via CGI (Common Gateway Interface) are input from a separate third-party tool. Recommendation alerts for profile recommendations are typically displayed temporarily on the user interface screen at the trigger point when control commands for PTZ movement are input, after which they disappear; however, alerts can also be accumulated to allow viewing of all alerts. Profile recommendation alerts may be displayed within the user settings and monitoring webpage provided by the camera, or, if the user settings and monitoring functions are provided through a separately installed application, they may be displayed within the operating system capable of running that program. The form of profile recommendation alerts can vary, but generally, they appear as a pop-up window in the lower right corner of the PC's operating system screen.

[0164] Hereinafter, a profile setting method is described for setting a profile for image capture by an image capture device so that a user can acquire an image they wish to obtain from the aforementioned image capture device or an image management server of an image capture system including the image capture device. The image capture device or the image management server of an image capture system including the image capture device can function as a profile setting device.

[0165] FIG. 7 is a block diagram showing an apparatus for executing a profile setting method according to one embodiment of the present invention.

[0166] Referring to FIG. 7, the profile setting device (400) may be implemented as a separate device from the aforementioned image capturing device (100 in FIG. 1 and 2, 300 in FIG. 5 and 6) and image management server (200 in FIG. 1 and 4), may be included as a part of the configuration of these devices, or may be included in at least one of an image signal processing unit (131 in FIG. 2), a control unit (130 in FIG. 2, 350 in FIG. 5), or a server control unit (250 in FIG. 4). Additionally, the function of each component of the profile setting device (400) may be performed by at least one component constituting the aforementioned image capturing device or image management server.

[0167] FIG. 8 is an example of a user interface for setting a profile in an image capturing device or image management server according to one embodiment, and FIG. 9 illustrates an example of a user interface for outputting a comparison profile and a preview screen for setting a profile.

[0168] Referring again to FIG. 7, the profile setting device (400) may be configured to include an image receiving unit (410), a profile storage unit (420), a preview image generating unit (430), a profile setting unit (440), a user interface unit (450), and a user preference learning unit (460). The illustrated components are not essential, so a profile setting device (400) with more or fewer components may be implemented. These components may be implemented in hardware or software, or through a combination of hardware and software. Among the components of the profile setting device, the functions of the image receiving unit (410), the preview image generating unit (430), the profile setting unit (440), and the user interface unit (450) may be performed by a control unit or processor of the image capturing device and the image management server. Additionally, the function of the profile storage unit (420) may be performed by a storage unit or memory of the image capturing device and the image management server. Additionally, the function of the user preference learning unit (460) may be performed by the AI ​​processing unit together with the control unit or processor of the video recording device and the video management server. Meanwhile, the function of the video receiving unit (410) may be performed by the communication unit or communication interface device of the video recording device and the video management server.

[0169] The video receiving unit (410) can receive a surveillance video captured from the image sensor (110 in FIG. 2) of the video capturing device.

[0170] The profile storage unit (420) can store comparison profiles having different profile attribute values ​​for each profile option classified according to the purpose of use for setting the video recording device according to the purpose of use for surveillance video. For example, the profile options can be classified into various profiles according to the purpose, such as a quality recommendation profile, a bitrate recommendation profile, a person-centered profile, an object-centered profile, a foreground-centered profile, a high-quality profile, a low-quality profile, a background-centered profile, and a PC / mobile terminal performance recommendation profile. The comparison profiles may include two or more profiles with different detailed attribute setting values ​​for each profile option. At this time, for each option, the values ​​of QP and GOP may be set as arbitrary integers, and for each option, the maximum bitrate, frame rate, and degree of video compression may be determined as arbitrary values.

[0171] For example, when a user selects a quality recommendation profile, the values ​​of the ISP functions, such as Noise Reduction Level, Contrast Level, and Brightness Level, are set to several recommended random values, and two or more codec-related functions, such as GOV length, whether it is HEVC or AVC, CABAC, profile, and video bitrate, may be recommended to the user as recommended values. At this time, as shown in FIG. 9, the user can select a profile after checking the recommended preview video. For example, the above quality recommendation profile option may include a first profile with video codec H.264, resolution 1920*1080, frame rate 20, video bitrate 4K, profile High, and GOV (Group of Video object planes) length 16, and a second profile with video codec HEVC, resolution 1920*1080, frame rate 20, video bitrate 3.5K, profile Main, and GOV (Group of Video object planes) length 16 as comparison profiles.

[0172] When a user selects a recommended bitrate profile, the values ​​of the ISP functions—Noise Reduction Level, Contrast Level, and Brightness Level—are fixed to the recommended values, and two or more codec-related functions—such as GOV length, HEVC or AVC, CABAC, profile, and video bitrate—can be recommended to the user as arbitrary values. Additionally, the bitrates of two or more preview videos are displayed as results, allowing the user to directly check the preview videos corresponding to the selected profile and decide on the profile, thereby helping to select an efficient profile. In this case, the user can also select the recommended preview video through an interface similar to that shown in Fig. 9.

[0173] When a user selects a PC / mobile performance recommendation profile, the values ​​of ISP functions such as Noise Reduction Level, Contrast Level, and Brightness Level are set to several recommended random values, and codec and related functions such as GOV length, HEVC or AVC, CABAC, profile, and video bitrate can be recommended as recommended random values. In this case, the recommended values ​​predict that the user will use a bitrate with low network usage, such as in a mobile environment, and recommend two or more profiles capable of achieving high efficiency at low bitrates. In this case, the user can also select a recommended preview video through an interface similar to that of Fig. 9. For example, the above PC / mobile terminal performance recommendation profile option may be composed of profiles that suggest settings for the video recording device to prevent the use of a profile that records 60 FPS video on a monitor or PC that only supports 30 FPS.

[0174] The preview video generation unit (430) receives a selection of one of the profile options from the user, reads the comparison profiles related to the selected profile option from the profile storage unit, outputs the profile attribute values ​​of each of the comparison profiles to the display, and prepares preview videos in the same number as the comparison profiles and outputs them to the display.

[0175] Here, the preview images may be generated from the surveillance video based on the comparison profiles. For example, if the user selects the image quality recommendation profile option as a profile option, the preview image generation unit (430) can generate preview images by processing the video currently captured by the video recording device into a first comparison profile and a second comparison profile, and then output the generated preview images to the display along with the profile attribute setting values ​​of each video.

[0176] As another example, the aforementioned preview videos may be generated and stored in advance based on the profile attribute values ​​of each of the aforementioned comparison profiles, so that the characteristics of the video resulting from the differences in the profile attribute values ​​are clearly distinguishable. Additionally, the aforementioned preview videos may be generated and stored in advance so that when a user selects a preferred video attribute, the difference before and after the selected video attribute is clearly visible. For instance, when a user selects a preferred video attribute or multiple recommended videos are generated and displayed, the current display may be an environment where the difference before and after the profile application is not pronounced, or where the video characteristics between the comparison profiles do not show distinct differences. Consequently, when a user selects a preferred video attribute, they may not perceive the changes in the video resulting from the application of that attribute, or when selecting a profile option, they may not perceive the differences between the videos resulting from the option selection. Therefore, comparison images or comparison videos may be stored in advance on the camera itself so that the user can more intuitively check the difference before and after the profile application and perceive the differences in the video resulting from the differences in profile attribute values ​​between the profile options. The above-mentioned pre-generated preview image may be stored in a separate storage unit (420) or a profile setting device (video recording device or video management server), and when the function is called, it may be read from the storage unit or storage and displayed on the display.

[0177] After the user checks the preview images and comparison profiles displayed on the display and selects the profile to be set, the profile setting unit (440) can set the video recording device to the profile selected by the user among the comparison profiles.

[0178] The user interface unit (450) can configure a user screen that receives input from the user through a display in relation to profile settings and displays information necessary for the user. The user interface unit (450) can configure a user interface screen and display it on a display device as illustrated in FIGS. 8 and 9, which will be described later.

[0179] In addition, the preview image generation unit (430) can generate image data information including storage capacity information per unit time or bandwidth information for transmitting image data for each of the preview images, that is, image data transmitted from the image capturing device with the settings of each comparison profile. The generated image data information may be included in an area (corresponding to 711 and 721 in FIG. 9) where profile attribute values ​​related to each preview image are displayed, and may be displayed in a second area (700 in FIG. 9) to be described later. The image data information may include costs due to increased bandwidth caused by each profile setting, costs due to storage capacity, warnings due to increased costs, etc. The user may decide whether to set the image capturing device to the relevant profile by referring to the image data information.

[0180] Meanwhile, the profile setting unit (440) receives the importance of each of the profile options from the user and can set the profile attribute values ​​of comparison profiles related to the profile options based on the importance set by the user, and the preview video generation unit (430) can generate a preview video according to the setting of the profile attribute values ​​reflecting the importance entered by the user and show it to the user. The user can input the importance of user-perspective attributes such as resolution, video smoothness, bitrate, person-centered, and background-centered, each with a score of 0 to 10 points, through the user interface provided by the user interface unit (450). Here, the importance score may indicate that the option selected by the user is important according to the higher score. The profile setting unit (440) can generate a profile by reflecting the setting value of the corresponding attribute among the profile attributes according to the importance score for each user-perspective attribute entered by the user. For example, if a user selects options such as resolution (1 point), video smoothness (10 points), and bitrate (1 point), the profile setting unit (440) can generate a profile with a higher frame rate even if the resolution is fixed at a low state to improve video smoothness within a low bitrate, and can generate profiles with a higher frame rate by changing the encoding codec in various ways. At this time, the preview video generation unit (430) can generate a preview video according to each of the profiles generated in this way and provide the user with a comparison video for each profile with different levels of importance.

[0181] Referring further to FIGS. 8 and 9, for example, the user interface unit (450) can play a surveillance video (600) currently received from a video recording device on the display, and the user can manually set a profile by changing attribute values ​​in the video attribute setting area (601) while checking the surveillance video (600) being played. Additionally, the user interface unit (450) can output a user interface to the display that includes a first area (610) for receiving input of a profile option list (611) for the video recording device and a selection of the displayed profile option list (611), two or more comparison profile information (711, 721) related to the profile option selected in the first area (610), and a second area (700) for displaying a preview video (710, 720) generated by the comparison profile information (711, 721). The user can check the difference in video according to the comparison profile settings by playing the preview videos (710, 720) generated by the comparison profile information (711, 721) simultaneously or individually in the second area (700), and can set the video recording device by selecting any one of these comparison profile information (711, 721). For example, the preview videos can be played through a triangular play button within the preview video, and can also be played simultaneously through a simultaneous play button. Afterwards, the user can set the corresponding profile by viewing the preview video and entering or selecting the video number. Here, the preview videos can be displayed within the second area (700) with video sizes relative to each profile, so that the relative sizes of the videos according to the comparison profile can be compared.

[0182] The user preference learning unit (460) can derive a preference for the user’s video features based on at least one of the video shooting pattern using the user’s video recording device, the video viewing pattern, and the video search pattern, and can generate a comparison profile based further on the derived user preference. That is, the user preference learning unit (460) can perform the function of analyzing the user’s video-related activity pattern to learn the video features preferred by the user and generating a personalized comparison profile based thereon.

[0183] Specifically, the user preference learning unit (460) can derive a preference for the user’s video features based on at least one of the following user patterns, and can generate a comparison profile based further on the derived user preference. Here, the video features may include content features of the video (e.g., theme, characters, objects, situations, emotions), technical features (e.g., resolution, frame rate, color tone, shooting composition, degree of shaking), or temporal features (e.g., shooting time, duration), etc.

[0184] Video recording patterns can refer to the manner or tendency of a user to record videos using video recording devices such as smartphones or cameras. For example, preferred video characteristics can be learned by analyzing tendencies to repeatedly record videos of specific subjects (e.g., pets, landscapes, people, cars, food, etc.), patterns of frequently recording at specific times or locations, and patterns of using specific compositions or shooting techniques.

[0185] Video viewing patterns can refer to a user's history and behavior regarding video content viewing. For example, preferences can be derived by analyzing tendencies such as repeatedly watching videos of a specific genre or performer, maintaining a longer viewing time for videos with specific characteristics (e.g., high resolution, specific color tone), or repeatedly watching videos about specific objects.

[0186] Video search patterns can refer to the history of search terms or filters entered by users on platforms such as video search engines or portals. For example, by analyzing patterns of repeatedly searching for specific keywords such as 'travel vlogs' or 'high-definition cooking,' it is possible to identify the content or technical characteristics of videos preferred by users.

[0187] In the process of generating a comparison profile, if the user preference learning unit (460) derives, for example, 'bright colors', 'shooting fast-moving objects', 'food themes', etc., the comparison profile can generate multiple comparison video shooting profiles that reflect these preferences.

[0188] Meanwhile, the profile setting device (400) can output a selection request message to the user for a comparison profile generated based on user preference under at least one of the following conditions: a change in the shooting environment, detection of a control signal for PTZ operation of the image capturing device, and an arbitrary point in time.

[0189] To explain in more detail, the profile setting device (400) can perform the function of outputting a selection request message to the user under appropriate conditions for a comparison profile generated based on the user's image feature preference, so that the user can efficiently use the set profile. This function can generally be implemented through the collaboration of the profile setting unit (440) and the user interface unit (450). The output of such a selection request message can be triggered when at least one of the following conditions is detected.

[0190] Regarding conditions for changes in the shooting environment, the profile setting device (400) can detect major changes in the shooting environment by analyzing video or environment sensor data input from the video capturing device. For detecting changes in the shooting environment, an image analysis module (e.g., an image processing algorithm executed by a processor) responsible for frame-by-frame analysis of video data received through the video receiving unit (410) may be utilized. This module can determine cases where the average brightness of the entire or specific area changes rapidly above a certain threshold, where the main color temperature of the image changes and white balance adjustment is required, or where the main object or background of the image changes and the previously set profile is no longer suitable.

[0191] Regarding the detection conditions for control signals for PTZ operation, if the video recording device includes Pan (horizontal movement), Tilt (vertical movement), and Zoom functions, the profile setting device (400) can trigger a request for profile selection by detecting control signals for the user to operate these PTZ functions. For detecting control signals for PTZ operation, a processor connected to the video receiver (410) monitors the user's PTZ operation input in real time. For example, the corresponding PTZ control signal may be detected when the user operates the zoom lever or inputs a zoom in / out gesture on the touch screen of the recording device. In particular, when a rapid Pan operation occurs, a profile suitable for recording video of a moving object can be recommended.

[0192] Regarding arbitrary timing conditions, the profile setting device (400) may output a selection request message at a predefined arbitrary time for the convenience of the user, in addition to the specific event conditions mentioned above. At this time, a timer module managed by a processor may be used to output the request message according to a set period or when the user completes a specific function. For example, a selection request message may be output at regular intervals after video recording begins, at every event completion point such as immediately after saving a video file, or at every activation point of the recording device, such as when the power of the video recording device is turned on or it enters recording mode.

[0193] When one of the above conditions is detected, the user interface unit (450) outputs a selection request message to the user containing the most suitable profile among the comparison profiles generated by the user preference learning unit (460) or a list of selectable profiles. The message may be output visually or audibly through the display of the shooting device, an external monitor, or a connected smart device.

[0194] Through this, users can quickly select and apply a profile that reflects their preferences for the current situation via the output message, which can improve video quality and user experience.

[0195] FIGS. 10 and 11 illustrate other examples of a user interface for outputting a comparison profile and a preview screen for profile settings.

[0196] The profile setting device (400) according to the embodiment can output a specific user interface (UI) screen to a display, which allows a user to efficiently compare and select profiles through the user interface unit (450), under the control of a processor.

[0197] Referring to FIG. 10, the user interface unit (450) controls the output of a UI screen including a first area and a second area to the user. The first area is a main area for displaying a preview image generated according to a profile currently set on the video recording device. The area labeled 'Preview A' in FIG. 10(a) and FIG. 10(b) corresponds to the first area, and through this area, the user can check the current shooting status in real time. The second area is an area for displaying two or more comparison profiles related to the profile option selected by the user and a plurality of preview images generated by them. The areas labeled 'Preview B' and 'Preview C' in FIG. 10(a) and FIG. 10(b) correspond to the second area. The user interface unit (450) controls the output of a plurality of preview images in the second area in sequential switching in response to user input. As illustrated in FIG. 10(a), when a user inputs a user input signal, such as a swipe, on preview B displayed in the second area through an input / output interface, the user interface unit (450) detects this and, in response to this user input signal, transmits a control signal to switch the preview B displayed in the second area to another preview image, preview C, included in the comparison profile list (see FIG. 10(b)). This allows the user to sequentially review multiple comparison profiles within the limited second area.

[0198] Referring to FIG. 11, the user interface unit (450) controls the output of a UI screen including a first area and a second area to the user, similar to FIG. 10. The first area is a main area for displaying a preview image generated according to a profile set in the current video recording device, and the second area is an area where a preview image according to a comparison profile is displayed. The user interface unit (450) controls the second area to be divided so that a plurality of preview images are displayed simultaneously, and can control the switching of images between areas according to user selection.

[0199] As illustrated in FIG. 11(a), the second region includes four divided regions, each controlled to output previews B, D, C, and E simultaneously. These preview images are generated based on the current profile, but are results to which different comparison profiles are applied.

[0200] In FIG. 11(a), when a user inputs a user selection signal (e.g., touch) for 'Preview C' among multiple preview images simultaneously displayed in the second area, the user interface unit (450) detects this signal and, in response to the monitored signal, controls the selected preview C to be displayed in the first area (main area) (see FIG. 11(b)). As a result, the profile that generated 'Preview C' is set as the currently selected profile or simulated. At the same time, the user interface unit (450) controls the output of new preview images (e.g., previews F, G, H, I, etc.) different from the selected preview image (C) instead of the remaining unselected preview images (B, D, E) displayed in the second area (see FIG. 11(b)). These new preview images are generated by applying a finely tuned profile based on the selected profile (C) or another similar profile, and can support additional in-depth comparison before the user confirms the selection.

[0201] Through a user interface screen such as the embodiment illustrated in FIGS. 10 to 11, the user can compare and select preview images according to multiple comparison profiles at a glance, thereby enabling the user to easily and efficiently select a profile for video recording.

[0202] Meanwhile, the embodiment of the present specification provides a method to visually provide various comparison profiles related thereto when a user selects a specific profile option, and to effectively set the profile selected by the user to a video source, in order to enhance the user's video shooting experience. This can be implemented by executing instructions stored in memory by the processor of the profile setting device (400). The profile setting method will be explained below with reference to FIG. 12.

[0203] FIG. 12 is a drawing illustrating a profile setting method according to one embodiment.

[0204] First, as a video frame input step, the processor receives a video frame from a video source (S110). If the video source is a video capturing device (e.g., smartphone, camera body, etc.) integrated with the profile setting device, the video is received directly from the video signal processing unit of the video capturing device; or if the video source is an external video capturing device (e.g., drone, surveillance camera) connected via a network, video data can be received via the network. The received video frame can be used to generate a preview video according to a comparison profile in a subsequent step.

[0205] Next, as a step of receiving a profile option selection input, the processor receives a selection input of one of the profile options through a user interface (S120). Here, the profile option may refer to a higher-level item that classifies profiles, such as 'scene settings', 'color settings', 'exposure settings', 'image quality settings', etc.

[0206] Next, as a step for outputting comparison profiles and preview videos, the processor outputs profile attribute values ​​of a plurality of comparison profiles related to the profile option selected in the previous step and a plurality of preview videos according to the comparison profiles (S130). In this process (S130), information necessary for the user to compare and select various profiles is provided. According to the embodiment, the plurality of comparison profiles may not simply be predefined values. The processor may derive user preferences based on at least one of the user's video shooting pattern, video viewing pattern, and video search pattern, and may dynamically generate personalized comparison profiles based further on the derived user preferences. The comparison profiles may be generated through this process.

[0207] Meanwhile, according to an embodiment, a preview image may be generated in real time. The processor may generate it in real time from an image frame input from an image source based on the profile attribute values ​​of each comparison profile. According to an embodiment, the preview image may be generated in advance. The preview image may be a template image generated in advance according to profile attribute values ​​so that image features based on differences in profile attribute values ​​are distinguished; in this case, the input image frame is not used for the real-time generation of the template image.

[0208] On the other hand, the processor can generate video data information for each comparison profile and output it along with a preview video. The video data information includes storage capacity information of video frames (e.g., file size per minute) or bandwidth information (e.g., Mbps required for real-time transmission), helping the user select a profile by considering technical constraints in addition to visual features.

[0209] In addition, regarding the control and output methods of the user interface where the preview video is displayed, the output of the preview video is controlled in various ways through the user interface screen.

[0210] According to an embodiment, preview images can be switched and output sequentially. When a user input signal selecting a profile option is received through a user interface screen, the processor can sequentially switch and output multiple preview images in response to the signal. Here, when a switching signal for the user's preview images is input, the processor can control the display of the preview images sequentially in a specific area of ​​the user interface screen in response to this signal. This is useful when reviewing many comparison profiles in a limited screen space.

[0211] According to an embodiment, multiple preview images can be simultaneously displayed and continuously compared. The processor simultaneously displays multiple preview images in a certain area of ​​a user interface screen, and when a user selection for one of them is input, it can continuously arrange and display the selected preview image and other preview images not displayed on the user interface screen so that they can be compared. This enables efficient comparison when making additional fine adjustments based on a criterion selected by the user.

[0212] Finally, as a profile setting step, the processor sets the profile of the video source to the profile selected by the user among a plurality of comparison profiles (S140). In this process (S140), the processor transmits the attribute values ​​of the profile finally selected by the user to the video signal processing unit of the video source and applies them so that they are reflected in actual shooting and recording.

[0213] As used herein, the term “part” (e.g., control part, etc.) may mean a unit comprising one or more combinations of hardware, software, or firmware, for example. “Part” may be interchangeably used with terms such as unit, logic, logical block, component, or circuit, for example. “Part” may be the smallest unit of an integrally formed part or a part thereof. “Part” may be the smallest unit or a part thereof that performs one or more functions. “Part” may be implemented mechanically or electronically. For example, “Part” may include at least one of an Application-Specific Integrated Circuit (ASIC) chip, Field-Programmable Gate Arrays (FPGAs), or programmable-logic device that performs certain operations known or to be developed in the future.

[0214] At least a portion of the device (e.g., modules or functions thereof) or method (e.g., operations) according to various embodiments may be implemented as instructions stored on a computer-readable storage medium, for example, in the form of program modules. When said instructions are executed by a processor, said one or more processors may perform functions corresponding to said instructions. A computer-readable medium includes all types of recording devices in which data that can be read by a computer system is stored. Computer-readable storage media / computer-readable recording media may include hard disks, floppy disks, magnetic media (e.g., magnetic tape), optical recording media (e.g., CD-ROM (compact disc read only memory), DVD (digital versatile disc), magneto-optical media (e.g., floptical disk), hardware devices (e.g., ROM (read only memory), RAM (random access memory), or flash memory, etc.). Additionally, program instructions may include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of various embodiments, and vice versa.

[0215] A module or program module according to various embodiments may include at least one of the aforementioned components, some of which may be omitted, or additional components may be included. Operations performed by a module, program module, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically. Additionally, some operations may be executed in a different order, omitted, or other operations may be added.

[0216] As used herein, the term "one" is defined as one or more. Furthermore, the use of introductory phrases such as "at least one" and "one or more" in the claims, even if the same claim contains introductory phrases such as "at least one" and "one or more" and ambiguously phrases such as "one," should not be interpreted to mean that the introduction of another claim element by the ambiguously phrased "one" limits any specific claim containing such introduced claim element to an invention comprising only one such element.

[0217] In this document, expressions such as "A or B" or "at least one of A and / or B" may include all possible combinations of the items listed together.

[0218] Unless otherwise specified, terms such as "first" and "second" are used to distinguish the elements described by such terms at will. Accordingly, these terms are not necessarily intended to indicate the temporal or other priority of such elements, nor does the mere fact that certain means are listed in different claims indicate that a combination of such means cannot be used advantageously. Accordingly, these terms are not necessarily intended to indicate the temporal or other priority of such elements. The mere fact that certain measures are cited in different claims does not indicate that a combination of such measures cannot be used advantageously.

[0219] Additionally, terms such as "front," "back," "top," "top," "bottom," "bottom," "on top," and "below" in the detailed description and claims are used for illustrative purposes but are not necessarily used to describe permanent relative positions. It is understood that such terms are interchangeable under appropriate circumstances to allow the embodiments of the invention described herein to operate in directions other than those shown or otherwise described herein.

[0220] For the sake of simplicity and clarity, it should be understood that the elements depicted in the drawings are not necessarily drawn in a fixed proportion. For example, the dimensions of some elements may be exaggerated compared to others for clarity. Additionally, where deemed appropriate, reference numbers may be repeated between the drawings to indicate corresponding or similar elements.

[0221] An arrangement of components to achieve the same function is effectively "related" so that the desired function is achieved. Therefore, any two components combined to achieve a specific functionality can be considered "related" to each other so that the desired function is achieved, regardless of the structure or mediating components. Likewise, two components related in this way can be considered "operably connected" or "operably combined" to achieve the desired function.

[0222] Furthermore, a person skilled in the art will recognize that the boundaries between the functionalities of the aforementioned operations are merely exemplary. Multiple operations may be combined into a single operation, a single operation may be distributed among additional operations, and operations may be executed with at least partial temporal overlap. Additionally, alternative embodiments may include multiple instances of a specific operation, and the order of operations may be changed in various other embodiments. However, other modifications, variations, and alternatives are also possible. Accordingly, the detailed description and drawings should be regarded as exemplary rather than restrictive.

[0223] The phrase "may be X" indicates that condition X may be satisfied. This phrase also indicates that condition X may not be satisfied. For example, a reference to a system containing a specific component must also include a scenario in which the system does not contain that specific component. For example, a reference to a method containing a specific action must also include a scenario in which that method does not contain that specific component. However, to give another example, a reference to a system configured to perform a specific action must also include a scenario in which the system is not configured to perform a specific task.

[0224] The terms "comprising," "having," "consisting of," "consisting of," and "essentially composed of" are used interchangeably. For example, any method may include at least the operations included in the drawings and / or specification, or may include only the operations included in the drawings and / or specification. Alternatively, the word "comprising" does not exclude the presence of the elements or operations listed in the claims.

[0225] A person skilled in the art will recognize that the boundaries between logic blocks are merely exemplary and that alternative embodiments may merge logic blocks or circuit elements or impose alternative decompositions of functions on various logic blocks or circuit elements. Accordingly, the architecture depicted herein is merely exemplary and should be understood that, in fact, many other architectures achieving the same functions can be implemented.

[0226] Additionally, for example, in one embodiment, the illustrated examples may be implemented as circuits located on a single integrated circuit or within the same device. Alternatively, the examples may be implemented as any number of individual integrated circuits or individual devices interconnected in a suitable manner, and other changes, modifications, variations, and alternatives are also possible. Accordingly, the specification and drawings should be regarded as exemplary rather than restrictive.

[0227] In addition, for example, the aforementioned examples or some thereof may be implemented as software or code representations of physical circuits or logical representations convertible into physical circuits, such as any appropriate type of hardware description language.

[0228] In addition, the present invention is not limited to physical devices or units implemented in non-programmable hardware, but may also be applied to programmable devices or units capable of performing desired device functions by operating according to appropriate program code, such as mainframes, minicomputers, servers, workstations, personal computers, notepads, personal digital information terminals (PDAs), electronic games, automobiles and other embedded systems, mobile phones and various other wireless devices, etc., which are generally referred to herein as 'computer systems'.

[0229] The system, device, or apparatus mentioned in this specification includes at least one hardware component.

[0230] Connections as described herein may be any type of connection suitable for transmitting signals from or to each node, unit, or device, for example, through an intermediate device. Thus, unless implicitly or otherwise stated, a connection may be, for example, a direct connection or an indirect connection. A connection may be described or depicted by reference as a single connection, multiple connections, a unidirectional connection, or a bidirectional connection. However, different embodiments may vary the implementation of a connection. For example, a separate unidirectional connection may be used instead of a bidirectional connection, and vice versa. Additionally, multiple connections may be replaced by a single connection that transmits multiple signals sequentially or in a time-multiplexed manner. Likewise, a single connection transmitting multiple signals may be separated into various connections transmitting a subset of these signals. Thus, many options exist for transmitting signals.

[0231] Preferred embodiments of the technology described in this specification have been described above with reference to the accompanying drawings. Herein, terms and words used in this specification and claims should not be interpreted as being limited to their ordinary or dictionary meanings, but should be interpreted in a meaning and concept consistent with the technical spirit of the invention. The scope of the invention is not limited to the embodiments disclosed in this specification, and the invention may be modified, changed, or improved in various forms within the scope described in the spirit of the invention and the claims.

[0232] The present invention can be easily applied to image capturing devices, such as digital cameras, smartphones, and surveillance camera systems, as well as related image processing systems, which include processors and memory. Essentially, the present invention reads multiple comparison profiles related to user-selected options for an image frame generated by an image signal processing unit from memory and transmits multiple preview images corresponding to these profiles to a display. Through this, the user can directly compare the visual results of various profiles without complex manual settings, and finally, in response to a user selection signal, the parameters of the image signal processing unit can be automatically set to the attribute values ​​of the corresponding profiles. By providing such an intuitive and efficient profile setting process, the optimization of image quality and user convenience are significantly improved, making industrial manufacturing and use easy.

Claims

1. At least one processor; A memory storing instructions to be executed by the above processor and a plurality of comparison profiles having different profile attribute values ​​for each profile option; Includes an input / output interface configured to transmit data to a display, receive a user selection signal, and transmit a setting signal; When the above instructions are executed by the processor, the processor: Receives an image frame generated by an image signal processing unit; When a selection for any one of the above profile options is input through the input / output interface, a plurality of comparison profiles related to the selected profile option are read from the memory, and the profile attribute values ​​of each comparison profile are transmitted to the display through the input / output interface; Generating multiple preview images according to each of the comparison profiles and transmitting them to the display through the input / output interface; and Setting parameters of the image signal processing unit based on the profile attribute value of the selected profile among the comparison profiles in response to a user selection signal received through the input / output interface, Video recording device.

2. In claim 1, the preview images are, One generated from an image frame received from the image signal processing unit based on the profile attribute values ​​of each of the above comparison profiles, Video recording device.

3. In claim 1, the preview images are, A profile attribute value of each of the above comparison profiles that is pre-generated to distinguish image features based on the difference in the profile attribute values, Video recording device.

4. In claim 1, the processor, Calculate image data information including storage capacity information or bandwidth information of an image frame according to each of the above comparison profiles, and Transmitting the above video data information to the display through the above input / output interface along with the corresponding profile, Video recording device.

5. In claim 1, the processor, A user interface screen including a first area for displaying the above profile options, two or more comparison profiles related to the profile option selected in the first area, and a second area for displaying a preview image generated by the two or more comparison profiles is further transmitted to the display through the input / output interface. When a selection input for the profile option in the first area is input by the user through the user interface screen, the profile attribute value of each of the comparison profiles is output to the second area, and preview images for each of the comparison profiles are transmitted to the display through the input / output interface so as to be output in the second area. Video recording device.

6. In claim 1, the processor, A user interface screen including a third area for displaying a preview image according to a currently set profile, two or more comparison profiles related to the selected profile option, and a fourth area for displaying a plurality of preview images generated by the two or more comparison profiles is further transmitted to the display through the input / output interface. Transmitting a control signal to the display through the input / output interface so that the plurality of preview images are sequentially switched and output to the fourth area in response to a user input signal in the fourth area received through the input / output interface, Video recording device.

7. In claim 6, the processor, Controls the above plurality of preview images to be simultaneously output to the above fourth area, and Controlling the output of a selected preview image to the third area in response to a user selection signal for one of the plurality of preview images simultaneously output to the fourth area, and transmitting a control signal to the display through the input / output interface so that a preview image different from the unselected preview image among the plurality of preview images is output to the fourth area. Video recording device.

8. In claim 1, the processor, When the importance of each of the profile options is input from the user through the above input / output interface, Setting profile attribute values ​​of the comparison profiles related to the profile options based on the above importance, Video recording device.

9. In claim 1, the processor, Deriving user preferences based on at least one of a user's video shooting pattern, video viewing pattern, and video search pattern, and generating the comparison profile based further on the derived user preferences, Video recording device.

10. A profile setting device for setting a profile for generating image frames of a camera, comprising a display, memory and at least one processor, The above memory stores a plurality of comparison profiles having different profile attribute values ​​for each profile option, and The above processor is, Receive video frames from the above camera; A user interface for selecting profile options is displayed on the above display, and when a selection for any one of the profile options is entered, a plurality of comparison profiles related to the selected profile option are read from the memory, and the profile attribute values ​​of each comparison profile are displayed on the display through the user interface; Generate multiple preview images according to each of the comparison profiles and display them on the display through the user interface; Characterized by transmitting a setting signal containing the attribute value of the selected comparison profile to the camera in response to a user selection input selecting one of the above comparison profiles. Profile setting device.

11. In claim 10, the above preview images are, Generated from an image frame received from the camera based on the profile attribute values ​​of each of the above comparison profiles, Profile setting device.

12. In claim 10, the above preview images are, A profile attribute value of each of the above comparison profiles that is pre-generated to distinguish image features based on the difference in the profile attribute values, Profile setting device.

13. In claim 10, the processor, Calculate image data information including storage capacity information or bandwidth information of an image frame according to each of the above comparison profiles, and Displaying the above video data information on the display along with the corresponding profile, Profile setting device.

14. In claim 10, the processor, A user interface screen is displayed on the display, comprising a first area for displaying the above-mentioned profile options, two or more comparison profiles related to the profile option selected in the first area, and a second area for displaying a preview image generated by the two or more comparison profiles. When a selection input for the profile option in the first area is input by the user through the user interface screen, the profile attribute value of each of the comparison profiles is output to the second area, and preview images for each of the comparison profiles are transmitted to the display through the input / output interface so as to be output in the second area. Profile setting device.

15. In claim 10, the processor, A user interface screen is displayed on the display, comprising a third area for displaying a preview image according to a currently set profile, two or more comparison profiles related to the selected profile option, and a fourth area for displaying a plurality of preview images generated by the two or more comparison profiles. Controlling the plurality of preview images to be sequentially switched and output to the fourth area in response to a user input signal in the fourth area, Profile setting device.

16. In claim 15, the processor, The above plurality of preview images are simultaneously output to the above fourth area, and In response to a user selection signal for one of the plurality of preview images simultaneously output in the fourth area, the selected preview image is output to the third area, and a preview image different from the unselected preview image among the plurality of preview images is output to the fourth area. Profile setting device.

17. In claim 10, the processor, When the importance of each of the profile options is entered by the user through the above user interface, Setting the profile attribute values ​​of the comparison profiles related to the profile options based on the above importance Profile setting device.

18. In claim 10, the processor, Deriving user preferences based on at least one of the user's shooting pattern, viewing pattern, and search pattern, and generating the comparison profile based further on the derived user preferences. Profile setting device.

19. A profile setting method of a profile setting device executed by a processor, Step of receiving video frames from a video source; A step of receiving a selection input of one of the profile options; A step of outputting profile attribute values ​​of a plurality of comparison profiles associated with a selected profile option and a plurality of preview images according to the comparison profiles; and The step of setting the profile of the image source to a profile selected by the user among the plurality of comparison profiles above; How to set up a profile.

20. In claim 19, the image source is, A video signal processing unit of a video recording device integrated with the above-mentioned profile setting device, or at least one of a video recording device connected via a network, How to set up a profile.

21. In claim 19, the preview image is, One generated from the image frame received from the image source based on the profile attribute values ​​of each of the above comparison profiles, How to set up a profile.

22. In claim 19, the preview image is, A profile attribute value of each of the above comparison profiles that is pre-generated to distinguish image features based on the difference in the profile attribute values, How to set up a profile.

23. In Paragraph 19, A step of calculating image data information including storage capacity information or bandwidth information of an image frame according to each of the above comparison profiles; and A step of outputting the above video data information together with the above preview video; further comprising How to set up a profile.

24. In Paragraph 19, The method further comprises the step of sequentially switching and outputting the plurality of preview images in response to the user input signal when a user input signal is received from a user selecting any one of the profile options through a user interface screen. How to set up a profile.

25. In Paragraph 19, The method further comprises the step of simultaneously outputting the plurality of preview images through a user interface screen, and when a user selection for one of the plurality of preview images is input, continuously arranging and outputting the selected preview image and other preview images not displayed on the user interface screen so as to be comparable. How to set up a profile.

26. In Paragraph 19, The method further comprises the step of deriving user preferences based on at least one of a user's shooting pattern, viewing pattern, and search pattern, and generating the comparison profile based further on the derived user preferences. How to set up a profile.

Images