Camera working method, device and system

Abstract

The invention discloses a camera working method, device and system. The method comprises the steps that one or more linkage events composed of camera input signals and camera output signals are stored in a camera, the linkage events are preset linkage events or linkage events created by a user in real time in control equipment, and then the linkage events are imported into the camera from the control equipment; receiving a shot picture fed back by a camera device in the camera, performing intelligent analysis on the shot picture based on an artificial intelligence machine model, and identifying a corresponding camera signal; and comparing the identified camera signal with the camera input signal in the stored linkage event, and if the linkage event is matched and all the camera input signals in the linkage event are satisfied, triggering and executing all the camera output signals in the linkage event. Through the technical scheme of the invention, a user can customize and program the input and output signals on the camera, and automatic linkage between camera signals is achieved.

Description

Technical Field

[0001] The present invention relates to the field of camera technology, and in particular to a camera working method, device and system. Background Art

[0002] With the development of intelligent technology, cameras have more and more functions and more and more camera signals. Although the camera signals are increasing, the correlation control between the signals in existing cameras is not high, and they cannot be configured by users at will, and the degree of intelligence is very low.

[0003] Based on this, the present invention proposes a camera signal control method and system, which provide users with an operating platform for autonomously controlling camera signals. The operation is simple, and linkage control between camera signals can be achieved. Problems occurring in the current scene can be discovered in a timely manner, thereby improving the safety of the camera's monitoring of the scene. Summary of the invention

[0004] The present invention provides a camera, comprising: a camera device and a signal control device; the signal control device comprises a linkage event storage module, a signal monitoring module, a signal analysis module, a signal execution module and a signal output module;

[0005] A linkage event storage module, used to store linkage events consisting of camera input signals and camera output signals;

[0006] A signal monitoring module is used to establish a connection relationship with the camera device, receive a camera signal fed back by the camera device, that is, the camera lens captures the current scene image, and transmit the received current scene image to the signal analysis module;

[0007] The signal analysis module is used to analyze the current scene picture transmitted by the signal monitoring module based on a pre-trained artificial intelligence machine model to determine the camera signal corresponding to the current scene picture;

[0008] The signal execution module is used to compare the camera signal identified by the signal analysis module with the camera input signal of the linkage event in the signal storage module. If all camera input signals in the matching linkage event are satisfied, all camera output signals of the linkage event are executed.

[0009] A camera as described above, wherein one or more linkage events are stored in the linkage event storage module, and the linkage event is one or more linkage events preset in the camera when the camera leaves the factory, or one or more linkage events imported from a control device, for subsequent signal comparison.

[0010] In the camera as described above, a linkage event includes one or more camera input signals and one or more camera output signals.

[0011] A camera as described above, wherein the signal analysis module pre-stores a trained artificial intelligence machine model, and the artificial intelligence machine model is preset in the camera before leaving the factory, or is imported into the camera by a terminal device.

[0012] A camera as described above, wherein a plurality of artificial intelligence machine models are arranged in the signal analysis module, and each artificial intelligence machine model can identify a corresponding type of camera signal.

[0013] The present invention also provides a camera system, comprising any of the above-mentioned cameras, and further comprising a control device; a signal linkage system is provided in the control device, and the signal linkage system specifically comprises a signal display interface, a signal selection module, a signal linkage event creation module and a device output module;

[0014] The signal display interface provides a programming interface that is easy to understand and program for users, and various programming components are displayed in the programming interface, including a camera input signal condition component, a camera output signal result component, and a linkage event component;

[0015] The signal selection module is used to receive the user's selection of the camera input signal in the condition component on the display screen, and receive the user's selection of the camera output signal in the result component on the display screen;

[0016] The signal linkage event creation module establishes a linkage event with the camera input signal and the camera output signal selected by the user in the signal selection module;

[0017] The device output module is used to send the linkage event created by the signal linkage event creation module to the camera.

[0018] A camera system as described above, wherein the signal selection module includes a conditional object selection submodule and a result object selection submodule, and property settings can be performed in both the object selection submodule and the result object selection submodule. When a user selects an object on the display screen, the currently selected object is recorded. If the user's property settings for the currently selected object are received, a corresponding relationship between the currently selected object and the property is established, and the entire object is used as an execution item of the event.

[0019] In the camera system as described above, the connection relationship between the device output module and the camera is a wired connection or a wireless connection, or is connected through other media, so as to import the created linkage event into the camera.

[0020] The present invention also provides a camera operating method, comprising:

[0021] One or more linkage events consisting of a camera input signal and a camera output signal are stored in the camera, wherein the linkage event is a preset linkage event or a linkage event created by a user in real time pairing the camera input signal and the camera output signal in the control device, and then imported into the camera from the control device;

[0022] Receive the shooting picture fed back by the camera device in the camera, perform intelligent analysis on the shooting picture based on the artificial intelligence machine model, and identify the corresponding camera signal;

[0023] The identified camera signal is compared with the camera input signal in the stored linkage event. If a linkage event is matched and all camera input signals in the linkage event are satisfied, all camera output signals in the linkage event are triggered to execute.

[0024] The beneficial effects achieved by the present invention are as follows: through the technical solution of the present invention, users can customize the input and output signals on the programming camera to achieve automatic linkage between camera signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0026] Figure 1 This is a schematic diagram of a mobile device in a camera system provided by Embodiment 1 of the present invention;

[0027] Figure 2 This is a schematic diagram of a camera in a camera system provided by Embodiment 1 of the present invention;

[0028] Figure 3 This is a flow chart of a camera working method provided in Embodiment 2 of the present invention. DETAILED DESCRIPTION

[0029] The following is a clear and complete description of the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0030] Embodiment 1

[0031] Embodiment 1 of the present invention provides a camera linkage system, including a camera and its control device (a device that can control the camera signal linkage, such as a mobile device connected to the camera, etc.). The camera is integrated with a camera device (i.e., a camera lens) and a signal control system. The signal control system can be pre-integrated in the camera when the camera leaves the factory, or can be imported into the camera through a mobile device, etc. Regardless of the pre-integration or post-import method, the signal control system in the camera can be matched and associated by the mobile device. The signal linkage system is integrated in the mobile device through application download or WeChat applets, and signal matching and association are operated in the signal linkage system.

[0032] like Figure 1 As shown, the signal linkage system in the mobile device includes:

[0033] (1) Signal display interface 110

[0034] The signal display interface 110 of the present invention can provide a user with an easy-to-understand and programmable programming interface. The user can customize the linkage relationship between various camera signals in the programming interface. The user establishes the linkage relationship between various camera signals in the programming interface, which is the user programming process. Various programming components are displayed in the programming interface, and the programming components can be pre-set or customized according to user needs.

[0035] Programming components include selectable camera input signal components, camera output signal components, and camera signal linkage event components that are easy for users to intuitively understand. These components can be programmed by users, including editing the association between camera signals, setting the properties of each camera signal, adding, deleting, modifying, and checking camera signals, naming each camera signal, and the position on the display screen.

[0036] The camera signal involved in the present invention can be any input and output signal / object / icon occurring on the camera, and also includes a preset custom signal output by the camera after performing artificial intelligence analysis on the current shooting scene. For example, the camera analyzes that a fight has occurred in the current shooting scene, and the preset custom signal name for such an event is an abnormal event signal. The camera signal can be displayed in various forms such as text, icons, and pictures in the camera signal control system, which is not limited here.

[0037] A component linkage system is displayed on the display screen of the terminal device. The component linkage system includes a condition component, an event component and a result component. The condition component includes multiple condition objects, which can be set by the user according to needs. The result component includes multiple result objects, which can also be set by the user according to needs. The event component includes at least one event component.

[0038] (2) Signal selection module 120

[0039] The signal selection module 120 includes a condition object selection submodule and a result object selection submodule. The object selection submodule receives the user's selection of the camera input signal in the condition component on the display screen, and the result object selection submodule receives the user's selection of the camera output signal in the result component on the display screen, and establishes an association event corresponding to the camera input signal and the camera output signal.

[0040] Property settings can be performed in both the object selection submodule and the result object selection submodule. When the user selects an object on the display screen, the currently selected object is recorded. If the user's property settings for the currently selected object are received, a correspondence between the currently selected object and the property is established, and the entire object is used as the execution item of the event.

[0041] (3) Signal linkage event creation module 130

[0042] The signal linkage event creation module 130 establishes a linkage event with the camera input signal and the camera output signal selected by the user in the signal selection module, the condition object selected by the object selection submodule is used as the trigger condition of the event, and the result object selected by the result object selection submodule is used as the execution result of the event. Among them, a linkage event can include one or more condition objects, and can also include one or more result objects.

[0043] In the signal linkage system, one or more linkage events can be created according to user needs. Each linkage event can include one or more camera signals, and the camera signals in each linkage event can be linked to each other. For example, signal A in the first linkage event can trigger signal B in the second linkage event. The creation of the above linkage events is programmed by the user, such as displayed in the form of cross-connections in the signal display interface for user viewing.

[0044] (4) Device output module 140

[0045] The device output module 140 is connected to the camera, and is used to send the linkage event created by the signal linkage event creation module 130 to the camera. The connection relationship between the device output module 140 and the camera can be a wired connection or a wireless connection, or can be connected through other media, for example, the mobile device and the camera are connected through a data cable, and the device output module of the mobile device imports the created one or more linkage events into the camera through the data cable; for another example, the mobile device and the camera are connected through a wireless form such as Bluetooth / NFC / WIFI, and the output module of the mobile device imports the created one or more linkage events into the camera through Bluetooth / NFC / WIFI; for another example, the mobile device is connected to the host, and the camera is also connected to the host, and the mobile device first transmits the created one or more linkage events to the host, and then downloads them from the host to the camera.

[0046] like Figure 2 As shown, the signal control device in the camera specifically includes:

[0047] (1) Linkage event storage module 210

[0048] A linkage event storage module 210 is set in the camera, and the linkage event storage module 210 is used to store linkage events. The linkage event can be one or more linkage events preset in the camera when the camera leaves the factory, or one or more linkage events imported from a mobile device for subsequent signal comparison.

[0049] It should be noted that the linkage events in the linkage event storage module 210 can be updated in real time, and considering that the conditions for creating linkage events on the camera are limited, the linkage events preset in the camera before leaving the factory or the linkage events imported by the mobile device can also be subsequently updated by the user using the mobile device.

[0050] In addition, the camera provided in this application supports the integration of third-party cloud services or APIs, such as face recognition services, weather query services, etc. Users can integrate these services into the camera system through programming to achieve more diversified functions.

[0051] (2) Signal monitoring module 220

[0052] The signal monitoring module 220 establishes a connection relationship with the camera's camera device, receives the camera signal fed back by the camera device, that is, the camera lens captures the current scene image, and sends the current scene image to the signal monitoring module. The signal monitoring module 220 can automatically identify scene changes within the camera's field of view, and execute corresponding response operations according to preset program logic. The signal monitoring module 220 transmits the received current scene image to the signal analysis module 230.

[0053] (3) Signal analysis module 230

[0054] The signal analysis module 230 analyzes the current scene image transmitted by the signal monitoring module. A trained artificial intelligence machine model is pre-stored in the signal analysis module 230. The artificial intelligence machine model can be preset in the camera before leaving the factory, or can be imported into the camera by the terminal device. The artificial intelligence machine model performs model analysis on the monitored scene image to determine the camera signal corresponding to the current scene image.

[0055] Preferably, multiple artificial intelligence machine models are provided in the signal analysis module, and each artificial intelligence machine model can identify a corresponding type of camera signal, for example, model A is used for behavior analysis and recognition, model B is used for face recognition, model C is used for license plate recognition, etc.

[0056] Specifically, the training method of the artificial intelligence machine model includes:

[0057] Collect a large number of training samples in advance. The training samples can be images / videos related to the event to be identified collected from any means, such as images / videos found on the Internet, images / videos taken manually, etc.

[0058] Extract data features from training samples to obtain a data feature set;

[0059] Taking the behavior analysis training sample as an example, the data features extracted from the behavior analysis training sample include but are not limited to spatiotemporal features, motion features, appearance features, audio features, environmental features, physiological features, etc. The spatiotemporal features are to analyze the changes in behavior over time and the position characteristics of objects or people in space; the motion features are the changes in the movement speed and acceleration of objects or people and the movement trajectory, reflecting the dynamic characteristics of the behavior; the appearance features are the shape, outline, color, etc. of objects or people; the audio features are the size and frequency distribution of the sound; the environmental features are the lighting, humidity, temperature and other characteristics of the surrounding environment; the physiological characteristics are to extract the heart rate, breathing rate, skin conductivity and other characteristics, reflecting the emotions and state of the person.

[0060] The data feature set is divided into a training set, a validation set, and a test set. The training set is input into the artificial intelligence machine model for training. The validation set is used to evaluate the model performance and adjust the model parameters accordingly. The test set is used to evaluate the generalization ability of the model, so as to train an artificial intelligence machine model that can identify predetermined events. Taking the behavior analysis artificial intelligence machine model as an example, the behavior analysis artificial intelligence machine model can be used to analyze whether fighting and other behaviors have occurred in the current environment. For the face recognition artificial intelligence machine model, it can identify specific people by training the facial features of one or some specific people. For the license plate recognition and other artificial intelligence machine models, it trains a large number of license plate edge features, color features, etc., and classifies them through machine learning algorithms to identify the license plate area, and then segment and recognize the characters in the license plate area to obtain the license plate logo.

[0061] In the embodiment of the present invention, various artificial intelligence machine models set in the signal analysis module can identify specific events, and the identified events are compared with the condition objects of the linkage events in the signal storage module one by one.

[0062] (4) Signal execution module 240

[0063] After comparing the camera signal identified by the signal analysis module 230 with the conditional object of the linkage event in the signal storage module, check the number of conditional objects in the linkage event. If the event contains only one conditional object and satisfies the properties of the conditional object, execute the result object of the linkage event. If the linkage event includes multiple result objects, these result objects are executed in parallel / sequentially according to their set properties.

[0064] (5) Signal output module 250

[0065] After the signal execution module 240 executes the linkage event, it may also include: if the transmission conditions are met, sending the linkage event occurrence log to the user's mobile device through the signal output module 250 for the user to view, and issuing a prompt on the mobile device.

[0066] In addition, the camera also includes a device linkage interface, which supports seamless connection with other devices such as smart home systems and security systems. Through mobile devices, cross-device linkage control between the camera and other devices can be achieved. For example, a linkage event between the camera signal and the access control switch can be set in the mobile device. When the camera detects the entry of a predetermined person, the access control system will be automatically opened or closed to realize face recognition door opening, etc.

[0067] The following are some examples of camera input and output signal pairing (only some examples, the following table mainly shows the number and matching relationship of several camera input signals and camera output signals in the linkage event, the actual pairing situation is mainly based on user needs and system requirements):

[0068]

[0069] Embodiment 2

[0070] like Figure 3 As shown, Embodiment 2 of the present invention provides a camera linkage system working method, including:

[0071] Step 310: store one or more linkage events consisting of a camera input signal and a camera output signal in the camera, wherein the linkage event is a preset linkage event, or a linkage event created by a user in a control device by pairing the camera input signal with the camera output signal in real time, and then importing the event into the camera from the control device.

[0072] Step 320: receiving the captured image fed back by the camera device in the camera, performing intelligent analysis on the captured image based on the artificial intelligence machine model, and identifying the corresponding camera signal;

[0073] Step 330: compare the identified camera signal with the camera input signal in the stored linkage event. If a linkage event is matched and all camera input signals in the linkage event are satisfied, trigger the execution of all camera output signals in the linkage event.

[0074] Corresponding to the above embodiment, an embodiment of the present invention provides a computer storage medium, including: at least one memory and at least one processor;

[0075] The memory is used to store one or more program instructions;

[0076] The processor is used to run one or more program instructions to execute a camera linkage system working method.

[0077] Corresponding to the above-mentioned embodiment, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer storage medium contains one or more program instructions, and the one or more program instructions are used by a processor to execute a camera linkage system working method.

[0078] The embodiment disclosed in the present invention provides a computer-readable storage medium, in which computer program instructions are stored. When the computer program instructions are executed on a computer, the computer executes the above-mentioned camera linkage system working method.

[0079] In the embodiment of the present invention, the processor may be an integrated circuit chip having the ability to process signals. The processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0080] The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present invention can be directly embodied as a hardware decoding processor for execution, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The processor reads the information in the storage medium and completes the steps of the above method in combination with its hardware.

[0081] The storage medium may be a memory, which may be, for example, a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory.

[0082] Among them, the non-volatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.

[0083] The volatile memory may be a random access memory (RAM) which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus DRAM (DRRAM).

[0084] The storage media described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memory.

[0085] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the present invention can be implemented using a combination of hardware and software. When software is used, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. Storage media can be any available media that can be accessed by general or special-purpose computers.

[0086] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solution of the present invention should be included in the scope of protection of the present invention.

Claims

1. A camera, characterized in that: include: A camera device and a signal control device; the signal control device includes a linkage event storage module, a signal monitoring module, a signal analysis module, a signal execution module and a signal output module; A linkage event storage module, used to store linkage events consisting of camera input signals and camera output signals; A signal monitoring module is used to establish a connection relationship with the camera device, receive a camera signal fed back by the camera device, that is, the camera lens captures the current scene image, and transmit the received current scene image to the signal analysis module; The signal analysis module is used to analyze the current scene picture transmitted by the signal monitoring module based on a pre-trained artificial intelligence machine model to determine the camera signal corresponding to the current scene picture; The signal execution module is used to compare the camera signal identified by the signal analysis module with the camera input signal of the linkage event in the signal storage module. If all camera input signals in the matching linkage event are satisfied, all camera output signals of the linkage event are executed.

2. A camera as claimed in claim 1, characterized in that: The linkage event storage module stores one or more linkage events, which are one or more linkage events preset in the camera when it leaves the factory, or one or more linkage events imported from the control device in real time for subsequent signal comparison.

3. A camera as claimed in claim 2, characterized in that: A linkage event includes one or more camera input signals and one or more camera output signals.

4. A camera as claimed in claim 1, characterized in that: The signal analysis module pre-stores a trained artificial intelligence machine model, which is preset in the camera before leaving the factory or imported into the camera by a terminal device.

5. A camera as claimed in claim 4, characterized in that: The camera supports connecting to other devices and setting linkage events between camera signals and control signals of other devices. When the camera signal in the linkage event is detected, the control signals of other devices are triggered to execute.

6. A camera system, characterized in that: The camera according to any one of claims 1 to 5 further comprises a control device; a signal linkage system is arranged in the control device, and the signal linkage system specifically comprises a signal display interface, a signal selection module, a signal linkage event creation module and a device output module; The signal display interface provides a programming interface that is easy to understand and program for users, and various programming components are displayed in the programming interface, including a camera input signal condition component, a camera output signal result component, and a linkage event component; The signal selection module is used to receive the user's selection of the camera input signal in the condition component on the display screen, and receive the user's selection of the camera output signal in the result component on the display screen; The signal linkage event creation module establishes a linkage event with the camera input signal and the camera output signal selected by the user in the signal selection module; The device output module is used to send the linkage event created by the signal linkage event creation module to the camera.

7. A camera system as claimed in claim 6, characterized in that: The signal selection module includes a conditional object selection submodule and a result object selection submodule. Property settings can be performed in both the object selection submodule and the result object selection submodule. When a user selects an object on the display screen, the currently selected object is recorded. If the user's property settings for the currently selected object are received, a corresponding relationship between the currently selected object and the property is established, and the entire object is used as an execution item of the event.

8. A camera system as claimed in claim 6, characterized in that: The connection relationship between the device output module and the camera is a wired connection or a wireless connection, or a connection is made through other media, so as to import the created linkage event into the camera.

9. A camera operation method, characterized in that: include: One or more linkage events consisting of a camera input signal and a camera output signal are stored in the camera, wherein the linkage event is a preset linkage event or a linkage event created by a user in real time pairing the camera input signal and the camera output signal in the control device, and then imported into the camera from the control device; Receive the shooting picture fed back by the camera device in the camera, perform intelligent analysis on the shooting picture based on the artificial intelligence machine model, and identify the corresponding camera signal; The identified camera signal is compared with the camera input signal in the stored linkage event. If a linkage event is matched and all camera input signals in the linkage event are satisfied, all camera output signals in the linkage event are triggered to execute.

Images