Multi-camera automatic identification USB camera device

Abstract

The invention discloses a multi-camera automatic identification USB camera device, and relates to the field of data identification, the multi-camera automatic identification USB camera device comprises a camera shooting part, a central control module and a connecting part, the camera shooting part is installed at the top end of the central control module, the connecting part is installed at the bottom end of the central control module, the camera shooting part is used as an execution part for image shooting, and the central control module is connected with the central control module. Performing MIPI access of a plurality of cameras; the central control module is used as a carrying end of each functional module and each functional component, and is used for automatically identifying an image connection scene, loading a parameter configuration file of a camera accessed to the camera component, and automatically acquiring and applying an image picture adjustment scheme adaptive to the current scene; by automatically identifying the accessed camera and the image display device and loading the corresponding parameter configuration file according to the unique ID and the type information of the device, a user does not need manual intervention, automatic identification and parameter loading functions, and manual intervention and configuration time can be reduced, so that the use complexity is reduced, and the use threshold is lowered.

Description

Technical Field

[0001] The present invention relates to the technical field of data recognition, and specifically to a USB camera device for multi-camera automatic recognition. Background Art

[0002] The widespread use of USB interfaces in modern devices has made the connection and operation of external devices fast and convenient. USB cameras are favored for their easy access and high versatility. With the rapid development of technology, it has become possible to interconnect devices, and various camera technologies and image processing methods have emerged continuously, promoting the creation and processing of high-quality visual content and enhancing the demand for smart devices. For example, in the medical field, doctors need multi-perspective images to assist in diagnosis, especially during surgeries and imaging examinations, where rapid configuration and adjustment of imaging devices are required so that doctors can obtain the best image quality.

[0003] In existing multi-camera systems, users often need to manually configure the parameters of each camera to adapt to different scenarios and requirements. This manual configuration is not only cumbersome but also error-prone, especially when scenes or devices need to be frequently changed. Moreover, it usually lacks the ability to recognize and adapt to environmental and scene changes in real time. When environmental conditions or display devices change, the system cannot automatically adjust parameters to optimize image quality, resulting in a decline in user experience. Most of the existing automatic adjustment mechanisms are based on fixed algorithms and do not comprehensively consider the key frame features and content features in specific scenarios. When the image quality is not ideal, there is a lack of a dynamic adjustment scheme based on user preset goals, thus affecting the final image effect.

[0004] Many existing camera devices are inefficient in connecting and recognizing new devices and cannot quickly adapt to new imaging display devices. This inefficient connectivity can lead to delays and unnecessary downtime. Summary of the Invention

[0005] (1) Technical problems to be solved: Aiming at the above-mentioned shortcomings of the prior art, the present invention provides a USB camera device for multi-camera automatic recognition, which can effectively solve the problems of the prior art.

[0006] (2) Technical solutions: To achieve the above purposes, the present invention is realized through the following technical solutions. The present invention discloses a USB camera device for multi-camera automatic recognition, including a camera component, a central control module, and a connection component. The camera component is installed on the top of the central control module, and the connection component is installed on the bottom of the central control module, where: The camera component, as the execution component for image capture, performs MIPI access for several cameras. The central control module, as the carrier for various functional modules and components, automatically identifies the image connection scenario, loads the parameter configuration file of the camera of the connected imaging component, and automatically obtains and applies the image screen adjustment scheme adapted to the current scenario. The connection component, as the connection carrier, inserts and removes the external USB interface.

[0007] Furthermore, there are sub-modules deployed under the central control module, and the sub-modules include: The control module is used for editing and submitting machine control instructions and obtaining access rights to external medical imaging devices. The parameter storage module, as the central database for capturing and analyzing data, is used to store the parameter configuration files corresponding to each camera in the imaging component under different imaging display devices and scenarios, and assigns several tags and classifies the historical image screen adjustment schemes. The automatic recognition module is used to recognize the newly connected imaging display device of the connection component, assign a certain camera connected to the imaging component, read the unique ID and device type information of the camera through the USB communication protocol, and automatically call the parameter configuration file of the corresponding camera according to the recognized camera information. The environment capture module is used to obtain the screen state and content state in the current environment and extract key screen features and content features. The screen adjustment module is used to analyze and process based on the extracted key screen features and content features, and generate a dynamic image screen adjustment scheme for several modes based on the current imaging display device according to the user's preset target. The mode switching module is used to adjust the original parameter configuration file according to the adjustment scheme of the mode when the user selects a certain specific mode, and apply the adjusted parameter configuration file to the current camera and imaging display device.

[0008] Furthermore, the control module is interconnected with a hot plug detection module through a wired network. The hot plug detection module is used to judge whether the connection component is inserted or removed by the change of voltage or current, generate an insertion or removal event. After the insertion event is triggered, query the information of the connected imaging display device, and automatically load the corresponding parameter configuration file according to the device information. When the removal event is triggered, inform the central control module to stop interacting with this imaging display device.

[0009] Furthermore, the environment capture module is interconnected with a similarity matching module through a wired network. The similarity matching module is interconnected with a parameter storage module through a wired network. The similarity matching module is configured to obtain the key frame features and content features of the environment capture data output by the environment capture module, perform tagging processing, output a plurality of tags, index the plurality of output tags in the database of the parameter storage module, and obtain a historical image frame adjustment scheme with an overall tag similarity higher than a preset threshold. If the indexing is successful, it jumps to the mode switching module for further operation. If the indexing fails, it jumps to the frame adjustment module for further operation.

[0010] Furthermore, the mode switching module is interconnected with a feedback module through a wired network. The feedback module is configured to obtain the real-time status of the current image frame adjustment scheme in real time, provide a feedback channel, and determine whether the current settings meet the user's requirements based on the feedback information. If the user feedback is dissatisfied, the application of the current image frame adjustment scheme is aborted, and it jumps back to the environment capture module for further operation. If the user feedback is satisfied, the current image frame adjustment scheme is used as available data and submitted to the parameter storage module for storage.

[0011] Furthermore, the attributes of the camera parameter configuration file in the central control module include: resolution, frame rate, exposure rate, and contrast.

[0012] Furthermore, the dynamic image frame adjustment scheme in the frame adjustment module is obtained by calculating an adjustment score. The calculation expression of the adjustment score is as follows: ; where represents the adjustment score of the parameter vector of the i-th adjustment scheme P, represents the number of key frame features, represents the k-th feature in the key frame feature set, represents the k-th key frame feature value under the adjustment scheme , represents the weight of the key frame feature , represents the number of content features, represents the j-th feature in the content feature set, represents the j-th content feature value under the adjustment scheme , represents the weight of the content feature , represents the weight coefficient of the distance between the adjustment user target and the adjustment scheme, represents the user target vector, represents the Euclidean distance between the user target vector and the current adjustment scheme.

[0013] Furthermore, the working logic of the adjustment score calculation expression is as follows: Calculate the weighted sum of all key screen features under the current adjustment scheme; Calculate the weighted sum of all content features under the current adjustment scheme; Calculate the distance between the user's preset target and the current adjustment scheme; Output the optimal adjustment scheme.

[0014] Furthermore, both the camera component and the connection component support TYPE-C connection.

[0015] Furthermore, the control module is interactively connected to the parameter storage module and the automatic recognition module through an electrical medium. The automatic recognition module is interactively connected to the environment capture module through an electrical medium. The environment capture module is interactively connected to the screen adjustment module and the mode switching module through an electrical medium.

[0016] (III) Beneficial effects: By adopting the technical solution provided by the present invention, compared with the known prior art, the following beneficial effects are achieved: 1. By automatically recognizing the connected camera and video display device and loading the corresponding parameter configuration file according to the unique ID and type information of the device, the user does not need to manually intervene. The automatic recognition and parameter loading functions can reduce manual intervention and configuration time, thereby improving work efficiency, reducing usage complexity, and lowering the usage threshold.

[0017] 2. By analyzing the screen features and content features, the system can generate multiple dynamic video adjustment schemes, and then evaluate and select the optimal scheme. It can automatically adjust the parameters according to environmental changes and user needs. The system can adaptively adjust the parameters to ensure that the video quality is always in the optimal state.

[0018] 3. Through historical data analysis, the system can quickly locate and apply the previously successful parameter configurations, improving the intelligence level of subsequent operations. Through the real-time feedback mechanism, the module mode switching module and the feedback module provide user satisfaction feedback, judge the current settings. If the user is not satisfied, the system can quickly reset, providing better adaptability and flexibility, and making the user experience more friendly. Description of the Drawings

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0020] Figure 1Schematic front view structure diagram of the present invention; Figure 2 Schematic top view structure diagram of the present invention; Figure 3 Schematic framework diagram of the present invention; Figure 4 Schematic circuit distribution diagram of the camera component in the present invention.

[0021] The reference numerals in the figure respectively represent: 1. Camera component; 2. Central control module; 21. Management and control module; 22. Parameter storage module; 23. Automatic identification module; 24. Environment capture module; 25. Picture adjustment module; 26. Mode switching module; 27. Feedback module; 28. Similarity matching module; 29. Hot plug detection module; 3. Connection component. Detailed implementation manners

[0022] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0023] The present invention will be further described below with reference to the embodiments.

[0024] Embodiment 1: A USB camera device with multi-camera automatic identification in this embodiment, as Figures 1 - 3 shown, includes a camera component 1, a central control module 2 and a connection component 3. The camera component 1 is installed at the top of the central control module 2, and the connection component 3 is installed at the bottom of the central control module 2, wherein: The camera component 1, as the execution component for image shooting, performs MIPI access for several cameras; enhances the flexibility and adaptability of the system, and can adjust the used cameras according to different scene requirements; the circuit distribution of the camera component 1 is as Figure 4 shown.

[0025] The central control module 2, as the carrier for each functional module and functional component, automatically identifies the image connection scenario, loads the parameter configuration file of the camera accessing the camera component 1, and automatically obtains and applies the image picture adjustment scheme adapted to the current scene; the attributes of the camera parameter configuration file include: resolution, frame rate, exposure rate and contrast; reduces manual intervention and improves the intelligence level of the system.

[0026] The central control module 2 is hierarchically deployed with sub-modules, and the sub-modules include: The control module 21 is used for editing and submitting machine control instructions and obtaining access rights to external medical imaging devices. The control module 21 is interconnected with a hot-swap detection module 29 through a wired network. The hot-swap detection module 29 is used to judge whether the connected component 3 is inserted or removed by the change of voltage or current, generate an insertion or removal event. After the insertion event is triggered, query the information of the connected imaging display device, and automatically load the corresponding parameter configuration file according to the device information. When the removal event is triggered, inform the central control module 2 to stop interacting with this imaging display device.

[0027] The parameter storage module 22, as the central database for capturing and analyzing data, is used to store the parameter configuration files corresponding to each camera in the imaging component 1 under different imaging display devices and scenarios, and assign several labels and classify the historical image adjustment schemes.

[0028] The automatic recognition module 23 is used to recognize the newly connected imaging display device of the connected component 3, and assign a certain camera connected to the imaging component 1. Read the unique ID and device type information of this camera through the USB communication protocol, and automatically call the parameter configuration file of the corresponding camera according to the recognized camera information.

[0029] The environment capture module 24 is used to obtain the picture state and content state in the current environment, and extract key picture features and content features. The environment capture module 24 is interconnected with a similarity matching module 28 through a wired network. The similarity matching module 28 and the parameter storage module 22 are interconnected through a wired network. The similarity matching module 28 is used to obtain the key picture features and content features of the environment capture data output by the environment capture module 24, perform tagging processing, output several labels, index the output several labels in the database of the parameter storage module 22, and obtain a historical image adjustment scheme with an overall label similarity higher than the preset threshold. If the indexing is successful, jump to the mode switching module 26 for further operation. If the indexing is not successful, jump to the picture adjustment module 25 for further operation.

[0030] The picture adjustment module 25 is used to analyze and process based on the extracted key picture features and content features, and generate a dynamic image adjustment scheme for several modes based on the current imaging display device according to the user's preset target.

[0031] The mode switching module 26 is used to adjust the original parameter configuration file according to the adjustment plan of a specific mode when the user selects a certain mode, and apply the adjusted parameter configuration file to the current camera and image display device; the mode switching module 26 is connected to a feedback module 27 through a wired network. The feedback module 27 is used to obtain the real-time status of the current image adjustment plan in real time, provide a feedback channel, and judge whether the current setting meets the user's needs according to the feedback information. If the user feedback is not satisfactory, the application of the current image adjustment plan is aborted, and it jumps back to the environment capture module 24 to further run. If the user feedback is satisfactory, the current image adjustment plan is used as available data and submitted to the parameter storage module 22 for storage.

[0032] The connecting component 3, as a connecting carrier, inserts and removes the external USB interface.

[0033] Both the camera component 1 and the connecting component 3 support TYPE-C connection.

[0034] As an implementation method in this embodiment, as Figure 3 shown, the control module 21 is connected to the parameter storage module 22 and the automatic recognition module 23 through an electrical medium for interaction. The automatic recognition module 23 is connected to the environment capture module 24 through an electrical medium for interaction. The environment capture module 24 is connected to the image adjustment module 25 and the mode switching module 26 through an electrical medium for interaction.

[0035] Compared with the prior art, through automatic recognition and parameter configuration, manual intervention is reduced, the convenience and efficiency of operation are improved, it can be flexibly configured according to actual needs, the system settings can be fed back in real time to ensure that the output effect meets the requirements, and the user experience is enhanced. Through the tagged management of the database, the system can quickly apply the historical image adjustment plan to improve work efficiency and accuracy.

[0036] Embodiment 2: On other levels, this embodiment also provides a calculation method for the adjustment score of a dynamic image adjustment plan. The specific calculation expression is: ; In the formula, represents the adjustment score of the parameter vector of the i-th adjustment plan P to evaluate the effect of the plan, to evaluate the effect of the plan, represents the number of key image features, represents the k-th feature in the set of key image features, including color distribution, contrast, brightness, and edge sharpness features. Such features are indicators extracted from the image to describe the image quality. represents the k-th key image feature value under the adjustment plan ; represents the key image feature weight, Represents the number of content features Represents the j-th feature in the set of content features Represents the adjustment plan The j-th content feature value under the adjustment plan Represents the content feature Weight Represents the weight coefficient for adjusting the distance between the user's target and the adjustment plan, which is used to adjust the influence degree of the deviation on the score Represents the user's target vector, including resolution, frame rate, exposure rate, and contrast Represents the Euclidean distance between the user's target vector and the current adjustment plan, indicating the deviation of the plan from the target

[0037] As a preferred implementation manner in this embodiment, the working logic for adjusting the score calculation expression is as follows: Calculate the weighted sum of all key frame features under the current adjustment plan Calculate the weighted sum of all content features under the current adjustment plan Calculate the distance between the user's preset target and the current adjustment plan Output the best adjustment plan

[0038] The above formula combines key frame features, content features, and the user's target, enabling the evaluation to be based not only on a single feature but also on multiple factors comprehensively. Furthermore, it ensures that the image adjustment plan can perform evenly in different dimensions, allowing the system to adaptively adjust parameters according to the current environment and content. Through real-time analysis and feedback, the system can optimize the adjustment plan at any time to cope with changing shooting scenarios and user needs

[0039] In summary, the present invention can automatically identify the connected camera and image display device without manual setting or configuration by the user, reducing the operation complexity. When a new device is connected, the system can quickly load the corresponding parameter configuration file, shortening the setting time and enabling the device to be quickly put into use. By performing real-time analysis based on key frame features and content features, it can dynamically optimize image parameters to achieve higher-quality image capture, and can automatically adjust the camera settings according to environmental changes to ensure the best imaging effect in different scenarios

[0040] By extracting key features and content features, a dynamic image adjustment plan is generated to improve image quality and content adaptability. By utilizing historical data, the system can quickly apply effective adjustment plans based on historical data. The user can preset the target according to their own needs, and the system can automatically optimize the parameters according to the target, effectively improving user satisfaction

[0041] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A USB camera device for multi-camera automatic recognition, characterized in that, It includes a camera component (1), a central control module (2), and a connection component (3). The camera component (1) is installed at the top of the central control module (2), and the connection component (3) is installed at the bottom of the central control module (2). Among them: The camera component (1), as the execution component for image capture, performs MIPI access for several cameras; The central control module (2), as the carrier for each functional module and functional component, automatically identifies the image connection scenario, loads the parameter configuration file of the cameras connected to the camera component (1), and automatically obtains and applies the image screen adjustment scheme adapted to the current scenario; The connection component (3), as the connection carrier, inserts and removes the external USB interface.

2. The USB camera device for multi-camera automatic recognition according to claim 1, characterized in that, There are sub-modules deployed at the lower level of the central control module (2). The sub-modules include: The control module (21) is used for editing and submitting machine control instructions and obtaining access rights to external medical imaging devices; The parameter storage module (22), as the central database for capturing and analyzing data, is used to store the parameter configuration files corresponding to each camera in the camera component (1) under different imaging display devices and scenarios, and assigns several tags and classifies the historical image screen adjustment schemes; The automatic recognition module (23) is used to recognize the newly connected imaging display device of the connection component (3), assign a certain camera connected to the camera component (1), read the unique ID and device type information of the camera through the USB communication protocol, and automatically call the corresponding parameter configuration file of the camera according to the recognized camera information; The environment capture module (24) is used to obtain the picture state and content state in the current environment and extract key picture features and content features; The picture adjustment module (25) is used to perform analysis and processing based on the extracted key picture features and content features, and generate a dynamic image screen adjustment scheme for several modes based on the current imaging display device according to the user's preset target; The mode switching module (26) is used to adjust the original parameter configuration file according to the adjustment scheme of a certain specific mode when the user selects a certain specific mode, and apply the adjusted parameter configuration file to the current camera and imaging display device.

3. The USB camera device for multi-camera automatic recognition according to claim 2, wherein, The control module (21) is connected to a hot plug detection module (29) through a wired network. The hot plug detection module (29) is used to judge whether the connection component (3) is inserted or removed by the change of voltage or current, generate an insertion or removal event. After the insertion event is triggered, query the information of the connected imaging display device, and automatically load the corresponding parameter configuration file according to the device information. When the removal event is triggered, inform the central control module (2) to stop interacting with this imaging display device.

4. The USB camera device for multi-camera automatic recognition according to claim 2, characterized in that, The environment capture module (24) is interconnected with a similarity matching module (28) via a wired network. The similarity matching module (28) is interconnected with a parameter storage module (22) via a wired network. The similarity matching module (28) is used to obtain the key frame features and content features of the environment capture data output by the environment capture module (24), perform tagging processing, output a number of tags, index the output tags in the database of the parameter storage module (22), obtain a historical image frame adjustment scheme with an overall tag similarity higher than a preset threshold. If the indexing is successful, it jumps to the mode switching module (26) for further operation. If the indexing is not successful, it jumps to the frame adjustment module (25) for further operation.

5. The USB camera device for multi-camera automatic recognition according to claim 2, characterized in that, The mode switching module (26) is interconnected with a feedback module (27) via a wired network. The feedback module (27) is used to obtain the real-time state of the current image frame adjustment scheme in real time, provide a feedback channel, and judge whether the current setting meets the user's needs according to the feedback information. If the user feedback is not satisfied, the application of the current image frame adjustment scheme is aborted and it jumps back to the environment capture module (24) for further operation. If the user feedback is satisfied, the current image frame adjustment scheme is used as available data and submitted to the parameter storage module (22) for storage.

6. The USB camera device for multi-camera automatic recognition according to claim 1, characterized in that, The attributes of the camera parameter configuration file in the central control module (2) include: resolution, frame rate, exposure rate, and contrast.

7. The USB camera device for multi-camera automatic recognition according to claim 2, characterized in that, In the screen adjustment module (25), the dynamic video screen adjustment scheme is obtained by calculating the adjustment score, and the calculation expression of the adjustment score is as follows: ; In the formula, represents the adjustment score of the parameter vector of the i-th adjustment scheme P, represents the number of key screen features, represents the k-th feature in the key screen feature set, represents under the adjustment scheme the k-th key screen feature value, represents the key screen feature weight, represents the number of content features, represents the j-th feature in the content feature set, represents under the adjustment scheme the j-th content feature value, represents the content feature weight, represents the weight coefficient of the distance between the adjustment user target and the adjustment scheme, represents the user target vector, represents the Euclidean distance between the user target vector and the current adjustment scheme.

8. The USB camera device for multi-camera automatic recognition according to claim 7, wherein, The working logic of the adjustment score calculation expression is as follows: Calculate the weighted sum of all key frame features under the current adjustment scheme; Calculate the weighted sum of all content features under the current adjustment scheme; Calculate the distance between the user's preset target and the current adjustment scheme; Output the optimal adjustment scheme.

9. The USB camera device for multi-camera automatic recognition according to claim 1, characterized in that Both the camera component (1) and the connection component (3) support TYPE-C connection.

10. The USB camera device for multi-camera automatic recognition according to claim 2, characterized in that, The control module (21) is interconnected with the parameter storage module (22) and the automatic recognition module (23) via an electrical medium. The automatic recognition module (23) is interconnected with the environment capture module (24) via an electrical medium. The environment capture module (24) is interconnected with the frame adjustment module (25) and the mode switching module (26) via an electrical medium.

Images