Camera system, image acquisition method, and display device
By designing a camera system that includes a two-dimensional pan/tilt and audio collector, the problem of blind spots of TV cameras in large scene environments is solved, flexible tracking of sound sources and high-quality image collection are achieved, and the application of display devices is expanded. Application scenarios.
Patent Information
- Application Number
- PCT/CN2024/091230
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-17
- Filing Date
- 2024-05-06
- Publication Date
- 2025-01-23
AI Technical Summary
The field angle of existing TV cameras is small, resulting in large blind spots in large scene environments and cannot meet the needs of scenes.
A camera system is designed, including camera components, audio collectors, image processors, and two -dimensional gimbal. The azimal information of the sound source is obtained through audio signals, and the two -dimensional gimbal platform is controlled to drive the camera component to rotate Track photography.
It effectively expands the application scenarios of display devices, solves the problem of blind spots in viewing angles in large scene environments, and achieves flexible tracking of sound sources and high-quality image collection.
Smart Images

Figure CN2024091230_23012025_PF_FP_ABST
Abstract
Description
Camera system, image acquisition method and display device
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on July 17, 2023, with application number 202310878101.8 and application name “A camera system, image acquisition method and display device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of camera technology, and in particular to a camera system, an image acquisition method, and a display device. Background Art
[0003] Currently, there are more and more application scenarios for cameras on TVs, such as taking pictures, video conferencing, entertainment and fitness, somatosensory games, AI recognition, etc. Technical issues
[0004] However, the TV cameras currently on the market all have ordinary FOV (Field of view). Due to their small FOV, there will be large blind spots when using TV cameras in large scene environments, which cannot meet the scene requirements. Technical Solutions
[0005] The purpose of this application is to provide a camera system, an image acquisition method and a display device to alleviate the technical problem of blind spots in camera imaging in large scene environments, thereby effectively expanding the application scenarios of the display device.
[0006] The present application provides a camera system, comprising a camera assembly, an audio collector, an image processor and a two-dimensional pan-tilt platform; the audio collector is connected to the image processor; the camera assembly is connected to the two-dimensional pan-tilt platform and the image processor;
[0007] The audio collector is used to collect audio signals and output the audio signals to the image processor; the image processor is used to obtain the azimuth information of the sound source corresponding to the audio signal based on the audio signal, and control the two-dimensional pan-tilt head to drive the camera assembly to rotate according to the azimuth information so that the sound source falls within the shooting range of the camera assembly; the camera assembly is used to collect images of the sound source; and the image processor is also used to perform image processing on the image information collected by the camera assembly.
[0008] In some embodiments of the camera system, the camera component includes an optical zoom camera, which is used to automatically identify the distance from the sound source and automatically zoom in according to the distance to capture an image of the sound source.
[0009] In some embodiments, the camera system includes a dual camera assembly, which includes a wide-angle camera and a telephoto camera. The image processor is also used to determine the distance between the dual cameras and the sound source based on the orientation information, and control the wide-angle camera or the telephoto camera to collect image information of the sound source based on the distance.
[0010] In some embodiments of the camera system, the camera component includes a dual camera, which includes a fisheye camera and an optical zoom camera; the image processor is also used to determine the distance from the sound source based on the orientation information, and control the fisheye camera or the optical zoom camera to collect image information of the sound source based on the distance.
[0011] In some embodiments of the camera system, the optical zoom camera is specifically used to automatically zoom to the wide-angle end to capture an image of the sound source when the interval distance is greater than a preset range, or automatically zoom to the telephoto end to capture an image of the sound source when the interval distance is less than a preset range.
[0012] In the camera system of some embodiments, the image processor is specifically used to control the telephoto camera to collect image information of the sound source when the interval distance is greater than a preset range; the image processor is specifically used to control the wide-angle camera to collect image information of the sound source when the interval distance is less than a preset range.
[0013] In the camera system of some embodiments, the image processor is specifically used to control the optical zoom camera to collect image information of the sound source when the interval distance is greater than a preset range; the image processor is specifically used to control the fisheye camera to collect image information of the sound source when the interval distance is less than a preset range.
[0014] In the camera system of some embodiments, the audio collector is specifically used to collect audio signals every first preset time.
[0015] In some embodiments of the camera system, the image processor is further configured to control the two-dimensional pan-tilt head to reset if no audio signal is received within a second preset time and no facial information is detected in the received image information.
[0016] The present application also provides an image acquisition method, which is applied to a camera system. The image acquisition method includes:
[0017] Obtaining the audio signal of the sound source;
[0018] Obtaining the position information of the corresponding sound source according to the audio signal, and controlling the two-dimensional pan-tilt head to drive the camera assembly to rotate according to the position information so that the sound source falls into the shooting range of the camera assembly;
[0019] Obtain image information collected by the camera component and perform image processing on the image information.
[0020] In some embodiments, the image acquisition method includes a camera assembly including an optical zoom camera; and the method for acquiring image information captured by the camera assembly includes:
[0021] Obtain image information collected by an optical zoom camera after automatic zooming based on the distance from the sound source.
[0022] In some embodiments, the image acquisition method includes a camera assembly including a dual camera, the dual camera including a wide-angle camera and a telephoto camera; and the method for acquiring image information captured by the camera assembly includes:
[0023] Obtain the distance between the dual cameras and the sound source based on the position information;
[0024] When the separation distance is greater than the preset range, the image information of the sound source captured by the telephoto camera is obtained;
[0025] When the interval distance is less than the preset range, the image information of the sound source collected by the wide-angle camera is obtained.
[0026] In some embodiments, the image acquisition method includes a camera assembly including a dual camera, the dual camera including a fisheye camera and an optical zoom camera; and the method for acquiring image information captured by the camera assembly includes:
[0027] Obtain the distance between the dual cameras and the sound source based on the position information;
[0028] When the separation distance is greater than a preset range, image information of the sound source captured by the optical zoom camera is obtained;
[0029] When the interval distance is less than the preset range, the image information of the sound source collected by the fisheye camera is obtained.
[0030] The embodiment of the present application further provides a display device, comprising a display screen and a camera system, wherein the display screen is connected to an image processor, and the display screen is used to display image information output by the camera system;
[0031] The camera system includes a camera component, an audio collector, an image processor and a two-dimensional pan-tilt platform; the audio collector is connected to the image processor; the camera component is connected to the two-dimensional pan-tilt platform and the image processor;
[0032] The audio collector is used to collect audio signals and output the audio signals to the image processor; the image processor is used to obtain the azimuth information of the sound source corresponding to the audio signal based on the audio signal, and control the two-dimensional pan-tilt head to drive the camera assembly to rotate according to the azimuth information so that the sound source falls within the shooting range of the camera assembly; the camera assembly is used to collect images of the sound source; and the image processor is also used to perform image processing on the image information collected by the camera assembly.
[0033] In some embodiments of the display device, the camera assembly includes an optical zoom camera, which is used to automatically identify the distance from the sound source and automatically zoom in according to the distance to capture an image of the sound source.
[0034] In some embodiments of the display device, the camera assembly includes a dual camera, and the dual camera includes a wide-angle camera and a telephoto camera; the image processor is also used to determine the distance between the dual camera and the sound source based on the orientation information, and control the wide-angle camera or the telephoto camera to collect image information of the sound source based on the distance.
[0035] In some embodiments of the display device, the camera component includes a dual camera, which includes a fisheye camera and an optical zoom camera; the image processor is also used to determine the distance from the sound source based on the orientation information, and control the fisheye camera or the optical zoom camera to collect image information of the sound source based on the distance.
[0036] In the display device of some embodiments, the optical zoom camera is specifically used to automatically zoom to the wide-angle end to capture an image of the sound source when the interval distance is greater than a preset range, or automatically zoom to the telephoto end to capture an image of the sound source when the interval distance is less than a preset range.
[0037] In some embodiments, the display device is a conference tablet having a display screen, two side frames around the display screen, and an upper frame and a lower frame. The camera assembly and the two-dimensional pan-tilt head are arranged on the top of the upper frame, and the audio collector is arranged inside the upper frame.
[0038] In some embodiments, the display device is a television having a display screen, two side frames arranged around the display screen, and an upper frame and a lower frame. The camera assembly and the two-dimensional pan-tilt head are arranged on the top of the upper frame, and the audio collector is arranged inside the upper frame. Beneficial effects
[0039] The camera system, image acquisition method and display device provided by the present application, the camera system controls the rotation of the two-dimensional pan-tilt head according to the audio signal to drive the rotation of the camera component to achieve tracking photography of the sound source; at the same time, since the rotation setting of the two-dimensional pan-tilt head can solve the blind spot problem of the display device in a large scene environment, the application scenario of the display device is expanded. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0041] FIG1 is a structural block diagram of a camera system in a display device provided in an embodiment of the present application.
[0042] FIG2 is a schematic diagram of the layout of the camera system in the display device provided in an embodiment of the present application.
[0043] FIG3 is a schematic diagram of a shooting area of a camera system in a display device provided in an embodiment of the present application.
[0044] FIG4 is a flowchart of the steps of the image acquisition method provided in an embodiment of the present application.
[0045] FIG5 is a first flow chart of step 300 in the image acquisition method provided in an embodiment of the present application.
[0046] FIG6 is a second flow chart of step 300 in the image acquisition method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0047] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.
[0048] In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance or implicitly indicating the number of technical features indicated. The features specified as "first" and "second" may explicitly or implicitly include one or more features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0049] Please refer to Figure 1. This embodiment provides a display device, which includes a display screen 10 and a camera system 20, wherein the camera system 20 includes a camera component 21, an audio collector 22, an image processor 23 and a two-dimensional pan-tilt head 24; the audio collector 22 is connected to the image processor 23; the camera component 21 is connected to the two-dimensional pan-tilt head 24 and the image processor 23, and the image processor 23 is also connected to the display screen 10.
[0050] During specific implementation, the audio collector 22 is used to collect audio signals and output the audio signals to the image processor 23; the image processor 23 is used to obtain the orientation information of the sound source corresponding to the audio signal based on the audio signal, and control the two-dimensional pan-tilt head 24 to drive the camera component 21 to rotate according to the orientation information, so that the sound source falls within the shooting range of the camera component 21; the camera component 21 is used to collect images of the sound source; the image processor 23 is also used to perform image processing on the image information collected by the camera component 21 and output it to the display screen 10, and the display screen 10 displays the image information output by the image processor 23.
[0051] In the display device in this embodiment, the camera system 20 controls the rotation of the two-dimensional pan-tilt head 24 according to the audio signal to drive the camera component 21 to rotate, so as to realize tracking photography of the sound source; at the same time, since the rotation setting of the two-dimensional pan-tilt head 24 can solve the blind spot problem of the viewing angle in the large scene environment of the display device, the application scenario of the display device is expanded.
[0052] The display device in this application can be a conference tablet, which integrates multiple functions such as television, computer, projector, electronic whiteboard, audio, video conferencing terminal, etc. It is suitable for group communication occasions and focuses on solving the systematic meeting needs such as remote audio and video communication in meetings, high-definition display of conference documents in various formats, video file playback, live audio, screen writing, as well as document annotation, storage, printing and distribution. It is widely used in education and teaching, corporate meetings, commercial exhibitions and other fields.
[0053] Please refer to Figure 2. The conference tablet in this embodiment has a display screen 10, two side frames and an upper frame and a lower frame arranged around the display screen 10, a camera assembly 21 and a two-dimensional pan-tilt head 24 are arranged on the top of the upper frame, and an audio collector 22 is arranged inside the upper frame. Usually, the two-dimensional pan-tilt head 24 and the camera assembly 21 are arranged in the middle position of the upper frame, and the corresponding audio collector 22 is also arranged in the middle position inside the upper frame. When the conference tablet in this application is used for classroom teaching, the image processor 23 tracks the azimuth information of the sound source based on the audio signal collected by the audio collector 22. In this embodiment, the sound source can be a classroom speaker. Afterwards, the image processor 23 controls the rotation of the two-dimensional pan-tilt head 24 based on the azimuth information to drive the camera assembly 21 to rotate, so that the sound source falls within the shooting range of the camera assembly 21, and tracks the speaker for image capture, thereby improving the flexibility of image capture and avoiding the blind spot problem in large scene environment shooting.
[0054] In some embodiments, the display device may also be a television, which has a display screen 10, two side frames and an upper frame and a lower frame arranged around the display screen 10, a camera component 21 and a two-dimensional pan-tilt head 24 are arranged on the top of the upper frame, and an audio collector 22 is arranged inside the upper frame; similarly, for the television, the image processor 23 can control the rotation of the two-dimensional pan-tilt head 24 according to the audio signal of the audio collector 22, and flexibly set the camera range of the camera component 21 to solve the blind spot problem of the viewing angle of the camera component 21, thereby expanding the application scenarios of the television.
[0055] In some embodiments, the display device may also be a commercial LCD display, such as an LCD advertising machine, a touch-sensitive integrated machine, an LCD splicing screen, an educational touch-sensitive integrated machine, an electronic class sign, an AI advertising machine, a customized commercial display, etc. Similarly, the two-dimensional pan-tilt platform 24 and the camera assembly 21 may be disposed on top of the upper frame of the commercial LCD display, and the audio collector 22 may be disposed within the upper frame near the camera assembly 21 to facilitate flexible adjustment of the camera assembly 21.
[0056] In some embodiments, the camera assembly 21 includes an optical zoom camera, which is used to automatically identify the distance from the sound source and automatically zoom in based on the distance to capture an image of the sound source. The image processor 23 determines the azimuth angle of the sound source based on the azimuth information. It then controls the rotation of the two-dimensional pan-tilt platform 24 based on this azimuth angle, driving the optical zoom camera to a position relative to the sound source to facilitate image capture of the sound source. The optical zoom camera then automatically identifies the distance between the current sound source and the camera, automatically zooming in and capturing the image, thereby ensuring the clarity of the captured image.
[0057] As an embodiment, the optical zoom camera is specifically configured to automatically zoom to the wide-angle end to capture an image of the sound source when the separation distance is greater than a preset range, or automatically zoom to the telephoto end to capture an image of the sound source when the separation distance is less than the preset range. This is equivalent to using the wide-angle end to capture an image when the separation distance is close, and using the telephoto end to capture an image when the separation distance is far. For example, as shown in FIG3 , the preset range in this embodiment is the area between the straight line where point A is located and the straight line where the dotted line is located; when the optical zoom camera detects a person in the first area ① or the second area ②, the optical zoom camera operates at the wide-angle end; the optical zoom camera electrical signal at the wide-angle end is also used during AI recognition; when the optical zoom camera detects a person in the third area ③ or the fourth area ④, the optical zoom camera operates at the telephoto end, and the optical zoom camera electrical signal at the telephoto end is also used during AI recognition. The default operating end of the optical zoom camera is the wide-angle end. In this embodiment, by providing an optical zoom camera, it is possible to adjust the wide-angle end or telephoto end for shooting according to the distance of the sound source, so as to ensure shooting at a longer distance and higher image quality clarity.
[0058] In some embodiments, the camera assembly 21 includes a dual camera, including a wide-angle camera and a telephoto camera. The image processor 23 is further configured to determine the distance between the dual cameras and the sound source based on the position information, and control the wide-angle camera or the telephoto camera to capture image information of the sound source based on the distance. That is, the camera assembly 21 in this embodiment may also be a dual camera, including a wide-angle camera and a telephoto camera. The image processor 23 obtains the position information of the sound source based on the audio signal, then determines the position of the sound source based on this position information to determine the distance between the dual cameras and the sound source, and then selects the telephoto camera or the wide-angle camera to capture image information.
[0059] Specifically, the image processor 23 is configured to control the telephoto camera to capture image information of the sound source when the separation distance is greater than a preset range; and to control the wide-angle camera to capture image information of the sound source when the separation distance is less than a preset range. This is equivalent to using the wide-angle camera for image capture when the separation distance is close, and using the telephoto camera for image capture when the separation distance is far. For example, as shown in Figure 3, when the image processor 23 detects a person in the first or second area, the image processor 23 selects the wide-angle camera, and the wide-angle camera's electrical signal is also used during AI recognition. When the image processor 23 detects a person in the third or fourth area, the image processor 23 selects the telephoto camera, and the telephoto camera's electrical signal is also used during AI recognition. The default setting for the dual camera is the wide-angle camera. In this embodiment, the dual camera configuration ensures the acquisition of image information from greater distances and higher recognition accuracy.
[0060] In some embodiments, the camera assembly 21 includes a dual camera, including a fisheye camera and an optical zoom camera. The image processor 23 is further configured to determine the distance to the sound source based on the position information and control the fisheye camera or the optical zoom camera to capture image information of the sound source based on the distance. That is, the camera assembly 21 in this embodiment may also be a dual camera, including a fisheye camera and an optical zoom camera. The image processor 23 obtains the position information of the sound source based on the audio signal, then determines the position of the sound source based on this position information to determine the distance between the dual camera and the sound source, and then selects the fisheye camera or the optical zoom camera to capture image information.
[0061] Specifically, the image processor 23 is specifically configured to control the optical zoom camera to capture image information of the sound source when the separation distance is greater than a preset range; and the image processor 23 is specifically configured to control the fisheye camera to capture image information of the sound source when the separation distance is less than a preset range. This is equivalent to using the fisheye zoom camera for image capture when the separation distance is close, and using the optical zoom camera for image capture when the separation distance is far. For example, as shown in FIG3 , when the image processor 23 detects a person in the first or second area, the image processor 23 selects the fisheye camera to capture the image, and the fisheye camera's electrical signal is also used during AI recognition; when the image processor 23 detects a person in the third or fourth area, the image processor 23 selects the optical zoom camera to capture the image, and the optical zoom camera's electrical signal is also used during AI recognition. The default setting for the dual-camera setup is the fisheye camera.
[0062] In some embodiments, the audio collector 22 is specifically used to collect audio signals every first preset time; the audio collector 22 collects audio signals once every first preset time to facilitate tracking the location of the sound source and ensure accurate acquisition of image information of the sound source.
[0063] In some embodiments, the image processor 23 is further used to control the two-dimensional pan-tilt platform 24 to reset if no audio signal is received within a second preset time and no facial information is detected in the received image information; wherein the second preset time is greater than the first preset time, that is, when the image processor 23 does not obtain an audio signal within a period of time, it means that the audio acquisition has not collected an audio signal within this period of time; at the same time, there is no facial information in the image information obtained by the image processor 23, which indicates that the camera component 21 has not captured any person at this time; this indicates that no one is speaking in the current environment where the display device is located, and therefore, the image processor 23 will control the two-dimensional pan-tilt platform 24 to reset to the default position, and at this time the camera component 21 returns to the default position.
[0064] As an embodiment, the audio collector 22 in the present application can be a microphone array, which can be set in the upper frame of the display screen 10, specifically in the middle position of the upper frame, so as to be able to obtain audio signals in all directions, so that the camera component 21 can obtain image components in all directions.
[0065] As an embodiment, the key components of the fisheye camera, optical zoom camera, wide-angle camera and telephoto camera in this application all include lenses, infrared filters, image sensors, flexible printed circuit boards and other devices. The working process of each camera is specifically as follows: the light signal of the captured environment and object passes through the lens and filter, and then passes through the image sensor, and is received by the photosensitive array of the diode of the image sensor to convert the light signal into an electrical signal, and then output to the image processor 23 through the MIPI signal interface on the flexible printed circuit board. After the image processor 23 processes the image information in terms of clarity, white balance, noise reduction and exposure, the processed image information is transmitted to the display screen 10 through the USB interface for display. Among them, the role of the lens is to correct the optical path, determine the imaging quality and field of view; the role of the filter is to pass only the visible light of the human eye in the 400nm-700nm band, ensuring that the imaging picture is close to the imaging picture of the human eye.
[0066] The camera system 20 in this application uses an optical zoom camera or a dual camera combined with a two-dimensional pan-tilt head 24 to collect image information. On the one hand, it can flexibly obtain image information over a wide range and solve the problem of blind spots in large scene environments. On the other hand, it can also ensure the clarity of images at long distances. At the same time, it can also combine audio signals to determine the location and distance of the sound source to achieve face tracking and recognition.
[0067] The present application also provides a camera system in an embodiment. This camera system can be applied to a television or commercial LCD screen, effectively increasing the shooting range of the television or commercial LCD screen, thereby expanding the application scenarios of the television or commercial LCD screen. Since the camera system is described in detail above, it will not be repeated here.
[0068] Referring to FIG. 4 , an embodiment of the present application further provides an image acquisition method, which is applied to the above-mentioned camera system and includes:
[0069] 100. Acquire an audio signal of a sound source;
[0070] 200. Obtaining position information of a corresponding sound source according to the audio signal, and controlling the two-dimensional pan-tilt platform to rotate the camera assembly according to the position information so that the sound source falls within the shooting range of the camera assembly;
[0071] 300. Obtain image information collected by the camera component and perform image processing on the image information.
[0072] The camera system in this application can effectively track and collect sound sources by setting up a combination of a two-dimensional pan-tilt head and audio signals when acquiring image information, so as to solve the problem of blind spots in large scene environments.
[0073] In some embodiments, the camera assembly includes an optical zoom camera; the dual camera includes a wide-angle camera and a telephoto camera; the method for obtaining image information captured by the camera assembly includes: obtaining image information captured by the optical zoom camera after automatic zooming according to the distance from the sound source.
[0074] Referring to FIG. 5 , in some embodiments, the camera assembly includes a dual camera, and the dual camera includes a wide-angle camera and a telephoto camera. The method for obtaining image information captured by the camera assembly includes:
[0075] 310. Obtain the distance between the dual-camera and the sound source based on the position information;
[0076] 320. When the interval distance is greater than a preset range, image information of the sound source captured by the telephoto camera is obtained;
[0077] 330. When the interval distance is less than a preset range, image information of the sound source captured by the wide-angle camera is obtained.
[0078] Referring to FIG. 6 , in some embodiments, the camera assembly includes a dual camera, and the dual camera includes a fisheye camera and an optical zoom camera. The method for obtaining image information captured by the camera assembly includes:
[0079] 301. Obtain the distance between the dual-camera and the sound source based on the position information;
[0080] 302. When the separation distance is greater than a preset range, obtaining image information of the sound source captured by the optical zoom camera;
[0081] 303. When the interval distance is less than a preset range, image information of the sound source collected by the fisheye camera is obtained.
[0082] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0083] The above is a detailed introduction to the camera system provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the technical solutions and core ideas of the present application. Ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or replace some of the technical features therein with equivalents; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A camera system, wherein: It includes a camera assembly, an audio collector, an image processor and a two-dimensional pan-tilt platform; the audio collector is connected to the image processor; the camera assembly is connected to the two-dimensional pan-tilt platform and the image processor; The audio collector is used to collect audio signals and output the audio signals to the image processor; the image processor is used to obtain the azimuth information of the sound source corresponding to the audio signal according to the audio signal, and control the two-dimensional pan-tilt head to drive the camera assembly to rotate according to the azimuth information so that the sound source falls within the shooting range of the camera assembly; the camera assembly is used to collect images of the sound source; and the image processor is also used to perform image processing on the image information collected by the camera assembly.
2. The camera system according to claim 1, wherein: The camera assembly includes an optical zoom camera, which is used to automatically identify the distance between the camera and the sound source and automatically zoom in according to the distance to capture an image of the sound source.
3. The camera system according to claim 1, wherein: The camera assembly includes a dual camera, and the dual camera includes a wide-angle camera and a telephoto camera; the image processor is also used to determine the distance between the dual camera and the sound source according to the orientation information, and control the wide-angle camera or the telephoto camera to collect image information of the sound source according to the distance.
4. The camera system according to claim 1, wherein: The camera assembly includes a dual camera, which includes a fisheye camera and an optical zoom camera; the image processor is also used to determine the distance from the sound source based on the orientation information, and control the fisheye camera or the optical zoom camera to collect image information of the sound source based on the distance.
5. The camera system according to claim 2, wherein: The optical zoom camera is specifically used to automatically zoom to a wide-angle end to capture an image of the sound source when the interval distance is greater than a preset range, or to automatically zoom to a telephoto end to capture an image of the sound source when the interval distance is less than the preset range.
6. The camera system according to claim 3, wherein: The image processor is specifically used to control the telephoto camera to collect image information of the sound source when the interval distance is greater than a preset range; the image processor is specifically used to control the wide-angle camera to collect image information of the sound source when the interval distance is less than the preset range.
7. The camera system according to claim 4, wherein: The image processor is specifically used to control the optical zoom camera to collect image information of the sound source when the interval distance is greater than a preset range; the image processor is specifically used to control the fisheye camera to collect image information of the sound source when the interval distance is less than the preset range.
8. The camera system according to any one of claims 5 to 7, wherein: The audio collector is specifically used to collect the audio signal every first preset time.
9. The camera system according to claim 8, wherein: The image processor is further configured to control the two-dimensional pan-tilt platform to reset if the audio signal is not received within a second preset time and no face information is detected in the received image information.
10. A method for acquiring an image, wherein: Applied in a camera system, the image acquisition method comprises: Acquire the audio signal of the sound source; Acquire the azimuth information corresponding to the sound source according to the audio signal, and control the two-dimensional pan-tilt platform to drive the camera assembly to rotate according to the azimuth information so that the sound source falls into the shooting range of the camera assembly; The image information collected by the camera component is obtained, and image processing is performed on the image information.
11. The image acquisition method according to claim 10, wherein: The camera assembly includes an optical zoom camera; the method for obtaining image information collected by the camera assembly includes: The image information collected by the optical zoom camera after automatic zooming according to the distance between the optical zoom camera and the sound source is obtained.
12. The image acquisition method according to claim 10, wherein: The camera assembly includes a dual camera, and the dual camera includes a wide-angle camera and a telephoto camera; the method for obtaining image information collected by the camera assembly includes: Acquire the distance between the dual-camera and the sound source according to the position information; When the interval distance is greater than a preset range, image information of the sound source captured by the telephoto camera is obtained; When the interval distance is smaller than the preset range, image information of the sound source collected by the wide-angle camera is obtained.
13. The image acquisition method according to claim 10, wherein: The camera assembly includes a dual camera, and the dual camera includes a fisheye camera and an optical zoom camera; the method for obtaining image information collected by the camera assembly includes: Acquire the distance between the dual-camera and the sound source according to the position information; When the interval distance is greater than a preset range, image information of the sound source collected by the optical zoom camera is obtained; When the interval distance is smaller than the preset range, image information of the sound source collected by the fisheye camera is obtained.
14. A display device, wherein: It includes a display screen and a camera system, wherein the display screen is connected to the image processor, and the display screen is used to display image information output by the camera system; The camera system includes a camera assembly, an audio collector, an image processor and a two-dimensional pan-tilt platform; the audio collector is connected to the image processor; the camera assembly is connected to the two-dimensional pan-tilt platform and the image processor; The audio collector is used to collect audio signals and output the audio signals to the image processor; the image processor is used to obtain the azimuth information of the sound source corresponding to the audio signal according to the audio signal, and control the two-dimensional pan-tilt head to drive the camera assembly to rotate according to the azimuth information so that the sound source falls within the shooting range of the camera assembly; the camera assembly is used to collect images of the sound source; and the image processor is also used to perform image processing on the image information collected by the camera assembly.
15. The display device according to claim 14, wherein: The camera assembly includes an optical zoom camera, which is used to automatically identify the distance between the camera and the sound source and automatically zoom in according to the distance to capture an image of the sound source.
16. The display device according to claim 14, wherein: The camera assembly includes a dual camera, and the dual camera includes a wide-angle camera and a telephoto camera; the image processor is also used to determine the distance between the dual camera and the sound source according to the orientation information, and control the wide-angle camera or the telephoto camera to collect image information of the sound source according to the distance.
17. The display device according to claim 14, wherein: The camera assembly includes a dual camera, which includes a fisheye camera and an optical zoom camera; the image processor is also used to determine the distance from the sound source based on the orientation information, and control the fisheye camera or the optical zoom camera to collect image information of the sound source based on the distance.
18. The display device according to claim 15, wherein: The optical zoom camera is specifically used to automatically zoom to a wide-angle end to capture an image of the sound source when the interval distance is greater than a preset range, or to automatically zoom to a telephoto end to capture an image of the sound source when the interval distance is less than the preset range.
19. The display device according to claim 14, wherein: The display device is a conference tablet, which has the display screen, two side frames arranged around the display screen, and an upper frame and a lower frame. The camera assembly and the two-dimensional pan-tilt head are arranged on the top of the upper frame, and the audio collector is arranged in the upper frame.
20. The display device according to claim 14, wherein: The display device is a television, which comprises the display screen, two side frames arranged around the display screen, an upper frame and a lower frame, the camera assembly and the two-dimensional pan-tilt head are arranged on the top of the upper frame, and the audio collector is arranged inside the upper frame.
Citation Information
Patent Citations
Photographing method and mobile terminal
CN107800967A
Camera shooting angle adjusting method and display equipment
CN111708383A
Tracking and positioning method, system, device, equipment, storage medium and product
CN114466139A
Video processing method and device for video conference, equipment and storage medium
CN115484431A
Camera system, image acquisition method and display equipment
CN117412173A