Positioning Method, Device, Storage Medium and Electronic Device of Image Acquisition Device

Abstract

The present application discloses a positioning method, device, storage medium, and electronic device for an image acquisition device. Among them, the method includes: determining the display position of a positioning image in a target electronic display screen among multiple electronic display screens; displaying the positioning image at the display position in the target electronic display screen during a target time period; controlling a first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of a target object in a ring screen display scene; determining the relative position relationship between the display position and the first image acquisition device, and determining the position of the first image acquisition device according to the relative position relationship. The present application solves the technical problems that in the related art, based on the positioning method using positioning stickers, manual on-site layout of positioning points is required, and the positioning stickers will block part of the display screen of the display, affecting the integrity of the displayed content and the viewing experience of the audience.

Description

Technical Field

[0001] The present application relates to the field of video shooting, and more particularly, to a positioning method, device, storage medium, and electronic device for an image acquisition device. Background Art

[0002] In a virtual shooting scenario, a green screen or a similar curtain is mostly used to set up the shooting background. In the application scenario where the traditional image acquisition device positioning scheme uses a green screen or a similar curtain, generally, positioning patches are set at the shooting site, and then the positioning sensor of the camera is used to identify the positioning patches, so as to realize the positioning of the position of the image acquisition device. However, in recent years, LED screens have been widely used to set up virtual shooting backgrounds in video shooting fields such as studios and live broadcast rooms. Since the positioning stickers will block the display of the LED screen, the cameras for non-virtual shooting cannot normally shoot the LED screen. Therefore, the above traditional image acquisition device positioning scheme is no longer applicable. In the application scenario where the LED screen is used as the virtual shooting background, a new image acquisition device positioning scheme is urgently needed.

[0003] In view of the above problems, no effective solution has been proposed yet. Summary of the Invention

[0004] Embodiments of the present application provide a positioning method, device, storage medium, and electronic device for an image acquisition device, so as to at least solve the technical problems that in the related art, the positioning method based on positioning stickers requires manual on-site layout of positioning points, and the positioning stickers will block part of the display screen of the display, affecting the integrity of the displayed content and the viewing experience of the audience.

[0005] According to one aspect of the embodiments of the present application, there is provided a positioning method for an image acquisition device, which is applied to a panoramic screen display scenario composed of multiple electronic display screens, and includes: determining the display position of a positioning image on a target electronic display screen among the multiple electronic display screens; displaying the positioning image at the display position on the target electronic display screen during a target time period; controlling a first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of a target object in the panoramic screen display scenario; determining the relative position relationship between the display position and the first image acquisition device, and determining the position of the first image acquisition device according to the relative position relationship.

[0006] Optionally, controlling the first image acquisition device to acquire positioning images during a target period includes: detecting a pulse signal in the current period, and determining that the current period is the target period when the type of the pulse signal in the current period is the first target pulse signal type, where the first target pulse signal type is the pulse signal type when the electronic display screen displays a positioning image; controlling the first image acquisition device to acquire positioning images during the target period.

[0007] Optionally, when the type of the pulse signal in the current period is the second target pulse signal type, determining that the current period is a non-target period, where the second target pulse signal type is the pulse signal type when the electronic display screen displays a background picture, controlling the target electronic display screen to display a background picture during the non-target period, and controlling the second image acquisition device to acquire a background picture and an image of a target object in a ring screen display scenario during the non-target period.

[0008] Optionally, before controlling the first image acquisition device to acquire positioning images during the target period, the method further includes: determining a display attribute of the positioning image, where the display attribute includes one of the following: brightness, or display duration; controlling the positioning image to be displayed based on the display attribute during the target period.

[0009] Optionally, determining the display attribute of the positioning image includes: obtaining on-site environment data of a target area collected by a sensor device; determining whether a predetermined object exists in the target area according to the on-site environment data, where the predetermined object includes: other objects except the target object; when it is determined that a predetermined object exists in the target area, determining that the display duration of the positioning image is less than a predetermined duration, and the predetermined duration is determined based on the display duration of other images displayed on the target electronic display screen; and / or determining that the brightness is less than a preset brightness, where the preset brightness is determined based on the average brightness of the display screen of the target electronic display screen.

[0010] Optionally, determining the display position of the positioning image on the target electronic display screen among multiple electronic display screens includes: determining component information of the target electronic display screen, where the component information includes: identification information of a cabinet or a lamp board; determining the arrangement information of the component corresponding to the identification information on the target electronic display screen, where the identification information corresponds to the component one by one; determining the display position according to the arrangement information.

[0011] Optionally, determining the display position according to the arrangement information includes: determining the positions corresponding to each component among multiple components; selecting a target component from multiple components, and determining the position where the target component is located as the origin position; constructing a coordinate system along two different predetermined directions starting from the origin position, determining the coordinate positions of each component in the coordinate system, and selecting a target coordinate position from the coordinate positions as the display position.

[0012] Optionally, determining the display position of the positioning image on a target electronic display screen among multiple electronic display screens includes: presenting a virtual display screen corresponding to the target electronic display screen; detecting a marking event for the virtual display screen to obtain a target marking point, and determining the position where the target marking point is located as the display position.

[0013] According to another aspect of the embodiments of the present application, there is also provided a method for positioning an image acquisition device, including: determining the display position of the positioning image on the electronic display screen; displaying the positioning image at the display position on the electronic display screen during a target time period; controlling a first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of a target object; determining the relative position relationship between the display position and the first image acquisition device, and determining the position of the first image acquisition device according to the relative position relationship.

[0014] According to another aspect of the embodiments of the present application, there is also provided a positioning device for an image acquisition device, which is applied to a panoramic display scenario composed of multiple electronic display screens, including: a first determination module, configured to determine the display position of the positioning image on a target electronic display screen among multiple electronic display screens; a first display module, configured to display the positioning image at the display position on the target electronic display screen during a target time period; a first control module, configured to control a first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of a target object located in the panoramic display scenario; a second determination module, configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0015] According to another aspect of the embodiments of the present application, there is also provided a positioning device for an image acquisition device, including: a third determination module, configured to determine the display position of the positioning image on the electronic display screen; a second display module, configured to display the positioning image at the display position on the electronic display screen during a target time period; a second control module, configured to control a first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of a target object; a fourth determination module, configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0016] According to another aspect of the embodiments of the present application, there is also provided a non-volatile storage medium, where the storage medium includes a stored program, and when the program runs, it controls the device where the storage medium is located to execute any one of the positioning methods for the image acquisition device.

[0017] According to another aspect of the embodiments of the present application, an electronic device is further provided, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement a positioning method for any image acquisition device.

[0018] In the embodiments of the present application, by directly displaying the positioning image on the display screen, the positioning sticker in the related art is replaced. By inserting the positioning image into the electronic display screen during the target period, and using the image acquisition device to collect the positioning image during the target period, and then determining the moving position of the image acquisition device based on the relative position between the image acquisition device and the positioning image, the purpose of determining the position of the image acquisition device based on the positioning image is achieved. And because the insertion and acquisition actions are controlled during the target period, the influence on the displayed picture on the display screen is minimized to the greatest extent, and the influence on the viewing experience of the audience can also be avoided as much as possible. And because the positioning image is directly inserted into the displayed picture on the display screen, there is no need to manually arrange the positioning points on site, saving the construction cost and improving the positioning efficiency. Furthermore, the technical problems in the related art are solved, that is, the positioning method based on the positioning sticker requires manual on-site arrangement of positioning points, and the positioning sticker will block part of the displayed picture on the display screen, affecting the integrity of the displayed content and the viewing experience of the audience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The schematic embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0020] Figure 1 is a schematic diagram of a circular screen display scene based on a green screen in the related art;

[0021] Figure 2 is a schematic flowchart of a positioning method for an image acquisition device according to an optional embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a circular screen display scene built in an exemplary embodiment of the present application;

[0023] Figure 4 is a schematic diagram of the process of inserting a positioning image into a normal picture according to an exemplary embodiment of the present application;

[0024] Figure 5 is a schematic diagram of an application scenario according to an exemplary embodiment of the present application;

[0025] Figure 6 is a schematic diagram of the fusion process of a normal picture and a positioning image in an exemplary embodiment of the present application;

[0026] Figure 7 It is a schematic flowchart of another optional method for positioning an image acquisition device according to an embodiment of the present application;

[0027] Figure 8 It is a schematic structural diagram of an optional positioning device for an image acquisition device according to an embodiment of the present application;

[0028] Figure 9 It is a schematic structural diagram of another optional device for positioning an image acquisition device according to an embodiment of the present application. Detailed implementation manners

[0029] In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application described herein can be implemented in an order different from those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0031] According to an embodiment of the present application, an embodiment of a method for positioning an image acquisition device is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0032] For the convenience of those skilled in the art to better understand the related embodiments of the present application, the following are the explanations of the technical terms or some nouns that may be involved in the related embodiments of the present application:

[0033] A pulse signal generator is a type of signal generator. Signal generators can be classified in many ways according to signal sources. One classification method divides them into hybrid signal sources and logic signal sources. Among them, hybrid signal sources mainly output analog waveforms; logic signal sources output digital waveforms. Hybrid signal sources can be further divided into function signal generators and arbitrary waveform / function generators. Function signal generators output standard waveforms such as sine waves and square waves, while arbitrary waveform / function generators output arbitrary waveforms defined by users. Logic signal generators can be further divided into pulse signal generators and pattern generators. Pulse signal generators drive the output of a small number of square waves or pulse waves, and pattern generators generate digital patterns for many channels.

[0034] Genlock, synchronous phase-locking, can synchronize one or more systems with the same synchronization source. It can make the refresh of the video consistent with an external video source. When an appropriate signal is provided, the system will lock its display refresh rate to this signal.

[0035] Figure 1 It is a ring screen display scenario based on a green screen in related technologies, such as Figure 1 shown. Since the image acquisition device (including but not limited to cameras, video cameras, webcams, and other image acquisition devices) needs to move for shooting, at this time, the backend server needs to render the corresponding picture according to the position where the image acquisition device moves. To solve the problem of positioning the position of the image acquisition device, it is necessary to paste positioning stickers or similar positioning devices on the site. When the image acquisition device moves, it can calculate its own position in real time through these positioning stickers, and then send the green screen picture it shoots and the position information to the backend server. The server renders the correct picture based on the position information.

[0036] Figure 2 It is a positioning method for an image acquisition device according to an embodiment of the present application, such as Figure 2 shown. This method is applied to a ring screen display scenario composed of multiple electronic displays. The method includes the following steps:

[0037] Step S202, determine the display position of the positioning image on the target electronic display among multiple electronic displays;

[0038] In the solution provided in step S202 of the present application above, multiple electronic displays (abbreviated as displays) are used to build a ring screen display scenario. The target electronic display can be any one of the multiple displays. The picture contents displayed on the multiple displays together constitute the background picture required for a stage, or a shooting scene, etc. The positioning image is an image used to confirm the position of the image acquisition device. The display form of the positioning image can be a specific symbol, such as a circle, a cross, a tick, etc., or a predetermined pattern, such as an animal image, a character image, etc.

[0039] Compared with the circular screen display scene constructed based on the green screen in the related technology, the circular screen display scene composed of multiple display screens saves the cost of setting up the green screen, and utilizes the property of the display screen itself that can display the positioning image to insert the positioning image into the display position, avoiding the use of positioning stickers and ensuring the integrity of the display screen display screen.

[0040] Optionally, the ring screen display scene composed of multiple display screens can generally be composed of 3 LED screens spliced ​​together. Figure 3 This is a ring screen display scene constructed in an exemplary embodiment of the present application, such as Figure 3 As shown, the ring screen display scene consists of three parts: LED screen-ceiling, LED screen-background and LED screen-ground.

[0041] Step S204, displaying a positioning image at a display position on a target electronic display screen within a target time period;

[0042] In the solution provided in the above step S204 of the present application, the positioning image can be inserted into the display position of the display screen in the target electronic display screen within the target time period, and the positioning image is only displayed at the display position within the target time period, and the positioning image is not displayed in other time periods except the target time period.

[0043] It should be noted that since the target display screen is part of the ring-screen display scene, it itself also needs to display the background pictures required by the shooting scene or stage. Therefore, inserting the positioning image on the target display screen will inevitably cause a visual impact on the background picture content currently displayed on the target display screen. By controlling the target time period to insert the positioning image into the target display screen and only displaying the positioning image within the target time period, the interference of the positioning image on the integrity of the background picture displayed on the target display screen is minimized, thereby improving the user's viewing experience.

[0044] Step S206, controlling the first image acquisition device to acquire a positioning image within a target period, wherein the first image acquisition device is used to acquire the positioning image and an image of a target object located in the ring screen display scene;

[0045] In the above step S206 of the present application, since the positioning image is inserted and displayed in the target time period, it is necessary to collect the positioning image in the target time period, and the above first image acquisition device is used to collect the positioning image and the image of the target object in the ring screen display scene. The above first image acquisition can be applied to a variety of different application scenarios, for example, it can be applied to a virtual shooting scene, that is, a scene without an audience on the scene, and it can also be applied to a scene with an audience on the scene.

[0046] In this embodiment, the target object captured by the first image capture may be an actor, a host, an actual set, etc. The captured positioning image and the image of the target object are sent to the server at the back end. The server at the back end can render the correct image based on the position indicated by the positioning image and the picture of the target object.

[0047] At the same time, it can be noted that by inserting a positioning image during the target time period and then capturing the positioning image within the target time period, the synchronization of the insertion action and the image capture action is achieved. By synchronizing the insertion action and the image capture action, the display time of the positioning image on the target display screen can be further reduced, and the influence of the positioning image on the background image displayed on the target display screen can be reduced.

[0048] Step S208: Determine the relative position relationship between the display position and the first image capture device, and determine the position of the first image capture device according to the relative position relationship.

[0049] In step S208 of the present application, during the movement of the first image capture device, the position of the first image capture device can be obtained in real time according to the relative position relationship between the display position of the captured positioning image and the first image capture device. Then, the position and the image of the target corresponding to the first image capture device can be sent to the server at the back end. The server can render the complete image to be presented based on the position information. That is, the positioning image and the image of the target object captured by the first image capture device can be used for rendering by the server at the back end. The server at the back end can render the complete image that conforms to the current position (i.e., an image composed of at least the image of the target object and the background image) according to the different positions of the first image capture device.

[0050] Specifically, the above rendering process may be that the server at the back end obtains the position information of the first image capture device according to the recognized positioning image, and based on this position information, information such as the shooting angle and shooting distance of the first image capture device relative to each display screen can be obtained. Then, the server at the back end can simultaneously combine the target object captured by the first image capture device at different positions (including different shooting angles, shooting distances, etc.) and the background image captured by the second image capture device to render the complete image taken from the perspective of the first image capture device, and the real-time complete image corresponding to the target object at different positions during the moving shooting process of the first image capture device can be obtained.

[0051] Optionally, during the above rendering process, in addition to combining the background screen collected by the second image acquisition device, it may also be necessary to combine the image data of the target object collected by the second image acquisition device. Specifically, the background screen collected by the second image acquisition device, the image screen of the target object collected by the second image acquisition device, and the images of the target object captured by the first image acquisition device at different positions (including different shooting angles, shooting distances, etc.) can be combined to render the complete images corresponding to the different positions of the first image acquisition device.

[0052] Through steps S202 to S208 of the present application, determine the display position of the positioning image in the display interface of the target electronic display screen among multiple electronic display screens; insert the positioning image into the display position on the target electronic display screen during the target period, and display the positioning image at the display position on the target electronic display screen during the target period; control the first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the images of the target object in the ring screen display scenario; determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship. That is, by inserting the positioning image into the electronic display screen during the target period, and using the image acquisition device to acquire the positioning image during the target period, and then using the relative position between the image acquisition device and the positioning image to determine the moving position of the image acquisition device, the purpose of determining the position of the image acquisition device based on the positioning image is achieved. And because the insertion and acquisition actions are controlled during the target period, the impact on the displayed screen of the display screen is minimized to the greatest extent, and the impact on the viewing experience of the audience can also be avoided as much as possible. And because the positioning image is directly inserted into the displayed screen of the display screen, there is no need to manually arrange positioning points on-site, saving the construction cost and improving the positioning efficiency, thereby solving the technical problems in the related art that the positioning method based on positioning stickers requires manual on-site arrangement of positioning points, and the positioning stickers will block part of the display screen of the display screen, affecting the integrity of the displayed content and the viewing experience of the audience.

[0053] In some optional embodiments of the present application, step S206 of controlling the first image acquisition device to acquire the positioning image during the target period can be implemented in the following manner:

[0054] Detect the pulse signal of the current period. When the type of the pulse signal is the first target pulse signal type, determine that the current period is the target period, where the first target pulse signal type is the pulse signal type when the electronic display screen displays the positioning image; control the first image acquisition device to acquire the positioning image during the target period. That is, by detecting the type of the pulse signal of the current period, when the type of the pulse signal is the pulse signal type corresponding to the display of the positioning image, the positioning image is displayed and acquired during the current period.

[0055] Optionally, when the type of the pulse signal in the current period is the second target pulse signal type, it is determined that the current period is a non-target period, where the second target pulse signal type is the pulse signal type when the electronic display screen displays the background picture. Control the target electronic display screen to display the background picture in the non-target period, and control the second image acquisition device to acquire the background picture and the image of the target object in the ring screen display scenario during the non-target period. That is, if the type of the pulse signal in the current period is the pulse signal type corresponding to the display of the background picture, the background picture is displayed instead of the positioning image, and the second image acquisition device is used to acquire the background picture and the target object in the ring screen display scenario. As described above, the target object includes, but is not limited to, the host, actors, and other objects, etc.

[0056] It should be noted that the above pulse signal can be generated by a pulse generator, and the pulse signal type can be determined based on the function waveform, frequency, pulse width, etc. of the pulse signal. For example, if the pulse signal is divided based on the function waveform of the pulse signal, the pulse signal can be divided into sine wave, sawtooth wave, triangular wave, square wave, etc. For example, the first target pulse signal type can be a sine wave, and the second target pulse signal type can be a square wave. When it is detected that the pulse signal in the current period is a sine wave, it is determined that the electronic display screen displays the positioning image, and the first image acquisition device is controlled to acquire the positioning image. When it is detected that the pulse signal in the current period is a square wave, it is determined that the electronic display screen displays the background picture, and the second image acquisition device is controlled to acquire the background picture.

[0057] Optionally, the pulse signal can be divided based on the frequency. The pulse signal can be divided into a high-frequency pulse signal and a low-frequency pulse signal. Among them, the frequency corresponding to the high-frequency pulse signal can be set to 100 MHz to 300 MHz, and the frequency corresponding to the low-frequency pulse signal can be set to 5 MHz to 10 MHz. Assuming that the first target pulse signal type is set as the high-frequency pulse signal and the second target pulse signal type is set as the low-frequency pulse signal, when the frequency of the pulse signal in the current period is a high-frequency pulse signal, the positioning image can be displayed on the electronic display screen, and the first image acquisition device is controlled to acquire the positioning image. When the frequency of the pulse signal in the current period is a low-frequency pulse signal, the background picture can be displayed on the electronic display screen, and the second image acquisition device is controlled to acquire the background picture.

[0058] Optionally, the above control to make the first image acquisition device acquire positioning images during the target period can also be achieved by identifying the identification information displayed on the electronic display screen. Specifically, different identification information is displayed on the electronic display screen, where different identification information is used to indicate whether the electronic display screen is currently displaying a positioning image or a background picture. For example, the first identification corresponds to the positioning picture, and the second identification corresponds to the background picture. When the recognition result indicates that the identification displayed on the electronic display screen during the current period is the first identification, it is determined that the current period is the target period, and the first image acquisition device is controlled to acquire positioning images during this target period. When the recognition result indicates that the identification displayed on the electronic display screen during the current period is the second identification, the second image acquisition device is controlled to acquire the background picture.

[0059] It should be noted that the above control to make the first image acquisition device acquire positioning images during the target period can also be achieved through Genlock. The implementation method can be to control the electronic display screen, the first image acquisition device, and the second image acquisition device through Genlock. For example, when controlling the electronic display screen to display a positioning image, a first signal is triggered and sent to the first image acquisition device to control the first image acquisition device to acquire positioning images. Similarly, when controlling the electronic display screen to display a background picture, a second signal is triggered and sent to the second image acquisition device to control the second image acquisition device to synchronously acquire the background picture.

[0060] Optionally, the above control to make the first image acquisition device acquire positioning images during the target period can also be achieved by setting a signal generator on the electronic display screen. Its principle is similar to Genlock. The difference is that the control signal is implemented by the signal generator set on the electronic display screen. The specific implementation process can be that when the electronic display screen displays a positioning image, a first signal is triggered and sent to the first image acquisition device to control the first image acquisition device to acquire positioning images. Similarly, when the electronic display screen displays a background picture, a second signal is triggered and sent to the second image acquisition device to control the second image acquisition device to synchronously acquire the background picture.

[0061] It should be noted that during the process of the first image acquisition device and the second image acquisition device respectively acquiring positioning images and background pictures, they can both synchronously acquire images of the target object.

[0062] In this embodiment, by controlling the display of the positioning image and the background screen at different time periods, the interference of the positioning image on the integrity of the background screen during the acquisition of the background screen displayed on the electronic display by the second image acquisition device is avoided. That is, by isolating the positioning image and the background screen by displaying them at different time periods, the mutual interference between the two is avoided. The implementation process can be to display the positioning image during the target time period and the background screen during the non-target time period, and then the positioning image is no longer displayed.

[0063] Figure 4 is a schematic diagram of inserting a positioning image into a normal screen (i.e., the background screen) according to the above embodiment, as Figure 4 shown, the electronic display can periodically display the positioning image and the normal screen. The camera responsible for virtual shooting (i.e., the first image acquisition device) can be synchronized with the control system of the display screen to lock the positioning image displayed on the display screen. At this time, the image recognized by the virtual shooting camera includes the positioning image and the image of the target object. Through this positioning image, the position of the camera itself can be accurately calculated, and then transmitted to the backend server for screen rendering to obtain the complete image of the target object at different positions. For the camera responsible for normal shooting (i.e., the second image acquisition device), it is also synchronized with the control system of the screen, but only locks the normal screen displayed on the screen, and thus can be unaffected by the inserted positioning image and capture the image it needs. As shown above, the above synchronization and locking process can be achieved by displaying the positioning image during the target time period and only the background screen during the non-target time period. It should be noted that the display screen used in the above embodiment includes but is not limited to: LED display screens.

[0064] Figure 5 is an application scenario diagram of the above embodiment, as Figure 5 shown, multiple LED screens form the shooting scene. The virtual shooting camera and the backend server are responsible for the shooting and rendering of the virtual screen, and the normal shooting camera is responsible for shooting the image actually displayed on the LED screen. Figure 6 is a schematic diagram of the fusion process of the normal screen and the positioning image in this application scenario, as Figure 6As shown, the virtual shooting camera accurately locates its own position by locking the positioning screen displayed on the LED screen. Then, it transmits the positioning information to the back-end processor to render the corresponding screen. The normal shooting camera only needs to lock the screen actually displayed on the LED screen to shoot without being affected by the positioning screen. It should be noted that this embodiment describes the accurate positioning of the camera by inserting a positioning image. Among them, the specific content of the positioning image is not limited as long as it can assist the camera in positioning. The content of the positioning image includes but is not limited to coordinates, longitude and latitude, various color blocks, etc. The application scenarios of this embodiment include but are not limited to the scenarios described above. It can be any scenario including the shooting site of the LED screen, and the specific implementation method of frame interpolation is not limited as long as it can insert the positioning image on the LED screen. It should also be noted that the positioning image can be an image uploaded by the user or an image automatically generated by setting, such as an automatically generated coordinate system, automatically generated longitude and latitude, etc.

[0065] As described above, the application scenarios of this application are not limited to the situation of multiple image acquisition devices shooting. Hereinafter, another optional application scenario of this application, the scenario of the first image acquisition device + on-site audience, will be described. Specifically:

[0066] Before controlling the first image acquisition device to acquire a positioning image in a target time period, the display attribute of the positioning image can be determined. Among them, the display attribute includes one of the following: brightness, or display duration; control the positioning image to be displayed based on the display attribute in the target time period.

[0067] As an optional implementation manner, determining the display attribute of the positioning image includes: obtaining the on-site environmental data of the target area collected by the sensor device; determining whether there is a predetermined object in the target area according to the on-site environmental data, where the predetermined object includes: other objects (such as audiences) other than the target object; in the case of determining that there is a predetermined object in the target area, determining that the display duration of the positioning image is less than a predetermined duration, and the predetermined duration is determined based on the display duration of other images displayed on the target electronic display screen except the positioning image; and / or determining that the brightness is less than a preset brightness, where the preset brightness is determined based on the average brightness of the display screen of the target electronic display screen. That is, by using the sensor device to detect whether there are audiences at the shooting site, in the case of having audiences, it is necessary to avoid the visual experience of the audiences watching the program as much as possible. Therefore, it is necessary to control the display logic of the positioning image. For example, determine that the display duration of the positioning image is less than the predetermined duration, or control the brightness of the positioning image when it is displayed to be less than the preset brightness.

[0068] It should be noted that the display duration of the above-mentioned positioning image can be determined according to the display duration of the background image on the display screen. For example, if the display duration of the background image is 16 ms, the display duration of the positioning image can be set to 0.67 ms. Due to the visual persistence effect of the human eye, the inserted positioning image will not be recognized and will not affect the viewing experience of the audience. Similarly, the display brightness of the above-mentioned positioning image can be determined based on the average brightness of the display screen of the display. This is because after the human eye adapts to the average brightness of a certain environment, the visual range has a certain limit. Therefore, after the average brightness is determined, the display brightness of the positioning image can be determined according to the average brightness. For example, if the average brightness is 500 nit, the brightness that can be recognized by the human eye is between 200-700 nit. Therefore, the display brightness of the positioning image can be determined to be 10 nit.

[0069] In some embodiments of the present application, the display position of the positioning image in the target electronic display screen among multiple electronic display screens in the above step S202 can be determined in the following manner: determine the component information of the target electronic display screen, where the component information includes: identification information of the cabinet or the light board; determine the arrangement information of the component corresponding to the identification information in the target electronic display screen, where the identification information corresponds to the component one by one; determine the display position according to the arrangement information. That is, the display position of the positioning image in the target display screen is determined by the arrangement position of the cabinet or the light board.

[0070] Specifically, determining the display position according to the arrangement information includes: determining the positions corresponding to each component among multiple components; selecting a target component from multiple components, and determining the position where the target component is located as the origin position; taking the origin position as the starting point, constructing a coordinate system along two different predetermined directions, determining the coordinate positions of each component in the coordinate system, and selecting a target coordinate position from the coordinate positions as the display position.

[0071] In this embodiment, the present application embodiment does not limit the determination method of the display position corresponding to the positioning image. The above process of constructing the coordinate system can be to construct a rectangular coordinate system with the origin position where the light board, cabinet, etc. are located, or to construct a latitude and longitude coordinate according to the latitude and longitude of the light board or the cabinet, so as to determine the display position.

[0072] As an alternative embodiment, the above process of determining the display position can also be determined by marking the electronic display screen as a whole by the user's marking operation. Specifically, a virtual display screen corresponding to the target electronic display screen can be displayed; a target marking point is obtained by detecting a marking event for the virtual display screen, and the position where the target marking point is located is determined as the display position.

[0073] In this embodiment, by displaying the virtual display screen corresponding to the target electronic display screen, then obtaining the target annotation point according to the user's annotation event, and finally determining the position where the target annotation point is located as the display position.

[0074] For example, the virtual display screen corresponding to the target display screen can be displayed on a display terminal connected to an input device (such as a mouse, keyboard), and the virtual display screen is displayed through the display screen of the display terminal. The user can annotate the virtual display screen through input devices such as a mouse and keyboard to determine the display position.

[0075] Figure 7 It is a schematic flowchart of a method for positioning an image acquisition device according to an embodiment of the present application. As Figure 7 shown, the method includes the following steps:

[0076] S702, determine the display position of the positioning image in the electronic display screen;

[0077] In the solution provided in S702 of the present application above, there can be one electronic display screen, that is, by displaying the positioning image on the display screen to be used to confirm the position of the image acquisition device. The display form of the positioning image can be a specific symbol, such as a circle, a cross, a tick, etc., or a predetermined pattern, such as an animal image, a character image, etc.

[0078] S704, display the positioning image at the display position in the electronic display screen during the target time period;

[0079] In the solution provided in step S704 of the present application above, the positioning image can be inserted into the display position of the display screen in the electronic display screen during the target time period, and the positioning image is only displayed during the target time period, and is not displayed during other time periods except the target time period.

[0080] It can be understood that since the electronic display screen itself also needs to display the background images required for the shooting scene, or the stage, etc., inserting the positioning image into the electronic display screen will inevitably cause a visual impact on the current displayed picture content in the display screen. By controlling the insertion of the positioning image into the target display screen during the target time period and only displaying the positioning image during the target time period, the interference of the positioning image on the complete picture required by the display screen is minimized to improve the user's viewing experience.

[0081] S706, control the first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of the target object;

[0082] In step S706 of the present application, since the positioning image is inserted and displayed during the target time period, it is necessary to collect the positioning image during the target time period. The first image acquisition device is used to collect the positioning image and the image of the target object in the ring screen display scene. The above first image acquisition can be applied to multiple different application scenarios. For example, it can be applied to a virtual shooting scenario, that is, a scenario without an audience on site, or it can also be applied to a scenario with an audience on site.

[0083] S708. Determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0084] In step S708 of the present application, during the movement of the first image acquisition device, the position of the first image acquisition device can be obtained in real time according to the relative position relationship between the display position of the collected positioning image and the first image acquisition device. Then, the position and the image of the target collected by the first image acquisition device can be sent to the server at the back end. The server can render the correct picture based on the position information.

[0085] Through steps S702 to S708 of the present application, determine the display position of the positioning image in the display interface of the electronic display screen; insert the positioning image into the display position in the electronic display screen during the target time period, and display the positioning image at the display position during the target time period; control the first image acquisition device to collect the positioning image during the target time period, where the first image acquisition device is used to collect the positioning image and the image of the target object; determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship, achieving the purpose of determining the position of the image acquisition device based on the positioning image. And because the insertion and acquisition actions are controlled and executed during the target time period, the influence on the displayed picture of the display screen is reduced, and the influence on the viewing experience of the audience can also be avoided as much as possible. And because the positioning image is directly inserted into the displayed picture on the display screen, there is no need to manually arrange positioning points on site, saving the construction cost and improving the positioning efficiency, thus solving the technical problems that in the related art, based on the positioning method using positioning stickers, it is necessary to manually arrange positioning points on site, and the positioning stickers will block part of the display picture of the display screen, affecting the integrity of the displayed content and the viewing experience of the audience.

[0086] Figure 8 It is a schematic structural diagram of a positioning device for an image acquisition device according to an embodiment of the present application, as Figure 8 shown. This device is applied to a ring screen display scene composed of multiple electronic display screens and includes:

[0087] The first determination module 80 is configured to determine the display position of the positioning image on the target electronic display screen among multiple electronic display screens;

[0088] The first display module 82 is configured to display the positioning image at the display position on the target electronic display screen during the target time period;

[0089] The first control module 84 is configured to control the first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of the target object in the panoramic display scene;

[0090] The second determination module 86 is configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0091] In the positioning device of the image acquisition device, the first determination module 80 is configured to determine the display position of the positioning image in the display interface of the target electronic display screen among multiple electronic display screens; the first display module 82 is configured to display the positioning image at the display position on the target electronic display screen during the target time period; the first control module 84 is configured to control the first image acquisition device to acquire the positioning image during the target time period, where the first image acquisition device is used to acquire the positioning image and the image of the target object in the panoramic display scene; the second determination module 86 is configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship, achieving the purpose of determining the position of the image acquisition device based on the positioning image. And since the insertion and acquisition actions are controlled and executed during the target time period, the influence on the displayed picture of the display screen is minimized to the greatest extent, and the influence on the viewing experience of the audience can also be avoided as much as possible. And since the positioning image is directly inserted into the displayed picture on the display screen, there is no need to manually arrange positioning points on site, saving the construction cost and improving the positioning efficiency, thereby solving the technical problems that in the related art, based on the positioning method using positioning stickers, it is necessary to manually arrange positioning points on site, and the positioning stickers will block part of the displayed picture of the display screen, affecting the integrity of the displayed content and the viewing experience of the audience.

[0092] Figure 9 It is a schematic structural diagram of another device for positioning an image acquisition device according to an embodiment of the present application. As Figure 9 shown, the device includes:

[0093] The third determination module 90 is configured to determine the display position of the positioning image on the electronic display screen;

[0094] The second display module 92 is configured to display the positioning image at the display position on the electronic display screen during the target time period;

[0095] The second control module 94 is configured to control the first image acquisition device to acquire positioning images during a target period, where the first image acquisition device is used to acquire positioning images and images of a target object;

[0096] The fourth determination module 96 is configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0097] In the positioning device of the image acquisition device, the third determination module 90 is configured to determine the display position of the positioning image in the display interface of the electronic display screen; the second display module 92 is configured to display the positioning image at the display position in the electronic display screen during the target period; the second control module 94 is configured to control the first image acquisition device to acquire positioning images during the target period, where the first image acquisition device is used to acquire positioning images and images of a target object; the fourth determination module 96 is configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship, achieving the purpose of determining the position of the image acquisition device based on the positioning image. Moreover, since the insertion and acquisition actions are controlled and executed during the target period, the influence on the displayed screen of the display screen is minimized to the greatest extent, and the influence on the viewing experience of the audience can also be avoided as much as possible. Moreover, since the positioning image is directly inserted into the displayed screen of the display screen, there is no need to manually arrange positioning points on-site, saving the construction cost and improving the positioning efficiency, thereby solving the technical problems that in the related art, based on the positioning method using positioning stickers, it is necessary to manually arrange positioning points on-site, and the positioning stickers will block part of the displayed screen of the display screen, affecting the integrity of the displayed content and the viewing experience of the audience.

[0098] According to another aspect of the embodiments of the present application, there is also provided a non-volatile storage medium, where the storage medium includes a stored program, and when the program runs, it controls the device where the storage medium is located to execute any one of the positioning methods of the image acquisition device.

[0099] According to another aspect of the embodiments of the present application, there is also provided an electronic device, including: a processor; a memory for storing instructions executable by the processor; where the processor is configured to execute the instructions to implement any one of the positioning methods of the image acquisition device.

[0100] Specifically, the above storage medium is used to store program instructions with the following functions to implement the following functions:

[0101] Determine the display position of the positioning image on the target electronic display screen among multiple electronic display screens; display the positioning image at the display position on the target electronic display screen during the target period; control the first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of the target object in the panoramic display scene; determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0102] Specifically, the above storage medium is used to store program instructions for the following functions, and is also used to implement the following functions:

[0103] Determine the display position of the positioning image on the electronic display screen; display the positioning image at the display position on the electronic display screen during the target period; control the first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of the target object; determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship.

[0104] In the related embodiments of the present application, by adopting the method of directly displaying the positioning image on the display screen, the positioning sticker in the related technology is replaced. By inserting the positioning image into the electronic display screen during the target period and using the image acquisition device to acquire the positioning image during the target period, and then using the relative position between the image acquisition device and the positioning image to determine the moving position of the image acquisition device, the purpose of determining the position of the image acquisition device based on the positioning image is achieved. And because the insertion and acquisition actions are controlled and executed during the target period, the influence on the displayed picture of the display screen is minimized to the greatest extent, and the influence on the viewing experience of the audience can also be avoided as much as possible. And because the positioning image is directly inserted into the displayed picture on the display screen, there is no need to manually arrange positioning points on site, saving the construction cost and improving the positioning efficiency. Furthermore, it solves the technical problems that in the related technology, based on the positioning method of the positioning sticker, it is necessary to manually arrange positioning points on site, and the positioning sticker will block part of the displayed picture of the display screen, affecting the integrity of the displayed content and the viewing experience of the audience.

[0105] The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0106] In the above embodiments of the present application, the descriptions of each embodiment have their own emphases. For the parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0107] In several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are merely illustrative. For example, the division of the units can be a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the couplings, direct couplings, or communication connections shown or discussed with each other can be through some interfaces. The indirect couplings or communication connections of units or modules can be in electrical or other forms.

[0108] The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they can be located in one place or distributed to multiple units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0109] In addition, in each embodiment of this application, the functional units can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0110] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of this application. The foregoing storage medium includes: various media such as USB flash drives, read-only memories (ROMs), random access memories (RAMs), mobile hard disks, magnetic disks, or optical discs that can store program codes.

[0111] The above are only the preferred embodiments of this application. It should be noted that for those of ordinary skill in the art, without departing from the principle of this application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of this application.

Claims

1. A positioning method for an image acquisition device, characterized in that, The method is applied to a panoramic display scenario composed of multiple electronic display screens, including: Determine the display position of the positioning image on the target electronic display screen among the multiple electronic display screens; Display the positioning image at the display position on the target electronic display screen during the target period, and control the first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of the target object in the panoramic display scenario; Determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship; Wherein, the method further includes: controlling the target electronic display screen to display a background image during the non-target period, and controlling the second image acquisition device to acquire the background image and the image of the target object in the panoramic display scenario during the non-target period.

2. The method according to claim 1, characterized in that, Controlling the first image acquisition device to acquire the positioning image during the target period includes: Detect the pulse signal of the current period; When the type of the pulse signal in the current period is the first target pulse signal type, determine that the current period is the target period, where the first target pulse signal type is the pulse signal type when the target electronic display screen displays the positioning image; Control the first image acquisition device to acquire the positioning image during the target period.

3. The method according to claim 2, characterized in that, When the type of the pulse signal in the current period is the second target pulse signal type, determine that the current period is the non-target period, where the second target pulse signal type is the pulse signal type when the target electronic display screen displays the background image.

4. The method according to claim 1, characterized in that, Before controlling the first image acquisition device to acquire the positioning image during the target period, the method further includes: Determine the display attribute of the positioning image, where the display attribute includes one of the following: brightness, or display duration; Control the positioning image to be displayed based on the display attribute during the target period.

5. The method according to claim 4, characterized in that, Determining the display attribute of the positioning image includes: Obtain the on-site environment data of the target area collected by the sensor device; Determine whether there is a predetermined object in the target area according to the on-site environment data, where the predetermined object includes: other objects except the target object; When it is determined that there is the predetermined object in the target area, determine that the display duration of the positioning image is less than the predetermined duration, and the predetermined duration is determined based on the display duration of other images displayed on the target electronic display screen except the positioning image; and / or Determine that the brightness is less than the preset brightness, where the preset brightness is determined based on the average brightness of the display screen of the target electronic display screen.

6. The method according to claim 1, characterized in that, Determining the display position of the positioning image on the target electronic display screen among the multiple electronic display screens includes: Determine the component information of the target electronic display screen, where the component information includes: identification information of the cabinet or the light board; Determine the arrangement information of the components corresponding to the identification information on the target electronic display screen, where the identification information corresponds to the components one by one; Determine the display position according to the arrangement information.

7. The method according to claim 6, characterized in that, Determining the display position according to the arrangement information includes: Determine the positions corresponding to each of the multiple components; Select a target component from the multiple components, and determine the position where the target component is located as the origin position; Taking the origin position as the starting point, construct a coordinate system along two different predetermined directions, determine the coordinate positions of each component in the coordinate system, and select a target coordinate position from the coordinate positions as the display position.

8. The method according to claim 1, characterized in that, Determine the display position of the positioning image on the target electronic display screen among the multiple electronic display screens, including: Display the virtual display screen corresponding to the target electronic display screen; Detect a marking event for the virtual display screen to obtain a target marking point, and determine the position where the target marking point is located as the display position.

9. A method for positioning an image acquisition device, characterized in that, Including: Determine the display position of the positioning image on the electronic display screen; Display the positioning image at the display position on the electronic display screen during the target period; Control a first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of a target object; Determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship. Wherein, the method further includes: controlling the electronic display screen to display a background picture during a non-target period.

10. A positioning device for an image acquisition device, characterized in that, The device is applied to a panoramic display scenario composed of multiple electronic display screens, and includes: A first determination module, configured to determine the display position of the positioning image on the target electronic display screen among the multiple electronic display screens; A first display module, configured to display the positioning image at the display position on the target electronic display screen during the target period; A first control module, configured to control a first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of a target object located in the panoramic display scenario; A second determination module, configured to determine the relative position relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative position relationship; Wherein, the device is further configured to control the target electronic display screen to display a background picture during a non-target period, and control a second image acquisition device to acquire the background picture and the image of the target object in the panoramic display scenario during the non-target period.

11. A device for positioning an image acquisition device, characterized in that, Including: A third determination module, configured to determine the display position of the positioning image on the electronic display screen; A second display module, configured to display the positioning image at the display position on the electronic display screen during the target period; A second control module, configured to control a first image acquisition device to acquire the positioning image during the target period, where the first image acquisition device is used to acquire the positioning image and the image of a target object; A fourth determination module, configured to determine the relative positional relationship between the display position and the first image acquisition device, and determine the position of the first image acquisition device according to the relative positional relationship; Wherein, the device is further configured to control the electronic display screen to display a background picture during a non-target period.

12. A non - volatile storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program runs, the device where the storage medium is located is controlled to execute the positioning method of the image acquisition device according to any one of claims 1 to 9.

13. An electronic device, characterized in that, Comprising: A processor; A memory for storing executable instructions of the processor; Wherein, the processor is configured to execute the instructions to implement the positioning method of the image acquisition device according to any one of claims 1 to 9.

Images