Method for inserting data into a digital video data stream

Abstract

Method for inserting data into a digital video signal stream, in which a screen image is generated on a screen (5) by the video signal stream and data are input which relate to an image content (15) spatially assigned to an object (10) in the screen image, the insertion of the data being carried out in an object-related manner by touching a touchscreen which reproduces the screen image and forms the screen 5, by means of a stylus or by means of a mouse, characterized in that during the insertion of the data the field of view (11) corresponding to the respective video signal stream is displayed on the screen (5) in a displaced and cropped manner while keeping the position of the object (10) relative to the screen (5) constant.

Description

[0001] The invention relates to a method for inserting data into a digital video signal stream according to the preamble of claim 1.

[0002] The invention further relates to a system for carrying out the method according to the preamble of claim 5.

[0003] Methods of this type are known from practice in which, during the input of data, for example, text, images, or videos, the screen image is frozen, and signals generating the frozen screen image and the superimposed image content are inserted into the video signal stream. Therefore, the moving screen image cannot be continued in the same display window during data input.

[0004] A method and a system having the features of the preamble of independent claims 1 and 5 are disclosed in US 2012 / 0299962 A1. US 2005 / 0280707 A1 describes a method for stabilizing video images recorded with a camera. Changes to the video images caused by unintentional movements of the camera are prevented.

[0005] The invention is based on the object of creating a new method of the type mentioned at the outset with improved possibilities for controlling the screen image during data input.

[0006] The method according to the invention which achieves this object is characterized in that, during the insertion of the data, the field of view corresponding to the respective video signal stream is displayed on the screen in a shifted and cropped manner while keeping the position of the object relative to the screen constant.

[0007] Advantageously, the cropped partial image can be further tracked as a moving screen image during data entry.

[0008] Data can be inserted by touching a touchscreen displaying the screen image. Alternatively, data generating object-related image content could also be entered using a computer mouse or stylus.

[0009] In areas of the screen that are not covered by the cropped field of view partial image, image content saved before a change in the field of view can be displayed, in particular the image content last displayed in this area.

[0010] In a preferred embodiment of the invention, the object is at rest with respect to its surroundings within the field of view, while other objects in the field of view can move.

[0011] A movement of the screen image can, for example, be based solely on a movement of a camera generating the video signal stream and an associated change in the field of view, wherein the disturbing influence of such tilting and / or translational movements of the camera during data input can be eliminated by the method according to the invention.

[0012] The system according to the invention preferably comprises a camera worn on a user's head, so that the field of view captured by the camera approximately corresponds to the user's field of vision. In this case, insertions introduced into the signal stream can be transmitted to the user in real time and displayed on the user's data glasses, so that the user perceives visual annotations associated with the object (augmented reality).

[0013] The video signal stream to be modified by insertion could also be generated by a playback device.

[0014] The invention will be further explained below with reference to exemplary embodiments and the accompanying drawings relating to these exemplary embodiments. They show: Fig. 1 is a schematic representation of a system according to the invention, and Fig. 2 and Fig. 3 the functioning of the system of Fig. 1 explanatory illustrations.

[0015] One in Fig. The camera 1 shown in Figure 1 generates a digital video signal stream that can be transmitted wirelessly or via a line 2 to a receiver device 3. The receiver device 3 comprises a processing device 4 that receives the video signal stream and a screen 5 that can be controlled by the processing device 4.

[0016] In the example shown, the screen 5 is a touchscreen via which image data can be input into the processing device 4.

[0017] The processing device 4 is further connected to a recording / playback device 6, which receives a video signal stream, possibly modified by the processing device 4 based on the input image data. The modified video signal stream can be transmitted wirelessly or via a line 7 from the processing device 4 directly or from the recording / playback device 6 to a playback device 8 arranged next to the camera 1.

[0018] The camera 1 can be, for example, a camera carried by a user, while the playback device 8 can be, for example, data glasses worn by the user.

[0019] The receiver device 3, including the recording / playback device 6, can be formed, for example, by a suitably programmed personal computer. A dashed line 9 in Fig. 1 indicates another usable device in which the camera 1 is also integrated, e.g. a tablet computer or a smartphone.

[0020] In the example shown, the user of the camera 1 and the playback device 8 is a worker working on site at a workplace, while a user of the receiver device 3 is located, for example, in a higher-level control center, from where he observes the worker's activity on the screen 5 and provides the worker with information as described below.

[0021] Camera 1, preferably worn on the worker's head, captures an object or field of view that approximately corresponds to the worker's field of vision. A corresponding screen image appears on screen 5. Communication between the control center user and the on-site worker can be based on comments that the user enters in the control center via touchscreen 5, spatially related to an object displayed in the screen image, e.g., a tool located in the captured field of view. For example, an arrow pointing toward the object is drawn at the relevant location on the touchscreen.

[0022] The drawing of such an annotation is made more difficult if the worker moves his head, even slightly, during the process. In this case, the field of view captured by camera 1 changes, and the object in question moves to a different position relative to the screen. This is illustrated by Fig. 2a and Fig. 2b. While an object 10 is moving according to Fig. 2a is located in the middle of the screen 5, it moves when the worker turns his head according to Fig. 2b, for example, by distance 3 toward the left edge of the screen. The drawing of an object-related annotation would be disrupted.

[0023] In order to keep the object 10 in place with respect to the touchscreen or screen 5 at least during the drawing of the annotation, the processing device 4 controls the touchscreen or screen 5 in such a way that when the field of view captured by the camera 1 changes, a cropped partial image 11 of the field of view is displayed in accordance with Fig. 2c, in which the object 10 remains in place on the screen, e.g. in the center of the screen 5. In the rest of the screen area, the corresponding image content 12 of the screen image before the change of the detected field of view according to Fig. 2a, which the processing device 4 stores.

[0024] While in the example shown the object 10 is at rest within the respective field of view and possibly only other objects are moving, in contrast to this the object 10 itself could also be in motion and be kept at the original starting position on the screen surface while the image of the respective field of view is continuously cropped.

[0025] It is understood that a change in the field of view generated by the camera can occur not only by turning the head but also by changing the inclination of the worker's head, so that in addition to a vertical boundary line 13, the cropped partial image 11 can also have a horizontal boundary line 14, as shown in Fig. 3. In addition to rotational movements, translational movements that change the camera's field of view are also possible, even in combination with rotational movements. It goes without saying that changes in the field of view can also be caused by differently adjusted recording lenses.

[0026] In the example shown, drawn annotations, e.g. the one in Fig. 2c, in real time to the playback device 8. Alternatively, the transmission can be delayed after the video signal stream modified by the image data input has been recorded by the recording / playback device 6.

[0027] In the embodiment described here, only the annotation displayed by the image data input is transmitted and appears in the data glasses worn by the worker. Since the worker's field of view approximately coincides with the field of view of camera 1, the worker perceives the annotation spatially relative to the object in his field of view (augmented reality).

[0028] The insertion of the annotation into the video signal stream can be time-limited, so that it disappears from the screen after a certain period of time. Alternatively, it would be conceivable for the annotation to remain object-specific even if the object in the object field moves and changes its position on the screen after the image data has been entered. In this case, the modified video data stream is always modified so that the displayed image content follows the object on the screen.

Claims

[1] Method for inserting data into a digital video signal stream, in which a screen image is generated on a screen (5) by the video signal stream and data are input which relate to an image content (15) spatially assigned to an object (10) in the screen image, wherein the insertion of the data is carried out object-related by touching a touchscreen displaying the screen image and forming the screen 5, by a pen or by a mouse, characterized by that during the insertion of the data, the field of view (11) corresponding to the respective video signal stream is displayed on the screen (5) in a shifted and cropped manner while keeping the position of the object (10) relative to the screen (5) constant. [2] Method according to claim 1, characterized by that the screen (5) outside the cropped field of view partial image is supplied with stored image content, in particular with the image content last shown in this area. [3] Method according to claim 1 or 2, characterized by that the object (10) is a stationary object with respect to the respective field of view (11). [4] Method according to one of claims 1 to 3, characterized by that a movement of the screen image is based on a change in the field of view (11), in particular a movement of a camera (1) generating the video data stream. [5] System for inserting data into a digital video signal stream, wherein a screen image can be generated on a screen (5) by means of the video signal stream and an image content (15) spatially associated with an object (10) in the screen image can be superimposed by means of the data, with a processing device (4) receiving the video signal stream and controlling the screen (5) and devices for inputting the data into the processing device (4), wherein the input devices comprise a touchscreen forming the screen (5), a pen interface and / or a computer mouse, characterized bythat the processing device (4), at least during the insertion of the data, displays the field of view (11) corresponding to the respective video signal stream on the screen (5) in a shifted and cropped manner such that the object (10) maintains its position relative to the screen (5). [6] System according to claim 5, characterized by that a camera (1) generating the video signal stream is provided. [7] System according to claim 6, characterized by that the camera (1) is a camera worn on the head of a user. [8] System according to one of claims 5 to 7, characterized by that data glasses (8) connected to the processing device (4) and / or a recording / playback device (6) are provided for a user. [9] System according to claim 8, characterized by that only the image content generated by the data insertion can be displayed in the data glasses (8) (augmented reality).

Images