Device for work support in a predefined work area within an assigned spatial profile

Abstract

Device (100) for supporting work in crafts within a predefined work area (310) within an assigned spatial profile (200), comprising at least one input device (110, 140) for entering work parameters to be displayed in the predefined work area (310), an image generation device (120) for generating image data at least on the basis of the work parameters to be displayed, and a projection device (150) for converting the image data into a predefined image (405) and for projecting the predefined image (405) onto an assigned projection surface (320) in the predefined work area (310), characterized in that the input device (110, 140) has a gesture evaluation device (140) which is designed to capture and evaluate gestures performed within the predefined work area (310) by a user (400) of the device (100) for entering the work parameters to be displayed.wherein the work parameters to be displayed are designed as light points (410; 510) for positioning a borehole in the working area (310).

Description

State of the art

[0001] The present invention relates to a device for work support in a predetermined work area within an assigned spatial profile, comprising at least one input device for inputting work parameters to be displayed in the predetermined work area, an image generation device for generating image data at least on the basis of the work parameters to be displayed, and a projection device for converting the image data into a predetermined image and for projecting the predetermined image onto an assigned projection surface in the predetermined work area.

[0002] Such a device is known from DE 100 57 791 A1. It is designed for use in harsh continuous operation in an associated working environment, e.g., as a work aid for mechanics and maintenance personnel, and is designed to project optical information such as pictograms or drawings onto surfaces located at any distance from the device.

[0003] A disadvantage of the prior art is that such a device only allows for the limited projection of complex images and can only display predefined optical information. For this to work, the user must provide the device with the relevant data before each use or interrupt its operation to modify this data.

[0004] Furthermore, US patent 2008 / 0028325A1 discloses an input / output (I / O) system for which a system and a method are provided. The I / O system includes a screen and a gesture control system.

[0005] WO 2012 / 135 554A1 discloses a head-mounted device for an immersive virtual or augmented reality experience to display data and enable collaboration between multiple users. Disclosure of the invention

[0006] One object of the invention is therefore to provide a new device for projecting a predetermined image onto an associated projection surface in a predetermined spatial profile, which is also suitable for projecting elaborate and complex images and in which the optical information displayed by it can be modified during the operation of the device.

[0007] This problem is solved by a device for work support within a predefined work area and an associated spatial profile, comprising at least one input device for entering work parameters to be displayed within the predefined work area, an image generation device for generating image data at least based on the work parameters to be displayed, and a projection device for converting the image data into a predefined image and projecting the predefined image onto an associated projection surface within the predefined work area. The input device includes a gesture evaluation device designed to capture and evaluate gestures performed by a user of the device within the predefined work area to input the work parameters to be displayed.

[0008] The invention thus enables the provision of a device in which optical information displayed during operation can be modified by the user through gesture control.

[0009] According to one embodiment, the gesture evaluation device has at least one depth sensor. In addition, or alternatively, the gesture evaluation device can have at least one TOF (Time Of Flight) camera.

[0010] This allows for the provision of a cost-effective and robust gesture evaluation system.

[0011] According to one embodiment, an environment detection unit is provided for the three-dimensional detection of the work area, which is designed to provide the image generation device with three-dimensional spatial data derived from the three-dimensional detection, which is combined by the image generation device with the operating parameters to be displayed when generating the image data.

[0012] The invention thus enables the generation of image data in a simple way.

[0013] The environmental sensing unit preferably includes at least one depth sensor. Alternatively, or in addition, the environmental sensing unit may include at least one time-of-flight (TOF) camera and / or at least one laser scanner.

[0014] This allows for the provision of a cost-effective and robust environmental sensing unit.

[0015] According to one embodiment, the image generation device has at least one processor, in particular a microprocessor.

[0016] The invention thus enables the provision of a simple and uncomplicated image generation device.

[0017] According to one embodiment, the projection device includes a spatial light modulator (SLM) and / or a MEMS laser scanner.

[0018] The invention thus enables the provision of a reliable and stable projection device.

[0019] Preferably, the device according to the invention for work support in a predetermined work area within an assigned spatial profile is a device capable of precisely capturing a spatial profile or an assigned 3D environment from a freely selectable stationary viewpoint at a specific spatial angle and processing the captured data in such a way that useful information or objects can be displayed at specific points of the spatial profile at a corresponding spatial angle via the integrated projection device. Furthermore, the device captures the user, who can interact directly with the information projected into the spatial profile, e.g., via gestures.

[0020] In addition to the displayed objects, such as lines or drill hole positions, which can support DIY projects, informative measurements between displayed objects and between the displayed objects and automatically extracted surrounding objects can be shown. For example, in addition to the drill hole position (in the form of a cross), the corresponding distance of the cross from the ceiling can be displayed. Furthermore, objects from the room profile can be automatically extracted, and guide lines can be displayed within the room profile to aid in aligning new objects with existing ones. Buttons and objects for user interaction can also be displayed, allowing the user to interact with the displayed information and objects. For example, a projected plus / minus button could be used to manually adjust the distance of the drill hole position from the ceiling.

[0021] Furthermore, the operating parameters to be displayed can be entered via another suitable input device, e.g., a display on the device, in particular a touchscreen, so that the user can, for example, view a corresponding wall surface from a certain distance in order to make changes to the operating parameters being displayed. In addition, the device can be configured to make design suggestions and provide corresponding assistance during the work process.

[0022] Furthermore, the device enables more relaxed working conditions, as, for example, hanging pictures can now be done by a single person, since one person no longer needs to hold the picture (risk of damage) while another views the result from a distance. Additionally, a photo and / or a 3D model of the room profile generated by the device can be transferred to an external device (e.g., PC, iPad, smartphone, etc.) via interfaces such as USB, Bluetooth, Wi-Fi, etc. A corresponding software application can then allow the user to interactively position objects to be hung, including the necessary drill holes. Once the user has finished, which they can do even away from the room profile or work area, e.g., on a train, bus, in a neighboring room, etc., he can transfer desired borehole positions and other data back to the device, which then projects them as described above. Brief description of the drawings

[0023] The invention is explained in more detail below with reference to exemplary embodiments illustrated in the drawings. The drawings show: Fig. 1 a schematic block diagram of a mobile projection system according to one embodiment, Fig. 2, Fig. 3, Fig. 4, Fig. 5 to Fig. 6 schematic views of an exemplary first spatial profile in which the mobile projection system of Fig. 1. It is used for projecting boreholes, and Fig. 7, Fig. 8, Fig. 9 to Fig. 10 schematic views of an exemplary second spatial profile, in which the mobile projection system of Fig. 1 is used for projecting alignment proposals. Description of the exemplary implementations

[0024] Fig. Figure 1 shows an exemplary device 100 for work support in a predefined work area within an assigned spatial profile. This device has, by way of example, five components: an environment detection unit 130 (hereinafter referred to as "3D-UEE" for the sake of simplicity), a projection device 150 (hereinafter referred to as "IDE" for the sake of simplicity), an image generation device 120 (hereinafter referred to as "DVE" for the sake of simplicity), a gesture evaluation device 140 (hereinafter referred to as "NEGE" for the sake of simplicity), and an input device 110, which is designed, for example, as a touchscreen or has another suitable display with an associated input unit, e.g., a keyboard.

[0025] The 3D-UEE 130 is preferably a depth sensor or depth image sensor designed to generate a dense and precise 3D point cloud within a defined solid angle (e.g., a 50° image diagonal). Active methods such as triangulation with structured light and time-of-flight (TOF) cameras are preferred over passive methods (stereo cameras). Currently, the latter do not generate regular, dense point clouds, but only depth information based on detected corresponding intensity features in a left and right camera image, and they struggle with untextured surfaces (e.g., white-painted walls). The 3D-UEE 130 can also be implemented using a laser scanner, which scans a defined solid angle area point by point and determines the light travel times and thus the distances for each point, as indicated by arrows 132 and 134.

[0026] The NEGE 140 can be implemented using the same sensor as the 3D-UEE 130 or can utilize an additional sensor, such as another camera, particularly a TOF camera. Specifically, the NEGE 140 can enable gesture-guided, interactive menu navigation, allowing a user to control the device 100 solely through appropriate gestures.

[0027] The DVE 120 consists of a processor, in particular a microprocessor, which processes the 3D raw data generated by the 3D-UEE 130, extracts geometric objects (e.g. edges, corners, surfaces), prepares information to be displayed (e.g. lines, boxes) and controls user interaction.

[0028] The IDE 150 receives information from the DVE 120 and projects the information to be displayed into its surroundings. Various projection methods (e.g., MEMS laser scanner, SLM, etc.) can be used, as indicated by arrows 152 and 154.

[0029] The input device 110 is used for the manual input and display of operating parameters, as indicated by arrows 112 and 114. Furthermore, the device 100 may have an automatic leveling function.

[0030] The device 100 can be used as described below: First, a user places the device 100 on a table or tripod and aligns it within a predefined spatial profile so that a desired work area ("AB") is covered by the device's field of view ("FOV"). To assist with this, the boundaries of the field of view are projected onto the spatial profile by the IDE 150. An optional leveling function can level the device 100 so that it stands flat. Ideally, the device 100 should then remain stationary for the duration of its use.

[0031] In the next step, the device 100 measures the AB and generates a 3D point cloud describing it. Depending on the measurement duration, a progress indicator projected onto the AB can assist with this process. Once the AB has been measured, which can take several seconds, the device is ready for use.

[0032] In the next step, a freely positionable menu is projected onto the AB screen, allowing the user to select a desired function. This selection can be confirmed, for example, by gesture control or by tapping a projected menu item, e.g., on the wall. Subsequently, one of the core functions of the device 100 is activated, for example, a core function for positioning a drill hole at a defined distance from the ceiling and an existing drill hole.

[0033] Here, the user enters a starting position, either through a non-contact gesture (pointing with an index finger), by tapping the wall at the desired starting position, or via another input method. The device then displays the selected starting position, for example, with a dot or cross, and additionally outputs dimensions to the ceiling and / or other extracted objects. Which objects are automatically extracted from the AB (array) or the associated 3D point cloud can be configured, preferably in corresponding option menus, such as projected menus.

[0034] In the final step, the user can manually fine-tune the position of the drill hole or use automatic alignment functions. Afterwards, they can drill the hole or continue with positioning further drill holes.

[0035] In an alternative, second core function, the Device 100 supports the positioning and alignment of, for example, pictures or picture frames. For this purpose, the user holds, for example, a picture to be hung in the AB (Above the Wall), the Device 100 extracts the dimensions of the picture and projects an abstract, digital representation of the picture onto the AB. The user can then adjust the desired image position by interacting with this projected image using non-contact gestures ("point to desired image position") or by moving the image along a path traced with a finger on a corresponding wall surface, or by other input methods. The DVE 120 assists the user by displaying guide lines that run, for example, along the edges of existing objects (e.g., pictures hanging in the AB). If desired, the projected picture to be hung can be automatically aligned to these guide lines.Once the desired image position has been found, the corresponding drill hole positions can be conveniently entered and displayed. For example, the image to be hung can be held with its back facing the 3D-UEE 130 to extract the required drill hole positions. However, the device 100 can be used not only for hanging pictures, but also for hanging any other objects, such as posters, porcelain items, etc.

[0036] The two core functions described above are exemplified below. Fig. 2, Fig. 3, Fig. 4, Fig. 5, Fig. 6, Fig. 7, Fig. 8, Fig. 9 to Fig. 10 further described.

[0037] When placing multiple objects (e.g., images) in the layout, the system can generate up to 100 design suggestions (e.g., equidistant placement of the objects between two wall edges, etc.) taking into account recognized design principles (e.g., the golden ratio, etc.). The user can view the various options sequentially and, if desired, modify the best one to their liking. It is also conceivable that, for example, a current wallpaper pattern could be considered in the suggestions.

[0038] Another application of the Device 100 is tiling assistance: If, for example, a wall (which may also contain doors or windows) is to be tiled, the Device 100 can measure this surface. After entering the edge length of the tiles to be used, it can calculate how they can be optimally positioned, minimizing the effort required for cutting. The IDE 150 can then project an optimal tile pattern onto the surface. Furthermore, the user can also be assisted with cutting the tiles by projecting the corresponding number and type of cuts (with dimensions) onto the surface.

[0039] Another application of the Device 100 is to assist with painting a wall: If the user wants to do more than just paint a wall a single color, but instead decorate it with geometric shapes (e.g., rectangles or similar) in a different color, the Device 100 can project these onto the work surface. This offers the advantage that the user can better assess the result.

[0040] As previously described, the size or type of structures can also be changed via gesture recognition. When masking off the areas to be painted, projected lines can be used as guidelines. Similarly, larger objects are often painted on the walls in children's rooms (horses, fairytale castles, etc.). Here, the Device 100 can also assist with evaluating, adjusting the size, and drawing the lines.

[0041] Fig. 2, Fig. 3, Fig. 4, Fig. 5 to Fig. 6, which will be referenced across all characters below, exemplify the following: Fig. 1 described, first core function of the device 100 of Fig. 1, in which the device 100 is used for work support, in particular for determining boreholes, in a predetermined spatial profile 200. Fig. Figure 2 shows the room profile 200, which illustrates a room corner with a floor 205 and a first side wall 210, which in a corner 240 abuts a second side wall 220, in which, by way of example, a door 230 is provided.

[0042] In a Fig. In the first step shown in Figure 3, a user of the device 100, which here is illustrated with a tripod 340, positions it on the floor 205 in the spatial profile 200 such that a projection surface 320 of the device 100 and a working area 310, in which the boreholes are to be drilled, coincide. The device 100 then optionally levels itself and measures the working area 310 as described above.

[0043] Once the surveying of work area 310 is complete, the work area can be started in Fig. Four users, designated with 400, after selecting the first core function, mark a first drill hole position as the starting position on the side wall 210 with a finger, which then appears as the first light point 410. Furthermore, the device provides several helpful dimensions 422, 424 as examples, which are projected onto the side wall 210 as a predefined image 405 along with the first light point 410. The dimensions 422, 424 indicate, for example, the distance of the selected first drill hole position or the first light point 410 from the ceiling and from the corner 240.

[0044] As in Fig. As shown in Figure 5, the user can then easily place further boreholes 400, the position of which relative to the first borehole position 410 or any other objects in the work area 310 is directly displayed due to the known three-dimensionally measured work area 310. For illustrative purposes, the user selects a second borehole position, which appears as a second light point 510 and for which helpful dimensions 522 are also displayed.

[0045] As in Fig. As shown in Figure 6, dimensions 422, 424, 522 can be hidden after completion of the appropriate placement of the borehole positions 410, 510, and the user 400 can, for example, begin drilling using a suitable hand-held power tool 600.

[0046] Fig. 7, Fig. 8, Fig. 9 to Fig. The 10 figures, which are subsequently referenced across all characters, exemplify the following: Fig. 1 described, second core function of the device 100 of Fig. 1, in which the device 100 is used to support work, in particular to supplement a series of images, in a given spatial profile 700. Fig. Figure 7 shows the room profile 700, which illustrates a room corner, with the floor 205, the first side wall 210, the corner 240, the second side wall 220 and the door 230. Fig. 2. In contrast to the room profile 200 of Fig. 2. In the room profile 700 on the side wall 210, two pictures 710, 720 are attached to associated fastening elements 712 and 722 respectively.

[0047] In a Fig. In the first step shown in section 8, a user of the device 100, which in turn is mounted on the tripod 340, is positioned. Fig. 3 has this in such a way in the room profile 700 on the floor 205 that the images 710, 720 in the work area 310 of Fig. 3 of the device 100 are located. The device 100 then optionally levels itself and measures the working area 310, as described above.

[0048] Once the surveying of work area 310 is complete, the work area can be started in Fig. 9 users marked with 400, e.g., after selecting the second one, at Fig. The core function described in section 1 is to point to a location 910 to supplement its image series, or the device 100 can also suggest the location 910 automatically. This can be supported by the device 100 displaying guidelines 902, 904. Furthermore, the device 100 can then display a corresponding picture frame at the location 910, including the necessary borehole 912 and corresponding helpful dimensions 914, 922.

[0049] In Fig. Figure 10 shows the final result, with the series of images formed by images 710, 720 and the supplementary image 910.

Claims

[1] Device (100) for work support during manual work in a predefined work area (310) within an assigned spatial profile (200), comprising at least one input device (110, 140) for inputting work parameters to be displayed in the predefined work area (310), an image generation device (120) for generating image data at least on the basis of the work parameters to be displayed, and a projection device (150) for converting the image data into a predefined image (405) and for projecting the predefined image (405) onto an assigned projection surface (320) in the predefined work area (310), characterized by, that the input device (110, 140) has a gesture evaluation device (140) which is designed to detect and evaluate gestures performed within the specified working area (310) by a user (400) of the device (100) to input the work parameters to be displayed, wherein the work parameters to be displayed are designed as light points (410; 510) for positioning a borehole in the working area (310). [2] Device according to claim 1, characterized by that the gesture evaluation device (140) has at least one depth sensor. [3] Device according to claim 1 or 2, characterized by that the gesture evaluation device (140) has at least one TOF camera. [4] Device according to any one of the preceding claims, characterized by, that an environment detection unit (130) is provided for the three-dimensional detection of the work area (310), which is designed to provide the image generation unit (120) with three-dimensional spatial data derived from the three-dimensional detection, which are combined by the image generation unit (120) with the work parameters to be displayed when generating the image data. [5] Device according to claim 4, characterized by that the environmental sensing unit (130) has at least one depth sensor. [6] Device according to claim 4 or 5, characterized by that the environmental sensing unit (130) has at least one TOF camera and / or at least one laser scanner. [7] Device according to any one of the preceding claims, characterized by , that the image generating device (120) has at least one processor, in particular a microprocessor. [8] Device according to any one of the preceding claims, characterized by , that the projection device (150) has a spatial modulator for light and / or a MEMS laser scanner.

Images