Processing of visually representable information
Patent Information
- Application Number
- DE102018222148
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2018-12-18
- Publication Date
- 2025-03-27
- Estimated Expiration
- Not applicable · inactive patent
Smart Images

Figure 00000000_0001_ABST 
Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a device and a method for processing visually representable information with information units that are linked to each other in pairs by visually representable links according to a predefined relationship. The invention further relates to a computer program for processing visually representable information.
[0002] It is common practice to present visually representable information in a structured manner, for example, on walls or boards (e.g., whiteboards). Parts of the information to be presented, referred to below as information units (which can alternatively be called information parts or subsets), are each represented in a specific area of the available display surface. Furthermore, the information units are usually connected to each other by lines to represent the relationships between two information units as links. These links may include branches and / or intersections. For example, a tree diagram may contain a branch at various points in the diagram. If a different type of relationship is to be represented, links can be depicted in a distinguishable way.
[0003] In practice, for example, sticky notes are used to represent information. Each sticky note contains the relevant information from a given unit (such as text, numbers, and / or graphics), and the sticky note is then affixed to the desired location within the overall representation. Connections between adjacent units of information, particularly on the sticky notes, can be represented by lines drawn on the background or by linear materials such as threads or ropes. To differentiate between various types of relationships, different colored threads, such as woolen threads, can be used. For example, black threads represent relationships within an organizational chart, while blue threads might indicate that individuals from different departments collaborate.
[0004] Such structures, also referred to as hierarchical due to their linear connections, can also be used to represent other information and relationships. These include, for example, work tasks that an organization must perform. The term Scrum, for instance, refers to a process model for project and product management, particularly for agile software development. Especially in agile development methods like Scrum, input information / requirements for a product to be developed are created as structured information in the form of a so-called backlog. Such backlogs can also be visualized using the structured representation described above.
[0005] The aforementioned structured information can be displayed not only in a physical space using the aforementioned walls or boards, but alternatively or additionally on a screen or other display unit that is the output device of a computer or computer network. Accordingly, the information can exist as computer-processable data, and software can be used that allows a user to process the displayed information.
[0006] However, the display options are limited. In particular, information cannot be displayed beyond the edges of a computer screen or within the projection area of a projector. As the amount of information increases, the display therefore either becomes cluttered or only parts of the total information can be viewed at any one time.
[0007] DE 20 2017 105 262 U1 reveals a system, comprehensive: a computer device configured to create a virtual reality environment, including the computer device: a memory that stores executable instructions; and a processor configured to execute the instructions to cause the computer to do the following: Displays, on a display of a head-mounted display device (HMD), a virtual environment; Determine, outside of the HMD, an initial gesture input; Generate, in response to the detection of the first gesture input, a virtual notation surface; Determine, outside of the HMD, a second gesture input; Displays, in response to the detection of the second gesture input, the virtual Notation interface as a virtual object in a virtual environment; Determine, outside of the HMD, a third gesture input; Annotate, in response to the detection of the third gesture input, the virtual notation surface; and Displaying the annotated notation surface as a virtual object in the virtual environment.
[0008] DE 10 2016 113 060 A1 discloses a method for controlling an object, where the object is arranged in real space and is linked to at least one virtual element of a figure space, wherein the object, a display device, an operating device and / or a control device are functionally connected, comprising the steps: - Determining the position and orientation of the operating device and / or the display device in relation to the object, - Generating a virtual pointer from the determined position and orientation of the operating device and / or the display device, - Selecting the object using the virtual pointer, - Representing the object enriched with the fewest elements of the figure space by means of the representation device, and / or - Controlling the object using the operating device.
[0009] US patent 2009 / 0243957 A1 discloses a system for visualizing information in a multi-display environment, the system comprising the following: a multi-display environment (“MDE”) that includes multiple displays arranged in different planes within a three-dimensional (“3D”) space, where the majority of displays can be operated in such a way that they can display a majority of graphic data objects arranged on the MDE; a coordinate determination module that is operable to determine the position of each of the plurality of displays and to use the determined position of each of the plurality of displays to calculate the position of each of the plurality of graphic data objects; and A placement module for placing multiple graphical decoration objects with direction-indicating properties on multiple graphical data objects, where the multiple graphical decoration objects illustrate relationships between the graphical data objects across multiple displays. The MDE can be a virtual environment.
[0010] It is an object of the present invention to provide a device and a method for processing visually representable information with information units and links of the type mentioned above, which expand the possibilities for the representation and processing of the information.
[0011] It is proposed to represent visually representable information in a virtual three-dimensional space and to process the information, particularly while it is visually perceptible to one or more people in that virtual three-dimensional space. This processing involves using at least one real-world position in a real three-dimensional space, occupied by a person for whom the represented information is visually perceptible. For example, the at least one person operates a positioning device that determines a current real-world position in the real three-dimensional space. This specific real-world position is assigned to a processing position for the information to be represented or displayed and used in the processing of the information. The represented information is also at least partially assigned to a position in a three-dimensional space.For display purposes, however, these are not positions in real three-dimensional space, but rather in the virtual three-dimensional space in which they are displayed. The position determined by the positioning device in real three-dimensional space therefore ultimately affects the display of the information in the virtual three-dimensional space.
[0012] The positioning device can include a movable part, which is moved, for example, by a user. Portable movable parts worn on a hand are known, for instance. According to one embodiment, the movement of the movable part in real space can be tracked by means of a motion tracking system. For this purpose, it is known, for example, to use multiple cameras at different positions and with different detection directions, whereby the position and / or change in position of the movable part is determined from the camera images using image recognition. Alternatively, the tracking system can include multiple distance measuring devices arranged at different positions in real space, each measuring the distance to the moving part.Alternatively or additionally, the moving part can have at least one inertial measuring unit, whereby the change in position in space can be determined by evaluating the measurement signals, in particular from the accelerometers of the measuring unit. If the position of the moving part in space is determined at a specific time or is fixed to a specific position value, it is sufficient to determine the change in position in space in order to determine the actual position at a later time.
[0013] The processing of information to be displayed or displayed using the real-world position can be carried out by means of positions assigned to the information in different spaces. While virtual positions in the virtual three-dimensional space are assigned to the information for display purposes, and the processing of the information can be carried out, in particular by changing at least one of the assigned virtual positions using the real-world position, this is only one possibility.If the information to be displayed or displayed is also assigned corresponding real-world positions in real three-dimensional space, or if each real-world position is assigned to one of several real three-dimensional spaces, each containing at least one person with a positioning device, then the information can be processed using the specific real-world position, either alternatively or additionally. Particularly when different people are present in different real-world spaces, a common processing space can also be defined. This processing space can be the virtual three-dimensional space in which the information is displayed or is to be displayed. However, the processing space can also be a space used solely for the purpose of processing the information.In this case, positions in the processing space correspond both to a position in the virtual three-dimensional space and to a position in each of the existing real three-dimensional spaces. As mentioned, there may also be only one real three-dimensional space. With continuous or repeated display of the information in the virtual three-dimensional space, the number of real three-dimensional spaces can change over time. This occurs, for example, when an additional person joins the process to view the information in the virtual three-dimensional space and participate in a change to the information or its display. The same applies when a person no longer participates in changing the information or its display.Then, this person will not trigger any determinations of real positions in the three-dimensional space in which the person is located, except, of course, if there is at least one other person in the space who participates in changing the information or its representation.
[0014] The information comprises multiple information units. Reference is made to the introductory description in this context. It should be added that each information unit contains, for example, information that can be represented as text, image, video, symbol, or an arrangement of symbols. During the display of the information in the virtual three-dimensional space, the information within each unit is represented accordingly. The representation of the unit's content can change over time, for example, at a user's command. It is not always necessary to display all of the information within the unit. At a user's command, i.e., specifically one of the aforementioned individuals, a portion of the unit's existing information can be added to and / or removed from the display over time.Despite its distance, the information remains part of the information unit. This does not preclude the possibility of additional information being added to the information unit over time. In fact, this possibility is preferred and is particularly necessary when building the overall information.
[0015] Each unit of information is assigned at least one virtual position in the virtual three-dimensional space. The preceding description regarding the correspondence of positions in the virtual three-dimensional space, in one or more real spaces, and optionally in the processing space, applies in particular to the assigned virtual position(s).
[0016] Regarding the corresponding positions in different spaces, it should be briefly noted that the technique of transforming positions into other spaces is generally known, especially in image data processing. With a one-to-one correspondence between positions in different spaces, a transformation matrix can be defined for each pair of spaces. Applying this matrix uniquely converts a position in one of the two spaces into a position in the other. For example, the positions in the different spaces can each be mathematically defined as a vector with three components, such as the coordinates of a three-dimensional Cartesian coordinate system. Multiplying this vector by the transformation matrix yields the vector of the corresponding position in the other space or coordinate system. These three-component vectors are mathematically called position vectors.In a possible visual representation, the vectors run from the origin of the coordinate system to the position in space. To calculate positions of the second (other) three-dimensional space in the first (one) space, the inverse matrix of the previously mentioned transformation matrix can be used.
[0017] The invention has the advantage that the virtual three-dimensional space provides a fundamentally unlimited space while still allowing the information to be displayed clearly. In particular, the display output can be selected and / or viewed in such a way that a large amount or subset of the information can be viewed simultaneously while maintaining clarity. Specifically, it is possible for a user viewing the display to navigate within the three-dimensional space. During navigation, the user changes the viewing direction and / or the size of the area in which the information or part of the information is displayed by means of a suitable command.In particular, the representation in three-dimensional virtual space makes it possible to display information not just on a single plane, as is the case when displaying it on a wall in a real room or on a blackboard. Compared to two-dimensional display on a computer screen, the representation in virtual three-dimensional space is also clearer.
[0018] As mentioned at the beginning, the information units are linked to each other by visually representable connections. These can be, in particular, linear connections, such as straight lines. The connections represent a predefined type of relationship between at least two of the information units. As mentioned, the relationship can, for example, consist of two people or organizational units being directly dependent on each other. One person or organizational unit might, for instance, be the one giving instructions to the other. This example illustrates that the connection can optionally also be directional. The direction of the connection can therefore also be significant. However, there are also undirected connections, such as...This is the case when two people or organizational units, each associated with one of the information units, collaborate, and this collaboration is the predefined type of relationship. Directed and undirected links can also occur with other structured information. The direction of a link can be represented in various ways. For example, in an organizational chart, the person or organizational unit higher in the hierarchy can be shown above the person or organizational unit immediately below them in the hierarchy. However, it is also possible, for example, to use arrows to represent directed links.
[0019] An organizational chart is just one example of structured information. For instance, the information can depict a chronological sequence of actions and / or procedural steps (e.g., processing steps), with each action or procedural step corresponding to a unit of information. Alternatively or additionally, the information can, for example, take the form of a mind map, with each thought corresponding to a unit of information.
[0020] In particular, with different types of structured information, at least one information unit can be in a hierarchical relationship with at least one other information unit, whereby a rank of the information unit within the hierarchical relationship is visually represented by the virtual position of the information unit and / or a visual link between the information unit and the other information unit.
[0021] In particular, the following is proposed: A device for processing visually representable information with information units that are linked to each other in pairs by visually representable links according to a predefined type of relationship, wherein the device comprises: - a display device designed to generate display data that defines a visual representation of the visually representable information in a virtual three-dimensional space, wherein • each of the information units is assigned a virtual position in the virtual three-dimensional space, or is assigned one by the display device, and the display device generates the display data in such a way that the information units are each displayed at the assigned virtual position in the virtual three-dimensional space, • for pairs of interconnected information units to which different virtual positions are assigned, in which a visually representable link exists in the display data or is generated by the display device, - an assignment device designed to receive a real position in a real three-dimensional space from a position determination device via an input interface of the device and to assign it to a processing position, - a processing unit connected to the assignment unit and designed to process and / or access the information, so that, using the processing position • the processing position is assigned as a virtual position to an information unit, • the assigned virtual position of one of the information units is changed, • the information unit whose assigned virtual position corresponds to the processing position is selected, or • a link is created or changed between one of the pairs of linked information units.
[0022] In particular, the device may have or be combined with an output device which is connected to the display device and is configured to output the display data or a part thereof, so that the information units and links in a representation of the virtual three-dimensional space are visually perceptible.
[0023] Furthermore, the following is proposed: A method for processing visually representable information with information units that are linked pairwise by visually representable links according to a predefined type of relationship, wherein: - a display device generates display data that defines a visual representation of the visually representable information in a virtual three-dimensional space, wherein • each of the information units is or will be assigned an associated virtual position in the virtual three-dimensional space, and the display data defines that the information units are each displayed at the assigned virtual position in the virtual three-dimensional space, • for pairs of interconnected information units to which different virtual positions are assigned, in which a visually representable link exists or is created in the representation data, - the display device transmits at least part of the generated display data, so that the transmitted data can be received or is received by an output device that outputs the transmitted data or at least part of it, so that the information units and the links in a representation of the virtual three-dimensional space are visually perceptible, - a real position in a real three-dimensional space is received and assigned to a processing position, - A processing unit receives the processing position and processes and / or accesses the information, so that, using the processing position • the processing position is assigned as a virtual position to an information unit, • the assigned virtual position of one of the information units is changed, • the information unit whose assigned virtual position corresponds to the processing position is selected, or • a link is created or changed between one of the pairs of linked information units.
[0024] The device is, for example, a computer or a computer network that has a corresponding implementation for performing its functions. At least the display unit, the allocation unit, and the processing unit can be implemented by program code in software and / or hardware. The display data or the portion of the display data transmitted by the display unit can be transferred to the aforementioned output unit. Whether only a portion of the display data is visually perceptible can depend, in particular, on user behavior. The selection of a visually perceptible portion can be effected with or without the involvement of the display unit.Another way to visually display only a portion of the display data, besides using the display device itself, is to control the output device, for example, indirectly via a graphics processing unit or another unit that is connected to the display device for receiving display data and to the output device for transmitting display data. Particularly with information consisting of several separate information structures that are not linked or have only a small number of links, it can be useful to visually display only a portion of the information.
[0025] Editing the display data can involve, for example, changing the position of at least one of the information units. As with other editing processes, it is possible to receive not just one, but at least two real positions and use corresponding editing positions. For example, the information unit can be changed from the previously assigned virtual position, which corresponds to (or is) a first editing position, to another virtual position, which corresponds to (or is) a second editing position.
[0026] The display data can be edited not only before the first visually perceptible output of the data, but also, and more importantly, while it is visually perceptible to at least one person. The display defined by the display data can be repeatedly edited using the single editing position or multiple editing positions. The resulting changes to the display data can be continuously displayed during the editing process by outputting correspondingly updated display data. This allows a user to directly recognize the result of the editing or even the editing process itself. For example, the user might operate the positioning device in such a way that a real position is continuously or repeatedly determined and transmitted to the device over a period of time.The process takes this into account. Accordingly, a processing position is assigned continuously or repeatedly, which is used when processing the information. For example, the user creates or defines a movement in real three-dimensional space, according to which the positioning device repeatedly or continuously determines and transmits the real position, so that the real positions are positions on a movement path. For example, combined with a user-generated command, this can be interpreted during information processing as "pulling" the assigned position of an information unit and / or a link, and corresponding processing of the information takes place. For example, in this way, an information unit is moved from a previously assigned virtual position to a new assigned virtual position in the virtual three-dimensional space.
[0027] Another advantageous processing method is the insertion of additional information units while the information is visually perceptible in the virtual three-dimensional space. Through a user-initiated command and a real-world position determined by the positioning device, which is assigned a processing position, a corresponding virtual position in the virtual three-dimensional space is selected. An information unit designated by the user or another user is then inserted at this position; that is, this information unit receives the processing position or a corresponding virtual position in the virtual space as its assigned position. Depending on the type of virtual position and the information involved, further processing of the information can occur automatically. For example...The position corresponding to the actual position determined by the positioning device may lie within a link between two existing information units. In this case, the information unit to be added can be inserted at this position, and links between the inserted information unit and the information units connected via the existing link can be automatically created. Optionally, the existing link can be automatically dissolved or removed from the information, either automatically or upon user command.
[0028] In particular, the processing device can therefore process the information in such a way (and be designed in such a way) that, using the processing position, one of the visually representable links is removed, an inserted information unit is inserted, and new visually representable links of the inserted information unit are created to each of those previously linked information units that were linked together by the removed link.
[0029] According to one embodiment of the device and the method, at least one of the information units can have a link to external information, wherein the link can be activated using the editing position (and, for example, triggered by a corresponding user command) so that the external information is loaded and / or perceptible in the virtual three-dimensional space by outputting corresponding display data. This allows the information units to be expanded without initially containing an excessive amount of information.
[0030] The display data defines a visual representation of the visually representable information such that information units are displayed in a plurality of display surfaces within the virtual three-dimensional space, with the display surfaces being oriented in different directions. The display setup can be designed accordingly. In particular, at least one of the display surfaces can be a flat display surface in the virtual three-dimensional space. Alternatively or additionally, at least one display surface can be curved, e.g., in the manner of a curved projection surface of a real image or video projection system. The fact that the display surfaces are oriented in different directions enables a particularly clear perception by the user(s). For example,The display surfaces in the virtual three-dimensional space can appear as the surfaces of building walls. This allows at least one user to orient themselves using the building structure and intuitively distinguish between the information displayed on the different surfaces. This also facilitates communication between different users. For example, one user can easily point a second user to the information on a particular wall or display surface, such as "the wall on the left in the room." Other building structures can also be visually represented in the virtual three-dimensional space, such as individual wall textures or colors, textured floors (like carpeting), ceilings, furnishings, doors, and / or windows. Furthermore, non-homogeneous lighting in such spaces can be simulated.Therefore, for example, one display area or a sub-area of the display of an information structure with information units and links can be displayed brighter than another display area or sub-area.
[0031] The structure of the information presented or to be presented is not limited to the representation of a single predefined type of relationship. The visually representable links are first links, where the predefined type of relationship, according to which the information units are linked pairwise by the first links, is a first type of relationship. A second type of relationship, different from the first type, is also predefined, and a plurality of the information units are linked pairwise by second visually representable links according to the second type of relationship. The different types of relationships are represented by visually distinguishable representations of the corresponding links. The first and second links are visually distinguishable from one another.
[0032] The first links are represented by the display data as lines such that they run along a first principal direction in the virtual three-dimensional space, and the second links are represented by the display data as lines such that they run along a second principal direction in the virtual three-dimensional space, which runs perpendicular to the first principal direction. Upon receiving a corresponding trigger command, the display device changes the virtual positions assigned to the information units in the virtual three-dimensional space, at least for a majority of the information units, and modifies the visual representations of the first and second links so that the first links run as lines along the second principal direction and the second links run as lines along the first principal direction.If the editing space differs from the virtual three-dimensional space, the changes to these positions and the course of the links can optionally take place in the editing space and be adopted accordingly for the virtual space by the display device.
[0033] The at least one positioning device can, in particular, be a device that is movable in real space with respect to all three linearly independent spatial directions. In particular, a real position can be set to that real position by moving the positioning device.
[0034] The positioning device can be configured, in particular, to determine a real movement, for example, of the positioning device itself or at least of a part of the user's body. The device is preferably configured to translate this real movement into a corresponding virtual movement in the virtual three-dimensional space. For this purpose, a scaling factor can be used, for example, which scales the virtual movement relative to the real movement. With the aid of such a scaling factor, a conversion of the movement's coordinates from a real coordinate system to a coordinate system within the virtual three-dimensional space can be performed. The real movement can also change the viewing direction within the virtual space. Alternatively or additionally, the movement can cause zooming in or out.
[0035] The positioning device may alternatively or additionally include, for example, a pointing / input device through which commands can be transmitted to the display device, resulting in movements in the virtual space. The movement may, in particular, be the movement of an information unit or a virtual tool.
[0036] The positioning device may alternatively or additionally include a device for determining the head position and / or head movement of a user, through which commands can be transmitted to the display device, resulting in such movements in the virtual space.
[0037] Optionally, the positioning device or an additional device can be configured to determine a direction or change of direction in real space and to transfer this real spatial direction or change of direction for processing and / or displaying the visually representable information. This can be used, in particular, to adjust the orientation of the information display in the virtual three-dimensional space. For example, if a user moves the appropriately configured positioning device so that it is oriented in a different spatial direction than before, a specific configuration will transfer the change of spatial direction or the new current spatial direction, and the assignment device will, for example, assign a corresponding change of spatial direction or new spatial direction in the processing space and / or the virtual space.The display device modifies the presentation of the display data accordingly, changing the orientation of the information displayed in the virtual space or the orientation of the entire visually perceptible output. Alternatively, or in combination with appropriate operation of the display device, this change can be effected by a transmission device to transmit part or all of the display data to the output device.
[0038] In particular, a user can move the positioning device to a real position in physical space, so that an effect can be achieved or is achieved at the corresponding virtual position in virtual three-dimensional space. For example, the current real position of the positioning device is either continuously or repeatedly transmitted to the assignment device, or the current real position is only transmitted there when a predefined operating mode is executed and / or the transmission is triggered by a command, especially one initiated by the user.
[0039] According to a specific embodiment of the method and the device, the assignment unit can receive real positions in various real three-dimensional spaces via the input interface or be configured accordingly. It assigns each real position to a corresponding processing position. The real positions are received by positioning devices located in the various real three-dimensional spaces. This allows users in different real spaces to access and / or modify the information displayed in the virtual space. At least one position is assigned to each position in a sub-area of the processing space in the various real spaces. Therefore, it is particularly possible that positioning devices in the various real spaces each determine and transmit a real position that corresponds to the same position in the processing space.However, it is also possible that different positioning devices in the same physical space determine the same physical position and transfer it for editing and / or access to an editing position and / or a virtual position. This allows users in the same space to select the same editing position.
[0040] The scope of the invention also includes a computer program for processing visually representable information with information units that are linked to each other in pairs by visually representable links according to a predefined type of relationship, in particular for carrying out the method according to one of claims 7 to 10, wherein the computer program, when executed on a computer or computer network: - Generates representation data that defines a visual representation of the visually representable information in a virtual three-dimensional space, whereby • each of the information units is or will be assigned an associated virtual position in the virtual three-dimensional space, and the display data defines that the information units are each displayed at the assigned virtual position in the virtual three-dimensional space, • for pairs of interconnected information units to which different virtual positions are assigned, in which a visually representable link exists or is created in the representation data, - transmits at least part of the generated representation data so that the transmitted data can be received by or is received by an output device that outputs the transmitted data or at least part of it, so that the information units and the links in a representation of the virtual three-dimensional space are visually perceptible, - receives a real position in a real three-dimensional space and assigns it to a processing position, - processes and / or accesses the information, so that, using the editing position • the processing position is assigned as a virtual position to an information unit, • the assigned virtual position of one of the information units is changed, • the information unit whose assigned virtual position corresponds to the processing position is selected, or • a link is created or changed between one of the pairs of linked information units.
[0041] Implementation of the computer program results from implementation of the method. Furthermore, the invention includes a data carrier, for example a portable optical data carrier, or the working memory or hard drive of a computer, on which the computer program is stored.
[0042] Embodiments of the invention will now be described with reference to the accompanying drawings. The individual figures of the drawing show: Fig. 1 a schematic view of a device according to the invention; Fig. 2 an embodiment of an information unit according to the invention; Fig. 3. An embodiment of a display surface in a virtual, three-dimensional space VDR according to the invention; Fig. 4 a further embodiment of a display surface in a virtual, three-dimensional space according to the invention; Fig. 5 an embodiment of a virtual, three-dimensional space according to the invention; Fig. 6 an embodiment of a virtual, three-dimensional space according to the invention; Fig. 7 a schematic view of an embodiment of a method according to the invention.
[0043] In different embodiments or figures, the same reference numerals may be used for functionally identical devices and elements.
[0044] Fig. Figure 1 shows a schematic view of a device according to the invention. A real, three-dimensional space RDR is shown, to which a three-dimensional coordinate system RK is assigned. A human user 21 of the arrangement wears an output device 10, which is designed as VR glasses. Alternatively or additionally, the output device 10 can be configured differently, in particular, for example, as a monitor, a device that generates a hologram, a virtual reality display, an augmented reality display, and / or a projector, in particular a 3D projector. The output device 10 has a transmitter / receiver 10a, which is wirelessly connected to a transmitter / receiver 10b using electromagnetic waves, for example, using a wireless network connection (WLAN) or a Bluetooth connection.The transmit / receive device 10b is connected to a display device 12, represented by an arrow line, and configured, for example, with a wired connection, such as a USB cable and / or a 1394 bus cable, and / or a wireless connection, such as a Bluetooth connection and / or a wireless network connection (WLAN), and / or via a computer's internal interface. Alternatively or additionally, the output device 10 can also be configured to be connected to the display device 12 with a cable, such as an HDMI cable, and / or a DVI cable, and / or a VGA cable, and / or a DisplayPort cable, and / or a USB cable, and / or a 1394 bus cable.
[0045] User 21 holds at least part of a positioning device 14 in the form of a motion controller in one hand. Alternatively or additionally, the positioning device 14 may have two motion controllers, with user 21 able to hold one motion controller in each hand. Alternatively or additionally, the positioning device 14 may, in particular, include or be a mouse, a 3D mouse, a trackball, a keyboard, a touchpad, a touchscreen, a gamepad, a joystick, a gesture recognition device, a motion sensor, a tracking sensor, an optical sensor, a graphics tablet, a remote control, an eye movement detection sensor, a head movement and position detection sensor, and / or a speech recognition device.
[0046] The positioning device 14 has a transmitter / receiver 14a which is wirelessly connected to a transmitter / receiver 14b using electromagnetic waves, for example, via a wireless network connection (WLAN) and / or a Bluetooth connection. The positioning device 14 is located at a real position RP of the coordinate system RK.
[0047] A virtual, three-dimensional space VDR, perceived by the user 21 using the output device 10, is shown schematically. Within the virtual, three-dimensional space, two display surfaces are shown. One display surface serves to hold information units IE and / or visually representable links VV, comparable to a real wall on which sticky notes can be attached. Information units IE can, for example, be understood as virtual sticky notes. Alternatively or additionally, the virtual, three-dimensional space VDR can have more or fewer than two display surfaces. Each display surface shows several information units IE, which are linked to each other by visually representable links VV. The information units IE each contain three points, which represent any content of the information units IE. The content is described further below in relation to Fig. Figure 2 explains. Information unit IE100 has an assigned virtual position ZVP in the coordinate system VK. A modified assigned virtual position AVP of information unit IE100 is also shown. An arrow indicates the direction of displacement of information unit IE100 from its assigned virtual position ZVP to the modified assigned virtual position AVP due to editing of information unit IE100. Information unit IE100 is linked to the information unit IE102 above it via a visually representable link VV100, which, due to editing, becomes a modified visually representable link AVV (represented by a dashed line). Information unit IE100, due to editing, becomes the displaced information unit IE101 (represented by a dashed line).
[0048] The transmitting / receiving device 10b is connected to the display device 12 via a connection (represented by an arrow line), for example, a wired connection, such as a USB cable and / or a 1394 bus cable, and / or a wireless connection, such as a Bluetooth connection and / or a wireless network connection (WLAN), and / or via a computer's internal interface. Display data DD is transmitted to the transmitting / receiving device 10b via this connection. The display device 12 can be, in particular, a main processor and / or a graphics processor and / or a computer, especially a computer that has a main processor and / or a graphics processor.
[0049] The transmit / receive device 14b is connected to an assignment device 15 and a display device 12. The assignment device 15 is connected to a processing device 16, and the processing device 16 is connected to the display device 12, each represented by arrow lines. Each connection is implemented, for example, via a wired connection, such as a USB cable and / or a 1394 bus cable, and / or a wireless connection, such as a Bluetooth connection and / or a wireless network connection (WLAN), and / or via a computer-internal interface. The transmit / receive device 14b forwards the real position RP, which is detected by the position determination device 14, to the assignment device 15. The assignment device 15 forwards the real position RP and a processing position ZBP to the processing device 16.Processing unit 16 forwards processing data BD to display unit 12. The processing data BD contains, in particular, the modified assigned virtual position AVP, as represented by the bracketed expression. Furthermore, the processing data BD contains, in particular, information about the graphical design of the processing, which is transferred by display unit 12 to display data DD. Additionally, the processing data may contain the assigned virtual position ZVP.
[0050] The allocation device 15 can, in particular, be a main processor and / or a computer comprising a main processor. The processing device 16 can, in particular, be a main processor and / or a computer comprising a main processor. In particular, the allocation device 15, the processing device 16, and / or the display device 12 can be integrated into a common computer and / or processor. The transmit / receive device 14b and / or the transmit / receive device 10b can also be integrated into and / or connected to such a common computer.
[0051] A memory 17 is connected to the display device 12. This memory can be configured, for example, as a hard drive, memory chip, SSD, or other data storage medium. It contains, in particular, information data (IED) that can be displayed in the information units (IE), such as text, hyperlinks, audio files, video files, and / or image files, and / or information about the structure of the virtual, three-dimensional space, such as geometry data and / or textures. Specifically, the memory 17 can contain assigned virtual positions (ZVP). The memory 17 is connected to the display device 12, for example, via a wired connection, such as a USB cable and / or a 1394 bus cable, and / or a wireless connection, such as a Bluetooth connection and / or a wireless network connection (WLAN), and / or via a computer-internal interface.Memory 17 can also be located on a server, for example a network and / or internet server.
[0052] User 21 specifies the real position RP using the positioning device 14, which is then transmitted to the transmitting / receiving device 14b via the transmitting / receiving device 14a. User 21 further specifies, for example by pressing a button that may be present on the positioning device 14, that they wish to perform a relocation operation of the information unit IE100. Alternatively or additionally, User 21 can use a different type of input, such as movement. To do this, they have selected the changed assigned virtual position AVP by positioning the positioning device 14 so that it is in the real position RP.User 21 could locate the real position RP by perceiving a movable pointer, similar to a mouse pointer, or alternatively or additionally another symbol, in the virtual, three-dimensional space VDR. This pointer is generated by the display device 12 in the form of display data DD and by the output device 10, and depends on the real position RP. For this purpose, the real position RP is transmitted from the transmitting / receiving device 14b to the display device 12 via a data connection, for example, a wired or wireless connection. User 21 can use such a pointer, alternatively or additionally, in particular to select and / or create an information unit IE and / or a visually representable link VV.
[0053] The sending / receiving unit 14b provides the assignment unit 15 with the real position RP and generates the processing position ZBP based on it. Using the processing position ZBP, the processing unit 16 determines the modified assigned virtual position AVP, which it forwards to the display unit 12 within the processing data BD. The processing data BD also contains, in particular, information relating to the graphical design of the processing. This can include, for example, information on how the displacement process is animated as a movement. In the present example, the visually representable link VV100 is extended by a movement of the information unit IE100, so that it becomes the information unit IE101, and its angle is changed in the virtual, three-dimensional space VDR.Therefore, the visually represented link VV100 can remain even though the information unit IE100 undergoes a position change. Alternatively or additionally, the visually represented link VV100 can be deleted.
[0054] The assigned virtual position ZVP of the information unit IE100, which may also be required for processing, is determined by user 21 in the same way as the modified assigned virtual position AVP – including the steps of specifying a real position RP and determining a processing position ZBP. The assigned virtual position ZVP may, in particular, have been defined before the modified assigned virtual position AVP and transmitted to the display unit 12.
[0055] From the processing data BD, the display unit 12 generates display data, which is sent to the transmit / receive unit 10a using the transmit / receive unit 10b, so that the output unit 10 can output it for the user 21.
[0056] User 21 can communicate with other users, particularly those working in parallel and / or with a time delay in the virtual, three-dimensional space, using an audio or audio-video telephony system. The display unit 12, the memory 17, the allocation unit 15, and / or the processing unit 16 can be located in a network for this purpose, for example, in a LAN (Local Area Network), a WAN (Wide Area Network), a GAN (Global Area Network), and / or the Internet, particularly in the form of a server.
[0057] The output device 10 can be designed, using appropriate devices, in particular using a data connection entering the display device 12, such that a change in the position of the output device 10 in the real three-dimensional space RDR leads to a change in perspective visible to the user 21 in the virtual space VDR.
[0058] Fig. Figure 2 shows an embodiment of an information unit IE according to the invention. The information unit IE is located within a virtual, three-dimensional space VDR, linked to other information units IE via visually representable links VV. It has an assigned virtual position ZVP of the coordinate system VK. The information unit IE has a visually representable frame 36. Alternatively or additionally, the visual information unit IE may, for example, not have a visually representable frame 36 and / or may have a background that is, for example, monochrome and / or transparent and / or multicolored, for example, specified by the user 21 (see Figure 2). Fig. 1) A visually representable frame 36 can only be displayed as long as the user 21 is editing within the information unit IE. The information unit IE contains written information 31, which is located in the Fig. 2 is represented by the word "text". Such written information can be formatted and edited, similar to a word processing program.
[0059] Furthermore, the information unit IE has a hyperlink 32, represented by the underlined word "Text". Hyperlink 32 can, for example, lead to another information unit (in Fig. 2 not shown, see for example Fig. 1 and Fig. 3-5) within the virtual three-dimensional space VDR, which is displayed when the hyperlink 32 is opened by the user 21 – for example, by changing the perspective of the image provided by the output device 10 to the user 21. Alternatively or additionally, the hyperlink 32 can point to any other electronic document, for example, a file stored in memory 17 or on a server, in particular a server in a network and / or the Internet.
[0060] A reference 33 to an audio file, which the user can open, for example, by pressing a button on the positioning device 14, is represented by a speaker icon. A reference 35 to a video file, which the user 21 can open, for example, by pressing a button on the positioning device 14, is represented by a camera icon. A reference 34 to an image file, which the user can open, for example, by pressing a button on the positioning device 14, is represented by a reduced version of the image. The image file, the video file, and / or the audio file can be stored, in particular, in memory 17. Alternatively and / or additionally, the image file, the video file, and / or the audio file can be stored, for example, on a server, in particular a server in a network and / or the Internet.When the video file is opened, it can be loaded in whole or in part, for example into memory 17 or display device 12 and / or working memory, so that it can be output by output device 10 using display data.
[0061] Fig. Figure 3 shows an embodiment of a display surface in a virtual, three-dimensional space VDR according to the invention. Various area-sized information units IE1 are located in the upper region of the Fig. Figure 3 shows various smaller information units (IE2) below. Information unit IE200 has an assigned virtual position (ZVP1) in the coordinate system (VK). To the right of information unit IE200 is a copied information unit (IE201). It is created by copying information unit IE200. A modified assigned virtual position (AVP) is used for this purpose. The copying process results in the creation of a new, visually representable link (VV201). The copying process is initiated by user 21. This is indicated by an arrow extending into the virtual, three-dimensional space (VDR) from the outside, emanating from the reference symbol (21) enclosed within the frame.
[0062] In the Fig. Figure 3 shows a visually representable link VVE. It links the information unit IE2 with the information unit IE3. The information unit IE2 has an assigned virtual position ZVP2, and the information unit IE3 has an assigned virtual position ZVP3. The visually representable link VVE is created by another user 22 during a link creation process. This is indicated by an arrow extending into the virtual, three-dimensional space VDR from the outside, emanating from the enclosed reference symbol 22.
[0063] Additionally, in Fig. 3. In particular, the following are shown: visually representable links VV2 and VV1, each represented by a line indicating a connection without sequence and / or hierarchy; visually representable links VV3, represented by an arrow line, indicating, for example, a sequence and / or hierarchy. A visually representable link VV4, represented by a double line, can, for example, represent an equation – similar to an equals sign.
[0064] The copying process of the information unit IE200 is triggered by user 21, in which user 21 specifies a real position RP, as in Fig. 1 shown and to Fig. 1 is described. The allocation facility 15 ( Fig. 1) receives the real position RP ( Fig. 1) and generates the processing position ZBP depending on it ( Fig. 1) The processing unit 16 ( Fig. 1) determined using the processing position ZBP ( Fig. 1) a changed assigned virtual position AVP ( Fig. 1), which they within processing data BD ( Fig. 1) to the display unit 12 ( Fig. 1) forwards. The modified assigned virtual position AVP indicates the destination of the copy operation. The processing data BD additionally contains, in particular, information relating to the graphical design of the copy operation.
[0065] The link creation process, in which the visually representable link VVE is created, is triggered by user 22, in which user 22 specifies two real positions RP, analogous to in Fig. 1 shown and to Fig. 1 is described. The allocation facility 15 ( Fig. 1) receives the two real positions RP (analogous to Fig. 1) and generates two processing positions ZBP depending on them (analogous to Fig. 1) The processing unit 16 determines the ZBP using the two processing positions (analogous to Fig. 1) the assigned virtual position ZVP2 of the information unit IE2 and the assigned virtual position ZVP3 of the information unit IE3.
[0066] Processing unit 16 recognizes, using the two real positions RP and the two processing positions ZBP, that user 22 wants to create a visually representable link between information unit IE2 and information unit IE3. Processing unit 16 forwards the assigned virtual position ZVP2 and the assigned virtual position ZVP3 within the processing data BD to the display unit 12. The processing data BD also contains, in particular, information relating to the graphical design of the link creation process and the visually representable link VVE. Specifically, the processing data BD can contain data relating to the graphical design of information units IE2 and IE3, for example, their virtual dimensions based on the coordinate system VK.This allows the display unit 12, for example, to graphically design the visually representable link VVE in such a way that it docks to the outside of the information units IE2 and IE3, respectively, without any gap and without protruding into them.
[0067] Alternatively or additionally, the in Fig. The three displayed information units (IE) do not all lie within a single display area. They can, for example, be distributed across multiple display areas and / or multiple rooms. 44 ( Fig. 6) be distributed or freely located in three-dimensional space VDR. A display surface can, in particular, be on a wall 42 ( Fig. 6) are located in a room 44 and / or graphically correspond to the wall 42. Alternatively, the visually representable link VVE can extend from one display surface to another and / or from one room 44 to another room 44 and / or from any position to any other position within the virtual three-dimensional space VDR. Alternatively, the copying process can extend from one display surface to another and / or from one room 44 to another room 44 and / or from any position to any other position within the space VDR. Information units IE and visually representable links VV between information units IE can be positioned arbitrarily in three-dimensional space.
[0068] Users 21 and 22 can communicate in parallel, for example, using an audio or audio-video telephony system, if they are not in close proximity. If they are in close proximity, they can, for example, use different positioning devices 14 and different output devices 10, but use the same transmit / receive devices 14b and 10b. A virtual figure, such as an avatar, can be used to represent a user within the virtual three-dimensional space VDR.
[0069] Fig. Figure 4 shows a further embodiment of a display surface in a virtual, three-dimensional space (VDR) according to the invention. In the center of Fig. Figure 4 shows a large information unit IE11. Visually representable links VV11 radiate from it, leading to further information units IE12, IE13, IE14, IE15, and IE300. Another visually representable link VV12 leads to yet another information unit IE15. This results in a tree diagram structure.
[0070] Information unit IE12 has a visually representable frame 36. Information unit IE13 has a visually representable frame 37, which is only displayed visually when information unit IE13 is selected, for example, for editing. This is indicated by a dashed line. Information unit IE14 has no frame. Information unit IE15 consists solely of a speaker icon. Information unit IE16 is selected due to an action by a user 21, represented by an arrow extending into the virtual, three-dimensional space VDR, as indicated by a selection frame MR.
[0071] The marking process of the information unit IE300 is triggered by user 21, who specifies a real position RP, as shown in Fig. 1 shown and to Fig. 1 is described. The allocation facility 15 ( Fig. 1) receives the real position RP (analogous to Fig. 1) and generates a processing position ZBP depending on it (analogous to Fig. 1) The processing unit 16 determines the processing position ZBP using the processing position (analogous to Fig. 1) the assigned virtual position ZVP of the information unit IE300.
[0072] Processing unit 16 uses the real position RP and the processing position ZBP to recognize that user 21 wants to mark the information unit IE300. Processing unit 16 forwards the assigned virtual position ZVP within the processing data BD to the display unit 12. The processing data BD also contains, in particular, information relating to the graphical design of the marking process and / or the marking itself.
[0073] Fig. Figure 5 shows an embodiment of a virtual, three-dimensional space VDR according to the invention with a coordinate system VK. Two display surfaces with information units IE are shown on two walls 42a, 42b of a room 44. The information units IE are partially linked to each other across both display surfaces by visually representable links VVI and linked within the display surface by visually representable links VV.
[0074] Wall 42a can be changed in height, in particular enlarged, for example, because more space is needed for information units (IE). This is indicated by vertical arrows PO and PU. Wall 42b can be changed in width, in particular enlarged, for example, if more space is needed for information units (IE). This is indicated by horizontal arrows PL and PR. Alternatively or additionally, wall 42a can be changed in width and / or wall 42b in height.
[0075] Fig. Figure 6 shows an embodiment of a virtual, three-dimensional space VDR according to the invention with a coordinate system VK. Seven display surfaces with information units IE are shown on seven walls 42 of four rooms 44. The information units IE are linked to each other by visually representable links VVI, partly across different display surfaces and / or rooms, and linked within the display surfaces by visually representable links VV.
[0076] Additional rooms 44 can be added to and / or removed from the virtual three-dimensional space VDR. The rooms 44 can be connected to each other by visually representable access points 43 and / or visually representable paths 41 and / or stairs 40. Various display surfaces, walls 42 and / or rooms 44 with their respective information units IE can contain information on different topics, for example, topics that are linked within a broader thematic framework than topics that are present in adjacent information units IE and / or information units within the same display surface. In particular, display surfaces, walls 42, and / or rooms 44 can be designed through variations in the structure and / or color of the walls, floor, and ceiling of the rooms 44.Information units (IE), visually representable links (VV), and relationships built through the information units (IE), such as a tree diagram, a flowchart, a hierarchy, a circuit diagram, etc., can also be individually adapted with regard to color, structure, and other design options.
[0077] Fig. Figure 7 shows a schematic view of an embodiment of a method according to the invention. In a first step S1, the display device 12 ( Fig. 1) Display data DD ( Fig. 1) generates a visual representation of information units ( ). Fig. 1) and visually representable links VV ( Fig. 1) in the virtual three-dimensional space RDR ( Fig. 1) define. This display data DD can, in particular, be designed so that it is sent to an output device 10 ( Fig. 1) can be transmitted. In a second step S2, the display data DD is received by the output device 10. In a third step S3, the display data DD is output to the user 21 ( Fig. 1), whereby alternatively only a portion of the display data DD can be output. In particular, this concerns a portion of the display data DD that allows user 21 to view the virtual, three-dimensional space from a specific perspective. Specifically, this perspective can correspond to the position of user 21's head within the real space RDR. If user 21 turns their head to one side, the perspective can also change accordingly.
[0078] In a fourth step S4, a real position RP in the real three-dimensional space RDR is received, which the user 21 defines, for example, using the positioning device 14. In a fifth step S5, a processing position ZBP is assigned to the real position RP, for example, using the assignment device 15. In a sixth step S6, the processing device 16 receives the processing position ZBP. In a seventh step S7, a processing operation is carried out using the processing position ZBP. For example, this could be a change from the assigned visual position ZVP to a modified assigned virtual position AVP, which is assigned to an information unit IE. Reference symbol list 10 Output device 10a, 10b Transmitting / receiving equipment 12 Display device 14 Position determination and locating device 14a, 14b Transmitting / receiving equipment 15 Assignment facility 16 Processing equipment 17 storage 21 users 22 other users 31 written pieces of information 32 Hyperlinks 33 Reference (link) to an audio file 34 Reference (link) to an image file 35 Reference (link) to a video file 36, 37 visually representable frame 40 visually representable staircases 41 visually representable paths 42, 42a, 42b Wall 43 visually representable access Room 44 AVP changed assigned virtual position AVV changed visually representable link BD processing data DD Display Data IE Information Unit IED Information Data MR marking frame PL horizontal arrow PO vertical arrow PR horizontal arrow PU vertical arrow RDR real three-dimensional space RK three-dimensional coordinate system RP real position S1 to S7 steps VDR virtual three-dimensional space VV, VVE visually representable link ZBP processing position ZVP-assigned virtual position
Claims
[1] Device for processing visually representable information with information units (IE) which are linked to each other in pairs by visually representable links according to a predefined type of relationship, the device comprising: - a display device (12) which is designed to generate display data which define a visual representation of the visually displayable information in a virtual three-dimensional space (VDR), wherein • each of the information units (IE) is assigned an associated virtual position (ZVP) in the virtual three-dimensional space (VDR) or is assigned by the display device (12) and the display device (12) generates the display data such that the information units (IE) are each displayed at the associated virtual position (ZVP) in the virtual three-dimensional space (VDR), • for pairs of interlinked information units (IE) to which different virtual positions (ZVP) are assigned, a visually representable link (VV) is present in the display data or is generated by the display device (12), - an assignment device (15) which is designed to receive a real position (RP) in a real three-dimensional space (RDR) from a position-determining device (14) via an input interface of the device and to assign it to a processing position (ZBP), - a processing device (16) which is connected to the allocation device (15) and which is designed to process and / or access the information, so that using the processing position (ZBP) • the processing position (ZBP) is assigned as an assigned virtual position (ZVP) of an information unit, • the assigned virtual position (ZVP) of one of the information units (IE) is changed, • the information unit (IE) whose assigned virtual position (ZVP) corresponds to the processing position (ZBP) is selected, or • a link between one of the pairs of linked information units (IE) is created or changed, wherein the display data define a visual display of the visually displayable information such that information units (IE) of the information are displayed in a plurality of display areas of the virtual three-dimensional space (VDR), wherein the display areas are oriented in different directions, wherein the visually representable links are first links, wherein the predefined type of relationships according to which the information units (IE) are each linked to one another in pairs by the first links is a first type of relationship, wherein a second type of relationship is predefined which is different from the first type of relationship, wherein a plurality of the information units (IE) are each linked to one another in pairs by second visually representable links (VV) according to the second type of relationship, and wherein the first and second links are visually distinguishable from one another, wherein the first links are represented linearly in such a way that they run in the virtual three-dimensional space (VDR) along a first main direction, wherein the second links are represented linearly in such a way,that they run in the virtual three-dimensional space (VDR) along a second main direction which runs transversely to the first main direction, and wherein the display device (12) is designed, upon receipt of a corresponding trigger command, to change the virtual positions (ZVP) assigned to the information units (IE) in the virtual three-dimensional space (VDR) at least for a majority of the information units (IE) and to change the visual representations of the first and second links, so that the first links run linearly along the second main direction and the second links run linearly along the first main direction. [2] Device according to claim 1, wherein the processing device (16) is designed to process the information such that, using the processing position (ZBP), one of the visually representable links is removed, an inserted information unit is inserted and new visually representable links (VV) of the inserted information unit are generated in each case to those previously linked information units (IE) which were linked to one another by the removed link. [3] Device according to claim 1 or 2, wherein at least one of the information units (IE) has a link to external information, wherein the link is operable using the processing position (ZBP) so that the external information is loaded and / or perceivable by outputting corresponding display data in the virtual three-dimensional space (VDR). [4] Device according to one of claims 1 to 3, wherein the allocation device (15) is designed to receive real positions in different real three-dimensional spaces via the input interface and to assign each to a processing position (ZBP), wherein the real positions are received from position determining devices which are located in the different real three-dimensional spaces. [5] Device according to one of claims 1 to 4, wherein the device comprises an output device (10) which is connected to the display device (12) and is designed to output the display data so that the information units (IE) and the links are visually perceptible in a display of the virtual three-dimensional space (VDR). [6] Device according to one of claims 1 to 5, wherein the device is combined with the position determining device (14), which is a device that is movable in the real three-dimensional space (RDR) with respect to all three linearly independent spatial directions. [7] Method for processing visually representable information with information units (IE) which are linked to each other in pairs by visually representable links (VV) according to a predefined type of relationship, where: - display data are generated by a display device (12) which define a visual representation of the visually displayable information in a virtual three-dimensional space (VDR), wherein • each of the information units (IE) is or will be assigned an associated virtual position (ZVP) in the virtual three-dimensional space (VDR) and the display data define that the information units (IE) are each displayed at the associated virtual position (ZVP) in the virtual three-dimensional space (VDR), • for pairs of linked information units (IE) to which different virtual positions are assigned, a visually representable link (VV) is present or created in the display data, - the display device (12) transmits at least part of the generated display data, so that the transmitted data can be received or are received by an output device (10) which outputs the transmitted data or at least part thereof, so that the information units (IE) and the links are visually perceptible in a representation of the virtual three-dimensional space (VDR), - a real position (RP) in a real three-dimensional space (RDR) is received and assigned to a processing position (ZBP), - a processing device (16) receives the processing position (ZBP) and processes the information and / or accesses it, so that using the processing position (ZBP) • the processing position (ZBP) is assigned as an assigned virtual position (ZVP) of an information unit, • the assigned virtual position (ZVP) of one of the information units (IE) is changed, • the information unit (IE) whose assigned virtual position (ZVP) corresponds to the processing position (ZBP) is selected, or • a link between one of the pairs of linked information units (IE) is created or changed, wherein the display data define a visual display of the visually displayable information such that information units (IE) of the information are displayed in a plurality of display areas of the virtual three-dimensional space (VDR), wherein the display areas are oriented in different directions, wherein the visually representable links are first links, wherein the predefined type of relationships according to which the information units (IE) are each linked to one another in pairs by the first links is a first type of relationship, wherein a second type of relationship is predefined which is different from the first type of relationship, wherein a plurality of the information units (IE) are each linked to one another in pairs by second visually representable links (VV) according to the second type of relationship, and wherein the first and second links are visually distinguishable from one another, wherein the first links are represented linearly by the representation data in such a way that they run along a first main direction in the virtual three-dimensional space (VDR), wherein the second links are represented linearly by the representation data in such a way,that they run in the virtual three-dimensional space (VDR) along a second main direction which runs transversely to the first main direction, and wherein the display device (12), upon receipt of a corresponding trigger command, changes the virtual positions (ZVP) assigned to the information units (IE) in the virtual three-dimensional space (VDR) at least for a majority of the information units (IE) and changes the visual representations of the first and second links, so that the first links run linearly along the second main direction and the second links run linearly along the first main direction. [8] Method according to claim 7, wherein the processing device (16) processes the information in such a way that, using the processing position (ZBP), one of the visually representable links is removed, an inserted information unit is inserted and new visually representable links (VV) of the inserted information unit are generated in each case to those previously linked information units (IE) which were linked to one another by the removed link. [9] Method according to claim 7 or 8, wherein at least one of the information units (IE) has a link to external information, wherein the link is operable using the processing position (ZBP) so that the external information is loaded and / or perceivable by outputting corresponding display data in the virtual three-dimensional space (VDR). [10] Method according to one of claims 7 to 9, wherein the allocation device (15) receives real positions in different real three-dimensional spaces via the input interface and assigns each to a processing position (ZBP), wherein the real positions are received from position determining devices located in the different real three-dimensional spaces. [11] Computer program for processing visually representable information with information units (IE) which are linked to one another in pairs by visually representable links (VV) according to a predefined type of relationship, in particular for carrying out the method according to one of claims 7 to 10, wherein the computer program when executed on a computer or computer network: - Display data is generated which defines a visual representation of the visually displayable information in a virtual three-dimensional space (VDR), where • each of the information units (IE) is or will be assigned an associated virtual position (ZVP) in the virtual three-dimensional space (VDR) and the display data define that the information units (IE) are each displayed at the associated virtual position (ZVP) in the virtual three-dimensional space (VDR), • for pairs of linked information units (IE) to which different virtual positions are assigned, a visually representable link (VV) is present or created in the display data, - transmits at least part of the generated display data so that the transmitted data can be received or is received by an output device (10) which outputs the transmitted data or at least part thereof so that the information units (IE) and the links are visually perceptible in a representation of the virtual three-dimensional space (VDR), - receives a real position (RP) in a real three-dimensional space (RDR) and assigns it to a processing position (ZBP), - edits and / or accesses the information so that, using the processing position (ZBP), • the processing position (ZBP) is assigned as an assigned virtual position (ZVP) of an information unit, • the assigned virtual position (ZVP) of one of the information units (IE) is changed, • the information unit (IE) whose assigned virtual position (ZVP) corresponds to the processing position (ZBP) is selected, or a link between one of the pairs of linked information units (IE) is created or changed, wherein the display data define a visual display of the visually displayable information such that information units (IE) of the information are displayed in a plurality of display areas of the virtual three-dimensional space (VDR), wherein the display areas are oriented in different directions, wherein the visually representable links are first links, wherein the predefined type of relationships according to which the information units (IE) are each linked to one another in pairs by the first links is a first type of relationship, wherein a second type of relationship is predefined which is different from the first type of relationship, wherein a plurality of the information units (IE) are each linked to one another in pairs by second visually representable links (VV) according to the second type of relationship, and wherein the first and second links are visually distinguishable from one another, wherein the first links are represented linearly by the representation data in such a way that they run along a first main direction in the virtual three-dimensional space (VDR), wherein the second links are represented linearly by the representation data in such a way,that they run in the virtual three-dimensional space (VDR) along a second main direction which runs transversely to the first main direction, and wherein the display device (12), upon receipt of a corresponding trigger command, changes the virtual positions (ZVP) assigned to the information units (IE) in the virtual three-dimensional space (VDR) at least for a majority of the information units (IE) and changes the visual representations of the first and second links, so that the first links run linearly along the second main direction and the second links run linearly along the first main direction. [12] A data carrier on which the computer program according to claim 11 is stored.
Citation Information
Patent Citations
method of controlling an object
DE102016113060A1
creating virtual notation surfaces with gestures in an augmented and / or virtual reality environment
DE202017105262U1
Systems and methods for information visualization in multi-display environments
US20090243957A1