Method, computer program product and processing circuit system for preprocessing visualization data

Abstract

Obtaining visualization data (D) representing a scene (S) having at least one object (110, 120, 130) in ). The visualization data (D in ) describes a scene (S) as seen from a position (P). A first metric and a second metric (L1, L2) are determined, the first metric and the second metric representing the extent of one of the objects (110) in a minimum dimension and a maximum dimension, respectively. An object aspect ratio (R) representing the relationship between the first metric and the second metric (L1; L2) is calculated. Based on the object aspect ratio (R), a selection margin (M) is assigned to the object (110). The selection margin specifies an area outside the object (110) except for a displayed object area (A) observed from a viewing direction (V) from the position (P) toward the object (110). 11 ), the object (110) can be effectively selected within the region for manipulation. Thus, the visualization data (D) is manipulated in response to user input (e.g., in the form of a gaze-based selection command). in ) becomes easier.

Description

[0001] This application is a divisional application of the Chinese invention patent application with the application date of March 25, 2021, application number 202110321568.3, and invention name “Method, computer program product and processing circuit system for preprocessing visual data”. Technical Field

[0002] The present invention generally relates to manipulating visual data in a user-friendly format. In particular, the present invention relates to a method for pre-processing manipulable visual data in response to user input, and a processing circuit system configured to implement such a method. The present invention also relates to a computer program product and a non-volatile data carrier. Background Art

[0003] Depending on the circumstances, determining which object of a set of potentially selectable objects the subject intends to select or manipulate by other means can be a relatively complex task. This may be particularly true in cases where the selection is based on the subject's gaze. However, similar problems may also arise in scenarios where the selection is made by other input means (e.g., via a manually controlled cursor or on a touch screen). That is, the target object may be obscured by other objects, by the subject's own fingers, and / or the target object may be oriented in such a way relative to the subject that a very small surface of the object is presented toward the subject's viewpoint. Of course, the selection process may be further complicated by the fact that the components of the scene containing the object to be selected change over time, making it difficult to correctly indicate the target object by muscle movement.

[0004] US 9,829,973 describes a solution for identifying an interactive element from one or more interactive elements present in a user interface. Gaze information is received from an eye tracking system; a likelihood of an interactive element being the subject of the gaze information from the eye tracking system is determined; and based on the likelihood determination, an interactive element is identified from the one or more interactive elements.

[0005] WO 2016 / 193394 discloses a method for determining whether a user's gaze is directed to a region of interest in a 3D scene. The method comprises: providing a 3D scene containing a region of interest; associating attributes with the region of interest, and creating a bitmap representing the position of the region of interest in a projected view of the 3D scene. Here, each pixel of the bitmap to which the region of interest is projected stores the attributes of the region of interest. The direction of the user's gaze is detected, and the bitmap is used to determine whether the detected user gaze is in the direction of the region of interest.

[0006] The above documents exemplify how users can efficiently interact with digital visual elements in a gaze-based manner. However, there are still problems to be solved, especially in accurately locating objects that are difficult to select due to their size, shape, and / or dimensional relationship to any adjacent objects. Summary of the invention

[0007] It is therefore an object of the present invention to provide an improved solution for facilitating user interaction with visualised data (eg in the form of 3D images or computer graphics).

[0008] According to one aspect of the present invention, the object is achieved by a method executed in at least one processor, which is used to pre-process manipulable visualization data in response to user input. The method includes obtaining visualization data representing a scene including at least one object. Here, the visualization data describes the scene as seen from a certain position, which is represented by a virtual camera position or a position from which an image of the scene is taken. A first metric and a second metric are determined, and the first metric and the second metric represent the extension of the object in a minimum size and a maximum size as seen from the position, respectively. An object aspect ratio representing the relationship between the first metric and the second metric is calculated. Based on the object aspect ratio, a selection margin is assigned to the object. The selection margin specifies an area outside the object, in addition to the area of ​​the object shown in the field of view of the object as seen from the position in question, within which the object can be effectively selected for manipulation.

[0009] This approach is advantageous because it facilitates user interaction with objects in the scene regardless of which selection technique is applied. However, this approach is particularly advantageous for gaze-based selection and when the objects to be selected have a relatively large aspect ratio (i.e., have a considerable difference between their largest and smallest dimensions).

[0010] According to one embodiment of this aspect of the invention, determining the first metric and the second metric includes enclosing the object in a rectangular box that covers the object in a field of view of the object as seen from the position. The first metric is set equal to the shortest side of the rectangular box, and the second metric is set equal to the longest side of the rectangular box.

[0011] Determining the first metric and the second metric may include obtaining position data that describes the corresponding position of each of the at least four corners of the cuboid into which the object is placed. More precisely, these corners include the base corner of the cuboid and three other corners, which are located on corresponding edges directly connected to the base corner. Based on the corresponding position of each of the at least four corners, each of the corners that can be seen from the position is projected onto a plane orthogonal to the direction of the field of view. Therefore, a planar projection of the cuboid is obtained. Thereafter, the maximum diagonal in the planar projection is determined. A transverse metric perpendicular to the maximum diagonal is also determined, which extends between two opposite sides of the planar projection. The first metric is assigned to be equal to the transverse metric, and the second metric is assigned to be equal to the maximum diagonal. This strategy provides relevant selection margins for objects of all shapes and sizes.

[0012] According to another embodiment of this aspect of the invention, the selection margin is assigned such that the region has a non-zero extension outside the object along at least one buffer side of the object. This means that the selection margin may extend from less than all sides of the object shown towards the position.

[0013] Preferably, each of the at least one buffer side is located on a side of the object that extends in the general direction of the largest dimension of the object. In other words, if the object has a generally rectangular shape, the at least one buffer side is preferably located along one or more of the longer sides of the object. Thereby, it is made easier for the user to select the object, as a miss in the vicinity but within the margin of the buffer side will also result in a valid selection. Providing such a selection margin along the shorter sides of the object is less useful, as the object itself is relatively wide in this dimension and is therefore more easily hit by a selection input.

[0014] Specifically, according to another embodiment of this aspect of the invention, the selected margin is assigned so that, from this position, the extension of the area on the side extending in the general direction of the largest dimension of the object is greater than the extension of the area on the side extending in the general direction of the shortest dimension of the object.

[0015] According to a further embodiment of this aspect of the invention, the selection margin is defined based on a threshold angle outside at least one edge of the object in the field of view of the object as seen from the position. This is advantageous because thereby for a given viewing angle towards the scene, if the distance between the position and the scene varies, a linear relationship is maintained between the object aspect ratio and the selection margin assigned to the object. Thus, the behavior becomes predictable.

[0016] According to yet another embodiment of this aspect of the invention, the margins are assigned so that the extent of the region outside the object in at least one direction depends on the object aspect ratio according to the following equation: E=KR-X , where E is the extent of the region in the at least one direction, K is a constant greater than zero, R is the aspect ratio of the object (i.e., the smallest dimension compared to the largest dimension) less than or equal to 1, and x is a constant greater than or equal to 1. This equation indicates that a larger difference between the smallest and largest dimensions of the object will result in the region having a relatively wider extent outside the object in the at least one direction, and vice versa. The magnitude of this effect can be adjusted by choosing constants K and x to different values.

[0017] According to a further embodiment of this aspect of the invention, the user input is generated based on gaze data registered for the subject regarding a display on which the scene seen from the position is presented and / or tactile input registered on the display presenting the scene seen from the position. Thus, user interaction can be achieved in a reliable and consistent manner.

[0018] According to another aspect of the invention, the object is achieved by a computer program product that can be loaded into a non-volatile data carrier that is communicatively connected to at least one processor. The computer program product contains software that is configured to cause the at least one processor to obtain visualization data when the computer program product is run on the at least one processor, the visualization data representing a scene including at least one object. The visualization data describes the scene as seen from a certain position, which position is represented by a virtual camera position or a position where an image of the scene is taken. The software is configured to determine a first metric representing the extension of the object in a minimum dimension as seen from the position, and a second metric representing the extension of the object in a maximum dimension as seen from the position. In addition, the software is configured to calculate an object aspect ratio representing the relationship between the first metric and the second metric, and assign a selection margin to the object based on the object aspect ratio. The selection margin specifies an area outside the object, in addition to the area of ​​the object shown towards the object field of view as seen from the position, within which the object can be effectively selected for manipulation. The advantages of the computer program product and the non-volatile data carrier are apparent from the previous discussion with reference to the proposed method.

[0019] According to another aspect of the present invention, the above object is achieved by a processing circuit system for preprocessing manipulable visualization data in response to user input, the processing circuit system being configured to implement the above method. The advantages of the processing circuit are apparent from the above discussion with reference to the proposed method.

[0020] According to another aspect of the present invention, the above-mentioned purpose is achieved by a computer-implemented method for manipulating data visible on a display. The method includes receiving visualization data that has been preprocessed according to the above-mentioned method. Therefore, the visualization data represents a scene seen from a specified position. The scene includes at least one object, and a selection margin is assigned to the at least one object. In addition to the object area shown in the object field of view seen from the specified position, the at least one object can be effectively selected within the selection margin for manipulation. The method further includes checking whether a user input has been obtained, and the user input represents the manipulation of one of the at least one objects in the object area shown in the object field of view seen from the position or in the selection margin. If such user input is obtained, the manipulation of the object is performed based on the obtained user input. As a result, even if such an object shows a small and / or irregular area towards the field of view seen from the specified position, the user can interact with the object in a reliable and consistent manner.

[0021] Further advantages, advantageous features, and applications of the invention will become apparent from the following description and the dependent claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The present invention will now be explained in more detail by means of preferred embodiments disclosed as examples and with reference to the accompanying drawings.

[0023] Figure 1 A schematic diagram showing a scene with an object as seen from a specified position;

[0024] Figure 2 Shown Figure 1 Visual data of the scene in which a selection margin is assigned to one of these objects;

[0025] Figures 3 to 5 It shows how to assign selection margins according to an embodiment of the present invention;

[0026] Figures 6a to 6c It shows how to surround an object with a cuboid in order to assign a selected margin to the object according to one embodiment of the present invention; and

[0027] Figure 7 shows a block diagram of processing circuitry according to one embodiment of the present invention;

[0028] Figure 8 A general method for pre-processing manipulable visualization data in response to user input according to the present invention is presented by way of a flow chart. DETAILED DESCRIPTION

[0029] Figure 1A schematic diagram of a scene S with objects 110, 120 and 130 is shown as seen from a specified position P, which is located at given coordinates in a three-dimensional (3D) coordinate system X, Y, Z relative to the scene S. This means that each of the objects 110, 120 and 130 exhibits a certain surface area in a viewing direction V from the position P towards the scene S. If the position P changes; typically, the viewing direction V of the scene S will also change. As a further consequence, the objects 110, 120 and 130 exhibit respective surface areas towards the new viewing direction V of the scene S, which surface areas may be at least slightly different.

[0030] Depending on the angle of the viewing direction V, the shape and / or the size of the object, the object may present a very small area towards the position P. Therefore, it may be complicated for the user to manipulate the object, for example via a gaze-based selection operation.

[0031] Therefore, according to the present invention, the following will describe the process of processing, in at least one processor, visualization data D representing a scene S. in Preprocessing. Visualization data D in The scene S is described as seen from a position P, which may be given, for example, by the position of a virtual camera in a 3D graphics environment.

[0032] In particular, according to the present invention, the visualization data D in The purpose of the pre-processing is to facilitate gaze-based selection operations with respect to objects 110, 120 and 130 in the scene S. The gaze-based selection operations rely on gaze data registered for a subject looking at a display on which the scene S is presented from a position P. Additionally or alternatively, the proposed in Pre-processing of facilitates tactile user input that is registered on a display presenting a scene S as seen from position P.

[0033] Reference now Figure 2 , we will show how to visualize data D in An object 110 in the represented scene S is assigned a selected margin M.

[0034] A first metric L1 is determined, the first metric L1 representing the extent of the object 110 in its smallest dimension as seen from the position P. Here, the first metric L1 is oriented parallel to the first axis X of the 3D coordinate system. A second metric L2 is determined, the second metric L2 representing the extent of the object 110 in its largest dimension as seen from the position P. Here, the second metric L2 is oriented parallel to the second axis Y of the 3D coordinate system. Of course, as will be discussed below, the first metric L1 and the second metric L2 can each have any orientation relative to the 3D coordinate system in which the object is located.

[0035] An object aspect ratio R is calculated based on the first metric L1 and the second metric L2. The object aspect ratio R represents the relationship between the first metric L1 and the second metric L2. In this example, the object aspect ratio R of the object 110 is approximately 1:3.

[0036] Based on the object aspect ratio R, the object 110 is assigned a selection margin M. The selection margin M specifies an area outside the object 110, except for the object area A of the object 110 as seen from the position P toward its viewing direction. 11 In addition, the object 110 can be effectively selected within the area for manipulation. Here, the area A 11 It is the size of the planar projection of the object 110 in the plane perpendicular to the viewing direction V.

[0037] Preferably, the selection margin M is assigned such that, viewed from position P, the extent z2 of the region on one side extending in the general direction of the largest dimension of the object 110 (i.e., along L2) is greater than the extent z1 of the region on one side extending in the general direction of the shortest dimension of the object 110 (i.e., along L1). Such a selection margin M makes it easier for the user to select the object 110, because a miss in the vicinity but within the margin M will also result in a valid selection of the object 110; and due to the object aspect ratio R, the risk of missing the object 110 is higher near the side of the object 110 extending along its largest dimension than on any other side of the object 110.

[0038] Figure 3 It is shown how to assign selected margins M1, M2, M3, M4 and M5 according to an embodiment of the present invention. It can be seen that here, the selected margins are assigned so that the region has a wider extension on the object side extending in the general direction of the maximum dimension of the object. In addition, the extension of the region varies according to the object aspect ratio R, so that for an object aspect ratio R close to 1, there is a relatively small difference between the extension of the region along the maximum dimension and the extension along the minimum dimension; and for an object aspect ratio R far from 1, there is a relatively large difference between the extension of the region along the maximum dimension and the extension along the minimum dimension.

[0039] For example, in Figure 3 , the first object 310 has an object aspect ratio R of 0.068. Here, the margin M1 is selected to have a region widest extension corresponding to 1.4 times L1 outside the side extending in the general direction of the maximum dimension of the first object 310, and a region narrowest extension corresponding to 0.80 times L1 outside the side extending in the general direction of the minimum dimension of the first object 310.

[0040] Figure 3The second object 320 in FIG. 3 has an object aspect ratio R of 0.071. Here, the margin M2 is selected to have a region widest extension corresponding to 1.2 times L1 outside the side extending in the general direction of the maximum dimension of the second object 320, and a region narrowest extension of zero outside the side extending in the general direction of the minimum dimension of the second object 320.

[0041] Figure 3 The third object 330 in FIG. 3 has an object aspect ratio R of 0.45. Here, the margin M3 is selected to have a region widest extension corresponding to 0.20 times L1 outside the side extending in the general direction of the maximum dimension of the third object 330, and a region narrowest extension corresponding to 0.10 times L1 outside the side extending in the general direction of the minimum dimension of the third object 330.

[0042] Figure 3 The fourth object 340 in FIG. 3 has an object aspect ratio R of 0.68. Here, the margin M4 is selected to have a region widest extension corresponding to 0.18 times L1 outside the side extending in the general direction of the largest dimension of the fourth object 340, and a region narrowest extension corresponding to 0.12 times L1 outside the side extending in the general direction of the smallest dimension of the fourth object 340.

[0043] Figure 3 The fifth object 350 in FIG. 3 has an object aspect ratio R of 0.90. Here, the margin M5 is selected to have a region widest extension corresponding to 0.11 times L1 outside the side extending in the general direction of the maximum dimension of the fifth object 350, and a region narrowest extension corresponding to 0.04 times L1 outside the side extending in the general direction of the minimum dimension of the fifth object 350.

[0044] Therefore, if Figure 3 As can be seen in FIG. 1 , the extension of the selected margin M varies with the object aspect ratio R in such a way that for an object with an object aspect ratio R close to 1, the selected margin M has a relatively small widest extension, and for an object with an object aspect ratio R quite far from 1, the selected margin has a relatively large widest extension. According to one embodiment of the present invention, this relationship is expressed as E=KR -X .

[0045] Here, E is the extension of the region outside the object in at least one direction. The extension E can be expressed as a multiple of the shortest extension L1 or as an angle, as will be described below with reference to Figure 4 K is a constant greater than zero, such as 1. R is an object aspect ratio less than or equal to 1, that is, L1 / L2, and x is a constant greater than or equal to 1, such as 1.

[0046] According to the invention, the margin M may be selected to be zero, i.e. non-existent, along one or more sides of the object. However, for the selected margin M, there is always a region with a non-zero extension outside at least one side of the object. For example, Figure 3 , a second object 320 having an object aspect ratio R of 0.071 (i.e., quite far from 1) is assigned a selected margin M such that the region has a non-zero extension outside the second object 320 along respective buffer sides B1 and B2 of the second object 320 , which extend along a maximum dimension L2 of the second object 320 .

[0047] Figure 4 It is shown how according to one embodiment of the invention a selected margin M is assigned, namely based on a threshold angle α outside at least one edge E2L and / or E2R of the object 110 seen from the position P in the viewing direction V of the object 110 . Figure 4 Shows Figure 1 and Figure 2 . A top perspective view of the object 110 in FIG. 1 is a view of the object 110 in FIG. 1 . The margin M is selected to have an extension z2 beyond the left edge E2L of the object 110. The margin M is selected to also extend by an amount z2 beyond the right edge E2R of the object 110. The extension amount z2 is defined based on a threshold angle α of the object 110 outside the left edge E2L and the right edge E2R, respectively, as seen from the position P in the viewing direction V of the object 110. Therefore, the margin M is selected to form a buffer side extending along the maximum dimension L2 of the object 110. Here, since the object aspect ratio R of the object 110 is relatively small, the margin M is selected to extend only by a minimum amount z1, for example zero, beyond the side of the object 110 extending along the minimum dimension L1 of the object.

[0048] Figure 5 It is shown how to determine a first metric L1 and a second metric L2, respectively, according to an embodiment of the present invention, and the first metric L1 and the second metric L2 are then used as the basis for assigning a selected margin M51 to the object 510. The process includes the following steps. First, the object 510 is enclosed in a rectangular frame 500, which covers the object when viewed from the position P along the viewing direction V of the object 510. For example, Figure 5 As shown, the rectangular box 500 may cover the object 510 with a minimum margin. Then, the first metric L1 and the second metric L2 are set equal to the shortest side and the longest side of the rectangular box 500, respectively. In an alternative embodiment of the present invention (not shown), the rectangular box does not completely surround the object 510. Alternatively, in this embodiment, the rectangular box may be defined to have approximately the same volume as the object 510. Therefore, in the example Figure 5 In the case of the illustrated irregular object 510 , the rectangular frame will at least partially “cut through” the object 510 .

[0049] In practice, in order to determine the first metric L1 and the second metric L2 of an arbitrary object, it may be advantageous to apply the following method. Figures 6a to 6c It is shown how to surround an object 610 with a cuboid 600 in order to assign a selected margin M6 to the object according to one embodiment of the present invention.

[0050] The method comprises the following steps.

[0051] First, position data is obtained, which describes the corresponding position of each of the at least four corners C1, C2, C4 and C5 of the cuboid 600 surrounding the object 610. The at least four corners include the base corner C1 of the cuboid 600 and three other corners, which are located on the corresponding edges directly connected to the base corner C1 and are visible from the position P along the viewing direction V. In the illustrated example, from the base corner C1, each of the three corners C2, C4 and C5 is located in a direction that is orthogonal to the directions of the other two corners.

[0052] Optionally, in a second step, based on the at least four corners C1, C2, C4 and C5, the corresponding positions of each remaining corner C3, C6 and C7 visible from position P along viewing direction V can be derived. In some cases, position P is unknown when determining the positions of the corners of cuboid 600. Therefore, corner C8 can also be determined.

[0053] Third, each of the at least four visible corners C1, C2, C4 and C5 (and possibly any other corners C3, C6 and / or C7 derived in the second step that are visible from the position P) is projected onto a plane orthogonal to the viewing direction V. Thus, a plane projection PPL of the cuboid 600 is obtained.

[0054] Fourth, the maximum diagonal line DL in the planar projection PPL is determined, which in this example extends between the corners C1 and C3.

[0055] Fifth, a cross metric CM is determined, which is perpendicular to the maximum diagonal line DL and extends between two opposite sides of the plane projection PPL.

[0056] Sixth, the first metric L1 is assigned equal to the cross metric CM, and the second metric L2 is assigned equal to the maximum diagonal DL.

[0057] Finally, the selection margin M6 is assigned based on the object aspect ratio R as described above.

[0058] Figure 7A block diagram of a processing circuit system 710 according to one embodiment of the invention is shown. The processing circuit system 710 includes at least one processor 720. The at least one processor 720 is communicatively connected to a non-volatile data carrier 730, which may be included in the processing circuit system 710 or may be located in a component external to the processing circuit system.

[0059] The non-volatile data carrier 730 stores a computer program product 735, which contains software configured to cause the at least one processor 720 to perform the following steps when the computer program product 735 is run on the at least one processor 720:

[0060] - obtaining visualization data D representing a scene S comprising at least one object in , the visualization data D in Describe the scene S as seen from position P;

[0061] - determining a first measure L1 representing the extension of the object in its smallest dimension as seen from the position P;

[0062] - determining a second measure L2 representing the extension of the object in its largest dimension as seen from position P;

[0063] - calculating an object aspect ratio R, which represents the relationship between the first metric L1 and the second metric L2; and

[0064] - assigning a selection margin M to the object based on its aspect ratio R, the selection margin specifying an area outside the object, except for the displayed object area A as viewed from position P towards its viewing direction V 11 In addition, the object can be effectively selected within the area for manipulation.

[0065] To summarize, and refer to Figure 8 With reference to the flowchart in FIG. 1 , we will now describe a general method for pre-processing manipulable visualization data in response to user input according to the present invention, the method being executed in at least one processor.

[0066] In a first step 810 , visualization data are obtained, which represent a scene as seen from a position P. The scene comprises at least one object, for example defined in 3D graphics.

[0067] Thereafter, in step 820, a first metric is determined, which represents the extent of at least one object in the scene at the smallest dimension of the object as seen from the position. In step 820, a second metric is also determined, which represents the extent of the object at the largest dimension as seen from the position.

[0068] Then, step 830 calculates the object aspect ratio, which represents the relationship between the first metric and the second metric, for example, calculated as the ratio of the first metric to the second metric.

[0069] Then, a selection margin is assigned to the object based on the object aspect ratio in step 840. The selection margin specifies an area outside the object within which the object can be effectively selected for manipulation, in addition to the displayed area of ​​the object as viewed from the position toward its viewing direction.

[0070] After this, the process ends. Naturally, in practice, the process is preferably repeated for one or more other objects in the scene. Furthermore, it is advantageous to preferably repeat the process for each object in the scene in response to changes in the scene and / or adjustments to the location from which the scene is viewed.

[0071] References Figure 8 All process steps described and any subsequence of steps can be controlled by at least one programmed processor. In addition, although the embodiments of the present invention described above with reference to the accompanying drawings include processors and processes executed in at least one processor, the present invention is therefore also extended to computer programs, especially computer programs on or in carriers, which are adapted to put the present invention into practice. The program can be in the form of source code, object code, code between source code and object code, such as partially compiled form, or any other form suitable for implementing the process according to the present invention. The program can be part of an operating system or a separate application program. The carrier can be any entity or device capable of carrying a program. For example, the carrier can include a storage medium, such as a flash memory, a ROM (read-only memory) (e.g., a DVD (digital video / versatile disk)), a CD (optical disk), or a semiconductor ROM, an EPROM (erasable programmable read-only memory), an EEPROM (electrically erasable programmable read-only memory), or a magnetic recording medium (e.g., a floppy disk or a hard disk). Further, the carrier can be a transmittable carrier, such as an electrical signal or an optical signal, which can be transmitted via an electrical cable or an optical cable or by radio or by other means. When the program is embodied in a signal which can be conveyed directly by cable or other device or means, the carrier may be constituted by such cable or device or means. Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform or to be used in the performance of the relevant process.

[0072] When used in this specification, the term "comprises / comprising" is used to specify the presence of stated features, integers, steps, or components. However, the term does not exclude the presence or addition of one or more additional features, integers, steps, or components or their combinations.

[0073] The invention is not limited to the embodiments described in the figures but may be varied freely within the scope of the claims.

Claims

1. A method executed in at least one processor for preprocessing manipulable visualization data in response to user input, the method comprising the steps of: obtaining visualization data representing a scene on a display including at least one object, the visualization data describing the scene as seen from a position, determining a first metric representing a minimum size of the object as seen from the location, and a second metric representing a maximum size of the object, calculating an object aspect ratio representing a relationship between the first metric and the second metric, assigning a selected margin distance to the object based on a threshold angle outside of at least one edge of the object as viewed from the location along a viewing direction, wherein the threshold angle and the object aspect ratio are mathematically related to each other, and A user input is obtained, the user input being generated based on at least one gaze data registered for a validly selected object within the selection margin in the scene.

2. The method according to claim 1, wherein: If the distance between the location and the scene varies, a mathematical relationship is maintained between the object aspect ratio and the selected margin assigned to the object.

3. The method according to claim 1, wherein: The object is further assigned the selection margin based on the object aspect ratio, the selection margin specifying an area outside the object, in addition to the displayed area of ​​the object observed from the position in a viewing direction toward the object, within which the object can be effectively selected for manipulation.

4. The method according to claim 1, wherein: The method includes a repeated process of adjusting the position of at least one object in the scene in response to a change in the scene or observation of the scene.

5. The method according to claim 3, wherein: The selection margins are assigned such that the extent of the region outside the object in at least one direction depends on the object aspect ratio according to the following equation: E=KR -X ,in, E is the extension of the region in the at least one direction, K is a constant greater than zero, R is the object aspect ratio less than or equal to 1, and X is a constant greater than or equal to 1.

6. The method according to claim 1, wherein: Determining the first metric and the second metric comprises the following steps: enclosing the object in a rectangular frame, the rectangular frame covering the object observed from the position along the observation direction of the object, setting the first metric equal to the shortest side of the rectangular box, and The second metric is set equal to the longest side of the rectangular box.

7. The method according to claim 1, wherein: Determining the first metric and the second metric comprises the following steps: obtaining position data describing a respective position of each of at least four corners of a cuboid surrounding the object, Based on the corresponding position of each of the at least four corners, each of the eight corners visible from the position is projected onto a plane orthogonal to the viewing direction, thereby obtaining a plane projection of the cuboid, determining the maximum diagonal in the projection of the plane, determining a transverse measure perpendicular to the maximum diagonal and extending between two opposite sides of the plane projection, assigning the first metric equal to the transverse metric, and The second metric is assigned to be equal to the maximum diagonal.

8. The method according to claim 1, wherein: The user input is further generated based on tactile input registered on a display presenting the scene as seen from the location.

9. A computer program product loadable into a non-volatile data carrier communicatively connected to at least one processor, the computer program product comprising software configured to, when the computer program product is run on the at least one processing circuitry, cause the at least one processing circuitry to: obtaining visualization data representing a scene on a display including at least one object, the visualization data describing the scene as seen from a position, determining a first metric representing a minimum size of the object as seen from the location, and a second metric representing a maximum size of the object, calculating an object aspect ratio representing a relationship between the first metric and the second metric, The object is assigned a selected margin based on a threshold angle outside of at least one edge of the object as viewed from the location along a viewing direction, wherein: The threshold angle and the object aspect ratio are mathematically related to each other, and A user input is obtained, the user input being generated based on at least one gaze data registered for a validly selected object within the selection margin in the scene.

10. A processing circuit system for pre-processing manipulable visualization data in response to user input, the processing circuit system being configured to: obtaining visualization data representing a scene on a display including at least one object, the visualization data describing the scene as seen from a position, determining a first metric representing a minimum size of the object as seen from the location, and a second metric representing a maximum size of the object, calculating an object aspect ratio representing a relationship between the first metric and the second metric, The object is assigned a selected margin based on a threshold angle outside of at least one edge of the object as viewed from the location along a viewing direction, wherein: The threshold angle and the object aspect ratio are mathematically related to each other, and A user input is obtained, the user input being generated based on at least one gaze data registered for a validly selected object within the selection margin in the scene.

11. A computer-implemented method for manipulating data visible on a display, the method comprising the steps of: receiving visualization data representing a scene on a display including at least one object, the visualization data describing the scene as seen from a location, determining a first metric representing a minimum size of the object as seen from the location, and a second metric representing a maximum size of the object, calculating an object aspect ratio representing a relationship between the first metric and the second metric, assigning a selection margin to the object based on a threshold angle outside of at least one edge of the object as viewed from the location along a viewing direction, the at least one object being effectively selectable for manipulation within the selection margin in addition to a displayed area of ​​the object as viewed from the designated location toward the viewing direction of the object, wherein the threshold angle and the object aspect ratio are mathematically related to each other, and checking whether a user input has been obtained, the user input being generated based on at least one gaze data registered for a validly selected object within the selection margin in the scene, wherein the user input represents manipulation of one of the at least one object in the following areas: in the area of ​​the object displayed as viewed from the position in a viewing direction towards the object, or In the selection margin, And if such user input is obtained, The object is then manipulated based on the obtained user input.

Images