Tactile stimulation pattern design program

Abstract

A computer-readable recording medium according to an embodiment of the present invention is a computer-readable recording medium in which a program executable by a computer is recorded, wherein the program generates a user interface, and the user interface comprises: an effect setting area in which a plurality of tactile stimulation unit patterns constituting a tactile stimulation effect are included, and activation time ratios of the tactile stimulation unit patterns are set with respect to a setting time of the tactile stimulation effect; a device visualization area in which a plurality of tactile stimulation providing devices corresponding to the tactile stimulation unit patterns are visualized and displayed, and nodes of the tactile stimulation unit patterns are set on the visualized tactile stimulation providing devices; and a timeline area in which a start time point and an end time point of the setting time of the tactile stimulation effect are set.

Description

Tactile Stimulation Pattern Design Program

[0001] The present invention relates to a tactile stimulation pattern design program.

[0002] A tactile stimulation providing device includes actuators and can provide tactile stimulation to a user by selectively vibrating the actuators. The tactile stimulation providing device can be provided to various body parts of the target user.

[0003] However, designing a tactile stimulation pattern by setting drive values ​​for each of the multiple actuators is a challenging task. Furthermore, designing devices that provide various tactile stimulations to various body parts to provide a single, consistent tactile stimulation pattern is an even more challenging task.

[0004] The technical challenge to be solved is to provide a tactile stimulation pattern design program that can easily design a tactile stimulation pattern for a single tactile stimulation providing device or multiple tactile stimulation providing devices.

[0005] According to one embodiment of the present invention, a computer-readable recording medium is provided, which is a computer-readable recording medium having recorded thereon a program executable by a computer, wherein the program generates a user interface, and the user interface comprises: an effect setting region that includes a plurality of tactile stimulation unit patterns constituting a tactile stimulation effect and sets active time ratios of the tactile stimulation unit patterns with respect to a set time of the tactile stimulation effect; a device visualization region that visualizes and displays a plurality of tactile stimulation providing devices corresponding to the tactile stimulation unit patterns and sets nodes of the tactile stimulation unit patterns on the visualized tactile stimulation providing devices; and a timeline region that sets a start time and an end time of the set time of the tactile stimulation effect.

[0006] By reducing the set time of the above tactile stimulation effect, the activation time ratios of the tactile stimulation unit patterns can be maintained, and the activation times of the tactile stimulation unit patterns can be reduced collectively.

[0007] By reducing the set time of the above tactile stimulation effect, the activation time ratios of the tactile stimulation unit patterns can be maintained, and the execution speeds of the tactile stimulation unit patterns can be uniformly increased.

[0008] Among the above tactile stimulus unit patterns, the first tactile stimulus unit pattern can be set as a tactile stimulus provision path from a departure node on a first tactile stimulus provision device among the plurality of tactile stimulus provision devices to an arrival node on a second tactile stimulus provision device.

[0009] The first tactile stimulation unit pattern is set to cause a virtual tactile stimulation point to move along the tactile stimulation provision path, and during at least a portion of the period during which the tactile stimulation point moves between the first tactile stimulation provision device and the second tactile stimulation provision device, the first actuator of the first tactile stimulation provision device and the second actuator of the second tactile stimulation provision device can be driven simultaneously.

[0010] The above first tactile stimulation unit pattern is set so that a virtual tactile stimulation point moves along the tactile stimulation provision path, and the speed at which the tactile stimulation point moves between the first tactile stimulation provision device and the second tactile stimulation provision device may be faster than the speed at which the tactile stimulation point moves above the first tactile stimulation provision device or the second tactile stimulation provision device.

[0011] According to one embodiment of the present invention, a computer-readable recording medium is provided, which is a computer-readable recording medium having recorded thereon a program executable by a computer, wherein the program generates a user interface, and the user interface includes: a device visualization area for visualizing and displaying a tactile stimulus providing device including a first sub-tactile stimulus providing device and a second sub-tactile stimulus providing device, and for setting nodes of a tactile stimulus unit pattern on the visualized tactile stimulus providing device, wherein the tactile stimulus unit pattern is set as a tactile stimulus providing path from a starting node on the first sub-tactile stimulus providing device to a destination node on the second sub-tactile stimulus providing device.

[0012] The first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device are configured separately from each other and can be mounted to surround symmetrical body parts of the user, respectively.

[0013] The above tactile stimulation unit pattern is set so that a virtual tactile stimulation point moves along the tactile stimulation provision path, and during at least a portion of the period during which the tactile stimulation point moves between the first sub-tactile stimulation provision device and the second sub-tactile stimulation provision device, the first actuator of the first sub-tactile stimulation provision device and the second actuator of the second sub-tactile stimulation provision device can be driven simultaneously.

[0014] The above tactile stimulation unit pattern is set so that a virtual tactile stimulation point moves along the tactile stimulation provision path, and the speed at which the tactile stimulation point moves between the first sub-tactile stimulation provision device and the second sub-tactile stimulation provision device may be faster than the speed at which the tactile stimulation point moves above the first sub-tactile stimulation provision device or the second sub-tactile stimulation provision device.

[0015] The first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device are configured to be connected to each other and can be mounted to surround one body part of the user.

[0016] The tactile stimulation provision path is formed by automatically connecting sequentially designated nodes, and when a first node is designated on the first sub-tactile stimulation provision device and a second node following the first node is designated on the second sub-tactile stimulation provision device, the tactile stimulation provision path can pass through the edge of the first sub-tactile stimulation provision device and the edge of the second sub-tactile stimulation provision device so that the path between the first node and the second node is the shortest distance.

[0017] The tactile stimulus providing path includes a first path on the first sub-tactile stimulus providing device and a second path on the second sub-tactile stimulus providing device, and the first path is continuously drawn from the starting node to the first intermediate node of the edge of the first sub-tactile stimulus providing device, and the second path is continuously drawn from the second intermediate node of the edge of the second sub-tactile stimulus providing device to the arrival node, and the path between the first intermediate node and the second intermediate node can be formed by being automatically connected.

[0018] The second intermediate node can be designated within a certain range from the first intermediate node.

[0019] After the first path is drawn and before the second path is drawn, the shape of the input cursor within the predetermined range and the shape of the input cursor outside the predetermined range may be different from each other.

[0020] After the first path is drawn and before the second path is drawn, a guide line may be displayed on the second sub-tactile stimulus providing device for a position corresponding to the first intermediate node.

[0021] In the first display mode, the first sub-tactile stimulus providing device and the second sub-tactile stimulus providing device may be visualized to be arranged side by side, and in the second display mode, the second sub-tactile stimulus providing device may be visualized to be positioned between the first part of the first sub-tactile stimulus providing device and the second part of the first sub-tactile stimulus providing device.

[0022] The tactile stimulation pattern design program according to the present invention can easily design a tactile stimulation pattern for a single tactile stimulation providing device or a plurality of tactile stimulation providing devices.

[0023] FIG. 1 is a drawing for explaining a tactile stimulus providing system according to one embodiment of the present invention.

[0024] FIG. 2 is a drawing for explaining a plurality of tactile stimulus providing devices according to one embodiment of the present invention.

[0025] FIGS. 3 and 4 are drawings for explaining a process of generating a tactile stimulus pattern in a user interface according to one embodiment of the present invention.

[0026] Figures 5 and 6 are drawings for explaining the process of generating tactile stimulus unit patterns in dot mode in a user interface.

[0027] Figure 7 is a drawing for explaining the process of generating a tactile stimulus unit pattern of a path mode in a user interface in the first display mode.

[0028] Figure 8 is a drawing for explaining the process of generating a tactile stimulus unit pattern of a path mode in a second display mode in a user interface.

[0029] FIGS. 9 to 11 are drawings for explaining a process of generating a tactile stimulus unit pattern in a free path mode in a user interface in a first display mode.

[0030] Figure 12 is a drawing for explaining the process of generating a tactile stimulus unit pattern in the free path mode in the second display mode in the user interface.

[0031] Figure 13 is a diagram illustrating a process for generating a tactile stimulus unit pattern in waveform mode in a user interface.

[0032] Figure 14 is a drawing for explaining a tactile stimulus providing path set on a first sub-tactile stimulus providing device and a second sub-tactile stimulus providing device.

[0033] Figures 15 to 22 are diagrams for explaining various options that can set multiple tactile stimulus unit patterns at once.

[0034] Figure 23 is a drawing for explaining a tactile stimulus providing path set on a first tactile stimulus providing device and a second tactile stimulus providing device.

[0035] Figure 24 is a diagram for explaining a group of tactile stimulation effects and multiple tracks.

[0036] Figures 25 to 27 are drawings for explaining a process in which multiple users participate in the design of a tactile stimulation pattern.

[0037] Hereinafter, various embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the invention. The present invention may be implemented in various different forms and is not limited to the embodiments described herein.

[0038] To clearly explain the present invention, irrelevant parts have been omitted, and the same reference numerals are used to designate identical or similar components throughout the specification. Accordingly, the reference numerals described above may also be used in other drawings.

[0039] Additionally, the sizes and thicknesses of each component shown in the drawings are arbitrarily shown for convenience of explanation, and thus the present invention is not necessarily limited to what is shown. In order to clearly express multiple layers and regions in the drawings, the thicknesses may be exaggerated.

[0040] FIG. 1 is a drawing for explaining a tactile stimulus providing system according to one embodiment of the present invention.

[0041] Referring to FIG. 1, a tactile stimulus providing system (8) according to one embodiment of the present invention may include a tactile stimulus pattern generating device (9) and a tactile stimulus providing device (10).

[0042] The tactile stimulation pattern generation device (9) can provide a user interface of a tactile stimulation pattern design program.

[0043] The tactile stimulation pattern generation device (9) may be a computer including at least one processor and memory for information processing. The tactile stimulation pattern generation device (9) may perform a desired function by reading a recording medium on which data or a program is recorded.

[0044] A storage medium includes any type of storage device that can store data or programs that can be read by a computer system. Examples of computer-readable storage media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, hard disk, external hard disk, solid state drive, USB storage device, DVD, and Blu-ray disc. Furthermore, a computer-readable storage medium may be a combination of multiple devices or distributed across networked computer systems. Such a storage medium may be a non-transitory computer-readable medium. A non-transitory computer-readable medium refers to a medium that permanently stores data or programs and is readable by a computer, rather than a medium that stores data or programs for a short period of time, such as registers, caches, and memories.

[0045] A user interface can be implemented through a display device that displays visual information to the user and an input device that receives user input. Display devices may include monitors, TVs, projectors, mobile displays, and the like. Input devices may include a mouse, keyboard, touchpad, microphone, vision sensor, and the like. The display device and input device are not necessarily distinct; for example, the display device and input device may be implemented as a single unit, such as a touch display device.

[0046] The plurality of actuators refers to a plurality of tactile stimulus providing modules physically present in the tactile stimulus providing device (10). The plurality of actuators may be vibration motors, which are one type of electric actuator. For example, an eccentric rotating mass (ERM) motor, a linear resonance actuator (LRA), a voice coil actuator (VCA), a piezo haptic actuator, etc. may be used as the actuator. Hereinafter, the plurality of actuators will be described as vibration motors as an example, but the plurality of actuators may be pneumatic, hydraulic, or thermal actuators. Therefore, one or more types of actuators may be applied to the present invention.

[0047] The user interface may include a plurality of virtual actuators to which the positions of the plurality of actuators are mapped. The user interface may graphically visualize and display the physical arrangement of the plurality of actuators included in the tactile stimulus providing device (10) so that the user can intuitively recognize it. For example, if the tactile stimulus providing device (10) includes a plurality of actuators in 5 rows and 5 columns, the user interface may include a plurality of virtual actuators in 5 rows and 5 columns. As another example, if the tactile stimulus providing device (10) includes a plurality of actuators in 1 row and 5 columns, the user interface may include a plurality of virtual actuators in 1 row and 5 columns.

[0048] In another embodiment, the plurality of actuators of the tactile stimulus providing device (10) and the plurality of virtual actuators of the user interface may not correspond one-to-one. For example, a tactile stimulus pattern generated for the plurality of virtual actuators in 1 row and 5 columns in the tactile stimulus pattern generating device (9) may correspond to one row among the plurality of actuators in 5 rows and 5 columns of the tactile stimulus providing device (10). Accordingly, the matching method of the plurality of actuators and the plurality of virtual actuators may vary depending on the embodiment.

[0049] The tactile stimulus pattern generated by the tactile stimulus pattern generating device (9) may be data, a command, or a program provided as input to the tactile stimulus providing device (10).

[0050] A tactile stimulation providing device (10) includes a plurality of actuators and drives the plurality of actuators according to a provided tactile stimulation pattern. As the driving time, driving frequency, driving intensity, driving interval, driving pulse shape, driving voltage, current waveform, etc. of the plurality of actuators are adjusted according to the tactile stimulation pattern, a user of the tactile stimulation providing device (10) can feel various tactile stimuli.

[0051] FIG. 2 is a drawing for explaining a plurality of tactile stimulus providing devices according to one embodiment of the present invention.

[0052] Referring to FIG. 2, a plurality of tactile stimulation providing devices (10V, 10H, 10A, 10G, 10F) are exemplarily illustrated. Even if not illustrated in FIG. 2, embodiments of the present invention may be applied to other tactile stimulation providing devices that can be mounted corresponding to a body part of a user.

[0053] The tactile stimulation providing device (10V) may have a vest shape and may be mounted on the user's torso. The tactile stimulation providing device (10V) may have a first sub-tactile stimulation providing device (FP) and a second sub-tactile stimulation providing device (BP). Here, the first sub-tactile stimulation providing device (FP) and the second sub-tactile stimulation providing device (BP) are configured to be connected to each other and may be mounted to surround one body part (e.g., torso) of the user. For example, the first sub-tactile stimulation providing device (FP) may serve as a front panel of the vest to cover the user's stomach and chest, and the second sub-tactile stimulation providing device (BP) may serve as a back panel of the vest to cover the user's back.

[0054] The first sub-tactile stimulus providing device (FP) may include a first part (LP) and a second part (RP). For example, the first part (LP) may be a left panel, and the second part (RP) may be a right panel. The first part (LP) and the second part (RP) may be fastened to each other via a fastening member (ZP). The fastening member (ZP) may be any known fastening member, such as a zipper, Velcro, buckle, or button.

[0055] A first part (LP) of a first sub-tactile stimulus providing device (FP) may include a plurality of actuators (F11, F12, F21, F22, F31, F32, F41, F42, F51, F52). A second part (RP) of a first sub-tactile stimulus providing device (FP) may include a plurality of actuators (F13, F14, F23, F24, F33, F34, F43, F44, F53, F54). The second sub-tactile stimulus providing device (BP) may include a plurality of actuators (B11, B12, B13, B14, B21, B22, B23, B24, B31, B32, B33, B34, B41, B42, B43, B44, B51, B52, B53, B54).

[0056] A first sub-tactile stimulus providing device (FP) may include a first edge (LSF) and a second edge (RSF). The first edge (LSF) may correspond to the left side of the user's torso. The second edge (RSF) may correspond to the right side of the user's torso. A second sub-tactile stimulus providing device (BP) may include a first edge (LSB) and a second edge (RSB). The first edge (LSB) may correspond to the left side of the user's torso. The second edge (RSB) may correspond to the right side of the user's torso. The first edges (LSF, LSB) may be directly connected to each other or may be connected via another material (e.g., an elastic material or a length-adjustable string). Similarly, the second edges (RSF, RSB) may be directly connected to each other or may be connected via another material.

[0057] The tactile stimulation providing device (10H) may be a head-mounted device and may be mounted on the user's head. The tactile stimulation providing device (10H) may include a body (HB) and a plurality of actuators (HAC) supported by the body (HB).

[0058] The tactile stimulation providing device (10A) may have an arm sleeve shape and may be mounted on both arms of the user. The tactile stimulation providing device (10A) may have a first sub-tactile stimulation providing device (10AL) and a second sub-tactile stimulation providing device (10AR). Here, the first sub-tactile stimulation providing device (10AL) and the second sub-tactile stimulation providing device (10AR) are configured separately from each other and may be mounted to surround symmetrical body parts of the user (e.g., both arms). For example, the first sub-tactile stimulation providing device (10AL) may cover the user's left arm, and the second sub-tactile stimulation providing device (10AR) may cover the user's right arm.

[0059] The first sub-tactile stimulus providing device (10AL) may include a body (ALB) and a plurality of actuators (ALAC) supported by the body (ALB). The second sub-tactile stimulus providing device (10AR) may include a body (ARB) and a plurality of actuators (ARAC) supported by the body (ARB).

[0060] The tactile stimulation providing device (10F) may have a foot-socket shape and may be mounted on both feet of the user. The tactile stimulation providing device (10F) may have a first sub-tactile stimulation providing device (10FL) and a second sub-tactile stimulation providing device (10FR). Here, the first sub-tactile stimulation providing device (10FL) and the second sub-tactile stimulation providing device (10FR) are configured separately from each other and may be mounted to surround symmetrical body parts of the user (e.g., both feet). For example, the first sub-tactile stimulation providing device (10FL) may cover the user's left foot, and the second sub-tactile stimulation providing device (10FR) may cover the user's right foot.

[0061] The first sub-tactile stimulus providing device (10FL) may include a body (FLB) and a plurality of actuators (FLAC) supported by the body (FLB). The second sub-tactile stimulus providing device (10FR) may include a body (FRB) and a plurality of actuators (FRAC) supported by the body (FRB).

[0062] The tactile stimulation providing device (10G) may have a glove shape and may be mounted on both hands of the user. The tactile stimulation providing device (10G) may have a first sub-tactile stimulation providing device (10GL) and a second sub-tactile stimulation providing device (10GR). Here, the first sub-tactile stimulation providing device (10GL) and the second sub-tactile stimulation providing device (10GR) are configured separately from each other and may be mounted to surround symmetrical body parts of the user (e.g., both hands). For example, the first sub-tactile stimulation providing device (10GL) may cover the user's left hand, and the second sub-tactile stimulation providing device (10GR) may cover the user's right hand.

[0063] The first sub-tactile stimulus providing device (10GL) may include a body (GLB) and a plurality of actuators (L1, L2, L3, L4, L5, LN) supported by the body (GLB). The second sub-tactile stimulus providing device (10GR) may include a body (GRB) and a plurality of actuators (R1, R2, R3, R4, R5, RN) supported by the body (GRB).

[0064] FIGS. 3 and 4 are drawings for explaining a process of generating a tactile stimulus pattern in a user interface according to one embodiment of the present invention.

[0065] Referring to FIG. 3, the user interface (90) may include a button (901) for creating a new tactile stimulation pattern.

[0066] Additionally, the user interface (90) may include buttons (902) for selecting pre-written templates included in the library. For example, the templates may include pre-written tactile stimulus patterns for gunshot, arrow shot, gun recoil, sword slash, item use, etc. In this case, tactile stimulus providing devices corresponding to the templates may be displayed as icons (9021) on the buttons (902). For example, the templates for gunshot and arrow shot may include tactile stimulus patterns for a vest-type tactile stimulus providing device (10V) and a head-mounted tactile stimulus providing device (10H).

[0067] In addition, the user interface (90) may include a history area (903) that shows a record of recently edited tactile stimulation patterns. The history area (903) may display information about each tactile stimulation pattern (e.g., title, types of corresponding tactile stimulation providing devices, length of time, etc.). The user interface (90) may be set to move to an editing screen for the tactile stimulation pattern when the tactile stimulation pattern is selected in the history area (903).

[0068] Referring to FIG. 4, when the button (901) of FIG. 3 is selected, the user interface (90) may generate a basic settings area (905). The basic settings area (905) may include a device selection area (9051). The device selection area (9051) may include selectable icons for tactile stimulation providing devices. In addition, the basic settings area (905) may be configured to set other options such as a title, time length, storage location, external media link, tag, description, etc.

[0069] Figures 5 and 6 are drawings for explaining the process of generating tactile stimulus unit patterns in dot mode in a user interface.

[0070] Referring to FIG. 5, a user interface (90) according to one embodiment of the present invention may include an effect setting area (ESA), a device visualization area (DVA), and a timeline area (TLA). Depending on the embodiment, the user interface (90) may further include an auxiliary area (AXA) and other areas (908, 906, 907, 9091, 9092, 9093). The auxiliary area (AXA) and other areas (906, 907, 908, 9091, 9092, 9093) may be implemented in other ways or may not be implemented at all. In particular, when implementing the embodiments of FIGS. 3 to 24, the user interface (90) may not include the auxiliary area (AXA).

[0071] The effect setting area (ESA) can include at least one tactile stimulation effect, and the tactile stimulation effect can include at least one tactile stimulation unit pattern. For example, the effect setting area (ESA) can include a first tactile stimulation effect (EF1), and the first tactile stimulation effect (EF1) can include a first tactile stimulation unit pattern (UPI1). That is, one tactile stimulation pattern can include multiple tactile stimulation effects, and each tactile stimulation effect can be hierarchically configured to include multiple tactile stimulation unit patterns. The tactile stimulation unit pattern can be the minimum unit for providing a tactile stimulation pattern.

[0072] The effect setting area (ESA) can provide information about the active time ratio, operation mode, intensity, transition effect, and corresponding tactile stimulus providing device of each tactile stimulus unit pattern. For example, the effect setting area (ESA) can display that the first tactile stimulus unit pattern (UPI1) has a first active time ratio (ATR1) of 100%, has a dot mode, is driven at an intensity of 78%, has no transition effect, and corresponds to a vest-type tactile stimulus providing device (10V).

[0073] The active time ratio may be the ratio of the active time of the tactile stimulation unit pattern to the set time of the tactile stimulation effect. For example, referring to the area (908), the set time of the first tactile stimulation effect (EF1) is set to 1 second. At this time, if the first active time ratio (ATR1) of the first tactile stimulation unit pattern (UPI1) is 100%, the first tactile stimulation unit pattern (UPI1) may start simultaneously when the first tactile stimulation effect (EF1) starts, and may end simultaneously when the first tactile stimulation effect (EF1) ends. That is, the first active time of the first tactile stimulation unit pattern (UPI1) may be set to 1 second.

[0074] In one embodiment, when the set time of the first tactile stimulation effect (EF1) is reduced, the first activation time ratio (ATR1) of the first tactile stimulation unit pattern (UPI1) may be maintained and the first activation time of the first tactile stimulation unit pattern (UPI1) may be reduced. For example, even if the set time of the first tactile stimulation effect (EF1) is reduced to 0.75 seconds, the first activation time ratio (ATR1) may be maintained at 100%. However, the first activation time of the first tactile stimulation unit pattern (UPI1) may be reduced to 0.75 seconds, which corresponds to 100% of 0.75 seconds.

[0075] For example, assume that the first tactile stimulation effect (EF1) includes multiple tactile stimulation unit patterns. In this case, if the setting time of the first tactile stimulation effect (EF1) is reduced, the activation time ratios of the multiple tactile stimulation unit patterns can be maintained, and the activation times of the multiple tactile stimulation unit patterns can be reduced collectively. According to the present embodiment, tactile stimulation patterns can be designed simply and consistently for multiple tactile stimulation providing devices corresponding to various body parts.

[0076] In one embodiment, when the setting time of the first tactile stimulation effect (EF1) is reduced, the first active time ratio (ATR1) of the first tactile stimulation unit pattern (UPI1) may be maintained, and the execution speed of the first tactile stimulation unit pattern (UPI1) may increase. For example, even if the setting time of the first tactile stimulation effect (EF1) is reduced to 0.75 seconds, the first active time ratio (ATR1) may be maintained at 100%. However, since the first active time of the first tactile stimulation unit pattern (UPI1) is shortened to 0.75 seconds, the execution speed increases in order to provide the tactile stimulation to the same location or the same path during the shortened time.

[0077] For example, assume that the first tactile stimulation effect (EF1) includes multiple tactile stimulation unit patterns. In this case, if the setting time of the first tactile stimulation effect (EF1) is reduced, the activation time ratios of the multiple tactile stimulation unit patterns can be maintained, and the execution speeds of the multiple tactile stimulation unit patterns can be uniformly increased. According to the present embodiment, tactile stimulation patterns can be designed simply and consistently for multiple tactile stimulation providing devices corresponding to various body parts.

[0078] The operation mode can define the operation method for multiple actuators. For example, the operation mode can include a dot mode, a path mode, a free path mode, and a waveform mode. The dot mode can be an operation mode that operates multiple specified actuators simultaneously. The waveform mode can be a mode that operates multiple specified actuators simultaneously, but can additionally set the time length or slope of a square pulse, or the driving voltage or current waveform. The path mode can be a mode in which a virtual tactile stimulation point moves along a path in which sequentially specified nodes are automatically connected from a starting node to an arrival node. The free path mode can be a mode in which a virtual tactile stimulation point moves along a continuously drawn path from a starting node to an arrival node.

[0079] Intensity can be the magnitude of the tactile stimulus provided by the actuator. For example, a higher intensity setting can result in a higher vibration frequency of the actuator, a higher vibration magnitude of the actuator, or a higher protrusion height of the actuator.

[0080] The transition effect may be an effect when a tactile stimulus unit pattern starts or when a tactile stimulus unit pattern ends. For example, the transition effect may include none, fade in, fade out, fade in and out, etc. As shown in Fig. 5, when the transition effect of the first tactile stimulus unit pattern (UPI1) is set to none, the first tactile stimulus unit pattern (UPI1) may start with an intensity of 78% when it starts, and may end with an intensity of 78% when it ends. The fade in may be an effect in which the intensity gradually increases when the tactile stimulus unit pattern starts. The fade out may be an effect in which the intensity gradually decreases when the tactile stimulus unit pattern ends. Fade-in and -out can be an effect where the intensity gradually increases when a tactile stimulus unit pattern begins, and then gradually decreases when the tactile stimulus unit pattern ends. The increase or decrease can be linear, exponential, or logarithmic, depending on the user's preference.

[0081] The effect setting area (ESA) may include an attribute setting area (UPSA). The attribute setting area (UPSA) may be configured to set attributes of a selected tactile stimulus unit pattern. For example, when a first tactile stimulus unit pattern (UPI1) is selected, the attribute setting area (UPSA) may provide controllable options for the first active time ratio (ATR1), intensity, transition effect, etc. of the first tactile stimulus unit pattern (UPI1).

[0082] For example, the property setting area (UPSA) may include a first unit pattern object (UPO1) capable of adjusting the first active time ratio (ATR1). The first unit pattern object (UPO1) may have a bar shape, and by adjusting one side (ATS), the start ratio of the first active time ratio (ATR1) may be adjusted, and by adjusting the other side (ATE), the end ratio of the first active time ratio (ATR1) may be adjusted. For example, the first active time ratio (ATR1) may be a value obtained by subtracting the start ratio from the end ratio. For example, if the start ratio is 0% and the end ratio is 100%, the first active time ratio (ATR1) may be 100%. For example, if the start ratio is 20% and the end ratio is 100%, the first active time ratio (ATR1) may be set to 80%. At this time, the first tactile stimulation effect (EF1) starts, and 0.2 seconds (20% of 1 second) later, the first tactile stimulation unit pattern (UPI1) starts, and the first tactile stimulation effect (EF1) and the first tactile stimulation unit pattern (UPI1) can end simultaneously. For example, if the start ratio is 0% and the end ratio is 80%, the first active time ratio (ATR1) can be set to 80%. At this time, the first tactile stimulation effect (EF1) and the first tactile stimulation unit pattern (UPI1) start simultaneously, and the first tactile stimulation unit pattern (UPI1) can end 0.2 seconds before the end of the first tactile stimulation effect (EF1).

[0083] The timeline area (TLA) can set the start and end times of the set time of the tactile stimulation effect. For example, the timeline area (TLA) can include a first effect object (EFO1) corresponding to a first tactile stimulation effect (EF1). The first effect object (EFO1) can have a bar shape, and by adjusting one side (STS), the start time of the set time of the first tactile stimulation effect (EF1) can be adjusted, and by adjusting the other side (STE), the end time of the set time of the first tactile stimulation effect (EF1) can be adjusted. The timeline area (TLA) includes at least one track, and tracks can be added for easy management. Each effect object can be positioned to be dependent on one track. The user can adjust the time position of the effect object on the track or move the effect object to another track through drag and drop operations. For example, the setting time of the tactile stimulation pattern can be displayed and controlled in the area (907). The length of the tracks can correspond to the setting time of the tactile stimulation pattern.

[0084] The device visualization area (DVA) can visualize and display at least one tactile stimulus providing device corresponding to a tactile stimulus effect. For example, the device visualization area (DVA) can visualize and display a plurality of tactile stimulus providing devices corresponding to tactile stimulus unit patterns included in a selected tactile stimulus effect. In the case of FIG. 5, the first tactile stimulus unit pattern (UPI1) included in the selected first tactile stimulus effect (EF1) corresponds to a vest-type tactile stimulus providing device (10V), and therefore, the device visualization area (DVA) can visualize the vest-type tactile stimulus providing device (10V). Through the device selection area (906), a tactile stimulus providing device corresponding to the first tactile stimulus effect (EF1) can be additionally selected. In this case, the device visualization area (DVA) will display a plurality of tactile stimulus providing devices.

[0085] The device visualization area (DVA) can set nodes of a tactile stimulus unit pattern on a visualized tactile stimulus providing device. For example, when any one of the operation mode buttons (9091, 9092, 9093) is selected, the device visualization area (DVA) can be in a state where node setting for the selected operation mode is possible. The node can be a component of the tactile stimulus unit pattern. Therefore, when the nodes are set, a tactile stimulus unit pattern having the nodes as components is generated, and information about the tactile stimulus unit pattern can be displayed in the effect setting area (ESA).

[0086] In the case of FIG. 5, the operation mode button (9091) corresponding to the dot mode is selected, and nodes corresponding to the actuators (F11, F21, F32, F43, F54, B51, B52) are set, so that a first tactile stimulation unit pattern (UPI1) including the corresponding nodes as components can be generated. The properties of the first tactile stimulation unit pattern (UPI1) can be set to default values. Thereafter, the properties of the first tactile stimulation unit pattern (UPI1) can be reset in the property setting area (UPSA).

[0087] As described above, the dot mode may be an operating mode that operates multiple designated actuators simultaneously. Accordingly, according to the case of FIG. 5, the first tactile stimulus unit pattern (UPI1) is set to vibrate the actuators (F11, F21, F32, F43, F54, B51, B52) simultaneously at 78% intensity for 1 second.

[0088] The auxiliary area (AXA) can display various auxiliary information. For example, as illustrated in FIG. 5, the auxiliary area (AXA) can display monitor information. For example, the monitor information can display a virtual person wearing tactile stimulation devices. For example, when a tactile stimulation pattern is played, the monitor information can display the tactile stimulation points felt by the user in real time. Meanwhile, the auxiliary area (AXA) can also display external media information. For example, the auxiliary area (AXA) can be configured to play a tactile stimulation pattern at a specific part of the timeline of external media such as a video or music. In addition, the auxiliary area (AXA) can be configured to perform functions such as chatting with other users and setting permissions.

[0089] Referring to FIG. 6, when the operation mode button (9091) corresponding to the dot mode is selected again, and nodes corresponding to the actuators (F13, F14, B11, B12, B13, B14) on the tactile stimulus providing device (10V) are set, a second tactile stimulus unit pattern (UPI2) including the corresponding nodes as components can be generated. That is, tactile stimulus unit patterns (UPI1, UPI2) of the same operation mode (e.g., dot mode) can be generated for the same tactile stimulus providing device (10V). The tactile stimulus unit patterns (UPI1, UPI2) may be temporally overlapped or temporally separated. At this time, if the tactile stimulus unit patterns that overlap in time drive the same actuators of the same tactile stimulus providing device, the tactile stimulus pattern design program can transmit all of the plurality of driving values ​​to the tactile stimulus providing device (or an interface program that connects the tactile stimulus pattern design program and the tactile stimulus providing device) so that the tactile stimulus providing device (or the interface program) can calculate a representative value. Alternatively, the tactile stimulus pattern design program can select a representative value on its own and transmit it to the tactile stimulus providing device (or the interface program). Methods for selecting the representative value may include a method of selecting a value that is felt most strongly by the user, a method of adding multiple values ​​linearly or logarithmically, etc.

[0090] In addition, the second tactile stimulus unit pattern (UPI2) is set to have an intensity of 81% and is set to have a fade-in and -out transition effect. According to one embodiment, a fade-in end ratio (FIE) may be adjustable on the second unit pattern object (UPO2). A fade-in effect in which the intensity gradually increases may be exerted from a start ratio (ATS) to a fade-in end ratio (FIE). According to one embodiment, a fade-out start ratio (FOS) may be adjustable on the second unit pattern object (UPO2). A fade-out effect in which the intensity gradually decreases linearly may be exerted from a fade-out start ratio (FOS) to an end ratio (ATE).

[0091] Figure 7 is a drawing for explaining the process of generating a tactile stimulus unit pattern of a path mode in a user interface in the first display mode.

[0092] Referring to FIG. 7, the device visualization area (DVA) can visualize and display a tactile stimulus providing device (10V) including a first sub-tactile stimulus providing device (FP) and a second sub-tactile stimulus providing device (BP). At this time, the first display mode (DPM1) may be selected. According to the first display mode (DPM1), the first sub-tactile stimulus providing device (FP) and the second sub-tactile stimulus providing device (BP) can be visualized to be arranged side by side.

[0093] In the case of Fig. 7, an operation mode button (9092) corresponding to the path mode can be selected. The path mode may be a mode in which a virtual tactile stimulation point moves along a tactile stimulation provision path in which sequentially designated nodes (AP1, AP2, AP3, AP4) are automatically connected from a starting node (AP1) to an arrival node (AP4). For example, if a user designates a node (AP1) and then designates a node (AP2), a unit path (UP1) connecting the node (AP1) to the node (AP2) with the shortest distance can be generated. In addition, if a user designates a node (AP3) after designating a node (AP2), a unit path (UP2) connecting the node (AP2) to the node (AP3) with the shortest distance can be generated. In addition, if a user designates a node (AP4) after designating a node (AP3), a unit path (UP3) connecting the node (AP3) to the node (AP4) with the shortest distance can be generated. The third tactile stimulation unit pattern (UPI3) can be set as a tactile stimulation provision path including unit paths (UP1, UP2, UP3).

[0094] Each node (AP1 to AP4) does not necessarily have to be at a position corresponding to the actuators (F11 to B54). By having the surrounding actuators provide tactile stimulation, the user can feel the tactile stimulation at a virtual position between the surrounding actuators. For example, to provide a virtual tactile stimulation at the node (AP1), the actuators (F11, F12, F21) can provide the tactile stimulation. Hereinafter, such a virtual position is defined as a tactile stimulation point. Accordingly, the nodes (AP1 to AP4) can be set to arbitrary positions on the visualized tactile stimulation providing device (10V).

[0095] The third tactile stimulus unit pattern (UPI3) may be set as a tactile stimulus provision path from a departure node (AP1) on a first sub-tactile stimulus provision device (FP) to an arrival node (AP4) on a second sub-tactile stimulus provision device (BP). At this time, when a node (AP2) is designated on the first sub-tactile stimulus provision device (FP) and a node (AP3) following the node (AP2) is designated on the second sub-tactile stimulus provision device (BP), the tactile stimulus provision path may pass through the second edge (RSF) of the first sub-tactile stimulus provision device (FP) and the second edge (RSB) of the second sub-tactile stimulus provision device (BP) such that the path between the nodes (AP2) and (AP3) becomes the first shortest distance (or, the first straight-line distance).

[0096] In another embodiment, when a node (AP2) is designated on a first sub-tactile stimulus providing device (FP) and a node (AP3) following the node (AP2) is designated on a second sub-tactile stimulus providing device (BP), the tactile stimulus providing path may pass through a first edge (LSF) of the first sub-tactile stimulus providing device (FP) and a first edge (LSB) of the second sub-tactile stimulus providing device (BP) so that the path between the node (AP2) and the node (AP3) becomes a second shortest distance (or, a second straight-line distance).

[0097] That is, the unit path (UP2) connecting the nodes (AP2) and (AP3) can be set to either the first shortest distance or the second shortest distance. For example, in the case of FIG. 7, the unit path (UP2) can be automatically selected as the first shortest distance, which is the shorter distance between the first shortest distance and the second shortest distance. According to an embodiment, the user interface (90) can provide an option for the user to select either the first shortest distance or the second shortest distance. For example, when specifying the node (AP3), if the user right-clicks the mouse, the unit path (UP2) can be selected as the second shortest distance. For another example, when specifying the node (AP3), if the user holds down the left-click of the mouse, the unit path (UP2) can be selected as the second shortest distance.

[0098] Figure 8 is a drawing for explaining the process of generating a tactile stimulus unit pattern of a path mode in a second display mode in a user interface.

[0099] Referring to FIG. 8, the device visualization area (DVA) can visualize and display a tactile stimulus providing device (10V) including a first sub-tactile stimulus providing device (FP) and a second sub-tactile stimulus providing device (BP). At this time, the second display mode (DPM2) may be selected. According to the second display mode (DPM2), the second sub-tactile stimulus providing device (BP) can be visualized to be positioned between the first part (LP) of the first sub-tactile stimulus providing device (FP) and the second part (RP) of the first sub-tactile stimulus providing device (FP). According to the second display mode (DPM2), the vest-type tactile stimulus providing device (10V) can be visualized as a viewpoint viewed from behind the vest with the fastening member (ZP) unfastened.

[0100] According to the present embodiment, since the user can edit the third tactile stimulation unit pattern (UPI3) by switching between the first display mode (DPM1) and the second display mode (DPM2), the user can easily and uniformly design the tactile stimulation pattern for multiple sub-tactile stimulation providing devices (FP, BP). That is, according to the present embodiment, there is an advantage in that a 360-degree tactile stimulation pattern can be easily designed on a 2D screen.

[0101] Figures 9 to 11 are diagrams for explaining a process of generating a tactile stimulus unit pattern in a free path mode in a user interface in a first display mode. Figure 12 is a diagram for explaining a process of generating a tactile stimulus unit pattern in a free path mode in a user interface in a second display mode.

[0102] Referring to FIG. 9, the device visualization area (DVA) can visualize and display a tactile stimulus providing device (10V) including a first sub-tactile stimulus providing device (FP) and a second sub-tactile stimulus providing device (BP). At this time, the first display mode (DPM1) may be selected. According to the first display mode (DPM1), the first sub-tactile stimulus providing device (FP) and the second sub-tactile stimulus providing device (BP) may be visualized to be arranged side by side.

[0103] In the case of Fig. 9, an operation mode button (9093) corresponding to the free path mode can be selected. The free path mode may be a mode in which a virtual tactile stimulation point moves along a continuously drawn path from a starting node (AP5) to an arrival node (AP8, see Fig. 11). The fourth tactile stimulation unit pattern (UPI4) may be set as a tactile stimulation provision path from a starting node (AP5) on a first sub-tactile stimulation provision device (FP) to an arrival node (AP8) on a second sub-tactile stimulation provision device (BP).

[0104] At this time, the second edge (RSF) of the first sub-tactile stimulus providing device (FP) is connected to the second edge (RSB) of the second sub-tactile stimulus providing device (BP), but in the first display mode (DPM1), the second edges (RSF, RSB) are visualized spaced apart from each other, so it is impossible to continuously draw a free path.

[0105] According to one embodiment, the tactile stimulus provision path of the fourth tactile stimulus unit pattern (UPI4) may include a first path (PTH1) on a first sub-tactile stimulus provision device (FP) and a second path (PTH2) on a second sub-tactile stimulus provision device (BP) (see FIG. 11).

[0106] A first path (PTH1) can be drawn continuously from a starting node (AP5) to a first intermediate node (AP6) of a second edge (RSF) of a first sub-tactile stimulus providing device (FP). In addition, a second path (PTH2) can be drawn continuously from a second intermediate node (AP7) of a second edge (RSB) of a second sub-tactile stimulus providing device (BP) to an arrival node (AP8). At this time, a path (910) between the first intermediate node (AP6) and the second intermediate node (AP7) can be formed by being automatically connected (see FIG. 12).

[0107] According to one embodiment, the second intermediate node (AP7) can be designated within a certain range (CA23) from the first intermediate node (AP6). Referring to FIG. 9, after the first path (PTH1) is drawn and before the second path (PTH2) is drawn, the shape of the input cursor (IC1) within the certain range (CA23) and the shape of the input cursor (IC2) outside the certain range (CA23) may be different from each other. Accordingly, the user can determine whether or not the free path can be drawn continuously through the shape of the input cursor. If the user starts drawing the free path outside the certain range (CA23), the second path (PTH2) is not generated, and a new tactile stimulus unit pattern may be generated.

[0108] In another embodiment, the second intermediate node (AP7) may be set to be identical to the first intermediate node (AP6). That is, the coordinates of the second intermediate node (AP7) in the first direction (DR1) and the second direction (DR2) may be identical to the coordinates of the first intermediate node (AP6) in the first direction (DR1) and the second direction (DR2). The first direction (DR1) and the second direction (DR2) may be directions that are perpendicular to each other. For example, when a user starts drawing the second path (PTH2) within a certain range (CA23), the second intermediate node (AP7) may be set to be identical to the first intermediate node (AP6), thereby satisfying the user's need to accurately connect the first path (PTH1) and the second path (PTH2).

[0109] In another embodiment, the coordinates of the second intermediate node (AP7) in the second direction (DR2) may be set to be the same as the coordinates of the first intermediate node (AP6) in the second direction (DR2), but the coordinates of the second intermediate node (AP7) in the first direction (DR1) may be set to be different from the coordinates of the first intermediate node (AP6) in the first direction (DR1). Alternatively, the coordinates of the second intermediate node (AP7) in the first direction (DR1) may be the same as the coordinates of the first intermediate node (AP6) in the first direction (DR1), but the coordinates of the second intermediate node (AP7) in the second direction (DR2) may be set to be different from the coordinates of the first intermediate node (AP6) in the second direction (DR2). According to this embodiment, the unnaturalness of mouse operation that a user may feel due to automatic coordinate alignment can be reduced.

[0110] Referring to Fig. 10, after the first path (PTH1) is drawn and before the second path (PTH2) is drawn, a guide line (GDL) may be displayed on the second sub-tactile stimulus providing device (BP) at a location corresponding to the first intermediate node (AP6). Accordingly, the user can more accurately draw the second path (PTH2).

[0111] Referring to FIG. 12, the device visualization area (DVA) can visualize the fourth tactile stimulus unit pattern (UPI4) in the second display mode (DPM2). According to the present embodiment, since the user can edit the fourth tactile stimulus unit pattern (UPI4) by switching between the first display mode (DPM1) and the second display mode (DPM2), the user can easily and uniformly design the tactile stimulus pattern for a plurality of sub-tactile stimulus providing devices (FP, BP). That is, according to the present embodiment, there is an advantage in that a 360-degree tactile stimulus pattern can be easily designed on a 2D screen.

[0112] Figure 13 is a diagram illustrating a process for generating a tactile stimulus unit pattern in waveform mode in a user interface.

[0113] First, through the device selection area (906), a tactile stimulus providing device (10G) corresponding to the first tactile stimulus effect (EF1) can be additionally selected. The device visualization area (DVA) can visualize and display multiple tactile stimulus providing devices (10V, 10G).

[0114] Next, an operation mode button (9094) corresponding to the waveform mode may be selected. In one embodiment, the waveform mode may be selected only for a tactile stimulus providing device (10G) including a linear resonant actuator. The waveform mode may be a mode that operates multiple designated actuators simultaneously, while additionally allowing the time length or slope of the square pulse to be set. The slope may be set to 0, to be set to be incremental, or to be set to be decremental. For example, the fifth tactile stimulus unit pattern (UPI5) may operate actuators (L1, L3, L4) simultaneously, while allowing the time length of the square pulse to be set to 20 ms and the slope of the square pulse to be set to be decremental.

[0115] In another embodiment, the waveform mode can also be selected for haptic stimulus providing devices including linear resonant actuators, voice coil actuators, piezo haptic actuators, etc. In the waveform mode of voice coil, piezo actuator, etc., the waveform of the driving voltage and current can be configured to be adjusted rather than the time and slope of the square pulse.

[0116] Figure 14 is a drawing for explaining a tactile stimulus providing path set on a first sub-tactile stimulus providing device and a second sub-tactile stimulus providing device.

[0117] In the case of Fig. 14, an operation mode button (9093) corresponding to the free path mode can be selected. The sixth tactile stimulation unit pattern (UPI6) can be set as a tactile stimulation provision path (TPTH) from a departure node (AP9) on the first sub-tactile stimulation provision device (10GL) to an arrival node (AP10) on the second sub-tactile stimulation provision device (10GR). The sixth tactile stimulation unit pattern (UPI6) can be set so that a virtual tactile stimulation point (TTP) moves to the tactile stimulation provision path (TPTH).

[0118] According to one embodiment, during at least a portion of a period during which a tactile stimulation point (TTP) moves through a section (X2) between a first sub-tactile stimulation providing device (10GL) and a second sub-tactile stimulation providing device (10GR), a first actuator (L5) of the first sub-tactile stimulation providing device (10GL) and a second actuator (R1) of the second sub-tactile stimulation providing device (10GR) may be driven simultaneously. Accordingly, a user can easily implement a tactile stimulation in which a virtual object moves between both hands.

[0119] According to one embodiment, the speed at which the tactile stimulation point (TTP) moves between the first sub-tactile stimulation providing device (10GL) and the second sub-tactile stimulation providing device (10GR) may be faster than the speed at which the tactile stimulation point (TTP) moves over the first sub-tactile stimulation providing device (10GL) or the second sub-tactile stimulation providing device (10GR). For example, the tactile stimulation point (TTP) may move faster in the section (X2) than in the section (X1). Here, the lengths of the sections (X1, X2) and the moving speeds of the tactile stimulation point (TTP) are described based on the actual sub-tactile stimulation providing devices (10GL, 10GR) (see FIG. 2), and are not based on the length on the user interface (90) illustrated in FIG. 14. For example, the section (X1) may be the distance between the index finger of the left hand and the thumb of the left hand, and the section (X2) may be the distance between the thumb of the left hand and the thumb of the right hand. Although it may vary from person to person, it is assumed that the section (X2) is approximately 20 times the length of the section (X1). Therefore, if the tactile stimulation point (TTP) moves at the same speed in the sections (X1) and (X2), it may be difficult for the user to feel the continuity of the tactile stimulation. According to the present embodiment, by increasing the moving speed of the tactile stimulation point (TTP) in the section (X2), the user can experience the continuity of the tactile stimulation provision path (TPTH). Although the sections (X1) and (X2) are displayed as having similar lengths on the user interface (90) of FIG. 14, the user may also set the scale so that the ratio of the sections (X1, X2) is similar to the ratio in the actual devices (10GL, 10G). Additionally, the user can set the movement speed of the tactile stimulation point (TTP) in the section (X2) according to his / her preference.

[0120] Figures 15 to 22 are diagrams for explaining various options that can set multiple tactile stimulus unit patterns at once.

[0121] Referring to FIG. 15, when a button (911) is selected, a menu area (912) may be generated. The menu area (912) may include various options that can collectively set multiple tactile stimulation unit patterns. These options may be applied to all tactile stimulation unit patterns belonging to a tactile stimulation effect, or may be applied only to tactile stimulation unit patterns corresponding to a specific device among the tactile stimulation effects.

[0122] For example, the menu area (912) may include options such as horizontal mirror inversion (9121), vertical mirror inversion (9122), equal time distribution (9123), fade out (9124), and unit pattern setting (9125).

[0123] Referring to Fig. 16, a case is illustrated in which horizontal mirror inversion (9121) is applied to all tactile stimulus unit patterns (UPIs) belonging to the first tactile stimulus effect (EF1). Compared to Fig. 15, it can be confirmed that the tactile stimulus provision path of the tactile stimulus provision device (10V) is inverted left and right, and the tactile stimulus provision path of the tactile stimulus provision device (10G) is inverted left and right.

[0124] Referring to Fig. 17, a case is illustrated in which vertical mirror inversion (9122) is applied to all tactile stimulus unit patterns (UPIs) belonging to the first tactile stimulus effect (EF1). Compared to Fig. 15, it can be confirmed that the tactile stimulus provision path of the tactile stimulus provision device (10V) is inverted up and down, and the tactile stimulus provision path of the tactile stimulus provision device (10G) is inverted up and down.

[0125] Referring to Fig. 18, compared to Fig. 5, a case is illustrated where one side (STS') of the first effect object (EFO1) is adjusted, thereby delaying the start time of the setting time of the first tactile stimulation effect (EF1). Referring to area (908), it can be confirmed that the setting time of the first tactile stimulation effect (EF1) has been reduced to 0.75 seconds.

[0126] In one embodiment, when the set time of the first tactile stimulation effect (EF1) is reduced, the active time ratios (ATRs) of the plurality of tactile stimulation unit patterns are maintained, and the active times of the plurality of tactile stimulation unit patterns may be reduced collectively (see the description of FIG. 5). In one embodiment, when the set time of the first tactile stimulation effect (EF1) is reduced, the active time ratios (ATRs) of the plurality of tactile stimulation unit patterns are maintained, and the execution speeds of the plurality of tactile stimulation unit patterns may be increased collectively (see the description of FIG. 5). According to these embodiments, tactile stimulation patterns can be designed simply and consistently for a plurality of tactile stimulation providing devices corresponding to various body parts.

[0127] Referring to FIG. 19, a case is illustrated in which equal time distribution (9123) is applied to tactile stimulus unit patterns corresponding to a tactile stimulus providing device (10V). At this time, the active time ratios (ARTV) of the tactile stimulus unit patterns corresponding to the tactile stimulus providing device (10V) can be arranged in a step shape with equal time intervals. At this time, it can be confirmed that the active time ratios (ARTG) of the tactile stimulus unit patterns corresponding to the tactile stimulus providing device (10G) are maintained without change.

[0128] Although not shown, the menu area (912) may further include options for accelerated time distribution, decelerated time distribution, etc. Accelerated time distribution may be arranged in a step-like manner with gradually decreasing time intervals for the active time ratios of the tactile stimulus unit patterns. Decelerated time distribution may be arranged in a step-like manner with gradually increasing time intervals for the active time ratios of the tactile stimulus unit patterns.

[0129] Referring to FIG. 20, a case is illustrated where a fade-out (9124) is applied to all tactile stimulus unit patterns (UPIs) belonging to the first tactile stimulus effect (EF1). Although not illustrated, the menu area (912) may further include fade-in, fade-in and-out options, etc.

[0130] Referring to Fig. 21, a case is illustrated where the sixth active time ratio (ATR6) of the sixth tactile stimulus unit pattern (UPI6) is adjusted. The attribute setting area (UPSA) may include a sixth unit pattern object (UPO6) capable of adjusting the sixth active time ratio (ATR6). The sixth unit pattern object (UPO6) is adjusted so that one side (ATS') has a start ratio greater than 0, and the other side (ATE') has an end ratio less than 100%.

[0131] Referring to Fig. 22, when the unit pattern setting (9125) is selected in the menu area (912), a unit pattern setting area (9125p) can be created. Unlike the attribute setting area (UPSA) where only the attributes of one tactile stimulus unit pattern can be set, the unit pattern setting area (9125p) allows for the easy setting of attributes of all tactile stimulus unit patterns.

[0132] Figure 23 is a drawing for explaining a tactile stimulus providing path set on a first tactile stimulus providing device and a second tactile stimulus providing device.

[0133] Referring to Fig. 23, a tactile stimulation pattern is illustrated that includes a first tactile stimulation effect (EF1) and a second tactile stimulation effect (EF2). Referring to the timeline area (TLA), it can be confirmed that a first effect object (EFO1) corresponding to the first tactile stimulation effect (EF1) and a second effect object (EFO2) corresponding to the second tactile stimulation effect (EF2) are arranged on the first track.

[0134] The tactile stimulus providing devices (10H, 10G, 10F, 10V, 10A) to which the second tactile stimulus effect (EF2) is to be provided can be selected through the device selection area (906). The second tactile stimulus effect (EF2) can include a seventh tactile stimulus unit pattern (UPI7) corresponding to the tactile stimulus providing device (10H), an eighth tactile stimulus unit pattern (UPI8) corresponding to the tactile stimulus providing device (10F), and a ninth tactile stimulus unit pattern (UPI9) corresponding to a plurality of tactile stimulus providing devices (10G, 10A).

[0135] The ninth tactile stimulation unit pattern (UPI9) may be set as a tactile stimulation provision path (TPTH) from a departure node (AP11) on a tactile stimulation provision device (10G) among a plurality of tactile stimulation provision devices (10H, 10G, 10F, 10V, 10A) to an arrival node (AP12) on a tactile stimulation provision device (10A). The ninth tactile stimulation unit pattern (UPI9) may be set so that a virtual tactile stimulation point (TTP) moves along the tactile stimulation provision path (TPTH).

[0136] According to one embodiment, at least one actuator of the tactile stimulation providing device (10G) and at least one actuator of the tactile stimulation providing device (10A) may be driven simultaneously during at least a portion of the time during which the tactile stimulation point (TTP) moves between the tactile stimulation providing device (10G) and the tactile stimulation providing device (10A). Accordingly, a user may experience a tactile stimulation moving between multiple body parts. For example, a user may feel a tactile stimulation like a snake crawling from a hand to an arm.

[0137] According to one embodiment, the speed at which the tactile stimulation point (TTP) moves between the tactile stimulation providing device (10G) and the tactile stimulation providing device (10A) may be faster than the speed at which the tactile stimulation point (TTP) moves over the tactile stimulation providing device (10G) or the tactile stimulation providing device (10A). According to this embodiment, by increasing the speed at which the tactile stimulation point (TTP) moves between distant body parts, the user can experience the continuity of the tactile stimulation providing path (TPTH).

[0138] The user interface (90) may be in a state where the 8th tactile stimulus unit pattern (UPI8) corresponding to the tactile stimulus providing device (10F) is selected. Here, the selected state may mean a state where the user clicks using an input device such as a mouse, a state where the user touches with a finger, etc. At this time, operation mode buttons (909a) corresponding to the tactile stimulus providing device (10F) may be displayed.

[0139] According to one embodiment, when a tactile stimulus providing device (10G) that does not correspond to the selected 8th tactile stimulus unit pattern (UPI8) is preliminarily selected, operation mode buttons (909b) corresponding to the tactile stimulus providing device (10G) may be displayed. Here, preliminarily selecting may include an action immediately before selection, for example, a case where a user moves a mouse cursor onto the tactile stimulus providing device (10G), a case where a finger for touching hovers over the tactile stimulus providing device (10G), etc. According to this embodiment, the user can easily start creating a tactile stimulus unit pattern of a tactile stimulus providing device (10G) that is different from the selected tactile stimulus providing device (10F). In addition, in the case of the tactile stimulation providing device (10G), an operation mode button (9094) corresponding to a waveform mode not provided by the tactile stimulation providing device (10F) is provided, so that the user can easily recognize that different operation modes can be provided for each tactile stimulation providing device.

[0140] Figure 24 is a diagram for explaining a group of tactile stimulation effects and multiple tracks.

[0141] Referring to Fig. 24, a tactile stimulation pattern is illustrated including a first tactile stimulation effect (EF1), a second tactile stimulation effect (EF2), and a third tactile stimulation effect (EF3). Referring to the timeline area (TLA), it can be confirmed that a first effect object (EFO1) corresponding to the first tactile stimulation effect (EF1) and a second effect object (EFO2) corresponding to the second tactile stimulation effect (EF2) are arranged on a first track, and a third effect object (EFO3) corresponding to the third tactile stimulation effect (EF3) is arranged on a second track.

[0142] According to one embodiment, the first tactile stimulation effect (EF1) and the second tactile stimulation effect (EF2) may be designated as a first group (GRP1). The first group (GRP1) may facilitate integrated management of the first tactile stimulation effect (EF1) and the second tactile stimulation effect (EF2).

[0143] Figures 25 to 27 are drawings for explaining a process in which multiple users participate in the design of a tactile stimulation pattern.

[0144] Referring to Figure 25, it can be seen that chat and permission settings between multiple users are implemented in the auxiliary area (AXA). Furthermore, it can be seen that input cursors (ICA, ICB, ICC) of multiple users are located in the device visualization area (DVA). For example, it is assumed that the first user (User_A) is the owner of the tactile stimulus pattern, and the second user (User_B) and the third user (User_B) are viewers.

[0145] The second user (User_B) and the third user (User_B), who correspond to the viewer, can have the View permission. The second user (User_B) and the third user (User_B) can experience the tactile stimulation using their tactile stimulation providing devices by playing the tactile stimulation pattern. In addition, the second user (User_B) and the third user (User_B) can also leave a memo (MEM) at a desired location in the device visualization area (DVA).

[0146] In addition, when the first user (User_A) grants the Edit permission, the second user (User_B) and the third user (User_B) may additionally have the Edit permission. For example, the first user (User_A) may grant the Edit permission to the second user (User_B) or the third user (User_B) by pressing the Edit button of the second user (User_B) or the third user (User_B) in the auxiliary area (AXA). However, only one of the first to third users (User_A, User_B, User_C) may be set to have the Edit permission. The input cursor (ICA) of a user with the Edit permission and the input cursors (ICB, ICC) of users without the Edit permission may be different from each other.

[0147] In one embodiment, editing permissions can be granted independently for each tactile stimulus unit pattern. Therefore, for a single tactile stimulus effect, multiple users can work on tactile stimulus unit patterns for which they each have permissions.

[0148] The owner, a first user (User_A), can also directly play a tactile stimulation pattern to connected users (User_B, User_C). For example, the first user (User_A) can command the tactile stimulation providing device of the second user (User_B) or the third user (User_B) to play the tactile stimulation pattern by pressing the play button of the second user (User_B) or the third user (User_B) in the auxiliary area (AXA). At this time, the users (User_B, User_C) can also set the first user (User_A) to not play the tactile stimulation pattern at will. For example, the second user (User_B) can set the first user (User_A) to not play the tactile stimulation pattern at will by pressing the play button on his / her user interface.

[0149] Referring to FIG. 26, the relationship between the tactile stimulation pattern server (201), the media server (202), the tactile stimulation pattern generation devices (9A, 9B), and the tactile stimulation provision devices (10A, 10B) is exemplarily illustrated. It is assumed that the tactile stimulation pattern generation device (9A) and the tactile stimulation provision device (10A) are used by a first user (User_A) who is the owner of the tactile stimulation pattern, and the tactile stimulation pattern generation device (9B) and the tactile stimulation provision device (10B) are used by a second user (User_B) who is the viewer.

[0150] When a first user (User_A) creates the first to nth tactile stimulation patterns, the first to nth tactile stimulation patterns can be stored in the tactile stimulation pattern server (201). n may be an integer greater than 1. At this time, when a video or music is added to the tactile stimulation pattern, the video or music may also be stored in the tactile stimulation pattern server (201). If a video or music from a media server (202) provided by a third party online is added to the tactile stimulation pattern, information about the online link of the video or music may be stored in the tactile stimulation pattern, and the video or music may not be stored separately in the tactile stimulation pattern server (201).

[0151] The first user (User_A) who created the tactile stimulation pattern in this way has the owner's authority, and the first user (User_A) can transfer this authority or grant the same level of authority to multiple people. When the owner first creates the tactile stimulation pattern, he / she can feel the tactile stimulation pattern through the tactile stimulation providing device (10A) through the driver software installed in the tactile stimulation pattern generating device (9A) or the tactile stimulation providing device (10A).

[0152] The first to nth tactile stimulation patterns stored in the tactile stimulation pattern server (201) can be accessed through a dedicated online platform that collects links or tactile stimulation patterns, and a second user (User_B) with viewer authority can download or stream them. At this time, in the case of tactile stimulation patterns in which a video is stored together, the video is also downloaded, cached, or streamed from the tactile stimulation pattern server (201), and in the case of a tactile stimulation pattern to which an online video is linked, the video is separately downloaded, cached, or streamed from the corresponding media server (202). At this time, the second user (User_B) can also directly play the tactile stimulation pattern through a combination of a web browser and driver software, or only through the driver software, without going through the tactile stimulation pattern design program of the tactile stimulation pattern generation device (9B).

[0153] Referring to FIG. 27, the relationship between the tactile stimulation pattern server (201), the tactile stimulation pattern generating devices (9A, 9B), and the tactile stimulation providing devices (10A, 10B) is exemplarily illustrated.

[0154] When two users (User_A, User_B) are co-creating the same tactile stimulus pattern, they can have a data flow like Figure 27. The first user (User_A) may have editing rights, and the second user (User_B) may only have viewer rights.

[0155] In order to function as a collaboration tool, the mouse movements, chats, memos, etc. of the second user (User_B) must be confirmed in real time on the screen of the first user (User_A). In addition, the first user (User_A) must be able to play back tactile stimulation patterns to multiple viewers. At this time, in order to ensure real-time performance by exchanging minimal data, basic information on the video and tactile stimulation patterns may be cached or downloaded to the tactile stimulation pattern generation device (9A, 9B) of each user, and only the first interaction data may be configured to be exchanged through the tactile stimulation pattern server (201). The first interaction data may correspond to coordinates for mouse movements, chats, memos, tactile stimulation pattern playback commands that the first user (User_A) transmits to the viewers, etc.

[0156] For example, when a first user (User_A) clicks a play button to transmit a tactile stimulation pattern to a second user (User_B), only the event that the play button was clicked is transmitted instead of the entire tactile stimulation pattern being transmitted through the tactile stimulation pattern server (201), and the tactile stimulation pattern cached in the tactile stimulation pattern generation device (9B) of the second user (User_B) can be played. Similarly, only the mouse coordinates of the second user (User_B) can be transmitted to the first user (User_A). When the first user (User_A) changes the tactile stimulation pattern, this change can be updated to the tactile stimulation pattern server (201), and then to the second user (User_B). The update of the tactile stimulation pattern itself does not cause a problem because it requires less real-time performance compared to mouse movement, chatting, pattern playback, etc.

[0157] Or, to further increase the speed, the tactile stimulation pattern generation device (9A) of the first user (User_A) with editing authority may act as the host of the server without going through the tactile stimulation pattern server (201), and the tactile stimulation pattern generation devices (9A, 9B) may exchange second interaction data. In this case, data such as chats and memos are also updated to the tactile stimulation pattern server (201) only through the first user (User_A), so although the stability of data storage is somewhat reduced, an interaction speed closer to real-time can be guaranteed.

[0158] The drawings and detailed description of the invention described so far are merely illustrative of the present invention and are used solely for the purpose of explaining the present invention and are not intended to limit the scope of the invention as defined in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent embodiments are possible. Accordingly, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

Claims

1. A computer-readable recording medium that records a program that can be executed by a computer. The above program generates a user interface, wherein the user interface: An effect setting area including a plurality of tactile stimulation unit patterns constituting a tactile stimulation effect, and setting the activation time ratios of the tactile stimulation unit patterns with respect to the setting time of the tactile stimulation effect; A device visualization area that visualizes and displays a plurality of tactile stimulus providing devices corresponding to the above tactile stimulus unit patterns and sets nodes of the tactile stimulus unit patterns on the visualized tactile stimulus providing devices; and Including a timeline area that sets the start and end points of the set time of the above tactile stimulation effect, A computer-readable recording medium.

2. In paragraph 1, When the set time of the above tactile stimulation effect is reduced, the activation time ratios of the tactile stimulation unit patterns are maintained, and the activation times of the tactile stimulation unit patterns are uniformly reduced. A computer-readable recording medium.

3. In paragraph 1, When the set time of the above tactile stimulation effect is reduced, the activation time ratios of the tactile stimulation unit patterns are maintained, and the execution speeds of the tactile stimulation unit patterns uniformly increase. A computer-readable recording medium.

4. In paragraph 1, Among the above tactile stimulus unit patterns, the first tactile stimulus unit pattern is set as a tactile stimulus provision path from a departure node on a first tactile stimulus provision device among the plurality of tactile stimulus provision devices to an arrival node on a second tactile stimulus provision device. A computer-readable recording medium.

5. In paragraph 4, The above first tactile stimulation unit pattern is set to move a virtual tactile stimulation point along the tactile stimulation provision path, During at least a portion of the period during which the tactile stimulation point moves between the first tactile stimulation providing device and the second tactile stimulation providing device, the first actuator of the first tactile stimulation providing device and the second actuator of the second tactile stimulation providing device are driven simultaneously. A computer-readable recording medium.

6. In paragraph 4, The above first tactile stimulation unit pattern is set to move a virtual tactile stimulation point along the tactile stimulation provision path, The speed at which the tactile stimulation point moves between the first tactile stimulation providing device and the second tactile stimulation providing device is faster than the speed at which the tactile stimulation point moves above the first tactile stimulation providing device or the second tactile stimulation providing device. A computer-readable recording medium.

7. A computer-readable recording medium that records a program that can be executed by a computer, The above program generates a user interface, wherein the user interface: A device visualization area for visualizing and displaying a tactile stimulus providing device including a first sub-tactile stimulus providing device and a second sub-tactile stimulus providing device, and setting nodes of a tactile stimulus unit pattern on the visualized tactile stimulus providing device, The above tactile stimulation unit pattern is set as a tactile stimulation provision path from a departure node on the first sub-tactile stimulation provision device to an arrival node on the second sub-tactile stimulation provision device. A computer-readable recording medium.

8. In paragraph 7, The first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device are configured separately from each other and are mounted to surround symmetrical body parts of the user, respectively. A computer-readable recording medium.

9. In paragraph 8, The above tactile stimulation unit pattern is set so that a virtual tactile stimulation point moves along the tactile stimulation provision path, During at least a portion of the period during which the tactile stimulation point moves between the first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device, the first actuator of the first sub-tactile stimulation providing device and the second actuator of the second sub-tactile stimulation providing device are driven simultaneously. A computer-readable recording medium.

10. In paragraph 8, The above tactile stimulation unit pattern is set so that a virtual tactile stimulation point moves along the tactile stimulation provision path, The speed at which the tactile stimulation point moves between the first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device is faster than the speed at which the tactile stimulation point moves above the first sub-tactile stimulation providing device or the second sub-tactile stimulation providing device. A computer-readable recording medium.

11. In paragraph 7, The first sub-tactile stimulation providing device and the second sub-tactile stimulation providing device are configured to be connected to each other and are mounted to surround one body part of the user. A computer-readable recording medium.

12. In paragraph 11, The above tactile stimulus provision path is formed by automatically connecting sequentially designated nodes, When a first node is designated on the first sub-tactile stimulus providing device and a second node following the first node is designated on the second sub-tactile stimulus providing device, the tactile stimulus providing path passes through the edge of the first sub-tactile stimulus providing device and the edge of the second sub-tactile stimulus providing device so that the path between the first node and the second node is the shortest distance. A computer-readable recording medium.

13. In paragraph 11, The above tactile stimulus providing path includes a first path on the first sub-tactile stimulus providing device and a second path on the second sub-tactile stimulus providing device, The first path is drawn continuously from the starting node to the first intermediate node at the edge of the first sub-tactile stimulus providing device, The second path is drawn continuously from the second intermediate node at the edge of the second sub-tactile stimulus providing device to the arrival node, The path between the first intermediate node and the second intermediate node is formed by automatically connecting, A computer-readable recording medium.

14. In paragraph 13, The second intermediate node is designated within a certain range from the first intermediate node, A computer-readable recording medium.

15. In paragraph 14, After the first path is drawn and before the second path is drawn, the shape of the input cursor within the predetermined range and the shape of the input cursor outside the predetermined range are different from each other. A computer-readable recording medium.

16. In paragraph 14, After the first path is drawn and before the second path is drawn, a guide line is displayed on the second sub-tactile stimulus providing device for a position corresponding to the first intermediate node. A computer-readable recording medium.

17. In paragraph 11, In the first display mode, the first sub-tactile stimulus providing device and the second sub-tactile stimulus providing device are visualized to be arranged side by side, In the second display mode, the second sub-tactile stimulus providing device is visualized to be positioned between the first part of the first sub-tactile stimulus providing device and the second part of the first sub-tactile stimulus providing device. A computer-readable recording medium.

Images