Terminal for providing realistic tactile content and method thereof

Abstract

The present invention relates to a terminal for providing realistic tactile content and a method thereof. The terminal includes: a display unit for displaying an image based on image content; a cover window disposed on an upper portion of the display unit; and a driving unit which is disposed on one surface of the cover window and includes a first driving unit for providing a first tactile stimulus with respect to a surface pressure among neural stimulus electricity-based tactile data on the basis of tactile content synchronized with the image content and a second driving unit for providing a second tactile stimulus with respect to surface roughness.

Description

Terminal and method for providing realistic tactile content

[0001] The present invention relates to a terminal and a method for providing realistic tactile content, and more particularly, to a method for providing surface pressure and surface roughness to a display device based on tactile content synchronized with video content.

[0002]

[0003] The material described in this section merely provides background information on one embodiment of the present invention and does not constitute prior art.

[0004] Display devices used to rely solely on sight and hearing to convey images and sounds, but recently, in display devices that include touch screens, the number of display devices that apply haptic technology, which can convey a tactile sensation corresponding to the image when touched with a finger or a pointer such as a stylus pen, is increasing.

[0005] Haptic is a key sense that conveys a sense of reality to users along with vision in order to create a virtual reality world, and attempts are being made to apply it to various fields such as education, training, and entertainment.

[0006] For example, tactile data is being applied in various fields, such as technology that increases educational effectiveness using tactile data, technology that utilizes tactile information in medical training or medical equipment, technology that presents tactile information in games or entertainment devices, technology that delivers tactile information together with message delivery, and technology that uses tactile data to deliver information to people with visual or hearing impairments.

[0007] Conventional tactile display devices simply transmit a sense of vibration and are unable to transmit delicate tactile data such as the roughness, pattern, or temperature of the object (surface) being touched, like the skin of a human hand.

[0008] In the past, simple tactile content was expressed by applying vibrations through haptics on small display devices such as mobile phones or tablet PCs or devices without displays. However, there is still a problem that realistic content that allows one to feel physical sensations is lacking because haptics or motors are driven using only arbitrary vibration signals unrelated to tactile stimulation of surface pressure or surface roughness.

[0009] Above all, mid- to large-sized display devices are typically constructed with smooth, hard surfaces, such as the cover window, substrate, and bezel, making it difficult for users to perceive realistic tactile stimulation expressed through vibration. Therefore, a structure suitable for sensing realistic tactile content on mid- to large-sized display devices must be designed.

[0010]

[0011] In order to solve the above-mentioned problem, the present invention aims to provide a terminal capable of providing surface pressure and surface roughness to a display device based on tactile content synchronized with video content according to one embodiment of the present invention.

[0012] However, the technical task that this embodiment seeks to achieve is not limited to the technical task described above, and other technical tasks may exist.

[0013]

[0014] As a technical means for achieving the above-described technical task, an embodiment of the present invention provides a terminal providing realistic tactile content. The terminal includes a display unit for displaying an image based on image content; a cover window disposed on an upper portion of the display unit; and a driving unit disposed on one surface of the cover window, the driving unit including a first driving unit for providing a first tactile stimulus for surface pressure among tactile data based on nerve stimulation electricity based on tactile content synchronized with the image content, and a second driving unit for providing a second tactile stimulus for surface roughness.

[0015] Alternatively, the first driving unit is disposed on one side of the cover window, and at least one second driving unit is disposed on a rear edge area of ​​the cover window.

[0016] Alternatively, the first driving unit displays the first tactile stimulus by moving the cover window left and right based on the user's gaze direction, and the second driving unit displays the second tactile stimulus by moving the cover window up and down based on the user's gaze direction.

[0017] Alternatively, the first driving unit includes a first driving circuit that analyzes stimulus intensity information for the surface pressure based on the tactile content to generate first tactile data; a first actuator that generates a first driving signal based on the generated first tactile data; and a SA (Slow Adaptive) receptor that is driven by the generated first driving signal to provide the first tactile stimulus.

[0018] Alternatively, the second driving unit includes a second driving circuit that analyzes stimulus intensity information on the surface roughness based on the tactile content to generate second tactile data; a second actuator that generates a second driving signal based on the generated second tactile data; and a FA (fast adaptive) receptor that is driven by the generated second driving signal to provide the second tactile stimulus.

[0019] Alternatively, the terminal further includes a rear panel coupled to the front surface excluding the upper surface of the display unit; and a coupling member disposed between the rear panel and the cover window, such that the cover window is coupled to the rear panel and the stimulus intensity of the tactile stimulus reproduced by the driving unit is transmitted to the cover window.

[0020] Alternatively, the bonding member may be any one of an elastic pad, a foam pad, or an elastic spring having an adhesive function.

[0021] As a technical means for achieving the above-described technical task, an embodiment of the present invention provides a method for providing realistic tactile content, which is performed by a terminal including at least one processor. The method comprises the steps of: analyzing tactile content synchronized with image content displayed on a display unit; generating a driving signal for driving a first driving unit providing a first tactile stimulus for surface pressure and a second driving unit providing a second tactile stimulus for surface roughness based on the analysis of the tactile content; and driving the first driving unit or the second driving unit by the driving signal to provide a tactile stimulus corresponding to the surface pressure or surface roughness onto a cover window disposed on an upper surface of the display unit, wherein the driving signal includes stimulus intensity information for the surface pressure or surface roughness.

[0022]

[0023] According to the problem solving means of the present invention described above, the present invention has the effect of analyzing tactile content and providing tactile stimulation for surface pressure and surface roughness based on SA (Slow Adaptive) type tactile data and FA (fast Adaptive) type tactile data.

[0024] In addition, the present invention can be applied to medium and large-sized display devices used in educational settings, exhibition halls, public places, commercial facilities, vehicles, etc. to display realistic tactile content, thereby producing the same effect as touching an object and feeling the texture of its surface without the actual object.

[0025]

[0026] FIG. 1 is a front view illustrating a terminal providing realistic tactile content according to one embodiment of the present invention.

[0027] FIG. 2 is a side view illustrating a terminal providing realistic tactile content according to one embodiment of the present invention.

[0028] FIG. 3 is an exemplary diagram illustrating a process of reproducing tactile stimulation of a terminal that provides realistic tactile content according to one embodiment of the present invention.

[0029] FIG. 4 is a drawing illustrating the configuration of an SA receptor according to one embodiment of the present invention.

[0030] FIG. 5 is a drawing illustrating the configuration of an FA receptor according to one embodiment of the present invention.

[0031] Figure 6 is a block diagram of a terminal according to one embodiment of the present invention.

[0032] FIG. 7 is a flowchart illustrating a method for providing realistic tactile content according to one embodiment of the present invention.

[0033]

[0034] Below, embodiments of the present invention are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present invention. The embodiments presented in the present invention are provided to enable those skilled in the art to utilize or practice the contents of the present invention. Accordingly, various modifications to the embodiments of the present invention will be apparent to those skilled in the art. That is, the present invention can be implemented in various different forms and is not limited to the embodiments described below.

[0035] Throughout the specification of the present invention, identical or similar drawing numbers refer to identical or similar components. Furthermore, for the purpose of clearly explaining the present invention, drawing numbers for parts in the drawings that are not relevant to the description of the present invention may be omitted.

[0036] The term "or" as used herein is intended to mean an inclusive "or" rather than an exclusive "or." That is, unless otherwise specified herein or the meaning is clear from the context, "X utilizes A or B" should be understood to mean either of the natural inclusive permutations. For example, unless otherwise specified herein or the meaning is clear from the context, "X utilizes A or B" can be interpreted to mean either X utilizes A, X utilizes B, or X utilizes both A and B.

[0037] The term "and / or" as used herein should be understood to refer to and include all possible combinations of one or more of the related concepts listed.

[0038] The terms "comprises" and / or "comprising" as used herein should be understood to mean the presence of certain features and / or components. However, it should be understood that the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other features, other components, and / or combinations thereof.

[0039] Unless otherwise specified in the present invention or unless the context makes it clear that the singular form is indicated, the singular should generally be construed to include "one or more."

[0040] The term "connection" as used in the present invention should be interpreted to include not only cases where components are "directly connected" but also cases where other components are "present" between them and cases where they are "electrically connected" with other components in between them.

[0041] The term "acquisition" as used in the present invention may be understood to refer to generating or receiving data in an on-device form as well as receiving data via a wireless communication network with an external device or system.

[0042] Meanwhile, the term "module" or "unit" used in the present invention can be understood as a term referring to an independent functional unit that processes computing resources, such as a computer-related entity, firmware, software or a part thereof, hardware or a part thereof, or a combination of software and hardware. At this time, the "module" or "unit" may be a unit composed of a single element, or a unit expressed as a combination or set of multiple elements. For example, as a narrow concept, a "module" or "unit" may refer to a hardware element of a computing device or a set thereof, an application program that performs a specific function of software, a processing process implemented through software execution, or a set of instructions for program execution, etc. In addition, as a broad concept, a "module" or "unit" may refer to the computing device itself that constitutes the system, or an application that runs on the computing device, etc. However, since the above-described concept is only an example, the concept of “module” or “part” can be defined in various ways within a range understandable to those skilled in the art based on the contents of the present invention.

[0043] The explanation of the aforementioned terms is intended to aid understanding of the present invention. Therefore, unless explicitly stated as limiting the scope of the present invention, it should be noted that the aforementioned terms are not intended to limit the technical concept of the present invention.

[0044]

[0045] Hereinafter, an embodiment of the present invention will be described in detail with reference to the attached drawings.

[0046] FIG. 1 is a front view illustrating a terminal providing realistic tactile content according to one embodiment of the present invention, FIG. 2 is a side view illustrating a terminal providing realistic tactile content according to one embodiment of the present invention, and FIG. 3 is an exemplary diagram illustrating a process of reproducing tactile stimulation of a terminal providing realistic tactile content according to one embodiment of the present invention.

[0047] Referring to FIGS. 1 to 3, a terminal (100) providing realistic tactile content includes, but is not limited to, a display unit (110), a cover window (120) in which a first driving unit (210) and a second driving unit (220) are arranged, a rear panel (130), and a connecting member (150).

[0048] The display unit (110) displays an image based on image content and may be a touch assembly including a touch screen such as an LCD or OLED, a power source, a driver, etc. In this case, the display unit (110) may be a small display applied to a mobile phone or tablet PC, or a medium to large display of approximately 10 inches or more.

[0049] The cover window (120) is positioned on the upper portion of the display unit (110) and may be made of tempered glass. This cover window (120) may be made in a size larger than the screen size of the display unit (110).

[0050] The driving unit (200) may be arranged on one side of the cover window (120) and may include a first driving unit (210) that provides a first tactile stimulus for surface pressure among tactile data based on nerve stimulation electricity based on tactile content synchronized with image content, and a second driving unit (220) that provides a second tactile stimulus for surface roughness.

[0051] The rear panel (130) is attached to the front surface excluding the upper surface of the display unit (110). This rear panel (130) is a bezel used to support the display unit (110) and has a structure in the form of a frame. For example, the bezel is typically manufactured by stamping a metal plate of a certain size, removing the central portion to create a rectangular flat frame, and then bending the frame.

[0052] A bonding member (150) is placed between the rear panel (130) and the cover window (120), so that the rear panel (130) and the cover window (120) are bonded together, and the tactile stimulation reproduced by the driving unit (200) is transmitted to the cover window (120). The bonding member (150) may use any one of an elastic pad, a foam pad, or an elastic spring having a strong adhesive function.

[0053] Accordingly, the coupling member (150) enables the vibration to be implemented in the driving unit (200) to be transmitted to the cover window (120) as is without loss of stimulus (or vibration) intensity when the first tactile stimulus by the first driving unit (210) or the tactile stimulus by the second driving unit (220) is transmitted in the form of vibration.

[0054] At this time, the first driving unit (210) includes, but is not limited to, a first driving circuit (not shown), a first actuator (not shown), and an SA receptor (210).

[0055] The first drive circuit analyzes stimulus intensity information regarding surface pressure based on tactile content to generate first tactile data. The first actuator generates a first drive signal based on the first tactile data generated by the first drive circuit. The stimulus intensity information includes the directionality of the vibration, such as left-right or up-down, and the intensity of the vibration.

[0056] As the SA receptor (210) is driven, vibrations can be transmitted in the x-direction, y-direction, and z-direction based on the set stimulus intensity information. Accordingly, the SA receptor (210) is driven by the first drive signal and can provide a first tactile stimulus, such as vibration, that a user can feel in tactile content based on the set stimulus intensity information.

[0057] The second drive unit (220) also includes, but is not limited to, a second drive circuit, a second actuator, and an FA receptor (220), similar to the first drive unit (210).

[0058] The second driving circuit analyzes stimulus intensity information on surface roughness based on tactile content to generate second tactile data, and the second actuator generates a second driving signal based on the second tactile data.

[0059] As the FA receptor (220) is driven, vibrations can be transmitted in the x-direction, y-direction, and z-direction based on the set stimulus intensity information. Accordingly, the FA receptor (220) is driven by a second driving signal and can provide a second tactile stimulus, such as vibration, that a user can feel in tactile content based on the set stimulus intensity information.

[0060] As illustrated in FIG. 3, the first driving unit (210) can move the cover window (120) left and right (Y direction) based on the user's gaze direction to express the sensitivity of surface pressure (or surface pressure sensation) as a first tactile stimulus, and the second driving unit (220) can move the cover window (120) up and down (Z direction) based on the user's gaze direction to express the surface roughness as a second tactile stimulus.

[0061] At this time, one or more first driving units (210) may be arranged on one side of the cover window (120), and the second driving units (220) may be arranged on at least one of the rear edges of the cover window (120). For example, the first driving unit (210) may include one SA receptor (210), and the second driving unit (220) may include four FA receptors (220).

[0062] In addition, although the driving unit (200) implements separate driving circuits for the SA receptor (210) and the FA receptor (220), it may be implemented by integrating them into a single driving circuit in consideration of the circuit specifications, installation space, etc. The driving unit (200) can separate SA-type tactile data (first tactile data) and FA-type tactile data (second tactile data) from tactile content by an application capable of processing tactile data, and can reproduce tactile stimulation based on each SA-type tactile data and FA-type tactile data, and can display each tactile stimulation in synchronization with the video content.

[0063] FIG. 4 is a drawing illustrating the configuration of an SA receptor according to one embodiment of the present invention, and FIG. 5 is a drawing illustrating the configuration of an FA receptor according to one embodiment of the present invention.

[0064] The SA receptor (210) may include a multilayer piezoelectric ceramic element (211) having internal electrodes, a multichannel amplifier (212) that amplifies the amplitude of micro-vibrations generated in a thickness mode in the all-ceramic element, and a contact pad (2132). This SA receptor (210) may be manufactured in a bar shape.

[0065] The FA receptor (220) may include a multilayer piezoelectric ceramic element (221) having internal electrodes, a multi-channel amplifier (222), and a contact pad (223). This FA receptor (220) may be manufactured in the form of a button.

[0066] Figure 6 is a block diagram of a terminal according to one embodiment of the present invention.

[0067] The terminal (100) according to one embodiment of the present invention may be a hardware device or a part of a hardware device that performs comprehensive processing and calculation of data, or may be a software-based computing environment connected to a communication network. For example, the terminal (100) may be a server that performs intensive data processing functions and shares resources, or may be a client that shares resources through interaction with a server. Furthermore, the terminal (100) may be a cloud system in which multiple servers and clients interact to comprehensively process data. Since the above description is only one example related to the type of the terminal (100), the type of the terminal (100) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present invention.

[0068] Referring to FIG. 6, a terminal (100) according to one embodiment of the present invention may include a processor (101), a memory (102), and a network unit (103). However, FIG. 6 is merely an example, and thus the terminal (100) may include other components for implementing a computing environment. In addition, only some of the disclosed components may be included in the terminal (100).

[0069] A processor (101) according to one embodiment of the present invention may be understood as a configuration unit including hardware and / or software for performing computing operations. The processor (101) for performing data processing may include a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), an application specific integrated circuit (ASICc), or a field programmable gate array (FPGA). The type of the processor (101) described above is only an example, and thus, the type of the processor (101) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present invention.

[0070] The processor (101) can execute an application capable of processing tactile data to provide tactile stimulation corresponding to realistic tactile content synchronized with video content. At this time, the memory (102) can store the execution code of the application.

[0071] The memory (102) may be understood as a configuration unit including hardware and / or software for storing and managing data processed in the terminal (100). That is, the memory (102) may store any type of data generated or determined by the processor (101) and any type of data received by the network unit (103). For example, the memory (101) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory, a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. In addition, the memory (120) may also include a database system that controls and manages data in a predetermined system. The type of memory (102) described above is only one example, and thus the type of memory (102) can be configured in various ways within a range understandable to those skilled in the art based on the contents of the present invention.

[0072] The memory (102) can structure and organize and manage data, combinations of data, and program codes executable by the processor (101) required for the processor (101) to perform operations.

[0073] The network unit (103) can be understood as a component that transmits and receives data through any type of known wired and wireless communication system. For example, the network unit (103) can perform data transmission and reception using a wired and wireless communication system such as a local area network (LAN), wideband code division multiple access (WCDMA), long term evolution (LTE), wireless broadband internet (WIBRO), 5th generation mobile communication (5G), ultra wide-band, Zigbee, radio frequency (RF) communication, wireless LAN, wireless fidelity, near field communication (NFC), or Bluetooth. Since the above-described communication systems are only examples, the wired and wireless communication system for data transmission and reception of the network unit (103) can be applied in various ways other than the above-described examples.

[0074] The network unit (103) can receive data necessary for the processor (101) to perform calculations through wired or wireless communication with any system or any client, etc. In addition, the network unit (103) can transmit data generated through calculations of the processor (101) through wired or wireless communication with any system or any client, etc.

[0075] FIG. 7 is a flowchart illustrating a method for providing realistic tactile content according to one embodiment of the present invention.

[0076] Referring to FIG. 7, the terminal (100) receives tactile content synchronized with the image content displayed on the display unit (110), and through an analysis process of the tactile content, generates tactile data including SA-type tactile data, FA-type tactile data, and stimulus intensity information including the directionality of vibration and the intensity of vibration for each tactile data (S1).

[0077] A driving signal for driving a first driving unit (210) is generated based on the first tactile data, and a second driving signal for driving a second driving unit is generated based on the second tactile data (S2). At this time, the driving unit (200) may display only one of the first tactile data and the second tactile data depending on the content of the video content, or may display both the first tactile data and the second tactile data simultaneously.

[0078] The first actuator drives the first driving unit (210) by the first driving signal, and the second actuator drives the second driving unit by the second driving signal (S3). Accordingly, the terminal (100) can provide a first tactile stimulus corresponding to surface pressure or a second tactile stimulus corresponding to surface roughness onto the cover window (120) disposed on the upper surface of the display unit (110) (S4).

[0079] In general, medium- to large-sized display devices are made of smooth and hard materials on the surfaces, such as the cover window, substrate, and bezel, so users cannot feel realistic tactile stimulation expressed as vibration.

[0080] Accordingly, the present invention can provide a terminal capable of expressing surface roughness and surface pressure by using a cover window, an SA receptor (210) and an FA receptor (220) capable of applying vibration to the cover window, and an actuator for driving each receptor, in order to display a sensitive tactile signal on a medium- to large-sized display device.

[0081] Accordingly, the present invention can display realistic tactile content on medium to large display devices used in educational settings, exhibition halls, public places, or commercial facilities and devices (vehicles, etc.), thereby producing the same effect as touching an object and feeling the texture of its surface without the actual object.

[0082]

[0083] The embodiments of the present invention described above may also be implemented in the form of a recording medium including computer-executable instructions, such as program modules executed by a computer. Such recording medium includes computer-readable media, and computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Furthermore, computer-readable media includes computer storage media, and computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0084] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0085] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

Claims

1. As a terminal that provides realistic tactile content, A display unit that displays a video based on video content; A cover window disposed on the upper part of the display unit; and A terminal including a driving unit including a first driving unit that provides a first tactile stimulus for surface pressure among tactile data based on neural stimulation electricity based on tactile content that is arranged on one side of the cover window and synchronized with the image content, and a second driving unit that provides a second tactile stimulus for surface roughness.

2. In paragraph 1, The above first driving unit is arranged on one side of the cover window, A terminal in which at least one of the second driving units is arranged in the rear edge area of ​​the cover window.

3. In paragraph 2, The first driving unit moves the cover window left and right based on the user's gaze direction to display the first tactile stimulus, A terminal in which the second driving unit moves the cover window up and down based on the user's gaze direction to display the second tactile stimulus.

4. In paragraph 1, The above first driving unit, A first driving circuit that analyzes stimulus intensity information for the surface pressure based on the above tactile content to generate first tactile data; A first actuator that generates a first driving signal based on the first tactile data generated above; and A terminal including a SA (Slow Adaptive) receptor that is driven by the first drive signal generated above and provides the first tactile stimulus.

5. In paragraph 1, The above second driving unit, A second driving circuit that analyzes stimulus intensity information on the surface roughness based on the above tactile content to generate second tactile data; A second actuator that generates a second driving signal based on the second tactile data generated above; and A terminal including a FA (fast adaptive) receptor that is driven by the second driving signal generated above and provides the second tactile stimulus.

6. In paragraph 1, A rear panel coupled to the front surface excluding the upper surface of the display unit; and A terminal further comprising a bonding member, which is arranged between the rear panel and the cover window, so that the cover window is bonded to the rear panel and the stimulus intensity of the tactile stimulus reproduced by the driving unit is transmitted to the cover window, wherein any one of an elastic pad having an adhesive function, a foam pad, or an elastic spring is used.

Images