Electronic device and control method thereof
The electronic device uses actuators to generate haptic patterns based on stroke characteristics, addressing the need for tactile text conveyance and route guidance, especially for users with disabilities.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-12-11
- Publication Date
- 2026-06-18
AI Technical Summary
Existing electronic devices lack effective methods to convey text content through haptic feedback, particularly in environments where visual or auditory input is not feasible, and there is a growing need to enhance tactile experiences, especially for users with disabilities.
An electronic device equipped with actuators that generate haptic patterns based on the characteristics of strokes for characters or symbols, using processors to control actuators to output varying intensities and patterns, including GPS-based route guidance.
Effectively conveys text content and enhances tactile experiences, enabling users to learn and utilize text in environments without visual or auditory input, and provides route guidance for individuals with disabilities.
Smart Images
Figure KR2024096708_18062026_PF_FP_ABST
Abstract
Description
Electronic device and its control method
[0001] The embodiments relate to an electronic device that provides haptic feedback and a method for controlling the same.
[0002] Electronic devices with haptic functions are used in various electronic devices because they can provide intuitive feedback to users and are highly space-efficient. For example, various electronic devices such as wireless communication devices, display devices, tablet PCs, laptop computers, touchpads, mice, joysticks, keyboards, and gamepads can include haptic functions to provide tactile feedback to users or enhance realism in multimedia delivery.
[0003] An electronic device having a haptic function can provide a sense of vibration through a vibration generating means such as a vibration motor or an actuator when a user touches the electronic device, and the actuator can induce a vibrating member made of a magnetic material to vibrate through a change in an electromagnetic field.
[0004] Recently, as VR (virtual reality) content such as 3D stereoscopic images has become commercialized, there is a growing need to provide various patterns of haptic functions in addition to visual and auditory haptics to enhance the user's tactile experience.
[0005] In addition, there is a growing need to provide text content using haptic functions in situations where users cannot check the text content visually or audibly.
[0006] In addition, there is a growing need to provide text content to people with visual or hearing impairments using haptic functions.
[0007] The purpose is to provide an electronic device and a control method thereof for conveying information about letters and symbols to a user using a haptic function according to an embodiment in order to solve the above problems.
[0008] To achieve the above objective, an electronic device according to an embodiment comprises at least one actuator that generates a haptic pattern using vibration; a communication circuit; and at least one processor electrically connected to the communication circuit; wherein, when an output for the haptic pattern is requested, the at least one processor distinguishes the characteristics of a stroke for a character or symbol corresponding to the output and controls the actuator to output haptic patterns of different intensities based on the characteristics of the stroke.
[0009] When the number of strokes is one, the actuator can be controlled to set the starting point strength greater than the ending point strength.
[0010] The processor can control the actuator to differently overlap the vibration intensity of the starting point intensity and the ending point intensity according to the order of the strokes when the number of strokes is multiple.
[0011] The processor can control the actuator to set the starting point strength greater than the ending point strength when the type of stroke is a straight line and the stroke is the first stroke.
[0012] The processor can control the actuator to set the starting point strength to be smaller than the ending point strength when the type of stroke is a straight line and the stroke is not the first stroke.
[0013] The processor can control the actuator such that, when the type of stroke is a curve, the starting point strength is smaller than the midpoint strength and the ending point strength is smaller than the midpoint strength.
[0014] The above processor can control the actuator to drive the actuator with a Max intensity at a cycle of less than 50ms when the type of stroke is a bent shape.
[0015] The processor can control multiple actuators to output haptic patterns of different intensities when the type of stroke is multiple or when the type of stroke is a curve.
[0016] The apparatus further includes a GPS receiver that receives GPS information, and the processor can control the actuator to output haptic patterns of different intensities based on the characteristics of strokes for characters or symbols corresponding to route guidance information based on the GPS information.
[0017] Additionally, the control method of an electronic device according to an embodiment may include the step of receiving a request for output of a haptic pattern; the step of distinguishing the characteristics of a stroke for a character or symbol corresponding to the output; and the step of controlling the actuator so that haptic patterns of different intensities are output based on the characteristics of the stroke.
[0018] When the number of strokes is one, the actuator can be controlled to set the starting point strength greater than the ending point strength.
[0019] When the number of strokes is multiple, the actuator can be controlled to drive the vibration intensity of the starting point intensity and the ending point intensity differently according to the order of the strokes.
[0020] If the type of stroke is a straight line and the stroke is the first stroke, the actuator can be controlled to set the starting point intensity greater than the ending point intensity.
[0021] If the type of stroke is a straight line and the stroke is not the first stroke, the actuator can be controlled to set the starting point strength to be smaller than the ending point strength.
[0022] If the type of stroke is a curve, the actuator can be controlled so that the starting point strength is smaller than the midpoint strength and the ending point strength is smaller than the midpoint strength.
[0023] If the type of stroke is a bent shape, the actuator can be controlled to drive the Max intensity at a cycle of less than 50ms.
[0024] If there are multiple types of strokes or if the type of stroke is a curve, multiple actuators can be controlled to output haptic patterns of different intensities.
[0025] The method further includes a step of receiving GPS information, and can control the actuator to output haptic patterns of different intensities based on the characteristics of strokes for characters or symbols corresponding to route guidance information based on the GPS information.
[0026] The embodiment can effectively convey text content to a user in an environment where sound cannot be used.
[0027] In addition, the embodiment tactilely reproduces the experience of writing characters, making it easy to learn and utilize.
[0028] In addition, the embodiment has the effect of utilizing haptic functions as a means of conveying route guidance information to people with disabilities.
[0029] FIG. 1 is a block diagram showing an electronic device according to one embodiment.
[0030] FIG. 2 is a diagram showing an example of an electronic device used according to one embodiment.
[0031] FIG. 3 is a block diagram showing the actuator configuration of an electronic device according to one embodiment.
[0032] FIG. 4 is a diagram showing the process of an electronic device defining a stroke according to one embodiment.
[0033] Figure 5 is a diagram illustrating the modeling process for a straight line-shaped stroke.
[0034] Figure 6 is a diagram illustrating the modeling process for a curved stroke.
[0035] Figure 7 is a diagram illustrating the modeling process for a bent stroke.
[0036] FIG. 8 is a flowchart illustrating a control method for an electronic device according to one embodiment.
[0037] Figure 9 is a diagram illustrating the process of printing an 'L' shaped character.
[0038] Figure 10 is a diagram showing the waveform for an 'L' shape.
[0039] Figure 11 is a diagram illustrating the process of printing a letter in the shape of an 'R'.
[0040] FIG. 12 is a block diagram showing an electronic device according to another embodiment.
[0041] Hereinafter, embodiments will be described in detail with reference to the attached drawings. Since embodiments may be subject to various modifications and may take various forms, specific embodiments are illustrated in the drawings and described in detail in the text. However, this is not intended to limit the embodiments to the specific disclosed forms, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and scope of the embodiments.
[0042] Terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms. These terms are used for the purpose of distinguishing one component from another. Furthermore, terms specifically defined in consideration of the configuration and operation of the embodiments are intended only to describe the embodiments and do not limit the scope of the embodiments.
[0043] In the description of the embodiments, where it is stated that an element is formed "on or under," the terms "on or under" include both cases where two elements are in direct contact with each other and cases where one or more other elements are placed between the two elements to form the element indirectly. Furthermore, when expressed as "on or under," the meaning may include not only the upward direction but also the downward direction relative to a single element.
[0044] Additionally, relational terms such as "upper / upper / above" and "lower / lower / below" used below may be used to distinguish one entity or element from another, without necessarily requiring or implying any physical or logical relationship or order between such entities or elements.
[0045] FIG. 1 is a block diagram showing an electronic device according to one embodiment.
[0046] Referring to FIG. 1, an electronic device (200) according to one embodiment is connected to a server (100) via a network, and the server (100) can transmit control signals, data, etc. to the electronic device (200).
[0047] The server (100) may include at least one processor (110), a communication circuit (120) electrically connected to at least one processor (110), and a memory (130). A computing device such as a smartphone, tablet PC, or PC computer may be substituted for the server (100). Additionally, a computing device such as a smartphone, tablet PC, or PC computer may be provided between the server (100) and the electronic device (200).
[0048] The electronic device (200) may be a wearable device. Alternatively, the electronic device (200) may be coupled to the wearable device to directly control the wearable device.
[0049] FIG. 2 is a diagram showing an example of an electronic device used according to one embodiment.
[0050] Referring to FIG. 2, the electronic device (200) according to the embodiment may be a wearable device worn on the user's body. For example, the electronic device (200) may include a smart watch worn on the user's wrist, a smart ring worn on the user's finger, or a VR device worn on the user's head.
[0051] As another example, the electronic device (200) may be a computing device such as a smartphone, tablet PC, or PC computer, but is not limited thereto.
[0052] Returning to FIG. 1, an electronic device according to one embodiment may include at least one processor (210), a communication circuit (220), and an actuator (240). Additionally, the electronic device (200) may further include a display (230) capable of providing various screen interfaces related to haptic feedback output, but the configuration of the display (230) may be optionally added or removed.
[0053] An electronic device (200) according to one embodiment can be connected to a server (100) through a communication circuit (220). The communication circuit (220) can perform communication using LPWN (Low Power Wireless Network) and LPWAN (Low Power Wide Area Network) such as LTE and 5G, as well as NB-IoT, LoRa, SigFox, and LTE-CAT1.
[0054] The communication circuit (220) can perform communication using a communication method that uses a wired LAN (Local Area Network) as well as a wireless LAN such as WiFi 802.11a / b / g / n. In addition, the communication circuit (220) can also perform communication with an internal or external device using a communication method such as NFC or Bluetooth.
[0055] An electronic device (200) according to one embodiment can output haptic feedback according to a control signal provided from a server (100). The electronic device (200) can generate vibration through an actuator (240).
[0056] The actuator (240) according to the embodiment may be composed of one or more actuators, but the number is not limited.
[0057] FIG. 3 is a block diagram showing the actuator configuration of an electronic device according to one embodiment.
[0058] Referring to FIG. 3, an actuator (240) of an electronic device according to one embodiment may include a first actuator (241), a second actuator (243), and a third actuator (245).
[0059] The first actuator (241), the second actuator (243), and the third actuator (245) can generate haptic patterns for letters or symbols according to control signals provided from the server (100). Through the continuous operation of the first actuator (241), the second actuator (243), and the third actuator (245), a sensation similar to that experienced when writing with a real pen can be generated.
[0060] Returning to FIG. 1, the processor (210) of an electronic device according to one embodiment may include all kinds of devices capable of processing data. Here, 'processor' may mean a data processing device embedded in hardware having a physically structured circuit to perform a function expressed, for example, by code or instructions included in a program. Examples of such data processing devices embedded in hardware may include, but are not limited to, processing devices such as a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA).
[0061] An electronic device (200) according to one embodiment may further include memory (not shown). The memory may be main memory accessed and used by a processor (210). For example, the memory may be volatile memory such as DRAM. Alternatively, the memory may be permanent memory, and the permanent memory may be, for example, NVDIMM.
[0062] A processor (210) of an electronic device (200) according to one embodiment can distinguish the characteristics of a stroke of a character or symbol corresponding to an output request when an output for a haptic pattern is requested.
[0063] FIG. 4 is a diagram showing the process of an electronic device defining a stroke according to one embodiment.
[0064] Referring to FIG. 4, the processor (210) of the electronic device (200) according to one embodiment can define a straight line, a curve, or a bend that is independently distinguished within a letter or symbol as a stroke.
[0065] As shown in FIG. 4a, the processor (210) of the electronic device (200) according to one embodiment can be divided into two straight strokes in the case of 'L'.
[0066] As illustrated in FIG. 4b, the processor (210) of the electronic device (200) according to one embodiment can be divided into two straight strokes and one curved stroke in the case of 'R'.
[0067] Returning to FIG. 1, the processor (210) of the electronic device (200) according to one embodiment can control the actuator (240) to output haptic patterns of different intensities based on the characteristics of the stroke. The haptic pattern can be implemented as a vibration pattern. The characteristics of the stroke may include straight lines, curves, or bends. In addition, the vibration period that generates the stroke is given by Equation 1.
[0068] [Mathematical Formula 1]
[0069]
[0070] Figure 5 is a diagram illustrating the modeling process for a straight line-shaped stroke.
[0071] Referring to FIG. 5, the processor of an electronic device according to one embodiment can be modeled as a single continuous vibration with respect to a straight line shape.
[0072] A processor (210) of an electronic device according to one embodiment can set the starting point strength and the ending point strength differently depending on the order of strokes.
[0073] The intensity of the starting point of the first stroke can be set to be greater than the intensity of the ending point of the first stroke. For example, the intensity of the starting point of the first stroke can be set to 100. The intensity of the ending point of the first stroke can be set to 70. The first stroke can generate vibration using the first actuator.
[0074] The intensity of the starting point of the other stroke can be set to be smaller than the intensity of the ending point of the other stroke. For example, the intensity of the starting point of the other stroke can be set to 50. The intensity of the ending point of the other stroke can be set to 100. The other stroke can generate vibration using a second actuator.
[0075] Figure 6 is a diagram illustrating the modeling process for a curved stroke.
[0076] Referring to FIG. 6, the processor (210) of an electronic device according to one embodiment can be modeled with two consecutive vibrations for a curved shape.
[0077] A processor of an electronic device according to one embodiment can represent a single curve by using two actuators to perform superposition driving.
[0078] The starting point strength of the first actuator can be set to be smaller than the ending point strength. For example, the starting point strength of the first actuator (241) can be set to 0. The ending point strength of the first actuator (241) can be set to 100.
[0079] The starting point strength of the second actuator (243) can be set to be greater than the ending point strength. For example, the starting point strength of the second actuator (243) can be set to 100. The ending point strength of the second actuator (243) can be set to 0.
[0080] The end point strength of the first actuator (241) and the start point strength of the second actuator (243) can be set to the same or similar strength.
[0081] That is, the processor of the electronic device according to one embodiment can set the intensity at the start point of the curve shape of the text to be smaller than the intensity at the midpoint, and the intensity at the midpoint to be larger than the intensity at the end point.
[0082] From this, it becomes possible to effectively express the process of reproducing the feeling of writing curved strokes or writing naturally.
[0083] Figure 7 is a diagram illustrating the modeling process for a bent stroke.
[0084] Referring to FIG. 7, the processor (210) of an electronic device according to one embodiment can be modeled in a bent shape.
[0085] A processor of an electronic device according to one embodiment can model a bend shape with a short period, such as a period of less than 50ms, that is close to the Max intensity. For example, it can be modeled with an intensity of 100. A third actuator can be used for the bend shape.
[0086] FIG. 8 is a flowchart illustrating a control method for an electronic device according to one embodiment.
[0087] Referring to FIG. 8, an electronic device according to one embodiment may receive an output request for a haptic pattern from a server or another type of electronic device (S100).
[0088] An electronic device according to one embodiment can distinguish the characteristics of a stroke (S200). An electronic device according to one embodiment can distinguish the characteristics of a stroke, whether the request includes a straight line shape, a curved shape, or a bent shape.
[0089] An electronic device according to one embodiment can output haptic patterns of different intensities and periods depending on the characteristics of the stroke (S300).
[0090] Figure 9 is a diagram illustrating the process of printing an 'L' shaped character.
[0091] Referring to FIG. 9, an electronic device (210) according to one embodiment can distinguish that the stroke of the letter 'L' includes a straight shape and a bent shape.
[0092] An electronic device (200) according to one embodiment can operate a second actuator to generate vibration for the first stroke. An electronic device according to one embodiment can output a starting point intensity for the first stroke as 100 and an ending point intensity for the first stroke as 70.
[0093] An electronic device (200) according to one embodiment can operate a first actuator to generate vibration for the second stroke. An electronic device according to one embodiment can output a starting point intensity for the second stroke as 50 and an ending point intensity for the second stroke as 100.
[0094] The starting point of the first actuator can be operated so as to partially overlap with the end point of the second actuator. The overlapping period may be 100ms.
[0095] The third actuator can output an intensity of 100 in the overlapping area where the first actuator and the second actuator are operated, or between where the first actuator and the second actuator are operated, to generate vibration for the bending part or for the emphasis function. This overlapping section has the effect of reproducing the tactile experience of actual handwriting.
[0096] Figure 10 is a diagram showing the waveform for an 'L' shape.
[0097] Referring to FIG. 10, an electronic device (200) according to one embodiment can effectively convey characters or symbols to a user by using a first actuator and a second actuator to output different intensities from the intensity at the starting point to the intensity at the end point, and by using a third actuator to generate vibration in the overlapping area where the first actuator and the second actuator are operated for a bending part or intensity function, or between where the first actuator and the second actuator are operated.
[0098] Figure 11 is a diagram illustrating the process of printing a letter in the shape of an 'R'.
[0099] Referring to FIG. 11, an electronic device (200) according to one embodiment can distinguish that the stroke of the letter 'R' includes a straight line shape, a curved shape, and a bent shape.
[0100] An electronic device (200) according to one embodiment can operate a second actuator to generate vibration for the first stroke. An electronic device according to one embodiment can output a starting point intensity for the first stroke as 100 and an ending point intensity for the first stroke as 70.
[0101] An electronic device (200) according to one embodiment can operate a first actuator and a second actuator to generate vibration for a second stroke.
[0102] An electronic device (200) according to one embodiment may operate a first actuator to output a starting point intensity of 0 and an intermediate point intensity of 100. The intermediate point intensity refers to the intermediate point of a character, and from the perspective of the first actuator, it may be the end point intensity.
[0103] An electronic device (200) according to one embodiment can operate a second actuator to output an intermediate point intensity of the text as 100 and an end point intensity as 0.
[0104] An electronic device (200) according to one embodiment can operate a first actuator and a third actuator to generate vibration for a third stroke.
[0105] An electronic device (200) according to one embodiment can operate a first actuator to output a starting point strength of 50 and an ending point strength of 100.
[0106] An electronic device (200) according to one embodiment may operate a third actuator to output a starting point intensity of 100. The starting point of the third actuator may be the same as the starting point of the first actuator or may be a point earlier than the starting point of the first actuator.
[0107] FIG. 12 is a block diagram showing an electronic device according to another embodiment.
[0108] Referring to FIG. 12, an electronic device (300) according to another embodiment is connected to a server (100) via a network, and the server (100) can transmit control signals, data, etc. to the electronic device (200). Such a server (100) may include at least one processor (110), a communication circuit (120) electrically connected to at least one processor (110), and a memory (130). A computing device such as a smartphone, tablet PC, or PC computer may be substituted for the server (100).
[0109] An electronic device (300) according to another embodiment may include at least one processor (310), a communication circuit (320), an actuator (340), and a GPS receiver (350). Additionally, a display (330) may be added.
[0110] The electronic device (300) may be a wearable device. Alternatively, the electronic device (300) may be coupled to the wearable device to directly control the wearable device.
[0111] The above electronic device (300) may be a smart watch worn by a user, for example, a person with a disability. The electronic device (300) may receive navigation information from a server or other computing device.
[0112] For example, when a user clicks a navigation request, the electronic device (300) can transmit the user's location from the GPS receiver (350) to the server (100). The server (100) can transmit navigation information to the electronic device (300) based on the GPS information. For example, the server (100) can transmit information about symbols such as arrows or letters such as L and R to the electronic device (300). Here, L is an abbreviation for Left and can mean 'go to the left', and R is an abbreviation for Right and can mean 'go to the right'.
[0113] The electronic device (300) can control the actuator (340) to generate vibrations of different intensities for symbols or letters such as L, R.
[0114] The electronic device (300) can express symbols and letters by vibration using the vibration method performed by the electronic device of FIG. 1.
[0115] Although the foregoing has been described with reference to the drawings and embodiments, those skilled in the art will understand that the embodiments can be modified and changed in various ways without departing from the technical spirit of the embodiments described in the following claims.
Claims
1. At least one actuator that generates a haptic pattern using vibration; Communication circuit; and at least one processor electrically connected to the above communication circuit; and The above at least one processor is, An electronic device that, when an output for the above haptic pattern is requested, distinguishes the characteristics of a stroke for a character or symbol corresponding to the output, and controls the actuator to output haptic patterns of different intensities based on the characteristics of the stroke.
2. In Paragraph 1, The above processor is, An electronic device that controls the actuator to set the starting point strength greater than the ending point strength when the number of strokes is one.
3. In Paragraph 1, The above processor is, An electronic device that controls the actuator to drive the vibration intensity of the starting point intensity and the ending point intensity differently in overlap according to the order of the strokes when the number of strokes is multiple.
4. In Paragraph 3, The above processor is, An electronic device that controls the actuator to set the starting point intensity greater than the ending point intensity when the type of the stroke is a straight line and the stroke is the first stroke.
5. In Paragraph 3, The above processor is, An electronic device that controls the actuator to set the starting point intensity smaller than the ending point intensity when the type of the stroke is a straight line and the stroke is not the first stroke.
6. In Paragraph 3, The above processor is, An electronic device that controls the actuator such that, when the type of stroke is a curve, the starting point strength is smaller than the intermediate point strength and the ending point strength is smaller than the intermediate point strength.
7. In Paragraph 2, The above processor is, An electronic device for controlling the actuator to drive the actuator with a Max intensity at a period of less than 50ms when the type of stroke is a bent shape.
8. In Paragraph 1, The above processor is, An electronic device that controls multiple actuators to output haptic patterns of different intensities when the types of strokes are multiple or when the types of strokes are curves.
9. In Paragraph 1, It further includes a GPS receiver that receives GPS information, The above processor is, An electronic device that controls the actuator to output haptic patterns of different intensities based on the characteristics of strokes for characters or symbols corresponding to route guidance information based on the above GPS information.
10. A step of receiving an output request for a haptic pattern; A step of distinguishing the characteristics of a stroke for a character or symbol corresponding to the above output; and A step of controlling the actuator to output haptic patterns of different intensities based on the characteristics of the stroke; A method for controlling an electronic device including 11. In Paragraph 10, A control method for an electronic device that controls an actuator to set the starting point strength greater than the ending point strength when the number of strokes is one.
12. In Paragraph 10, A control method for an electronic device that controls an actuator to differently superimpose the vibration intensity of the starting point intensity and the ending point intensity according to the order of the strokes when the number of strokes is multiple.
13. In Paragraph 12, A control method for an electronic device that controls an actuator to set the starting point intensity greater than the ending point intensity when the type of stroke is a straight line and the stroke is the first stroke.
14. In Paragraph 12, A control method for an electronic device that controls an actuator to set the starting point intensity smaller than the ending point intensity when the type of stroke is a straight line and the stroke is not the first stroke.
15. In Paragraph 12, A control method for an electronic device that controls an actuator such that, when the type of stroke is a curve, the starting point strength is smaller than the midpoint strength and the ending point strength is smaller than the midpoint strength.
16. In Paragraph 10, A control method for an electronic device that controls the actuator to drive the Max intensity at a cycle of less than 50ms when the type of stroke is a bent shape.
17. In Paragraph 10, A control method for an electronic device that controls multiple actuators to output haptic patterns of different intensities when the types of strokes are multiple or when the types of strokes are curves.
18. In Paragraph 10, It further includes a step of receiving GPS information, A control method for an electronic device that controls an actuator to output haptic patterns of different intensities based on the characteristics of strokes of characters or symbols corresponding to route guidance information based on the above GPS information.