Visual Feedback from User Device
User equipment with gesture sensors and visual feedback mechanisms addresses precision and accuracy issues in touchscreen interactions by clearly indicating gesture detection directions, improving user experience.
Patent Information
- Application Number
- JP2023501204
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-07-10
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2040-07-10
AI Technical Summary
Existing user interfaces on devices like smartphones and tablets face limitations in scrolling precision and accuracy due to the physical size of touchscreen displays, and radar-based systems often suffer from uncertainty in gesture detection and tracking.
User equipment equipped with gesture sensors that detect user movements outside the main body and provide visual feedback indicating the direction of motion detection, using light emissions and icons on the display to enhance interaction clarity.
Improves user experience by providing clear visual indicators of gesture sensor activation and direction, enhancing interaction efficiency and reducing ambiguity in gesture recognition.
Smart Images

Figure 0007618776000001 
Figure 0007618776000002 
Figure 0007618776000003
Abstract
Description
[Technical field]
[0001] SUMMARY OF THE DISCLOSURE The embodiments presented herein relate to user equipment, methods, computer programs, and computer program products for providing visual feedback from a user equipment. [Background technology]
[0002] Many types of user equipment, such as so-called smartphones, tablet computers, smart watches, etc., are equipped with user interfaces in the form of touch screen displays for user interaction. These user interfaces are based on the user touching the display with one or more fingers and moving the fingers in a certain way, thus creating a gesture that can be interpreted by the user interface as having a certain meaning.
[0003] In some applications or navigation scenarios, touch input to a touchscreen display, for example scrolling content that is not related to the size of the display itself, is limited by the actual physical size of the touchscreen display. For example, for scrolling to be precise, a common gesture is for a user to move a finger slowly on the touchscreen display, and the amount of scrolling using one single gesture is generally limited to moving the finger to the edge of the touchscreen display after which the scrolling stops. For example, for scrolling to be fast, a common gesture is for a user to move a finger quickly on the touchscreen display and then lift the finger, causing the scrolling to become similar to rolling a wheel. The first type of scrolling is limited by being slower than the second type of scrolling, but the second type of scrolling is limited by being less precise than the first type of scrolling. More examples of this limit the user experience when interacting with the user interface.
[0004] Thus, some types of user equipment are equipped with one or more types of sensors, such as radar sensors, that enable gesture recognition or detection of movements in some parts of the space around the user equipment. Examples of techniques and systems that enable smartphone-based radar systems that facilitate ease and accuracy of user interaction with displayed objects in an augmented reality interface are provided in the document US Patent Application Publication No. 20200064996(A1). However, such user equipment also has drawbacks. For example, there may be uncertainty as to whether a gesture has been detected, or even that tracking is so active.
[0005] Thus, there remains a need for a means to improve the user experience for users interacting with the user interface of a user equipment. Summary of the Invention
[0006] An objective of the embodiments herein is to provide a means for efficient interaction by a user with a user equipment.
[0007] According to a first aspect, a user equipment is presented. The user equipment has a body. The user equipment comprises at least one gesture sensor configured to detect, when activated, a movement of a user interacting with the user equipment in at least one direction out of and from the body. The user equipment comprises a visual user interface configured to provide visual feedback of an activation of the gesture sensor. The visual feedback indicates in which at least one direction from the body detection of a movement using the gesture sensor has been activated.
[0008] According to a second aspect, a method for providing visual feedback from a user equipment is presented. The method is implemented by the user equipment according to the first aspect. The method includes activating at least one gesture sensor to detect a movement of a user interacting with the user equipment in at least one direction out of and from the body. The method includes providing visual feedback that the gesture sensor has been activated. The visual feedback indicates in which at least one direction from the body detection of the movement using the gesture sensor has been activated.
[0009] According to a third aspect, a computer program for providing visual feedback from a user equipment is presented, the computer program comprising computer program code which, when running on a user equipment according to the first aspect, causes the user equipment to perform a method according to the second aspect.
[0010] According to a fourth aspect, there is provided a computer program product comprising a computer program according to the third aspect and a computer readable storage medium on which the computer program is stored. The computer readable storage medium may be a non-transitory computer readable storage medium.
[0011] Whether the gesture sensor is activated or not is a technical condition of the user equipment. Visual feedback is an example of a visual indicator. Thus, these aspects advantageously provide a visual indication of the technical condition of the user equipment.
[0012] Advantageously, these aspects improve the user experience for a user interacting with the user interface of a user equipment.
[0013] Advantageously, these aspects provide an efficient means for a user to know that the gesture sensor has been activated.
[0014] Advantageously, these aspects provide an efficient means for a user to know in which direction or directions the motion detection performed by the gesture sensor has been performed.
[0015] Other objectives, features and advantages of the enclosed embodiments will become apparent from the following detailed disclosure, from the attached dependent claims, as well as from the drawings.
[0016] In general, all terms used in the claims should be interpreted according to their customary meaning in the art, unless expressly stated otherwise herein. All references to "a / an / the element, apparatus, component, means, module, step, etc." should be openly interpreted to refer to at least one instance of that element, apparatus, component, means, module, step, etc., unless expressly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless expressly stated otherwise.
[0017] The inventive concept will now be described, by way of example only, with reference to the accompanying drawings in which: [Brief description of the drawings]
[0018] [Figure 1] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Diagram 3] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Figure 4] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Diagram 5] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Figure 6] FIG. 2 is a schematic diagram illustrating a user equipment according to an embodiment. [Figure 7] 1 is a flowchart of a method according to an embodiment. [Figure 8]FIG. 2 is a schematic diagram illustrating functional units of a user equipment according to one embodiment; [Figure 9] FIG. 2 is a schematic diagram illustrating functional modules of a user equipment according to one embodiment. [Figure 10] FIG. 1 illustrates an example of a computer program product comprising a computer-readable storage medium according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] The inventive concept will now be described more fully hereinafter with reference to the accompanying drawings, in which several embodiments of the inventive concept are shown. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein, but rather, these embodiments are provided as examples so that this disclosure will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. Like numbers refer to like elements throughout the description. Any step or feature indicated by a dashed line should be considered optional.
[0020] As discussed above, there remains a need for means to improve the user experience for users interacting with the user interface of a user equipment.
[0021] Furthermore, there may be different types of ambiguity due to the situation when a user is interacting with the user interface of the user equipment. For example, it may be difficult for a user to tell whether the motion detection (performed by the gesture sensor) is active or not. For example, even if it can be confirmed that the motion detection is active, it may be difficult to tell whether the presence of the user is detected or not (such as whether the presence of a finger is detected or not). For example, even if it can be confirmed that the presence of the user is detected, it may be difficult to tell whether the gesture sensor is able to accurately interpret the user's movements according to the intended gesture. For example, even if it can be confirmed that the user's movements are not interpreted according to the intended gesture, it may be difficult to tell whether such misinterpretation depends on the hardware (e.g., the gesture sensor) or the software (e.g., the application in which the information from the gesture sensor is used as input).
[0022] Therefore, the embodiments disclosed herein relate to a mechanism for insertion purposes. To obtain such a mechanism, a user equipment 100, a method implemented by the user equipment 100, and a computer program product, for example in the form of a computer program, are provided, comprising code, which when running on the user equipment 100, causes the user equipment 100 to implement the method.
[0023] 1 is a schematic diagram from a perspective view illustrating a user device 100 according to one embodiment. Non-limiting examples of user device 100 include mobile phones, tablet computers, smart watches, and the like.
[0024] User device 100 has a body 110. The body is defined by a top surface 140, a bottom surface 150, and a frame 160 extending between top surface 140 and bottom surface 150. The user device includes a touchscreen display 130b defined by an extending rim or border 170.
[0025] User equipment 100 includes at least one gesture sensor 120. When activated, at least one gesture sensor 120 is configured to detect movement of a user (not shown in FIG. 1 ) interacting with user equipment 100 in at least one direction out of and from body 110. Non-limiting examples of gesture sensors 120 are proximity sensors, image sensors, radar sensors, infrared sensors, etc. Although only one gesture sensor 120 is shown in FIG. 1 , user equipment may be provided with two or more gesture sensors 120. These two or more gesture sensors 120 may be of the same type or may be of at least two different types.
[0026] User device 100 includes visual user interfaces 130a1, 130a2, and 130b. Visual user interfaces 130a1, 130a2, and 130b are configured to provide visual feedback of activation of gesture sensor 120. The visual feedback indicates in which at least one direction from body 110 detection of movement using gesture sensor 120 has been activated. Examples of visual user interfaces 130a1, 130a2, and 130b are provided below.
[0027] Whether the gesture sensor 120 is activated or not is a technical condition of the user equipment 100. The visual feedback is an example of a visual indicator. Thus, this embodiment provides a visual indication of the technical condition of the user equipment 100.
[0028] Next, embodiments relating to further details of the user equipment 100 are disclosed.
[0029] A first embodiment for providing visual feedback of activation of gesture sensor 120 is now disclosed with respect to user equipment 100 of Fig. 2. Fig. 2 shows a schematic top view of user equipment 100 of Fig. 1, in which a visual user interface consists of light sources 130a1, 130a2 arranged along frame 160 in a direction in which at least one gesture sensor 120 is set to detect user movement. In the embodiment of Fig. 2, user equipment 100 is shown having four such light sources, but as one skilled in the art will appreciate, user equipment 100 may have any number of such light sources 130a1, 130a2 arranged along frame 160 in a direction in which at least one gesture sensor 120 is set to detect user movement.
[0030] In some aspects, feedback of activation of the gesture sensor 120 is provided by light 200 being emitted along the frame 160. The light 200 may then be emitted by the light sources 130a1, 130a2 only in this or those directions in which motion detection by the gesture sensor 120 was activated. In particular, in some embodiments, visual feedback is indicated by light 200 being emitted only from the light sources 130a1, 130a2 located in the direction in which motion detection using the gesture sensor 120 was activated. This is advantageous since motion detection may not be activated in all directions at once.
[0031] In some aspects, light 200 may be emitted from all light sources 130a1, 130a2 when motion detection is activated above top surface 140 and / or below bottom surface 150. That is, in some embodiments, visual feedback is indicated by light 200 being emitted from all light sources 130a1, 130a2 when motion detection using gesture sensor 120 is activated in a direction extending perpendicular to top surface 140 and bottom surface 150. This is advantageous because different types of indications depending on in which direction or directions motion detection was activated provide feedback to the user regarding in which direction or directions relative to user device 100 a gesture for interaction with user device 100 should be performed.
[0032] A second embodiment for providing visual feedback of activation of gesture sensor 120 is now disclosed with respect to user device 100 of Fig. 3. Fig. 3 shows a schematic top view of user device 100 of Fig. 1, where the visual user interface is a touchscreen display 130b. In this embodiment, visual feedback is indicated by light 210 being emitted along rim 170 of touchscreen display 130b only in this or those directions in which motion detection using gesture sensor 120 has been activated. This is advantageous since motion detection may not be activated in all directions at once.
[0033] In some embodiments, when motion detection is activated above the top surface 140 and / or below the bottom surface 150, the light 210 may be along the entire rim 170.
[0034] In some aspects, visual feedback of the user's movements as detected by the gesture sensor 130 is also provided. That is, in some embodiments, the visual user interfaces 130a1, 130a2, 130b are configured to provide additional visual feedback of the user's 300 movements as detected by the gesture sensor 120. The additional visual feedback indicates in which at least one direction from the body 110 the movement was detected.
[0035] Whether or not a movement is detected by the gesture sensor 120 is a technical condition of the user equipment 100. The further visual feedback is an example of a visual indicator. Thus, this embodiment provides a visual indication of the technical condition of the user equipment 100.
[0036] As will be further disclosed below, the visual feedback may vary depending on the user's detected movements, gestures, position, etc.
[0037] In particular, in some aspects the type of visual feedback depends on in which direction motion is detected, i.e. in some embodiments what type of further visual feedback should be provided depends on in which at least one direction from body 110 motion is detected.
[0038] In some aspects, when user motion is detected above top surface 140 and / or below bottom surface 150, light 200 may be emitted from all light sources 130a1, 130a2 and / or light 210 may be emitted along the entire rim 170 of touch screen display 130b. In some aspects, for user motion detected along a direction extending perpendicular to top surface 140 and bottom surface 150, visual feedback may change (e.g., with respect to color and / or light intensity) when the user is moved closer to or farther away from user equipment 100. Further aspects of visual feedback of user motion detection when the user moves closer to or farther away from user equipment 100 are disclosed below. Colors may be shifted according to a scale that may be set by the user or may be hard-coded in user equipment 100.
[0039] In some aspects, the intensity of the emitted light 200, 210 is proportional to the distance between the user device 100 and the detected object (e.g., the user's finger). That is, in some embodiments, the gesture sensor 120 is configured to detect a distance D (see FIG. 6 ) between the gesture sensor 120 and a part 310 (such as a finger) of the user 300 (or an object such as a stylus held by the user 300) that causes a movement of the user 300 to be detected. Providing further visual feedback then involves emitting the light 200, 210 from the visual user interface 130a1, 130a2, 130b, where the intensity of the light 200, 210 is proportional to the detected distance D between the gesture sensor 120 and the part 310 of the user 300.
[0040] Next, a first embodiment for providing visual feedback of a user's movement as detected by the gesture sensor 130 is disclosed with respect to the user equipment 100 of FIG. 4. FIG. 4 shows a schematic top view of the user equipment 100 of FIG. 1, in which the visual user interface consists of light sources 130a1, 130a2 arranged along the frame 160 in a direction in which at least one gesture sensor 120 is set to detect the user's movement. In this embodiment, it is assumed that the movement of the finger 310 of the user 300 is detected by the gesture sensor 120 in a direction from the body 110 in which the light source 130a1 is located. Thus, the light 200 is emitted by the light source 130a1, not the light sensor 130a2. In this respect, the user equipment 100 of FIG. 4 has a total of eight light sources, and the light 200 is emitted from only two of the light sources located in the direction in which the movement of the finger 310 is detected. As one skilled in the art will appreciate, increasing the total number of light sources 130a1, 130a2 increases the level of granularity at which visual feedback of the detected movement of the user 300 can be provided.
[0041] Further, as finger 310 is moved closer to user device 100, the intensity of emitted light 200 may increase, but as finger 310 is moved farther away from user device 100, the intensity of emitted light 200 may decrease until gesture sensor 120 is no longer able to detect the movement or position of user 300. User device 100 may be configured to thereby visually indicate to user 300 that user device 100 has detected the movement of finger 310.
[0042] A second embodiment for providing visual feedback of user movements as detected by gesture sensor 120 is now disclosed with respect to user equipment 100 of Fig. 5. Fig. 5 shows, in a schematic manner, a top view of user equipment 100 of Fig. 1, where the visual user interface is a touchscreen display 130b. In this embodiment, further visual feedback is provided as at least one icon 180 arranged on the touchscreen display 130b of user equipment 100.
[0043] One or more icons 180 may be displayed on the touchscreen display 130b in the direction or directions in which motion detection was activated and / or user motion was detected. That is, in some embodiments, at least one icon 180 is oriented on the touchscreen display 130b to indicate in which of at least one direction from the body 110 motion was detected. Thus, if motion detection is activated in two or more directions from the body 110, one icon 180 may be displayed in each of those directions. Alternatively, as disclosed below, motion detection may be activated in two or more directions from the body 110, but only a single icon 180 may be displayed.
[0044] Next, a third embodiment for providing visual feedback of a user's movement as detected by the gesture sensor 130 is disclosed with respect to the user equipment 100 of FIG. 6. FIG. 6 shows a schematic top view of the user equipment 100 of FIG. 1, where the visual user interface is a touch screen display 130b. In this embodiment, further visual feedback is provided as at least one icon 180 arranged on the touch screen display 130b of the user equipment 100. This embodiment shows an example in which the size of the one or more icons 180 is proportional to a distance D between the user equipment 100 and a detected object (e.g., a finger 310 of the user 300). That is, in some embodiments, the gesture sensor 120 is set to detect a distance D between the gesture sensor 120 and a part 310 of the user 300 that causes a movement of the user 300 to be detected, and the size of the at least one icon 180 is proportional to the detected distance D between the gesture sensor 120 and the part 310 of the user 300. Thus, when user 300 moves closer to user equipment 100 (and the movement of user 300 is detected by gesture sensor 120), icon 180 may increase in size, and vice versa when user 300 moves away from user equipment 100 (and the movement of user 300 is detected by gesture sensor 120) until the movement of user 300 can no longer be detected by gesture sensor 120. Distance D may be a vertical distance and / or a horizontal distance relative to user equipment 100.
[0045] In some examples, there is only one single icon 180 disposed on the touch screen display 130b, the icon 180 comprising a visual indicator 190 of in which at least one direction from the body 110 motion detection has been activated and / or in which at least one direction from the body 110 motion has been detected. In this regard, as shown in the embodiment of FIG. 6, only a single icon 180 is displayed, the single icon 180 having a visual indicator 190 in the form of an arrow pointing in the direction in which motion of the user 300 has been detected.
[0046] As described above, gesture sensor 120 may recognize gestures of user 300. That is, in some embodiments, gesture sensor 120 is configured to recognize detected movements as gestures for user 300's interaction with user equipment 100. For example, visual feedback of a recognized gesture may be provided as blinking of lights 200, 210.
[0047] In some non-limiting examples, the gesture defines one of a virtual touch operation, a virtual scroll operation, a virtual zoom operation. The gesture may be used by the user 300 to activate a function (e.g., a virtual double tap in the air), or a gesture to return to a menu, or other depending on the application. Thus, the type of visual feedback may depend on the type of recognized gesture. That is, in some embodiments, what type of visual feedback should be provided by the visual user interfaces 130a1, 130a2, 130b depends on what type of gesture was detected. For example, each gesture may be associated with its own color, light blinking pattern, etc., and visual feedback of a particular type of recognized gesture may be provided according to the color, light blinking pattern, etc. associated with that particular type of gesture. The color, light blinking pattern, etc. may be shifted according to a scale that may be set by the user or may be hard-coded in the user equipment 100.
[0048] 7 is a flow chart illustrating an embodiment of a method for providing visual feedback from user equipment 100. The method is implemented by user equipment 100 as disclosed above. The method is advantageously provided as a computer program 1020.
[0049] S102: User device 100 activates at least one gesture sensor 120 to detect movements of user 300 interacting with user device 100 in at least one direction out of and from body 110.
[0050] S104: User device 100 provides visual feedback that gesture sensor 120 has been activated. The visual feedback indicates in which at least one direction from body 110 detection of movement using gesture sensor 120 has been activated.
[0051] In this regard, visual feedback may be provided when user device 100 itself is powered on. In another example, visual feedback is provided when an application that utilizes user motion detection (e.g., an application that uses the user's detected gestures as input) is activated.
[0052] Whether the gesture sensor 120 is activated or not is a technical condition of the user equipment 100. The visual feedback is an example of a visual indicator. Thus, this embodiment provides a visual indication of the technical condition of the user equipment 100.
[0053] The visual feedback may be provided according to any of the embodiments, aspects, and examples disclosed above, and thus repeated description thereof will be omitted.
[0054] Next, embodiments relating to further details of providing visual feedback from user device 100 as implemented by user device 100 are disclosed.
[0055] S106: The user equipment 100 detects the movement of the user 300.
[0056] S108: User device 100 provides further visual feedback indicating in at least one direction from body 110 in which motion was detected.
[0057] Whether or not a movement is detected by the gesture sensor 120 is a technical condition of the user equipment 100. The further visual feedback is an example of a visual indicator. Thus, this embodiment provides a visual indication of the technical condition of the user equipment 100.
[0058] The additional visual feedback may be provided according to any of the embodiments, aspects, and examples disclosed above, and thus a repeated description thereof will be omitted.
[0059] 8 illustrates, in terms of several functional units, components of the user equipment 100 according to an embodiment. The processing circuitry 810 is provided using any combination of one or more of a suitable central processing unit (CPU), multiprocessor, microcontroller, digital signal processor (DSP), etc. capable of executing software instructions stored, for example, in a computer program product 1010 (as in FIG. 10) in the form of a storage medium 830. The processing circuitry 810 may further be provided as at least one application specific integrated circuit (ASIC), or field programmable gate array (FPGA).
[0060] In particular, the processing circuitry 810 is configured to cause the user equipment 100 to perform a set of operations or steps, as disclosed above. For example, the storage medium 830 may store a set of operations, and the processing circuitry 810 may be configured to retrieve the set of operations from the storage medium 830 to cause the user equipment 100 to perform the set of operations. The set of operations may be provided as a set of executable instructions. Thus, the processing circuitry 810 is configured to perform the methods disclosed herein. The storage medium 830 may also comprise persistent storage, which may be, for example, any one or combination of magnetic memory, optical memory, solid state memory, or even remotely mounted memory.
[0061] User equipment 100 may further comprise at least a wireless interface 820 configured for communication with other communication entities, functions, nodes, and devices. Thus, communication interface 820 may comprise one or more transmitters and receivers comprising analog and digital components. User equipment 100 further comprises a gesture sensor 840, such as gesture sensor 120. User equipment 100 further comprises a visual user interface 850, such as light sources 130a1, 130a2 and / or touchscreen display 130b.
[0062] Processing circuitry 810 controls the overall operation of user equipment 100, for example, by sending data and control signals to communication interface 820 and storage medium 830, by receiving data and reports from wireless interface 820, gesture sensor 840, and visual user interface 850, and by retrieving data and instructions from storage medium 830. Other components of user equipment 100, and related functions are omitted so as not to obscure the concepts presented herein.
[0063] FIG. 9 shows the components of the user equipment 100 according to an embodiment in terms of some functional modules. The user equipment 100 of FIG. 9 comprises some functional modules, namely an activation module 910 configured to perform step S102 and a provisioning module 920 configured to perform step S104. The user equipment 100 of FIG. 9 may further comprise some optional functional modules, such as any of a detection module 930 configured to perform step S106, a provisioning module 940 configured to perform step S108. Broadly speaking, each functional module 910-940 may be implemented in one embodiment only in hardware, and in another embodiment with the aid of software, i.e. the latter embodiment has computer program instructions stored in the storage medium 830 that, when activated on a processing circuit, cause the user equipment 100 to perform the corresponding steps described above in relation to FIG. 9. It should also be mentioned that the modules correspond to parts of a computer program, but they do not have to be separate modules therein, and the manner in which they are implemented in software depends on the programming language used. Preferably, one or more or all of the functional modules 910-940 may be implemented by the processing circuitry 810, possibly in cooperation with the communications interface 820 and / or the storage medium 830. The processing circuitry 810 may thus be configured to fetch instructions provided by the functional modules 910-940 from the storage medium 830 and execute these instructions, thereby performing any steps disclosed herein.
[0064] 10 illustrates an example of a computer program product 1010 comprising a computer-readable storage medium 1030. On this computer-readable storage medium 1030, a computer program 1020 may be stored that may cause the processing circuit 810, and entities and devices operatively coupled thereto, such as the communications interface 820 and the storage medium 830, to perform methods according to embodiments described herein. Thus, the computer program 1020 and / or the computer program product 1010 may provide means for performing any of the steps disclosed herein.
[0065] In the example of Fig. 10, the computer program product 1010 is shown as an optical disc, such as a CD (compact disc) or a DVD (digital versatile disc), or a Blu-Ray disc. The computer program product 1010 may also be embodied as a memory, such as a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or an electrically erasable programmable read-only memory (EEPROM), more particularly as a non-volatile storage medium of the device in an external memory, such as a USB (universal serial bus) memory, or a flash memory, such as a compact flash memory. Thus, although the computer program 1020 is shown here diagrammatically as a track on the illustrated optical disc, the computer program 1020 may be stored in any manner suitable for the computer program product 1010.
[0066] The inventive concept has been described above primarily with reference to a few embodiments. However, as will be readily appreciated by those skilled in the art, other embodiments than those disclosed above are equally possible within the scope of the inventive concept as defined by the appended claims.
Claims
1. A user equipment (100), the user equipment (100) having a main body (110), at least one gesture sensor (120) configured, when activated, to detect movement of a user (300) interacting with the user device (100) in at least one direction out of and away from the body (110); a visual user interface (130a1, 130a2, 130b) configured to provide visual feedback of activation of the gesture sensor (120), the visual feedback indicating in which at least one direction from the body (110) the detection of a movement using the gesture sensor (120) has been activated; Equipped with the body (110) is defined by a top surface (140), a bottom surface (150), and a frame (160) extending between the top surface (140) and the bottom surface (150), the visual user interface (130a1, 130a2, 130b) comprising light sources (130a1, 130a2) arranged along the frame (160) in a direction such that the at least one gesture sensor (120) detects a movement of the user (300); The visual feedback is indicated by light (200) being emitted from all of the light sources (130a1, 130a2) when detection of movement using the gesture sensor (120) is activated in a direction extending perpendicular to the top surface (140) and the bottom surface (150), of the user device (100).
2. 2. The user equipment (100) of claim 1, wherein the visual user interface (130a1, 130a2, 130b) is configured to provide further visual feedback of the user's (300) movements as detected by the gesture sensor (120), the further visual feedback indicating in which of at least one direction from the body (110) the movements were detected.
3. 3. The user device (100) of claim 2, wherein what type of further visual feedback to provide depends on in what at least one direction from the body (110) the movement is detected.
4. 4. The user equipment (100) of claim 2 or 3, wherein the gesture sensor (120) is configured to detect a distance (D) between the gesture sensor (120) and a part (310) of the user (300) that causes the movement of the user (300) to be detected, and wherein providing the further visual feedback involves emitting light (200, 210) from the visual user interface (130a1, 130a2, 130b), the intensity of the light (200, 210) being proportional to the detected distance (D) between the gesture sensor (120) and the part (310) of the user (300).
5. The user equipment (100) of claim 2, wherein the further visual feedback is provided as at least one icon (180) disposed on a touch screen display (130b) of the user equipment (100).
6. 6. The user device (100) of claim 5, wherein the at least one icon (180) is oriented on the touch screen display (130b) to indicate in which at least one direction from the body (110) the movement was detected.
7. The user equipment (100) of claim 5 or 6, wherein the gesture sensor (120) is configured to detect a distance (D) between the gesture sensor (120) and a part (310) of the user (300) that causes the movement of the user (300) to be detected, and a size of the at least one icon (180) is proportional to the detected distance (D) between the gesture sensor (120) and the part (310) of the user (300).
8. 8. The user equipment (100) of claim 5, wherein there is only one single icon (180) disposed on the touch screen display (130b), the icon (180) comprising a visual indicator (190) of in at least one direction from the body (110) in which the movement has been detected.
9. The user equipment (100) of claim 2, wherein the gesture sensor (120) is configured to recognize the detected movements as gestures of the user's (300) interaction with the user equipment (100).
10. The user equipment (100) of claim 9, wherein the gesture defines one of a virtual touch action, a virtual scrolling action, and a virtual zoom action.
11. 11. The user equipment (100) of claim 9 or 10, wherein what type of visual feedback should be provided by the visual user interface (130a1, 130a2, 130b) depends on what type of gesture is detected.
12. The user equipment (100) of claim 1 , wherein the user equipment (100) is one of a mobile phone, a tablet computer, and a smart watch.
13. The user equipment (100) of any one of claims 1 to 12, wherein each at least one gesture sensor (120) is a proximity sensor.
14. A method for providing visual feedback from a user equipment (100), the method being implemented by a user equipment (100) according to any one of claims 1 to 13, the method comprising the steps of: activating (S102) the at least one gesture sensor (120) to detect movements of a user (300) interacting with the user device (100) in at least one direction out of and from the body (110); providing visual feedback that the gesture sensor (120) has been activated (S104), the visual feedback indicating in which at least one direction from the body (110) the detection of the movement using the gesture sensor (120) has been activated (S104); Including, the body (110) is defined by a top surface (140), a bottom surface (150), and a frame (160) extending between the top surface (140) and the bottom surface (150), the visual user interface (130a1, 130a2, 130b) comprising light sources (130a1, 130a2) arranged along the frame (160) in a direction such that the at least one gesture sensor (120) detects a movement of the user (300); The method, wherein the visual feedback is indicated by light (200) being emitted from all of the light sources (130a1, 130a2) when detection of movement using the gesture sensor (120) is activated in a direction extending perpendicular to the top surface (140) and the bottom surface (150).
15. Detecting (S106) the movement of the user (300); providing (S108) further visual feedback indicating in which at least one direction from said body (110) said movement was detected; The method of claim 14 further comprising:
16. 14. A computer program (1020) for providing visual feedback from a user equipment (100), the computer program comprising computer code, the computer code being configured, when running on a processing circuit (810) of the user equipment (100) of any one of claims 1 to 13, to cause the user equipment (100) to: activating (S102) the at least one gesture sensor (120) to detect movements of a user (300) interacting with the user device (100) in at least one direction out of and from the body (110); providing visual feedback that the gesture sensor (120) has been activated (S104), the visual feedback indicating in which at least one direction from the body (110) the detection of the movement using the gesture sensor (120) has been activated (S104); Let them do so, the body (110) is defined by a top surface (140), a bottom surface (150), and a frame (160) extending between the top surface (140) and the bottom surface (150), the visual user interface (130a1, 130a2, 130b) comprising light sources (130a1, 130a2) arranged along the frame (160) in a direction such that the at least one gesture sensor (120) detects a movement of the user (300); A computer program (1020), wherein the visual feedback is indicated by light (200) being emitted from all of the light sources (130a1, 130a2) when detection of movement using the gesture sensor (120) is activated in a direction extending perpendicular to the top surface (140) and the bottom surface (150).
17. A computer readable storage medium (1030) having stored thereon the computer program (1020) according to claim 16.
Citation Information
Patent Citations
Image projector
JP2015125670A
Electronic device
JP2016057779A
User Input Using Proximity Sensing
US20090139778A1
Mobile systems including image sensors, methods of operating image sensors, and methods of operating mobile systems
US20140111423A1
Touchless user interfaces
US20160224235A1