Smart device with display capable of content multi-functional operation of display information and / or data

By setting two operating areas on the display of the smart device, controlling different display parameters with finger touch, simulating natural 3D motion, the difficulty of image control and data input in miniaturized devices is solved, and a more comfortable and fast operation method is achieved, simplifying complex tasks.

CN120595985APending Publication Date: 2025-09-05格扎巴林特
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202510124031.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2017-02-27
Filing Date
2018-02-23
Publication Date
2025-09-05

AI Technical Summary

Technical Problem

In the miniaturized design of the display of existing smart devices, the image control and operation areas occupy small areas that cannot be ignored, making it difficult to realize complex image processing and data input tasks, especially in three-dimensional data display and multi-functional operations, which make users difficult to operate and fatigue.

Method used

Two operating areas are arranged on the display of the smart device, arranged in different positions and connected by mechanical connections, finger touch controls different display parameters, simulates natural 3D motion, and realizes image processing and data input by coordinating the movement of the two fingers on the operating area.

Benefits of technology

It provides a more comfortable and faster operation method, expands the possibility of image control and data input, reduces the space occupied on the display surface, and simplifies the operation of complex tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120595985A_ABST
    Figure CN120595985A_ABST
Patent Text Reader

Abstract

The invention relates to a device for the controlled manual selection of images displayed on display means (13, 22) of an intelligent electronic device comprising an operating area (2, 25, 32, 41) controlled by the touch of a finger, in which a first predetermined image group and / or display means parameters can be controlled by the finger of a user, and / or a second predetermined image group and / or display means parameters can be controlled by the finger of the user. The device comprises a further operating area (1, 27, 37, 38, 42) which is arranged in a position that can be touched by different fingers of the same user and which, by touching, can adjust at least one further display parameter that does not belong to the first group, and which is arranged at a distance from the operating area (2, 25, 32, 41), the operating areas are mechanically connected by a common body (11, 24, 31).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the patent application with application number 201880013900.6 filed with the China Patent Office on February 23, 2018 and entitled “Smart device with a display capable of realizing simultaneous multi-functional operation of displayed information and / or data”. Technical Field

[0002] The present invention relates to a device for manually controlling the selection and / or adjustment of display parameters of an image to be displayed on a display of an intelligent electronic device, which has an operating area controlled by finger touch, through which a first predetermined group of display images and / or parameters can be controlled by the user's finger. Background Art

[0003] As we all know, the rapid development of computing devices has provided such high processor and data storage capacity that it has become possible to realize a wide range of smart devices with a small size. These devices mainly include mobile phones with increasingly more functions—only a small portion of their capacity is needed for phone use—or smart watches with performance comparable to these mobile phones. In addition, specific smart devices serve different tasks. Devices that can be built into cars also belong to this category and can perform a variety of tasks in addition to navigation.

[0004] Such devices require that their users have a higher degree of choice or the ability to take advantage of the capabilities offered by these devices, while the size of the human hand and fingers and their anatomical limitations or other circumstances (e.g., other tasks of a car driver's hands or the need to hold a device) impose artificial limitations on miniaturization from the perspective of operating the device and selecting from a variety of functions.

[0005] Such limitations include, for example, the design of keyboards required for data entry, where miniaturization necessitates operating in a smaller area. Regarding data entry, one area of ​​development is the improvement of voice recognition, which could replace manual data entry to a certain extent, or the invention of intelligent recognition of small finger movements, which could provide a solution for direct data entry, but users would then have to learn predetermined gesture combinations. Such a system is known from WO 2016 / 170374 A1, which presents a new paradigm for direct data entry. Two alternative solutions have been proposed for sensing the same gesture combination. In one solution, part or the entire operating surface of the device can be slightly moved relative to the device body in two mutually orthogonal directions. The displacement is limited by a closed path (preferably circular or elliptical), and depressions or stops are arranged at preferably diametrically opposed positions along this path, which can be easily sensed by the user's finger by touch or through tactile feedback. Reaching the edge of the path can also be sensed. The operating area is always brought to the center of the area by a biased spring system, so that characteristic input can be performed by drawing gesture combinations that can be easily learned and sensed. In another embodiment using the same principle, the input area is stationary, but it includes a similar path of depressions along which the finger can move. Specific locations can be identified by depressions placed at these locations or by small bumps that can be sensed by the fingertip. Both alternatives are characterized in that "drawing" of features occurs in the same way and is always associated with tactile feedback, i.e., the user does not need to observe the display area or visually check the movement of the finger in order to draw the feature.

[0006] Controlling the image displayed on a display according to user needs is a task that is becoming increasingly complex due to the increasing possibilities and user demands. In the case of touchscreen devices, multiple display functions can be achieved through gestures performed in different directions, including moving the image in two directions, increasing or decreasing the scale, or rotating the image. A common drawback of these solutions is that they occupy a non-negligible area of ​​the already small display area. This problem becomes more prominent as display size decreases.

[0007] The development of requirements requires image processing that goes beyond the possibilities listed. A typical example of such a requirement is visualization in 3D, which is required in more and more applications. The three-dimensional data of the object to be displayed is available in the memory of the device, but the user may need to move the picture in one or more of three mutually orthogonal directions, to rotate the image around any axis and to enlarge or reduce its size. A similar task that cannot be solved in a two-dimensional plane is if a map of a given area should be viewed from different aspects during navigation, for example, the type of point of interest (POI) selected, traffic signs or height lines that need to be observed more closely or surrounding areas. These different display contents are arranged in layers, and for image control it is also necessary to move between the layers.

[0008] Another set of image processing parameters is not related to 3D tasks, but to optimal performance in a search (scrolling) task, in which smaller areas are first searched within a larger area. As we approach the target, the enlarged image should move more slowly. This means that it is also necessary to be able to change the search speed when moving along the parameters (left and right or up and down). From the demand side, a large number of parameters need to be changed, and the number of parameters that can be manipulated in two-dimensional areas of increasingly smaller size is limited. The task can be solved by, for example, associating and using several functional areas. Summary of the Invention

[0009] The object of the present invention is to make better use of the human side of such human-machine systems and to provide graphical control and operating possibilities, whereby the set of parameters that previously used two-dimensional controls could already operate well can be expanded by creating adjustment possibilities for further parameters.

[0010] A further object of the invention is that the expansion of the possibilities does not make the user more fatigued, but that he can carry out the required adjustments in a comfortable and almost automatic manner.

[0011] A further object of the invention is to provide an additional operating area which does not occupy a valuable portion of the available display surface, or at most only occupies a small area.

[0012] Yet another object of the present invention is to optimize the previously defined objects to different important fields of application (smart watches, automotive applications, use in mobile devices) by taking into account the limitations of these specific applications.

[0013] It is a further object of the present invention to provide for the use of the above-mentioned direct data input functionality also for image processing and control during the provision of magnified image manipulation and image control tasks.

[0014] These objects are achieved by providing a device for controlled manual selection of images displayed on a display device of an intelligent electronic device and / or adjustment of their display parameters, the intelligent electronic device comprising an operating area controlled by the touch of a finger, wherein a first predetermined group of images and / or display device parameters can be controlled by the user's finger, and the device comprises a further operating area, which is arranged at a position that can be touched by a different finger of the same user and at least one further display parameter that does not belong to the first group can be adjusted by touch, and the further operating area is arranged separated from the operating area, and the operating areas are mechanically connected via a common body.

[0015] In order to simulate natural 3D movement, it is preferred that the operating areas are at an angle to each other, or that they are arranged on opposite surfaces of the body.

[0016] In order to utilize known direct data input solutions, the operating area or a part thereof can be moved relative to the body along a closed path in two mutually orthogonal directions, and the design of such an operating area constitutes an element of a data input device known per se in a first functional mode, while in different other functional modes, this movement relative to the body is associated with other display parameters.

[0017] Learning such input is made easier if simultaneous movements of two fingers on the operating area and the further operating area are coordinated with one another according to a predetermined logic system and such movements result in movements of images logically connected to the same logic system.

[0018] Special image processing possibilities are provided when the first and second sets of display parameters together comprise parameters required for adjusting the image along three mutually orthogonal coordinates x, y, z.

[0019] In an important application area, the body is constituted by the body of a smart watch that can be placed on the user's wrist, and the operating area is arranged near one end of the display device, while the other operating area is arranged near the other end of the display device.

[0020] If the additional operating area is much smaller than the operating area, the overall size can be reduced.

[0021] In another important application, the body is constituted by a portion of a steering wheel of a car.

[0022] In this case, it is preferred that the operation area is placed within the reach of a finger and faces the driver when the steering wheel is gripped, and the further operation area is arranged within the reach of another finger of the same hand and faces the opposite direction.

[0023] In another desirable application field, the body is composed of a flat rectangular body of an intelligent electronic device, and the operating area is arranged on the front of the device, which includes the display device of the device, and the further operating area is arranged on the rear surface of the device, and the operating area includes a device for ensuring data input through tactile feedback, which is achieved by moving the device or by moving a finger along a closed path through a combination of gestures, while further image display parameters can be controlled by the same device including a closed path in another operating mode.

[0024] In another possible field of application, the operating panel and the further operating panel are arranged on one or more bodies, which can be tilted into space from a flat operating surface of a notebook or a tablet computer with a keyboard.

[0025] The device according to the invention provides a complete solution for the task group, and its use provides a significantly enhanced and simplified operation compared to previously known solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The device according to the invention will now be described in more detail with reference to exemplary embodiments of the invention, which description will make reference to the accompanying drawings. In the drawings:

[0027] Figure 1 A perspective view of a smartwatch viewed slightly from below is shown;

[0028] Figure 2 is viewed slightly from above. Figure 1 Similar views;

[0029] Figure 3 This is an enlarged view showing the movable characteristics of the operating area 1;

[0030] Figure 4 shows simplified perspective views of a smartwatch seen from different directions;

[0031] Figure 5 shows a schematic diagram of downward movement along the axis z;

[0032] Figure 6 shows a schematic diagram of upward movement along axis z;

[0033] Figure 7 shows a schematic diagram of movement along axis x;

[0034] Figure 8 shows a schematic diagram of clockwise rotational motion around axis z;

[0035] Figure 9 A schematic diagram showing rotation in another direction about the axis z is shown;

[0036] Figure 10 shows a schematic diagram of movement in plane x, y;

[0037] Figure 11 A schematic diagram showing a rotation in one direction about an axis x is shown;

[0038] Figure 12 A schematic diagram showing rotation in another direction about the axis x is shown;

[0039] Figure 13 Details of the car's interior are shown, including the steering wheel and part of the dashboard and windshield.

[0040] Figure 14 is a schematic diagram showing the operation of the first operating area for the driver;

[0041] Figure 15 is a schematic diagram of a second operating area facing away from the driver;

[0042] Figure 16 is a perspective view of a smart mobile device in which the entire display area can be moved;

[0043] Figure 17 is similar to Figure 16 a view where the operating area occupies only a small portion of the upper surface;

[0044] Figure 18 is a schematic diagram showing a rear panel of a mobile device;

[0045] Figure 19 A floor plan showing a laptop or desktop device; and

[0046] Figure 20 Shown from Figure 19 The upper plane of the device is shown extending upwards to two operating areas. DETAILED DESCRIPTION

[0047] The first embodiment of the device according to the present invention is a smartwatch 10, which has a large, curved body that conforms to the shape of the lower arm (wrist). It is connected to a matching metal band 12 via a pivotal connection that can be released or opened, ensuring that the watch 10 is worn comfortably on the lower arm. Inside the smartwatch 10 is a microelectronic system with an internal structure and processing power comparable to that of conventional smart mobile phones, providing substantially the same functionality and, in the present invention, additional functionality not available with conventional flat handheld mobile phones. The essence of the present invention lies not in the internal design of the smartwatch, but in the solution that allows the user to operate this microelectronic system in a more comfortable, faster, and more efficient manner.

[0048] The largest central area of ​​watch 10 is a slightly curved display 13, which is preferably, but not necessarily, touch sensitive. Figure 1 In FIG, the watch 10 is shown from a slightly lower angle, while in Figure 2 Above and below the upper edge of the display 13 (as shown in FIG. Figure 2 As shown), a first operating area (sensor / sensing area) 1 is arranged, which has an operating surface that is sensitive to touch and has a narrow shape elongated in the horizontal direction and forms a rectangle that extends along practically the entire width of the watch 10.

[0049] A second operating area (sensor / sensing region) 2 is arranged below the display 13. Figure 1 As can be well seen in FIG, its width is preferably equal to that of body 11 of watch 10 , but its height is higher than that of first operating area 1 , so that it has a significantly larger surface.

[0050] In a preferred embodiment, the second operating area 2 is a flat mechanical unit that can be moved parallel to itself (but in any case without rotation) relative to the body 11 of the watch 10 along the Figure 1 The two mutually orthogonal axes shown by the double arrow 14 are slightly displaced. The mechanical connection between the operating area 2 and the body 11 and the related functions are as disclosed in WO / 2016 / 170374A1, that is, the operating area 2 can be moved by a single finger in a manner limited by the closed path 15, as shown in FIG. Figure 3 As shown, this movement provides tactile feedback and enables data to be input in an easy manner. In order to facilitate tactile feedback on the diametrically opposite sides of the path 15, corresponding small depressions 16 are formed, whereby during use it is possible to sense when the corresponding depression 16 is reached during movement along the path 15. This possibility of moving the operating area 2 enables the direct data input described in the cited document. It should be noted that Figure 3 The actual dimensions of the path 15 shown in FIG are much smaller, and the length of the diameter of the displacement is at most a few millimeters. In other embodiments, the surfaces of operating areas 1 and 2 are sensing surfaces, so that finger movements along the surfaces are detected by appropriate electronic units, and the corresponding movement gestures can be distinguished from each other based on their direction, speed, size, and position. Because operating surface 2 is significantly larger than the other, more detailed and complex gestures can be performed by moving our fingers along this surface.

[0051] It should be noted that the operating area 2 is along Figure 3The movement of the path 15 shown in the figure occurs against the spring bias, so the user can clearly distinguish whether he / she is moving a finger along a stationary surface (as if it were only lightly touched) or whether the entire operating area 2 is being moved by being pushed hard - which is necessary for data entry.

[0052] Since the operating area 2 is used for different purposes on it (preferably on its upper part), several small functional areas are shown. Figure 1 , which is associated with digital input. In the default state, the sensor input function of the operating area 2 is set, and if the operating area 2 is pushed and moved completely relative to the body 11, the data input function will be triggered. In this starting state, the data input is, for example, the input of characters adjusted to the English alphabet, but after previously pressing the functional area 17, the corresponding movement combination will be associated with numbers or punctuation marks, and other functional areas can be assigned to different word processing commands or states. These possibilities are described in detail in the cited literature, and from the point of view of the present invention, it is important that the operating area 2 can also be used to input data and commands in a stronger pressing state.

[0053] In the case of the present invention applied to the smartwatch 10, it is important to note that the operating areas 1 and 2 are characterized not only by the fact that they are arranged at a certain distance from each other (for example, at the ends of the display 13), but also, importantly, by the fact that their respective planes form / enclose an angle, which facilitates the process of user space control described later. It is also important to note that the distance and arrangement of the operating areas 1 and 2 are such that they can be easily touched by two fingers without any physical effort, so that they can be contacted by the fingers individually or together, so that the fingers can be comfortably moved along them.

[0054] Figure 4 A simplified perspective view of the smartwatch 10 is shown, in which the relative angles formed / enclosed by the operating areas 1 and 2 are better shown. In order to make the understanding of the individual functions easier, the basic characteristics of these functions have been Figure 4-12 are shown by their English terms.

[0055] Now refer to Figures 5 to 12, which illustrates the implementation of each of the main functions. Because operations occur in space, i.e., three dimensions, the directions x, y, and z of the spatial coordinate system are always indicated next to each diagram, and the projection into the xy plane is shown to the right of the coordinates. These coordinates are drawn with bold lines, along which a given function (combination of movements) can control the movement of an image or cursor displayed on display 13. The processor in smartwatch 10 should include the spatial data for a given function and be able to display it. This could be, for example, in the case of a map, the display of the map itself in the xy plane, while (as is known) also including features visible in various layers (e.g., points of interest, traffic signs, regulations, height lines, etc.), as their simultaneous display would make the image too complex to understand. When the internal coordinates of a product or body are available in the machine (e.g., in the case of 3D planning), there are other functions and procedures, and it is important that the user can not only visualize the structure in the xy plane, but also inspect it in depth—i.e., along the z axis—and thus select an image of interest. The solution according to the present invention provides a simple way to handle this rather complex task, ensuring that fingers and hands do not cover the area of ​​display 13 during operation.

[0056] Figure 5 A downward movement along the z axis (expansion) is shown. For this movement, two fingers should be moved downward along the operating areas 1 and 2, as indicated by the arrows in the figure. We then move downward in depth from one layer to another. Because the watch 10 is most often worn on the left wrist, the downward movement of content in space represents the brain's natural imaging of sliding two fingers downward, so this control utilizes the most natural movement combination for the user.

[0057] Figure 6 An opposite upward movement (pitch) along axis z is shown, which is exactly the opposite of the movement described previously.

[0058] Figure 7 The image shows a displacement in the x-direction in the xy plane (called a slide) when controlled with two fingers in both directions. It should be noted that in the actual displayed plane, basic movements (moving from right to left and up and down, as well as zooming in or out of the image) can also be achieved by plane control of the operating area 2, but if the user is already accustomed to controlling the position of the displayed image, it is worth ensuring that such movements are controlled with two fingers.

[0059] Figure 8 shows the control of rotation in the clockwise direction around the axis z, while Figure 9 A similar control is shown in the counterclockwise direction. The finger movement associated with the rotation again corresponds to a natural way, as the fingers move in the opposite direction.

[0060] Figure 10 The aforementioned single-finger movement is illustrated, requiring only a finger movement along operating area 2. This type of movement (translation) is most commonly used within a given image plane. Therefore, this type of movement can be supported by a variety of functions. When an image or cursor is to be moved within the displayed plane, the searched location is initially searched with a coarser movement. Once the target is visible, the movement speed is reduced. The term "speed" refers to the displacement on the screen associated with the overall / single finger movement. The presence of another operating area 1 provides a good option for changing the speed. If a different finger touches operating area 1 at a stable position 18, the processor in watch 10 will detect this contact as a control event for changing the speed. In many cases, a single speed change step is sufficient, and in this case, simply touching position 18 is sufficient. In systems with multiple speeds, control can be achieved through multiple subsequent touches, and changes in the opposite direction can also be achieved in a variety of ways. One such option is to decrease the speed if the right side of operating area 1 is touched, and increase it if the left side is touched. In another possibility, the position of the contact does not play a role, but, for example, the first three contacts increase the speed and each subsequent contact decreases the same speed. The essence is not how the speed is changed, but that the speed change is achieved by touching another operating area 1.

[0061] at last, Figure 11 and 12 Rotational control in the yz plane (ie about axis y) is shown, which is as natural to the user as in the xy plane.

[0062] In addition to controlling with two fingers, the functions used and learned in previous devices can still be used, i.e. if the two fingers are moved apart along the larger operating area 2, the image will be enlarged, while if the fingers are moved towards each other the image will be smaller.

[0063] If the operating area 2 is moved relative to the body 11, a further interesting possibility is obtained, namely that the shift of the displayed image in a given plane is controlled by one finger, either upwards and downwards or from right to left, and this possibility corresponds to a scrolling function. When the display is controlled in this way, the operating area 2 is not in data input mode, so the operating area 2 can be moved along Figure 3The path 15 shown moves to any one of the special positions defined by the four recesses 16. These positions can, for example, be associated with corresponding movements in the upward, downward, rightward and leftward directions. The processor in the watch 10 can also be programmed so that in the display control mode, the placement of the operating area 2 to any one of the recesses 16 will cause the displayed image to move (shift) in the relevant direction, which means a simple implementation of the up-down and left-right scrolling functions without the need for any separate processing equipment. It should be noted that the possibility of moving the operating area 2 relative to the body 11 can be associated with other display control functions by associating the corresponding gestures with appropriate display control functions that can be easily understood. For example, a clockwise rotation gesture along the path 15 can cause the image to be rotated to the right, while a gesture in the opposite direction causes the image to be rotated to the left. Therefore, according to the present invention, first of all, by using a gesture such as Figure 5-12 The controls of the two operating areas shown enhance the traditional controls in a single plane, which can be combined or supplemented with the possibility of moving the operating area 2 relative to the body 11 and taking advantage of the presence of a special position, whereby further display functions can be realized, which increases the freedom of operation and its comfort.

[0064] Three-dimensional control of images and / or cursors by multiple fingers can be applied not only in smart watches, but also in many other application fields. Figure 13A detail of a car interior is shown, with a steering wheel 20 grasped by the driver's hands. The car's interior features the usual operating and display devices, including a built-in display 21 and, in front of the windshield, a projected image 22 generated by a projector from an intelligent electronic control unit built into the instrument panel. Image 22 may display details of a road map. The control system according to the present invention is responsible for three-dimensionally controlling the display image 22 projected for the driver by a control unit (not shown) described above, in a manner similar to that described in the previous embodiment. The car's steering wheel 20 and its central portion 23, which is fixed to the steering column, are typically connected by two connecting members 24, one positioned near the driver's right hand and the other near the left. Depending on whether the driver is right-handed or left-handed, a sensor-based operating area 25 is located on the front surface of either the right or left connecting member 24. This sensor-based operating area can be designed and controlled in a manner similar to the operating area 2 of the smartwatch 10 in the previous example. The difference lies in the larger available surface, which may make it unnecessary to design the entire operating area 25 movable, as data input is handled in operating area 2. In this case, a different type of data input may be more preferable, which is described in document WO / 2016 / 170374A1 as a second data input mode, in which instead of the operating area moving along a closed path, a closed path is formed on the surface, and grooves are arranged at the edges of the path to enable touch sensing in diagonally opposite positions. This inner area is divided into multiple parts, preferably four parts, by a slightly outwardly bulging island, and in this case, data input can be performed with the same combination of movements when the entire area moves along the path, but in this case the finger must move over the stationary area. Whether the data input area is provided on a separate part of the operating area 25 or arranged next to it or in any convenient location is just a matter of detail.

[0065] exist Figure 14 and Figure 15 In the enlarged view of FIG, the front portion of the connecting member 24 of the steering wheel is shown ( Figure 14 ) and rear ( Figure 15 ). Figure 14 An enlarged view of the front operating area 25 facing the driver when touched by the thumb 26 is shown. Figure 15 The rear surface of the connecting member 24 is shown, which is further away from the driver and has a rear operating area 27 with a sensor thereon and is contacted by the driver's index finger 28 .

[0066] To control the image and / or cursor projected or displayed on the display 21, the same combination of movements can be associated as has been associated with Figure 5-Figure 12As shown and explained, all types of movements along or around the axes x, y, z can thus be controlled by easily coordinated movements of two fingers of the driver. Although it is preferred if the two front and rear operating areas 25, 27 are arranged behind each other and can be controlled by two fingers of the same hand, a different solution is also possible in which a second operating area 27 is provided on the front surface of another or other connecting member of the steering wheel 20, which can be controlled by a finger of the driver's left hand 29 ( Figure 13 ).

[0067] The previously mentioned data input function can be implemented according to both versions of the previously cited document. The front operating area 25 can be moved relative to the connecting member 24 of the steering wheel, similar to the movement of the operating area 2, and in that case, similar functional possibilities can be obtained. Alternatively, as described above, a closed path can be provided on a part of the front operating area 25, and the movement of the finger on this area provides data input or a special image movement function. In the embodiments described so far, the structure providing the operating area does not require a special grip by hand, because the watch 10 is fixed to the hand and the fingers of the other hand can move freely on it. In automotive applications, the operating area is held by the steering wheel, and the fingers of the hand holding the steering wheel can be moved along the various areas in a simple manner.

[0068] When operating components of smart mobile phones or other smart electronic devices, the most common requirement is three-dimensional control or the need to enhance operating functions. In this case, the free movement of the fingers is limited by the need to hold the device itself with the hand, that is, the hand has to multitask, and without the risk of dropping the device, the movement of the fingers is far less free than in previous solutions.

[0069] exist Figure 16 and 17 , typical smart mobile devices are shown respectively, which are basically equipped with the data input operation area as described in the previously disclosed WO / 2016 / 170374A1. Figure 16 The device 30 shown in FIG has a flat rectangular body 31 which is almost completely covered by an operating area 32 which is also a touch screen display. The operating area 32 can be moved within certain limits in the direction of the double arrow 33, as described in detail in the literature. Figure 17The device 34 shown in FIG differs only in that it has only a small operating area 35, which is also movable in both directions within certain limits and leaves a large portion of the front surface of the device 34 unoccupied. This operating area 35 also provides a touch screen display. The surface of the operating area 35 is also a sensor surface that can detect the movement of a finger that comes into contact with it. The operating area 35 can also naturally be used for data input, as described in the cited document.

[0070] Figure 18 The back side of the previously described device 30, 34 is shown, on which, preferably in the central portion, a ridge 36, parallel to the longitudinal axis of the device, slightly bulges out of the surface. On either side of the ridge, corresponding operating areas 37, 38 are provided. When the device is held in the hand, the thumb can freely move along the front operating area 32 or 35 provided on the front side of the device, and another finger can move along the back surface without risk of dropping the device. However, such movements are not as delicate and complex as they would be if the fingers had no other tasks, due to the constraints imposed by the grip. A finger touching the back side will have the freedom to feel the presence of ridge 36 and can distinguish whether it is touching area 37 or 38 to the right or left of ridge 36.

[0071] In such a device, the operating area on the front face will be reused in various ways, i.e. if slightly pressed and displaced in the x or y direction relative to the body 31 of the device 30 or 34, the data input function will be selected and data input can be performed with the movement.

[0072] When a finger is moved on the operating area 32 or 35 with such little force that it cannot move away from its biased basic position, translation control can be achieved as the finger moves, such as Figure 10As shown. If, at the same time, the operating area 37 to the left of the ridge 36 is touched (i.e., without moving the finger by gripping the device), a function change occurs, and by moving the operating area 32 or 35, a different movement function can be selected. Depending on the gesture, the operating area 32 or 35 can be moved radially from the central position to any of the recesses 16, can be pushed into these recesses, or can be moved along a closed path. For each of these positions and gestures, individual image or cursor control functions can be associated. For example, if the operating area is pressed along the y-axis to the upper recess, the image can be moved upward or, conversely, downward, and if it is pressed to the end of the horizontal diagonal, the image can be moved left or right. A clockwise arc gesture results in a rightward rotation, while a counter-clockwise arc gesture results in a leftward rotation. Interesting combinations can be achieved, for example, if the operating area is pressed to a vertical recess, the image moves upward. If, in this case, the pressure is reduced but the finger moves in the same vertical direction along the sensing area, the initial vertical image movement can continue until the finger is released or lifted.

[0073] If the finger on the rear side does not touch the operating area 37 on the left side of the ridge 36, but touches the operating area 38 on the right side, the function will change. If the front operating area 32 or 35 is displaced, the control will be controlled in the z direction, that is, upward or downward movement, and it is orthogonal to the control in the previous case.

[0074] Figures 16 to 18 The solution shown does not have any particular graphical control scheme, but would provide, in addition to conventional control, a further dimension of control, in addition to moving the finger along the sensing operating surface. To achieve this, the operating area itself must be moved relative to the body of the device, and two additional functions can be added by touching the appropriate area on the back of the device, which can be performed by holding the device with the fingers on the back without the risk of dropping it.

[0075] Finally, reference Figure 19 and 20 . Figure 19A top view of a conventional laptop computer 40 or similar computer is shown, in which the keyboard is represented by area 39 and a substantially rectangular area is provided on its front side for a conventional touchpad as a cursor control area. According to the invention, an enhancement of the operating area is provided, so that two operating areas 41, 42 are provided in a given area, which can be swiveled out at an angle relative to each other. In the initial or basic position, these areas are arranged in the upper plane of the laptop computer 40 and, despite being divided into two parts, they can be used for conventional cursor control functions. A button 43 or similar device is provided next to the operating areas 41, 42, and as a result of pressing the button 43, the two operating areas 41, 42 will (due to the spring bias) bulge out of the upper plane and will take Figure 20 The position shown in FIG. Guide elements not shown in the figure ensure that this inclined position of the operating areas 41, 42 is maintained in a stable manner. In this raised position, the roles of the operating areas 41, 42 will be separate / different and they will assume the same Figure 1-12 The functions of the operating areas 1 and 2 described in the smartwatch 10 are described above. Since the two operating areas 41 and 42 are now separate and have their own different inclined planes, the same functions described in the control of the smartwatch 10 can be achieved through them. Although the angled design is preferred, an alternative solution can also be implemented: the rectangular support element is in an upright position relative to the upper plane, and the operating areas are provided on the front and rear surfaces of the plate.

[0076] The present invention is not limited to any one of the exemplary embodiments shown, since its essence lies in a substantial enhancement and simplification of operating functions, and it solves tasks that seemed unsolvable until now, such as a device with a small operating area like a smart watch 10 not only has the operating possibilities of a laptop or mobile phone, but also, taking into account their functions, it can provide more services related to such a device.

Claims

1. A device for the controlled manual adjustment of an image displayed on a display (21) of an intelligent electronic device in a vehicle having a steering wheel (20) and / or display parameters of the image, the intelligent electronic device storing data constituting a map or a plurality of different layers of a map of the parameters, wherein: An operating area (25) is provided on a first surface of a component of a steering wheel (20), the operating area (25) being within reach of a finger (26) of a driver's hand when the steering wheel (20) is gripped, and the first surface faces the driver, the operating area (25) having a touch-sensitive surface, and by touching and moving the finger (26) on the operating area (25), an image and / or display parameters on a display (21 or 22) can be controlled with two degrees of freedom, characterized in that the component has an opposite second surface facing away from the driver and capable of being touched by different fingers (28) of the same hand of the driver, the opposite surface having a touch-sensitive surface constituting another operating area (27), and by touching and moving the different fingers (28) on the other operating area (27) The invention relates to a method for controlling a plurality of image elements of the display device and the display apparatus according to the present invention. The method comprises the steps of: moving a finger (26) on a first operating area (25) to control at least one image or display parameter that does not belong to the first group; the movement of the finger (26) on the first operating area (25) to control at least one image or display parameter that does not belong to the first group; and the method of controlling the plurality of image elements of the display device and the display apparatus according to the present invention. The method comprises the steps of: moving a finger (26) on the first operating area (25) to control at least one image or display parameter that does not belong to the first group when the finger (26) is moved simultaneously by the finger (28); and the method of controlling the plurality of image elements of the display device and the display apparatus according to the present invention.

2. The device according to claim 1, wherein The operating area (25, 27) is arranged outside the connecting member (24) of the steering wheel (20) so that the fingers (26, 28) of the hand gripping the steering wheel (20) can easily reach the operating area (25, 27).

3. The device according to claim 1 or 2, wherein: The object is a map of the vehicle area, and the image control includes controls in the map plane and selections in different layers of the map.

4. The device according to claim 3, wherein Controls in the map plane include one or more of sliding, rotating, zooming in or out of the map.

5. The device according to any one of claims 1 to 4, wherein By touching another operation area (27) in a predetermined manner, the movement speed of a cursor or an image controlled by the movement of a finger on the first operation area (25) can be changed.

6. The device according to any one of claims 1 to 5, wherein: The operating area (25) or a part thereof is movable in two mutually orthogonal directions relative to the steering wheel (20) along a closed path (15), and this design of the operating area (25) constitutes an element of a data input device known per se, and the data input functional mode is different from the image control functional mode.

7. The device according to claim 6, wherein The closed path (15) has four depressions (16) in four main directions, and in the image control mode, by pushing the operating area (25) to any of the depressions (16), the image scrolls in the corresponding direction as long as the pressing is maintained.

Citation Information

Patent Citations

  • Method and data entry device for the entry of data in electrical form

    WO2016170374A1