Frame module, display device, control system, control method and related equipment

Abstract

The invention relates to a frame module, a display device, a control system, a control method and related equipment, the frame module is used for forming the display device with a display screen module, and the frame module comprises a frame and a sensing device integrated in at least one frame. The sensing device is used for sensing user interaction operation in a sensing area formed on the frame module by the sensing device. According to the embodiment, the sensing area, formed on the frame module, of the sensing device is not connected with the display area of the display screen module, so that the sensing area on the frame module provides an additional interaction interface for a user, the user can control functions by touching the frame in the frame module, the user can jump out of the screen and use the frame outside the screen, and the user experience is improved. The screen light pollution is reduced, meanwhile, function quick control is carried out, visual feedback of a display area does not need to be relied on, blind operation of a user is facilitated, and operation convenience and safety are improved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a frame module, a display device, a control system, a control method, and related equipment. Background Art

[0002] Currently, electronic devices' function controls are integrated into touch screens, requiring users to access and operate the desired functions on the touch screen, relying on visual feedback from the screen. However, this method of function control makes it difficult to quickly operate functions and is not feasible for blind operation. Summary of the Invention

[0003] The embodiments of the present application provide a frame module, display device, control system, control method and related equipment to solve the problem that users rely on the visual feedback of the screen and cannot quickly obtain and operate the required functions, thereby at least partially solving the above-mentioned technical problems.

[0004] To achieve the above-mentioned object, according to a first aspect of the present application, a frame module is provided, wherein the frame module is used to form a display device together with a display screen module, and the frame module includes a frame and a sensing device integrated in at least one of the frames;

[0005] The sensing device is used to sense user interaction operations in a sensing area formed by the sensing device on the frame module.

[0006] According to a second aspect of the present application, a display device is provided, comprising a display screen module and the above-mentioned frame module.

[0007] According to a third aspect of the present application, there is provided a device control system for a target device, comprising the above-mentioned display device and a controller;

[0008] The frame module of the display device is used to sense user interaction operations on the frame module;

[0009] The controller is used to control a target function of the target device based on a user interaction operation sensed by the frame module.

[0010] According to a third aspect of the present application, a target device is provided, comprising the above-mentioned device control system.

[0011] According to a fourth aspect of the present application, a target device is provided, comprising the above-mentioned device control system.

[0012] According to a fifth aspect of the present application, a control method is provided, which is applied to the above-mentioned target device, and the method includes:

[0013] According to the user interaction operation sensed by the display device in the target device based on the frame module, a target function of the target device is controlled.

[0014] According to a sixth aspect of the present application, a computer device is provided, comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads the instructions from the memory to execute the steps of the above-mentioned control method.

[0015] According to a seventh aspect of the present application, a computer-readable storage medium is provided, which stores a plurality of instructions suitable for loading by a processor to execute the steps of the above-mentioned control method.

[0016] According to an eighth aspect of the present application, a computer program product is provided, comprising a computer program or instructions, which implement the steps of the above-mentioned control method when executed by a processor.

[0017] The frame module, display device, control system, control method and related equipment of the embodiments of the present application, wherein the frame module is used to form a display device with the display screen module, the frame module includes a frame and a sensing device integrated in at least one of the frames; the sensing device is used to sense user interaction operations in the sensing area formed by the sensing device on the frame module. The sensing area formed by the sensing device on the frame module in this embodiment is not connected to the display area of ​​the display screen module. In this way, the sensing area on the frame module provides an additional interactive interface for the user, allowing the user to control functions by touching the frame in the frame module. The user can jump out of the screen and use the outer frame of the screen to reduce light pollution of the screen while quickly controlling functions without relying on visual feedback from the display area, facilitating blind operation by the user and improving the convenience and safety of operation.

[0018] Other features and advantages of the present application will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] To more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0020] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings, wherein the same drawing numbers represent the same parts in the following description.

[0021] Figure 1 is a schematic diagram of an application scenario of a display device provided in some embodiments of the present application;

[0022] Figure 2 is a schematic structural diagram of a display device composed of a frame module and a display screen module provided in some embodiments of the present application;

[0023] Figure 3 is a schematic diagram of the structure of a device control system provided in some embodiments of the present application;

[0024] Figure 4 This is a flowchart of a border sliding gesture interaction provided in some embodiments of the present application;

[0025] Figure 5 is a flowchart of a border tap gesture interaction provided in some embodiments of the present application;

[0026] Figure 6 is a flow chart of a control method provided in some embodiments of the present application;

[0027] Figure 7 is a schematic structural diagram of a control device provided in some embodiments of the present application;

[0028] Figure 8 It is a schematic diagram of the structure of a computer device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0030] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0031] In related technologies, touch sensors are added to the edges or frames of the screen to expand the interactive contact area or introduce new trigger paths to achieve terminal user interface interaction. Function control is usually achieved in the following ways:

[0032] The first is to add capacitive or piezoresistive sensors to the inner edge of the screen to achieve quick function control;

[0033] The second method uses a gravity acceleration sensor or a gyroscope to identify tapping actions, thereby triggering specific shortcut functions;

[0034] The third method is to install sensors on the screen border, such as infrared sensors or gesture sensors, to convert the non-touchable area into a touchable area;

[0035] The fourth type uses pressure-sensitive and touch-sensitive technology in the border and edge areas to achieve a variety of refined function controls such as sliding left and right, up and down, and clicking.

[0036] However, all four implementation methods require reliance on visual feedback from the screen for operation. In driving scenarios, they do not fully consider the characteristics of the driving environment, such as the user's distracted attention, short visual concentration time, and the need for blind control. Blind operation cannot be achieved, and it is difficult to quickly obtain and operate the required functions, affecting the user experience.

[0037] In view of this, the embodiments of the present application provide a frame module, a display device, a control system, a control method and related equipment. The frame module is used to form a display device with a display screen module. The frame module includes a frame and a sensing device integrated in at least one frame. The sensing device is used to sense the user's interactive operation in the sensing area formed by the sensing device on the frame module. The sensing area formed by the sensing device on the frame module in this embodiment is not connected to the display area of ​​the display screen module. In this way, the sensing area on the frame module provides an additional interactive interface for the user, so that the user can control the function by touching the frame in the frame module. The user can jump out of the screen and use the frame outside the screen to reduce the light pollution of the screen while quickly controlling the function without relying on the visual feedback of the display area, which is convenient for the user's blind operation and improves the convenience and safety of operation.

[0038] See also Figure 1 and Figure 2 , Figure 1 Schematic diagram of application scenario of the display device. Figure 2 This is a schematic diagram of the structure of a display device consisting of a frame module and a display screen module. Figure 1 The application scenario is the use scenario of the vehicle-mounted central control screen, and the display device is taken as an example of the vehicle-mounted central control screen, including the display device 10, the steering wheel 20, and the user hand 30.

[0039] The display device 10 is used to present various vehicle information and interactive interfaces. The display area in the display device is used to provide information display functions, and is also integrated with the interactive functions of the frame module to enhance the overall user experience. The display area and the frame module can work together. When the user operates through the sensing area of ​​the frame, the display area will display the operation results in real time. The steering wheel 20 is located in front of the display device 10 and is the main operating component for the user. The position of the steering wheel 20 affects the general position of the user's hands in the driving state, thereby jointly realizing vehicle control and information interaction. The user's hand 30 indicates the position and movement of the user's hand during the interactive operation, showing how the main driver can realize various functional operations and controls by touching different areas of the frame.

[0040] Figure 2 In the embodiment, the frame module of the display device 10 includes a top frame 101, side frames 102, a bottom frame 103, and a sensing area 101a of the top frame 101, a sensing area 102a of the side frames 102, and a sensing area 103a of the bottom frame. The display screen module of the display device 10 includes a display area 104.

[0041] The border module in the embodiment of the present application is used to form a display device together with the display screen module, and the border module includes a border and a sensing device integrated in at least one of the borders; the sensing device is used to sense user interaction operations in the sensing area formed by the sensing device on the border module.

[0042] The frame of the frame module is a frame adjacent to the outer edge of the display screen module and is used to fix and decorate the display screen module.

[0043] The sensing device is integrated into the frame of the frame module. It can be an infrared sensor or a pressure sensor, etc. These sensors can detect the user's touch or pressure operation on the frame. The sensing device is used to sense user interaction operations within the sensing area formed by the sensing device on the frame module.

[0044] User interaction refers to operations performed by the user on the display device's frame module. The sensing areas 101a, 102a, and 103a formed by the sensing device on the frame module support different gestures and touch modes. Gestures include single-finger, double-finger, three-finger, and four-finger gestures, and touch modes include single, double, triple, long press, flick, and swipe.

[0045] Specifically, the frame module is used to form a display device with the display screen module, and the frame module includes a frame and a sensing device integrated in at least one frame. The sensing device is used to sense the user interaction operation in the sensing area formed by the sensing device on the frame module. It can be seen that the sensing areas 101a, 102a, and 103a formed by the sensing device on the frame module in this embodiment are not connected to the display area 104 of the display screen module, that is, the sensing area on the frame module is physically independent of the display area of ​​the display screen module, that is, the sensing area on the frame module is physically separated from the display screen module, rather than integrated together, and the sensing area does not cover the display area of ​​the display screen. In this way, the sensing area on the frame module provides the user with an additional interactive interface, allowing the user to control the function by touching the frame in the frame module. The user can jump out of the screen and use the frame outside the screen to reduce screen light pollution while quickly controlling the function without relying on the visual feedback of the display area, facilitating the user's blind operation and improving the convenience and safety of operation.

[0046] In some embodiments, the frame integrated with the sensing device includes at least one of a side frame located on the side of the display screen module, a top frame located on the top surface of the display screen module, and a bottom frame located on the bottom surface of the display screen module.

[0047] like Figure 2 As shown, there is a top frame 101 on the top surface of the display module, a side frame 102 on the side of the display module, and a bottom frame 103 on the bottom surface of the display module. Top frame 101, side frame 102, and bottom frame 103 all serve as supporting structures and decorative elements, and are integrated with interactive functions to allow the driver to operate.

[0048] Specifically, the bezels integrated with the sensing device include at least one of a side bezel located on the side of the display module, a top bezel located on the top surface of the display module, and a bottom bezel located on the bottom surface of the display module. The side bezels may be at least one of a left side bezel and a right side bezel. Because there are multiple bezels integrated with the sensing device, the sensing area of ​​the bezels can be fully utilized, and functions can be combined, facilitating the operation and control of multiple functions.

[0049] It is worth noting that the border-based interaction method can flexibly select different positions such as side borders, bottom borders, top borders, etc. according to actual needs, further enhancing the user experience.

[0050] In one specific embodiment, using the top frame as an example, a user who encounters a beautiful scene while driving alone can quickly activate the dashcam's automatic capture feature by performing a multi-finger double-tap on the sensing area of ​​the top frame. The user can then disable the feature by performing a multi-finger double-tap again, and the captured video clip will be automatically saved locally for later use.

[0051] While driving, users have an urgent need to record the scenery along the way or quickly activate car functions such as air purification and nap mode. Since it's difficult for users to take their hands off the steering wheel for even a short period of time, the interactive method of double-clicking the top bezel to activate preset functions is particularly convenient, helping to minimize the risk of driver distraction and enabling quick, blind operation, further enhancing the user experience.

[0052] In some embodiments, the sensing device includes at least one of a pressure sensor, an infrared sensor, and a capacitive sensor.

[0053] Specifically, the sensing device includes at least one of a pressure sensor and an infrared sensor. As a preference in this embodiment, the pressure sensor is selected to reduce costs.

[0054] In some embodiments, for a frame integrated with the sensing device, a frame area in the sensing area and other frame areas in the frame have different visual effects and / or tactile effects.

[0055] Among them, the other border areas are non-sensing areas in the border, that is, areas that cannot sense user operations.

[0056] Among them, the visual effect can be color, and the tactile effect can be material or craftsmanship.

[0057] Specifically, for the frame integrated with the sensing device, the visual effects and / or tactile effects of the frame area in the sensing area and other frame areas in the frame enable the user to accurately perceive the sensing area when interacting with the frame, thereby improving operational efficiency.

[0058] In some embodiments, the border is processed with a material to distinguish the visual effect and / or tactile effect of the border area from other border areas.

[0059] In some embodiments, the material processing includes color, material, and finish (CMF) material processing. CMF material processing is a method involving color, material, and finish surface treatment technology. It can "add" or "subtract" the material surface through different process methods to produce different visual and tactile effects.

[0060] Specifically, this can be achieved by using different colors, materials, and surface treatment processes. For example, different surface treatment processes can be used, such as painting, powder coating, coating, anodizing, vacuum plating, etc. in the coating process, and grinding, polishing, sandblasting, etching, etc. in the removal process. Through these processes, the frame can be specially processed to make it tactilely different from its ordinary areas, so that the user can identify which areas have touch functions, that is, to distinguish which areas on the frame have sensing components and which areas do not. It can be understood that in this embodiment, by processing the material of the frame, compared with the traditional technology of splicing different components or multiple embedded processes, not only can material processing be performed on the one-piece frame, but it also greatly saves costs and achieves low-cost control.

[0061] The above-mentioned frame module is used to form a display device with the display screen module. The frame module includes a frame and a sensing device integrated in at least one frame. The sensing device is used to sense the user's interactive operation in the sensing area formed by the sensing device on the frame module. The sensing area formed by the sensing device on the frame module in this embodiment is not connected to the display area of ​​the display screen module. In this way, the sensing area on the frame module provides an additional interactive interface for the user, allowing the user to control the function by touching the frame in the frame module. The user can jump out of the screen and use the frame outside the screen to reduce light pollution of the screen while quickly controlling the function without relying on the visual feedback of the display area, which facilitates the user's blind operation and improves the convenience and safety of operation.

[0062] See also Figure 2 In one embodiment, a display device is provided, including a display screen module and the frame module in the above embodiment.

[0063] Specifically, the display device 10 includes a frame module and a display screen module. Since the frame module enables the user to control functions by touching the frame in the frame module, the user can jump out of the screen and use the frame outside the screen to reduce screen light pollution while quickly controlling functions without relying on visual feedback from the display area, which facilitates blind operation by the user, thereby improving the convenience and safety of operating the display device.

[0064] See also Figure 3 In one embodiment, a device control system of a target device is proposed, comprising the display device and the controller in the above embodiment; the border module of the display device is used to perceive the user interaction operation on the border module; and the controller is used to control the target function of the target device based on the user interaction operation perceived by the border module.

[0065] The controller can be an in-vehicle controller. The target device can be a vehicle. The target function refers to a control function on the target device that matches the user interaction operation, such as the target device's volume adjustment function, air conditioning adjustment function, image screenshot function, seat angle adjustment function, application switching, and customized quick vehicle control functions. Users can also customize the correspondence between user interaction operations and control functions. When a pressure operation or sliding operation that meets preset conditions is detected on the border module, the corresponding control function is triggered.

[0066] Different user interaction operations and corresponding functions can be pre-bound and stored in the memory of the device control system. The controller 160 determines the matching target function according to the received user interaction operation and controls the target function of the target device.

[0067] Specifically, the frame module of the display device 10 is used to sense user interaction operations on the frame module and transmit them to the controller. The controller 160 identifies the user's intention based on the user interaction operation and executes the corresponding control command to control the target function of the target device. The device control system allows the user to interact with the target device without directly operating the display area of ​​the display screen module to achieve the target function of the target device. Since the function operation is performed on the frame, there is no need to rely on the display screen module. Quick control can be performed when the screen is off or in the screen saver state, reducing light pollution and improving the convenience of controlling the function of the target device.

[0068] In some embodiments, the controller is used to control the target function of the target device based on the user interaction operation perceived by the border module, including: the controller is used to determine the target function of the target device based on the user interaction operation perceived by the border module; the controller is used to execute the target function.

[0069] Specifically, different user interaction operations are equipped with corresponding control functions. The controller determines the target function of the target device corresponding to the user interaction operation based on the user interaction operation perceived by the border module, and executes the target function, thereby realizing the functions required for the quick operation.

[0070] In some embodiments, the frame module of the display device is used to sense user interaction operations on the frame module, including: a sensing device in the frame module, used to sense touch signals of user interaction operations.

[0071] Specifically, the sensing device is used to sense the touch signal generated by the user's interactive operation on the border module, and can transmit the touch signal to the controller for further processing. The controller analyzes the touch signal based on the signal perception and processing algorithm to determine the target function of the user's interactive operation. Since the touch signal is analyzed, the accuracy of the target function can be ensured.

[0072] In some embodiments, the controller is used to determine the target function of the target device based on the user interaction operation perceived by the border module, including: the controller is used to determine the operation gesture and touch method of the target user based on the touch signal of the user interaction operation perceived by the border module; the controller is used to determine the target function of the target device according to the operation gesture and touch method.

[0073] Gestures and touch methods are a series of actions performed on a touch interface using a finger or stylus, which can be recognized and translated into specific commands or functions. Gestures can be single-, double-, three-, or four-finger gestures, and touch methods can include single tap, double tap, triple tap, long press, flick, swipe, and other interaction methods.

[0074] The sensing areas of the top frame, side frame, and bottom frame can be bound to corresponding control functions. When the target user's operation gestures and touch methods, such as up and down sliding operation gestures, are recognized, the preset function adjustments are executed.

[0075] Specifically, the controller determines the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the frame module, and then identifies the target function that the target user wants to execute.

[0076] It's worth noting that the controller can automatically adjust preset control functions (such as the brightness adjustment function of the display module) and can also display the adjustment process on the display area corresponding to the position of the sensing area. Adjustment is not limited to specific sliding gestures, and can support single-finger, two-finger, and multi-finger sliding, up and down, flicking, etc., and is not limited to sliding with the pads or backs of the fingers.

[0077] In one example, taking the left border of the screen near the main driver's seat as an example, if it is set to slide to adjust the screen brightness, when the user drives the vehicle into dim scenes such as tunnels, in order to reduce light pollution, the display module automatically reduces the screen brightness, and the specific reduced brightness value is displayed on the left side of the screen. If the screen brightness still does not meet the requirements, the user does not need to tilt his head, just slide up and down on the left border of the screen to complete the brightness adjustment, or slide to the bottom to turn off the screen directly to minimize light pollution. Similarly, the sliding gesture can be set to control the air volume and temperature of the air conditioner. The sliding gesture can also be set to functions such as parking vision.

[0078] In another example, sliding interaction can also control system-level operations. Taking the bottom border as an example, you can slide the bottom border of the screen to quickly switch between different applications. Swipe right to switch to the historically opened application, and swipe left to switch to the most recently opened application.

[0079] In some embodiments, the controller is used to determine the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the border module, including: the controller determines the operation gesture and the touch mode according to the position of the sensing area and the touch signal.

[0080] The position of the sensing area refers to the touch position of a frame in the frame module by the target user, for example, a touch position on the sensing area of ​​the side frame, that is, the position of the sensing area can determine which frame the touch operation is based on.

[0081] Specifically, the controller may determine the operation gesture and touch mode according to the position of the sensing area and the touch signal.

[0082] In some embodiments, the controller identifies the touch position, touch direction, and touch speed of the target user based on the position of the sensing area and the touch signal; and determines the operation gesture and the touch mode based on the touch position, touch direction, and touch speed of the target user.

[0083] Specifically, the controller identifies the touch position, touch direction and touch speed of the target user based on the position of the sensing area and the touch signal, and determines the operation gesture and touch mode based on the touch position, touch direction and touch speed of the target user. Since the analysis is based on the touch position, touch direction and touch speed of the target user, the accuracy of determining the operation gesture and touch mode can be improved.

[0084] In one embodiment, Figure 4 As shown in the figure, the flowchart of the border sliding gesture interaction is as follows:

[0085] S200: The user touches and slides a finger on the sensing area of ​​the side frame of the central control screen (such as the sensing area 102a of the side frame).

[0086] S201: The sensing area 102a of the side frame detects a touch position and activates a sensing device to continuously monitor subsequent changes in the touch position.

[0087] S202: The sensing device determines whether the touch position change value in a short period of time is less than a threshold.

[0088] S203: If the touch position change value is greater than or equal to the threshold, detect the touch position change direction and speed.

[0089] S204: Execute the currently preset function adjustment based on the direction and speed of the touch position change. For example, if the sliding border is set to brightness adjustment, sliding upward increases the screen brightness, and sliding downward decreases the screen brightness; the faster the sliding speed, the faster the brightness changes.

[0090] S205: If the touch position change value is less than the threshold, a long press event is triggered, and the display area 104 of the display device 10 displays a function list of switching sliding adjustment preset functions, including controlling screen brightness, air conditioning volume, temperature, driving field of view, etc.

[0091] S206: Continue sliding up and down without releasing the touch, detect the direction and speed of the touch position change, switch the preset function bound to the screen border sliding, and the function list is displayed in a loop, and only one function can be selected at a time.

[0092] S207: The finger is released from contact with the screen border, which means that the currently highlighted function is selected and the switch is completed. The display area 104 of the display device 10 retracts the function list. Sliding the side border again will adjust the selected new function.

[0093] In one embodiment, Figure 5 The following is a flowchart of the border tap gesture interaction. The specific steps are as follows:

[0094] S300: The user touches the sensing area of ​​the top frame of the display device (such as the sensing area 101a of the top frame) with one finger, two fingers, or multiple fingers, and then lifts the fingers.

[0095] S301: The sensing area 101a of the top frame monitors the occurrence of the first touch event in real time, and activates the sensing device to continuously monitor subsequent tapping events.

[0096] S302: The sensing device determines whether a second touch event is detected within a preset short time.

[0097] S303: If a second touch event is not detected within a short period of time, the first tap event with a single finger, two fingers, or multiple fingers is responded to and the corresponding preset function is executed. For example, in the screenshot function, each triggering requires a response to the screenshot event; while the mute function has a reversible property of on and off. Therefore, when the user triggers the same interaction event again, the opposite operation is performed, that is, the first tap responds to the on event, and the second tap responds to the off event, thus achieving a cyclic operation of the function.

[0098] S304: If a second touch event is detected within a short period of time, a second tap event of a single finger, two fingers or multiple fingers is responded to, and a corresponding response is also performed according to the preset function attributes. This process is the same as step S303.

[0099] It can be understood that in this embodiment, the detection of the slap gesture and the response to the corresponding function can be achieved without the need for an embedded acceleration sensor or electronic gyroscope, thereby providing an efficient and low-cost function call and safe interaction method.

[0100] In some embodiments, the controller is used to determine the target function of the target device based on the operation gesture and touch method, including: determining the target function corresponding to the operation gesture and touch method based on the correspondence between the preset operation gesture and touch method and the control function of the target device.

[0101] Specifically, the operation gesture and touch mode can be pre-bound to the control function of the target device to form a correspondence between the preset operation gesture and touch mode and the control function of the target device. Therefore, in the correspondence between the operation gesture and touch mode and the control function of the target device, the control function mapped by the operation gesture and touch mode is determined as the target function, so that the target function can be quickly determined for subsequent execution of the target function.

[0102] In some embodiments, the controller is further configured to output feedback information of a preset mode when detecting that the target function is successfully executed.

[0103] In some embodiments, the preset mode includes an auditory mode and / or a visual mode. For example, it can be a preset sound effect,

[0104] Specifically, when the controller detects that the target function is successfully executed, it can output feedback information in a preset mode to assist in sound feedback. Multi-channel feedback of the border module interaction is realized. Compared with the existing border module interaction without feedback, the border that can perceive the interaction has different tactile feedback, and the user can clearly identify it without visual participation. In this embodiment, by combining tactile feedback with auditory feedback, the user can accurately operate and judge whether the function is successfully executed even when the screen display cannot be directly observed, thereby improving the convenience and safety of operating functions while driving. It also combines real-time sound effects to feedback the effectiveness of the operation, reduce visual dependence, and achieve fast blind operation.

[0105] In some embodiments, the controller is further configured to control a display area of ​​the display device to display an execution result of the target function.

[0106] Specifically, the controller is responsible for not only recognizing user gestures and touch patterns to determine the desired function, but also providing feedback to the user on the results of these functions. This feedback is achieved through the display area. For example, if a user adjusts the screen brightness through a touch gesture on the bezel module, the controller adjusts the brightness and displays the new brightness level on the screen, allowing the user to instantly see the effect of the operation, making the execution of the target function more intuitive and enhancing the user experience.

[0107] In some embodiments, the controller is further configured to display an execution process of the target function in a display area of ​​the display device when the target function is executed.

[0108] Specifically, when executing the target function, the controller displays the execution process of the target function on the display area controller of the display device, which not only improves the user experience, but also increases the transparency and safety of the operation. At the same time, it also helps users learn and adapt to the functions of the device, and further improves the accuracy of the operation.

[0109] In some embodiments, the controller is configured to control a target function of the target device based on a user interaction operation sensed by a bezel module when the display area of ​​the display apparatus is in an inactive display state.

[0110] Among them, the inactive display state can be that the display area of ​​the display device is in a screen saver or screen off state, which can reduce the heat generated by the display device, improve the performance of the sensing device, and thereby improve the stability and sensitivity of the frame module interaction.

[0111] Specifically, when the display area of ​​the display device is in an inactive display state, the target function of the target device is controlled based on the user interaction operation perceived by the border module, thereby completely getting rid of the interaction of the border module from the screen display. The operation function can still be triggered in the screen saver or off state, and the heat generation and light pollution of the display device are also reduced.

[0112] In some embodiments, the system further includes: at least one functional module, each of the functional modules is communicatively connected to the controller, and each of the functional modules corresponds to at least one of the target functions.

[0113] The functional module is a component within the device control system that is used to execute specific operations corresponding to gestures and touch modes performed by the user via the sensing device on the frame module. The functional module is in communication with the controller to receive instructions from the controller and execute corresponding functions. In some embodiments, the functional module includes at least one of the air conditioning function module, the seat function module, the sound function module, and the photography function module in the target device.

[0114] Specifically, each functional module is communicatively connected to the controller, and each functional module corresponds to at least one target function to execute the corresponding target function.

[0115] In one embodiment, Figure 3Figure 1 shows the structure of the device control system. Controller 160 is the center of cabin information processing and function control. It collects signal data from relevant cabin sensors, pre-processes it using algorithms, identifies operational intent, connects various functional modules, distributes the processed information, and controls the corresponding modules to perform specific functions.

[0116] The display device 10 is used to display interactive interface information, which is controlled by the on-screen display control unit 113. The on-screen touch sensing unit 112 is used to realize touch interaction within the screen, which is the main way of display screen interaction. Due to the limitations of on-screen interaction, a sensing device 111 is arranged at the border of the display screen to sense the user's touch operation on the border. After the sensing device 111 senses the touch signal, it transmits the signal to the controller 160 for further processing. The controller 160 identifies the specific touch position, touch direction and touch speed based on the signal perception and processing algorithm, and determines the corresponding response event, and then transmits the result to different functional modules to perform specific functions. The on-screen display control unit 113 can also continuously adjust the screen brightness, and can associate the touch operation of the screen border with the brightness adjustment. The user can quickly adjust the brightness by sliding the border.

[0117] The in-vehicle image 120 is used to record the environment and vehicle conditions outside the vehicle in real time. Currently, in-vehicle images can automatically record driving records in real time. However, when encountering unexpected situations or special scenery outside the vehicle, users often want to record them immediately or quickly transfer them to their mobile phones. To meet this need, a border-based image control function is proposed. The user's touch operation on the screen border is linked to the image control unit 121, and the in-vehicle image recording can be turned on and off through blind operation of the border.

[0118] The in-vehicle air conditioning system 130 controls the temperature and air volume inside the vehicle, primarily comprising a temperature control unit 131 and an air volume control unit 132. Current in-vehicle air conditioning is a common function, requiring frequent adjustments. Current methods rely primarily on touchscreen controls, which can obstruct visual access and compromise driving safety. Therefore, a new air conditioning adjustment method based on border interaction links user touch controls on the screen border with temperature and air volume, enabling rapid adjustment of the air conditioner through blind interactions such as sliding the border.

[0119] Similar to the air conditioning control function, adjustments to the seat 140 and sound 150 can control seat massage, angle control, and volume, respectively, specifically through the massage control unit 141, angle control unit 142, and volume control unit 151. Seat and volume control are also common in-vehicle functions, so the present invention also interacts with the screen frame to execute functions such as turning seat massage on and off and continuously adjusting the volume based on the processing results of the vehicle controller.

[0120] The target device includes a device control system, a display device, and a controller. The display device's bezel module is configured to sense user interactions on the bezel module. The controller is configured to control the target function of the target device based on the user interactions sensed by the bezel module. This device control system allows users to interact with the target device and control the target function without directly manipulating the display area of ​​the display module. Because function operations are performed within the bezel, without relying on the display module, quick control is possible even when the screen is off or in screen saver mode, reducing light pollution and improving the convenience of controlling the target device's functions.

[0121] In one embodiment, a target device is provided, comprising the device control system in the above embodiment.

[0122] Specifically, the target device includes a bezel module. By interacting with the sensing area on the bezel, users can control the device more intuitively and conveniently, eliminating the need for complex operation procedures and improving the user experience. This target device with bezel touch functionality can provide a richer, more intuitive, and safer interaction method, while also improving device durability and energy efficiency, enhancing the user experience.

[0123] In some embodiments, the target device comprises a vehicle.

[0124] Specifically, since the target vehicle includes a frame module, it is convenient for users to perform blind operations in driving scenarios. The visual stage, behavioral stage and feedback stage can be completed within a few seconds, reducing user driving distraction problems, improving driving safety and the convenience of operating functions.

[0125] like Figure 6 As shown, in one embodiment, a control method is proposed, which is applied to the target device in the above embodiment. The control method specifically includes the following steps.

[0126] Step S10 : controlling a target function of the target device according to a user interaction operation sensed by a display device in the target device based on a frame module.

[0127] Specifically, the target function of the target device is controlled based on the user interaction operation perceived by the frame module. This allows the user to interact with the target device without directly operating the display area of ​​the display module to achieve the target function of the target device. Since the function operation is performed in the frame, there is no need to rely on the display module. Quick control can be performed even when the screen is off or in the screen saver state, reducing light pollution and improving the convenience of controlling the function of the target device.

[0128] In some embodiments, controlling the target function of the target device based on the user interaction operation perceived by the border module according to the display device in the target device includes: determining the target function of the target device based on the user interaction operation perceived by the border module; and controlling the target function.

[0129] In some embodiments, determining the target function of the target device based on the user interaction operation perceived by the border module includes: determining the operation gesture and touch method of the target user based on the touch signal of the user interaction operation perceived by the border module; and determining the target function of the target device according to the operation gesture and touch method.

[0130] In some embodiments, determining the operation gesture and the touch mode based on the position of the sensing area and the touch signal includes: identifying the touch position, touch direction and touch speed of the target user based on the position of the sensing area and the touch signal; determining the operation gesture and the touch mode based on the touch position, touch direction and touch speed of the target user.

[0131] In some embodiments, controlling the target function of the target device according to the user interaction operation perceived by the display device in the target device based on the border module includes: when the display screen module of the display device is in an inactive display state, controlling the target function of the target device according to the user interaction operation perceived by the display device in the target device based on the border module.

[0132] Based on the same inventive concept, this application also provides a control device for implementing the control method involved in the above-mentioned embodiment where a computer device is the execution subject. The implementation solution provided by this device is similar to the implementation solution described in the above-mentioned method. Therefore, the specific limitations in one or more control device embodiments provided below can be referred to the limitations of the control method involved in the embodiment where a computer device is the execution subject above, and will not be repeated here.

[0133] In some embodiments, as Figure 7 As shown, a control device is provided, comprising:

[0134] The control module 701 is configured to control a target function of the target device according to a user interaction operation sensed by a display device in the target device based on a frame module.

[0135] In some embodiments, the control module 701 is specifically configured to: determine a target function of the target device based on the user interaction operation perceived by the frame module; and control the target function.

[0136] In some embodiments, the control module 701 is further used to: determine the operation gesture and touch mode of the target user based on the touch signal of the user interaction operation sensed by the frame module; and determine the target function of the target device according to the operation gesture and touch mode.

[0137] In some embodiments, the control module 701 is further configured to determine the operation gesture and the touch mode according to the position of the sensing area and the touch signal.

[0138] In some embodiments, the control module 701 is further specifically used to: when the display screen module of the display device is in an inactive display state, control the target function of the target device according to the user interaction operation perceived by the display device in the target device based on the border module.

[0139] Each module in each of the above devices may be implemented in whole or in part through software, hardware, or a combination thereof. Each of the above modules may be embedded in or independent of the processor in the control device in hardware form, or may be stored in a memory in a computer device in software form, so that the processor can call and execute the corresponding operations of each of the above modules.

[0140] In some embodiments, a computer device is provided, whose internal structure diagram can be as follows: Figure 8 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a control method is implemented.

[0141] Optionally, the computer device further includes a display unit. The display unit of the computer device is used to produce a visually visible image and may be a display screen, a projection device, or a virtual reality imaging device. The display screen may be a liquid crystal display or an electronic ink display screen. The input device of the computer device may be a touch layer covering the display screen, a keypad, a trackball, or a touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse.

[0142] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the control device to which the scheme of the present application is applied. The specific control device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0143] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. For purposes of illustration and not limitation, RAM may be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The processors involved in the various embodiments provided herein may be general-purpose processors, central processing units (CPUs), graphics processors (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), data processing logic devices based on quantum computing, and the like, without limitation thereto.

[0144] Correspondingly, an embodiment of the present application further provides a computer device, which may be a terminal device or a server.

[0145] like Figure 8 As shown, Figure 8A schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device 1000 includes a processor 1001 having one or more processing cores, a memory 1002 having one or more computer-readable storage media, and a computer program stored in the memory 1002 and executable on the processor. The processor 1001 is electrically connected to the memory 1002. Those skilled in the art will appreciate that the computer device structure shown in the figure does not constitute a limitation of the computer device, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0146] The processor 1001 is the control center of the computer device 1000. It connects the various parts of the entire computer device 1000 using various interfaces and lines. By running or loading software programs and / or units stored in the memory 1002 and calling data stored in the memory 1002, it executes various functions of the computer device 1000 and processes data, thereby monitoring the computer device 1000 as a whole. The processor 1001 can be a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc., and can implement or execute the various methods, steps, and logic blocks disclosed in the embodiments of this application.

[0147] In the embodiment of the present application, the processor 1001 in the computer device 1000 will load instructions corresponding to one or more application processes into the memory 1002 according to the following steps, and the processor 1001 will run the application stored in the memory 1002 to implement various functions, such as controlling the target function of the target device based on the user interaction operation perceived by the display device of the target device based on the frame module. The specific implementation of each of the above operations can be found in the previous embodiment and will not be repeated here.

[0148] Alternatively, as Figure 8 As shown, the computer device 1000 further includes: a touch screen 1003, a radio frequency circuit 1004, an audio circuit 1005, an input unit 1006, and a power supply 1007. Among them, the processor 1001 is electrically connected to the touch screen 1003, the radio frequency circuit 1004, the audio circuit 1005, the input unit 1006, and the power supply 1007 respectively. It can be understood by those skilled in the art that Figure 8 The computer device structure shown in the figure does not constitute a limitation to the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0149] The touch display screen 1003 can be used to display a graphical user interface and receive user actions on the operation instructions generated by the graphical user interface. The touch display screen 1003 can include a display panel and a touch panel. Among them, the display panel can be used to display the information input by the user or the information provided to the user and various graphical user interfaces of the computer device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light emitting diode (OLED), etc. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or accessory such as a finger, a stylus on the touch panel or near the touch panel) and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 1001, and can receive commands sent by the processor 1001 and execute them. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1001 to determine the type of touch event, and then the processor 1001 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1003 to realize input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize input and output functions. That is, the touch display screen 1003 can also be used as part of the input unit 1006 to realize the input function.

[0150] The RF circuit 1004 may be used to transmit and receive RF signals, thereby establishing wireless communication with a network device or other computer device through wireless communication, and transmitting and receiving signals between the network device or other computer device.

[0151] Audio circuit 1005 can be used to provide an audio interface between the user and the computer device through a speaker and microphone. Audio circuit 1005 can convert received audio data into electrical signals and transmit them to the speaker, which then converts them into sound signals for output. The microphone, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 1005 and converted into audio data. The audio data is then output to processor 1001 for processing, and then transmitted via RF circuit 1004 to, for example, another computer device. Alternatively, the audio data can be output to memory 1002 for further processing. Audio circuit 1005 may also include an earphone jack to allow communication between external headphones and the computer device.

[0152] The input unit 1006 may be configured to receive input digital, character information, or user feature information (such as fingerprint, iris, or facial information), and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control.

[0153] Power supply 1007 is used to supply power to various components of computer device 1000. Optionally, power supply 1007 can be logically connected to processor 1001 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. Power supply 1007 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0154] although Figure 8 Not shown in the figure, the computer device 1000 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0155] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0156] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0157] To this end, embodiments of the present application provide a computer-readable storage medium storing a plurality of computer programs capable of being loaded by a processor to execute any of the control methods provided in the embodiments of the present application. The computer program can execute the following control method steps: determining a first directional control variable for a vehicle; performing directional coupling control processing based on the first directional control variable to obtain a second directional control variable for the vehicle; and directional controlling the vehicle based on the first and second directional control variables. The specific implementation of each of the above operations can be found in the previous embodiments and will not be repeated here.

[0158] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0159] Since the computer program stored in the computer-readable storage medium can execute any one of the control methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the control methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0160] According to one aspect of the present application, a computer program product or computer program is also provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations of the above embodiments.

[0161] In the above-described embodiments of the vehicle lateral and longitudinal control device, computer-readable storage medium, computer device, and computer program product, the descriptions of each embodiment have different focuses. For portions not described in detail in a particular embodiment, reference can be made to the relevant descriptions of other embodiments. Those skilled in the art will clearly understand that, for ease and brevity of description, the specific operating processes and beneficial effects of the above-described vehicle lateral and longitudinal control device, computer-readable storage medium, computer program product, computer device, and their corresponding units can be referred to in the description of the control method in the above embodiments, and the details will not be repeated here.

[0162] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0163] The above are only preferred embodiments of the present application and do not constitute any form of limitation to the present application. Although the descriptions of each embodiment in the embodiments of the present application have different focuses, for parts that are not described in detail in a certain embodiment, please refer to the relevant embodiments of other embodiments. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. A frame module, characterized in that: The frame module is used to form a display device with the display screen module, and the frame module includes a frame and a sensing device integrated in at least one of the frames; The sensing device is used to sense user interaction operations in a sensing area formed by the sensing device on the frame module.

2. The module according to claim 1, characterized in that For the frame integrated with the sensing device, the frame area in the sensing area and other frame areas in the frame have different visual effects and / or tactile effects.

3. The module according to claim 2, characterized in that The border is processed by material to distinguish the visual effect and / or tactile effect of the border area from other border areas.

4. The module according to claim 3, characterized in that The material processing includes material processing of color, material and process.

5. The module according to claim 1, characterized in that The sensing device includes at least one of a pressure sensor, an infrared sensor and a capacitive sensor.

6. The module according to claim 1, characterized in that The frame integrated with the sensing device includes at least one of a side frame located on the side of the display screen module, a top frame located on the top surface of the display screen module, and a bottom frame located on the bottom surface of the display screen module.

7. A display device, characterized in that: The display device includes a display screen module and a frame module according to any one of claims 1 to 6.

8. A device control system for a target device, characterized in that: comprising the display device and the controller as claimed in claim 7; The frame module of the display device is used to sense user interaction operations on the frame module; The controller is used to control a target function of the target device based on a user interaction operation sensed by the frame module.

9. The system according to claim 8, characterized in that The controller is used to control a target function of the target device based on a user interaction operation sensed by the frame module, including: The controller is used to determine the target function of the target device based on the user interaction operation perceived by the frame module; The controller is configured to execute the target function.

10. The system according to claim 8, wherein: The frame module of the display device is used to perceive user interaction operations on the frame module, including: The sensing device in the frame module is used to sense touch signals of user interaction operations.

11. The system according to claim 10, wherein: The controller is used to determine a target function of the target device based on the user interaction operation sensed by the frame module, including: The controller is used to determine the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the frame module; The controller is used to determine the target function of the target device according to the operation gesture and touch mode.

12. The system according to claim 11, wherein: The controller is used to determine the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the frame module, including: The controller determines the operation gesture and the touch mode according to the position of the sensing area and the touch signal.

13. The system according to claim 12, wherein: The controller determines the operation gesture and the touch mode according to the position of the sensing area and the touch signal, including: The controller identifies the touch position, touch direction, and touch speed of the target user according to the position of the sensing area and the touch signal; The operation gesture and the touch mode are determined according to the touch position, touch direction and touch speed of the target user.

14. The system according to claim 12, wherein: The controller is configured to determine a target function of the target device according to the operation gesture and the touch mode, including: The target function corresponding to the operation gesture and touch mode is determined according to the correspondence between the preset operation gesture and touch mode and the control function of the target device.

15. The system according to claim 9, wherein: The controller is further configured to output feedback information of a preset mode when detecting that the target function is successfully executed.

16. The system according to claim 15, characterized in that The preset mode includes an auditory mode and / or a visual mode.

17. The system according to claim 8, wherein: The controller is further configured to control the display area of ​​the display device to display the execution result of the target function.

18. The system according to claim 8, wherein: The controller is further configured to display an execution process of the target function in a display area of ​​the display device when the target function is executed.

19. The system according to claim 8, wherein: The controller is configured to control a target function of the target device based on a user interaction operation sensed by a frame module when the display area of ​​the display apparatus is in an inactive display state.

20. The system according to claim 8, wherein The system further comprises: At least one functional module, each of the functional modules is communicatively connected to the controller, and each of the functional modules corresponds to at least one target function.

21. The system according to claim 20, wherein: The functional module includes at least one of an air conditioning functional module, a seat functional module, a sound functional module, and a photography functional module in the target device.

22. A target device, characterized in that: Comprising the equipment control system according to any one of claims 8 to 21.

23. The target device according to claim 22, characterized in that The target device includes a vehicle.

24. A control method, characterized in that: Applied to the target device according to claim 22 or 23, the method comprises: According to the user interaction operation sensed by the display device in the target device based on the frame module, a target function of the target device is controlled.

25. The method according to claim 24, characterized in that The controlling the target function of the target device according to the user interaction operation sensed by the display device in the target device based on the frame module includes: Determining a target function of the target device based on the user interaction operation sensed by the frame module; The target function is controlled.

26. The method according to claim 25, characterized in that The determining of the target function of the target device based on the user interaction operation perceived by the border module includes: Determine the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the frame module; The target function of the target device is determined according to the operation gesture and the touch mode.

27. The method according to claim 26, characterized in that The step of determining the target user's operation gesture and touch mode based on the touch signal of the user interaction operation sensed by the frame module includes: The operation gesture and the touch mode are determined according to the position of the sensing area and the touch signal.

28. The method according to claim 27, characterized in that The determining the operation gesture and the touch mode according to the position of the sensing area and the touch signal includes: identifying the touch position, touch direction, and touch speed of the target user according to the position of the sensing area and the touch signal; The operation gesture and the touch mode are determined according to the touch position, touch direction and touch speed of the target user.

29. The method according to claim 24, wherein The controlling the target function of the target device according to the user interaction operation sensed by the display device in the target device based on the frame module includes: When the display screen module of the display device is in an inactive display state, the target function of the target device is controlled according to the user interaction operation sensed by the display device in the target device based on the frame module.

30. A computer device, characterized in that: It comprises a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the control method according to any one of claims 24 to 29.

31. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the control method according to any one of claims 24 to 29.

32. A computer program product, characterized in that The method comprises a computer program, wherein the computer program is used by a processor to execute the steps of the control method according to any one of claims 24 to 29.

Images