Control method and device for mobile terminal, medium and equipment

Abstract

The invention discloses a control method and device for a mobile terminal, a medium and equipment. The control method comprises the steps that current screen state information of a first display screen of the mobile terminal is determined; based on the current screen state information, determining a target touch window on a second display screen of the vehicle-mounted terminal and size information of the target touch window; in response to a received touch instruction for the target touch window, determining a second touch coordinate of the first touch coordinate mapped on the first display screen based on the first touch coordinate of the touch instruction, the size information of the target touch window and the current screen state information; and sending a touch instruction including the second touch coordinate to the mobile terminal to control the mobile terminal to execute the touch instruction at a position, corresponding to the second touch coordinate, on the first display screen. According to the scheme, the mobile terminal in different screen folding states can be accurately controlled in each screen rotation direction through the target touch window.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent vehicle technology, and in particular to a method, device, medium, and equipment for controlling a mobile terminal. Background Art

[0002] With the development of smart car technology, vehicles are becoming more and more widely used in people's daily lives. For example, when a user is driving, they can project the screen content of their mobile terminal to the car display screen through wired or wireless means.

[0003] Conventional screen projection solutions establish a touch coordinate system based on the fixed physical parameters of the mobile terminal screen (such as resolution and aspect ratio), allowing users to reversely control the mobile terminal interface through the vehicle touch screen. However, for mobile terminals with foldable screens, when the effective resolution changes due to folding or unfolding the screen, if the vehicle still uses the original coordinate parameters, the touch input will be misaligned with the screen display area.

[0004] Therefore, how to provide a control method for a mobile terminal with a foldable screen becomes an urgent problem to be solved. Summary of the Invention

[0005] In order to solve the above technical problems, the present disclosure provides a method, device, medium and equipment for controlling a mobile terminal to solve the problem of controlling a mobile terminal with a foldable screen.

[0006] In one aspect, a method for controlling a mobile terminal is provided, comprising:

[0007] Determining current screen status information of the first display screen of the mobile terminal;

[0008] Determining a target touch window on a second display screen of the in-vehicle terminal and size information of the target touch window based on the current screen state information;

[0009] In response to receiving a touch instruction for the target touch window, determining, based on first touch coordinates of the touch instruction, size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen mapped from the first touch coordinates;

[0010] A touch instruction including the second touch coordinates is sent to the mobile terminal to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

[0011] In another aspect, a device for controlling a mobile terminal is provided, comprising:

[0012] A first acquisition module, configured to determine current screen status information of a first display screen of the mobile terminal;

[0013] A first determining module is configured to determine a target touch window and size information of the target touch window on the second display screen of the vehicle-mounted terminal based on the current screen state information;

[0014] a second determining module configured to, in response to receiving a touch instruction for the target touch window, determine, based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information, second touch coordinates mapped to the first display screen by the first touch coordinates;

[0015] The first sending module is configured to send a touch instruction including the second touch coordinates to the mobile terminal, so as to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

[0016] In yet another aspect, an embodiment provides a computer program product. When an instruction processor in the computer program product executes, the method for controlling a mobile terminal provided in the embodiment of the first aspect of the present disclosure is executed.

[0017] On the other hand, an electronic device is proposed, which includes: a processor; a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the control method of the mobile terminal described in the first aspect above.

[0018] The present invention provides a method for controlling a mobile terminal. The method can determine the current screen state information of a first display screen of the mobile terminal and, based on the current screen state information, determine a target touch window and the size information of the target touch window on a second display screen of the vehicle-mounted terminal. In response to receiving a touch instruction for the target touch window, the method determines, based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen to which the first touch coordinates are mapped. The method then sends a touch instruction including the second touch coordinates to the mobile terminal to control the mobile terminal to execute the touch instruction at a location on the first display screen corresponding to the second touch coordinates. This method allows the target touch window on the second display screen to be accurately determined based on the current screen state information of the first display screen of the mobile terminal. Therefore, after receiving a touch instruction from a user for the target touch window, the method can accurately convert the first touch coordinates of the touch instruction into second touch coordinates on the second display screen based on the size information of the target touch window and the current screen state information. Furthermore, by sending the touch instruction including the second touch coordinates to the mobile terminal, the method can accurately control the mobile terminal to execute a touch operation at a location on the second display screen corresponding to the second touch coordinates. In this way, precise control of the mobile terminal in different screen folding states in various screen rotation directions can be achieved through the target touch window. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 FIG. 1 is a schematic diagram of a scenario for controlling a mobile terminal provided by an exemplary embodiment of the present disclosure.

[0020] Figure 2 It is a flowchart of a method for controlling a mobile terminal provided by an exemplary embodiment of the present disclosure.

[0021] Figure 3 It is a flowchart of a method for controlling a mobile terminal provided by another exemplary embodiment of the present disclosure.

[0022] Figures 4A to 4B A schematic diagram of a coordinate system provided by an exemplary embodiment of the present disclosure is shown.

[0023] Figure 5 It is a flowchart of a method for controlling a mobile terminal provided by another exemplary embodiment of the present disclosure.

[0024] 6A to 6D A schematic diagram of a coordinate system provided by an exemplary embodiment of the present disclosure is shown.

[0025] Figure 7 It is a flowchart of a method for controlling a mobile terminal provided by another exemplary embodiment of the present disclosure.

[0026] Figures 8A to 8BA schematic diagram of a coordinate system provided by an exemplary embodiment of the present disclosure is shown.

[0027] Figure 9 It is a structural diagram of a device for controlling a mobile terminal provided by an exemplary embodiment of the present disclosure.

[0028] Figure 10 is a structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] To explain the present disclosure, example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. It should be understood that the present disclosure is not limited to the example embodiments.

[0030] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0031] Application Overview

[0032] In traditional screen projection solutions, when projecting a single-screen mobile terminal to a vehicle computer, a touch coordinate system is established based on the fixed physical parameters of the mobile terminal screen (such as resolution and aspect ratio), allowing users to reversely control the mobile terminal screen through the vehicle computer touch screen. However, for mobile terminals with foldable screens, the effective display area changes when the screen switches from a semi-expanded state to a folded state, or when the mobile terminal screen switches from landscape to portrait. At this time, if the vehicle computer still uses the original coordinate parameters, the touch input from the vehicle computer will be mapped to inaccurate touch coordinates on the mobile terminal screen.

[0033] Based on the above technical problems, the control method for the mobile terminal provided by the embodiment of the present disclosure can determine the current screen status information of the first display screen of the mobile terminal, and based on the current screen status information, determine the target touch window and the size information of the target touch window on the second display screen of the vehicle-mounted terminal. In response to receiving a touch instruction for the target touch window, based on the first touch coordinates of the touch instruction and the size information of the target touch window and the current screen status information, determine the second touch coordinates mapped to the first display screen, and send a touch instruction including the second touch coordinates to the mobile terminal to control the mobile terminal to execute the touch instruction at the position corresponding to the second touch coordinates on the first display screen. This solution accurately determines the target touch window on the second display screen based on the current screen state information of the first display screen of the mobile terminal. Therefore, upon receiving a user's touch instruction in the target touch window, the first touch coordinates of the touch instruction can be accurately converted into second touch coordinates on the second display screen, combining the size information of the target touch window and the current screen state information. Furthermore, by sending a touch instruction including the second touch coordinates to the mobile terminal, the mobile terminal can be precisely controlled to perform a touch operation at the position corresponding to the second touch coordinates on the second display screen. In this way, precise control of the mobile terminal in various screen rotation directions in different screen folding states can be achieved through the target touch window.

[0034] Exemplary Systems

[0035] Figure 1 FIG. 1 is a schematic diagram of a scenario for controlling a mobile terminal provided by an exemplary embodiment of the present disclosure. Figure 1 As shown, it includes a mobile terminal 100 and an in-vehicle terminal 111 in the vehicle 100 .

[0036] For example, Figure 1 As shown in (a) of FIG, the first display screen 101 of the mobile terminal 100 is in a folded state and the current screen orientation is a forward-facing portrait orientation. A "Noontime News" pause interface is displayed on the first display screen 101. When the mobile terminal 100 and the vehicle-mounted terminal 111 have established a Bluetooth Serial Port Profile (SPP) serial port protocol, the current screen status information of the first display screen 101 can be sent to the vehicle-mounted terminal 111.

[0037] After the vehicle terminal 111 obtains the current screen status information of the first display screen 101, it can determine based on the current screen status information: Figure 1 FIG. 1 shows the target touch window 113 on the second display screen 112 and the size information of the target touch window 113 as shown in FIG. 1 . FIG.

[0038] For example, Figure 1As shown in (c), if the user clicks and inputs at point A of the target touch window 113, then in response to the click input, the second touch coordinates mapped to the first display screen 101 can be determined based on the first touch coordinates of the click input and the size information of the target touch window 113 and the current screen status information.

[0039] After the vehicle terminal 111 sends the touch command including the second touch coordinates to the mobile terminal 110, Figure 1 As shown in (a) of FIG. 1 , the mobile terminal 110 performs a click input at the location of point B corresponding to the second touch coordinate, so that the mobile terminal 110 responds to the click input at the location of point B, as shown in FIG. Figure 1 As shown in (b) in FIG. 1 , the first display screen 101 displays an interface in which “Midday News” is being played.

[0040] The control method for a mobile terminal provided by the embodiments of the present disclosure can accurately determine the target touch window on the second display screen based on the current screen state information of the first display screen of the mobile terminal. Therefore, after receiving a touch instruction from the user on the target touch window, the method can accurately convert the first touch coordinates of the touch instruction into second touch coordinates on the second display screen by combining the size information of the target touch window and the current screen state information. Then, by sending a touch instruction including the second touch coordinates to the mobile terminal, the method can accurately control the mobile terminal to perform a touch operation at the position corresponding to the second touch coordinates on the second display screen. In this way, it is possible to achieve precise control of the mobile terminal in different screen folding states in various screen rotation directions through the target touch window.

[0041] Exemplary Methods

[0042] Figure 2 This is a flow chart of a method for controlling a mobile terminal provided by an exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices such as Figure 2 As shown, the following steps are included:

[0043] Step 201: Determine current screen status information of a first display screen of a mobile terminal.

[0044] In the embodiments of the present disclosure, the mobile terminal may be a mobile terminal with a single screen or a mobile terminal with a foldable screen. In the case of a mobile terminal with a single screen, the first display screen is a fixed screen; in the case of a mobile terminal with a foldable screen, the first display screen is a foldable screen, for example, a double-folding screen or a triple-folding screen.

[0045] In some embodiments, the current screen state information of the first display screen may include the current screen orientation and current screen effective display size of the first display screen and current screen folding state information.

[0046] In some examples, the current screen direction is used to indicate the orientation of the current screen or the rotation angle of the current screen. For example, the current screen direction can be 0 degrees, 90 degrees, 180 degrees, or 270 degrees of rotation of the current screen.

[0047] In some examples, the current effective display size of the screen refers to the size information of the effective display area on the first display screen corresponding to the current screen folding state information, and the current effective display size of the screen includes the effective display width and the effective display height. It should be noted that the effective display area is the screen area on the first display screen that currently has display and touch capabilities.

[0048] In some examples, the above-mentioned current screen folding state information is the screen folding state of the first display screen at the current moment, and the current screen folding state information includes the first display screen being in a folded state, the first display screen being in a semi-expanded state, and the first display screen being in an expanded state.

[0049] In some embodiments, the above step 201 may specifically include: in response to a change in the screen status of the first display screen of the mobile terminal, obtaining updated current screen status information of the first display screen; wherein the change in screen status includes at least one of the following: a change in screen orientation, a change in screen folding status.

[0050] When the screen state of the first display screen changes, the mobile terminal sends updated current screen state information to the vehicle-mounted terminal, so that steps S201 and S202 can be continued, ie, rebuilding the target touch window on the second display screen.

[0051] In other embodiments, the above step 201 may specifically include: in response to the vehicle-mounted terminal and the mobile terminal having established a communication connection according to a preset protocol, obtaining current screen status information of the first display screen.

[0052] In some examples, the preset protocol may include a Bluetooth Serial Port Profile (SPP) protocol or a Bluetooth Generic Attribute Profile (GATT) low power protocol.

[0053] When the vehicle-mounted terminal and the mobile terminal have established a communication connection using a preset protocol, the vehicle-mounted terminal can receive the current screen status information of the first display screen sent by the mobile terminal.

[0054] Step 202 : Determine a target touch window and size information of the target touch window on the second display screen of the vehicle-mounted terminal based on the current screen state information.

[0055] In some embodiments, for different screen state information of the first display screen, the position and size information of the target touch window on the second display screen are also different. Therefore, after obtaining the current screen state information of the first display screen, the target touch window corresponding to the current screen state information and the size information of the target touch window can be determined. The size information of the target touch window includes the width and height of the target touch window.

[0056] In some embodiments, the target touch window may be highlighted on the second display screen, so that the user can easily determine the position of the target touch window and perform touch operations on the target touch window.

[0057] Exemplarily, the second display screen may be a central control screen.

[0058] Step 203 : In response to receiving a touch instruction for the target touch window, determining second touch coordinates mapped to the first touch coordinates on the first display screen based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information.

[0059] In some examples, the touch instruction to the target touch window is an instruction input by the user in the target touch window, for example, the touch instruction is a click input by the user in the target touch window, or a sliding input by the user in the target touch window. The embodiments of the present disclosure do not limit the type of touch instruction.

[0060] The target touch window on the second display screen can be regarded as a touch pad that can receive any type of touch input from the user. The user can perform touch operations on the first display screen of the mobile terminal by touch input on the target touch window, thereby achieving the purpose of remotely controlling the mobile terminal through the touch operation.

[0061] Step 204 : Sending a touch instruction including the second touch coordinates to the mobile terminal to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

[0062] For example, the touch instruction is a click operation. When a user performs a click operation on the first touch coordinate (300, 600) of the target touch window on the second display screen of the vehicle-mounted terminal, in response to the click operation, the first touch coordinate is converted to the second touch coordinate (450, 900) mapped on the first display screen. After the vehicle-mounted terminal sends a touch instruction including (450, 900) to the mobile terminal, the mobile terminal performs a click operation on the position corresponding to (450, 900) on the first display screen. The mobile terminal can then respond to the click operation on the position corresponding to (450, 900), thereby achieving control of the mobile terminal through the touch operation on the vehicle-mounted terminal.

[0063] The present invention provides a method for controlling a mobile terminal. The method can determine the current screen state information of a first display screen of the mobile terminal and, based on the current screen state information, determine a target touch window and the size information of the target touch window on a second display screen of the vehicle-mounted terminal. In response to receiving a touch instruction for the target touch window, the method determines, based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen to which the first touch coordinates are mapped. The method then sends a touch instruction including the second touch coordinates to the mobile terminal to control the mobile terminal to execute the touch instruction at a location on the first display screen corresponding to the second touch coordinates. This method allows the target touch window on the second display screen to be accurately determined based on the current screen state information of the first display screen of the mobile terminal. Therefore, after receiving a touch instruction from a user for the target touch window, the method can accurately convert the first touch coordinates of the touch instruction into second touch coordinates on the second display screen based on the size information of the target touch window and the current screen state information. Furthermore, by sending the touch instruction including the second touch coordinates to the mobile terminal, the method can accurately control the mobile terminal to execute a touch operation at a location on the second display screen corresponding to the second touch coordinates. In this way, precise control of the mobile terminal in different screen folding states in various screen rotation directions can be achieved through the target touch window.

[0064] like Figure 3 As shown, the current screen state information of the first display screen includes the current screen direction and the current screen effective display size of the first display screen and the current screen folding state information; in the above Figure 2 Based on the illustrated embodiment, step 202 may include the following steps:

[0065] Step 2021: Based on the current screen orientation and the current screen folding state information, determine a first touch coordinate system of the first display screen corresponding to the current screen state information.

[0066] Due to changes in screen orientation (for example, landscape or portrait), the first touch coordinate system of the first display screen of the mobile terminal will rotate, and since the effective display area is essentially the mapping area on the first display screen, when different screen folding states of the first display screen change the layout of the effective display area in the first display screen, the mapping area under the first touch coordinate system will change. Therefore, different screen orientations and screen folding state information correspond to different first touch coordinate systems of the first display screen, and thus based on the current screen orientation and the current screen folding state information, the first touch coordinate system of the first display screen corresponding to the current screen state information can be determined.

[0067] In some examples, a first touch coordinate system for the first display screen is typically constructed with the upper left corner of the first display screen as the coordinate origin, with the horizontal axis (x-axis) extending rightward from the coordinate origin and the vertical axis (y-axis) extending downward from the coordinate origin. When the screen orientation changes, the orientation of the coordinate system changes, meaning the first touch coordinate system changes.

[0068] For example, Figure 4A FIG. 1 shows a schematic diagram of a coordinate system provided by an exemplary embodiment of the present disclosure. Figure 4A As shown in (b) in FIG, when the current screen orientation is a positive vertical screen, that is, a rotation of 0 degrees, and the current screen folding state information indicates that the first display screen is in a fully folded state, the upper left corner of the first display screen is used as the coordinate origin, and the horizontal axis (x-axis) direction is extended to the right from the coordinate origin, and the vertical axis (y-axis) direction is extended downward from the coordinate origin to construct a first touch coordinate system, where 1110 is the effective display area in the first display screen; Figure 4A As shown in (c), when the current screen orientation is reverse portrait, that is, rotated 180 degrees clockwise, and the current screen folding state information is that the first display screen is in a fully folded state, the position of the upper left corner of the first display screen is changed to the position of the lower right corner, that is, the origin of the coordinate system needs to be rotated 180 degrees clockwise. Figure 4A The coordinate system shown in (b) is rotated 180 degrees clockwise to obtain the first touch coordinate system corresponding to the current screen direction and the current screen folding state information.

[0069] For example, Figure 4B FIG. 1 shows a schematic diagram of a coordinate system provided by an exemplary embodiment of the present disclosure. Figure 4B As shown in (b), when the current screen direction is the forward horizontal screen, that is, rotated 90 degrees counterclockwise, and the current screen folding state information is that the first display screen is in the fully folded state, the position of the upper left corner of the first display screen is changed to the position of the lower left corner, that is, the origin of the coordinate system needs to be rotated 90 degrees counterclockwise. Figure 4AThe coordinate system shown in (b) is rotated 90 degrees counterclockwise to obtain the first touch coordinate system corresponding to the current screen direction and the current screen folding state information; Figure 4B As shown in (c), when the current screen direction is reverse landscape, that is, rotated 270 degrees clockwise, and the current screen folding state information is that the first display screen is in a fully folded state, the position of the upper left corner of the first display screen is changed to the position of the lower left corner, that is, the origin of the coordinate system needs to be rotated 270 degrees counterclockwise. Figure 4A The coordinate system shown in (b) is rotated counterclockwise by 270 degrees to obtain the first touch coordinate system corresponding to the current screen direction and the current screen folding state information.

[0070] Step 2022: Based on the first touch coordinate system and the current screen direction, determine a second touch coordinate system of the second display screen that has a mapping relationship with the first touch coordinate system.

[0071] In some embodiments, based on the current screen orientation and the first touch coordinate system, the second touch coordinate system of the second display screen of the vehicle terminal is aligned with the first touch coordinate system to be in the same orientation. For example, if the first touch coordinate system is the coordinate system of the first display screen in landscape mode, the second touch coordinate system is also the coordinate system of the second display screen in landscape mode. For another example, if the first touch coordinate system is the coordinate system of the first display screen in portrait mode, the second touch coordinate system is also the coordinate system of the second display screen in portrait mode.

[0072] In some examples, after aligning the second touch coordinate system of the second display screen of the vehicle-mounted terminal with the first touch coordinate system in the same orientation, a second coordinate system is constructed based on the current screen orientation of the second display screen. In the current screen orientation, the second touch coordinate system of the second display screen is always taken as the coordinate origin, and the horizontal axis (x-axis) extending rightward from the coordinate origin and the vertical axis (y-axis) extending downward from the coordinate origin are used to obtain the second touch coordinate system of the second display screen.

[0073] In one example, Figure 4A (b) is the first touch coordinate system when the first display screen is in the positive vertical screen state (ie, rotated 0 degrees), as shown in FIG. Figure 4A For the second display screen shown in (a), when the second display screen is also in portrait mode, a second touch coordinate system is constructed with the upper left corner of the second display screen as the coordinate origin, extending rightward from the coordinate origin as the horizontal axis (x-axis), and extending downward from the coordinate origin as the vertical axis (y-axis); Figure 4A (c) is the first touch coordinate system when the first display screen is in the reverse vertical screen state (ie, rotated 180 degrees), such as Figure 4AThe second display screen shown in (a) in the figure is also in the landscape state. The upper left corner of the second display screen is used as the coordinate origin. The horizontal axis (x-axis) direction is extended to the right from the coordinate origin, and the vertical axis (y-axis) direction is extended downward from the coordinate origin to construct a second touch coordinate system.

[0074] In another example, Figure 4B (b) is the first touch coordinate system when the first display screen is in the forward horizontal state (ie, rotated 90 degrees counterclockwise), as shown in FIG. Figure 4B For the second display screen shown in (a), when the second display screen is also in landscape mode, a second touch coordinate system is constructed with the upper left corner of the second display screen as the coordinate origin, the horizontal axis (x-axis) extending rightward from the coordinate origin, and the vertical axis (y-axis) extending downward from the coordinate origin; Figure 4B (c) is the first touch coordinate system when the first display screen is in the reverse horizontal state (ie, rotated 270 degrees counterclockwise), as shown in FIG. Figure 4B The second display screen shown in (a) in the figure is also in the landscape state. The upper left corner of the second display screen is used as the coordinate origin. The horizontal axis (x-axis) direction is extended to the right from the coordinate origin, and the vertical axis (y-axis) direction is extended downward from the coordinate origin to construct a second touch coordinate system.

[0075] Step 2023: Determine the target touch window and the size information of the target touch window based on the current effective screen display size and the second touch coordinate system.

[0076] The target touch window corresponds to the effective display area corresponding to the effective display size of the current screen.

[0077] In some embodiments, the aspect ratio of the effective display area can be determined based on the current screen's effective display size. Since the aspect ratio of the target touch window is the same as that of the effective display area, the size information of the target touch window can be determined based on the preset constraints and the aspect ratio of the effective display area. The size information of the target touch window includes the width and height of the target touch window, and the preset constraints are used to constrain the size of the target touch window. For example, the preset constraints constrain the height of the target touch window to a preset height, or constrain the width of the target touch window to a preset width.

[0078] For example, if the size information of the target touch window includes the width w1 of the target touch window and the height h1 of the target touch window, when the preset constraint condition constrains the height of the target touch window to be a preset height, the preset height is determined as the height h1 of the target touch window. Since the aspect ratio of the effective display area is w2 / h2, w1=(w2 / h2)*h1.

[0079] In some embodiments, since the layout of the target touch window is different in different second touch coordinate systems, and the target touch window corresponds to the effective display area corresponding to the effective display size of the current screen, the target touch window on the corresponding second display screen can be determined through the second touch coordinate system and the effective display size of the current screen.

[0080] The control method for a mobile terminal provided by the embodiment of the present disclosure can determine a first touch coordinate system corresponding to the current screen state information of the first display screen based on the current screen orientation and the current screen folding state information, and determine a second touch coordinate system of the second display screen that has a mapping relationship with the first touch coordinate system based on the first touch coordinate system and the current screen orientation. Therefore, the target touch window and the size information of the target touch window can be determined based on the current screen effective display size and the second touch coordinate system. Since the scheme can construct a second touch coordinate system that has a mapping relationship with the first touch coordinate system in real time based on the first touch coordinate system determined by the current screen orientation and the current screen folding state information, the target touch window can be accurately determined based on the second touch coordinate system constructed in real time and the current screen effective display size, so that the user can use the target touch window to achieve precise touch control of the effective display area of the mobile terminal.

[0081] like Figure 5 As shown in the above Figure 3 Based on the embodiment shown, step 203 may include the following steps:

[0082] Step 2031 : In response to receiving a touch instruction for a target touch window of the current screen effective display size, determine an effective display area and size information of the effective display area on the first display screen based on the current screen effective display size and a first touch coordinate system.

[0083] In some embodiments, the effective display size of the current screen refers to the size information of the effective display area, so the effective display width in the effective display size of the current screen can be used as the width of the effective display area, and the effective display height in the effective display size of the current screen can be used as the height of the effective display area.

[0084] In some embodiments, since the first touch coordinate system corresponds to the current screen direction and current screen folding status information of the first display screen, and the orientation of the effective display area corresponds to the current screen direction and current screen folding status information, after determining the size information of the effective display area, the corresponding effective display area can be determined based on the size information of the effective display area and the first touch coordinate system.

[0085] For example, 6A to 6DFIG1 shows a schematic diagram of a coordinate system of a first display screen in a semi-expanded state provided by an exemplary embodiment of the present disclosure. Figure 6A The coordinate system shown in (b) is the first touch coordinate system corresponding to the first display screen when the first display screen is in a semi-expanded state and the current screen direction is a forward vertical screen, such as Figure 6A The area 1210 shown in (b) is the effective display area in the first display screen; Figure 6B The coordinate system shown in (b) is the first touch coordinate system corresponding to the first display screen when the first display screen is in a semi-expanded state and the current screen orientation is reverse vertical screen, such as Figure 6B The area 1210 shown in (b) is the effective display area in the first display screen; Figure 6C The coordinate system shown in (b) is the first touch coordinate system corresponding to the first display screen when the first display screen is in a semi-expanded state and the current screen direction is a forward horizontal screen, such as Figure 6C The area 1210 shown in (b) is the effective display area in the first display screen; Figure 6D The coordinate system shown in (b) is the first touch coordinate system corresponding to the first display screen when the first display screen is in a semi-expanded state and the current screen direction is the reverse horizontal screen, such as Figure 6D The area 1210 shown in (b) is the effective display area in the first display screen.

[0086] Step 2032: Determine the second touch coordinates on the second display screen based on the current screen orientation and the current screen folding state information, the first touch coordinates, the size information of the target touch window, and the size information of the effective display area.

[0087] In some embodiments, a size ratio between the first touch coordinates and the target touch window can be determined based on the first touch coordinates and the size information of the target touch window. Combined with the current screen orientation and the current screen folding state information, and the size ratio, the first touch coordinates are converted to a second touch coordinate system on the second display screen to obtain the second touch coordinates. For details, please refer to the detailed description in the following embodiments, and the embodiments of this disclosure are not further described here.

[0088] The control method for a mobile terminal provided by the embodiment of the present disclosure can convert the first touch coordinates into the second touch coordinates by combining the current screen orientation and the current screen folding state information as well as the size information of the target touch window and the size information of the effective display area, thereby ensuring that the obtained second touch coordinates fall within the effective display area corresponding to the target touch window, thereby avoiding the touch coordinates from being mapped to the invalid display area on the first display screen, thereby achieving accurate touch mapping of the target touch window to the effective display area.

[0089] like Figure 7 As shown in the above Figure 5 Based on the illustrated embodiment, step 2032 may include the following steps:

[0090] Step 2032a: Determine a first target size corresponding to the first display screen based on the current screen folding state information, the first touch coordinate system, and the size information of the effective display area.

[0091] The first target size includes a first target width and a first target height.

[0092] In some examples, the current screen folding state information includes three folding states of the first display screen, and the three folding states specifically include: the first display screen is in a folded state, the first display screen is in a semi-expanded state, and the first display screen is in an expanded state.

[0093] In some embodiments, the first target size is used to determine a mapping relationship between the first touch coordinates and the second touch coordinates, that is, the first touch coordinates can be converted into the second touch coordinates based on the first target size.

[0094] When the current screen folding state information indicates that the first display screen is in a folded state or an unfolded state, there is no need to consider the invalid display area on the first display screen. Therefore, the first target size is determined directly based on the size information of the effective display area. When the current screen folding state information indicates that the first display screen is in a semi-expanded state, the invalid display area on the first display screen needs to be considered. Therefore, the first target size is determined by combining the size information of the effective display area and the size information of the invalid display area.

[0095] In some embodiments, the above step 2032a may specifically include the following step (a), or the following steps (b) to (d):

[0096] (a) In response to current screen folding state information indicating that the first display screen is in a folded state or an unfolded state, determining a first target size based on size information of an effective display area.

[0097] In some embodiments, when the first display screen is in a folded state or an unfolded state, the height of the effective display area is determined as the first target height in the first target size, and the width of the effective display area is determined as the first target width in the first target size.

[0098] For example, it is assumed that the first target height in the first target size is TargetHeight, and the first target width in the first target size is TargetWidth. When the first display screen is in the folded state, Figure 4AAs shown in (b), at this time, the first display screen is in the positive vertical screen, the area 1110 is the effective display area, the horizontal width of the area 1110 is used as the first target width TargetWidth, and the vertical height of the area 1110 is used as the first target height TargetHeight; when the first display screen is in the folded state, as shown in FIG. Figure 4A As shown in (c), at this time, the first display screen is in reverse portrait orientation, area 1110 is the effective display area, the horizontal width of area 1110 is used as the first target width TargetWidth, and the vertical height of area 1110 is used as the first target height argetHeight.

[0099] For example, Figures 8A to 8B FIG2 shows a schematic diagram of a coordinate system of a first display screen in a fully expanded state provided by an exemplary embodiment of the present disclosure. Assume that the first target height in the first target size is TargetHeight, and the first target width in the first target size is TargetWidth. When the first display screen is in a fully expanded state, as shown in FIG22 , Figure 8A As shown in (b), at this time, the first display screen is in the positive vertical screen, the area 1310 is the effective display area, the horizontal width of the area 1310 is used as the first target width TargetWidth, and the vertical height of the area 1310 is used as the first target height TargetHeight; when the first display screen is in the folded state, as shown in FIG. Figure 8A As shown in (c), at this time, the first display screen is in reverse portrait orientation, area 1310 is the effective display area, the horizontal width of area 1310 is used as the first target width TargetWidth, and the vertical height of area 1310 is used as the first target height TargetHeight.

[0100] In this way, when the first display screen is in a folded state or a fully expanded state, the current screen orientation has no effect on the first target size. That is, when the current screen orientation is in any direction, the first target size is determined based on the size information of the effective display area.

[0101] (b) In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, obtaining size information of an invalid display area on the first display screen corresponding to the current screen folding state information.

[0102] In some examples, the invalid display area is an unavailable screen area on the first display screen when the first display screen is in a semi-expanded state; the vehicle-mounted terminal can receive size information of the invalid display area sent by the mobile terminal, and the size information includes the width and height of the invalid display area.

[0103] (c) Determining offset size information of the invalid display area based on the size information of the invalid display area and the first touch coordinate system.

[0104] In some embodiments, the offset size information refers to the screen size offset of the invalid display area relative to the effective display area, and the offset size information may include a horizontal offset value and a vertical offset value; the size information of the invalid display area includes the width and height of the invalid display area, and the offset value of the invalid display area in the horizontal axis direction of the first touch coordinate system relative to the effective display area is determined as the horizontal offset value, and the offset value of the invalid display area in the vertical axis direction of the first touch coordinate system relative to the effective display area is determined as the vertical offset value.

[0105] For example, Figure 6A As shown in (b), the area 1220 is the invalid display area. The horizontal offset value of the area 1220 is the width of the invalid display area in the x-axis direction, and the vertical offset value of the area 1220 is 0; Figure 6B As shown in (b), the area 1220 is an invalid display area, the horizontal offset value of the area 1220 is the width of the invalid display area in the x-axis direction, and the vertical offset value of the area 1220 is 0; Figure 6C As shown in (b), the area 1220 is an invalid display area, the horizontal offset value of the area 1220 is the width of the invalid display area in the x-axis direction, and the vertical offset value of the area 1220 is 0; Figure 6C As shown in (b), area 1220 is an invalid display area, the horizontal offset value of area 1220 is the width of the invalid display area in the x-axis direction, and the vertical offset value of area 1220 is 0.

[0106] Based on the above embodiment, it can be seen that the horizontal offset value is the horizontal width of the invalid display area, and the vertical offset value is 0.

[0107] (d) Determine a first target size based on the offset size information and the size information of the effective display area.

[0108] In some embodiments, when the offset size information includes a horizontal offset value and a vertical offset value, the first target width in the first target size is determined based on the horizontal offset value and the width of the effective display area, and the first target height in the first target size is determined based on the vertical offset value and the height of the effective display area.

[0109] For example, it is assumed that the first target height in the first target size is TargetHeight, and the first target width in the first target size is TargetWidth. When the first display screen is in a semi-expanded state, as shown in FIG. Figure 6CAs shown in (b), region 1210 is the valid display area, and region 1220 is the invalid display area. Since the horizontal offset value of region 1220 is the width of region 1220 in the x-axis direction, the first target width is the sum of the horizontal width of region 1220 and the horizontal width of region 1210. Since the vertical offset value of region 1220 is 0, the first target height is the vertical height of region 1210. Since region 1220 and region 1210 are the same height, the first target height is also the vertical height of region 1220.

[0110] Step 2032b: Determine a second target size corresponding to the second display screen based on the current screen folding state information, the second touch coordinate system, and the size information of the target touch window.

[0111] The second target size includes a second target width and a second target height.

[0112] When the current screen folding state information indicates that the first display screen is in a folded state or an unfolded state, there is no need to consider the non-touch area corresponding to the invalid display area on the second display screen. Therefore, the second target size is determined directly based on the size information of the target touch window. When the current screen folding state information indicates that the first display screen is in a semi-expanded state, it is necessary to consider the non-touch area corresponding to the invalid display area on the second display screen. Therefore, the first target size is determined by combining the size information of the target touch window and the size information of the non-touch area.

[0113] In some embodiments, the above step 2032b may specifically include the following step (e), or the following steps (f) and (g):

[0114] (e) In response to the current screen folding state information indicating that the first display screen is in a folded state or an unfolded state, determining a second target size based on the size information of the target touch window.

[0115] When the first display screen is in a folded state or an unfolded state, the width of the target touch window is determined as a second target width in the second target size, and the height of the target touch window is determined as a second target height in the second target size.

[0116] For example, it is assumed that the second target height in the second target size is SourceHeight, and the second target width in the second target size is SourceWidth. When the first display screen is in the folded state, as shown in FIG. Figure 4A As shown in (a), the area 2110 is the target touch window, the vertical height of the area 2110 is determined as the second target height SourceHeight, and the horizontal width of the area 2110 is determined as the second target width SourceWidth; Figure 4BAs shown in (a) in FIG. 2 , the region 2110 is the target touch window, the vertical height of the region 2110 is determined as SourceHeight, and the horizontal width of the region 2110 is determined as SourceWidth.

[0117] For example, it is assumed that the second target height in the second target size is SourceHeight, and the second target width in the second target size is SourceWidth. When the first display screen is in the fully expanded state, such as Figure 8A As shown in (a), the area 2310 is the target touch window, the vertical height of the area 2310 is determined as the second target height SourceHeight, and the horizontal width of the area 2310 is determined as the second target width SourceWidth; Figure 8B As shown in (a) in FIG. 2 , the region 2310 is the target touch window, the vertical height of the region 2310 is determined as the second target height SourceHeight, and the horizontal width of the region 2310 is determined as the second target width SourceWidth.

[0118] (f) In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, determining a non-touch area corresponding to the invalid display area on the second display screen in a second touch coordinate system and size information of the non-touch area.

[0119] In some examples, since the invalid display area corresponds to the non-touch area, the layout of the non-invalid display area on the second display screen can be based on the layout; the ratio between the width of the invalid display area and the width of the valid display area on the first display screen is the same as the ratio between the width of the non-touch area on the second display screen and the width of the target touch window, so the width of the non-touch area is determined based on the ratio between the width of the invalid display area and the width of the valid display area and the width of the target touch window, and the height of the non-touch area is the height of the target touch window.

[0120] For example, Figure 6A As shown, Figure 6A The area 2210 shown in (a) is the target touch window, and the area 2220 is the non-touch area. Figure 6A The area 1210 shown in (b) is the valid display area, the area 1220 is the invalid display area, the height of the area 2220 is the height of the area 2210, and the width of the area 2220 w1 = (w3 / w4)*w2; wherein w3 represents the width of the area 1220, w4 represents the width of the area 1210, and w2 represents the width of the area 2210.

[0121] For example, Figure 6A As shown, Figure 6AThe area 2220 shown in (a) is Figure 6A The non-touch area corresponding to the invalid display area 1220 shown in (b) of FIG. Figure 6D As shown, Figure 6D The area 2220 shown in (a) is Figure 6D The invalid display area 1220 shown in (b) corresponds to the non-touch area.

[0122] (g) Determine a second target size based on the size information of the non-touch area and the size information of the target touch window.

[0123] In some embodiments, the size information of the non-touch area includes the width and height of the non-touch area, the size information of the target touch window includes the width and height of the target touch window, the second target width in the second target size is determined based on the width of the non-touch area and the width of the target touch window, and the second target height in the second target size is determined based on the height of the non-touch area and the height of the target touch window.

[0124] For example, it is assumed that the second target height in the second target size is SourceHeight, and the second target width in the first target size is SourceWidth. When the first display screen is in the folded state, Figure 6A As shown in (a), area 2210 is the target touch window, area 2220 is the non-touch area, and the sum of the horizontal width of area 2210 and the horizontal width of area 2220 is determined as SourceWidth; since area 2210 and area 2220 are of the same height, the vertical height of area 2210 or the vertical height of area 2220 is determined as SourceHeight.

[0125] For example, it is assumed that the second target height in the second target size is SourceHeight, and the second target width in the first target size is SourceWidth. When the first display screen is in the folded state, Figure 6B As shown in (a), area 2210 is the target touch window, area 2220 is the non-touch area, and the sum of the horizontal width of area 2210 and the horizontal width of area 2220 is determined as SourceWidth; since area 2210 and area 2220 are of the same height, the vertical height of area 2210 or the vertical height of area 2220 is determined as SourceHeight.

[0126] Step 2032c: Determine the second touch coordinates based on the current screen direction, the first target size, the second target size, and the first touch coordinates.

[0127] In some embodiments, the first touch coordinate system of the first display screen rotates for different screen orientations. Consequently, the horizontal and vertical axes of the first touch coordinate system are swapped relative to the horizontal and vertical axes of the second touch coordinate system. Consequently, the first touch coordinates need to be converted to the second touch coordinate system corresponding to the current screen orientation based on the first target size and the second target size to calculate the second touch coordinates. For details, please refer to the detailed description in the following embodiments, and the embodiments of this disclosure are not further elaborated here.

[0128] In some embodiments, the first touch coordinate includes a first horizontal coordinate and a first vertical coordinate; the above step 2032c may specifically include: in response to the current screen orientation being that the screen orientation of the first display screen is in a vertical state, determining the second horizontal coordinate based on the first horizontal coordinate, the first target width and the second target width; and determining the second vertical coordinate based on the first vertical coordinate, the first target height and the second target height; determining the second touch coordinate based on the second horizontal coordinate and the second vertical coordinate.

[0129] In some embodiments, the above-mentioned portrait state includes: the screen direction of the first display screen is forward portrait, that is, the rotation angle of the first display screen is 0 degrees; the screen direction of the first display screen is reverse portrait, that is, the rotation angle of the first display screen is 180 degrees.

[0130] In some examples, when the portrait state is that the screen orientation of the first display screen is a positive portrait state, the second horizontal coordinate can be calculated by the following formula (1), recorded as tx; and the second vertical coordinate can be calculated based on the following formula (2), recorded as ty:

[0131] tx = (sx / SourceWidth) * TargetWidth (1)

[0132] Wherein, sx represents the first horizontal coordinate, TargetWidth represents the first target width, and SourceWidth represents the second target width.

[0133] ty = (sy / SourceHeight) * TargetHeight (2)

[0134] Among them, sy represents the first vertical coordinate, TargetHeight represents the first target height, and SourceHeight represents the second target height.

[0135] In some examples, when the portrait state is that the screen orientation of the first display screen is reverse portrait, that is, rotated 180°, the second horizontal coordinate can be calculated by the following formula (3), recorded as tx; the second vertical coordinate can be calculated based on the following formula (4), recorded as ty:

[0136] tx = ((SourceWidth - sx) / SourceWidth) * TargetWidth (3)

[0137] Wherein, sx represents the first horizontal coordinate, TargetWidth represents the first target width, and SourceWidth represents the second target width.

[0138] ty = ((SourceHeight - sy) / SourceHeight) * TargetHeight (4)

[0139] Among them, sy represents the first vertical coordinate, TargetHeight represents the first target height, and SourceHeight represents the second target height.

[0140] In some embodiments, the first touch coordinate includes a first horizontal coordinate and a first vertical coordinate; the above step 2032c may specifically include: in response to the current screen orientation of the first display screen being in a horizontal state, determining a third horizontal coordinate based on the first vertical coordinate, the first target width and the second target height; determining the third vertical coordinate based on the first horizontal coordinate, the first target height and the second target width; and determining the second touch coordinate based on the third horizontal coordinate and the third vertical coordinate.

[0141] In some embodiments, the above-mentioned landscape state includes: the screen direction of the first display screen is forward landscape, that is, the rotation angle of the first display screen is 90 degrees; the screen direction of the first display screen is reverse landscape, that is, the rotation angle of the first display screen is 270 degrees.

[0142] In some examples, when the landscape state is that the screen orientation of the first display screen is the positive landscape orientation, that is, rotated 90 degrees counterclockwise, the third horizontal coordinate can be calculated by the following formula (5), recorded as tx; the third vertical coordinate can be calculated based on the following formula (6), recorded as ty:

[0143] tx = ((SourceHeight - sy) / SourceHeight) * TargetWidth (5)

[0144] Among them, sy represents the first vertical coordinate, TargetWidth represents the first target width, and SourceHeight represents the second target height.

[0145] ty = (sx / SourceWidth) * TargetHeight (6)

[0146] Wherein, sx represents the first horizontal coordinate, TargetHeight represents the first target height, and SourceWidth represents the second target width.

[0147] In some examples, when the landscape state is that the screen orientation of the first display screen is reverse landscape, that is, rotated 270 degrees counterclockwise, the third horizontal coordinate can be calculated by the following formula (7), recorded as tx; the third vertical coordinate can be calculated based on the following formula (8), recorded as ty:

[0148] tx = (sy / SourceHeight) * TargetWidth (7)

[0149] Among them, sy represents the first vertical coordinate, TargetWidth represents the first target width, and SourceHeight represents the second target height.

[0150] ty = ((SourceWidth - sx) / SourceWidth) * TargetHeight (8)

[0151] Wherein, sx represents the first horizontal coordinate, TargetHeight represents the first target height, and SourceWidth represents the second target width.

[0152] In some embodiments, after the third horizontal coordinate and the third vertical coordinate are determined, the third horizontal coordinate may be determined as the horizontal coordinate of the second touch coordinate, and the third vertical coordinate may be determined as the vertical coordinate of the second touch coordinate.

[0153] The control method for a mobile terminal provided by the embodiment of the present disclosure can accurately determine the first target size and the second target size corresponding to each display screen by combining the current screen folding state information, the first touch coordinate system, the size information of the effective display area, the second touch coordinate system, and the size information of the target touch window. Therefore, based on the accurate first target size and the second target size and combined with the current screen direction, the second touch coordinates of the first display screen in different folding states in any screen direction can be accurately calculated, so that precise touch of the corresponding position of the effective display area can be achieved by touching the target touch window.

[0154] In some embodiments, the above-mentioned step 204 may specifically include: generating and sending an input device descriptor corresponding to the vehicle-mounted terminal to the mobile terminal; the input device descriptor includes type information and absolute coordinate system information of the vehicle-mounted terminal; in response to the mobile terminal confirming that the vehicle-mounted terminal is the input device of the mobile terminal based on the input device descriptor, sending a touch instruction including the second touch coordinates to the mobile terminal.

[0155] In some embodiments, the type information of the vehicle-mounted terminal may be a multi-touch device, and the absolute coordinate system information may be a physical screen resolution of the first display screen of the mobile terminal.

[0156] In some examples, the input device descriptor may be sent to the mobile terminal via a Bluetooth (Human Interface Device, HID) human interface device communication protocol.

[0157] In the control method for a mobile terminal provided in an embodiment of the present disclosure, since an input device descriptor corresponding to the vehicle-mounted terminal can be generated and sent to the mobile terminal, after the mobile terminal confirms that the vehicle-mounted terminal is the input device of the mobile terminal based on the input device descriptor, a touch instruction including the second touch coordinate can be sent to the mobile terminal, thereby registering the vehicle-mounted terminal as a device of the mobile terminal through the input device descriptor, so that the touch instruction sent by the vehicle-mounted terminal can be subsequently recognized to achieve control of the mobile terminal.

[0158] Exemplary devices

[0159] Figure 9 This is a schematic diagram of a control device for a mobile terminal provided by an exemplary embodiment of the present disclosure. The control device can be provided in an electronic device such as a terminal device or a server, or in an object such as a vehicle, to execute the control method for a mobile terminal according to any of the above embodiments of the present disclosure.

[0160] like Figure 9 As shown, the apparatus 300 may include:

[0161] A first determining module 301 is configured to determine current screen status information of a first display screen of the mobile terminal;

[0162] A second determining module 302 is configured to determine a target touch window and size information of the target touch window on a second display screen of the vehicle-mounted terminal based on the current screen state information;

[0163] a third determining module 303 for, in response to receiving a touch instruction for the target touch window, determining, based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen to which the first touch coordinates are mapped;

[0164] The instruction sending module 304 is configured to send a touch instruction including the second touch coordinates to the mobile terminal, so as to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

[0165] In one possible implementation, the current screen status information of the first display screen includes the current screen orientation and the current effective screen display size of the first display screen and the current screen folding status information; the second determination module 302 can be specifically used to determine the first touch coordinate system of the first display screen corresponding to the current screen status information based on the current screen orientation and the current screen folding status information; based on the first touch coordinate system and the current screen orientation, determine the second touch coordinate system of the second display screen that has a mapping relationship with the first touch coordinate system; based on the current effective screen display size and the second touch coordinate system, determine the target touch window and the size information of the target touch window; wherein, the target touch window corresponds to the effective display area corresponding to the effective display size of the current screen.

[0166] In one possible implementation, the third determination module 303 can be specifically used to determine the effective display area on the first display screen and the size information of the effective display area based on the current screen effective display size and the first touch coordinate system in response to receiving a touch instruction for the target touch window; and determine the second touch coordinates on the second display screen based on the current screen direction and the current screen folding state information, as well as the first touch coordinates and the size information of the target touch window and the size information of the effective display area.

[0167] In one possible implementation, the third determination module 303 can be specifically used to determine the first target size corresponding to the first display screen based on the current screen folding state information, the first touch coordinate system, and the size information of the effective display area; wherein the first target size includes a first target width and a first target height; based on the current screen folding state information, the second touch coordinate system, and the size information of the target touch window, determine the second target size corresponding to the second display screen; wherein the second target size includes a second target width and a second target height; and determine the second touch coordinates based on the current screen direction, the first target size, the second target size, and the first touch coordinates.

[0168] In one possible implementation, the first touch coordinates include a first horizontal coordinate and a first vertical coordinate; the third determination module 303 can be specifically used to determine the second horizontal coordinate based on the first horizontal coordinate, the first target width and the second target width in response to the current screen orientation being the vertical screen orientation of the first display screen; and determine the second vertical coordinate based on the first vertical coordinate, the first target height and the second target height; and determine the second touch coordinates based on the second horizontal coordinate and the second vertical coordinate.

[0169] In one possible implementation, the first touch coordinates include a first horizontal coordinate and a first vertical coordinate; the third determination module 303 can be specifically used to determine the third horizontal coordinate based on the first vertical coordinate, the first target width and the second target height in response to the current screen orientation being the horizontal screen state of the first display screen; determine the third vertical coordinate based on the first horizontal coordinate, the first target height and the second target width; and determine the second touch coordinates based on the third horizontal coordinate and the third vertical coordinate.

[0170] In a possible implementation, the third determining module 303 may be specifically configured to determine the first target size based on the size information of the effective display area in response to the current screen folding state information indicating that the first display screen is in a folded state or an unfolded state; or

[0171] In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, acquiring size information of an invalid display area on the first display screen corresponding to the current screen folding state information;

[0172] Determining offset size information of the invalid display area based on size information of the invalid display area and the first touch coordinate system;

[0173] The first target size is determined based on the offset size information and the size information of the effective display area.

[0174] In a possible implementation, the third determining module 303 may be specifically configured to determine the second target size based on the size information of the target touch window in response to the current screen folding state information indicating that the first display screen is in a folded state or an unfolded state; or

[0175] In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, determining a non-touch area corresponding to the invalid display area on the second display screen in the second touch coordinate system and size information of the non-touch area;

[0176] The second target size is determined based on the size information of the non-touch area and the size information of the target touch window.

[0177] In a possible implementation, the first determining module 301 may be specifically configured to obtain updated current screen state information of the first display screen in response to a change in the screen state of the first display screen of the mobile terminal;

[0178] The change in screen status includes at least one of the following: a change in screen orientation, a change in screen folding status.

[0179] In a possible implementation, the instruction sending module 304 may be specifically configured to generate and send an input device descriptor corresponding to the vehicle-mounted terminal to the mobile terminal; the input device descriptor includes type information and absolute coordinate system information of the vehicle-mounted terminal;

[0180] In response to the mobile terminal confirming that the in-vehicle terminal is the input device of the mobile terminal based on the input device descriptor, a touch instruction including the second touch coordinates is sent to the mobile terminal.

[0181] In a possible implementation, the first determining module 301 may be specifically configured to obtain the current front screen status information of the first display screen in response to the vehicle-mounted terminal and the mobile terminal having established a communication connection using a preset protocol.

[0182] The beneficial technical effects corresponding to the exemplary embodiment of this device can be found in the corresponding beneficial technical effects of the above exemplary method part, which will not be repeated here.

[0183] Exemplary electronic devices

[0184] Figure 10 A structural diagram of an electronic device provided in an embodiment of the present disclosure includes at least one processor 11 and a memory 12.

[0185] The processor 111 may be a central processing unit (CPU) or other forms of processing units with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 11 to perform desired functions.

[0186] The memory 112 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on a computer-readable storage medium, and the processor 111 may execute one or more computer program instructions to implement the control method for the mobile terminal and / or other desired functions of the various embodiments of the present disclosure described above.

[0187] In one example, the electronic device 11 may further include an input device 113 and an output device 114 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0188] The input device 113 may include various sensors, including but not limited to: a distance sensor for detecting the distance between a target object and the vehicle; an image sensor for collecting information about the vehicle's surroundings. In some examples, the input device may also include a pressure sensor for detecting seat pressure to determine the presence and location of a passenger; a temperature sensor for monitoring cabin temperature; a humidity sensor for monitoring cabin humidity to assist in regulating the interior environment; an air quality sensor for monitoring interior air quality, such as carbon dioxide and volatile organic compounds (VOCs); a light sensor for detecting light intensity inside and outside the vehicle; an acceleration sensor for detecting changes in vehicle acceleration; a distance sensor for detecting the distance between the vehicle and other objects; a touchscreen sensor for interacting with the vehicle's infotainment system; biometric sensors, such as fingerprint recognition and facial recognition; a heart rate monitor for monitoring the driver's heart rate; a sound sensor for voice recognition and interaction to enable voice control; a seat sensor for monitoring seat occupancy, such as whether the seat is occupied and the passenger's body shape; and wireless communication sensors, such as Bluetooth and Wi-Fi, for connecting to smart devices to enable data transmission and remote control. In addition to the examples given above, the input device may also include more or fewer sensors, which will not be described in detail here.

[0189] The output device 114 can output various information or signals to other hardware or devices, which may include displays, vehicle audio systems, seats, windows, steering wheels, etc., as well as communication networks and remote output devices connected thereto. The displays may include multiple different display screens, such as a driver's screen, a passenger screen, and a rear screen. The vehicle audio systems may include multiple speakers located in different locations within the vehicle cabin, and the different display screens or speakers may operate independently.

[0190] Of course, to simplify, Figure 10 Only some of the components related to the present disclosure in the electronic device 11 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, the electronic device 11 may further include any other appropriate components according to specific application scenarios.

[0191] Exemplary computer program products and computer-readable storage media

[0192] In addition to the above-mentioned methods and devices, embodiments of the present disclosure may also provide a computer program product, including computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the control method for a mobile terminal of various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section.

[0193] The computer program product may be written in any combination of one or more programming languages to implement the operations of the disclosed embodiments, including object-oriented programming languages such as Java, C++, and conventional procedural programming languages such as C or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's computing device, as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0194] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, enables the processor to execute the steps of the method for controlling a mobile terminal of various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section.

[0195] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium is, for example, but not limited to, a system, device or component comprising electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0196] The basic principles of the present disclosure have been described above in conjunction with specific embodiments. However, the advantages, strengths, and effects mentioned in this disclosure are merely illustrative and not restrictive, and should not be considered as essential to each embodiment of the present disclosure. Furthermore, the specific details disclosed above are provided for illustrative purposes and to facilitate understanding, rather than as limitations. These details do not limit the present disclosure to necessarily being implemented using these specific details.

[0197] Those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is intended to include these modifications and variations.

Claims

1. A method for controlling a mobile terminal, comprising: Determining current screen status information of the first display screen of the mobile terminal; Determining a target touch window on a second display screen of the in-vehicle terminal and size information of the target touch window based on the current screen state information; In response to receiving a touch instruction for the target touch window, determining, based on first touch coordinates of the touch instruction, size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen mapped from the first touch coordinates; A touch instruction including the second touch coordinates is sent to the mobile terminal to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

2. The method according to claim 1, wherein The current screen state information of the first display screen includes the current screen orientation and the current effective display size of the first display screen, and the current screen folding state information; and determining the target touch window and the size information of the target touch window on the second display screen of the in-vehicle terminal based on the current screen state information includes: determining, based on the current screen orientation and the current screen folding state information, a first touch coordinate system of the first display screen corresponding to the current screen state information; Determining, based on the first touch coordinate system and the current screen direction, a second touch coordinate system of the second display screen that has a mapping relationship with the first touch coordinate system; The target touch window and size information of the target touch window are determined based on the current screen effective display size and the second touch coordinate system; wherein the target touch window corresponds to the effective display area corresponding to the current screen effective display size.

3. The method according to claim 2, wherein: The step of determining, in response to receiving a touch instruction for the target touch window, second touch coordinates on the first display screen mapped from the first touch coordinates based on first touch coordinates of the touch instruction, size information of the target touch window, and current screen state information, includes: In response to receiving a touch instruction for the target touch window, determining an effective display area on the first display screen and size information of the effective display area based on the current screen effective display size and the first touch coordinate system; The second touch coordinates on the second display screen are determined based on the current screen direction and the current screen folding state information, the first touch coordinates, the size information of the target touch window, and the size information of the effective display area.

4. The method according to claim 3, wherein: The determining the second touch coordinates on the second display screen based on the current screen direction and the current screen folding state information, the first touch coordinates, the size information of the target touch window, and the size information of the effective display area includes: Determining a first target size corresponding to the first display screen based on the current screen folding state information, the first touch coordinate system, and the size information of the effective display area; wherein the first target size includes a first target width and a first target height; Determining a second target size corresponding to the second display screen based on the current screen folding state information, the second touch coordinate system, and the size information of the target touch window; wherein the second target size includes a second target width and a second target height; The second touch coordinates are determined based on the current screen direction, the first target size, the second target size, and the first touch coordinates.

5. The method according to claim 4, wherein The first touch coordinates include a first horizontal coordinate and a first vertical coordinate; The determining the second touch coordinates based on the current screen direction, the first target size, the second target size, and the first touch coordinates includes: In response to the current screen orientation being that the screen orientation of the first display screen is in a vertical screen state, determining a second abscissa based on the first abscissa, the first target width, and the second target width; and determining a second ordinate based on the first ordinate, the first target height, and the second target height; The second touch coordinate is determined based on the second horizontal coordinate and the second vertical coordinate.

6. The method according to claim 4, wherein: The first touch coordinates include a first horizontal coordinate and a first vertical coordinate; The determining the second touch coordinates based on the current screen direction, the first target size, the second target size, and the first touch coordinates includes: In response to the current screen orientation being that the screen orientation of the first display screen is in a horizontal state, determining a third abscissa based on the first ordinate, the first target width, and the second target height; determining a third ordinate based on the first abscissa, the first target height, and the second target width; The second touch coordinate is determined based on the third horizontal coordinate and the third vertical coordinate.

7. The method according to claim 4, wherein: The determining, based on the current screen folding state information, the first touch coordinate system, and the size information of the effective display area, a first target size corresponding to the first display screen includes: In response to the current screen folding state information indicating that the first display screen is in a folded state or an unfolded state, determining the first target size based on the size information of the effective display area; or In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, acquiring size information of an invalid display area on the first display screen corresponding to the current screen folding state information; Determining offset size information of the invalid display area based on size information of the invalid display area and the first touch coordinate system; The first target size is determined based on the offset size information and the size information of the effective display area.

8. The method according to claim 4, wherein The determining, based on the current screen folding state information, the second touch coordinate system, and the size information of the target touch window, a second target size corresponding to the second display screen includes: In response to the current screen folding state information indicating that the first display screen is in a folded state or an unfolded state, determining the second target size based on the size information of the target touch window; or In response to the current screen folding state information indicating that the first display screen is in a semi-expanded state, determining a non-touch area corresponding to the invalid display area on the second display screen in the second touch coordinate system and size information of the non-touch area; The second target size is determined based on the size information of the non-touch area and the size information of the target touch window.

9. The method according to claim 1, wherein The determining the current screen status information of the first display screen of the mobile terminal includes: In response to a change in the screen state of the first display screen of the mobile terminal, acquiring updated current screen state information of the first display screen; The change in screen status includes at least one of the following: a change in screen orientation, a change in screen folding status.

10. The method according to claim 1, wherein The sending the touch instruction including the second touch coordinates to the mobile terminal includes: generating and sending an input device descriptor corresponding to the vehicle-mounted terminal to the mobile terminal; the input device descriptor includes type information and absolute coordinate system information of the vehicle-mounted terminal; In response to the mobile terminal confirming that the in-vehicle terminal is the input device of the mobile terminal based on the input device descriptor, a touch instruction including the second touch coordinates is sent to the mobile terminal.

11. The method according to claim 1, wherein determining the current screen status information of the first display screen of the mobile terminal comprises: In response to the vehicle-mounted terminal and the mobile terminal having established a communication connection according to a preset protocol, the current screen status information of the first display screen is acquired.

12. A device for controlling a mobile terminal, comprising: A first determining module, configured to determine current screen state information of a first display screen of the mobile terminal; A second determining module is configured to determine a target touch window and size information of the target touch window on a second display screen of the vehicle-mounted terminal based on the current screen state information; a third determining module configured to, in response to receiving a touch instruction for the target touch window, determine, based on the first touch coordinates of the touch instruction, the size information of the target touch window, and the current screen state information, second touch coordinates on the first display screen to which the first touch coordinates are mapped; The instruction sending module is configured to send a touch instruction including the second touch coordinates to the mobile terminal, so as to control the mobile terminal to execute the touch instruction at a position corresponding to the second touch coordinates on the first display screen.

13. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the method for controlling a mobile terminal according to any one of claims 1 to 11.

14. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method for controlling the mobile terminal according to any one of claims 1 to 11.

Images