Method for controlling terminal device, and apparatus

Abstract

The present application relates to the technical field of terminals. Provided are a method for controlling a terminal device, and an apparatus. The terminal device comprises a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen being a folding screen. When the folding state of the terminal device is a first state, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera. The method comprises: acquiring a first instruction from a user, the first instruction being used for adjusting the folding state of the terminal device to a second state; and, in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display an image shot by the second camera. The method in the embodiments of the present application can prevent interruptions of shooting pictures displayed by display screens, thereby improving user experience.

Description

Method and apparatus for controlling terminal device

[0001] The present application claims priority from the Chinese patent application No. 202410391008.9 filed on March 29, 2024, and entitled "Method and apparatus for controlling terminal device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, in particular to a method and apparatus for controlling terminal device. BACKGROUND

[0003] With the continuous development of science and technology, more and more terminal devices with display screens are widely used in people's daily life and work. At the same time, with the rapid development of screen technology, the display screen of the terminal device also becomes larger and larger in order to provide more abundant information to the user. However, the display screen of the terminal device is too large, which will seriously affect its portability, therefore, in recent years, many folding screen terminal devices (i.e. terminal devices configured with folding screens, such as folding screen mobile phones, folding screen tablets, etc.) have appeared.

[0004] However, the existing folding screen terminal device still has some problems, which affects the user's experience. SUMMARY

[0005] The present application provides a method and apparatus for controlling terminal device, which can avoid the interruption of the shooting picture displayed on the display screen, and can improve the user experience.

[0006] In a first aspect, a method for controlling a terminal device is provided, the terminal device comprising a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen being a folding screen, the open-close state of the terminal device being in a first state, the first camera being in a shooting state and the first display screen displaying an image shot by the first camera; wherein the method comprises: obtaining a first instruction of a user, the first instruction being used to adjust the open-close state of the terminal device to a second state; in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display an image shot by the second camera.

[0007] In the embodiments of the present application, the first instruction is used to adjust the open-close state of the terminal device to a second state, in response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image shot by the second camera. In this way, when the open-close state of the terminal device changes, the camera in the shooting state can be switched, and the corresponding display screen is controlled to display the image shot by the camera, which can avoid the interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot normally display the shooting picture, etc.), thereby improving the user experience.

[0008] In some possible implementation manners, the open-close state of the terminal device includes an unfolded state and a folded state.

[0009] In some possible implementation manners, when the terminal device is in the second state, the first camera is in an open state.

[0010] In the embodiments of the present application, the first camera and the second camera are in the open state at the same time, so that when the open-close state of the terminal device changes, the camera in the shooting state can be quickly switched, and the corresponding display screen is controlled to display the image shot by the camera, thereby improving the user experience.

[0011] In some possible implementation manners, when the terminal device is in the second state, the first camera is in a closed state.

[0012] In the embodiments of the present application, when the terminal device is in the second state, the first camera is in the closed state, so that by closing the camera which does not need to display the shooting picture, the power consumption of the terminal device can be reduced, and the standby time of the terminal device can be prolonged, thereby improving the user experience.

[0013] In some possible implementation manners, the second state is a folded state, and the method further includes: adjusting the angle of the image displayed on the second display screen.

[0014] In the embodiments of the present application, when the open-close state of the terminal device is in the folded state, the angle of the image displayed on the second display screen is adjusted, which can avoid the shooting picture displayed on the display screen being upside down, thereby improving the user experience.

[0015] In some possible implementation manners, the adjusting of the angle of the image displayed on the second display screen includes: flipping the image displayed on the second display screen by 180 degrees.

[0016] In a second aspect, an apparatus for controlling a terminal device is provided. The terminal device includes a first display screen, a second display screen, a first camera, and a second camera. At least one of the first display screen and the second display screen is a folding screen. An open-close state of the terminal device is in a first state. The first camera is in a shooting state, and the first display screen displays an image captured by the first camera. The apparatus includes an obtaining unit configured to obtain a first instruction of a user. The first instruction is used to adjust the open-close state of the terminal device to a second state. A control unit is configured to control the second camera to be in a shooting state and control the second display screen to display an image captured by the second camera in response to the first instruction.

[0017] In the embodiments of the present application, the first instruction is used to adjust the open-close state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in the shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the open-close state of the terminal device changes, the camera in the shooting state can be switched, and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting image displayed on the display screen (for example, the display screen appears black or cannot normally display the shooting image, etc.), thereby improving the user experience.

[0018] In some possible implementation manners, the open-close state of the terminal device includes an unfolded state and a folded state.

[0019] In some possible implementation manners, when the terminal device is in the second state, the first camera is in an open state.

[0020] In the embodiments of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the open-close state of the terminal device changes, the camera in the shooting state can be quickly switched, and the corresponding display screen can be controlled to display the image captured by the camera, thereby improving the user experience.

[0021] In some possible implementation manners, when the terminal device is in the second state, the first camera is in a closed state.

[0022] In the embodiments of the present application, when the terminal device is in the second state, the first camera is in the closed state. In this way, by closing the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, and the standby time of the terminal device can be prolonged, thereby improving the user experience.

[0023] In some possible implementation manners, the second state is the folded state, and the apparatus further includes an adjusting unit configured to adjust an angle of the image displayed on the second display screen.

[0024] In the embodiments of the present application, when the open / close state of the terminal device is in the folded state, the angle of the image displayed by the second display screen is adjusted, so that the inverted shooting picture displayed by the display screen can be avoided, thereby improving the user experience.

[0025] In some possible implementation manners, the adjusting unit is specifically configured to: flip the image displayed by the second display screen by 180 degrees.

[0026] In a third aspect, an apparatus for controlling a terminal device is provided, including: a processor and a memory, the processor being coupled with the memory, and the memory being configured to store a computer program (which can also be referred to as code or instructions), the computer program being executed by the processor to cause the apparatus to perform the method in the first aspect or any possible implementation manner of the first aspect.

[0027] In some possible implementation manners, the apparatus further includes a memory coupled with the processor.

[0028] In some possible implementation manners, the processor is one or more, and / or the memory is one or more.

[0029] In some possible implementation manners, the memory can be integrated with the processor, or the memory is separately arranged from the processor.

[0030] In a fourth aspect, a terminal device is provided, which is a foldable-screen terminal device, and the terminal device includes the apparatus in the second aspect or any possible implementation manner of the second aspect, or the apparatus in the third aspect or any possible implementation manner of the third aspect.

[0031] In a fifth aspect, a computer-readable storage medium is provided, and the computer-readable storage medium has stored thereon a computer program (which can also be referred to as code or instructions), when the computer program is run on a computer, the computer program causes the computer to perform the method in the first aspect or any possible implementation manner of the first aspect.

[0032] In a sixth aspect, a computer program product is provided, including: a computer program (which can also be referred to as code or instructions), when the computer program is run on a computer, the computer program causes the computer to perform the method in the first aspect or any possible implementation manner of the first aspect.

[0033] In a seventh aspect, a chip is provided, including: a processor and a memory, the memory being configured to store a computer program (which can also be referred to as code or instructions), and the processor being configured to invoke and run the computer program stored in the memory, so that an apparatus or a device installed with the chip performs the method in the first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0034] FIG. 1 is a structural schematic diagram of a folding screen terminal device according to an embodiment of the present application.

[0035] FIG. 2 is a structural schematic diagram of a folding screen terminal device according to another embodiment of the present application.

[0036] FIG. 3 is a structural schematic diagram of a folding screen terminal device according to yet another embodiment of the present application.

[0037] FIG. 4 is a structural schematic diagram of a folding screen terminal device according to yet another embodiment of the present application.

[0038] FIG. 5 is a hardware structural schematic diagram of a folding screen terminal device according to an embodiment of the present application.

[0039] FIG. 6 is a software structural schematic diagram of a folding screen terminal device according to an embodiment of the present application.

[0040] FIG. 7 is a software and hardware structural schematic diagram of a folding screen terminal device according to an embodiment of the present application.

[0041] FIG. 8 is a schematic block diagram of a video call using a folding screen terminal device according to an embodiment of the present application.

[0042] FIG. 9 is a schematic block diagram of a video call using a folding screen terminal device according to another embodiment of the present application.

[0043] FIG. 10 is a schematic flowchart of a method of controlling a terminal device according to an embodiment of the present application.

[0044] FIG. 11 is a schematic block diagram of adjusting an angle of an image displayed by a display according to an embodiment of the present application.

[0045] FIG. 12 is a schematic flowchart of a method of controlling a terminal device according to an embodiment of the present application.

[0046] FIG. 13 is a schematic block diagram of a video call using a folding screen terminal device according to an embodiment of the present application.

[0047] FIG. 14 is a schematic block diagram of a video call using a folding screen terminal device according to another embodiment of the present application.

[0048] FIG. 15 is a schematic flowchart of a method of controlling a terminal device according to another embodiment of the present application.

[0049] FIG. 16 is a schematic structural diagram of an apparatus for controlling a terminal device according to an embodiment of the present application.

[0050] FIG. 17 is a schematic structural diagram of an apparatus according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0052] In the description of the present application, unless otherwise specified, the character " / " represents that the objects before and after the character are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. In addition, in the description of the present application, unless otherwise specified, "at least one" means one or more, and "multiple" means two or more than two. "At least one of the following" or the like means any combination of the items, including any combination of single item or multiple items. For example, at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, "first", "second", and the like are used to distinguish the same items or similar items with basically the same function and role. Those skilled in the art can understand that "first", "second", and the like do not limit the quantity and execution order, and "first", "second", and the like do not necessarily mean different. It should be understood that in the present application, "in the case of", "if", "when", "if", and the like can be replaced.

[0053] The technical solutions in the embodiments of the present application can be applied to various folding screen terminal devices. The folding screen terminal device in the embodiments of the present application can refer to a terminal device configured with a folding screen, for example, a mobile phone, a tablet computer, a smart watch, a wearable device, a vehicle-mounted device, an augmented reality (AR) device, a virtual reality (VR) device, and the like. The specific form of the folding screen terminal device is not limited in the embodiments of the present application.

[0054] The structure of the folding screen terminal device will be described below with reference to FIG. 1 and FIG. 2, taking a folding screen mobile phone as an example.

[0055] For example, FIG. 1 shows a schematic diagram of a folding screen mobile phone structure provided by an embodiment of the present application. FIG. 1A shows a schematic diagram of a folding screen mobile phone in a folded state. In the folded state, the display screen 110 and the camera 111 can work. Optionally, the display screen 110 and the camera 111 can be arranged on the outside of the mobile phone (here, the outside can be understood as the outside of the mobile phone in the folded state). Therefore, the display screen 110 can be referred to as an outer screen, and the camera 111 can be referred to as an outer screen camera. It should be noted that FIG. 1A only takes one display screen and one camera as an example. In the present application, the display screen 110 can include one or more display screens, and the camera 111 can include one or more cameras.

[0056] FIG. 1B shows a schematic diagram of a folding screen mobile phone in an unfolded state. For example, the mobile phone shown in FIG. 1A can be unfolded around the hinge at the folding area to form the unfolded state shown in FIG. 1B. The display screen 110 and the camera 111 shown in FIG. 1A can be located on the back of the mobile phone in the unfolded state shown in FIG. 1B (not shown in FIG. 1B). As shown in FIG. 1B, there is a folding area on the screen. The screens on the left and right sides of the folding area can rotate around the hinge at the folding area to achieve unfolding or folding. For example, a hinge or the like can be arranged at the folding area, so that the screens on the left and right sides of the folding area can rotate around the hinge at the folding area. As shown in FIG. 1B, the folding area can divide the display screen 110 into two parts, i.e., a first display area and a second display area. The first display area and the second display area can rotate around the hinge at the folding area. As shown in FIG. 1B, the display screen 120 and the camera 121 can work when the mobile phone is in the unfolded state. At the same time, the display screen 110 and / or the camera 111 can also work when the mobile phone is in the unfolded state. Optionally, the display screen 120 and the camera 121 can be arranged on the inside of the mobile phone (here, the inside can be understood as the inside of the mobile phone in the folded state). Therefore, the display screen 120 can be referred to as an inner screen, and the camera 121 can be referred to as an inner screen camera. It should be noted that FIG. 1B only takes one display screen and one camera as an example. In the present application, the display screen 120 can include one or more display screens, and the camera 121 can include one or more cameras (for example, the camera 121 can be a camera group including multiple cameras).

[0057] FIG. 1C shows that the first display area and the second display area of the display screen 120 of the mobile phone shown in FIG. 1B are folded around the hinge at the folding area to form a folding angle a folding angle between 0° and 360°, the mobile phone can be considered as in an unfolded state, and if the folding angle is 0° or 360°, the mobile phone can be considered as in a folded state.

[0058] It should be noted that the C diagram in FIG. 1 shows that the display screen 120 is folded in an outward folding manner in the unfolded state, i.e., the display screen 120 is folded in a direction away from the first display area and the second display area. Alternatively, the display screen 120 can be folded in an inward folding manner in the unfolded state, i.e., the display screen 120 is folded in a direction towards the first display area and the second display area.

[0059] FIG. 1 shows a left-right folding case of the folding screen terminal device. In the embodiments of the present application, the folding screen terminal device can also be in a top-bottom folding case. The top-bottom folding terminal device will be introduced below in combination with FIG. 2.

[0060] The A diagram in FIG. 2 shows a schematic diagram of a folding screen mobile phone in an unfolded state according to an embodiment of the present application. As shown in the A diagram in FIG. 2, there is a folding area on the screen, and the screens on the left and right sides of the folding area can rotate around the rotation shaft at the folding area to realize unfolding or folding. For example, a hinge or the like can be arranged at the folding area, so that the screens on the left and right sides of the folding area can rotate around the rotation shaft at the folding area. As shown in the A diagram, the folding area can divide the display screen 210 into two parts, i.e., a first display area and a second display area, and the first display area and the second display area can rotate around the rotation shaft at the folding area. As shown in the A diagram, the display screen 210 and the camera 211 can work in the unfolded state of the mobile phone, and the display screen 210 and / or the camera 211 shown in the A diagram can also work in the unfolded state of the mobile phone. Alternatively, the display screen 210 and the camera 211 can be arranged on the inner side of the mobile phone (here, the inner side can be understood as the inner side of the mobile phone in the folded state), so that the display screen 210 can be referred to as an inner screen, and the camera 211 can be referred to as an inner screen camera. It should be noted that the A diagram in FIG. 2 is only an example of one display screen and one camera, and in the present application, the display screen 210 can include one or more display screens, and the camera 211 can include one or more cameras (for example, the camera 211 can be a camera group including multiple cameras). As shown in the A diagram, there is a folding area on the display screen 210, and the screens on the upper and lower sides of the folding area can rotate around the rotation shaft at the folding area to realize unfolding or folding.

[0061] The B diagram in FIG. 2 shows that the first display area and the second display area of the display screen 210 of the mobile phone shown in the A diagram in FIG. 2 are folded around the rotation shaft at the folding area to form a folding angle the folding angle is between 0° and 360°, the folding state of the folding screen mobile phone can be considered as unfolded state, and if the folding angle is 0° or 360°, the folding state of the folding screen mobile phone can be considered as folded state. the folding angle is between 0° and 360°, the folding state of the folding screen mobile phone can be considered as unfolded state, and if the folding angle is 0° or 360°, the folding state of the folding screen mobile phone can be considered as folded state. the folding angle is between 0° and 360°, the folding state of the folding screen mobile phone can be considered as unfolded state, and if the folding angle is 0° or 360°, the folding state of the folding screen mobile phone can be considered as folded state.

[0062] FIG. 2C shows a schematic diagram of the folding screen mobile phone in the folded state. FIG. 2C shows a schematic diagram of folding the first display area and the second display area of the display 210 around the rotation shaft at the folding area to form a folding angle of 0°. As shown in FIG. 2C, the display 220 and the camera 221 can work when the folding screen mobile phone is in the folded state. Optionally, the display 220 and the camera 221 can be arranged on the outer side of the folding screen mobile phone (here, the outer side can be understood as the outer side of the folding screen mobile phone in the folded state), and thus the display 220 can be referred to as an outer screen, and the camera 221 can be referred to as an outer screen camera. It should be noted that FIG. 2C only takes one display and one camera as an example, and in the present application, the display 220 can include one or more displays, and the camera 221 can include one or more cameras (for example, the camera 221 can be a camera group including multiple cameras). The shape and position of the display 220 and the camera 221 are only examples.

[0063] It should be noted that FIG. 2B shows that the display 210 is folded in the unfolded state in a direction in which the first display area and the second display area face each other (i.e., an inner folding manner), and the display 210 can also be folded in the unfolded state in a direction in which the first display area and the second display area face away from each other (i.e., an outer folding manner).

[0064] Figure 3 shows a schematic diagram of a two-fold screen phone structure provided in an embodiment of this application. Figure A in Figure 3 shows a schematic diagram of the foldable screen phone in the unfolded state (i.e., the flattened state). As shown in Figure A in Figure 3, there are two folding areas on the screen. The screens located on the left and right sides of either folding area can rotate around the pivot at the folding area to unfold or fold. For example, hinges or other components can be provided at the folding area to allow the screens on the left and right sides of the folding area to rotate around the pivot at the folding area. As shown in Figure A, the phone's display screen 310 is divided into three parts by the folding area, namely a first display area, a second display area, and a third display area. The first display area, the second display area, and the third display area can all rotate around the pivot at the folding area. As shown in Figure A, the display screen 310 and the camera 311 can work when the phone is in the unfolded state. It should be noted that Figure 3 only uses one display screen and one camera as an example. In this application, the display screen 310 may include one or more display screens, and the camera 311 may include one or more cameras (for example, the camera 311 may be a camera group including multiple cameras).

[0065] Figure 3B shows another schematic diagram of a foldable screen phone in its unfolded state. Figure 3B illustrates the foldable screen phone shown in Figure 3A, folded around the pivot point at the folding area in a direction opposite to the first and second display areas (i.e., outward folding), forming the folding angle. (i.e., the inward folding angle on the back of the screen is) The folding angle can be less than 180°, with the second and third display areas facing each other (i.e., folding inwards). (i.e., the inward folding angle of the front of the screen is) The diagram shows an angle of less than 180°. In other embodiments of this application, the foldable screen phone shown in Figure 3A can also be folded in a direction where the first display area and the second display area face each other (i.e., inward folding) or the second display area and the third display area face away from each other (i.e., outward folding). This application does not impose any restrictions on this.

[0066] Figure 3 shows a two-fold foldable screen phone folded horizontally. In this embodiment, a two-fold or multi-fold foldable screen phone can also be folded vertically. For example, Figure 4 shows a two-fold foldable screen phone folded vertically.

[0067] FIG. 4 shows another two-fold folding screen mobile phone structure provided by the embodiments of the present application. FIG. 4A shows a two-fold folding screen mobile phone in an unfolded state. There are two folding areas on the screen. The screens on the upper and lower sides of any folding area can rotate around the rotating shaft at the folding area to achieve unfolding or folding. For example, a hinge or other components can be arranged at the folding area, so that the screens on the left and right sides of the folding area can rotate around the rotating shaft at the folding area. As shown in FIG. 4A, the display screen 410 of the mobile phone is divided into three parts by the folding area, namely a first display area, a second display area and a third display area. The first display area, the second display area and the third display area can rotate around the rotating shaft at the folding area. As shown in FIG. 4A, the display screen 410 and the camera 411 can work when the mobile phone is in the unfolded state. It should be noted that only one display screen and one camera are taken as examples in FIG. 4. In the present application, the display screen 410 can include one or more display screens, and the camera 411 can include one or more cameras (for example, the camera 411 can be a camera group including multiple cameras).

[0068] FIG. 4B shows another unfolded state of the folding screen mobile phone. As shown in FIG. 4B, the foldable display screen in the unfolded state can be folded towards the direction that the first display area and the second display area face each other (i.e., the inner folding mode) to form a folding angle which can be less than 180°. The second display area and the third display area are in a flat state relative to the folding area, that is, the folding angle formed by the front surfaces of the screens of the second display area and the third display area is which can be 180°.

[0069] It should be understood that in other embodiments of the present application, the foldable display screen in the unfolded state can also be folded towards the direction that the first display area and the second display area face away from each other (i.e., the outer folding mode), the second display area and the third display area face each other (i.e., the inner folding mode), or the first display area and the second display area face each other (i.e., the inner folding mode), the second display area and the third display area face away from each other (i.e., the outer folding mode), or the first display area and the second display area face away from each other (i.e., the outer folding mode), the second display area and the third display area face away from each other (i.e., the outer folding mode). The embodiments of the present application are not limited here.

[0070] That is, in various folding screen terminal devices provided by the present application (such as folding screen mobile phones, folding screen tablets and the like), the folding mode of the display areas on both sides of any folding area can be the outer folding mode or the inner folding mode. The embodiments of the present application are not limited here.

[0071] It should be noted that the folding screen mobile phone described in the embodiments of the present application can be understood as the folding screen mobile phone with one rotation shaft shown in FIG. 1 or FIG. 2; the folding screen mobile phone described in the embodiments of the present application can be understood as the folding screen mobile phone with two rotation shafts shown in FIG. 3 or FIG. 4. In other embodiments, the folding screen mobile phone with one rotation shaft and the folding screen mobile phone with two rotation shafts can also have other names. For example, the folding screen mobile phone shown in FIG. 3 or FIG. 4 can also be called a folding screen mobile phone with three rotation shafts because it has three display areas, and the present application does not limit the name thereof.

[0072] It should also be understood that in the embodiments of the present application, the inner folding manner can be understood as folding the two display areas left and right or up and down around the rotation shaft at a certain folding area towards the direction in which the two screen front surfaces face each other. The screen front surface can be understood as the side of the larger display screen (i.e., the foldable flexible display screen) of the folding screen mobile phone that displays images or pictures. In the folding process, the included angle between the two screen front surfaces (i.e., the screen front surface inner folding angle) becomes smaller and smaller.

[0073] In the embodiments of the present application, the outer folding manner can be understood as folding the two display areas left and right or up and down around the rotation shaft at a certain folding area towards the direction in which the two screen back surfaces face each other. The screen back surface can be understood as the side opposite to the screen front surface, for example, the side where the back cover of the mobile phone is located, etc. In the folding process, the included angle between the two screen back surfaces (i.e., the screen back surface inner folding angle) becomes smaller and smaller.

[0074] It should be noted that the folding screen terminal device shown in FIGS. 1 to 4 only shows the folding screen terminal device including one folding area and two folding areas, but the number of folding areas is not limited in the embodiments of the present application. For example, the folding screen terminal device in the embodiments of the present application can also include more than two folding areas, which is not limited in the embodiments of the present application.

[0075] FIG. 5 shows a structural schematic diagram of a folding screen terminal device 500 provided by an embodiment of the present application. The folding screen terminal device can be any one of the folding screen terminal devices (for example, a folding screen mobile phone, a folding screen tablet computer, etc.) in the above embodiments. As shown in FIG. 5, the folding screen terminal device 500 can include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a loudspeaker 570A, a receiver 570B, a microphone 570C, a headset interface 570D, a sensor module 580, etc. The folding screen terminal device 500 is used to execute the steps performed by any one of the folding screen terminal devices in the above task examples or display any one of the interfaces.

[0076] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the folding screen terminal device 500. In some other embodiments of the present application, the folding screen terminal device 500 can include more or fewer components than the illustration, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 510 can include one or more processing units, for example: the processor 510 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0078] The memory in the processor 510 can also be configured to store instructions and data. In some embodiments, the memory in the processor 510 is a cache memory. The memory can save instructions or data that the processor 510 has just used or repeatedly uses. If the processor 510 needs to use the instructions or data again, it can be directly called from the memory. Avoiding repeated access reduces the waiting time of the processor 510, thus improving the efficiency of the system. For example: the processor can determine the number of application programs currently running in the foreground of the terminal device.

[0079] The wireless communication function of the folding screen terminal device 500 can be realized through the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor, and the baseband processor, etc.

[0080] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the folding screen terminal device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antenna. For example: the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0081] The mobile communication module 550 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. on the folding screen terminal device 500. The mobile communication module 550 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 550 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer to the modem processor for demodulation. The mobile communication module 550 can also amplify the signal modulated by the modem processor, and radiate as electromagnetic waves through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 550 can be disposed in the processor 510. In some embodiments, at least part of the function modules of the mobile communication module 550 can be disposed in the same device as at least part of the modules of the processor 510.

[0082] The wireless communication module 560 can provide a solution for wireless communication including wireless local area networks (WLAN), such as wireless fidelity (Wi-Fi) network, bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. on the folding screen terminal device 500. The wireless communication module 560 can be one or more devices integrated with at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and sends the processed signal to the processor 510. The wireless communication module 560 can also receive a signal to be sent from the processor 510, perform frequency modulation and amplification, and radiate as electromagnetic waves through the antenna 2.

[0083] In some embodiments, the antenna 1 and the mobile communication module 550 of the foldable terminal device 500 are coupled, and the antenna 2 and the wireless communication module 560 are coupled, so that the foldable terminal device 500 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0084] The foldable terminal device 500 implements a display function through a GPU, a display screen 594, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 510 can include one or more GPUs, which execute program instructions to generate or change display information.

[0085] The display screen 594 is configured to display images, videos, and the like. The display screen 594 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-OLED, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the foldable-screen terminal device 500 can include one or N display screens 594, where N is a positive integer greater than 1.

[0086] In some embodiments of the present application, when the display panel is made of OLED, AMOLED, FLED, or the like, the display screen 594 in FIG. 5 can be bent. Here, the display screen 594 can be bent at any position to any angle, and can maintain the folding angle. For example, the display screen 594 can be folded left and right from the middle, or folded up and down from the middle. In embodiments of the present application, the display screen that can be bent is referred to as a foldable display screen. The foldable display screen can be a single screen or a display screen composed of multiple screens, without limitation.

[0087] For example, the foldable display screen can include at least two physical forms: an unfolded form and a folded form. As shown in B of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the middle folding area of the foldable display screen (if the foldable display screen is folded up and down, the foldable display screen can be folded up and down from the upper and lower ends of the middle folding area of the foldable display screen). The included angle between the left and right ends of the middle folding area of the foldable display screen is 180 degrees (i.e., the flat state), as shown in C of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the folding area of the foldable display screen. The included angle between the left and right ends of the folding area of the foldable display screen is 0 degrees (i.e., the folded state). For example, the foldable display screen can include at least two physical forms: an unfolded form and a folded form. As shown in B of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the middle folding area of the foldable display screen (if the foldable display screen is folded up and down, the foldable display screen can be folded up and down from the upper and lower ends of the middle folding area of the foldable display screen). The included angle between the left and right ends of the middle folding area of the foldable display screen is 180 degrees (i.e., the flat state), as shown in C of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the folding area of the foldable display screen. The included angle between the left and right ends of the folding area of the foldable display screen is 0 degrees (i.e., the folded state). For example, the foldable display screen can include at least two physical forms: an unfolded form and a folded form. As shown in B of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the middle folding area of the foldable display screen (if the foldable display screen is folded up and down, the foldable display screen can be folded up and down from the upper and lower ends of the middle folding area of the foldable display screen). The included angle between the left and right ends of the middle folding area of the foldable display screen is 180 degrees (i.e., the flat state), as shown in C of FIG. 1, the foldable display screen is in the unfolded form, i.e., the foldable display screen can be folded left and right from the left and right ends of the folding area of the foldable display screen. The included angle between the left and right ends of the folding area of the foldable display screen is 0 degrees (i.e., the folded state).

[0088] In embodiments of the present application, the foldable display screen can be a single-fold display screen (i.e., only one folding area) or a multi-fold display screen (i.e., two or more folding areas). In addition, the folding mode can be an inner folding mode or an outer folding mode, or a combination of the inner folding mode and the outer folding mode.

[0089] In some embodiments, the foldable-screen terminal device 500 can determine whether the foldable display screen is in a folded state or an unfolded state, and whether the foldable display screen is in a portrait mode or a landscape mode, through one or more of a gravity sensor, an acceleration sensor, and a gyroscope. The foldable-screen terminal device 500 can also detect the angle at which the foldable display screen is bent through an angle sensor, and determine whether the folding manner of the foldable-screen terminal device is inward folding (folding towards a direction in which the two display areas face each other) or outward folding (folding towards a direction in which the two display areas face away from each other) through a folding sensor. Then, the foldable-screen terminal device 500 can determine whether the foldable display screen is in a folded state or an unfolded state according to the included angle of the bent part. The foldable-screen terminal device 500 can also determine the orientation of the foldable display screen in the folded state through one or more of a gravity sensor, an acceleration sensor, and a gyroscope, and further determine the display area in which the interface content output by the display system is displayed. For example, when the first display area of the foldable display screen faces upwards relative to the ground, the foldable-screen terminal device 500 can display the interface content output by the display system on the first display area.

[0090] In some embodiments, the foldable-screen terminal device 500 can also set an angle sensor at the folding area of the foldable display screen. The foldable-screen terminal device 500 can measure the included angle between the two ends of the middle bent part of the foldable display screen through the angle sensor arranged at the folding area of the foldable display screen. When the included angle is greater than or equal to a preset angle, the folding area can identify that the foldable display screen enters an unfolded state through the angle sensor. When the included angle is less than or equal to the preset angle, the folding area can identify that the foldable display screen enters a folded state through the angle sensor.

[0091] In other embodiments, the folding area can also identify whether the foldable display screen is in a folded state or an unfolded state through a physical switch arranged at the folding area of the foldable display screen. For example, when the foldable-screen terminal device 500 receives a folding operation of the foldable display screen by a user, the physical switch arranged on the terminal device is triggered to open, and the foldable-screen terminal device 500 can determine that the foldable display screen is in a folded state. When the foldable-screen terminal device 500 receives an unfolding operation of the foldable display screen by a user, the physical switch arranged on the terminal device is triggered to close, and the foldable-screen terminal device 500 can determine that the foldable display screen is in an unfolded state. The above examples are only used to explain the present application and should not be construed as limiting.

[0092] The foldable-screen terminal device 500 can realize the photographing function through an ISP, a camera 593, a video codec, a GPU, a display screen 594, and an application processor.

[0093] ISP is used to process the data feedback by the camera 593. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and conversion into a visible image. ISP can also optimize the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, ISP can be provided in the camera 593.

[0094] The camera 593 is used to capture still images or videos. Objects generate optical images through lenses and project them onto photosensitive elements. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard RGB, YUV, or other format image signal. In some embodiments, the foldable screen terminal device 500 can include one or N cameras 593, where N is a positive integer greater than 1.

[0095] The digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the foldable screen terminal device 500 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0096] The video codec is used to compress or decompress digital video. The foldable screen terminal device 500 can support one or more video codecs. In this way, the foldable screen terminal device 500 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0097] The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the foldable screen terminal device 500. The external memory card communicates with the processor 510 through the external memory interface 520 to realize data storage functions. For example, music, video, and other files can be saved in the external memory card.

[0098] The internal memory 521 can be used to store computer executable program codes including instructions. The processor 510 performs various functional applications and data processing of the folding screen terminal device 500 by running the instructions stored in the internal memory 521. The internal memory 521 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data (such as audio data, a phone book, etc.) created during the use of the folding screen terminal device 500, and the like. In addition, the internal memory 521 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0099] The folding screen terminal device 500 can realize audio functions through an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, an earphone interface 570D, and an application processor, and the like. For example, music playing, recording, and the like.

[0100] The audio module 570 is used to convert digital audio information into an analog audio signal output, and is also used to convert an analog audio input into a digital audio signal. The audio module 570 can also be used to encode and decode audio signals. In some embodiments, the audio module 570 can be disposed in the processor 510, or part of the functions of the audio module 570 can be disposed in the processor 510.

[0101] The speaker 570A, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The folding screen terminal device 500 can listen to music or listen to a hands-free call through the speaker 570A.

[0102] The receiver 570B, also known as a "earpiece", is used to convert an audio electrical signal into a sound signal. When the folding screen terminal device 500 answers a call or a voice message, the receiver 570B can be held close to the ear to listen to the voice.

[0103] Microphone 570C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending voice messages, the user can speak into the microphone 570C by placing the mouth close to the microphone 570C, and input the sound signal into the microphone 570C. The folding screen terminal device 500 can be provided with at least one microphone 570C. In other embodiments, the folding screen terminal device 500 can be provided with two microphones 570C, in addition to collecting sound signals, it can also realize the noise reduction function. In other embodiments, the folding screen terminal device 500 can also be provided with three, four or more microphones 570C, to realize the collection of sound signals, noise reduction, and can also identify the sound source, realize the directional recording function, etc.

[0104] The earphone interface 570D is used to connect the wired earphone. The earphone interface 570D can be a USB interface 530, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0105] The sensor module 580 can include a pressure sensor, a gyroscope sensor, an angle sensor, a folding sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0106] Of course, the folding screen terminal device 500 can also include a charging management module, a power management module, a battery, a key, an indicator, and one or more SIM card interfaces, etc., and the embodiments of the present application do not make any limitation thereto.

[0107] FIG. 6 shows a software structure block diagram of the folding screen terminal device according to an embodiment of the present application.

[0108] The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom, the application layer, the application framework layer, the native layer, the kernel layer and the hardware layer.

[0109] The application layer can include a series of application packages.

[0110] As shown in FIG. 6, the application programs include system application programs and third-party application programs. For example, the application programs can include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as short message), and the like. In addition, the application program package can also include: home screen (i.e. desktop), negative one screen, control center, notification center, and the like. In the embodiments of the present application, the application program package can also include a super collection application, which can be a system application. The application program package can also include an application program of a task flow manager, which is used to call and manage the task flow manager.

[0111] The application program framework layer provides an application programming interface (application programming interface, API) and a programming framework for the application programs of the application program layer. The application program framework layer includes some pre-defined functions. For example, in FIG. 6, the android open source project (AOSP) is taken as an example. The upper layer application is some user-accessible applications using the FRAMEWORK interface, which run on the folding screen terminal device and are the window for the user to interact with the folding screen terminal device.

[0112] For example, the AOSP can include: an activity manager service (AMS) module, a display manager service (DMS) module, a window manager service (WMS), and an input management module (input).

[0113] The AMS module is used to manage the activities running in the system, including process, application program, service, task information, and the like.

[0114] The input management module can provide an input management service (IMS), which can be used to manage the input of the system, such as touch screen input, key input, sensor input, and the like. The IMS takes events from the input device node, and through the interaction with the WMS, the events are distributed to the appropriate window.

[0115] The DMS module is one of the system services responsible for display management, and also has some other functions, including screen brightness adjustment, which also involves the DMS.

[0116] The WMS module is used for managing window programs. The window manager can acquire a display screen size, determine whether there is a status bar, lock a screen, and capture a screen, etc.

[0117] As shown in FIG. 6, the application framework layer can further include a multi-screen display service and a folding display service, etc. The multi-screen display service is used to provide a display interface of a plurality of different display areas of the folding-screen terminal device to a user, i.e., to control display rules of the plurality of different display areas. The folding display service is used to provide different display modes and display interfaces of the folding-screen terminal device in a folded state and an unfolded state, i.e., to control display rules of the plurality of different display areas of the folding-screen terminal device in a folding process.

[0118] The native layer includes a surface service (SurfaceFlinger) and a sensor service, etc. Each application can correspond to one or more graphical interfaces, and each interface is referred to as a surface. In the implementation of Android, SurfaceFlinger is a service that provides a system-wide surface composition function, which can combine 2D and 3D surfaces of various applications.

[0119] The sensor service can provide processing of a plurality of different sensor data on the folding-screen terminal device.

[0120] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a sensor driver, a touch screen driver, etc., and can further include a camera driver, an audio driver, a touch control chip driver, and an input system, etc.

[0121] The hardware layer is an interface layer between the operating system software and hardware components, which provides an interface for interaction between the upper layer software and the lower layer hardware. For example, the lower layer hardware can include an inner screen, an outer screen, an accelerometer sensor (A), a gyroscope sensor (G), a gravity sensor, a magnetometer, a touch screen sensor, a distance sensor, an angle sensor, etc.

[0122] The display driver and the inner screen and the outer screen interact through a mobile industry processor interface (MIPI).

[0123] FIG. 7 shows a structural block diagram of software and hardware of the folding-screen terminal device according to an embodiment of the present application.

[0124] As shown in FIG. 7, the folding screen terminal device includes an application layer, a function unit layer, and a physical unit layer. The application layer and the function unit layer are software structures, and the physical unit layer is a hardware layer.

[0125] As shown in FIG. 7, the application includes a system application and a third-party application. For example, the application can include a camera, a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, a video, a game, shopping, travel, instant messaging (such as a short message), and the like.

[0126] The function unit layer includes a sensor module, a timer module, and a screen service module.

[0127] The sensor module is configured to acquire and process data detected by various sensors. For example, the sensor module can include a gravity recognition module, a folding recognition module, and an angle recognition module. The gravity recognition module can recognize the placement of the foldable electronic device according to data detected by a gravity sensor. The folding recognition module is configured to determine the use state of the foldable electronic device (e.g., a folded state or an unfolded state) and the folding manner (e.g., an inner folding manner or an outer folding manner) according to data detected by a folding sensor. The angle recognition module is configured to determine the folding angle of the foldable electronic device according to parameters detected by an angle sensor. The timer module is configured to provide timing services. For example, the timer module can record the duration that the display screen of the foldable terminal device is at a certain folding angle.

[0128] The screen service module can include a screen management module, a multi-screen display service module, a folding display service module, an image synthesis service module, and an input management module. The multi-screen display service module is configured to provide the display interfaces of different display regions of the folding screen terminal device to a user. The folding display service module is configured to provide different display manners and display interfaces of the folding screen terminal device in the folded state and the unfolded state. The image synthesis service module is configured to synthesize the interfaces displayed on different display regions. The input management module is configured to analyze touch events through a touch screen and inject the touch events to corresponding display regions or services for execution.

[0129] The physical unit layer can include various physical hardware, such as various sensors (folding sensors, gravity sensors, gyroscopes, angle sensors, and the like), timers, screens, folding hinges of folding regions, cameras, speakers, antennas, CPUs, and the like.

[0130] It can be understood that the structure illustrated in the present application does not constitute a specific limitation on the folding screen terminal device. In other embodiments, the folding screen terminal device can include more or fewer components than those illustrated, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. The present application does not limit this.

[0131] With the continuous development of science and technology, more and more terminal devices with display screens are widely used in people's daily life and work. At the same time, with the rapid development of screen technology, the display screen of the terminal device also becomes larger and larger in order to provide more abundant information to the user. However, the display screen of the terminal device is too large, which will seriously affect its portability, therefore, in recent years, many folding screen terminal devices have appeared. However, the existing folding screen terminal device still has some problems, which affects the user's experience.

[0132] For example, as shown in FIG. 8, in the case that the mobile phone is in an unfolded state, the user opens a video call from the inner screen, the inner screen displays a video picture taken by the inner screen camera, at this time, if the user closes the mobile phone (i.e. sets the mobile phone to a folded state), the outer screen of the mobile phone is in a locked state, and the outer screen has no video picture (may only have sound), after the user unlocks the outer screen, the outer screen still has no video picture, that is, the shooting picture displayed on the display screen is interrupted.

[0133] For example, as shown in FIG. 9, in the case that the mobile phone is in a folded state, the user opens a video call from the outer screen, the outer screen displays a video picture taken by the outer screen camera, at this time, if the user unfolds the mobile phone (i.e. sets the mobile phone to an unfolded state), the inner screen of the mobile phone has no video picture, that is, the shooting picture displayed on the display screen is interrupted.

[0134] It can be seen that when the opening and closing state of the terminal device changes, the shooting picture displayed on the display screen cannot be continued, and the shooting picture interruption may occur, thereby affecting the user's experience.

[0135] Moreover, the outer screen camera is usually used as a rear camera, when the terminal device is in a folded state, the outer screen camera is used as a front camera (for example, the user uses the outer screen camera for self-shooting, which can be considered as using the outer screen camera as a front camera), the picture displayed on the display screen may be inverted, which also affects the user's experience.

[0136] In order to solve one or more of the above technical problems, the present application proposes a method and device for controlling a terminal device. The method for controlling a terminal device in the embodiment of the present application will be illustrated in detail below in combination with FIG. 10.

[0137] FIG. 10 is a schematic flow chart of a method for controlling a terminal device according to an embodiment of the present application. The method 1000 shown in FIG. 10 can include steps S1010 and S1020, which are specifically as follows:

[0138] S1010, obtaining a first instruction of a user.

[0139] The first instruction can be used to adjust the open-close state of the terminal device to a second state.

[0140] In some embodiments, the terminal device can be a folding screen terminal device, for example, the terminal device can be a one-fold folding screen terminal device as shown in FIG. 1 or FIG. 2, or a two-fold folding screen terminal device as shown in FIG. 3 or FIG. 4, or a multi-fold folding screen terminal device including more than two folding areas. For example, the terminal device can include a first display screen and a second display screen, and at least one of the first display screen and the second display screen can be a folding screen.

[0141] In some embodiments, the open-close state of the terminal device can include an unfolded state and a folded state. For example, the open-close state of the terminal device can be in a first state, where the first state can be the unfolded state or the folded state.

[0142] In some embodiments, the terminal device can include a first camera and a second camera. In the embodiments of the present application, the terminal device can be applied to a video chat scene, a live broadcast scene, and a shooting scene, etc., that is, a certain camera (such as the first camera or the second camera) of the terminal device can be in a shooting state, and a certain display screen (such as the first display screen or the second display screen) of the terminal device can display the image shot by the camera. For example, the first camera can be in a shooting state and the first display screen can display the image shot by the first camera.

[0143] For example, as shown in A of FIG. 1, when the mobile phone is in the folded state, the camera 111 can be in a shooting state, and the display screen 110 can display the image of the camera 111.

[0144] For another example, as shown in B or C of FIG. 1, when the mobile phone is in the unfolded state, the camera 121 can be in a shooting state, and the display screen 120 can display the image of the camera 121; or, when the mobile phone is in the unfolded state, the camera 111 (located on the back of the mobile phone in the unfolded state shown in B or C of FIG. 1) can be in a shooting state, and the display screen 120 can display the image of the camera 111.

[0145] For another example, as shown in C of FIG. 2, when the mobile phone is in the folded state, the camera 221 can be in a shooting state, and the display screen 220 can display the image of the camera 221.

[0146] For another example, as shown in A or B of FIG. 2, when the mobile phone is in the unfolded state, the camera 211 can be in a shooting state, and the display screen 210 can display the image of the camera 211; or, when the mobile phone is in the unfolded state, the camera 221 (located on the back of the mobile phone in the unfolded state shown in A or B of FIG. 2) can be in a shooting state, and the display screen 210 can display the image of the camera 221.

[0147] In some embodiments, the open-close state of the terminal device can be adjusted to the second state according to the first instruction.

[0148] Optionally, the first state and the second state can be different. For example, if the first state is the unfolded state, the second state can be the folded state; if the first state is the folded state, the second state can be the unfolded state.

[0149] S1020, in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display an image shot by the second camera.

[0150] In the embodiments of the present application, the first instruction is used to adjust the open-close state of the terminal device to the second state, in response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display an image shot by the second camera, so that when the open-close state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen is controlled to display the image shot by the camera, which can avoid the interruption of the shooting image displayed on the display screen (for example, the display screen appears black or cannot normally display the shooting image, etc.), thereby improving the user experience.

[0151] In some embodiments, the first camera and the second camera can be in an open state at the same time. For example, when the terminal device is in the second state, the first camera can be in an open state. It should be noted that the open state here can be understood as: the first camera remains in a powered-on state. That is, the first camera and the second camera can remain in a powered-on state at the same time.

[0152] In the embodiments of the present application, the first camera and the second camera are in an open state at the same time, so that when the open-close state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen is controlled to display the image shot by the camera, thereby improving the user experience.

[0153] In some embodiments, the camera in a non-shooting state can be turned off. For example, when the terminal device is in the second state, the first camera can be in an off state. It should be noted that the off state here can be understood as: the first camera is not powered or the first camera is powered off.

[0154] In the embodiments of the present application, when the terminal device is in the second state, the first camera is in an off state, so that by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, and the standby time of the terminal device can be prolonged, thereby improving the user experience.

[0155] In some embodiments, the first camera and the second camera can be the same camera. For example, the first camera and the second camera can be an outer screen camera. When the open-close state of the terminal device is in the unfolded state, the outer screen camera can be used for shooting, and the inner screen can be used to display the image shot by the outer screen camera. When the open-close state of the terminal device is adjusted to the folded state, the outer screen camera can be used for shooting, and the outer screen can be used to display the image shot by the outer screen camera.

[0156] For the up-down folding terminal device shown in FIGS. 2 and 4, the present embodiment can also provide a technical solution that can avoid the inversion of the shooting image displayed by the display screen of the terminal device.

[0157] For the folding screen terminal device, the outer screen camera can be used as a rear camera or a front camera. For example, when the terminal device is in the unfolded state, the outer screen camera is used to shoot a rear scene, and the outer screen camera is a rear camera. When the terminal device is in the folded state, the outer screen camera is used for self-shooting, and the outer screen camera is a front camera.

[0158] It should be noted that the rear camera referred to here is relative to the front camera. For example, the front camera can refer to a camera facing the user, such as a camera for self-shooting, and the rear camera can refer to a camera facing away from the user, such as a camera for shooting a scene opposite the user.

[0159] In the case where the second state is the folded state, the second camera can be an outer screen camera. For example, in the case where the terminal device is in the folded state, the second camera can be used as a front camera. At this time, if the second camera is still used as a rear camera, as shown in the left part of FIG. 9, the shooting image displayed by the second display screen will be inverted. At this time, the angle of the image displayed by the display screen can be adjusted.

[0160] For example, the method 1000 can further include step S1030, which is specifically as follows:

[0161] S1030, adjust the angle of the image displayed by the second display screen.

[0162] In some embodiments, in the case where the second camera is used as a front camera, the angle of the image (or shooting image) displayed by the second display screen can be adjusted.

[0163] For example, as shown in FIG. 11, the open-close state of the terminal device 1100 is the folding state, the display screen 1110 is an outer screen, and the camera 1120 is an outer screen camera. The user uses the camera 1120 for video call (at this time, the camera 1120 is used as a front camera), and the display screen 1110 can display the video picture taken by the camera 1120, as shown in the left picture of FIG. 11. The video picture displayed on the display screen 1110 is inverted, at this time, the video picture displayed on the display screen 1110 can be flipped by 180 degrees, and the flipped video picture can be as shown in the right picture of FIG. 11.

[0164] In the embodiment of the present application, when the open-close state of the terminal device is in the folding state, the angle of the image displayed on the second display screen is adjusted, which can avoid the inversion of the shooting picture displayed on the display screen, thereby improving the user experience.

[0165] The embodiment in which the first camera and the second camera are both in the open state will be described below with reference to FIG. 12.

[0166] FIG. 12 is a schematic flowchart of a method for controlling a terminal device according to an embodiment of the present application. The method 1200 shown in FIG. 12 can include steps S1210-S1270, and the details are as follows.

[0167] S1210, the device reports the capability.

[0168] When the user starts the terminal device (turns on the terminal device), each device in the bottom layer of the terminal device can report the capability.

[0169] For example, the camera can report three sets of front capabilities, which are respectively unfolded front, folding front and logical front. The unfolded front can correspond to the inner screen camera, the device identifier can be device2, the device orientation of device2 can be front (front), and the sensor orientation of device2 can be 90°. The folding front can correspond to the outer screen camera, the device identifier can be device1, the device orientation of device1 can be front (front), and the sensor orientation of device1 can be 270°. The device identifier of the logical front can be device3, the logical front can include the inner screen camera and the outer screen camera, the device identifier of the inner screen camera can be device2, and the device identifier of the outer screen camera can be device1.

[0170] It should be noted that the parameters corresponding to the above various front capabilities are only examples and are not limited, for example, the sensor orientation of the inner screen camera can also be 270°, and the sensor orientation of the outer screen camera can also be 90°.

[0171] S1220, open the inner screen camera and the outer screen camera simultaneously, use the inner screen camera to take a picture and control the inner screen to display the picture taken by the inner screen camera.

[0172] If the user opens the video call when the terminal device is in the unfolded state, the terminal device can be controlled to open the logically front camera, i.e., the inner screen camera (device2) and the outer screen camera (device1) are opened simultaneously (i.e., both the inner screen camera and the outer screen camera are powered on). At this time, the inner screen camera (device2) can be used to take a picture and the inner screen can be controlled to display the picture taken by the inner screen camera (device2).

[0173] S1230, perceive the opening and closing state of the terminal device.

[0174] During the video call, the opening and closing state of the terminal device can be continuously perceived whether it changes.

[0175] S1240, switch the inner screen camera to the outer screen camera and use the outer screen to display the picture taken.

[0176] If the user folds the terminal device during the video call, the opening and closing state of the terminal device can be perceived to change to the folded state through step S1230, at this time, the inner screen camera (device2) can be switched to the outer screen camera (device1) and the outer screen can be used to display the picture taken.

[0177] For example, as shown in FIG. 13, when the mobile phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the picture taken by the inner screen camera. At this time, if the user closes the mobile phone (i.e., sets the mobile phone to the folded state), the outer screen of the mobile phone is in the locked state, and the outer screen has no picture (may only have sound). After the user unlocks the outer screen, the outer screen can display the picture taken by the outer screen camera.

[0178] At this time, the outer screen camera is used as a rear camera, and the image displayed on the outer screen can be flipped, for example, the image displayed on the outer screen can be flipped by 180°, so that the picture taken by the display screen can be avoided from being upside down, thereby improving the user experience.

[0179] S1250, switch the outer screen camera to the inner screen camera and use the inner screen to display the picture taken.

[0180] If the user unfolds the terminal device during the video call, the opening and closing state of the terminal device can be perceived to change to the unfolded state through step S1230, at this time, the outer screen camera (device1) can be switched to the inner screen camera (device2) and the inner screen can be used to display the picture taken.

[0181] For example, as shown in FIG. 14, when the mobile phone is in the folded state, the user uses the outer screen for video call, and the outer screen displays the shooting picture of the outer screen camera. At this time, if the user unfolds the mobile phone (i.e., sets the mobile phone to the unfolded state), the inner screen of the mobile phone can display the picture shot by the inner screen camera.

[0182] S1260, determining whether the video call is ended.

[0183] If the video call is ended, S1270 can be performed; if the video call is not ended, S1230 can be performed, i.e., continuously sensing whether the opening and closing state of the terminal device changes.

[0184] S1270, closing the inner screen camera and the outer screen camera.

[0185] In the case where the video call is ended, the inner screen camera (device2) and the outer screen camera (device1) are closed.

[0186] The embodiment of closing the camera in the non-shooting state is described below with reference to FIG. 15.

[0187] FIG. 15 is a schematic flowchart of a method for controlling a terminal device according to an embodiment of the present application. The method 1500 shown in FIG. 15 can include steps S1510 to S1570, and the details are as follows.

[0188] S1510, the device reports the capability.

[0189] When the user starts the terminal device (turns on the terminal device), each device in the underlying layer of the terminal device can report the capability.

[0190] For example, the camera can report two sets of front-facing capabilities, which are unfolded state front-facing and folded state front-facing. The unfolded state front-facing can correspond to the inner screen camera, the device identifier can be device2, the device orientation of device2 can be front (front), and the sensor angle of device2 can be 90°. The folded state front-facing can correspond to the outer screen camera, the device identifier can be device1, the device orientation of device1 can be front (front), and the sensor angle of device1 can be 270°.

[0191] S1520, turning on the inner screen camera, using the inner screen camera for shooting, and controlling the inner screen to display the picture shot by the inner screen camera.

[0192] If the user opens the video call when the terminal device is in the unfolded state, the terminal device can be controlled to open the front camera in the unfolded state, i.e., to open the inner screen camera (i.e., to power on the inner screen camera). At this time, the inner screen camera (device 2) can be used to take pictures and the inner screen can be controlled to display the pictures taken by the inner screen camera (device 2).

[0193] S1530, sensing the open / close state of the terminal device.

[0194] During the video call, the open / close state of the terminal device can be continuously sensed for changes.

[0195] S1540, closing the inner screen camera, opening the outer screen camera, and using the outer screen to display the pictures taken.

[0196] If the user folds the terminal device during the video call, the open / close state of the terminal device can be sensed to change to the folded state through step S1330. At this time, the inner screen camera (device 2) can be closed, the outer screen camera (device 1) can be opened, and the outer screen can be used to display the pictures taken.

[0197] For example, as shown in FIG. 13, when the mobile phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the pictures taken by the inner screen camera. At this time, if the user folds the mobile phone (i.e., sets the mobile phone to the folded state), the outer screen of the mobile phone is in the locked state, and the outer screen has no picture (possibly only sound). After the user unlocks the outer screen, the outer screen can display the pictures taken by the outer screen camera.

[0198] At this time, the outer screen camera is used as a rear camera, and the image displayed on the outer screen can be flipped, for example, the image displayed on the outer screen can be flipped by 180°. In this way, the taken pictures displayed on the display screen can be prevented from being upside down, thereby improving the user experience.

[0199] S1550, closing the outer screen camera, opening the inner screen camera, and using the inner screen to display the pictures taken.

[0200] If the user unfolds the terminal device during the video call, the open / close state of the terminal device can be sensed to change to the unfolded state through step S1330. At this time, the outer screen camera (device 1) can be closed, the inner screen camera (device 2) can be opened, and the inner screen can be used to display the pictures taken.

[0201] For example, as shown in FIG. 14, when the mobile phone is in the folded state, the user uses the outer screen to make a video call, and the outer screen displays the pictures taken by the outer screen camera. At this time, if the user unfolds the mobile phone (i.e., sets the mobile phone to the unfolded state), the inner screen of the mobile phone can display the pictures taken by the inner screen camera.

[0202] S1560, determining whether the video call is ended.

[0203] If the video call is ended, S1570 can be performed; if the video call is not ended, S1530 can be performed, i.e., continuously sensing whether the open-close state of the terminal device changes.

[0204] S1570, turning off the inner screen camera or the outer screen camera.

[0205] In the case where the video call is ended, the inner screen camera or the outer screen camera is turned off.

[0206] The method embodiments of the present application are described in detail above in combination with FIGS. 1-15, and the device embodiments of the present application are described in detail below in combination with FIGS. 16 and 17. It should be understood that the description of the method embodiments and the description of the device embodiments correspond to each other, and thus, the parts not described in detail can be referred to the foregoing method embodiments.

[0207] FIG. 16 is a schematic structural diagram of a device 1600 for controlling a terminal device according to an embodiment of the present application. The terminal device includes a first display screen, a second display screen, a first camera, and a second camera. At least one of the first display screen and the second display screen is a folding screen. The open-close state of the terminal device is in a first state. The first camera is in a shooting state, and the first display screen displays an image shot by the first camera.

[0208] As shown in FIG. 16, the device 1600 includes an obtaining unit 1610 and a control unit 1620, which are specifically as follows.

[0209] The obtaining unit 1610 is configured to obtain a first instruction of a user, the first instruction being used to adjust the open-close state of the terminal device to a second state.

[0210] The control unit 1620, in response to the first instruction, is configured to control the second camera to be in a shooting state, and control the second display screen to display an image shot by the second camera.

[0211] In the embodiments of the present application, the first instruction is used to adjust the open-close state of the terminal device to a second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display an image shot by the second camera. In this way, when the open-close state of the terminal device changes, the camera in the shooting state can be switched, and the corresponding display screen can be controlled to display the image shot by the camera, which can avoid the interruption of the shooting image displayed on the display screen (for example, the display screen appears black or cannot normally display the shooting image, etc.), thereby improving the user experience.

[0212] In some possible implementation manners, the open-close state of the terminal device includes an unfolded state and a folded state.

[0213] In some possible implementation manners, the first camera is in an open state when the terminal device is in the second state.

[0214] In the embodiments of the present application, the first camera and the second camera are in the open state simultaneously, so that when the open / close state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can display the image shot by the camera, thereby improving the user experience.

[0215] In some possible implementation manners, the first camera is in a closed state when the terminal device is in the second state.

[0216] In the embodiments of the present application, the first camera is in the closed state when the terminal device is in the second state, so that by closing the camera which does not need to display the shot image, the power consumption of the terminal device can be reduced and the standby time of the terminal device can be prolonged, thereby improving the user experience.

[0217] In some possible implementation manners, the second state is a folded state, and the apparatus 1600 further includes an adjusting unit 1630 configured to adjust the angle of the image displayed by the second display screen.

[0218] In the embodiments of the present application, in the case that the open / close state of the terminal device is in the folded state, the angle of the image displayed by the second display screen is adjusted, so that the shot image displayed by the display screen can be prevented from being upside down, thereby improving the user experience.

[0219] In some possible implementation manners, the adjusting unit 1630 is specifically configured to flip the image displayed by the second display screen by 180 degrees.

[0220] FIG. 17 is a schematic structural diagram of an apparatus according to an embodiment of the present application. The dashed line in FIG. 17 indicates that the unit or module is optional. The apparatus 1700 can be used to implement the methods described in the above method embodiments. The apparatus 1700 can be a chip or an apparatus for controlling a terminal device.

[0221] The apparatus 1700 can include one or more processors 1710. The processor 1710 can support the apparatus 1700 to implement the methods described in the preceding method embodiments. The processor 1710 can be a general processor or a dedicated processor. For example, the processor can be a central processing unit (CPU). Alternatively, the processor can also be other general processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general processor can be a microprocessor or the processor can also be any conventional processor or the like.

[0222] The apparatus 1700 can also include one or more memories 1720. The memory 1720 stores programs, which can be executed by the processor 1710, so that the processor 1710 performs the methods described in the preceding method embodiments. The memory 1720 can be independent of the processor 1710 or integrated in the processor 1710.

[0223] The apparatus 1700 can also include a transceiver 1730. The processor 1710 can communicate with other devices or chips through the transceiver 1730. For example, the processor 1710 can perform data transceiving with other devices or chips through the transceiver 1730.

[0224] It should be noted that the information exchange, execution process and the like between the above apparatus / units, since based on the same concept as the method embodiments of the present application, the specific functions and the technical effects brought by them can be referred to the method embodiments part, and will not be described here.

[0225] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is exemplified, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to complete all or part of the above described functions. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of software functional unit. In addition, the specific name of each functional unit and module is only for convenient distinction, and does not limit the protection scope of the present application. The specific working process of the units and modules in the system can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0226] The embodiment of the present application further provides a computer readable storage medium, the computer readable storage medium stores a computer program, and the computer program is executed by a computer to make the computer implement the steps in each of the method embodiments.

[0227] The embodiment of the present application provides a computer program product, when the computer program product is run on a terminal device (such as a server or a terminal device), so that the terminal device implements the steps in each of the method embodiments.

[0228] The embodiment of the present application provides a chip, the chip includes a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory, so that the terminal device (such as a server or a terminal device) installed with the chip executes the steps in each of the method embodiments.

[0229] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the present application can implement all or part of the processes in the above-mentioned embodiment methods through a computer program to instruct relevant hardware to complete, and the computer program can be stored in a computer readable storage medium. When the computer program is executed by a processor, the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable files or some intermediate forms. The computer readable storage medium at least includes any entity or device capable of carrying the computer program code to the device / terminal equipment, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, according to legislation and patent practice, the computer readable storage medium can not be an electrical carrier signal and a telecommunication signal.

[0230] In the above embodiments, the description of each embodiment has its own focus, and the parts not described or recorded in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0231] Those of ordinary skill in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0232] In the embodiments provided by the present application, it should be understood that the disclosed apparatus / terminal equipment and method can be implemented in other ways. For example, the above-described apparatus / terminal equipment embodiments are only schematic. For example, the division of the modules or units is only a logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between each of the units can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or in other forms.

[0233] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may also be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0234] The above is merely a specific implementation of the present application, but the protection scope of the present application is not limited thereto, any change or replacement within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of controlling a terminal device, characterized by, The terminal device comprises a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen is a folding screen, the open-close state of the terminal device is in a first state, the first camera is in a shooting state and the first display screen displays an image shot by the first camera; The method comprises: obtaining a first instruction of a user, the first instruction being used to adjust the open-close state of the terminal device to a second state; in response to the first instruction, controlling the second camera to be in a shooting state and controlling the second display screen to display an image shot by the second camera.

2. The method of claim 1, wherein, The open-close state of the terminal device comprises an unfolded state and a folded state.

3. The method according to claim 1 or 2, characterized in that, When the terminal device is in the second state, the first camera is in an open state.

4. The method according to claim 1 or 2, characterized in that, When the terminal device is in the second state, the first camera is in a closed state.

5. The method according to any one of claims 1 to 4, characterized in that, The second state is a folded state, and the method further comprises: adjusting the angle of the image displayed by the second display screen.

6. The method of claim 5, wherein, The adjustment of the angle of the image displayed by the second display screen comprises: turning the image displayed by the second display screen by 180 degrees.

7. An apparatus for controlling a terminal device, the apparatus comprising: The terminal device comprises a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen is a folding screen, the open-close state of the terminal device is in a first state, the first camera is in a shooting state and the first display screen displays an image shot by the first camera; The device comprises: an obtaining unit configured to obtain a first instruction of a user, the first instruction being used to adjust the open-close state of the terminal device to a second state; a control unit configured to, in response to the first instruction, control the second camera to be in a shooting state and control the second display screen to display an image shot by the second camera.

8. The apparatus of claim 7, wherein, The open-close state of the terminal device comprises an unfolded state and a folded state.

9. The apparatus of claim 7 or 8, wherein, When the terminal device is in the second state, the first camera is in an open state.

10. The apparatus of claim 7 or 8, wherein, When the terminal device is in the second state, the first camera is in a closed state.

11. The apparatus of any one of claims 7 to 10, wherein, The second state is a folded state, and the device further comprises an adjusting unit configured to: adjust the angle of the image displayed by the second display screen.

12. The apparatus of claim 11, wherein, The adjusting unit is specifically configured to: turn the image displayed by the second display screen by 180 degrees.

13. An apparatus for controlling a terminal device, the apparatus comprising: comprises: a processor and a memory, the processor is coupled with the memory, the memory is used to store a computer program, the computer program is executed by the processor, so that the device executes the method in any one of claims 1 to 6.

14. A terminal device, comprising: The terminal device comprises the device in any one of claims 7 to 13.

15. A computer readable storage medium characterized by: The computer readable storage medium stores a computer program, when the computer program runs on a computer, so that the computer executes the method in any one of claims 1 to 6.

16. A computer program product, characterised in that, comprises: a computer program, when the computer program runs on a computer, so that the computer executes the method in any one of claims 1 to 6.

17. A chip, characterized by comprises: a processor and a memory for storing a computer program, the processor being configured to invoke and run the computer program stored in the memory, so that a device or apparatus in which the chip is installed performs the method according to any one of claims 1 to 6.

Images