Method and device for controlling terminal equipment

Abstract

The invention provides a method and device for controlling terminal equipment, and relates to the technical field of terminals. The terminal equipment comprises a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen is a folding screen, and the opening and closing state of the terminal equipment is in a first state. The first camera is in a shooting state, and the first display screen displays an image shot by the first camera; the method comprises the steps that a first instruction of a user is acquired, and the first instruction is used for adjusting the opening and closing state of the terminal equipment into a second state; and in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display an image shot by the second camera. According to the method in the embodiment of the invention, interruption of the shot picture displayed by the display screen can be avoided, and the user experience can be improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a method and apparatus for controlling a terminal device. Background Art

[0002] With the continuous advancement of science and technology, more and more terminal devices with displays are widely used in people's daily lives and work. At the same time, with the rapid development of screen technology, the displays of terminal devices are becoming larger and larger, providing users with richer information. However, a terminal device with a large display screen will seriously affect its portability. Therefore, in recent years, many foldable screen terminal devices (i.e., terminal devices equipped with foldable screens, such as foldable screen mobile phones and foldable screen tablets) have emerged.

[0003] However, existing foldable screen terminal devices still have some problems that affect the user experience. Summary of the Invention

[0004] The present application provides a method and apparatus for controlling a terminal device, which can avoid interruption of a captured image displayed on a display screen and improve user experience.

[0005] In a first aspect, a method for controlling a terminal device is provided, wherein the terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a folding screen, the opening and closing state of the terminal device is in a first state, the first camera is in a shooting state, and the first display screen displays an image captured by the first camera; wherein the method includes: obtaining a first instruction from a user, the first instruction being used to adjust the opening and closing state of the terminal device to a second state; in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display the image captured by the second camera.

[0006] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0007] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0008] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0009] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0010] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0011] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0012] In some possible implementations, the second state is a folded state, and the method further includes: adjusting an angle of an image displayed on the second display screen.

[0013] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0014] In some possible implementations, adjusting the angle of the image displayed on the second display screen includes: flipping the image displayed on the second display screen by 180 degrees.

[0015] In a second aspect, a device for controlling a terminal device is provided, wherein the terminal device includes a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen is a folding screen, the opening and closing state of the terminal device is in a first state, the first camera is in a shooting state and the first display screen displays an image captured by the first camera; wherein the device includes: an acquisition unit for acquiring a first instruction from a user, the first instruction being used to adjust the opening and closing state of the terminal device to a second state; a control unit, responsive to the first instruction, for controlling the second camera to be in a shooting state, and controlling the second display screen to display the image captured by the second camera.

[0016] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0017] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0018] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0019] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0020] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0021] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0022] In some possible implementations, the second state is a folded state, and the device further includes an adjustment unit configured to adjust an angle of an image displayed on the second display screen.

[0023] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0024] In some possible implementations, the adjustment unit is specifically configured to flip the image displayed on the second display screen by 180 degrees.

[0025] In a third aspect, a device for controlling a terminal device is provided, comprising: a processor and a memory, wherein the processor is coupled to the memory, and the memory is used to store a computer program (also referred to as code, or instructions). When the computer program is executed by the processor, the device executes the method in the first aspect or any possible implementation of the first aspect.

[0026] In some possible implementations, the apparatus further includes a memory coupled to the processor.

[0027] In some possible implementations, there are one or more processors and / or one or more memories.

[0028] In some possible implementations, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

[0029] In a fourth aspect, a terminal device is provided, which is a folding screen terminal device, and the terminal device includes the device in the above-mentioned second aspect or any possible implementation of the second aspect, or the device in the above-mentioned third aspect or any possible implementation of the third aspect.

[0030] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program (also referred to as code or instructions) is stored. When the computer program runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0031] In the sixth aspect, a computer program product is provided, comprising: a computer program (also referred to as code, or instructions), which, when run on a computer, enables the computer to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0032] In the seventh aspect, a chip is provided, comprising: a processor and a memory, wherein the memory is used to store a computer program (also referred to as code, or instructions), and the processor is used to call and run the computer program stored in the memory, so that a device or equipment equipped with the chip executes the method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a structural diagram of a folding screen terminal device provided by an embodiment of the present application.

[0034] Figure 2 This is a structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0035] Figure 3This is a structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0036] Figure 4 This is a structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0037] Figure 5 This is a schematic diagram of the hardware structure of a folding screen terminal device provided by an embodiment of the present application.

[0038] Figure 6 This is a schematic diagram of the software structure of a folding screen terminal device provided by an embodiment of the present application.

[0039] Figure 7 This is a schematic diagram of the software and hardware structure of a foldable screen terminal device provided by an embodiment of the present application.

[0040] Figure 8 This is a schematic block diagram of using a foldable screen terminal device to make a video call in one embodiment of the present application.

[0041] Figure 9 This is a schematic block diagram of using a foldable screen terminal device for making a video call in another embodiment of the present application.

[0042] Figure 10 This is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application.

[0043] Figure 11 This is a schematic block diagram of adjusting the angle of an image displayed on a display screen in one embodiment of the present application.

[0044] Figure 12 This is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application.

[0045] Figure 13 This is a schematic block diagram of using a foldable screen terminal device to make a video call in one embodiment of the present application.

[0046] Figure 14 This is a schematic block diagram of using a foldable screen terminal device for making a video call in another embodiment of the present application.

[0047] Figure 15 This is a schematic flowchart of a method for controlling a terminal device provided in another embodiment of the present application.

[0048] Figure 16 This is a schematic structural diagram of an apparatus for controlling terminal equipment provided in one embodiment of the present application.

[0049] Figure 17 It is a schematic structural diagram of a device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0051] In the description of this application, unless otherwise specified, the character " / " indicates that the objects associated before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, in the description of this application, unless otherwise specified, "at least one" refers to one or more, and "more than one" refers to two or more than two. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. It should be understood that in the present application, similar descriptions such as "under the circumstances of...", "if...", "when...", and "if..." can be used interchangeably.

[0052] The technical solutions in the embodiments of the present application can be applied to various foldable screen terminal devices. The foldable screen terminal device in the embodiments of the present application can refer to a terminal device equipped with a foldable screen, such as a mobile phone, a tablet computer, a smart watch, a wearable device, an in-vehicle device, an augmented reality (AR) device, a virtual reality (VR) device, etc. The embodiments of the present application do not limit the specific form of the foldable screen terminal device.

[0053] The following combination Figure 1 and Figure 2 , taking a foldable screen mobile phone as an example, the structure of the foldable screen terminal device is described.

[0054] For example, Figure 1 The figure shows a schematic diagram of a folding screen mobile phone structure provided by an embodiment of the present application. Figure 1Figure A in the figure shows a schematic diagram of a foldable screen mobile phone in a folded state (or can also be called a folded state, etc.). Among them, the display screen 110 and the camera 111 can work when the mobile phone (unless otherwise specified, the mobile phones in the embodiments of this application refer to foldable screen mobile phones) is in a folded state. Optionally, the display screen 110 and the camera 111 can be set on the outside of the mobile phone (the outside here can be understood as the outside of the mobile phone when it is in a folded state). Therefore, the display screen 110 can be called an external screen, and the camera 111 can be called an external screen camera. It should be noted that Figure 1 Figure A in FIG only takes a display screen and a camera as an example. In the present application, the display screen 110 may include one or more display screens, and the camera 111 may include one or more cameras.

[0055] Figure 1 Figure B in FIG is a schematic diagram of a foldable screen mobile phone in an unfolded state (or also called a flattened state, unfolded state, etc.). For example, Figure 1 The mobile phone shown in Figure A is unfolded around the axis at the folding area. Figure 1 The expanded state is shown in Figure B. Figure 1 The display screen 110 and the camera 111 shown in FIG. A can be located in Figure 1 The back of the mobile phone in the unfolded state shown in Figure B (not shown in Figure B). Figure 1 As shown in Figure B in the figure, there is a folding area on the screen, and the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area to achieve unfolding or folding. For example, hinges and other components can be provided at the folding area, so that the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area. As shown in Figure B, the folding area can divide the display screen 110 into two parts, namely the first display area and the second display area, and the first display area and the second display area can be rotated around the rotating axis at the folding area. As shown in Figure B, the display screen 120 and the camera 121 can work when the mobile phone is in the unfolded state, and at the same time, the display screen 110 and / or the camera 111 can also work when the mobile phone is in the unfolded state. Optionally, the display screen 120 and the camera 121 can be arranged on the inner side of the mobile phone (the inner side here can be understood as the inner side of the mobile phone when it is in the folded state), so the display screen 120 can be called an inner screen, and the camera 121 can be called an inner screen camera. It should be noted that, Figure 1 Figure B in the figure only takes a display screen and a camera as an example. In the present application, the display screen 120 may include one or more display screens, and the camera 121 may include one or more cameras (for example, the camera 121 may be a camera group including multiple cameras).

[0056] Figure 1 Figure C shows the Figure 1 FIG. B shows a schematic diagram of a mobile phone in which the first display area and the second display area of ​​the display screen 120 are folded around the rotation axis at the folding area to form a folding angle φ. It is understood that if the folding angle φ is between 0° and 360°, the mobile phone can be considered to be in the unfolded state, and if the folding angle φ is 0° or 360°, the mobile phone can be considered to be in the folded state.

[0057] It should be noted that Figure 1 Figure C shows that the display screen 120 is folded in the direction opposite to the first display area and the second display area in the expanded form (i.e., an outward folding method). The display screen 120 can also be folded in the direction facing the first display area and the second display area in the expanded form (i.e., an inward folding method).

[0058] Figure 1 The foldable screen terminal device is shown as folding left and right. In the embodiment of the present application, the foldable screen terminal device can also be folded up and down. Figure 2 Introducing a terminal device that folds up and down.

[0059] Figure 2 FIG. A in FIG. 1 is a schematic diagram of a folding screen mobile phone in an unfolded state provided by an embodiment of the present application. Figure 2 As shown in Figure A in the figure, there is a folding area on the screen, and the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area to achieve unfolding or folding. For example, hinges and other components can be set at the folding area, so that the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area. As shown in Figure A, the folding area can divide the display screen 210 into two parts, namely the first display area and the second display area, and the first display area and the second display area can be rotated around the rotating axis at the folding area. As shown in Figure A, the display screen 210 and the camera 211 can work when the mobile phone is in the unfolded state. At the same time, the display screen 210 and / or camera 211 shown in Figure A can also work when the mobile phone is in the unfolded state. Optionally, the display screen 210 and the camera 211 can be set on the inner side of the mobile phone (the inner side here can be understood as the inner side of the mobile phone when it is in the folded state). Therefore, the display screen 210 can be called an inner screen, and the camera 211 can be called an inner screen camera. It should be noted that, Figure 2 Figure A in the figure only uses a display screen and a camera as an example. In this application, the display screen 210 may include one or more display screens, and the camera 211 may include one or more cameras (for example, the camera 211 may be a camera group including multiple cameras). As shown in Figure A, there is a folding area on the display screen 210. The screens located above and below the folding area can be rotated around the rotation axis of the folding area to be unfolded or folded.

[0060] Figure 2 Figure B shows the Figure 2 FIG. A in FIG. 1 shows a schematic diagram of a mobile phone in which the first display area and the second display area of ​​the display screen 210 are folded around the rotation axis at the folding area to form a folding angle φ. It is understood that if the folding angle φ is between 0° and 360°, the mobile phone can be considered to be in the unfolded state, and if the folding angle φ is 0° or 360°, the mobile phone can be considered to be in the folded state.

[0061] Figure 2 Figure C shows a schematic diagram of a foldable screen mobile phone in a folded state (or it can also be called a folded state, etc.). Figure 2 Figure C shows the Figure 2 The mobile phone shown in Figure A in the figure is a schematic diagram of folding the first display area and the second display area of ​​the display screen 210 around the rotating axis at the folding area to form a folding angle of 0. As shown in Figure C, the display screen 220 and the camera 221 can work when the mobile phone is in a folded state. Optionally, the display screen 220 and the camera 221 can be set on the outside of the mobile phone (the outside here can be understood as the outside of the mobile phone when it is in a folded state). Therefore, the display screen 220 can be called an external screen, and the camera 2211 can be called an external screen camera. It should be noted that Figure 2 Figure C in FIG. 2 only uses one display screen and one camera as an example. In the present application, the display screen 220 may include one or more display screens, and the camera 221 may include one or more cameras (for example, the camera 221 may be a camera group including multiple cameras). The shapes and positions of the display screen 220 and the camera 221 are also limited to examples only.

[0062] It should be noted that Figure 2 Figure B shows that the display screen 210 is folded in the direction facing the first display area and the second display area in the expanded form (i.e., an inward folding method). The display screen 210 can also be folded in the direction opposite to the first display area and the second display area in the expanded form (i.e., an outward folding method).

[0063] Figure 3 The figure shows a schematic diagram of a two-fold folding screen mobile phone structure provided by an embodiment of the present application. Figure 3 Figure A in FIG shows a schematic diagram of a folding screen mobile phone in an unfolded state (ie, flattened state). Figure 3As shown in Figure A in the figure, there are two folding areas on the screen, and the screens on the left and right sides of any folding area can be rotated around the rotating axis at the folding area to achieve unfolding or folding. For example, hinges and other components can be set at the folding area, so that the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area. As shown in Figure A, the display screen 310 of the mobile phone is divided into three parts by the folding area, namely the first display area, the second display area and the third display area, and the first display area, the second display area and the third display area can all rotate around the rotating axis at the folding area. As shown in Figure A, the display screen 310 and the camera 311 can work when the mobile phone is in the unfolded state. It should be noted that, Figure 3 Only one display screen and one camera are taken as examples. In this application, the display screen 310 may include one or more display screens, and the camera 311 may include one or more cameras (for example, the camera 311 may be a camera group including multiple cameras).

[0064] Figure 3 Figure B shows another schematic diagram of a foldable screen mobile phone in the unfolded state. Figure 3 Figure B shows the Figure 3 The foldable screen mobile phone shown in Figure A is a schematic diagram showing that the foldable screen mobile phone is folded around the rotation axis at the folding area, in the direction where the first display area and the second display area are opposite to each other (i.e., outward folding mode) to form a folding angle φ (i.e., the inward folding angle of the back of the screen is φ, and φ can be less than 180°), and in the direction where the second display area and the third display area are facing each other (i.e., inward folding mode) to form a folding angle φ (i.e., the inward folding angle of the front of the screen is φ, and φ can be less than 180°). In other embodiments of the present application, Figure 3 The foldable screen mobile phone shown in Figure A is folded in the direction where the first display area and the second display area face each other (i.e., inward folding) and the second display area and the third display area are opposite to each other (i.e., outward folding). This is not limited in the embodiments of the present application.

[0065] Figure 3 The two-fold folding screen mobile phone is shown as folding left and right. In the embodiment of the present application, the two-fold or multi-fold folding screen mobile phone can also be folded up and down, for example, Figure 4 The picture shows a two-fold folding screen mobile phone folded up and down.

[0066] Figure 4 The figure shows another schematic diagram of a two-fold folding screen mobile phone structure provided by an embodiment of the present application. Figure 4Figure A in the figure shows a schematic diagram of a two-fold folding screen mobile phone in the unfolded state. There are two folding areas on the screen. The screens located on the upper and lower sides of any folding area can be rotated around the rotating axis at the folding area to achieve unfolding or folding. For example, hinges and other components can be set at the folding area, so that the screens on the left and right sides of the folding area can be rotated around the rotating axis at the folding area. As shown in Figure A, the display screen 410 of the mobile phone is divided into three parts by the folding area, namely the first display area, the second display area and the third display area. The first display area, the second display area and the third display area can all rotate around the rotating axis at the folding area. As shown in Figure A, the display screen 410 and the camera 411 can work when the mobile phone is in the unfolded state. It should be noted that, Figure 4 Only one display screen and one camera are taken as examples. In this application, the display screen 410 may include one or more display screens, and the camera 411 may include one or more cameras (for example, the camera 411 may be a camera group including multiple cameras).

[0067] Figure 4 Figure B in the figure shows another schematic diagram of a folding screen mobile phone in the unfolded state. Figure 4 As shown in Figure B of the foldable display, when unfolded, the display can be folded in a direction where the first and second display areas face each other (i.e., folding inwards), forming a folding angle φ, which can be less than 180°. The second and third display areas are flattened relative to the folding area, i.e., the front faces of the second and third display areas form a folding angle φ, which can be 180°.

[0068] It should be understood that in other embodiments of the present application, the foldable display screen, in the unfolded state, can also be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an outward folding mode) and the second display area and the third display area are opposite to each other (i.e., an inward folding mode); or, it can be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an inward folding mode) and the second display area and the third display area are opposite to each other (i.e., an outward folding mode); or, it can be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an outward folding mode) and the second display area and the third display area are opposite to each other (i.e., an outward folding mode). The embodiments of the present application are not limited here.

[0069] That is, in the various folding screen terminal devices provided in this application (for example, including folding screen mobile phones, folding screen tablets, etc.), the display areas on both sides of any folding area can be folded outward or inward. This embodiment of the application is not limited here.

[0070] It should be noted that the one-fold folding screen mobile phone described in the embodiment of this application can be understood as Figure 1 or Figure 2 The folding screen mobile phone shown in the figure has a rotating shaft; the two-fold folding screen mobile phone described in the embodiment of the present application can be understood as Figure 3 or Figure 4 The foldable screen mobile phone shown has two rotating shafts. In other embodiments, the one-fold foldable screen mobile phone and the two-fold foldable screen mobile phone may also have other names, for example, Figure 3 or Figure 4 The folding screen mobile phone shown can also be called a three-fold screen mobile phone because it has three display areas. This application does not limit its name.

[0071] It should also be understood that in the embodiments of the present application, the inward folding method can be understood as: folding the two display areas to the left and right or above and below the axis of a folding area in a direction in which the two screen fronts face each other. Among them, the screen front can be understood as the side of the folding screen phone's larger display (i.e., the foldable flexible display) that displays an image or picture. With this folding method, the angle between the two screen fronts (i.e., the inward folding angle of the screen front) will become smaller and smaller during the folding process.

[0072] In the embodiments of the present application, the outward folding method can be understood as: folding the two display areas to the left and right or above and below the axis of a folding area so that the two screen backs face each other. The back of the screen can be understood as the side opposite to the front of the screen, such as the side where the back cover of the mobile phone is located. With this folding method, the angle between the two screen backs (i.e., the inward folding angle of the screen back) will become smaller and smaller during the folding process.

[0073] It should be noted that the above Figures 1 to 4 Only folding screen terminal devices including one folding area and two folding areas are shown, but the number of folding areas is not limited in the embodiments of the present application. For example, the folding screen terminal device in the embodiments of the present application may also include more than two folding areas, and the embodiments of the present application do not limit this.

[0074] Figure 5 The figure shows a schematic diagram of the structure of a folding screen terminal device 500 provided in one embodiment of the present application. The folding screen terminal device can be any of the folding screen terminal devices in the above-mentioned embodiments (for example, a folding screen mobile phone, a folding screen tablet computer, etc.). Figure 5The foldable screen terminal device 500 may include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, an earphone interface 570D, a sensor module 580, etc. The foldable screen terminal device 500 is used to perform any step performed by the foldable screen terminal device or any interface displayed in the above task examples.

[0075] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the foldable screen terminal device 500. In other embodiments of this application, the foldable screen terminal device 500 may include more or fewer components than shown, or combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0076] The processor 510 may include one or more processing units. For example, the processor 510 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0077] Processor 510 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 510. If processor 510 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 510, and thus improves system efficiency. For example, the processor can determine the number of applications currently running in the foreground of the terminal device.

[0078] The wireless communication function of the folding screen terminal device 500 can be realized through antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, modem processor and baseband processor.

[0079] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in foldable screen terminal device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antenna can be used in conjunction with a tuning switch.

[0080] The mobile communication module 550 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the folding screen terminal device 500. The mobile communication module 550 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 550 can receive electromagnetic waves from the antenna 1, and filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 550 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 550 can be set in the processor 510. In some embodiments, at least some of the functional modules of the mobile communication module 550 can be set in the same device as at least some of the modules of the processor 510.

[0081] The wireless communication module 560 can provide wireless communication solutions including wireless local area networks (WLAN) applied to the folding screen terminal device 500, such as wireless fidelity (Wi-Fi) networks, Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 510. The wireless communication module 560 can also receive the signal to be sent from the processor 510, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.

[0082] In some embodiments, the antenna 1 of the foldable screen terminal device 500 is coupled to the mobile communication module 550, and the antenna 2 is coupled to the wireless communication module 560, so that the foldable screen terminal device 500 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0083] The foldable screen terminal device 500 implements display functions through a GPU, display screen 594, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 510 may include one or more GPUs, which execute program instructions to generate or change display information.

[0084] The display screen 594 is used to display images, videos, etc. The display screen 594 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the foldable screen terminal device 500 may include one or N display screens 594, where N is a positive integer greater than 1.

[0085] In some embodiments of the present application, when the display panel adopts materials such as OLED, AMOLED, FLED, etc., the above Figure 5 The display screen 594 in the embodiment can be bent. Here, the display screen 594 can be bent means that the display screen can be bent to any angle at any position and can maintain the folded angle. For example, the display screen 594 can be folded in half from the left to the right in the middle, or it can be folded in half from the top to the bottom in the middle. In the embodiment of the present application, a display screen that can be bent is referred to as a foldable display screen. The foldable display screen can be a single screen or a display screen composed of multiple screens pieced together, which is not limited here.

[0086] For example, the foldable display screen may include at least two physical forms: an unfolded form and a folded form. Figure 1 As shown in Figure B, the foldable display is in an unfolded state, that is, the left and right ends of the middle folding area of ​​the foldable display can be folded in half from the middle (if the foldable display is folded up and down, the upper and lower ends of the middle bending part of the foldable display) form an angle φ of 180 degrees (i.e., in a flattened state). Figure 1 As shown in Figure C in the figure, the foldable display is in an unfolded form, which means that the angle φ formed by the left and right ends of the foldable display can be folded from the left and right sides of the folding area of ​​the foldable display to be between 0° and 360°.

[0087] In the embodiments of the present application, the foldable display can be a single-fold display (i.e., with only one folding area) or a multi-fold display (with two or more folding areas). Furthermore, the folding method can be an inward folding method or an outward folding method, or a combination of the inward folding method and the outward folding method.

[0088] In some embodiments, the foldable screen terminal device 500 can use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine whether the foldable display is in a folded or unfolded state, and can also determine whether the foldable display is in a portrait or landscape state. The foldable screen terminal device 500 can also use an angle sensor to detect the bending angle of the foldable display, and use the folding sensor to determine whether the foldable screen terminal device folds inward (folding in the direction where the two display areas face each other) or outward (folding in the direction where the two display areas face each other). Then, the foldable screen terminal device 500 can determine whether the foldable display is in a folded or unfolded state based on the bending angle. The foldable screen terminal device 500 can also use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine the orientation of the foldable display in the folded state, and then determine the display area of ​​the interface content output by the display system. For example, when the first display area of ​​the foldable display is facing upward relative to the ground, the foldable screen terminal device 500 can display the interface content output by the display system on the first display area.

[0089] In some embodiments, the foldable screen terminal device 500 may further include an angle sensor in the folding region of the foldable display. The foldable screen terminal device 500 may use the angle sensor in the folding region to measure the angle between the two ends of the foldable display's middle bend. When the angle is greater than or equal to a preset angle, the folding region may use the angle sensor to identify that the foldable display has entered an unfolded state. When the angle is less than or equal to a preset angle, the folding region may use the angle sensor to identify that the foldable display has entered a folded state.

[0090] In some other embodiments, the folding area can also identify whether the foldable display is in a folded state by a physical switch set in the folding area of ​​the foldable display. For example, when the folding screen terminal device 500 receives a folding operation of the foldable display by the user, the physical switch set on the terminal device is triggered to turn on, and the folding screen terminal device 500 can determine that the foldable display is in a folded state. When the folding screen terminal device 500 receives an unfolding operation of the foldable display by the user, the physical switch set on the terminal device is triggered to turn off, and the folding screen terminal device 500 can determine that the foldable display is in an unfolded state. The above examples are only used to explain this application and should not constitute a limitation.

[0091] The foldable screen terminal device 500 can realize the shooting function through ISP, camera 593, video codec, GPU, display screen 594 and application processor.

[0092] The ISP processes data fed back by the camera 593. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within the camera 593.

[0093] The camera 593 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the folding screen terminal device 500 may include 1 or N cameras 593, where N is a positive integer greater than 1.

[0094] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the foldable screen terminal device 500 is performing frequency selection, the digital signal processor is used to perform Fourier transform on the frequency energy.

[0095] Video codecs are used to compress or decompress digital video. The foldable screen terminal device 500 may support one or more video codecs. This allows the foldable screen terminal device 500 to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0096] The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the foldable screen terminal device 500. The external memory card communicates with the processor 510 through the external memory interface 520 to implement data storage functions. For example, files such as music and videos can be saved on the external memory card.

[0097] The internal memory 521 can be used to store computer executable program codes, which include instructions. The processor 510 executes various functional applications and data processing of the folding screen terminal device 500 by running the instructions stored in the internal memory 521. The internal memory 521 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the folding screen terminal device 500 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 521 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0098] The foldable screen terminal device 500 can implement audio functions such as music playback and recording through the audio module 570, speaker 570A, receiver 570B, microphone 570C, headphone jack 570D, and application processor.

[0099] The audio module 570 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 570 can also be used to encode and decode audio signals. In some embodiments, the audio module 570 can be provided in the processor 510, or some functional modules of the audio module 570 can be provided in the processor 510.

[0100] Speaker 570A, also known as a "horn," is used to convert audio electrical signals into sound signals. The foldable screen terminal device 500 can listen to music or make hands-free calls through speaker 570A.

[0101] The receiver 570B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the foldable screen terminal device 500 receives a call or voice message, the voice can be heard by placing the receiver 570B close to the human ear.

[0102] Microphone 570C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 570C to input the sound signal into the microphone 570C. The folding screen terminal device 500 can be provided with at least one microphone 570C. In other embodiments, the folding screen terminal device 500 can be provided with two microphones 570C, which can not only collect sound signals but also realize noise reduction functions. In other embodiments, the folding screen terminal device 500 can also be provided with three, four or more microphones 570C to collect sound signals, reduce noise, identify the source of sound, realize directional recording functions, etc.

[0103] The headphone jack 570D is used to connect a wired headphone. The headphone jack 570D can be the USB interface 530, or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0104] The sensor module 580 may include: a pressure sensor, a gyroscope sensor, an angle sensor, a folding sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0105] Of course, the folding screen terminal device 500 may also include a charging management module, a power management module, a battery, buttons, indicators, and one or more SIM card interfaces, etc., and the embodiments of the present application do not impose any restrictions on this.

[0106] Figure 6 A software structure block diagram of a foldable screen terminal device according to an embodiment of the present application is shown.

[0107] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: application layer, application framework layer, native layer, kernel layer, and hardware layer, from top to bottom.

[0108] The application layer can include a series of application packages.

[0109] like Figure 6As shown, applications include system applications and third-party applications. For example, applications may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as text messages) and other applications. In addition, the application package may also include: home screen (i.e. desktop), negative one screen, control center, notification center and other system applications. In the embodiment of the present application, the application package may also include a super collection application, which may be a system application. The application package may also include an application of the task flow manager for calling and managing the task flow manager.

[0110] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. For example, Figure 6 Taking the Android Open Source Project (AOSP) as an example, upper-layer applications are applications that users can directly access using the FRAMEWORK interface. They run on foldable screen terminals and serve as a window for users to interact with the foldable screen terminal.

[0111] For example, AOSP may include: an activity manager service (AMS) module, a display manager service (DMS) module, a window manager service (WMS), and an input management module (input).

[0112] The AMS module is used to manage the activities running in the system, including process, application, service, task information, etc.

[0113] The input management module provides input management services (IMS), which can be used to manage system input, such as touch screen input, key input, and sensor input. IMS extracts events from input device nodes and distributes them to appropriate windows through interaction with the WMS.

[0114] The DMS module is one of the system services responsible for screen display management. Some other functions, including screen brightness adjustment, also involve DMS.

[0115] The WMS module is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0116] like Figure 6 As shown, the application framework layer may also include: multi-screen display services and folding display services. Among them, the multi-screen display service is used to provide users with display interfaces of multiple different display areas of the folding screen terminal device, that is, to control the display rules of multiple different display areas. The folding display service is used to provide different display modes and display interfaces of the folding screen terminal device in the folded state and the unfolded state, that is, to control the display rules of multiple different display areas of the folding screen terminal device during the screen folding process.

[0117] The native layer includes the interface service (SurfaceFlinger) and the sensor service (sensor service). Each application may correspond to one or more graphical interfaces, and each interface is called a surface. In the Android implementation, SurfaceFlinger is a service that provides system-wide interface composition (surface composer) functionality, which can combine 2D and 3D surfaces of various applications.

[0118] The sensor service can provide processing of multiple different sensor data on foldable screen terminal devices.

[0119] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, sensor drivers, touch screen drivers, etc. For example, it can also include: camera drivers, audio drivers, touch chip drivers and input systems.

[0120] The hardware layer is the interface layer between the operating system software and the hardware components. It provides an interface for interaction between the upper-layer software and the lower-layer hardware. For example, the lower-layer hardware may include: internal screen, external screen, accelerometer sensor (A), gyroscope sensor (G), gravity sensor, magnetometer, touch screen sensor, distance sensor, angle sensor, etc.

[0121] Among them, the display driver and the internal screen and external screen interact through the mobile industry processor interface (MIPI).

[0122] Figure 7 A structural block diagram of the software and hardware of the foldable screen terminal device provided in an embodiment of the present application is shown.

[0123] like Figure 7 As shown, the foldable screen terminal device includes: an application layer, a functional unit layer, and a physical unit layer. Among them, the application layer and the functional unit layer are software structures, and the physical unit layer is a hardware layer.

[0124] like Figure 7 As shown, applications include system applications and third-party applications. For example, applications may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as short message) and other applications.

[0125] The functional unit layer includes: sensor module, timer module, and screen service module.

[0126] Among them, the sensor module is used to obtain and process the data detected by various sensors. For example, the sensor module may include: a gravity recognition module, a folding recognition module, an angle recognition module, etc. The gravity recognition module can identify the placement of the foldable electronic device based on the data detected by the gravity sensor. The folding recognition module is used to determine the usage state of the foldable electronic device, such as whether it is in a folded state or an unfolded state, and determine the folding method (inward folding method or outward folding method) based on the data detected by the folding sensor. The angle recognition module can determine the folding angle of the electronic device based on the parameters detected by the angle sensor. The timer module provides timing services to users. For example, it records the duration that the display screen of the foldable terminal device is at a certain folding angle.

[0127] The screen service module may include: a screen management module, a multi-screen display service module, a folding display service module, an image synthesis service module, and an input management module. Among them, the multi-screen display service module is used to provide users with display interfaces of multiple different display areas of the folding screen terminal device, and the folding display service module is used to provide different display modes and display interfaces of the folding screen terminal device in the folded state and the unfolded state. The image synthesis service module is used to synthesize the interfaces displayed in different display areas. The input management module parses touch events through the touch screen and injects them into the corresponding display area or service for execution.

[0128] The physical unit layer may include various physical hardware, for example, various sensors (folding sensors, gravity sensors, gyroscopes, angle sensors, etc.), timers, screens, folding hinges in the folding area, cameras, speakers, antennas, CPUs, and the like.

[0129] It is understood that the structure illustrated in this application does not constitute a specific limitation on foldable screen terminal devices. In other embodiments, the foldable screen terminal device may include more or fewer components than shown, or combine or split certain components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. This application does not limit this.

[0130] With the continuous advancement of science and technology, more and more terminal devices with displays are widely used in people's daily lives and work. At the same time, with the rapid development of screen technology, terminal device displays are becoming larger and larger, providing users with richer information. However, large display screens can seriously affect the portability of terminal devices. As a result, many foldable screen terminal devices have emerged in recent years. However, existing foldable screen terminal devices still have some problems that affect the user experience.

[0131] For example, Figure 8 As shown, when the phone is in the unfolded state, the user opens a video call from the inner screen, and the inner screen displays the video image captured by the inner screen camera. At this time, if the user closes the phone (that is, puts the phone in the folded state), the outer screen of the phone is in the locked screen state, and there is no video image on the outer screen (there may only be sound). After the user unlocks the outer screen, there is still no video image on the outer screen, that is, the shooting image displayed on the display screen is interrupted.

[0132] For example, Figure 9 As shown, when the phone is in a folded state, the user opens a video call from the external screen, and the external screen displays the video image captured by the external screen camera. At this time, if the user unfolds the phone (that is, puts the phone in the unfolded state), there is no video image on the internal screen of the phone, that is, the shooting image displayed on the display screen is interrupted.

[0133] It can be seen that when the opening and closing state of the terminal device changes, the shooting picture displayed on the display screen cannot be continued, and the shooting picture will be interrupted, which will affect the user experience.

[0134] Moreover, the external screen camera is usually used as a rear camera. When the terminal device is in a folded state and the external screen camera is used as a front camera (for example, when a user uses the external screen camera to take a selfie, it can be considered that the external screen camera is used as a front camera), the picture displayed on the display may be inverted, which will also affect the user experience.

[0135] In order to solve one or more of the above technical problems, the present application proposes a method and apparatus for controlling a terminal device. Figure 10 The method for controlling the terminal device in the embodiment of the present application is described in detail with examples.

[0136] Figure 10 This is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application. Figure 10 The method 1000 shown may include steps S1010 and S1020, specifically as follows:

[0137] S1010: Obtain the user's first instruction.

[0138] The first instruction may be used to adjust the opening and closing state of the terminal device to the second state.

[0139] In some embodiments, the terminal device may be a folding screen terminal device, for example, the terminal device may be Figure 1 or Figure 2 The foldable screen terminal device shown can also be Figure 3 or Figure 4 The two-fold folding screen terminal device shown can also be a multi-folding screen terminal device including more than two folding areas. For example, the terminal device can include a first display screen and a second display screen, and at least one of the first display screen and the second display screen can be a folding screen.

[0140] In some embodiments, the opening and closing state of the terminal device may include an unfolded state and a folded state. For example, the opening and closing state of the terminal device may be in a first state, wherein the first state may be an unfolded state or a folded state.

[0141] In some embodiments, the terminal device may include a first camera and a second camera. In embodiments of the present application, the terminal device may be used in video chat scenarios, live broadcast scenarios, and shooting scenarios, etc. That is, a camera of the terminal device (such as the first camera or the second camera) may be in a shooting state, and a display screen of the terminal device (such as the first display screen or the second display screen) may display the image captured by the camera. For example, the first camera may be in a shooting state and the first display screen may display the image captured by the first camera.

[0142] For example, Figure 1 As shown in Figure A in FIG, when the mobile phone is in the folded state, the camera 111 can be in the shooting state, and the display screen 110 can display the image of the camera 111.

[0143] For example, Figure 1 As shown in FIG. B or FIG. C, when the mobile phone is in the unfolded state, the camera 121 can be in the shooting state, and the display screen 120 can display the image of the camera 121; or, when the mobile phone is in the unfolded state, (located at Figure 1 The camera 111 on the back of the mobile phone in the unfolded state shown in Figure B or Figure C can be in a shooting state, and the display screen 120 can display the image of the camera 111.

[0144] For example, Figure 2 As shown in Figure C in the figure, when the mobile phone is in the folded state, the camera 221 can be in the shooting state, and the display screen 220 can display the image of the camera 221.

[0145] For example, Figure 2 As shown in FIG. A or FIG. B, when the mobile phone is in the unfolded state, the camera 211 can be in the shooting state, and the display screen 210 can display the image of the camera 211; or, when the mobile phone is in the unfolded state, (located at Figure 2 The camera 221 on the back of the mobile phone in the unfolded state shown in Figure A or Figure B can be in a shooting state, and the display screen 210 can display the image of the camera 221.

[0146] In some embodiments, the opening and closing state of the terminal device can be adjusted to the second state according to the first instruction.

[0147] Optionally, the first state and the second state may be different. For example, if the first state is the unfolded state, the second state may be the folded state; if the first state is the folded state, the second state may be the unfolded state.

[0148] S1020: In response to the first instruction, control the second camera to be in a shooting state, and control the second display screen to display the image shot by the second camera.

[0149] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0150] In some embodiments, the first camera and the second camera can be turned on at the same time. For example, when the terminal device is in the second state, the first camera can be turned on. It should be noted that the turned-on state here can be understood as: the first camera remains powered on. In other words, the first camera and the second camera can remain powered on at the same time.

[0151] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0152] In some embodiments, a camera that is not in a shooting state can be turned off. For example, when the terminal device is in the second state, the first camera can be turned off. It should be noted that the off state here can be understood as: not supplying power to the first camera, or in other words, turning off the power to the first camera.

[0153] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0154] In some embodiments, the first camera and the second camera can be the same camera. For example, the first camera and the second camera can be external screen cameras. When the terminal device is in the unfolded state, the external screen camera can be used to shoot, and the image captured by the external screen camera is displayed on the internal screen. When the terminal device is adjusted to the folded state, the external screen camera can be used to shoot, and the image captured by the external screen camera is displayed on the external screen.

[0155] for Figure 2 and Figure 4 The terminal device shown can be folded up and down. In an embodiment of the present application, a technical solution can also be provided to prevent the shooting picture displayed on the display screen of the terminal device from being inverted.

[0156] For foldable devices, the external screen camera can be used as both the rear camera and the front camera. For example, when the device is unfolded and the external screen camera is used to capture rear-facing scenes, it functions as the rear camera. When the device is folded and the external screen camera is used to capture selfies, it functions as the front camera.

[0157] It should be noted that the rear camera mentioned here is relative to the front camera. For example, the front camera can refer to the camera facing the user, such as a camera that can be used for selfies, and the rear camera can refer to the camera facing away from the user, such as a camera that can be used to capture the scenery opposite the user.

[0158] When the second state is the folded state, the second camera can be an external screen camera. For example, when the terminal device is in the folded state, the second camera can be used as a front camera. At this time, if the second camera is still used as a rear camera, such as Figure 9 As shown in the middle left image, the second monitor will display the captured image upside down. In this case, you can adjust the angle of the image displayed on the monitor.

[0159] For example, method 1000 may further include step S1030, which is specifically as follows:

[0160] S1030: Adjust the angle of the image displayed on the second display screen.

[0161] In some embodiments, when the second camera is used as a front camera, the angle of the image (or the captured image) displayed on the second display screen can be adjusted.

[0162] For example, Figure 11 As shown, the terminal device 1100 is in a folded state, the display screen 1110 is an external screen, and the camera 1120 is an external screen camera. The user uses the camera 1120 to make a video call (at this time, the camera 1120 is used as a front camera), and the display screen 1110 can display the video image captured by the camera 1120, as shown in FIG. Figure 11 As shown in the middle left figure, the video image displayed on the display screen 1110 is inverted. At this time, the video image displayed on the display screen 1110 can be flipped 180 degrees. The flipped video image can be shown as follows: Figure 11 As shown in the middle right picture.

[0163] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0164] The following combination Figure 12 An embodiment in which the first camera and the second camera are both turned on is exemplarily described.

[0165] Figure 12 This is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application. Figure 12 The method 1200 shown may include steps S1210 to S1270, as follows:

[0166] S1210, device reporting capability.

[0167] When the user turns on the terminal device, each device at the bottom of the terminal device can report its capabilities.

[0168] For example, the camera can report three sets of front-facing capabilities, namely, unfolded front-facing, folded front-facing and logical front-facing. Among them, the unfolded front-facing can correspond to the internal screen camera, the device identifier can be device2, the device orientation (facing) of device2 can be front, and the sensor angle (sensor orientation) of device2 can be 90°; the folded front-facing can correspond to the external screen camera, the device identifier can be device1, the device orientation of device1 can be front, and the sensor angle of device1 can be 270°; the device identifier of the logical front can be device3, and the logical front can include the internal screen camera and the external screen camera. The device identifier of the internal screen camera can be device2, and the device identifier of the external screen camera can be device1.

[0169] It should be noted that the parameters corresponding to the above-mentioned various front-facing capabilities are only examples and not limitations. For example, the sensor angle of the internal screen camera can also be 270°, and the sensor angle of the external screen camera can also be 90°.

[0170] S1220, open the internal screen camera and the external screen camera at the same time, use the internal screen camera to shoot, and control the internal screen to display the image captured by the internal screen camera.

[0171] If the user initiates a video call while the device is unfolded, the user can control the device to turn on the logical front camera, that is, turn on both the internal screen camera (device2) and the external screen camera (device1) simultaneously (that is, both the internal screen camera and the external screen camera remain powered). At this point, the internal screen camera (device2) can be used to shoot and the internal screen can be controlled to display the image captured by the internal screen camera (device2).

[0172] S1230: Sense the opening and closing status of the terminal device.

[0173] During a video call, you can continuously sense whether the opening and closing status of the terminal device has changed.

[0174] S1240, switch the internal screen camera to the external screen camera and use the external screen to display the captured image.

[0175] If the user folds the terminal device during a video call, step S1230 can sense that the opening and closing state of the terminal device has changed to a folded state. At this time, the internal screen camera (device2) can be switched to the external screen camera (device1) and the captured image can be displayed using the external screen.

[0176] For example, Figure 13As shown, when the phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the picture taken by the inner screen camera. At this time, if the user closes the phone (that is, puts the phone in the folded state), the outer screen of the phone is in the locked screen state, and there is no picture on the outer screen (there may only be sound). After the user unlocks the outer screen, the outer screen can display the picture taken by the outer screen camera.

[0177] At this time, the external screen camera is used as a rear camera, and the image displayed on the external screen can be flipped. For example, the image displayed on the external screen can be flipped 180°. In this way, the shooting picture displayed on the display screen can be avoided from being upside down, thereby improving the user experience.

[0178] For S1250, switch the external screen camera to the internal screen camera and use the internal screen to display the captured image.

[0179] If the user unfolds the terminal device during a video call, step S1230 can sense that the opening and closing state of the terminal device has changed to the unfolded state. At this time, the external screen camera (device1) can be switched to the internal screen camera (device2) and the captured image can be displayed using the internal screen.

[0180] For example, Figure 14 As shown, when the phone is in a folded state, the user uses the external screen to make a video call, and the external screen displays the picture taken by the external screen camera. At this time, if the user unfolds the phone (that is, puts the phone in an unfolded state), the internal screen of the phone can display the picture taken by the internal screen camera.

[0181] S1260: Determine whether the video call is ended.

[0182] If the video call ends, S1270 may be executed; if the video call does not end, S1230 may be executed, that is, continuously sensing whether the opening and closing state of the terminal device changes.

[0183] On S1270, turn off both the internal and external cameras.

[0184] When the video call ends, turn off the internal screen camera (device2) and the external screen camera (device1).

[0185] The following combination Figure 15 An embodiment of shutting down a camera in a non-shooting state is described exemplarily.

[0186] Figure 15 This is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application. Figure 15 The method 1500 shown may include steps S1510 to S1570, which are specifically as follows:

[0187] S1510, device reporting capability.

[0188] When the user turns on the terminal device, each device at the bottom of the terminal device can report its capabilities.

[0189] For example, the camera can report two sets of front-facing capabilities, namely, unfolded front-facing and folded front-facing. Among them, the unfolded front-facing can correspond to the internal screen camera, the device identifier can be device2, the device orientation of device2 can be front, and the sensor angle of device2 can be 90°; the folded front-facing can correspond to the external screen camera, the device identifier can be device1, the device orientation of device1 can be front, and the sensor angle of device1 can be 270°.

[0190] S1520: Turn on the internal screen camera, use the internal screen camera to shoot, and control the internal screen to display the images captured by the internal screen camera.

[0191] If the user opens a video call while the terminal device is in the unfolded state, the user can control the terminal device to turn on the unfolded front camera, that is, turn on the internal screen camera (that is, power on the internal screen camera). At this time, the internal screen camera (device2) can be used to shoot and the internal screen can be controlled to display the image captured by the internal screen camera (device2).

[0192] S1530: Sense the open and closed state of the terminal device.

[0193] During a video call, you can continuously sense whether the opening and closing status of the terminal device has changed.

[0194] For S1540, turn off the internal camera, turn on the external camera, and use the external screen to display the captured image.

[0195] If the user folds the terminal device during a video call, step S1330 can sense that the opening and closing state of the terminal device has changed to a folded state. At this time, the internal screen camera (device2) can be turned off, the external screen camera (device1) can be turned on, and the captured image can be displayed using the external screen.

[0196] For example, Figure 13 As shown, when the phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the picture taken by the inner screen camera. At this time, if the user closes the phone (that is, puts the phone in the folded state), the outer screen of the phone is in the locked screen state, and there is no picture on the outer screen (there may only be sound). After the user unlocks the outer screen, the outer screen can display the picture taken by the outer screen camera.

[0197] At this time, the external screen camera is used as a rear camera, and the image displayed on the external screen can be flipped. For example, the image displayed on the external screen can be flipped 180°. In this way, the shooting picture displayed on the display screen can be avoided from being upside down, thereby improving the user experience.

[0198] For S1550, turn off the external camera, turn on the internal camera, and use the internal screen to display the captured image.

[0199] If the user unfolds the terminal device during a video call, step S1330 can sense that the opening and closing state of the terminal device has changed to the unfolded state. At this time, the external screen camera (device1) can be turned off, the internal screen camera (device2) can be turned on, and the captured image can be displayed using the internal screen.

[0200] For example, Figure 14 As shown, when the phone is in a folded state, the user uses the external screen to make a video call, and the external screen displays the picture taken by the external screen camera. At this time, if the user unfolds the phone (that is, puts the phone in an unfolded state), the internal screen of the phone can display the picture taken by the internal screen camera.

[0201] S1560: Determine whether the video call is ended.

[0202] If the video call ends, S1570 may be executed; if the video call does not end, S1530 may be executed, that is, continuously sensing whether the opening and closing state of the terminal device changes.

[0203] On S1570, turn off the internal or external camera.

[0204] When the video call ends, turn off the internal or external camera.

[0205] Combined with the above Figures 1 to 15 , describes the method embodiment of the present application in detail, and the following is combined with Figure 16 and Figure 17 , the device embodiment of the present application is described in detail. It should be understood that the description of the method embodiment corresponds to the description of the device embodiment, so for parts not described in detail, reference can be made to the previous method embodiment.

[0206] Figure 16 1 is a schematic structural diagram of an apparatus 1600 for controlling a terminal device provided in one embodiment of the present application. The terminal device includes a first display screen, a second display screen, a first camera, and a second camera. At least one of the first display screen and the second display screen is a foldable screen. The terminal device is in a first state when it is opened or closed. The first camera is in a shooting state, and the first display screen displays an image captured by the first camera.

[0207] like Figure 16 As shown, the apparatus 1600 includes an acquisition unit 1610 and a control unit 1620, which are specifically as follows:

[0208] An acquiring unit 1610 is configured to acquire a first instruction from a user, where the first instruction is configured to adjust the open or closed state of the terminal device to a second state;

[0209] The control unit 1620 is configured to control the second camera to be in a shooting state and control the second display screen to display the image shot by the second camera in response to the first instruction.

[0210] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0211] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0212] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0213] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0214] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0215] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0216] In some possible implementations, the second state is a folded state, and the apparatus 1600 further includes an adjustment unit 1630 configured to adjust an angle of an image displayed on the second display screen.

[0217] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0218] In some possible implementations, the adjusting unit 1630 is specifically configured to flip the image displayed on the second display screen by 180 degrees.

[0219] Figure 17 It is a schematic structural diagram of a device provided in one embodiment of the present application. Figure 17 The dotted line in the figure indicates that the unit or module is optional. The device 1700 can be used to implement the method described in the above method embodiment. The device 1700 can be a chip or a device for controlling a terminal device.

[0220] The device 1700 may include one or more processors 1710. The processor 1710 may support the device 1700 to implement the method described in the above method embodiment. The processor 1710 may be a general-purpose processor or a special-purpose processor. For example, the processor may be a central processing unit (CPU). Alternatively, the processor may be another general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0221] The apparatus 1700 may further include one or more memories 1720. The memories 1720 store programs that can be executed by the processor 1710, causing the processor 1710 to perform the methods described in the above method embodiments. The memories 1720 may be independent of the processor 1710 or integrated into the processor 1710.

[0222] The apparatus 1700 may further include a transceiver 1730. The processor 1710 may communicate with other devices or chips via the transceiver 1730. For example, the processor 1710 may transmit and receive data with other devices or chips via the transceiver 1730.

[0223] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0224] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0225] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a computer, the computer implements the steps in the above-mentioned various method embodiments.

[0226] An embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device (such as a server or a terminal device), the terminal device implements the steps in the above-mentioned various method embodiments.

[0227] An embodiment of the present application provides a chip, which includes a processor and a memory, wherein the memory is used to store computer programs, and the processor is used to call and run the computer programs stored in the memory, so that a terminal device (such as a server or terminal device) equipped with the chip executes the steps in the above-mentioned method embodiments.

[0228] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may at least include: any entity or device that can carry the computer program code to the device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, a computer-readable storage medium cannot be an electric carrier signal or a telecommunication signal.

[0229] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0230] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0231] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0232] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0233] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for controlling a terminal device, characterized in that: The terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a foldable screen, the terminal device is in a first state when it is opened or closed, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera; The method comprises: Obtaining a first instruction from a user, where the first instruction is used to adjust the open / closed state of the terminal device to a second state; In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image shot by the second camera.

2. The method according to claim 1, characterized in that The opening and closing states of the terminal device include an unfolded state and a folded state.

3. The method according to claim 1 or 2, characterized in that When the terminal device is in the second state, the first camera is in the turned-on state.

4. The method according to claim 1 or 2, characterized in that When the terminal device is in the second state, the first camera is in an off state.

5. The method according to any one of claims 1 to 4, characterized in that The second state is a folded state, and the method further includes: Adjust the angle of the image displayed on the second display screen.

6. The method according to claim 5, characterized in that The adjusting the angle of the image displayed on the second display screen includes: The image displayed on the second display screen is flipped 180 degrees.

7. A device for controlling a terminal device, characterized in that: The terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a foldable screen, the terminal device is in a first state when it is opened or closed, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera; Wherein, the device comprises: an acquiring unit, configured to acquire a first instruction from a user, wherein the first instruction is used to adjust the open / closed state of the terminal device to a second state; The control unit is configured to control the second camera to be in a shooting state and control the second display screen to display an image shot by the second camera in response to the first instruction.

8. The device according to claim 7, characterized in that The opening and closing states of the terminal device include an unfolded state and a folded state.

9. The device according to claim 7 or 8, characterized in that When the terminal device is in the second state, the first camera is in the turned-on state.

10. The device according to claim 7 or 8, characterized in that When the terminal device is in the second state, the first camera is in an off state.

11. The device according to any one of claims 7 to 10, characterized in that The second state is a folded state, and the device further includes an adjustment unit for: Adjust the angle of the image displayed on the second display screen.

12. The device according to claim 11, characterized in that The adjustment unit is specifically used for: The image displayed on the second display screen is flipped 180 degrees.

13. A device for controlling a terminal device, characterized in that: include: A processor and a memory, wherein the processor is coupled to the memory, and the memory is used to store a computer program, and when the computer program is executed by the processor, the device performs the method according to any one of claims 1 to 6.

14. A terminal device, characterized in that: The terminal device includes the apparatus according to any one of claims 7 to 13.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 6.

16. A computer program product, characterized in that include: A computer program, when running on a computer, causes the computer to execute the method according to any one of claims 1 to 6.

17. A chip, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory, so that a device or apparatus equipped with the chip executes the method according to any one of claims 1 to 6.

Images