Method for controlling terminal device, and apparatus

Abstract

The present application relates to the technical field of terminals. Provided are a method for controlling a terminal device, and an apparatus. The terminal device comprises a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen being a folding screen. When the folding state of the terminal device is a first state, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera. The method comprises: acquiring a first instruction from a user, the first instruction being used for adjusting the folding state of the terminal device to a second state; and, in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display an image shot by the second camera. The method in the embodiments of the present application can prevent interruptions of shooting pictures displayed by display screens, thereby improving user experience.

Description

Method and device for controlling terminal equipment

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on March 29, 2024, with application number 202410391008.9 and application name “Method and Apparatus for Controlling Terminal Equipment”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a method and apparatus for controlling a terminal device. Background Art

[0003] With the continuous advancement of science and technology, more and more terminal devices with displays are widely used in people's daily lives and work. At the same time, with the rapid development of screen technology, the displays of terminal devices are becoming larger and larger, providing users with richer information. However, a terminal device with a large display screen will seriously affect its portability. Therefore, in recent years, many foldable screen terminal devices (i.e., terminal devices equipped with foldable screens, such as foldable screen mobile phones and foldable screen tablets) have emerged.

[0004] However, existing foldable screen terminal devices still have some problems that affect the user experience. Summary of the Invention

[0005] The present application provides a method and apparatus for controlling a terminal device, which can avoid interruption of a captured image displayed on a display screen and improve user experience.

[0006] In a first aspect, a method for controlling a terminal device is provided, wherein the terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a folding screen, the opening and closing state of the terminal device is in a first state, the first camera is in a shooting state, and the first display screen displays an image captured by the first camera; wherein the method includes: obtaining a first instruction from a user, the first instruction being used to adjust the opening and closing state of the terminal device to a second state; in response to the first instruction, controlling the second camera to be in a shooting state, and controlling the second display screen to display the image captured by the second camera.

[0007] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0008] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0009] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0010] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0011] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0012] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0013] In some possible implementations, the second state is a folded state, and the method further includes: adjusting an angle of an image displayed on the second display screen.

[0014] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0015] In some possible implementations, adjusting the angle of the image displayed on the second display screen includes: flipping the image displayed on the second display screen by 180 degrees.

[0016] In a second aspect, a device for controlling a terminal device is provided, wherein the terminal device includes a first display screen, a second display screen, a first camera and a second camera, at least one of the first display screen and the second display screen is a folding screen, the opening and closing state of the terminal device is in a first state, the first camera is in a shooting state and the first display screen displays an image captured by the first camera; wherein the device includes: an acquisition unit for acquiring a first instruction from a user, the first instruction being used to adjust the opening and closing state of the terminal device to a second state; a control unit, responsive to the first instruction, for controlling the second camera to be in a shooting state, and controlling the second display screen to display the image captured by the second camera.

[0017] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0018] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0019] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0020] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0021] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0022] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0023] In some possible implementations, the second state is a folded state, and the device further includes an adjustment unit configured to adjust an angle of an image displayed on the second display screen.

[0024] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0025] In some possible implementations, the adjustment unit is specifically configured to flip the image displayed on the second display screen by 180 degrees.

[0026] In a third aspect, a device for controlling a terminal device is provided, comprising: a processor and a memory, wherein the processor is coupled to the memory, and the memory is used to store a computer program (also referred to as code, or instructions). When the computer program is executed by the processor, the device executes the method in the first aspect or any possible implementation of the first aspect.

[0027] In some possible implementations, the apparatus further includes a memory coupled to the processor.

[0028] In some possible implementations, there are one or more processors and / or one or more memories.

[0029] In some possible implementations, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

[0030] In a fourth aspect, a terminal device is provided, which is a folding screen terminal device, and the terminal device includes the device in the above-mentioned second aspect or any possible implementation of the second aspect, or the device in the above-mentioned third aspect or any possible implementation of the third aspect.

[0031] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program (also referred to as code or instructions) is stored. When the computer program runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0032] In the sixth aspect, a computer program product is provided, comprising: a computer program (also referred to as code, or instructions), which, when run on a computer, enables the computer to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0033] In the seventh aspect, a chip is provided, comprising: a processor and a memory, wherein the memory is used to store a computer program (also referred to as code, or instructions), and the processor is used to call and run the computer program stored in the memory, so that a device or equipment equipped with the chip executes the method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] FIG1 is a schematic structural diagram of a folding screen terminal device provided in one embodiment of the present application.

[0035] FIG2 is a schematic structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0036] FIG3 is a schematic structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0037] FIG4 is a schematic structural diagram of a folding screen terminal device provided in another embodiment of the present application.

[0038] FIG5 is a schematic diagram of the hardware structure of a folding screen terminal device provided in one embodiment of the present application.

[0039] Figure 6 is a schematic diagram of the software structure of a folding screen terminal device provided by an embodiment of the present application.

[0040] Figure 7 is a schematic diagram of the software and hardware structure of a folding screen terminal device provided by an embodiment of the present application.

[0041] Figure 8 is a schematic block diagram of using a foldable screen terminal device to make a video call in one embodiment of the present application.

[0042] Figure 9 is a schematic block diagram of using a foldable screen terminal device to conduct a video call in another embodiment of the present application.

[0043] FIG10 is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application.

[0044] FIG11 is a schematic block diagram of adjusting the angle of an image displayed on a display screen in one embodiment of the present application.

[0045] FIG12 is a schematic flowchart of a method for controlling a terminal device provided in one embodiment of the present application.

[0046] Figure 13 is a schematic block diagram of using a foldable screen terminal device to make a video call in one embodiment of the present application.

[0047] Figure 14 is a schematic block diagram of using a foldable screen terminal device to make a video call in another embodiment of the present application.

[0048] FIG15 is a schematic flowchart of a method for controlling a terminal device provided in another embodiment of the present application.

[0049] FIG16 is a schematic structural diagram of an apparatus for controlling a terminal device provided in one embodiment of the present application.

[0050] FIG17 is a schematic structural diagram of a device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0052] In the description of this application, unless otherwise specified, the character " / " indicates that the objects associated before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, in the description of this application, unless otherwise specified, "at least one" refers to one or more, and "more than one" refers to two or more than two. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. It should be understood that in the present application, similar descriptions such as "under the circumstances of...", "if...", "when...", and "if..." can be used interchangeably.

[0053] The technical solutions in the embodiments of the present application can be applied to various foldable screen terminal devices. The foldable screen terminal device in the embodiments of the present application can refer to a terminal device equipped with a foldable screen, such as a mobile phone, a tablet computer, a smart watch, a wearable device, an in-vehicle device, an augmented reality (AR) device, a virtual reality (VR) device, etc. The embodiments of the present application do not limit the specific form of the foldable screen terminal device.

[0054] 1 and 2 , the structure of the foldable screen terminal device is described below using a foldable screen mobile phone as an example.

[0055] For example, Figure 1 shows a schematic diagram of a folding screen mobile phone structure provided in an embodiment of the present application, and Figure A in Figure 1 shows a schematic diagram of a folding screen mobile phone in a folded state (or can also be called a folded state, etc.). Among them, the display screen 110 and the camera 111 can work when the mobile phone (unless otherwise specified, the mobile phones in the embodiments of the present application refer to folding screen mobile phones) is in a folded state. Optionally, the display screen 110 and the camera 111 can be arranged on the outside of the mobile phone (the outside here can be understood as the outside of the mobile phone when it is in a folded state), so the display screen 110 can be called an external screen, and the camera 111 can be called an external screen camera. It should be noted that Figure A in Figure 1 only takes a display screen and a camera as an example. In this application, the display screen 110 may include one or more display screens, and the camera 111 may include one or more cameras.

[0056] Figure 1B shows a schematic diagram of a foldable screen phone in its unfolded state (also known as a flattened state, unfolded state, etc.). For example, the phone shown in Figure 1A can be unfolded around the rotation axis at the folding area to the unfolded state shown in Figure 1B. The display screen 110 and camera 111 shown in Figure 1A can be located on the back of the phone in the unfolded state shown in Figure 1B (not shown in Figure B). As shown in Figure 1B, there is a folding area on the screen, and the screens on the left and right sides of the folding area can be rotated around the rotation axis of the folding area to unfold or fold. For example, a hinge or other component can be provided at the folding area to enable the screens on the left and right sides of the folding area to rotate around the rotation axis of the folding area. As shown in Figure B, the folding area can divide the display screen 110 into two parts, namely a first display area and a second display area, and the first and second display areas can rotate around the rotation axis of the folding area. As shown in Figure B, the display screen 120 and camera 121 can operate when the phone is in the unfolded state, and the display screen 110 and / or camera 111 can also operate when the phone is in the unfolded state. Optionally, the display screen 120 and the camera 121 can be arranged on the inner side of the mobile phone (the inner side here can be understood as the inner side of the mobile phone when it is in the folded state), therefore, the display screen 120 can be called the inner screen, and the camera 121 can be called the inner screen camera. It should be noted that Figure B in Figure 1 only uses one display screen and one camera as an example. In this application, the display screen 120 may include one or more display screens, and the camera 121 may include one or more cameras (for example, the camera 121 may be a camera group including multiple cameras).

[0057] FIG1 C shows that the mobile phone shown in FIG1 B is folded around the rotation axis at the folding area to form a folding angle by folding the first display area and the second display area of ​​the display screen 120. It is understandable that if the folding angle If the folding angle is between 0° and 360°, the phone can be considered to be in the unfolded state. If the angle is 0° or 360°, the phone can be considered to be in a folded state.

[0058] It should be noted that Figure C in Figure 1 shows that the display screen 120 is folded in the direction opposite to the first display area and the second display area in the expanded form (i.e., an outward folding method). The display screen 120 can also be folded in the direction facing the first display area and the second display area in the expanded form (i.e., an inward folding method).

[0059] FIG1 shows a case where the folding screen terminal device is folded left and right. In an embodiment of the present application, the folding screen terminal device can also be folded up and down. The terminal device that folds up and down is introduced below in conjunction with FIG2 .

[0060] FIG2A shows a schematic diagram of a foldable screen mobile phone provided in an embodiment of the present application in its unfolded state. As shown in FIG2A , there is a folding area on the screen, and the screens on the left and right sides of the folding area can be rotated around a rotation axis at the folding area to unfold or fold. For example, a hinge or other component can be provided at the folding area so that the screens on the left and right sides of the folding area can rotate around the rotation axis at the folding area. As shown in FIG2A , the folding area can divide the display screen 210 into two parts, namely a first display area and a second display area, and the first display area and the second display area can rotate around the rotation axis at the folding area. As shown in FIG2A , the display screen 210 and camera 211 can operate when the phone is in the unfolded state. At the same time, the display screen 210 and / or camera 211 shown in FIG2A can also operate when the phone is in the unfolded state. Optionally, the display screen 210 and camera 211 can be located on the inside of the phone (the inside here can be understood as the inside of the phone when in the folded state). Therefore, the display screen 210 can be referred to as the inner screen and the camera 211 can be referred to as the inner screen camera. It should be noted that Figure A in FIG2 uses only one display screen and one camera as an example. In the present application, the display screen 210 may include one or more display screens, and the camera 211 may include one or more cameras (for example, the camera 211 may be a camera group including multiple cameras). As shown in Figure A, there is a folding area on the display screen 210, and the screens located above and below the folding area can be rotated around the rotation axis of the folding area to be unfolded or folded.

[0061] FIG2B shows that the mobile phone shown in FIG2A is folded around the rotation axis at the folding area to form a folding angle by folding the first display area and the second display area of ​​the display screen 210. It is understandable that if the folding angle If the folding angle is between 0° and 360°, the phone can be considered to be in the unfolded state. If the angle is 0° or 360°, the phone can be considered to be in a folded state.

[0062] Figure C in Figure 2 shows a schematic diagram of a foldable screen mobile phone in a folded state (or can also be called a folded state, etc.). Figure C in Figure 2 shows a schematic diagram of the mobile phone shown in Figure A in Figure 2 folding the first display area and the second display area of ​​the display screen 210 around the rotating axis at the folding area to form a folding angle of 0. As shown in Figure C, the display screen 220 and the camera 221 can work when the mobile phone is in a folded state. Optionally, the display screen 220 and the camera 221 can be set on the outside of the mobile phone (the outside here can be understood as the outside of the mobile phone when it is in a folded state). Therefore, the display screen 220 can be called an external screen and the camera 2211 can be called an external screen camera. It should be noted that Figure C in Figure 2 only takes one display screen and one camera as an example. In this application, the display screen 220 can include one or more display screens, and the camera 221 can include one or more cameras (for example, the camera 221 can be a camera group including multiple cameras). The shape and position of the display screen 220 and the camera 221 are also limited for example only.

[0063] It should be noted that Figure B in Figure 2 shows that the display screen 210 is folded in the direction facing the first display area and the second display area in the expanded form (i.e., an inward folding method). The display screen 210 can also be folded in the direction opposite to the first display area and the second display area in the expanded form (i.e., an outward folding method).

[0064] FIG3 is a schematic diagram of a two-fold foldable screen mobile phone structure provided by an embodiment of the present application. FIG3A shows a schematic diagram of the foldable screen mobile phone in the unfolded state (i.e., flattened state). As shown in FIG3A, there are two folding areas on the screen. The screens on the left and right sides of either folding area can be rotated around the rotation axis of the folding area to unfold or fold. For example, a hinge or other component can be provided at the folding area to enable the screens on the left and right sides of the folding area to rotate around the rotation axis of the folding area. As shown in FIG3A, the display screen 310 of the mobile phone is divided into three parts by the folding area: a first display area, a second display area, and a third display area. The first display area, the second display area, and the third display area can all rotate around the rotation axis of the folding area. As shown in FIG3A, the display screen 310 and the camera 311 can operate when the mobile phone is in the unfolded state. It should be noted that FIG3 only uses one display screen and one camera as an example. In the present application, the display screen 310 may include one or more display screens, and the camera 311 may include one or more cameras (for example, the camera 311 may be a camera group including multiple cameras).

[0065] Figure 3 B shows another schematic diagram of a foldable screen mobile phone in the unfolded state. Figure 3 B shows the foldable screen mobile phone shown in Figure 3 A folded around the axis of the folding area, in the direction where the first display area and the second display area are opposite to each other (i.e., folding outwards) to form a folding angle. (ie the inner folding angle of the back of the screen is The folding angle can be less than 180°), the second display area and the third display area face each other (ie, inward folding) to form a folding angle (i.e. the inner folding angle of the front of the screen is In other embodiments of the present application, the foldable screen mobile phone shown in Figure A of Figure 3 can also be folded in a direction where the first display area and the second display area face each other (i.e., inward folding) or the second display area and the third display area face each other (i.e., outward folding), and this is not limited in the embodiments of the present application.

[0066] FIG3 shows a two-fold folding screen mobile phone that is folded left and right. In an embodiment of the present application, a two-fold or multi-fold folding screen mobile phone can also be folded up and down. For example, FIG4 shows a two-fold folding screen mobile phone that is folded up and down.

[0067] FIG4 is a schematic diagram of another embodiment of a two-fold foldable screen mobile phone structure provided by the present application. FIG4A shows a schematic diagram of a two-fold foldable screen mobile phone in the unfolded state. There are two folding areas on the screen. The screens located above and below each folding area can be rotated around the rotation axis of the folding area to unfold or fold. For example, a hinge or other component can be provided at the folding area so that the screens on the left and right sides of the folding area can rotate around the rotation axis of the folding area. As shown in FIG4A, the display screen 410 of the mobile phone is divided into three parts by the folding area: a first display area, a second display area, and a third display area. The first display area, the second display area, and the third display area can all rotate around the rotation axis of the folding area. As shown in FIG4A, the display screen 410 and the camera 411 can operate when the mobile phone is in the unfolded state. It should be noted that FIG4 only uses one display screen and one camera as an example. In the present application, the display screen 410 may include one or more display screens, and the camera 411 may include one or more cameras (for example, the camera 411 may be a camera group including multiple cameras).

[0068] FIG4B is another schematic diagram of a foldable screen mobile phone in the unfolded state. As shown in FIG4B, the foldable display screen can be folded in the direction in which the first display area and the second display area face each other (i.e., inward folding) to form a folding angle. The second display area and the third display area are in a flattened state relative to the folding area, that is, the folding angle formed by the front of the screen of the second display area and the third display area is less than 180 degrees. It can be 180°.

[0069] It should be understood that in other embodiments of the present application, the foldable display screen, in the unfolded state, can also be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an outward folding mode) and the second display area and the third display area are opposite to each other (i.e., an inward folding mode); or, it can be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an inward folding mode) and the second display area and the third display area are opposite to each other (i.e., an outward folding mode); or, it can be folded in a direction in which the first display area and the second display area are opposite to each other (i.e., an outward folding mode) and the second display area and the third display area are opposite to each other (i.e., an outward folding mode). The embodiments of the present application are not limited here.

[0070] That is, in the various folding screen terminal devices provided in this application (for example, including folding screen mobile phones, folding screen tablets, etc.), the display areas on both sides of any folding area can be folded outward or inward. This embodiment of the application is not limited here.

[0071] It should be noted that the single-fold folding screen mobile phone described in the embodiments of this application can be understood as the folding screen mobile phone with a single hinge as shown in Figure 1 or Figure 2; the double-folding folding screen mobile phone described in the embodiments of this application can be understood as the folding screen mobile phone with two hinges as shown in Figure 3 or Figure 4. In other embodiments, the single-folding folding screen mobile phone and the double-folding folding screen mobile phone can also have other names. For example, the folding screen mobile phone shown in Figure 3 or Figure 4 can also be called a triple-folding screen mobile phone because it has three display areas. This application does not limit its name.

[0072] It should also be understood that in the embodiments of the present application, the inward folding method can be understood as: folding the two display areas to the left and right or above and below the axis of a folding area in a direction in which the two screen fronts face each other. Among them, the screen front can be understood as the side of the folding screen phone's larger display (i.e., the foldable flexible display) that displays an image or picture. With this folding method, the angle between the two screen fronts (i.e., the inward folding angle of the screen front) will become smaller and smaller during the folding process.

[0073] In the embodiments of the present application, the outward folding method can be understood as: folding the two display areas to the left and right or above and below the axis of a folding area so that the two screen backs face each other. The back of the screen can be understood as the side opposite to the front of the screen, such as the side where the back cover of the mobile phone is located. With this folding method, the angle between the two screen backs (i.e., the inward folding angle of the screen back) will become smaller and smaller during the folding process.

[0074] It should be noted that the above Figures 1 to 4 only show folding screen terminal devices including one folding area and two folding areas, but the embodiment of the present application does not limit the number of folding areas. For example, the folding screen terminal device in the embodiment of the present application may also include more than two folding areas, and the embodiment of the present application does not limit this.

[0075] FIG5 is a schematic structural diagram of a foldable screen terminal device 500 provided in one embodiment of the present application. The foldable screen terminal device may be any of the foldable screen terminal devices in the above-mentioned embodiments (for example, a foldable screen mobile phone, a foldable screen tablet computer, etc.). As shown in FIG5 , the foldable screen terminal device 500 may include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, an earphone interface 570D, a sensor module 580, etc. The foldable screen terminal device 500 is used to perform the steps performed by any of the foldable screen terminal devices in the above-mentioned task examples or display any of the interfaces.

[0076] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the foldable screen terminal device 500. In other embodiments of this application, the foldable screen terminal device 500 may include more or fewer components than shown, or combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 510 may include one or more processing units. For example, the processor 510 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0078] Processor 510 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 510. If processor 510 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 510, and thus improves system efficiency. For example, the processor can determine the number of applications currently running in the foreground of the terminal device.

[0079] The wireless communication function of the folding screen terminal device 500 can be realized through antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, modem processor and baseband processor.

[0080] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in foldable screen terminal device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antenna can be used in conjunction with a tuning switch.

[0081] The mobile communication module 550 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the folding screen terminal device 500. The mobile communication module 550 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 550 can receive electromagnetic waves from the antenna 1, and filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 550 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 550 can be set in the processor 510. In some embodiments, at least some of the functional modules of the mobile communication module 550 can be set in the same device as at least some of the modules of the processor 510.

[0082] The wireless communication module 560 can provide wireless communication solutions including wireless local area networks (WLAN) applied to the folding screen terminal device 500, such as wireless fidelity (Wi-Fi) networks, Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 560 can be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 510. The wireless communication module 560 can also receive the signal to be sent from the processor 510, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.

[0083] In some embodiments, the antenna 1 of the foldable screen terminal device 500 is coupled to the mobile communication module 550, and the antenna 2 is coupled to the wireless communication module 560, so that the foldable screen terminal device 500 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0084] The foldable screen terminal device 500 implements display functions through a GPU, display screen 594, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 510 may include one or more GPUs, which execute program instructions to generate or change display information.

[0085] The display screen 594 is used to display images, videos, etc. The display screen 594 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the foldable screen terminal device 500 may include one or N display screens 594, where N is a positive integer greater than one.

[0086] In some embodiments of the present application, when the display panel uses materials such as OLED, AMOLED, FLED, etc., the display screen 594 in Figure 5 above can be bent. Here, the display screen 594 can be bent, which means that the display screen can be bent to any angle at any position and can maintain the folding angle. For example, the display screen 594 can be folded in half from the left to the right in the middle, or it can be folded in half from the top to the bottom in the middle. In the embodiments of the present application, a display screen that can be bent is referred to as a foldable display screen. Among them, the foldable display screen can be a single screen or a display screen composed of multiple screens pieced together, which is not limited here.

[0087] For example, a foldable display screen can include at least two physical forms: an unfolded form and a folded form. As shown in Figure 1B, the foldable display screen is in the unfolded form, which means that the left and right ends of the middle folding area of ​​the foldable display screen can be folded in half from the middle (if the foldable display screen is folded up and down, the angle formed by the upper and lower ends of the middle bending part of the foldable display screen) is: The angle of the foldable display screen is 180 degrees (i.e., flattened), as shown in Figure C of Figure 1. The foldable display screen is in an unfolded state, which means that the foldable display screen can be folded from the left and right ends of the foldable display screen to form an angle. Between 0° and 360°.

[0088] In the embodiments of the present application, the foldable display can be a single-fold display (i.e., with only one folding area) or a multi-fold display (with two or more folding areas). Furthermore, the folding method can be an inward folding method or an outward folding method, or a combination of the inward folding method and the outward folding method.

[0089] In some embodiments, the foldable screen terminal device 500 can use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine whether the foldable display is in a folded or unfolded state, and can also determine whether the foldable display is in a portrait or landscape state. The foldable screen terminal device 500 can also use an angle sensor to detect the bending angle of the foldable display, and use the folding sensor to determine whether the foldable screen terminal device folds inward (folding in the direction where the two display areas face each other) or outward (folding in the direction where the two display areas face each other). Then, the foldable screen terminal device 500 can determine whether the foldable display is in a folded or unfolded state based on the bending angle. The foldable screen terminal device 500 can also use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine the orientation of the foldable display in the folded state, and then determine the display area of ​​the interface content output by the display system. For example, when the first display area of ​​the foldable display is facing upward relative to the ground, the foldable screen terminal device 500 can display the interface content output by the display system on the first display area.

[0090] In some embodiments, the foldable screen terminal device 500 may further include an angle sensor in the folding region of the foldable display. The foldable screen terminal device 500 may use the angle sensor in the folding region to measure the angle between the two ends of the foldable display's middle bend. When the angle is greater than or equal to a preset angle, the folding region may use the angle sensor to identify that the foldable display has entered an unfolded state. When the angle is less than or equal to a preset angle, the folding region may use the angle sensor to identify that the foldable display has entered a folded state.

[0091] In some other embodiments, the folding area can also identify whether the foldable display is in a folded state by a physical switch set in the folding area of ​​the foldable display. For example, when the folding screen terminal device 500 receives a folding operation of the foldable display by the user, the physical switch set on the terminal device is triggered to turn on, and the folding screen terminal device 500 can determine that the foldable display is in a folded state. When the folding screen terminal device 500 receives an unfolding operation of the foldable display by the user, the physical switch set on the terminal device is triggered to turn off, and the folding screen terminal device 500 can determine that the foldable display is in an unfolded state. The above examples are only used to explain this application and should not constitute a limitation.

[0092] The foldable screen terminal device 500 can realize the shooting function through ISP, camera 593, video codec, GPU, display screen 594 and application processor.

[0093] The ISP processes data fed back by the camera 593. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within the camera 593.

[0094] The camera 593 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the folding screen terminal device 500 may include 1 or N cameras 593, where N is a positive integer greater than 1.

[0095] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the foldable screen terminal device 500 is performing frequency selection, the digital signal processor is used to perform Fourier transform on the frequency energy.

[0096] Video codecs are used to compress or decompress digital video. The foldable screen terminal device 500 may support one or more video codecs. This allows the foldable screen terminal device 500 to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0097] The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the foldable screen terminal device 500. The external memory card communicates with the processor 510 through the external memory interface 520 to implement data storage functions. For example, files such as music and videos can be saved on the external memory card.

[0098] The internal memory 521 can be used to store computer executable program codes, which include instructions. The processor 510 executes various functional applications and data processing of the folding screen terminal device 500 by running the instructions stored in the internal memory 521. The internal memory 521 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the folding screen terminal device 500 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 521 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0099] The foldable screen terminal device 500 can implement audio functions such as music playback and recording through the audio module 570, speaker 570A, receiver 570B, microphone 570C, headphone jack 570D, and application processor.

[0100] The audio module 570 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 570 can also be used to encode and decode audio signals. In some embodiments, the audio module 570 can be provided in the processor 510, or some functional modules of the audio module 570 can be provided in the processor 510.

[0101] Speaker 570A, also known as a "horn," is used to convert audio electrical signals into sound signals. The foldable screen terminal device 500 can listen to music or make hands-free calls through speaker 570A.

[0102] The receiver 570B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the foldable screen terminal device 500 receives a call or voice message, the voice can be heard by placing the receiver 570B close to the human ear.

[0103] Microphone 570C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 570C to input the sound signal into the microphone 570C. The folding screen terminal device 500 can be provided with at least one microphone 570C. In other embodiments, the folding screen terminal device 500 can be provided with two microphones 570C, which can not only collect sound signals but also realize noise reduction functions. In other embodiments, the folding screen terminal device 500 can also be provided with three, four or more microphones 570C to collect sound signals, reduce noise, identify the source of sound, realize directional recording functions, etc.

[0104] The headphone jack 570D is used to connect a wired headphone. The headphone jack 570D can be the USB interface 530, or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0105] The sensor module 580 may include: a pressure sensor, a gyroscope sensor, an angle sensor, a folding sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0106] Of course, the folding screen terminal device 500 may also include a charging management module, a power management module, a battery, buttons, indicators, and one or more SIM card interfaces, etc., and the embodiments of the present application do not impose any restrictions on this.

[0107] Figure 6 shows a software structure block diagram of the folding screen terminal device according to an embodiment of the present application.

[0108] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: application layer, application framework layer, native layer, kernel layer, and hardware layer, from top to bottom.

[0109] The application layer can include a series of application packages.

[0110] As shown in Figure 6, applications include system applications and third-party applications. For example, applications may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as text messages) and other applications. In addition, the application package may also include: home screen (i.e. desktop), negative screen, control center, notification center and other system applications. In the embodiment of the present application, the application package may also include a super collection application, which may be a system application. The application package may also include an application of the task flow manager for calling and managing the task flow manager.

[0111] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example, Figure 6 uses the Android Open Source Project (AOSP) as an example. Upper-layer applications are applications that use the FRAMEWORK interface and are directly accessible to users. They run on foldable screen terminal devices and serve as the window for users to interact with the foldable screen terminal device.

[0112] For example, AOSP may include: an activity manager service (AMS) module, a display manager service (DMS) module, a window manager service (WMS), and an input management module (input).

[0113] The AMS module is used to manage the activities running in the system, including process, application, service, task information, etc.

[0114] The input management module provides input management services (IMS), which can be used to manage system input, such as touch screen input, key input, and sensor input. IMS extracts events from input device nodes and distributes them to appropriate windows through interaction with the WMS.

[0115] The DMS module is one of the system services responsible for screen display management. Some other functions, including screen brightness adjustment, also involve DMS.

[0116] The WMS module is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0117] As shown in Figure 6, the application framework layer may also include: multi-screen display services and folding display services. Among them, the multi-screen display service is used to provide users with display interfaces of multiple different display areas of the folding screen terminal device, that is, to control the display rules of multiple different display areas. The folding display service is used to provide different display modes and display interfaces of the folding screen terminal device in the folded state and the unfolded state, that is, to control the display rules of multiple different display areas of the folding screen terminal device during the screen folding process.

[0118] The native layer includes the interface service (SurfaceFlinger) and the sensor service. Each application may correspond to one or more graphical interfaces, and each interface is called a surface. In the Android implementation, SurfaceFlinger is a service that provides system-wide interface composition (surface composer) functionality, which can combine 2D and 3D surfaces of various applications.

[0119] The sensor service can provide processing of multiple different sensor data on foldable screen terminal devices.

[0120] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, sensor drivers, touch screen drivers, etc. For example, it can also include: camera drivers, audio drivers, touch chip drivers and input systems.

[0121] The hardware layer is the interface between the operating system software and the hardware components. It provides an interface for interaction between the upper-layer software and the lower-layer hardware. For example, the lower-layer hardware may include: internal screen, external screen, accelerometer sensor (A), gyroscope sensor (G), gravity sensor, magnetometer, touch screen sensor, distance sensor, angle sensor, etc.

[0122] Among them, the display driver and the internal screen and external screen interact through the mobile industry processor interface (MIPI).

[0123] Figure 7 shows a structural block diagram of the software and hardware of the folding screen terminal device provided in an embodiment of the present application.

[0124] As shown in Figure 7, the foldable screen terminal device includes: an application layer, a functional unit layer, and a physical unit layer. Among them, the application layer and the functional unit layer are software structures, and the physical unit layer is the hardware layer.

[0125] As shown in Figure 7, applications include system applications and third-party applications. For example, applications may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant messaging (such as short message) and other applications.

[0126] The functional unit layer includes: sensor module, timer module, and screen service module.

[0127] Among them, the sensor module is used to obtain and process the data detected by various sensors. For example, the sensor module may include: a gravity recognition module, a folding recognition module, an angle recognition module, etc. The gravity recognition module can identify the placement of the foldable electronic device based on the data detected by the gravity sensor. The folding recognition module is used to determine the usage state of the foldable electronic device, such as whether it is in a folded state or an unfolded state, and determine the folding method (inward folding method or outward folding method) based on the data detected by the folding sensor. The angle recognition module can determine the folding angle of the electronic device based on the parameters detected by the angle sensor. The timer module provides timing services to users. For example, it records the duration that the display screen of the foldable terminal device is at a certain folding angle.

[0128] The screen service module may include: a screen management module, a multi-screen display service module, a folding display service module, an image synthesis service module, and an input management module. Among them, the multi-screen display service module is used to provide users with display interfaces of multiple different display areas of the folding screen terminal device, and the folding display service module is used to provide different display modes and display interfaces of the folding screen terminal device in the folded state and the unfolded state. The image synthesis service module is used to synthesize the interfaces displayed in different display areas. The input management module parses touch events through the touch screen and injects them into the corresponding display area or service for execution.

[0129] The physical unit layer may include various physical hardware, for example, various sensors (folding sensors, gravity sensors, gyroscopes, angle sensors, etc.), timers, screens, folding hinges in the folding area, cameras, speakers, antennas, CPUs, and the like.

[0130] It is understood that the structure illustrated in this application does not constitute a specific limitation on foldable screen terminal devices. In other embodiments, the foldable screen terminal device may include more or fewer components than shown, or combine or split certain components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. This application does not limit this.

[0131] With the continuous advancement of science and technology, more and more terminal devices with displays are widely used in people's daily lives and work. At the same time, with the rapid development of screen technology, the displays of terminal devices are becoming larger and larger, providing users with richer information. However, a terminal device with a large display screen will seriously affect its portability. As a result, many foldable screen terminal devices have emerged in recent years. However, existing foldable screen terminal devices still have some problems that affect the user experience.

[0132] For example, as shown in Figure 8, when the mobile phone is in the unfolded state, the user opens a video call from the inner screen, and the inner screen displays the video image captured by the inner screen camera. At this time, if the user closes the mobile phone (that is, puts the mobile phone into the folded state), the outer screen of the mobile phone is in the locked screen state, and there is no video image on the outer screen (there may only be sound). After the user unlocks the outer screen, there is still no video image on the outer screen, that is, the shooting image displayed on the display screen is interrupted.

[0133] For example, as shown in Figure 9, when the mobile phone is in a folded state, the user opens a video call from the external screen, and the external screen displays the video image captured by the external screen camera. At this time, if the user unfolds the mobile phone (that is, puts the mobile phone into an unfolded state), there is no video image on the internal screen of the mobile phone, that is, the shooting image displayed on the display screen is interrupted.

[0134] It can be seen that when the opening and closing state of the terminal device changes, the shooting picture displayed on the display screen cannot be continued, and the shooting picture will be interrupted, which will affect the user experience.

[0135] Moreover, the external screen camera is usually used as a rear camera. When the terminal device is in a folded state and the external screen camera is used as a front camera (for example, when a user uses the external screen camera to take a selfie, it can be considered that the external screen camera is used as a front camera), the picture displayed on the display may be inverted, which will also affect the user experience.

[0136] In order to solve one or more of the above technical problems, the present application proposes a method and apparatus for controlling a terminal device. The method for controlling a terminal device in an embodiment of the present application is described in detail below with reference to FIG10 .

[0137] FIG10 is a schematic flow chart of a method for controlling a terminal device according to an embodiment of the present application. The method 1000 shown in FIG10 may include steps S1010 and S1020, which are as follows:

[0138] S1010: Obtain the user's first instruction.

[0139] The first instruction may be used to adjust the opening and closing state of the terminal device to the second state.

[0140] In some embodiments, the terminal device may be a foldable screen terminal device. For example, the terminal device may be a single-fold foldable screen terminal device as shown in FIG1 or FIG2 , or a double-fold foldable screen terminal device as shown in FIG3 or FIG4 , or a multi-fold foldable screen terminal device including two or more foldable areas. For example, the terminal device may include a first display screen and a second display screen, and at least one of the first display screen and the second display screen may be a foldable screen.

[0141] In some embodiments, the opening and closing state of the terminal device may include an unfolded state and a folded state. For example, the opening and closing state of the terminal device may be in a first state, wherein the first state may be an unfolded state or a folded state.

[0142] In some embodiments, the terminal device may include a first camera and a second camera. In embodiments of the present application, the terminal device may be used in video chat scenarios, live broadcast scenarios, and shooting scenarios, etc. That is, a camera of the terminal device (such as the first camera or the second camera) may be in a shooting state, and a display screen of the terminal device (such as the first display screen or the second display screen) may display the image captured by the camera. For example, the first camera may be in a shooting state and the first display screen may display the image captured by the first camera.

[0143] For example, as shown in Figure A of Figure 1 , when the mobile phone is in the folded state, the camera 111 can be in a shooting state, and the display screen 110 can display the image of the camera 111.

[0144] For another example, as shown in Figure B or Figure C in Figure 1, when the mobile phone is in the unfolded state, the camera 121 can be in a shooting state, and the display screen 120 can display the image of the camera 121; or, when the mobile phone is in the unfolded state, the camera 111 (located on the back of the mobile phone in the unfolded state shown in Figure B or Figure C in Figure 1) can be in a shooting state, and the display screen 120 can display the image of the camera 111.

[0145] For another example, as shown in Figure C of FIG2 , when the mobile phone is in the folded state, the camera 221 may be in a shooting state, and the display screen 220 may display the image of the camera 221 .

[0146] For another example, as shown in Figure A or Figure B in Figure 2 , when the mobile phone is in the unfolded state, the camera 211 may be in a shooting state, and the display screen 210 may display the image of the camera 211; or, when the mobile phone is in the unfolded state, the camera 221 (located on the back of the mobile phone in the unfolded state as shown in Figure A or Figure B in Figure 2 ) may be in a shooting state, and the display screen 210 may display the image of the camera 221.

[0147] In some embodiments, the opening and closing state of the terminal device can be adjusted to the second state according to the first instruction.

[0148] Optionally, the first state and the second state may be different. For example, if the first state is the unfolded state, the second state may be the folded state; if the first state is the folded state, the second state may be the unfolded state.

[0149] S1020: In response to the first instruction, control the second camera to be in a shooting state, and control the second display screen to display the image shot by the second camera.

[0150] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0151] In some embodiments, the first camera and the second camera can be turned on at the same time. For example, when the terminal device is in the second state, the first camera can be turned on. It should be noted that the turned-on state here can be understood as: the first camera remains powered on. In other words, the first camera and the second camera can remain powered on at the same time.

[0152] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0153] In some embodiments, a camera that is not in a shooting state can be turned off. For example, when the terminal device is in the second state, the first camera can be turned off. It should be noted that the off state here can be understood as: not supplying power to the first camera, or in other words, turning off the power to the first camera.

[0154] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0155] In some embodiments, the first camera and the second camera can be the same camera. For example, the first camera and the second camera can be external screen cameras. When the terminal device is in the unfolded state, the external screen camera can be used to shoot, and the image captured by the external screen camera is displayed on the internal screen. When the terminal device is adjusted to the folded state, the external screen camera can be used to shoot, and the image captured by the external screen camera is displayed on the external screen.

[0156] For the terminal device that folds up and down as shown in Figures 2 and 4, an embodiment of the present application can also provide a technical solution that can prevent the shooting picture displayed on the display screen of the terminal device from being inverted.

[0157] For foldable devices, the external screen camera can be used as both the rear camera and the front camera. For example, when the device is unfolded and the external screen camera is used to capture rear-facing scenes, it functions as the rear camera. When the device is folded and the external screen camera is used to capture selfies, it functions as the front camera.

[0158] It should be noted that the rear camera mentioned here is relative to the front camera. For example, the front camera can refer to the camera facing the user, such as a camera that can be used for selfies, and the rear camera can refer to the camera facing away from the user, such as a camera that can be used to capture the scenery opposite the user.

[0159] When the second state is the folded state, the second camera can be used as an external screen camera. For example, when the terminal device is in the folded state, the second camera can be used as a front camera. At this time, if the second camera is still used as a rear camera, as shown in the left figure in Figure 9, the shooting image displayed on the second display screen will appear upside down. In this case, the angle of the image displayed on the display screen can be adjusted.

[0160] For example, method 1000 may further include step S1030, which is specifically as follows:

[0161] S1030: Adjust the angle of the image displayed on the second display screen.

[0162] In some embodiments, when the second camera is used as a front camera, the angle of the image (or the captured image) displayed on the second display screen can be adjusted.

[0163] For example, as shown in Figure 11, the opening and closing state of the terminal device 1100 is a folded state, the display screen 1110 is an external screen, and the camera 1120 is an external screen camera. The user uses the camera 1120 to make a video call (at this time, the camera 1120 is used as a front camera). The display screen 1110 can display the video picture taken by the camera 1120. As shown in the left picture of Figure 11, the video picture displayed on the display screen 1110 appears inverted. At this time, the video picture displayed on the display screen 1110 can be flipped 180 degrees, and the flipped video picture can be shown in the right picture of Figure 11.

[0164] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0165] The following is an exemplary description of an embodiment in which the first camera and the second camera are both turned on with reference to FIG12 .

[0166] FIG12 is a schematic flow chart of a method for controlling a terminal device according to an embodiment of the present application. The method 1200 shown in FIG12 may include steps S1210 to S1270, which are as follows:

[0167] S1210, device reporting capability.

[0168] When the user turns on the terminal device, each device at the bottom of the terminal device can report its capabilities.

[0169] For example, the camera can report three sets of front-facing capabilities, namely, unfolded front-facing, folded front-facing and logical front-facing. Among them, the unfolded front-facing can correspond to the internal screen camera, the device identifier can be device2, the device orientation (facing) of device2 can be front, and the sensor angle (sensor orientation) of device2 can be 90°; the folded front-facing can correspond to the external screen camera, the device identifier can be device1, the device orientation of device1 can be front, and the sensor angle of device1 can be 270°; the device identifier of the logical front can be device3, and the logical front can include the internal screen camera and the external screen camera. The device identifier of the internal screen camera can be device2, and the device identifier of the external screen camera can be device1.

[0170] It should be noted that the parameters corresponding to the above-mentioned various front-facing capabilities are only examples and not limitations. For example, the sensor angle of the internal screen camera can also be 270°, and the sensor angle of the external screen camera can also be 90°.

[0171] S1220, open the internal screen camera and the external screen camera at the same time, use the internal screen camera to shoot, and control the internal screen to display the image captured by the internal screen camera.

[0172] If the user initiates a video call while the device is unfolded, the user can control the device to turn on the logical front camera, that is, turn on both the internal screen camera (device2) and the external screen camera (device1) simultaneously (that is, both the internal screen camera and the external screen camera remain powered). At this point, the internal screen camera (device2) can be used to shoot and the internal screen can be controlled to display the image captured by the internal screen camera (device2).

[0173] S1230: Sense the opening and closing status of the terminal device.

[0174] During a video call, you can continuously sense whether the opening and closing status of the terminal device has changed.

[0175] S1240, switch the internal screen camera to the external screen camera and use the external screen to display the captured image.

[0176] If the user folds the terminal device during a video call, step S1230 can sense that the opening and closing state of the terminal device has changed to a folded state. At this time, the internal screen camera (device2) can be switched to the external screen camera (device1) and the captured image can be displayed using the external screen.

[0177] For example, as shown in Figure 13, when the mobile phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the picture taken by the inner screen camera. At this time, if the user closes the mobile phone (that is, puts the mobile phone in the folded state), the outer screen of the mobile phone is in the locked screen state, and there is no picture on the outer screen (there may only be sound). After the user unlocks the outer screen, the outer screen can display the picture taken by the outer screen camera.

[0178] At this time, the external screen camera is used as a rear camera, and the image displayed on the external screen can be flipped. For example, the image displayed on the external screen can be flipped 180°. In this way, the shooting picture displayed on the display screen can be avoided from being upside down, thereby improving the user experience.

[0179] For S1250, switch the external screen camera to the internal screen camera and use the internal screen to display the captured image.

[0180] If the user unfolds the terminal device during a video call, step S1230 can sense that the opening and closing state of the terminal device has changed to the unfolded state. At this time, the external screen camera (device1) can be switched to the internal screen camera (device2) and the captured image can be displayed using the internal screen.

[0181] For example, as shown in Figure 14, when the mobile phone is in a folded state, the user uses the external screen to make a video call, and the external screen displays the picture taken by the external screen camera. At this time, if the user unfolds the mobile phone (that is, puts the mobile phone in an unfolded state), the internal screen of the mobile phone can display the picture taken by the internal screen camera.

[0182] S1260: Determine whether the video call is ended.

[0183] If the video call ends, S1270 may be executed; if the video call does not end, S1230 may be executed, that is, continuously sensing whether the opening and closing state of the terminal device changes.

[0184] On S1270, turn off both the internal and external cameras.

[0185] When the video call ends, turn off the internal screen camera (device2) and the external screen camera (device1).

[0186] The following is an exemplary description of an embodiment of turning off a camera in a non-shooting state with reference to FIG. 15 .

[0187] Figure 15 is a schematic flow chart of a method for controlling a terminal device provided by an embodiment of the present application. The method 1500 shown in Figure 15 may include steps S1510 to S1570, which are as follows:

[0188] S1510, device reporting capability.

[0189] When the user turns on the terminal device, each device at the bottom of the terminal device can report its capabilities.

[0190] For example, the camera can report two sets of front-facing capabilities, namely, unfolded front-facing and folded front-facing. Among them, the unfolded front-facing can correspond to the internal screen camera, the device identifier can be device2, the device orientation of device2 can be front, and the sensor angle of device2 can be 90°; the folded front-facing can correspond to the external screen camera, the device identifier can be device1, the device orientation of device1 can be front, and the sensor angle of device1 can be 270°.

[0191] S1520: Turn on the internal screen camera, use the internal screen camera to shoot, and control the internal screen to display the images captured by the internal screen camera.

[0192] If the user opens a video call while the terminal device is in the unfolded state, the user can control the terminal device to turn on the unfolded front camera, that is, turn on the internal screen camera (that is, power on the internal screen camera). At this time, the internal screen camera (device2) can be used to shoot and the internal screen can be controlled to display the image captured by the internal screen camera (device2).

[0193] S1530: Sense the open and closed state of the terminal device.

[0194] During a video call, you can continuously sense whether the opening and closing status of the terminal device has changed.

[0195] For S1540, turn off the internal camera, turn on the external camera, and use the external screen to display the captured image.

[0196] If the user folds the terminal device during a video call, step S1330 can sense that the opening and closing state of the terminal device has changed to a folded state. At this time, the internal screen camera (device2) can be turned off, the external screen camera (device1) can be turned on, and the captured image can be displayed using the external screen.

[0197] For example, as shown in Figure 13, when the mobile phone is in the unfolded state, the user uses the inner screen to make a video call, and the inner screen displays the picture taken by the inner screen camera. At this time, if the user closes the mobile phone (that is, puts the mobile phone in the folded state), the outer screen of the mobile phone is in the locked screen state, and there is no picture on the outer screen (there may only be sound). After the user unlocks the outer screen, the outer screen can display the picture taken by the outer screen camera.

[0198] At this time, the external screen camera is used as a rear camera, and the image displayed on the external screen can be flipped. For example, the image displayed on the external screen can be flipped 180°. In this way, the shooting picture displayed on the display screen can be avoided from being upside down, thereby improving the user experience.

[0199] For S1550, turn off the external camera, turn on the internal camera, and use the internal screen to display the captured image.

[0200] If the user unfolds the terminal device during a video call, step S1330 can sense that the opening and closing state of the terminal device has changed to the unfolded state. At this time, the external screen camera (device1) can be turned off, the internal screen camera (device2) can be turned on, and the captured image can be displayed using the internal screen.

[0201] For example, as shown in Figure 14, when the mobile phone is in a folded state, the user uses the external screen to make a video call, and the external screen displays the picture taken by the external screen camera. At this time, if the user unfolds the mobile phone (that is, puts the mobile phone in an unfolded state), the internal screen of the mobile phone can display the picture taken by the internal screen camera.

[0202] S1560: Determine whether the video call is ended.

[0203] If the video call ends, S1570 may be executed; if the video call does not end, S1530 may be executed, that is, continuously sensing whether the opening and closing state of the terminal device changes.

[0204] On S1570, turn off the internal or external camera.

[0205] When the video call ends, turn off the internal or external camera.

[0206] The method embodiment of the present application is described in detail above in conjunction with Figures 1 to 15 . The device embodiment of the present application is described in detail below in conjunction with Figures 16 and 17 . It should be understood that the description of the method embodiment corresponds to the description of the device embodiment. Therefore, for parts not described in detail, reference can be made to the above method embodiment.

[0207] Figure 16 is a schematic structural diagram of an apparatus 1600 for controlling a terminal device provided in one embodiment of the present application. The terminal device includes a first display screen, a second display screen, a first camera, and a second camera. At least one of the first display screen and the second display screen is a foldable screen. The terminal device is in a first state when opened or closed. The first camera is in a shooting state, and the first display screen displays an image captured by the first camera.

[0208] As shown in FIG16 , the apparatus 1600 includes an acquisition unit 1610 and a control unit 1620 , specifically as follows:

[0209] An acquiring unit 1610 is configured to acquire a first instruction from a user, where the first instruction is configured to adjust the open or closed state of the terminal device to a second state;

[0210] The control unit 1620 is configured to control the second camera to be in a shooting state and control the second display screen to display the image shot by the second camera in response to the first instruction.

[0211] In an embodiment of the present application, the first instruction is used to adjust the opening and closing state of the terminal device to the second state. In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image captured by the second camera. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be switched and the corresponding display screen can be controlled to display the image captured by the camera. This can avoid interruption of the shooting picture displayed on the display screen (for example, the display screen appears black or cannot display the shooting picture normally, etc.), thereby improving the user experience.

[0212] In some possible implementations, the opening and closing states of the terminal device include an unfolded state and a folded state.

[0213] In some possible implementations, when the terminal device is in the second state, the first camera is in an on state.

[0214] In an embodiment of the present application, the first camera and the second camera are in the open state at the same time. In this way, when the opening and closing state of the terminal device changes, the camera in the shooting state can be quickly switched and the corresponding display screen can be controlled to display the image taken by the camera, thereby improving the user experience.

[0215] In some possible implementations, when the terminal device is in the second state, the first camera is in an off state.

[0216] In an embodiment of the present application, when the terminal device is in the second state, the first camera is in the off state. In this way, by turning off the camera that does not need to display the shooting image, the power consumption of the terminal device can be reduced, the standby time of the terminal device can be extended, and the user experience can be improved.

[0217] In some possible implementations, the second state is a folded state, and the apparatus 1600 further includes an adjustment unit 1630 configured to adjust an angle of an image displayed on the second display screen.

[0218] In an embodiment of the present application, when the terminal device is in a folded state, adjusting the angle of the image displayed on the second display screen can avoid the shooting picture displayed on the display screen from being inverted, thereby improving the user experience.

[0219] In some possible implementations, the adjusting unit 1630 is specifically configured to flip the image displayed on the second display screen by 180 degrees.

[0220] Figure 17 is a schematic diagram of the structure of an apparatus provided in one embodiment of the present application. The dotted lines in Figure 17 indicate that the unit or module is optional. Apparatus 1700 can be used to implement the method described in the above method embodiment. Apparatus 1700 can be a chip or a device for controlling a terminal device.

[0221] The device 1700 may include one or more processors 1710. The processor 1710 may support the device 1700 to implement the method described in the method embodiment above. The processor 1710 may be a general-purpose processor or a special-purpose processor. For example, the processor may be a central processing unit (CPU). Alternatively, the processor may be another general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0222] The apparatus 1700 may further include one or more memories 1720. The memories 1720 store programs that can be executed by the processor 1710, causing the processor 1710 to perform the methods described in the above method embodiments. The memories 1720 may be independent of the processor 1710 or integrated into the processor 1710.

[0223] The apparatus 1700 may further include a transceiver 1730. The processor 1710 may communicate with other devices or chips via the transceiver 1730. For example, the processor 1710 may transmit and receive data with other devices or chips via the transceiver 1730.

[0224] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0225] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0226] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a computer, the computer implements the steps in the above-mentioned various method embodiments.

[0227] An embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device (such as a server or a terminal device), the terminal device implements the steps in the above-mentioned various method embodiments.

[0228] An embodiment of the present application provides a chip, which includes a processor and a memory, wherein the memory is used to store computer programs, and the processor is used to call and run the computer programs stored in the memory, so that a terminal device (such as a server or terminal device) equipped with the chip executes the steps in the above-mentioned method embodiments.

[0229] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may at least include: any entity or device that can carry the computer program code to the device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, a computer-readable storage medium cannot be an electric carrier signal or a telecommunication signal.

[0230] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0231] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0232] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0233] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0234] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for controlling a terminal device, characterized in that: The terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a foldable screen, the terminal device is in a first state when it is opened or closed, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera; The method comprises: Obtaining a first instruction from a user, where the first instruction is used to adjust the open / closed state of the terminal device to a second state; In response to the first instruction, the second camera is controlled to be in a shooting state, and the second display screen is controlled to display the image shot by the second camera.

2. The method according to claim 1, characterized in that The opening and closing states of the terminal device include an unfolded state and a folded state.

3. The method according to claim 1 or 2, characterized in that When the terminal device is in the second state, the first camera is in the turned-on state.

4. The method according to claim 1 or 2, characterized in that When the terminal device is in the second state, the first camera is in an off state.

5. The method according to any one of claims 1 to 4, characterized in that The second state is a folded state, and the method further includes: Adjust the angle of the image displayed on the second display screen.

6. The method according to claim 5, characterized in that The adjusting the angle of the image displayed on the second display screen includes: The image displayed on the second display screen is flipped 180 degrees.

7. A device for controlling a terminal device, characterized in that: The terminal device includes a first display screen, a second display screen, a first camera, and a second camera, at least one of the first display screen and the second display screen is a foldable screen, the terminal device is in a first state when it is opened or closed, the first camera is in a shooting state, and the first display screen displays an image shot by the first camera; Wherein, the device comprises: an acquiring unit, configured to acquire a first instruction from a user, wherein the first instruction is used to adjust the open / closed state of the terminal device to a second state; The control unit is configured to control the second camera to be in a shooting state and control the second display screen to display an image shot by the second camera in response to the first instruction.

8. The device according to claim 7, characterized in that The opening and closing states of the terminal device include an unfolded state and a folded state.

9. The device according to claim 7 or 8, characterized in that When the terminal device is in the second state, the first camera is in the turned-on state.

10. The device according to claim 7 or 8, characterized in that When the terminal device is in the second state, the first camera is in an off state.

11. The device according to any one of claims 7 to 10, characterized in that The second state is a folded state, and the device further includes an adjustment unit for: Adjust the angle of the image displayed on the second display screen.

12. The device according to claim 11, characterized in that The adjustment unit is specifically used for: The image displayed on the second display screen is flipped 180 degrees.

13. A device for controlling a terminal device, characterized in that: include: A processor and a memory, wherein the processor is coupled to the memory, and the memory is used to store a computer program, and when the computer program is executed by the processor, the device performs the method according to any one of claims 1 to 6.

14. A terminal device, characterized in that: The terminal device includes the apparatus according to any one of claims 7 to 13.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 6.

16. A computer program product, characterized in that include: A computer program, when running on a computer, causes the computer to execute the method according to any one of claims 1 to 6.

17. A chip, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory, so that a device or apparatus equipped with the chip executes the method according to any one of claims 1 to 6.

Images