A method and device for obtaining content
By implementing cross-device screenshot or screen recording command control in electronic devices, the problem of information sharing between devices is solved, and user experience and device linkage are improved.
Patent Information
- Application Number
- CN202110887743.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-09-29
- Filing Date
- 2021-08-03
- Publication Date
- 2025-01-03
- Estimated Expiration
- 2041-08-03
AI Technical Summary
Existing electronic devices cannot perform screenshots or recordings on other devices on one device, which limits linkage and information sharing between devices.
Through a content acquisition method and device, one device allows a device to send screenshot or screen recording instructions to other devices, control it to perform screenshot or screen recording operations, and feed the result content to the initiating device to realize content acquisition across devices.
It enhances the linkage between different devices, facilitates users to quickly obtain information, improves user experience, and realizes quick sharing between devices.
Smart Images

Figure CN114356187B_ABST
Abstract
Description
[0001] This application claims priority to a Chinese patent application filed with the China Patent Office on September 29, 2020, with application number 202011048184.0 and application name “A Content Acquisition Method and Device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a content acquisition method and device. Background Art
[0003] Currently, electronic devices can obtain desired content through the functions of screenshot or screen recording. Taking screenshot as an example, users can trigger the screenshot operation of the electronic device by sliding down with three fingers or tapping with knuckles, that is, the electronic device can only take a screenshot of itself, but not of other devices.
[0004] As the types of electronic devices increase, it has become an inevitable trend to enhance the linkage between different electronic devices. Therefore, how to take screenshots or record screens of other devices on one electronic device has become a problem to be solved. Summary of the invention
[0005] The present application provides a content acquisition method and apparatus, which are used to control other devices to perform operations through one device to acquire content on the other devices.
[0006] In a first aspect, the present application provides a content acquisition method, the method comprising: a first device triggers a content acquisition instruction to a second device, the content acquisition instruction being used to instruct the second device to take a screenshot or record a screen of content currently displayed on a display screen of the second device, and to feed back the content obtained by the screenshot or recording operation to the first device; the first device receives and displays the content corresponding to the content acquisition instruction sent by the second device.
[0007] Through the above technical solution, the first device can control the second device to perform a screenshot operation or a screen recording operation, and can receive and display the content obtained by the second device performing the screenshot operation or the screen recording operation. In this way, it is possible to control one or more other devices to perform a screenshot or screen recording operation through one device, thereby enhancing the linkage between different devices, facilitating users to quickly obtain information, and improving user experience.
[0008] In the present application, the first device triggers a content acquisition instruction to the second device, which may include the following implementation methods:
[0009] The first way: the first device responds to a first operation of the user, where the first operation is used to trigger a content acquisition instruction to the second device.
[0010] The second method: the first device triggers a content acquisition instruction to the second device by performing a touch operation with the second device.
[0011] The second manner: the first device sends a notification message to the third device, where the notification message is used to notify the third device to trigger a content acquisition instruction to the second device.
[0012] It should be noted that the solution of the present application can be applicable to short-range communication scenarios, that is, the communication between the first device and the second device is short-range communication.
[0013] Through the above three methods, the user can independently select the device to be controlled, or trigger a content acquisition instruction to the second device by performing a "touch" operation with the second device, or indirectly trigger a content acquisition instruction to the second device through an intermediate device, thereby realizing controlling other devices to perform screenshot operations or screen recording operations on one device.
[0014] In one possible design, before the first device responds to the user's first operation, the first device may also respond to the user's second operation to display a list of currently connectable devices on a display screen, where the second operation is used to trigger the display of the list of connectable devices; the first device responds to the user's third operation to select a second device in the displayed list of connectable devices, where the third operation is an operation in which the user selects a corresponding device in the displayed list of connectable devices.
[0015] Through the above technical solution, the user can select a controlled device from multiple devices, and then trigger a content acquisition instruction to the selected device on the first device, thereby controlling the second device to perform an operation.
[0016] In a possible design, the first device may also synchronously display a first interface while receiving and displaying the content corresponding to the content acquisition instruction sent by the second device, where the first interface includes the transmission progress of the content.
[0017] Through the above technical solution, the transmission progress of the content corresponding to the content acquisition instruction can be displayed on the first device, so that the user can understand the reception status of the content of the screenshot or screen recording peer device, thereby improving the user experience.
[0018] In a possible design, the method further includes: the first device displays first prompt information, where the first prompt information is used to prompt the second device of a status of an operation corresponding to the content acquisition instruction.
[0019] Through the above technical solution, when the second device executes an operation corresponding to the content acquisition instruction, prompt information for prompting the second device to execute the operation corresponding to the content acquisition instruction can be displayed on the first device, so that the user can easily check whether the operation executed by the second device is correct.
[0020] In a possible design, the method also includes: the first device displays second prompt information, and the second prompt information is used to prompt the user to receive content sent by the second device that corresponds to the content acquisition instruction.
[0021] Through the above technical solution, when the second device feeds back content corresponding to the content acquisition instruction to the first device, prompt information can be displayed on the first device so that the user can receive the feedback content of the second device in a timely manner.
[0022] In a second aspect, the present application also provides a content acquisition method, which includes: a second device receives a content acquisition instruction triggered by a first device, the content acquisition instruction being used to instruct the second device to take a screenshot or record the content currently displayed on the display screen of the second device; the second device takes a screenshot or records the content currently displayed on its own display screen according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction; the second device sends the content corresponding to the content acquisition instruction to the first device.
[0023] In the above technical solution, after receiving the content acquisition instruction triggered by the first device, the second device can perform a corresponding operation and send the content corresponding to the content acquisition instruction to the first device. In this way, the content displayed on the second device can be captured or recorded by controlling the second device by the first device, thereby improving the user experience and achieving the purpose of quickly sharing information between devices.
[0024] In a possible design, the method further includes: the second device displays third prompt information, and the third prompt information is used to prompt the user whether to execute the content acquisition instruction sent by the first device.
[0025] Through the above technical solution, after receiving the content acquisition instruction triggered by the first device, the second device can display a prompt message on the display screen for user confirmation. After the user confirms, the second device will perform the corresponding operation. This can improve the security of content acquisition and protect the security of user information.
[0026] In a possible design, while the second device is sending the content corresponding to the content acquisition instruction to the first device, a second interface may also be displayed, where the second interface includes the transmission progress of the content.
[0027] Through the above technical solution, when the second device sends the content corresponding to the content acquisition instruction to the first device, the content transmission progress can be displayed on the display screen of the second device so that the user can understand the transmission status and avoid transmission interruption caused by other factors such as network interruption.
[0028] In the third aspect, the present application also provides a content acquisition device, which includes: a display screen; one or more processors; a memory; multiple applications; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are called and executed by the one or more processors, the content acquisition device executes the above-mentioned first aspect and any possible design of the first aspect. Technical solution.
[0029] In a fourth aspect, the present application also provides a content acquisition device, which includes modules / units for executing the first aspect or any possible design method of the first aspect; these modules / units can be implemented by hardware, or corresponding software can be implemented by hardware.
[0030] In the fifth aspect, the present application also provides a content acquisition device, which includes: a display screen; one or more processors; a memory; multiple applications; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are called and executed by the one or more processors, the content acquisition device executes the above-mentioned second aspect and any possible design of the second aspect of the technical solution.
[0031] In a sixth aspect, the present application also provides a content acquisition device, which includes modules / units for executing the second aspect or any possible design method of the second aspect; these modules / units can be implemented by hardware, or corresponding software can be implemented by hardware.
[0032] In the seventh aspect, an embodiment of the present application also provides a chip, which is coupled to a memory in an electronic device to execute the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect; in the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.
[0033] In the eighth aspect, an embodiment of the present application also provides a chip, which is coupled to a memory in an electronic device to execute the technical solution of the second aspect of the embodiment of the present application and any possible design of the second aspect; in the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.
[0034] In the ninth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect.
[0035] In the tenth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the technical solution of the second aspect of the embodiment of the present application and any possible design of the second aspect.
[0036] In the eleventh aspect, the embodiment of the present application also provides a computer program product, which, when running on an electronic device, enables the electronic device to execute the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect.
[0037] In the twelfth aspect, the embodiments of the present application further provide a computer program product, which, when executed on an electronic device, enables the electronic device to execute the technical solution of the second aspect of the embodiments of the present application and any possible design of the second aspect thereof.
[0038] For each aspect from the third aspect to the twelfth aspect and the technical effects that may be achieved by each aspect, please refer to the above-mentioned description of the technical effects that can be achieved by various possible schemes in the first aspect and the second aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1A A schematic diagram of a user interface provided in an embodiment of the present application;
[0040] Figure 1B A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0041] Figure 2 A schematic diagram of an application scenario provided for an embodiment of the present application;
[0042] Figure 3A A flowchart of a content acquisition method provided in an embodiment of the present application;
[0043] Figure 3B A flow chart of a content acquisition method provided in an embodiment of the present application;
[0044] Figure 4A A schematic diagram of a user interface provided in an embodiment of the present application;
[0045] Figure 4B A schematic diagram of software modules of a content acquisition method provided in an embodiment of the present application;
[0046] Figure 4C-4D A schematic diagram of a user interface provided in an embodiment of the present application;
[0047] Figure 5A A flowchart of a content acquisition method provided in an embodiment of the present application;
[0048] Figure 5B A flow chart of a content acquisition method provided in an embodiment of the present application;
[0049] Fig. 6A A schematic diagram of a user interface provided in an embodiment of the present application;
[0050] Figure 6B An operation schematic diagram provided for an embodiment of the present application;
[0051] Figure 6C A software module diagram of a content acquisition method provided in an embodiment of the present application;
[0052] Figure 6D-Figure 7B A schematic diagram of a user interface provided in an embodiment of the present application;
[0053] Figure 7C An operation schematic diagram is provided for an embodiment of the present application;
[0054] Fig.7D A schematic diagram of a user interface provided in an embodiment of the present application;
[0055] Fig. 7E A schematic diagram of software modules of a content acquisition method provided in an embodiment of the present application;
[0056] Fig. 8A A flowchart of a content acquisition method provided in an embodiment of the present application;
[0057] Figure 8B A flow chart of a content acquisition method provided in an embodiment of the present application;
[0058] Fig. 9A A schematic diagram of a user interface provided in an embodiment of the present application;
[0059] Fig. 9B An operation schematic diagram provided for an embodiment of the present application;
[0060] Fig. 9C A schematic diagram of a user interface provided in an embodiment of the present application;
[0061] Fig.9D A schematic diagram of software modules of a content acquisition method provided in an embodiment of the present application;
[0062] Fig.10 A schematic diagram of a user interface provided in an embodiment of the present application;
[0063] Fig.11 A flow chart of a content acquisition method provided in an embodiment of the present application;
[0064] Fig.12 A schematic diagram of a content acquisition device provided in an embodiment of the present application;
[0065] Fig.13 A schematic diagram of the structure of another content acquisition device provided in an embodiment of the present application;
[0066] Fig.14 A schematic diagram of the structure of another content acquisition device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0067] The technical solutions in the embodiments of the present application will be described in detail below in conjunction with the drawings in the following embodiments of the present application.
[0068] For ease of understanding, an exemplary description of concepts related to the present application is provided for reference, as shown below:
[0069] 1. Screenshot: Also known as screenshot, it saves the desktop, windows, dialog boxes, tabs and other screen elements displayed on the display of the electronic device as pictures.
[0070] 2. Screen recording: Also known as screen recording, it records the user's operation process on the display screen of the electronic device and saves it as a video format file.
[0071] For example, Figure 1A FIG. 1 is a schematic diagram of a user interface provided in an embodiment of the present application. Figure 1A As shown, taking a mobile phone as an example, assuming that the user opens the notification bar through a gesture operation, such as sliding down from the top of the display screen, that is, the notification bar is displayed on the display screen of the mobile phone, and the user can click the function button in the notification bar to control the mobile phone to perform the corresponding operation. For example, the user can click the "screenshot" button 11, and the mobile phone can respond to the user's click operation on the "screenshot" button and perform the screen capture operation. For another example, the user clicks the "screen recording" button 12, and the mobile phone can respond to the user's click operation on the "screen recording" button 12 and perform the screen recording operation.
[0072] At present, taking a mobile phone as an example, a mobile phone can take a screenshot of the content currently displayed on its own device screen by performing gesture operations on the touch screen (for example, tapping the touch screen with a knuckle), but the mobile phone cannot take a screenshot or record the content currently displayed on the screen of other devices. Therefore, how to control another device to take a screenshot or record the screen through one device to obtain the content currently displayed on the screen of another device is a problem to be solved.
[0073] To solve the above technical problems, an embodiment of the present application proposes a content acquisition method, which can control another device or multiple devices to take screenshots or record screens by sending instructions for triggering screenshots or screen recording from one device to another device or multiple devices, thereby obtaining the content currently displayed on the display screen of the other device or multiple devices.
[0074] It can be understood that the "content" in the embodiments of the present application may include images, videos, texts or icons currently displayed on the display screen of another device or multiple other devices, and the present application does not specifically limit this.
[0075] The application (application, App) involved in the embodiments of the present application, referred to as application, is a software program that can realize one or more specific functions. Generally, multiple applications can be installed in an electronic device. For example, a camera application, a text message application, a mailbox application, a message application, a gallery, a map, a Tencent video, etc. The application mentioned below can be an application installed when the electronic device leaves the factory, or it can be an application downloaded by the user from the Internet or obtained from other electronic devices during the use of the electronic device.
[0076] It should be noted that the content acquisition method provided in the embodiments of the present application can be applicable to any electronic device with a display screen, such as mobile phones, tablet computers, wearable devices (for example, watches, bracelets, smart helmets, etc.), vehicle-mounted devices, smart homes, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc., and the embodiments of the present application are not limited.
[0077] For the convenience of description, two devices are taken as examples below, such as the first device and the second device, to illustrate the process in which one device sends a command to another device for triggering screenshot or screen recording to control the other device to take a screenshot or screen recording, thereby obtaining the content currently displayed on the display screen of another device. The principle of obtaining the content displayed on the display screens of multiple other devices is similar to the principle of one device obtaining the content displayed on the display screen of another device. Assume that the first device wants to control the second device to execute a screenshot or screen recording file to obtain the display content on the display screen of the second device. Among them, the first device can be a mobile phone, a tablet computer, etc., and the second device can be a watch, a large-screen device (such as a smart screen), etc., which is not limited in this application.
[0078] The following uses mobile phones as an example to introduce the structure of the electronic device.
[0079] like Figure 1B As shown, the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0080] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the mobile phone 100. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory can save instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
[0081] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile phone 100, and can also be used to transmit data between the mobile phone 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
[0082] The wireless communication function of the mobile phone 100 can be realized by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0083] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the mobile phone 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0084] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0085] In some embodiments, the antenna 1 of the mobile phone 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile phone 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0086] The display screen 194 is used to display the display interface of the application, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the mobile phone 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. In an embodiment of the present application, the display screen 194 can be used to display multiple application interfaces simultaneously.
[0087] The camera 193 is used to capture still images or videos. The camera 193 may include a front camera and a rear camera.
[0088] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application (such as iQiyi application, WeChat application, etc.). The data storage area can store data (such as images, videos, etc.) generated during the use of the mobile phone 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0089] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are stored in the external memory card.
[0090] The mobile phone 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.
[0091] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The gyroscope sensor 180B can be used to determine the motion posture of the mobile phone 100. In some embodiments, the angular velocity of the mobile phone 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B.
[0092] The gyroscope sensor 180B can be used for anti-shake shooting. The air pressure sensor 180C is used to measure air pressure. In some embodiments, the mobile phone 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation. The magnetic sensor 180D includes a Hall sensor. The mobile phone 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the mobile phone 100 is a flip phone, the mobile phone 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the automatic unlocking of the flip cover and other features are set. The acceleration sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in all directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.
[0093] Distance sensor 180F is used to measure distance. Mobile phone 100 can measure distance by infrared or laser. In some embodiments, when shooting a scene, mobile phone 100 can use distance sensor 180F to measure distance to achieve fast focus. Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. Mobile phone 100 emits infrared light outward through the light emitting diode. Mobile phone 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near mobile phone 100. When insufficient reflected light is detected, mobile phone 100 can determine that there is no object near mobile phone 100. Mobile phone 100 can use proximity light sensor 180G to detect that the user holds the mobile phone 100 close to the ear to talk, so as to automatically turn off the screen to save power. Proximity light sensor 180G can also be used in leather case mode, pocket mode to automatically unlock and lock the screen.
[0094] The ambient light sensor 180L is used to sense the ambient light brightness. The mobile phone 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the mobile phone 100 is in a pocket to prevent accidental touches. The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.
[0095] The temperature sensor 180J is used to detect temperature. In some embodiments, the mobile phone 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the mobile phone 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the mobile phone 100 heats the battery 142 to avoid abnormal shutdown of the mobile phone 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the mobile phone 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.
[0096] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the mobile phone 100, which is different from the position of the display screen 194.
[0097] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of vibrating bones of the human body. The bone conduction sensor 180M can also contact the human body's pulse to receive blood pressure beating signals.
[0098] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The mobile phone 100 can receive the button input and generate a key signal input related to the user settings and function control of the mobile phone 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the mobile phone 100.
[0099] Understandably, Figure 1B The components shown do not constitute a specific limitation on the mobile phone. The mobile phone may also include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. Figure 1B The mobile phone 100 shown is taken as an example for introduction.
[0100] In addition, at least one of the following embodiments includes one or more, wherein more means greater than or equal to two. In addition, it should be understood that in the description of this application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.
[0101] The content acquisition method provided in the embodiment of the present application can be applied to a scenario where multiple electronic devices are interconnected based on a communication network, such as Figure 2 As shown, multiple electronic devices including a mobile phone, an electronic device 1, an electronic device 2, an electronic device 3, and an electronic device 4 are included. Among them, the electronic device can be a watch, a tablet computer, a smart screen, a remote control, etc., and the mobile phone can interact with the watch, the smart screen, etc. The communication network can be a local area network or a wide area network, etc., which is not specifically limited in the embodiments of the present application. Exemplarily, the communication network can be a short-range communication network such as a wifi hotspot network, a wifi P2P network, a Bluetooth network, a zigbee network, or an NFC network.
[0102] exist Figure 2In the scenario shown, the mobile phone can establish a connection with other electronic devices, and then the mobile phone can control other electronic devices to perform a screenshot operation or a screen recording operation, and then other electronic devices can transmit the content obtained by performing the screenshot operation or the screen recording operation (such as pictures or videos, etc.) to the mobile phone through the local area network, so that the mobile phone can obtain the content displayed on the display screen of other electronic devices. Exemplarily, the mobile phone can "touch" the electronic device 3 (watch), and establish an NFC communication connection between the mobile phone and the watch by "touch", and trigger the instruction to perform the screenshot operation to the watch. After the watch receives the instruction of the screenshot operation, it can take a screenshot of the content currently displayed on the watch, and then when the watch completes the screenshot operation, it can transmit the content after the screenshot (which can be a screenshot of a picture or text, etc.) to the mobile phone through Bluetooth or wifi. Of course, it can be understood that the above is an example of the first device controlling the second device to perform the screenshot operation or the screen recording operation. In actual implementation, the second device can also control the first device to perform the screenshot operation or the screen recording operation. Combined with the above example, that is, the watch can also trigger the instruction to perform the screenshot operation to the mobile phone. When the mobile phone receives the screenshot operation instruction, it can take a screenshot of the content currently displayed on the mobile phone. Then, when the mobile phone completes the screenshot operation, it can transmit the screenshot content (which can be a picture screenshot or text screenshot and other information) to the watch via Bluetooth or WiFi. This application does not limit this.
[0103] Further, in an embodiment of the present application, a permission table may be stored in the initiating electronic device, and the permission table is used to indicate which electronic devices the initiating electronic device can send screenshot operation instructions or screen recording operation instructions to and / or which electronic devices the electronic device cannot send screenshot operation instructions or screen recording operation instructions to. In other words, the permission table can be used to indicate which electronic devices the initiating electronic device can control to take screenshots or screen recordings. Exemplarily, the permission table can be shown in Table 1.
[0104] Table 1
[0105]
[0106] It should be noted that "1" in Table 1 indicates permission, and "0" indicates no permission. For example, electronic device A can take screenshots of electronic device C, but cannot record the screen of electronic device C. It is understood that Table 1 is only a schematic illustration, and this application may be expressed in other forms without limitation.
[0107] When the initiating electronic device has the authority to initiate screenshot or screen recording instructions to other electronic devices, correspondingly, other electronic devices can receive the screenshot or screen recording instructions, and can agree to accept or disagree to accept the operation instructions sent by the initiating device. Exemplarily, after other electronic devices agree to accept the operation instructions sent by the initiating device, the initiating device can control other electronic devices to perform screenshot or screen recording operations. Exemplarily, after electronic device A sends a screenshot operation instruction to electronic device B, when electronic device B allows electronic device A to perform a screenshot operation on its own device, electronic device A can control electronic device B to perform a screenshot operation.
[0108] It should be noted that the above description is based on the identification of the electronic device as an example. That is to say, when an electronic device allows other electronic devices to perform screenshot operations or screen recording operations, all displayed content of the device terminal can be used by other electronic devices to perform screenshot operations or screen recording operations. In actual applications, permissions can also be set for different content in an electronic device. For example, permissions can be set for different content displayed on the electronic device. For example, for content displayed on the electronic device that includes the user's privacy information (for example, the user's ID number, bank card number, etc.), it may not be allowed to be used by other electronic devices to perform screenshot operations or screen recording operations. For content displayed on the electronic device that does not contain the user's privacy information, it may be allowed to be used by other electronic devices to perform screenshot operations or screen recording operations, etc.
[0109] The following is a detailed introduction to the content acquisition method involved in the embodiments of the present application in conjunction with specific scenarios.
[0110] Scenario 1: The master device selects the target device to achieve interaction between the master device and the target device. It should be noted that the master device can be understood as the first device, such as a mobile phone, and the target device can be understood as the second device, such as a smart screen, watch and other electronic devices.
[0111] like Figure 3A FIG. 1 is a schematic flow chart of a content acquisition method provided in an embodiment of the present application. Figure 3A As shown. On the master device side, the master device receives the screenshot or screen recording event, then queries and displays the list of available devices. The user can select the target device in the list of available devices and send the screenshot or screen recording command to the target device. On the target device side, the target device can parse the screenshot or screen recording command sent by the master device, and then start the screenshot or screen recording operation. After the screenshot or screen recording operation is completed, the content obtained by the screenshot or screen recording can be transmitted to the master device for storage.
[0112] The following will introduce the content acquisition method involved in this application in detail with reference to the user interface schematic diagram. Figure 3BAs shown, it is a flow chart of a content acquisition method provided by an embodiment of the present application, see Figure 3B As shown, the method may include the following steps:
[0113] Step 301: The master device responds to the user's operation of selecting a target device.
[0114] Take the mobile phone as the main device and the smart screen as the target device for the following example. Assume that a user is viewing a map on a smart screen and wants to take a screenshot of the geographical location of a certain place on the map (for the convenience of description, the image to be obtained can be referred to as the "target content") and share it with other users. Figure 4A As shown, the mobile phone 100 displays the main interface 400. Among them, the main interface 400 may include multiple applications, such as email, clock, gallery, etc. The user can call up the control bar through gesture operation on the main interface 400, and then select the target device in the control bar. Exemplarily, the gesture operation can be a sliding operation from the lower left corner upward on the main interface 400 of the mobile phone 100. When the mobile phone 100 detects the gesture operation, the user interface 410 can be displayed on the main interface. Among them, the user interface 410 may include a control bar 411, and the control bar 411 includes at least one list of connectable devices, such as "Smart Screen" 412 and "MateBook X" 413. The user can select "Smart Screen" 412 in the list of connectable devices, and the mobile phone 100 can respond to the user's click operation on the "Smart Screen" 412, and display the user interface 420 on the display screen. Among them, the user interface 420 may include multiple control function options, for example, it may include a "screenshot" button 421, a "recording" button 422, etc.
[0115] It should be noted that, in the embodiment of the present application, the electronic devices in the list of connectable devices displayed in the user interface 410 may be other electronic devices in the same local area network as the main device (mobile phone).
[0116] In other embodiments, the gesture operation may also be other operations, such as a sliding operation from the lower right corner upward, from the upper left corner downward, from the upper right corner downward, etc. In other embodiments, the gesture operation may also be a sliding operation from the lower left corner upward / from the lower right corner upward / from the upper left corner downward / from the upper right corner downward with a certain pressure. For example, the mobile phone 100 detects a sliding operation from the upper left corner downward, and the pressure sensor set on the display screen detects that the pressure value generated by the sliding operation is greater than a threshold value, the mobile phone 100 displays the control bar 411.
[0117] In other embodiments, the gesture operation may also be a sliding operation from the lower left corner upward / from the lower right corner upward / from the upper left corner downward / from the upper right corner downward, and the sliding operation stays or presses for a preset time without interval at the end position. For example, when the mobile phone 100 detects a sliding operation from the upper left corner downward, and the mobile phone 100 detects that the sliding operation slides to the end position, it stays or presses for a preset time (for example, 2 seconds) at the end position, and the mobile phone 100 displays the control bar 411.
[0118] In other embodiments, the gesture operation may also be other operations, such as drawing a circle or a polygon on the display screen; or, the gesture operation may also be an operation such as “shake”, which is not limited in the embodiments of the present application.
[0119] Step 302: The master device triggers a content acquisition instruction.
[0120] For example, the user can click the "screen capture" button 421 in the user interface 420, and the mobile phone 100 can respond to the user's click operation on the "screen capture" button 421 and send a screen capture instruction to the smart screen. It is understandable that if the user clicks the "record screen" button 422 in the interface 420, the mobile phone 100 can respond to the user's click operation on the "record screen" button 422 and send a screen recording instruction to the smart screen.
[0121] For example, see Figure 4B As shown, the user can select a smart screen from the list of available devices displayed on the mobile phone, and then the control signaling module can send the screenshot operation instruction triggered by the user to the smart screen to the soft bus (service bus, SB) of the mobile phone. The soft bus of the mobile phone sends the screenshot operation instruction to the soft bus of the smart screen through the near-field network.
[0122] Step 303: The target device performs a corresponding operation according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction.
[0123] When the user clicks the "screenshot" button 421 on the user interface 420, the mobile phone 100 can respond to the user's click operation on the "screenshot" button 421 and trigger a screenshot instruction to the smart screen. Correspondingly, the soft bus on the smart screen can send the screenshot instruction received from the mobile phone to the control signaling module on the smart screen, and then the control signaling module of the smart screen can control the smart screen to perform a screenshot operation on the target content, and obtain a screenshot of the target content displayed on the smart screen.
[0124] If the user clicks the "record screen" button 422 in the interface 420, the mobile phone 100 can respond to the user's click operation on the "record screen" button 421 and trigger a screen recording instruction to the smart screen. After receiving the screen recording instruction, the smart screen can perform a screen recording operation on the displayed target content for a certain length of time (for example, 15 seconds) to obtain a video file corresponding to the target content displayed on the smart screen within a certain length of time.
[0125] As a possible implementation, for example, after receiving the screen recording instruction, the smart screen can record the content displayed on the smart screen. At the same time, the display screen of the mobile phone 100 can display the recording time during the screen recording process. Figure 4C As shown, Figure 4C As shown, when the smart screen is recording, the display screen of the mobile phone 100 may display a user interface 450. The duration of the screen recording may be indicated by the shaded portion on the "record" button. When the display screen of the mobile phone 100 displays the user interface 460, that is, when the shaded portion on the "record" button is filled, it indicates that the smart screen has stopped recording.
[0126] As another possible implementation, during the recording process of the smart screen, the recording duration can be determined by the user. Figure 4A , the user can click the "record screen" button 422 in the user interface 420 of the mobile phone, and then the smart screen can start the screen recording operation. If the user wants to stop the screen recording, the user can click the "record screen" button 422 in the user interface 420 of the mobile phone again, and then the smart screen can stop the screen recording operation. In other words, the user can choose the screen recording time according to their own needs, which can improve the user experience.
[0127] Step 304: The target device transmits the content corresponding to the content acquisition instruction to the main device.
[0128] For example, see Figure 4A and 4B As shown, after the smart screen takes a screenshot of the displayed interface, the control signaling module on the smart screen can send the screenshot to the file transfer module. The file transfer module then transmits the obtained content to the mobile phone 100 through the soft bus. During the image transmission process, the user interface 430 can be displayed on the mobile phone 100. Among them, the transmission progress of the screenshot that can be displayed in the user interface 430 is 50% (that is, the black semicircle outside the "screenshot" in the figure). When the transmission progress is 100%, that is, after the transmission is completed, the user interface 440 can be displayed on the display screen of the mobile phone 100, such as the map shown in the figure.
[0129] Of course, in actual product implementation, the transmission progress can be displayed in colors such as blue and red, and the style of the transmission progress can also be other display forms, for example, it can also be represented by the size of the shaded area, etc. This application does not limit this.
[0130] As another example, see Figure 4C As shown, after the smart screen performs the screen recording operation, the smart screen can transfer the recorded file to the mobile phone 100. During the file transfer process, the user interface 470 can be displayed on the display screen of the mobile phone 100. Among them, the file transfer progress 471 can be displayed on the user interface 470, for example, the file transfer progress can be indicated in the form of text, such as "30% transferred" as shown in the figure. It should be noted that the style of the file transfer progress can also be in other forms, which is not limited in this application.
[0131] It should be noted that Figure 4A , Figure 4C This is a user interface diagram for content acquisition on the main device (mobile phone). The following describes the process of the controlled end device, i.e. the target device, such as a smart screen, being controlled to execute operation instructions.
[0132] See also Figure 4D As shown, before the mobile phone triggers the operation execution instruction, the user interface 40 is displayed on the smart screen, for example, a map as shown in the figure can be displayed. The user can select the smart screen in the connectable list displayed on the mobile phone, and choose to perform a screenshot operation on the smart screen, and then the mobile phone can trigger the screenshot instruction to the smart screen. After the smart screen receives the screenshot instruction, the user interface 41 can be displayed. Among them, the user interface 41 may include a prompt box "HUAWEI Mate 30 requests a screenshot, is it allowed?" 4101, "Allow" 4102 and "Reject" 4103.
[0133] After the user selects "Allow" 4102 in the user interface 41 of the smart screen, the smart screen can perform a screenshot operation, and the user interface 42 can be displayed on the smart screen. For example, the user interface 42 may include a prompt box "Screenshot in progress" 4201. After the smart screen completes the screenshot operation, the screenshot image can be sent to the mobile phone. When sending a screenshot image to a mobile phone, a user interface 43 may be displayed on the smart screen, and the user interface 43 may include a prompt box "Sending files to HUAWEI Mate 30, 30% transferred" 4301, that is, the file transfer progress will be displayed on the display screen of the smart screen. It is understandable that the prompt box 4301 may disappear after the file transfer is completed.
[0134] It should be noted that, assuming that the display screen of the smart screen is a touch screen, in this application, the user can select the button "Allow" 4102 through the remote control, or can select the button "Allow" 4102 by clicking on the touch screen. This application does not limit this.
[0135] Of course, it is understandable that the above user interface diagram is only a schematic illustration. When the actual product is implemented, the content displayed on the user interface may also be other content, such as Figure 4D The content of the prompt box 4101 may also be "Do you allow HUAWEI Mate 30 to take a screenshot?" etc. This application does not make any specific limitations on this.
[0136] Scenario 2: The master device interacts with the target device by touching or scanning.
[0137] like Figure 5A FIG. 1 is a schematic flow chart of a content acquisition method provided in an embodiment of the present application. Figure 5A As shown. The master device can establish a connection with the target device by "touch" or "scan", and send a screenshot or screen recording command to the target device. On the target device side, the target device parses the screenshot or screen recording command sent by the master device, and then starts to perform the screenshot or screen recording operation. After the screenshot or screen recording operation is completed, the content obtained by the screenshot or screen recording can be transmitted to the master device for storage.
[0138] The following will introduce the two implementation methods of this scenario in detail with the help of the user interface diagram. Figure 5B As shown, it is a flow chart of a content acquisition method provided by an embodiment of the present application, see Figure 5B As shown, the method may include the following steps:
[0139] It should be noted that step 502 and step 503 are Figure 3B Step 303 and step 304 in the embodiment shown are the same. For details, please refer to Figure 3B The description in the illustrated embodiment will not be described in detail here.
[0140] Step 501: The master device triggers a content acquisition instruction to the target device.
[0141] Step 502: The target device performs a corresponding operation according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction.
[0142] Step 503: The target device transmits the content corresponding to the content acquisition instruction to the master device.
[0143] As a possible implementation method, the master device can establish a connection with the target device by "touching" the target device, and at the same time trigger the target device to execute the content acquisition instruction. Fig. 6A As shown, for example, the mobile phone 100 displays the main interface 600, when the mobile phone 100 and the watch (HUAWEI Watch1) are "touched" (for example, see Figure 6B After that, the mobile phone 100 may respond to the "touch" operation and then trigger the screenshot operation instruction to the watch. At the same time, the display screen of the mobile phone 100 may display a user interface 610, and the user interface 610 may include a prompt box 611. Among them, the content of the prompt box 611 may be "HUAWEI Watch1 is performing a screenshot operation". Of course, it is understandable that the prompt box 611 can be displayed for a certain length of time, for example, it can be displayed for 10 seconds.
[0144] For example, see Figure 6C As shown, a schematic diagram of software module interaction provided by an embodiment of the present application is shown. After the mobile phone and the watch perform a "touch and click" operation, the control signaling module on the mobile phone can send a screenshot operation instruction to the soft bus on the mobile phone, and then the soft bus on the mobile phone can send the screenshot operation instruction to the soft bus on the watch through the near field network.
[0145] Correspondingly, when the soft bus on the watch can send the screenshot operation instruction received from the mobile phone 100 to the control signaling module on the watch, the control signaling module on the watch can respond to the screenshot operation instruction and take a screenshot of the target content according to the screenshot operation instruction. After the watch completes the screenshot operation, the image after the screenshot can be transmitted to the file transfer module on the mobile phone 100 through the file transfer module and the soft bus, and then the file transfer module on the mobile phone 100 saves the image after the screenshot in the application gallery. Exemplarily, before the watch transmits the image to the mobile phone 100, the display screen of the mobile phone 100 can display a user interface 620. Among them, the user interface 620 may include a prompt box 621, and the prompt box 621 may have a text prompt "Do you want to receive files from HUAWEI Watch1?" 622, a selection button "Yes" 623 and a selection button "No" 624. After the user clicks the selection button "Yes" 623, the watch can transmit the image to the mobile phone 100. During the image transmission process, a user interface 630 may be displayed on the display screen of the mobile phone 100 , and the user interface 630 may display the image transmission progress, for example, a prompt box 631 may be displayed, and the content of the prompt box 631 may be “The file is being transferred, and 70% has been transferred”.
[0146] It is understandable that the user can check the image transmission progress by pulling down the "Notification Management" in the notification bar. For example, when the image transmission is completed, the user can slide from the top to the bottom on the display screen of the mobile phone 100, and then the mobile phone 100 can respond to the sliding operation of the user's finger on the display screen, and a user interface 640 can be displayed on the display screen. The user interface 640 may include a file transmission progress notification 641, for example, "File has been transferred". After the user clicks on the transmission progress notification 641, a user interface 650 may be displayed on the display screen of the mobile phone 100, and the user interface 650 may display an image obtained by taking a screenshot from the display screen of the watch.
[0147] It should be noted that Figure 4A and Figure 4C In the embodiment shown, after the smart screen completes the screenshot operation or the screen recording operation, it can also display the following Fig. 6A The user interface 620 shown, for example, may display a prompt box "Do you want to receive files from the smart screen?" When the user clicks the "Yes" button, the smart screen may send the file to the mobile phone 100. Of course, considering that the screenshot operation or screen recording itself is triggered by the mobile phone 100 to the smart screen, the embodiment of the present application may also directly display the screenshot image or screen recording file without the user clicking the "Yes" button, that is, it may directly display the screenshot image or screen recording file. Figure 4A The user interface 440 is shown, but is not limited in this application.
[0148] In other embodiments of the present application, after the mobile phone 100 is "touched" with the watch (HUAWEI Watch1), the display screen of the mobile phone 100 may also display the following: Fig.6D The user interface 660 shown in FIG. 1 may include a prompt box. The prompt box may include a text prompt “Do you want to take a screenshot of HUAWEI Watch 1?” 661, a selection button “Yes” 662, and a selection button “No” 663. When the user clicks the selection button “Yes” 662, the mobile phone 100 may respond to the user’s click operation on the selection button “Yes” 662 by displaying a message on the display screen. Fig. 6A Of course, it is understandable that after the user clicks the selection button "Yes" 662, the display screen of the mobile phone 100 may not display Fig. 6A The user interface 610 in the watch can then execute the screenshot command. When the screenshot operation on the watch is completed, the display screen of the mobile phone 100 directly displays Fig. 6A The user interface 620 in FIG.
[0149] It should be noted that Fig. 6A and Fig.6DThe introduction is made by taking a mobile phone controlling a watch to perform a screenshot operation as an example. The screen recording operation can refer to the schematic diagram in the above embodiment, which will not be described in detail here.
[0150] See also Fig. 6E As shown, a user interface schematic diagram of a watch performing a screenshot operation provided by an embodiment of the present application. Exemplarily, assuming that the watch displays a user interface 60, when the mobile phone (HUAWEI Mate 30) "touches" the watch, a user interface 61 may be displayed on the display screen of the watch. Among them, the user interface 61 may include a prompt box "HUAWEI Mate 30 requests a screenshot, is it allowed?" 6101, a selection button "Allow" 6102, and a selection button "Reject" 6103. After the user clicks the selection button "Allow" 6102, the watch can perform a screenshot operation, and a user interface 62 may be displayed on the display screen of the watch. For example, the user interface 62 may include a prompt box "Screenshot is being taken" 6201. After the watch completes the screenshot operation, the picture after the screenshot can be sent to the mobile phone HUAWEI Mate30, for example, the watch can display the user interface 63 as shown in the figure. Among them, the user interface 63 may include a prompt box "The file has been transferred 70%" 6301, that is, the display screen of the watch can display the transmission progress of sending the screenshot file to the mobile phone HUAWEI Mate30. It should be noted that the prompt box 6301 may disappear when the file transfer is completed.
[0151] As another possible implementation method, the host device can trigger a content acquisition instruction to the target device by "scanning" so that the target device executes the operation corresponding to the content acquisition instruction. For example, taking a mobile phone and a smart screen as an example, the user can open the "menu bar" of the smart screen by pressing the button on the remote control of the smart screen, for example Fig. 7A As shown in (a) in the figure, the smart screen can then display the following Fig. 7A The user can select the "Screenshot (Scan Code)" box in the "Menu Bar" through the touch screen or remote control button, and then a QR code will pop up on the smart screen, such as Fig. 7A As shown in (c), the QR code is used to represent the Internet protocol (IP) address information of the smart screen in the local area network and the operation execution instructions (screenshot instructions) selected by the user.
[0152] See also Figure 7B As shown, the user can scan the QR code on the smart screen by using the "Scan" function on the mobile phone 100 system (for example, Figure 7C), establish a connection with the smart screen, and then trigger the screenshot instruction to the smart screen according to the screenshot instruction in the QR code. For example, the negative one screen interface 700 may be displayed on the display screen of the mobile phone 100, and the interface 700 may include multiple functional controls, such as "Scan" 701. The user can click "Scan" 701, and the mobile phone 100 can respond to the user's click operation and display the user interface 710 on the display screen. Among them, the user interface 710 may include a scanning box 711.
[0153] The user can scan through the scanning box 711 Fig. 7A After scanning the QR code on the smart screen shown in (c), the mobile phone 100 can send a screenshot instruction to the smart screen, and the user interface 720 can be displayed on the display screen of the mobile phone 100. Among them, the user interface 720 may include a prompt message 721, and the prompt message 721 is used to prompt the user that the smart screen is about to perform a screenshot operation. Then after a set time, such as 5 seconds, a user interface 730 can be displayed on the display screen of the mobile phone 100. Among them, the user interface 730 may include a prompt message 731, and the prompt message 731 is used to prompt the user that the smart screen is taking a screenshot. Accordingly, after receiving the screenshot instruction, the smart screen can execute the operation corresponding to the screenshot instruction. For subsequent steps and user interface diagrams, please refer to Fig. 6A The description in the illustrated embodiment will not be repeated here.
[0154] In other embodiments, see Fig.7D As shown, the user can scan the QR code on the smart screen through the scanning box 711. After scanning, the user interface 740 can also be displayed on the display screen of the mobile phone 100. Among them, the user interface 740 may include a text prompt "Do you want to take a screenshot of the smart screen?" 741, a selection button "Yes" 742, and a selection button "No" 743. When the user clicks the selection button "Yes" 742, the display screen of the mobile phone 100 may display Figure 7B Then, after receiving the screenshot instruction, the smart screen can execute the operation corresponding to the screenshot instruction. The subsequent steps and user interface diagram can be found in Fig. 6A The description in the illustrated embodiment will not be repeated here.
[0155] It is understandable that when the actual product is implemented, users can also open the "Scan" function in applications such as WeChat and browsers to scan the QR code, and this application does not limit this.
[0156] For example, see Fig. 7EThe figure shows a schematic diagram of software module interaction provided in an embodiment of the present application. After the mobile phone and the smart screen perform a "scan" operation, the control signaling module on the mobile phone can send the screenshot operation instruction to the soft bus on the smart screen, and then the soft bus on the mobile phone can send the screenshot operation instruction to the soft bus on the smart screen through the near-field network. Correspondingly, the soft bus on the smart screen can send the screenshot operation instruction received from the mobile phone to the control signaling module on the smart screen, and then the control signaling module of the smart screen can control the smart screen to perform a screenshot operation on the target content, and obtain a screenshot of the target content displayed on the smart screen. For details of the subsequent steps, please refer to the aforementioned embodiments, for example Figure 4B , Figure 6C The introduction in will not be repeated here.
[0157] Scenario 3: The master device interacts with the target device through the intermediate device.
[0158] like Fig. 8A FIG. 1 is a schematic flow chart of a content acquisition method provided in an embodiment of the present application. Fig. 8A As shown. On the host device side, the mobile phone can interact with the intermediate device (remote control), and the remote control processes the notification message triggered by the mobile phone, and then the remote control can trigger the screenshot or screen recording command to the target device. On the target device side, the target device can parse the screenshot or screen recording command sent by the host device, and then start the screenshot or screen recording operation. After the screenshot or screen recording operation is completed, the content obtained by the screenshot or screen recording can be transmitted to the host device for storage.
[0159] like Figure 8B As shown, it is a flow chart of a content acquisition method provided by an embodiment of the present application, see Figure 8B As shown, the method may include the following steps:
[0160] Step 801: The master device sends a notification message to the intermediate device. The notification message is used to trigger a content acquisition instruction to the target device.
[0161] Taking the main device as a mobile phone and the target device as a smart screen as an example, in the embodiment of the present application, the remote control of the smart screen has an NFC module, for example, Fig. 9A As shown, a remote controller with an NFC module is provided in an embodiment of the present application. For example, the mobile phone 100 can "touch" the remote controller of the smart screen (for example, see Fig. 9B The operation diagram shown in the figure) enables the mobile phone 100 to establish a connection with the remote control, and at the same time triggers the sending of a notification message to the remote control, where the notification message is used to notify the remote control that it can trigger the sending of a screenshot operation instruction to the smart screen.
[0162] It should be noted that Fig. 9AIn the schematic diagram, NFC is only used to indicate the location of the NFC module. When the actual product is implemented, NFC may not be displayed on the remote control, and a built-in method may be selected.
[0163] As an example, Fig. 9C As shown, after the mobile phone 100 and the remote control are "touched", a user interface 900 may be displayed on the display interface of the mobile phone 100. The user interface 900 may include a prompt box, which may specifically include a text prompt "Do you want to take a screenshot of the smart screen" 901, a selection button "Yes" 902, and a selection button "No" 903. After the user clicks the selection button "Yes" 902, the mobile phone 100 may respond to the user's click operation on the selection button "Yes" 902, and notify the remote control to send a screenshot instruction to the smart screen.
[0164] It is understandable that the mobile phone can "touch" the area where the NFC module on the remote control is located, so that the remote control can receive the touch operation between the mobile phone and the remote control.
[0165] Step 802: The intermediate device triggers a content acquisition instruction to the target device.
[0166] When the remote controller receives the notification message triggered by the mobile phone 100, it can send a screenshot command to the smart screen, so that the smart screen executes the screenshot operation corresponding to the screenshot command. Fig.9D As shown, a schematic diagram of software module interaction provided by an embodiment of the present application is shown. After the mobile phone and the remote controller perform a "touch and click" operation, the soft bus on the remote controller can send a notification message to the soft bus on the smart screen through the near field network.
[0167] Step 803: The target device performs a corresponding operation according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction.
[0168] Step 804: The target device transmits the content corresponding to the content acquisition instruction to the master device.
[0169] Correspondingly, the soft bus on the smart screen can send the screenshot command received from the remote control to the control signaling module on the smart screen, and then the control signaling module of the smart screen can control the smart screen to take a screenshot of the target content, and obtain a screenshot of the target content displayed on the smart screen. After the control signaling module of the smart screen takes a screenshot of the displayed content, the control signaling module on the smart screen can send the screenshot to the file transfer module. The file transfer module then transmits the obtained content to the file transfer module of the mobile phone through the soft bus, and the file transfer module of the mobile phone can store the received screenshot in the gallery of the corresponding application.
[0170] It should be noted that step 803 and step 804 are Figure 3BStep 303 and step 304 in the embodiment shown are the same. For details, please refer to Figure 3B The description in the illustrated embodiment will not be described in detail here.
[0171] Furthermore, the above embodiment is only introduced by taking the example that the initiating electronic device can control the target electronic device to perform a screenshot operation or a screen recording operation. In the embodiment of the present application, if the initiating electronic device does not have the authority to control the target electronic device to perform a screenshot operation or a screen recording operation, a prompt message can be displayed on the initiating electronic device to prompt the user that the target electronic device cannot be controlled by the initiating electronic device to perform a screenshot operation or a screen recording operation.
[0172] For example, see Fig.10 As shown, for example, the mobile phone (HUAWEI Mate 30) does not have the authority to control the watch (HUAWEI Watch 2) to perform a screenshot operation. After the mobile phone triggers a screenshot operation instruction to the watch, a user interface 1000 may be displayed on the display screen of the mobile phone. Among them, the user interface 1000 may include a prompt box 1001, and the content of the prompt box 1001 may be "HUAWEIMate 30 cannot take a screenshot of HUAWEI Watch 2". It is understandable that the prompt box 1001 may disappear after being displayed for a certain period of time, such as 10 seconds.
[0173] Based on the above embodiments, Fig.11 As shown, the present application embodiment also provides a content acquisition method, see Fig.11 As shown, the method may include the following steps:
[0174] Step 1101: The first device triggers a content acquisition instruction to the second device.
[0175] The content acquisition instruction is used to instruct the second device to take a screenshot or record a screen of the content currently displayed on the display screen of the second device, and feed back the content obtained by the screenshot or recording operation to the first device.
[0176] Step 1102: The second device takes a screenshot or records the content currently displayed on its own display screen according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction.
[0177] After receiving the content acquisition instruction, the second device may perform an operation corresponding to the content acquisition instruction to obtain the content corresponding to the content acquisition instruction, and send the obtained content to the first device. Correspondingly, the first device may receive the content corresponding to the content acquisition instruction sent by the second device.
[0178] Step 1103: The first device receives the content corresponding to the content acquisition instruction sent by the second device.
[0179] Step 1104: The first device displays the content corresponding to the content acquisition instruction sent by the second device.
[0180] For the specific implementation of the above steps, please refer to the detailed description in the above embodiments, which will not be repeated here.
[0181] In the embodiments provided by the present application, the method provided by the embodiments of the present application is introduced from the perspective of the electronic device as the execution subject. In order to implement the functions in the methods provided by the embodiments of the present application, the electronic device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.
[0182] like Fig.12 FIG. 1 is a schematic diagram of a content acquisition device provided in an embodiment of the present application. Fig.12 As shown, the device may include: a screen capture and recording module, a capture module, a manager and a soft bus.
[0183] Among them, the screenshot and recording module is used to adapt to different devices, and perform screenshot and recording processing in combination with factors such as the screen shape, size, and resolution of the device; the capture module is used to capture screenshot and recording events, such as touch, scan, gesture operation, etc.; the manager is used to provide an interface to handle cross-device command transmission (such as the mobile phone requesting a screenshot from the smart screen), file transfer (such as transferring the screenshot file of the smart screen to the mobile phone) and business logic (such as querying the list of devices that can take screenshots); the soft bus is the underlying interaction channel between devices. For example, when the image obtained by the smart screen performing a screenshot operation is transmitted between the mobile phone (device A) and the smart screen (device B), the manager's interface can be called to send the image to the soft bus, and the image can be transmitted to the mobile phone through the soft bus.
[0184] like Fig.13 FIG. 1 is a schematic diagram of a content acquisition device provided in an embodiment of the present application. The device may be an electronic device with a display screen. For example, the electronic device may be a first device, such as a mobile phone. Fig.13 As shown, the device 1300 includes: a display screen 1301; one or more processors 1302; a memory 1303; multiple applications 1304 (not shown in the figure); and one or more computer programs 1305 (not shown in the figure), and the above-mentioned components can be connected via one or more communication buses 1306.
[0185] The display screen 1301 is used to display the display interface of the application in the electronic device.
[0186] The memory 1303 stores one or more computer programs, and the one or more computer programs include instructions; the processor 1302 calls the instructions stored in the memory 1303, so that the content acquisition device 1300 performs the following steps:
[0187] Trigger a content acquisition instruction to the second device, wherein the content acquisition instruction is used to instruct the second device to take a screenshot or record the content currently displayed on the display screen of the second device, and feed back the content obtained by the screenshot or recording operation to the first device; receive and display the content corresponding to the content acquisition instruction sent by the second device.
[0188] In a possible implementation, triggering the content acquisition instruction to the second device includes: responding to a first operation of a user, where the first operation is used to trigger the content acquisition instruction to the second device.
[0189] In a possible implementation manner, triggering the content acquisition instruction to the second device includes: triggering the content acquisition instruction to the second device by performing a tap operation with the second device.
[0190] In a possible implementation manner, triggering the content acquisition instruction to the second device includes: sending a notification message to a third device, where the notification message is used to notify the third device to trigger the content acquisition instruction to the second device.
[0191] In one possible implementation, when the instruction is called and executed by the one or more processors 1302, the content acquisition device further performs the following steps before responding to the user's first operation: responding to the user's second operation, displaying the current list of connectable devices, the second operation is used to trigger the display of the list of connectable devices; responding to the user's third operation, selecting a second device in the displayed list of connectable devices, the third operation is an operation in which the user selects a corresponding device in the displayed list of connectable devices.
[0192] In one possible implementation, when the instruction is called and executed by the one or more processors 1302, the content acquisition device 1300 also performs the following steps: in the process of receiving and displaying the content corresponding to the content acquisition instruction sent by the second device, displaying a first interface, wherein the first interface includes the transmission progress of the content.
[0193] In one possible implementation, when the instruction is called and executed by the one or more processors 1302, the content acquisition device 1300 further performs the following steps: displaying a first prompt message, wherein the first prompt message is used to prompt the second device of the status of the operation corresponding to the content acquisition instruction.
[0194] In one possible implementation, when the instruction is called and executed by the one or more processors 1302, the content acquisition device 1300 further performs the following steps: displaying a second prompt information, wherein the second prompt information is used to prompt the user to receive the content corresponding to the content acquisition instruction sent by the second device.
[0195] like Fig.14 FIG. 1 is a schematic diagram of another content acquisition device provided in an embodiment of the present application. The device may be an electronic device with a display screen. For example, the electronic device may be a second device, such as a smart screen, a watch, etc. Fig.14 As shown, the device 1400 includes: a display screen 1401; one or more processors 1402; a memory 1403; multiple applications 1404 (not shown in the figure); and one or more computer programs 1405 (not shown in the figure), and the above-mentioned components can be connected via one or more communication buses 1406.
[0196] The display screen 1401 is used to display the display interface of the application in the electronic device, etc.
[0197] The memory 1403 stores one or more computer programs, and the one or more computer programs include instructions; the processor 1402 calls the instructions stored in the memory 1403, so that the electronic device 1400 performs the following steps:
[0198] Receive a content acquisition instruction triggered by a first device, wherein the content acquisition instruction is used to instruct the second device to take a screenshot or record the content currently displayed on the display screen of the second device; take a screenshot or record the content currently displayed on its own display screen according to the content acquisition instruction to obtain content corresponding to the content acquisition instruction; and send the content corresponding to the content acquisition instruction to the first device.
[0199] In a possible implementation, when the instruction is called and executed by the one or more processors 1402, the content acquisition device 1400 further performs the following steps: displaying a third prompt information, wherein the third prompt information is used to prompt whether to determine whether to execute the content acquisition instruction sent by the first device.
[0200] In one possible implementation, when the instruction is called and executed by the one or more processors 1402, the electronic device 1400 further performs the following steps: while sending the content corresponding to the content acquisition instruction to the first device, a second interface is displayed, and the second interface includes the transmission progress of the content.
[0201] In the embodiment of the present application, the processor 1302 and the processor 1402 may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiment of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor. The software module may be located in the memory 1303 and the memory 1403, and the processor 1302 and the processor 1402 read the program instructions in the memory 1303 and the memory 1403, and complete the steps of the above method in combination with its hardware.
[0202] In the embodiment of the present application, the memory 1303 and the memory 1403 may be non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or may be a volatile memory (volatile memory), such as RAM. The memory may also be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory in the embodiment of the present application may also be a circuit or any other device that can implement a storage function, for storing instructions and / or data.
[0203] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0204] Based on the above embodiments, the embodiments of the present application further provide a chip, which is coupled with a memory in an electronic device to execute the content acquisition method provided in the embodiments of the present application; in the embodiments of the present application, "coupling" refers to the direct or indirect combination of two components with each other.
[0205] Based on the above embodiments, the present application further provides a computer storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the content acquisition method provided in the above embodiments.
[0206] The present application also provides a computer program product in an embodiment, including instructions, which, when executed on a computer, enable the computer to execute the content acquisition method provided in the above embodiment.
[0207] The present application embodiment is described with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the present application embodiment. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by instructions. These instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one flow chart or multiple flows and / or one box or multiple boxes of the block diagram.
[0208] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0209] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
Claims
1. A content acquisition method, applied to a system including a first device, a second device and an intermediate device, characterized in that: include: In response to a first operation of a user, the first device sends a notification message to the intermediate device, where the notification message is used to notify the intermediate device to trigger a content acquisition instruction to the second device, and the first operation is a touch operation; The intermediate device triggers the content acquisition instruction to the second device, where the content acquisition instruction is used to instruct the second device to take a screenshot or record a screen of the content currently displayed on the display screen of the second device, and feed back the content obtained by the screenshot or recording operation to the first device; The second device obtains content corresponding to the content acquisition instruction according to the content acquisition instruction; The second device sends the content corresponding to the content acquisition instruction to the first device; The first device receives and displays the content corresponding to the content acquisition instruction sent by the second device.
2. The method according to claim 1, characterized in that The bump operation includes a bump operation of the first device and the intermediate device.
3. The method according to claim 1 or 2, characterized in that Before the intermediate device triggers the content acquisition instruction to the second device, the method further includes: In response to a second operation of the user on the first device, the intermediate device triggers the content acquisition instruction to the second device, where the second operation is to confirm an operation of taking a screenshot or recording a screen on the second device.
4. The method according to claim 1 or 2, characterized in that: The method further comprises: The first device displays a first interface during the process of receiving and displaying the content corresponding to the content acquisition instruction sent by the second device, where the first interface includes the transmission progress of the content.
5. The method according to claim 1 or 2, characterized in that: Before the second device sends the content corresponding to the content acquisition instruction to the first device, the method further includes: The first device displays first prompt information, where the first prompt information is used to prompt the second device of a status of an operation corresponding to the content acquisition instruction being executed.
6. The method according to claim 1 or 2, characterized in that: Before the second device sends the content corresponding to the content acquisition instruction to the first device, the method further includes: The first device displays second prompt information, where the second prompt information is used to prompt a user to receive content corresponding to the content acquisition instruction sent by the second device.
7. A system for a content acquisition method, comprising a first device, a second device and an intermediate device, characterized in that: The first device executes the method executed by the first device as described in any one of claims 1-6, the second device executes the method executed by the second device as described in any one of claims 1-6, and the intermediate device executes the method executed by the intermediate device as described in any one of claims 1-6.
8. A content acquisition method, applied to a first device, characterized in that: include: In response to a first operation of the user, the first device sends a notification message to the intermediate device, the notification message is used to notify the intermediate device to trigger a content acquisition instruction to the second device, the first operation is a touch operation; the content acquisition instruction is used to instruct the second device to take a screenshot or record a screen of content currently displayed on a display screen of the second device, and feed back the content obtained by the screenshot or recording operation to the first device; The first device receives and displays the content corresponding to the content acquisition instruction sent by the second device.
9. A content acquisition device, applied to a first device, characterized in that: including a display screen; one or more processors; Memory; a plurality of applications; and one or more computer programs; The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are called and executed by the one or more processors, the content acquisition device performs the following steps: In response to a first operation of the user, a notification message is sent to the intermediate device, where the notification message is used to notify the intermediate device to trigger a content acquisition instruction to the second device, where the first operation is a touch operation; the content acquisition instruction is used to instruct the second device to take a screenshot or record a screen of content currently displayed on a display screen of the second device, and feed back the content obtained by the screenshot or recording operation to the first device; Receive and display content corresponding to the content acquisition instruction sent by the second device.
10. A computer storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, enable the electronic device to execute the content acquisition method as claimed in claim 8.
Citation Information
Patent Citations
Image acquisition method and device
CN105338399A
Cross-device content projection method and electronic device
CN110958475A
