Parameter adjustment method in screen projection scene and electronic equipment
By detecting user operations during screen projection and adjusting the parameters of the target device during target screen projection business, the problem of user operations and counter-control during screen projection is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202410174776.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-06
- Publication Date
- 2025-08-08
AI Technical Summary
During the screen projection process, the destination device cannot adjust the screen brightness of the local end according to the user's operation, resulting in the user's adjustment operation of the destination device reverse control to the source device, affecting the user's experience.
After receiving the screen projection data, the first electronic device displays the screen projection content in the display interface, and responds to user operations when target screen projection services, adjusts local parameters, such as screen brightness, screen clarity or volume, and recognizes and responds to user's intentions by detecting the user's operations in the preset area.
It realizes that the parameters of the target device are accurately adjusted according to user operations during screen projection, improves the user experience and avoids error responses caused by operational conflicts.
Smart Images

Figure CN120455750A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a parameter adjustment method and electronic device in a screen projection scenario. Background Art
[0002] Screen mirroring technology allows electronic devices to project their displayed content onto other electronic devices. The device initiating the screen mirroring is called the source device, and the device receiving the screen mirroring is called the destination device. After the screen mirroring, the source and destination devices can display the same content. For example, when a user plays a video on a smartphone, they can cast the video to a smart TV, and the smartphone and smart TV can play the video synchronously.
[0003] However, during the screen projection process, since the input devices such as the touch screen of the destination device are taken over by the source device, when the user triggers the operation of adjusting the screen brightness in the destination device, the brightness adjustment operation will be reversed to the source device. That is to say, when the user triggers the brightness adjustment operation in the destination device, the screen brightness of the source device will change with the user's adjustment, while the screen brightness of the destination device will not change.
[0004] It can be seen that in the current screen projection technology, the destination device cannot adjust the screen brightness of the local end according to user operations during the process of receiving the screen projection. Summary of the Invention
[0005] The present application provides a parameter adjustment method and electronic device in a screen projection scenario, which are used to provide a method for adjusting parameters on the destination device side according to user operations in a screen projection scenario.
[0006] In the first aspect, the present application provides a parameter adjustment method and electronic device in a screen projection scenario, which can be executed by a first electronic device, the first electronic device being the destination device receiving the screen projection, and the second electronic device being the source device initiating the screen projection. In this method, the first electronic device receives the projection data sent by the second electronic device; the first electronic device displays the projection content in the display interface of the first electronic device according to the projection data, and the projection content is displayed in the first window of the display interface; when the projection service corresponding to the projection content is the target projection service, in response to the user's first operation in the first window, the first electronic device adjusts the first parameter of the first electronic device.
[0007] In the above method, when the projection service corresponding to the projection content displayed on the first electronic device is the target projection service, when the first electronic device detects an operation triggered by the user for adjusting parameters during the projection process, the first electronic device can adjust the first parameter of the first electronic device according to the user's first operation, so that the first electronic device can analyze the intention of the operation triggered by the user, and when displaying the display content corresponding to the target projection service, it can adjust the local parameters according to the user operation to meet the user's needs to adjust the local parameters and improve the user experience.
[0008] In one possible design, the first operation satisfies at least one of the following: the first operation matches any user operation among a plurality of preset user operations; or, the effective area of the first operation is a preset area in the first window.
[0009] Optionally, the preset area is part or all of the area in the first window.
[0010] Through this design, the user can trigger a preset user operation in the preset area of the first window to control the adjustment of parameters on the first electronic device side, avoiding conflicts between the user-triggered operation of adjusting parameters on the first electronic device side and other operations, which may cause the first electronic device to respond incorrectly, thereby improving the accuracy of the first electronic device's response to the user-triggered operation of adjusting parameters on the local side.
[0011] In one possible design, before adjusting the first parameter of the first electronic device, the method also includes: determining the first parameter corresponding to the first operation based on the correspondence between multiple preset parameters and multiple display areas and the effective area of the first operation, and the multiple display areas belong to the preset areas in the first window.
[0012] Through this design, the first electronic device can pre-store the correspondence between multiple parameters and multiple display areas. The user can trigger the adjustment of different parameters by triggering operations in different areas of the preset area, so that the user can conveniently adjust multiple parameters on the first electronic device side during the screen projection process.
[0013] In one possible design, the first parameter is screen brightness, screen clarity or volume.
[0014] Through this design, users can trigger the adjustment of the screen brightness, screen clarity or volume on the first electronic device side during the screen projection process, meeting the user's needs to adjust the local device parameters when the target screen projection service is running, thereby improving the user experience.
[0015] In one possible design, before receiving the screen projection data sent by the second electronic device, the method also includes: receiving a screen projection request message sent by the second electronic device; and creating the first window.
[0016] Through this design, the first electronic device can display the projected content in the first window, so that the first electronic device can detect the operations triggered by the user in the first window, and thus can promptly detect the operations triggered by the user to adjust the parameters of the local end.
[0017] In one possible design, the first window is any one of a full-screen window, a small window, and a floating window.
[0018] In one possible design, the size of the first window is any one of the following: a preset size; a user-defined size; or a size adapted to the projected content.
[0019] Through the above design, the first electronic device can flexibly create first windows of different forms or sizes.
[0020] In one possible design, the method further includes: in response to a second operation triggered by a user, generating first control information according to the second operation; and sending the first control information to the second electronic device.
[0021] In one possible design, the second operation satisfies at least one of the following: the second operation does not match each user operation among the preset multiple user operations; or, the effective area of the second operation is a display area other than the preset area in the first window.
[0022] Through the above design, the first electronic device can also reverse the user-triggered operation to the second electronic device when it determines that the user-triggered operation is not an operation for adjusting parameters on the first electronic device side, to ensure that the user-triggered control operation can be responded to normally.
[0023] In one possible design, the target screen projection service is a multimedia service.
[0024] In one possible design, the preset area in the first window is the display area of the multimedia content corresponding to the multimedia service.
[0025] Through the above design, the first electronic device can respond to the operation triggered by the user in the display area of the multimedia content to adjust the parameters on the first electronic device side, so that the first electronic device can accurately identify the intention of the operation triggered by the user and improve the user experience.
[0026] In a second aspect, the present application provides an electronic device comprising multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the electronic device in the first aspect and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.
[0027] In a third aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the method executed by the electronic device in the above-mentioned first aspect and its various embodiments.
[0028] In a fourth aspect, the present application also provides a computer program product comprising instructions, which, when run on a computer, enables the computer to execute the method executed by the server or electronic device in any of the above aspects and their respective embodiments.
[0029] In a fifth aspect, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a computer, the computer executes the method executed by the server or electronic device in any of the above aspects and its various embodiments.
[0030] In a sixth aspect, the present application also provides a chip, which is used to read a computer program stored in a memory and execute the method executed by the server or electronic device in any of the above aspects and its various embodiments.
[0031] In a seventh aspect, the present application further provides a chip system, comprising a processor for supporting a computer device in implementing the method executed by a server or electronic device in any of the above aspects and their respective embodiments. In one possible design, the chip system further comprises a memory for storing programs and data necessary for the computer device. The chip system may be composed of a chip or may include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 A schematic diagram of a screen projection scenario provided in an embodiment of the present application;
[0033] Figure 2 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0034] Figure 3 A software structure block diagram of an electronic device provided in an embodiment of the present application;
[0035] Figure 4A parameter adjustment method in a screen projection scenario provided in an embodiment of the present application;
[0036] Figure 5 This is an example diagram of a screen projection interface provided in an embodiment of the present application;
[0037] Figure 6 A schematic diagram of the structure of an electronic device in a screen projection scenario provided by an embodiment of the present application;
[0038] Figure 7 A flowchart of a parameter adjustment method in a screen projection scenario provided in an embodiment of the present application. DETAILED DESCRIPTION
[0039] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.
[0040] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.
[0041] Screen casting technology is a technology that projects the content displayed on the screen of one electronic device onto the screen of another electronic device for display. The electronic device that initiates the screen casting can be called the source device, and the electronic device receiving the screen casting can be called the destination device. During the screen casting process, the source device and the destination device can display the same content simultaneously. The content cast from the source device to the destination device includes but is not limited to: the source device's display interface, multimedia content, and documents.
[0042] Figure 1 A schematic diagram of a screen projection scenario provided in an embodiment of the present application. Figure 1, the screen projection scene may include a first electronic device and a second electronic device, wherein the first electronic device is the destination device receiving the screen projection, and the second electronic device is the source device initiating the screen projection. The user can trigger the operation of projecting the screen to the first electronic device in the second electronic device. During the screen projection process, the first electronic device and the second electronic device can synchronously display the same content, such as Figure 1 The first electronic device and the second electronic device can synchronously display the same video.
[0043] During the screen projection process, because the input device such as the touch screen of the first electronic device is taken over by the second electronic device, when the user triggers the operation of adjusting the screen brightness on the first electronic device, the first electronic device will not respond to the user-triggered operation of adjusting the screen brightness. Instead, it will send control information to the second electronic device. This control information is used to instruct the adjustment of the screen brightness, so that the brightness adjustment operation triggered by the user will be reversely controlled on the second electronic device. In other words, when the user triggers the brightness adjustment operation on the first electronic device, the screen brightness of the second electronic device will change as the user adjusts it, while the screen brightness of the first electronic device will not change.
[0044] It can be seen that in the current screen projection technology, the destination device cannot adjust the screen brightness of the local device during the process of receiving the screen projection.
[0045] Based on the above problems, the embodiment of the present application provides a parameter adjustment method in a screen projection scene. Figure 1 The first electronic device in the scenario shown is executed. In the parameter adjustment method in the screen projection scenario provided in the embodiment of the present application, the first electronic device receives the screen projection data sent by the second electronic device, and the first electronic device displays the screen projection content in the display interface of the first electronic device according to the received screen projection data, wherein the screen projection content is displayed in the first window of the display interface. When the screen projection service corresponding to the screen projection content is the target screen projection service, in response to the user's first operation in the first window, the first electronic device adjusts the first parameter of the first electronic device. Through this solution, when the first electronic device detects an operation for adjusting parameters triggered by the user during the screen projection process, when the screen projection service corresponding to the screen projection content displayed by the first electronic device is the target screen projection service, the first electronic device can adjust the first parameter of the first electronic device according to the user's first operation, so that the first electronic device can analyze the intention of the operation triggered by the user, and when displaying the display content corresponding to the target screen projection service, it can adjust the local parameters according to the user operation to meet the user's needs for adjusting the local parameters and improve the user experience.
[0046] The following describes electronic devices and embodiments for using such electronic devices. The electronic devices of the embodiments of the present application may be tablet computers, mobile phones, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), wearable devices, etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.
[0047] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions such as a personal digital assistant and / or a music player. Or portable terminal devices with other operating systems.
[0048] Figure 2 Schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0049] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device 100. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. This memory may store instructions or data that have just been used or are being recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces the processor 110's waiting time, and thus improves system efficiency.
[0050] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.
[0051] The wireless communication functionality of electronic device 100 can be implemented using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0052] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0053] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0054] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0055] The display screen 194 is used to display the display interface of the application, such as displaying the display page of the application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0056] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0057] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and the software code of at least one application, etc. The data storage area can store data generated during the use of the electronic device 100 (such as captured images, recorded videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0058] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as pictures and videos can be stored on the external memory card.
[0059] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0060] Among them, the sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.
[0061] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .
[0062] Touch sensor 180C, also known as a "touch panel," can be disposed on display screen 194. The touch sensor 180C and display screen 194 form a touch screen, also known as a "touch screen." Touch sensor 180C is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 194. In other embodiments, touch sensor 180C can also be disposed on the surface of electronic device 100, at a location different from that of display screen 194.
[0063] The buttons 190 include a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive button input and generate key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
[0064] It is understandable that Figure 2The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or arrange the components differently. Figure 2 The combination / connection relationship between the components can also be adjusted and modified.
[0065] Figure 3 This is a software structure diagram of an electronic device provided in an embodiment of the present application. Figure 3 As shown, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers: from top to bottom, the application layer, the application framework layer (framework, FWK), the runtime (runtime) and system library, and the kernel layer.
[0066] The application layer can include a series of application packages. Figure 3 As shown, the application layer may include a camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In the embodiment of the present application, the application layer may include a target installation package of a target application that the electronic device requests to download from a server, and the function files and layout files in the target installation package are adapted to the electronic device.
[0067] The application framework layer provides application programming interface (API) and programming framework for the application layer. The application framework layer may include some predefined functions. Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.
[0068] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.
[0069] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0070] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).
[0071] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0072] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0073] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0074] The core library consists of two parts: one containing the Java language's callable functions and the other containing the operating system's core libraries. The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0075] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and an image processing library.
[0076] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0077] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0078] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0079] A 2D graphics engine is a drawing engine for 2D drawings.
[0080] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0081] The hardware layer can include various sensors, such as accelerometers, gyroscopes, touch sensors, etc.
[0082] It should be noted that Figure 2 and Figure 3 The structure shown is only an example of the electronic device provided by the embodiment of the present application, and does not limit the electronic device provided by the embodiment of the present application. In specific implementation, the electronic device may have more Figure 2 or Figure 3 More or fewer devices or modules may be included in the structures shown.
[0083] The following introduces the parameter adjustment method in the screen projection scenario provided by the embodiment of the present application.
[0084] Figure 4 A parameter adjustment method in a screen projection scenario provided in an embodiment of the present application can be executed by a first electronic device, which can have Figure 2 , and / or, Figure 3 The structure shown. Figure 4 , the method comprises the following steps:
[0085] S401: The first electronic device receives a screen projection request message sent by the second electronic device.
[0086] The user can trigger the operation of projecting the screen from the second electronic device to the first electronic device. In response to the user operation, the second electronic device sends a screen projection request message to the first electronic device.
[0087] In the embodiments of the present application, screen projection may include application-level screen projection and system-level screen projection, wherein application-level screen projection may be screen projection initiated by a user in an application running on a second electronic device, such as a user may click on a screen projection control in an application interface displayed on the second electronic device and select the first electronic device to trigger screen projection. System-level screen projection may be screen projection triggered by a user through a system-level screen projection function provided by the second electronic device, such as a user may select a "mirror screen projection" control in the negative first screen of the second electronic device and select the first electronic device to trigger screen projection.
[0088] S402: The first electronic device creates a first window.
[0089] After receiving the screen projection request message sent by the second electronic device, the first electronic device can create a first window, which can be used to display the content projected from the second electronic device to the first electronic device. Exemplarily, the first window can be a shell window.
[0090] In an optional embodiment, the form of the first window created by the first electronic device (which can also be understood as the style of the first window) can be any one of a full-screen window, a small window, and a floating window. The size of the first window can be a preset size; or the user can customize the size of the first window, and the user can also manually adjust the size of the first window at any time; or the first electronic device can determine the size of the first window according to the screen projection service, and the size of the first window determined by the first electronic device according to the screen projection service is adapted to the projection content. For example, when the screen projection service is a video screen projection service, in order to provide the user with a better viewing effect, the first electronic device can create a full-screen first window; when the screen projection service is an interface screen projection service, the first electronic device can create a first window according to the screen size of the second electronic device to ensure the projection display effect.
[0091] In this way, the first electronic device can display the projected content in the first window, so that the first electronic device can detect the operation triggered by the user in the first window, and thus can timely detect the operation triggered by the user to adjust the parameters of the local end.
[0092] S403: The first electronic device establishes a screen projection channel with the second electronic device, and the first electronic device receives the screen projection data sent by the second electronic device.
[0093] Optionally, the screen projection channel established between the first electronic device and the second electronic device may be, for example, a Bluetooth channel, a Wi-Fi channel, or the like.
[0094] After establishing a screen casting channel with the first electronic device, the second electronic device can obtain the casting data corresponding to the casting content and send the casting data to the first electronic device. For example, when the second electronic device casts a video displayed on the second electronic device to the first electronic device, the second electronic device can obtain the video data and send the obtained video data to the first electronic device through the screen casting channel.
[0095] S404: The first electronic device displays the projection content on the display interface of the first electronic device according to the projection data.
[0096] Among them, the projection content is displayed in the first window of the display interface.
[0097] For example, if the projection data received by the first electronic device is video data, the first electronic device can display the video in the first window. For another example, if the projection data received by the first electronic device is a recording of the display interface of the second electronic device, the first electronic device can display the display interface of the second electronic device in the first window.
[0098] S405: When the screen projection service corresponding to the screen projection content is the target screen projection service, in response to a first operation triggered by the user in the first window, adjust a first parameter of the first electronic device.
[0099] In the embodiment of the present application, the screen projection content corresponds to the screen projection service, which may include, for example, multimedia services. Specifically, multimedia services may also include video services, picture services, etc. Taking the video service as an example, the screen projection content corresponding to the video service may be a video, a video application interface including the video, and a display interface of a second electronic device including the video.
[0100] In an embodiment of the present application, when the screen projection service corresponding to the screen projection content is the target screen projection service, the first electronic device can respond to the first operation triggered by the user in the first window and call the system interface of the first electronic device to adjust the parameters on the side of the first electronic device. The target screen projection service is a preset screen projection service. Optionally, the first electronic device can determine whether the screen projection service corresponding to the screen projection content is the target screen projection service when detecting the first operation. When it is determined that the screen projection service corresponding to the screen projection content is the target screen projection service, the first parameter of the first electronic device is adjusted according to the first operation. When the target screen projection service is running in the first electronic device, the first electronic device can adjust the parameters on the side of the first electronic device according to the first operation triggered by the user, and no longer reversely control the operation triggered by the user to the second electronic device. For example, the target screen projection service can be a multimedia service. In this way, when the first electronic device is running the target screen projection service such as a multimedia service, the user may trigger an operation to adjust the screen brightness, volume and other parameters on the side of the first electronic device. The first electronic device can respond to the user-triggered operation of adjusting the parameters in a timely manner when the target screen projection service is running, thereby meeting the user's need to adjust the parameters of the local device and improving the user experience.
[0101] The first operation may be an operation triggered by the user for adjusting parameters, wherein the above parameters may include at least one of screen brightness, screen clarity, and volume. In the embodiment of the present application, the first electronic device may respond to the operation triggered by the user to adjust the parameters of the local device, and the first electronic device needs to control the user-triggered operation on the projection content to the second electronic device. For example, in a video service, if the user triggers the operation to adjust the screen brightness, the first electronic device can adjust the screen brightness of the first electronic device in response to the operation; and if the user triggers the operation to pause playback, the first electronic device needs to control the user-triggered operation to pause playback to the second electronic device, thereby pausing the projection video. To this end, the first operation needs to meet at least one of the following conditions:
[0102] Condition 1: The first operation matches any one of multiple preset user operations.
[0103] In an embodiment of the present application, the first electronic device may store a plurality of preset user operations, and the plurality of preset user operations are user operations that the first electronic device can respond to. For example, the user operations that the first electronic device can respond to include a swipe-up operation or a swipe-down operation triggered by the user in a preset area in the first window. After detecting that the user triggers the first operation in the first window, the first electronic device may determine whether the first operation matches any of the plurality of preset user operations. When it is determined that the first operation matches any of the plurality of preset user operations, the first electronic device determines that the first operation is an operation that the first electronic device can respond to and is used to adjust parameters. When the first electronic device determines that the first operation does not match any of the plurality of preset user operations, the first electronic device needs to reversely control the first operation to the second electronic device.
[0104] Condition 2: The effective area of the first operation is a preset area in the first window.
[0105] In an embodiment of the present application, the first electronic device can detect the area of the first operation triggered by the user. When the effective area of the first operation is a preset area in the first window, the first electronic device can determine that the user's first operation is an operation for adjusting the parameters of the first electronic device, wherein, when the target screen projection service is a multimedia service, the preset area in the first window can be a display area of the multimedia content corresponding to the multimedia service, and the preset area can be part or all of the area in the first window. When the effective area of the first operation is a display area other than the preset area in the first window, the first electronic device can determine that the first operation is an operation that needs to be reversely controlled to the second electronic device, and the first electronic device can generate first control information based on the first operation and send the first control information to the second electronic device.
[0106] For example, when the second electronic device projects the video application interface to the first electronic device, the preset area in the first window can be the video display area. Figure 5 This is an example diagram of a screen projection interface provided in an embodiment of the present application. Figure 5 , the second electronic device projects the video application interface to the first electronic device, and the first electronic device displays the video application interface 501 in the first window. The video application interface includes a video display area 502. In this example, the preset area in the first window is the video display area 502. It is understandable that when the video application interface displays the video content in full screen, the size of the video display area 502 is the same as the size of the video application interface 501. That is, in this case, the preset area is the entire area in the first window.
[0107] It can be understood that the first operation for adjusting the parameters on the local side that the first electronic device can respond to meets the above conditions. It can also be understood that the second operation that the first electronic device needs to control back to the second electronic device meets at least one of the following conditions: the second operation does not match each user operation in the preset multiple user operations; the effective area of the second operation is the display area other than the preset area in the first window.
[0108] After the user triggers an operation in the video display area 502, the first electronic device can adjust the parameters of the first electronic device according to the operation triggered by the user, such as Figure 5 The sliding operation a and the sliding operation b triggered by the user are operations for triggering the adjustment of the parameters of the first electronic device. After the user triggers an operation in the display area outside the preset area of the first window, the first electronic device can determine that the operation is an operation that needs to be reversely controlled to the second electronic device, and the first electronic device can generate first control information and send the first control information to the second electronic device; Figure 5 The sliding operation c and the sliding operation d triggered by the user are operations that need to be reversely controlled to the second electronic device.
[0109] In some optional embodiments, the first electronic device may determine the first parameter corresponding to the first operation based on a correspondence between multiple preset parameters and multiple display areas and an effective area of the first operation triggered by the user, wherein the multiple display areas belong to preset areas in the first window. The first electronic device may pre-store the correspondence between multiple parameters and multiple display areas. For example, a swipe up operation triggered by the user in the left area of the first window is used to increase screen brightness; a swipe down operation triggered by the user in the left area of the first window is used to decrease screen brightness; a swipe up operation triggered by the user in the right area of the first window is used to increase volume; and a swipe down operation triggered by the user in the right area of the first window is used to decrease volume.
[0110] Optionally, the first electronic device may pre-store a correspondence between multiple parameters and multiple display areas, wherein the multiple display areas stored by the first electronic device may be a size ratio relationship between the multiple display areas and a preset area, and the sizes of the multiple display areas change as the size of the preset area changes; or the multiple display areas stored by the first electronic device may be display areas of a preset size in the preset area and at a preset position.
[0111] When the first electronic device adjusts the first parameter according to the first operation, the degree of adjustment of the first parameter is related to the first operation triggered by the user. For example, the first operation is a sliding operation. When the first electronic device adjusts the screen brightness based on the first operation, the greater the displacement of the first operation, the greater the brightness difference between the screen brightness after adjustment by the first electronic device and the screen brightness before adjustment.
[0112] For example, refer to Figure 5 , the first electronic device can detect a sliding operation a triggered by the user in the left area of the video display area 502, and adjust the screen brightness according to the sliding operation a triggered by the user. The first electronic device can detect a sliding operation b triggered by the user in the right area of the video display area 502, and lower the volume according to the sliding operation b triggered by the user. When the sliding operation c triggered by the user is located in the display area outside the preset area in the first window, the first electronic device can determine that the sliding operation c is an operation that needs to be reversely controlled to the second electronic device, and the first electronic device can generate first control information according to the sliding operation c and send the first control information to the second electronic device.
[0113] It should be noted that the above embodiment is introduced by taking the sliding operation as the first operation triggered by the user as an example. During implementation, the electronic device can also preset other gestures for adjusting the parameters of the electronic device. For example, the first operation can also be a double-click operation, a heavy press operation, etc. The embodiment of the present application does not limit this.
[0114] Based on the same concept, Figure 6 This is a schematic diagram of the structure of an electronic device in a screen projection scenario provided by an embodiment of the present application. Figure 6 The second electronic device is a source device, and the second electronic device may include a screen projection processing module and a screen projection sending module. Further, the screen projection processing module may include a user interface interaction module and a screen management module; the first electronic device is a destination device, and the first electronic device may include a screen projection processing module and a screen projection receiving module. Further, the screen projection processing module may include a user interface interaction module and a parameter adjustment module.
[0115] The user interface interaction module of the second electronic device is used to receive the screen projection operation triggered by the user, the screen management module is used to create and manage the virtual screen during the screen projection process, and the screen projection sending module is used to send the screen projection data to the destination device through the communication module.
[0116] The user interface interaction module of the first electronic device is used to obtain the operations triggered by the user in the first window, the parameter adjustment module is used to parse the user operations obtained by the user interface interaction module and call the system interface to adjust the parameters, and the screen projection receiving module is used to receive the screen projection data sent by the source device through the communication module.
[0117] based on Figure 6 The structure of the electronic device shown in the figure is further introduced below with an example of the parameter adjustment method in the screen projection scene provided by the embodiment of the present application. Figure 7 This is a flow chart of a parameter adjustment method in a screen projection scenario provided by an embodiment of the present application. Figure 7 The second electronic device is used to project a video to the first electronic device as an example for explanation. Figure 7 , the method comprises the following steps:
[0118] S701: The screen projection processing module of the second electronic device detects a screen projection operation triggered by the user.
[0119] S702: The screen projection processing module of the second electronic device initializes the screen projection service and obtains video application information.
[0120] Among them, the video application information includes the identification, application version and other information of the video application that the user triggers the screen projection operation.
[0121] S703: The screen projection processing module of the second electronic device sends a screen projection request message to the screen projection processing module of the first electronic device.
[0122] Optionally, the screen projection request message may include the device identification of the second electronic device, video application information, etc.
[0123] S704: The screen projection processing module of the first electronic device creates a first window.
[0124] S705: The screen projection sending module of the second electronic device and the screen projection receiving module of the first electronic device establish a screen projection channel.
[0125] S706: The screen projection sending module of the second electronic device records the video application interface displayed by the second electronic device to generate screen projection data.
[0126] S707: The screen projection sending module of the second electronic device sends the screen projection data to the screen projection receiving module of the first electronic device.
[0127] S708: The screen projection receiving module of the first electronic device parses the screen projection data.
[0128] S709: The screen projection receiving module of the first electronic device sends the parsed screen projection data to the screen projection processing module of the first electronic device.
[0129] S710: The screen projection processing module of the first electronic device displays the video application interface in the first window according to the parsed screen projection data.
[0130] S711: The first electronic device determines that the video service corresponding to the video application interface is the target screen projection service.
[0131] In this example, the projection content is a video application interface, the projection service corresponding to the video application interface is a video service, and the video service belongs to the target projection service in the embodiment of the present application. When the first electronic device displays the video application interface in the first window, the first electronic device can respond to the user-triggered operation for adjusting the parameters on the first electronic device side.
[0132] It should be noted that S711 is an optional step. During implementation, after the first electronic device receives the projection data and displays the video application interface, it indicates that the projection service corresponding to the projection content currently displayed by the first electronic device is the target projection service. The first electronic device can directly respond to the operation triggered by the user for adjusting the parameters on the first electronic device side without executing S711 again.
[0133] S712: In response to a first operation triggered by the user in the left area of the video display area in the first window, the screen projection processing module of the first electronic device determines a brightness adjustment value according to the first operation.
[0134] For example, the first operation may be an upward sliding operation or a downward sliding operation triggered by the user in the left area of the video display area.
[0135] S713: The screen projection processing module of the first electronic device calls the system interface to adjust the screen brightness of the first electronic device according to the brightness adjustment value.
[0136] S714: In response to a third operation triggered by the user in the right area of the video display area in the first window, the screen projection processing module of the first electronic device determines a volume adjustment value according to the third operation.
[0137] For example, the third operation may be an upward sliding operation or a downward sliding operation triggered by the user in the right area of the video display area.
[0138] S715: The screen projection processing module of the first electronic device calls the system interface to adjust the volume of the first electronic device according to the volume adjustment value.
[0139] S716: In response to a second operation triggered by the user in a display area outside the video display area of the first window, the screen projection processing module of the first electronic device generates first control information according to the second operation.
[0140] Among them, the first control information is used to indicate the second operation triggered by the user in the first electronic device. For example, the first control information can indicate the location where the user triggers the second operation on the screen of the first electronic device and the type of the second operation. The type of the second operation can be, for example, a sliding operation, a click operation, a double-click operation, etc.
[0141] S717: The screen projection processing module of the first electronic device sends first control information to the screen projection processing module of the second electronic device.
[0142] It should be noted that Figure 7 In the illustrated embodiment, steps S712 - S713 , S714 - S715 , and S716 - S717 are all optional steps.
[0143] Based on the above embodiments, the present application further provides an electronic device, the electronic device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the functions performed by the first electronic device in each method described in the embodiments of the present application, such as performing Figure 4 The embodiment shown or Figure 7 The steps executed by the first electronic device in the embodiment shown are as follows: The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0144] Based on the above embodiments, the present application further provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the functions executed by the electronic device in each method described in the embodiments of the present application. Figure 4 The embodiment shown or Figure 7 The steps are performed by the first electronic device in the illustrated embodiment.
[0145] Based on the above embodiments, the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the methods described in the embodiments of the present application.
[0146] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.
[0147] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the various methods described in the embodiments of the present application.
[0148] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the various methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory for storing the necessary programs and data for the computer device. The chip system can be composed of a chip or can include a chip and other discrete devices.
[0149] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0150] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0151] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.
[0152] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0153] Obviously, those skilled in the art may make various modifications and variations to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A parameter adjustment method in a screen projection scenario, characterized in that: Applied to a first electronic device, the method includes: Receiving screen projection data sent by a second electronic device; Displaying the projected content on the display interface of the first electronic device according to the projected data, wherein the projected content is displayed in a first window of the display interface; When the screen projection service corresponding to the screen projection content is a target screen projection service, in response to a first operation of the user in the first window, a first parameter of the first electronic device is adjusted.
2. The method according to claim 1, wherein The first operation satisfies at least one of the following: The first operation matches any one of a plurality of preset user operations; or, The effective area of the first operation is a preset area in the first window.
3. The method according to claim 1 or 2, wherein: Before adjusting the first parameter of the first electronic device, the method further includes: The first parameter corresponding to the first operation is determined according to a correspondence between a plurality of preset parameters and a plurality of display areas and an effective area of the first operation, wherein the plurality of display areas belong to a preset area in the first window.
4. The method according to any one of claims 1 to 3, wherein The first parameter is screen brightness, screen clarity or volume.
5. The method according to any one of claims 1 to 4, characterized in that Before receiving the screen projection data sent by the second electronic device, the method further includes: Receiving a screen projection request message sent by the second electronic device; Create the first window.
6. The method according to any one of claims 1 to 5, wherein: The first window is any one of a full-screen window, a small window and a floating window.
7. The method according to claim 5 or 6, wherein: The size of the first window is any of the following: Preset size; User-defined size; or, The size that is adapted to the projected content.
8. The method according to any one of claims 1 to 7, wherein: The method further comprises: In response to a second operation triggered by a user, generating first control information according to the second operation; The first control information is sent to the second electronic device.
9. The method according to claim 8, wherein The second operation satisfies at least one of the following: The second operation does not match any user operation in the preset multiple user operations; or, The effective area of the second operation is the display area except the preset area in the first window.
10. The method according to any one of claims 1 to 9, wherein The target screen projection service is a multimedia service.
11. The method according to claim 10, wherein The preset area in the first window is a display area for multimedia content corresponding to the multimedia service.
12. An electronic device, characterized in that: The system comprises at least one processor coupled to at least one memory, and the at least one processor is configured to read a program stored in the at least one memory to execute the method according to any one of claims 1 to 11.
13. A readable storage medium, characterized in that: The readable storage medium stores instructions, which, when executed on an electronic device, enable the electronic device to execute the method according to any one of claims 1 to 11.
14. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, it enables the computer to execute the method according to any one of claims 1 to 11.
15. A chip, characterized in that: The chip is used to read a computer program stored in a memory to execute the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Screen projection method and device, electronic device and computer readable medium
CN112019897A
Screen projection method and device, electronic device and computer readable medium
CN112019898A
Reverse control method and device, computer equipment and storage medium
CN113556588A
Method for calling out screen display menu in screen projection scene and electronic equipment
CN117170549A
Display device, screen projection device, and device control method based on trajectory extraction
WO2023179129A1