Mobile terminal application cross-device migration running method based on near field communication and terminal

Abstract

The application discloses a mobile terminal application cross-device migration running method and terminal based on near field communication, relates to the technical field of intelligent terminals, and comprises the following steps: a mobile terminal is connected with a display device through a near field communication module to establish a distributed soft bus connection; the mobile terminal packs a complete state of a target application into an application data packet and transmits the application data packet to the display device through the established distributed soft bus; a display device self-adaptive rendering engine receives and analyzes the application data packet, switches to a display device display adapted user interface, and realizes seamless switching of audio and video capabilities; the mobile terminal screen is automatically switched into a target application migration display control touchpad interface, touch operations are acquired through the mobile terminal screen as the touchpad interface, and the touch operations are real-timely mapped into movement and operation instructions of a display device screen cursor. The application provides a terminal side solution method which can fully utilize an existing mobile application ecology and intelligently and seamlessly adapt the mobile application ecology to a television large screen.

Description

Technical Field

[0001] This invention relates to the field of smart terminal technology, and in particular to a method, apparatus, smart terminal, and storage medium for cross-device migration and operation of mobile terminal applications based on near-field communication. Background Technology

[0002] With the development of electronic technology, mobile devices have become increasingly popular due to their portability. However, mobile device screens are small, and users sometimes want to switch mobile applications to display devices such as televisions. Currently, the core pain point facing smart TVs is that their application ecosystem (TV apps) is extremely lacking compared to the mobile application ecosystem (phone apps). Many popular mobile applications have not developed TV versions, preventing users from enjoying full mobile internet services on the large TV screen.

[0003] While some screen mirroring solutions exist in the current technology, these solutions have the following drawbacks: Traditional screen mirroring technology only mirrors the screen and cannot change the interface layout of the application itself. It displays an unoptimized mobile phone interface on the TV, resulting in a poor user experience, and the mobile phone cannot be used for other purposes.

[0004] Therefore, existing technologies still need to be improved and developed. Summary of the Invention

[0005] The technical problem to be solved by this invention is to provide a method, apparatus, smart terminal and storage medium for cross-device migration and operation of mobile terminal applications based on near-field communication, addressing the deficiencies of the prior art. This invention provides a terminal-side solution that can fully utilize the existing mobile application ecosystem and intelligently and seamlessly adapt it to a large TV screen. This invention, triggered by near-field connection, seamlessly migrates mobile device applications to a smart TV and runs them in a style adapted to the large screen, while simultaneously realizing hardware capability sharing and interactive control, providing convenience for users.

[0006] The technical solution adopted by this invention to solve the problem is as follows: A method for cross-device migration and operation of mobile terminal applications based on near-field communication, comprising: The mobile terminal is paired with the display device through the near field communication module, and the pre-set distributed soft bus of both parties is activated to establish a secure connection between them. The mobile terminal obtains the selected target application to be switched, packages the current complete state of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus; The adaptive rendering engine of the display device receives and parses the application data packets, and according to the preset adaptation rules, rearranges and scales the user interface components of the target application on the mobile terminal in real time, switches to the display device to display the adapted user interface; and controls the redirection of the audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities. The control automatically switches the mobile terminal screen to the touchpad interface of the target application migration display control, and obtains touch operations through the mobile terminal screen as the touchpad interface, and maps them in real time to the movement and operation instructions of the display device screen cursor.

[0007] The method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein, after the step of obtaining touch operations through the mobile terminal screen (which serves as a touchpad interface) and mapping them in real time to movement and operation commands of the display device screen cursor, the method further includes: When an operation command to switch the target application from the display device back to the mobile terminal is detected, control is used to repackage all data of the current state of the target application and transmit it back to the mobile terminal through the established distributed soft bus. The target application on the mobile terminal is restored to its corresponding state, enabling seamless task continuation.

[0008] The method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the step of pairing the mobile terminal with the display device through the near-field communication module and waking up the preset distributed soft bus of both parties to establish a secure connection between them further includes: Near-field communication modules are pre-installed on mobile terminals and display devices; The system is configured to trigger the start of a distributed soft bus between the mobile terminal and the display device when the distance between the mobile terminal and the display device is within a predetermined distance, thereby establishing a virtual communication channel between the mobile terminal and the display device.

[0009] The method for cross-device migration and operation of mobile terminal applications based on near-field communication includes the following steps: the mobile terminal obtains the selected target application to be switched, packages the current complete state of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus: When it is necessary to switch the target application to the display device, the user's operation command is received through the mobile terminal to select the target application to be switched; The mobile terminal automatically captures the running status of the current application based on the selected target application to be switched, packages the current complete status of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus.

[0010] The method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the step of receiving and parsing the application data packet through the adaptive rendering engine of the display device, and rearranging and scaling the user interface components of the target application on the mobile terminal in real time according to preset adaptation rules, and switching to displaying the adapted user interface on the display device includes: An adaptive rendering engine is pre-configured on the display device to receive the target application state and dynamically reconstruct the user interface of the target application on the display device according to the screen size and interaction characteristics of the display device. The application data packet is received and parsed by the adaptive rendering engine of the display device, and the display interface of the display device is reorganized according to the preset adaptation rules, so as to automatically convert the single-column list layout of the mobile terminal into the multi-column grid layout of the display device. And scaling the font and controls of the display interface of the display device, scaling the displayed text and touch hotspots proportionally, and switching to the display device to display the adapted user interface; It will also automatically generate focus navigation logic suitable for remote control operation based on the displayed navigation focus.

[0011] The method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the step of automatically switching the mobile terminal screen to the touchpad interface of the target application migration display control, and obtaining touch operations through the mobile terminal screen as the touchpad interface and mapping them in real time to the movement and operation commands of the display device screen cursor, further includes: A touchpad simulation module is pre-installed on the mobile terminal to transform the mobile terminal screen into a virtual touchpad for the display device, receive touch and gesture inputs, and convert the received touch and gesture inputs into cursor movement and click events on the display device. A cross-device input route is pre-configured to transmit input events from the mobile terminal to the display device in real time via a distributed soft bus.

[0012] The aforementioned method for cross-device migration and operation of mobile terminal applications based on near-field communication (NFC) wherein the near-field communication module is an NFC module or a UWB baseband communication module.

[0013] A device for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the device includes: The near-field communication and virtual channel establishment module is used to control the mobile terminal to complete pairing with the display device through the near-field communication module, and to wake up the preset distributed soft bus of both parties to establish a secure connection between them. The packet transmission module is used to control the mobile terminal to obtain the selected target application to be switched, package the current complete state of the target application into an application data packet, and transmit it to the display device through the established distributed soft bus; The parsing and rendering display module is used to receive and parse the application data packet through the adaptive rendering engine of the display device, and rearrange and scale the user interface components of the target application on the mobile terminal in real time according to the preset adaptation rules, and switch to the display device to display the adapted user interface; and control the redirection of the audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities; The touch panel switching module is used to control the automatic switching of the mobile terminal screen to the touch panel interface of the target application migration display control. The touch operation is obtained through the mobile terminal screen as the touch panel interface and mapped in real time to the movement and operation instructions of the cursor on the display device screen.

[0014] A smart terminal includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising the method for performing any one of the methods.

[0015] A computer-readable storage medium, wherein, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any of the methods described herein.

[0016] The present invention provides a method, apparatus, smart terminal, and storage medium for cross-device migration and operation of mobile terminal applications based on near-field communication, using video frame extraction, multi-level visual filtering, and face quality scoring. Through simple tap-to-interact interaction, the present invention enables native-level, large-screen adaptation of mobile applications on televisions, utilizing the television's hardware capabilities and transforming the mobile phone into a touchpad, thereby completely solving the problem of a lack of television app ecosystem. Furthermore, the present invention also has the following advantages: 1) Completely solve the bottleneck of the TV ecosystem: Instantly transform a massive number of mobile applications into usable large-screen applications without requiring additional adaptation from developers, fundamentally solving the problem of a lack of TV app ecosystem.

[0017] 2) Native-level large-screen experience: Through dynamic UI reconstruction, it provides an interface optimized for TVs, rather than a simple screen mirror, and the experience is no different from the native TV App.

[0018] 3) Minimalist interaction paradigm: "Tap to connect" greatly simplifies the process of device discovery, connection, and task migration, providing a smooth and intuitive user experience with zero learning cost.

[0019] 4) Hardware capability integration: It realizes the complementary advantages of mobile applications and TV hardware, allowing mobile applications to access the TV's large screen and high-quality audio-visual system, thereby enhancing the value of the applications.

[0020] 5) Innovative interaction mode: Turning the mobile phone into a touchpad not only solves the problem of precise pointer control on the TV, but also makes full use of the interactive advantages of the mobile phone touch screen, forming a perfect interactive loop. Attached Figure Description

[0021] Figure 1 This is a flowchart illustrating the cross-device migration and operation method for mobile terminal applications based on near-field communication provided in Embodiment 1 of the present invention.

[0022] Figure 2 The present invention provides a schematic diagram of an embodiment of a mobile terminal application cross-device migration and operation device based on near-field communication.

[0023] Figure 3 This is a block diagram illustrating the internal structure of a smart terminal provided in an embodiment of the present invention. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of this invention clearer and more explicit, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0025] It should be noted that if the embodiments of the present invention involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of the components in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indicators will also change accordingly.

[0026] With the development of electronic technology, mobile terminals are becoming increasingly popular due to their portability. However, mobile terminal screens are small, and users sometimes want to switch mobile terminal applications to display devices such as smart TVs. For example, a user may want to switch from opening a Word document to operating it on a large smart TV screen, or a user may want to switch from operating a game application on a mobile phone to displaying it on a large smart TV screen.

[0027] However, the core pain point currently facing smart TVs lies in the severe lack of their application ecosystem (TV-side apps) compared to the mobile application ecosystem (phone-side apps). Many popular mobile applications lack TV versions, preventing users from enjoying full mobile internet services on the large TV screen. Existing solutions have significant shortcomings: 1) Traditional screen mirroring technologies (such as Miracast and AirPlay): These only mirror the screen and cannot change the interface layout of the application itself. The screen is displayed on the TV as an unoptimized mobile phone interface, resulting in a poor user experience and the phone cannot be used for other purposes.

[0028] 2) Switching app interfaces through TV app stores: This relies on developers actively adapting the app, which is time-consuming and costly, and cannot solve the problem of missing a large number of mobile apps.

[0029] 3) Cloud gaming / cloud application approach for application interface switching: This approach has high network requirements, introduces latency, and requires the server to perform a large amount of application virtualization work.

[0030] Existing technologies suffer from three major drawbacks: non-adaptive screen mirroring interfaces, the need for separate TV adaptation for applications, and high latency and bandwidth costs associated with cloud solutions. Therefore, there is an urgent need for a terminal-side solution that can fully leverage the existing mobile application ecosystem and intelligently and seamlessly adapt it to large TV screens.

[0031] To address this, this application proposes a method for cross-device migration and operation of mobile terminal applications based on near-field communication (NFC). This invention relies on near-field pairing and a distributed soft bus for local direct transmission of the application's full state packet, achieving cross-device application migration from the terminal side without cloud access, developer adaptation, or occupation of the phone's screen mirroring channel. It possesses a unique technical path distinct from traditional screen mirroring, TV app stores, and cloud application solutions. Figure 1 As shown in Embodiment 1 of the present invention, a method for cross-device migration and operation of mobile terminal applications based on near-field communication includes the following steps: S100: The mobile terminal is paired with the display device through the near-field communication module, and the pre-set distributed soft bus of both parties is activated to establish a secure connection between them. The display device in this embodiment can be a smart TV, a commercial large screen, or other large-screen terminal with display, graphics rendering, and interactive processing capabilities. The mobile terminal is, for example, a user's smartphone. The near-field communication module in this embodiment can be an NFC near-field communication module or a UWB baseband communication module, etc., used for rapid discovery, identity verification, and pairing between the mobile terminal and the smart TV, unlike long-distance public network transmission.

[0032] In this embodiment, pairing refers to the process by which the user's smartphone and the smart TV complete device identification, device capability negotiation, and security key exchange to establish a mutually trusted device relationship.

[0033] The distributed soft bus in this embodiment refers to a cross-terminal virtual communication bus that does not require a router as a relay. It establishes an independent, encrypted, and low-latency transmission channel between local devices, supporting bidirectional communication of application data, interactive commands, and graphical status between devices, which is different from ordinary Wi-Fi screen mirroring links.

[0034] The secure connection in this embodiment refers to encrypting and encapsulating the transmitted data with an encryption key negotiated during the pairing phase to prevent application state data from being hijacked or tampered with.

[0035] In the specific implementation of step S100, the mobile terminal, such as a mobile phone, is brought close to the NFC near-field communication module sensing area of ​​the smart TV. The near-field communication modules of the mobile phone and the smart TV exchange device certificates to complete device identity matching and pairing authentication. After pairing is completed, the distributed soft bus program built into both ends is automatically woken up and started. Based on the point-to-point local independent transmission channel established by pairing, a secure cross-device data interaction link is built as the underlying carrier for subsequent cross-terminal transmission of application status.

[0036] The present invention differs from traditional screen mirroring, which only reuses the video transmission channel and has no independent encrypted soft bus. The solution of the present invention establishes a dedicated distributed communication link through near-field fast pairing, thereby achieving physical isolation between business data and screen mirroring channel.

[0037] For example, when a user's mobile phone turns on the NFC near-field communication module and locates the NFC near-field communication sensing area of ​​the smart TV in the living room; the two parties exchange device IDs to complete pairing; the built-in distributed soft bus service of the mobile phone and TV is automatically activated to generate a dedicated transmission channel, without the need to connect to the home router or rely on the public network.

[0038] Thus, this invention relies on NFC near-field pairing and local distributed soft bus point-to-point transmission, without going through a cloud server, without needing public network bandwidth, and without the screen and operation delay problems common in cloud applications; it can achieve low-latency local near-field links, avoiding the bandwidth and latency defects of cloud applications.

[0039] Furthermore, this invention employs near-field communication to automatically discover devices, and one-click pairing automatically activates the soft bus, eliminating the need for users to manually connect to the same Wi-Fi network or manually enable the screen mirroring function, thus seamlessly completing device interconnection; it enables rapid and automatic device linkage with a low operating threshold.

[0040] Moreover, this invention uses a distributed soft bus as an independent data channel, which does not occupy the screen mirroring output capability. During the application state migration and transmission process, the mobile phone can exit the current application and run other software, solving the pain point of traditional screen mirroring mobile phones being monopolized and unusable.

[0041] S200: The mobile terminal obtains the selected target application to be switched, packages the current complete state of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus. The target application in this embodiment refers to the native mobile app (without a TV-specific version) selected by the mobile user and required to be migrated to the TV screen, such as mobile Word, mobile games, and short video apps.

[0042] The complete application state in this embodiment refers to all runtime data that maintains the uninterrupted operation of the application, including APP front-end page layout parameters, runtime memory snapshots, page control coordinates, login sessions, operation contexts, pop-up hierarchy, media rendering parameters, etc.

[0043] The application data packet in this embodiment refers to a structured data packet that is uniformly serialized, compressed, and encapsulated to represent the complete running state of an application, and is adapted to the distributed soft bus transmission protocol.

[0044] In the specific implementation of step S200, the user can select the native mobile APP to be migrated on the mobile phone. The terminal mobile phone system captures the current running context and interface state of the APP application. All state information is uniformly compressed and packaged into a standardized application data package. Relying on the distributed soft bus point-to-point channel built in the previous step, the packaged standardized application data package is completely sent to the display device such as a smart TV, and all the underlying data required for the uninterrupted operation of the application is synchronized to the smart TV screen.

[0045] The difference between this invention and existing screen mirroring technologies is that traditional screen mirroring only transmits the pixel stream of the image, while the embodiments of this invention transmit the application running logic and control state, rather than a simple image mirror; it does not require cloud virtualization and is purely local transmission on the terminal side.

[0046] For example, when a user opens a mobile Word document on their phone and selects to migrate the application for opening the Word document to the TV, the smartphone system captures the complete running state of the Word document, including its current content, font layout, cursor position, menu bar controls, and login account session, compresses and encapsulates it into an application data package, and transmits it directly to the smart TV via a distributed soft bus with local encryption. The TV then receives the complete application running data.

[0047] In this way, compared to traditional mobile phone screen mirroring which only synchronizes pixel images and directly stretches the vertical interface of the mobile phone, this embodiment receives the complete application controls and layout status through a smart TV screen and can then re-adaptively render the layout of the large screen locally. This achieves automatic interface adaptation to the TV size, optimizes the user experience, and solves the problem of distorted display of the mobile phone interface on a large screen.

[0048] Furthermore, this invention only transmits the application's running status, does not require the app to adapt its code for TV, and eliminates the need for developers to modify their applications, thus addressing industry pain points such as a lack of TV application ecosystem, long adaptation cycles, and high modification costs. This invention fully reuses the existing mobile application ecosystem, eliminating the need for manufacturers to develop TV-specific versions.

[0049] Compared to cloud gaming / cloud application solutions, the solution in this invention packages and transmits all application states locally on the mobile phone and TV, eliminating the need for continuous virtualization of applications on the server side and saving on cloud server computing power and bandwidth operating costs.

[0050] S300: The application data packet is received and parsed by the adaptive rendering engine of the display device, and the user interface components of the target application on the mobile terminal are rearranged and scaled in real time according to the preset adaptation rules, and switched to the display device to display the adapted user interface; and the audio and / or video rendering instructions corresponding to the target application are redirected to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities. The adaptive rendering engine in this embodiment refers to a graphics rendering processing program deployed locally on a smart TV or large-screen display device. It is specifically designed to parse the running status data of mobile terminals such as mobile applications, replacing the traditional simple screen casting logic of screen decoding, and supporting control self-rearrangement, adaptive scaling, and audio-visual command splitting.

[0051] The application data package in this embodiment refers to a structured compressed data package that is packaged and transmitted by the mobile terminal in the preceding steps, containing the entire runtime context of the target APP, interface component parameters, interaction status, and audio and video control instructions. The adaptation rules in this embodiment refer to the standardized layout strategy library preset locally by the display device, including large screen resolution adaptation ratio, landscape / portrait conversion logic, control spacing magnification factor, button touch area expansion rules, font magnification ratio, pop-up window centering rules, etc.

[0052] The user interface components in this embodiment refer to all the basic building blocks of a mobile app interface, including text boxes, buttons, input boxes, pop-ups, menu bars, image controls, scrolling views, game rendering layers, and other detachable UI units. The rearrangement and scaling in this embodiment refers to breaking away from the constraints of the phone's native portrait screen layout and repositioning all UI components and adjusting their dimensions according to the display ratio of a smart TV's large screen, without directly stretching the original phone image.

[0053] The audio and video rendering instructions refer to the low-level control instructions within the mobile terminal APP that control video playback, background music, and sound effect output. They do not contain complete audio and video streams, but are only control logic signals.

[0054] In this embodiment, redirection refers to switching the audio and video output path from the phone's earpiece and screen to the smart TV's own display screen and built-in speakers / external audio. Seamless audio and video switching means that there is no black screen, stuttering, audio-video desynchronization, or audio interruption during the interface switching process, and the playback progress, sound effects, and picture status are completely continued from the mobile phone when playback resumes.

[0055] In the specific implementation of step S300, the adaptive rendering engine of the display device, such as a smart TV, receives the application data packet transmitted from the distributed soft bus and completes data parsing to extract the original parameters of all UI components of the target mobile application. The adaptive rendering engine reads the locally preset large-screen adaptation rules, re-plans the layout coordinates and adaptively scales the size of each interface component in real time, generates a new interface adapted to the TV large-screen resolution and landscape viewing, and outputs it to the display screen. At the same time, the engine intercepts the APP's native audio and video rendering control commands, redirecting the audio and video output path from the mobile terminal to the display and sound hardware of the large screen itself, ultimately realizing automatic interface optimization and seamless synchronous playback of audio and video after the mobile native application is transferred to the large screen.

[0056] For example, taking the example of a user migrating a vertical Word document from their mobile phone to a 1080P smart TV, the adaptive rendering engine of the smart TV receives and parses the Word application data package transmitted from the mobile phone, extracting the coordinates and size parameters of all UI components such as text boxes, menu bars, cursors, and function buttons; then it calls the large screen adaptation rules, such as landscape layout, button enlargement by 1.8 times, font enlargement by 1.5 times, and moving the side toolbar to the bottom of the screen; the engine rearranges all components in real time to generate a wide document interface adapted to the TV's landscape screen.

[0057] Furthermore, in this embodiment of the invention, the accompanying audio commands for reading aloud from the document will be intercepted simultaneously, and the audio output will be redirected to the TV speaker, while the text output will be displayed on the TV screen. This allows for complete document operation on the large screen without stretching or blurring, and the audio will not remain on the phone.

[0058] As can be seen from the above, the present invention can solve the problem of distorted screen mirroring interface in traditional screen mirroring because the present invention no longer directly transmits the pixel image of the mobile phone, but disassembles the UI components, rearranges and scales them, and coordinates the layout of the large screen display, greatly improving the user experience; and the present invention does not require APP manufacturers to develop TV-specific versions, but relies on the local adaptive rendering engine of the terminal side, reducing the application adaptation cost and shortening the implementation cycle.

[0059] Furthermore, this embodiment of the invention achieves complete audio and video retention on the large screen through audio-visual command redirection, allowing the mobile phone to run other programs independently, thus solving the defect of traditional screen-casting phones being monopolized and unusable.

[0060] Furthermore, this invention only transmits interface status and control commands, without continuously pushing high-definition video streams, which significantly reduces network bandwidth consumption compared to cloud applications and eliminates operation delays caused by the cloud. The rendering, adaptation, and audio-visual splitting of this invention are all completed locally on the display device, such as a smart TV, without relying on cloud virtualization servers, resulting in lower hardware deployment costs and normal use in offline near-field connection scenarios. Moreover, this invention is based on continuous rendering of the complete application status, with no application restart or progress loss during the switching process, and uninterrupted audio-visual synchronization, achieving a seamless switching effect across devices.

[0061] S400: The control automatically switches the mobile terminal screen to the touchpad interface of the target application migration display control, and obtains touch operations through the mobile terminal screen as the touchpad interface, and maps them in real time to the movement and operation instructions of the display device screen cursor.

[0062] In this embodiment of the invention, the mobile terminal, such as a mobile phone screen, is also controlled to automatically switch to a touchpad interface. This touchpad interface may include virtual directional keys, left and right buttons, and a gesture area. Touch operations are then acquired through the mobile terminal screen, which serves as the touchpad interface, and mapped in real-time to movement and operation commands of the cursor on the display device screen. For example, all touch operations performed by the user on the mobile phone are captured by the input routing module and mapped in real-time to movement and operation commands of the cursor on the TV screen, controlling the smart TV display to respond to all touch operations.

[0063] In a further embodiment of the present invention, the method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein after the step of obtaining touch operations through the mobile terminal screen (which serves as a touchpad interface) and mapping them in real time to movement and operation instructions of the display device screen cursor, the method further includes: S600: When an operation command to switch the target application from the display device back to the mobile terminal is detected, control the repackaging of all data of the current state of the target application and transmit it back to the mobile terminal through the established distributed soft bus; control the target application of the mobile terminal to restore to the corresponding state, so as to achieve seamless task continuation.

[0064] In this embodiment of the invention, when the user completes the operation or taps the screen again, it is determined that an operation command to switch the target application from the display device back to the mobile terminal display has been detected. The system then controls the current application state on the smart TV (including new data generated on the TV) to be repackaged and transmitted back to the mobile phone via the established distributed soft bus. The mobile application then returns to the corresponding state, achieving seamless task continuation.

[0065] The present invention will be further described in detail below through a specific application example: For example, taking e-commerce app shopping as an example, when using the method of this embodiment of the invention, if a user is browsing a shoe product on their mobile phone using the Taobao shopping app and wants to switch to viewing it on a smart TV, they can tap their phone against the smart TV's NFC tag. A confirmation dialog box will then pop up on the smartphone, which the user clicks to confirm. The phone then packages and sends the current product details page status (including the product ID and the user's shopping cart information) to the smart TV.

[0066] After receiving the data packet, the smart TV's adaptive rendering engine starts working. It reconstructs the vertically scrolling details page on the mobile phone into a horizontally focused large-screen page with larger images and clearer text, and automatically generates focus navigation logic.

[0067] At the same time, the user's smartphone screen transforms into a touchpad. The user controls the cursor on the TV by swiping the smartphone screen, moving it to the "Add to Cart" button, and tapping the screen to complete the action.

[0068] After the operation is complete, when the user picks up their smartphone or taps it against the smart TV's NFC module again, the TV automatically notifies that the connection has been lost. The Taobao Shopping App on the phone immediately returns to the same page that was viewed on the TV, and new items have been added to the shopping cart.

[0069] In this embodiment of the invention, the large-screen adaptive rendering engine has built-in universal adaptation templates for different application types (such as news, video, shopping, and office). For apps without predefined templates, an AI-based layout analysis algorithm can be used for intelligent adaptation. All data transmission is end-to-end encrypted to ensure user privacy and data security.

[0070] In a further embodiment of the present invention, the method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the step of pairing the mobile terminal with the display device through the near-field communication module and waking up the preset distributed soft bus of both parties to establish a secure connection between them further includes: S101. A near-field communication module is pre-installed on the mobile terminal and the display device; In this embodiment of the invention, a near-field communication module is pre-set on the mobile terminal and the display device. In specific implementation, the near-field communication module can be an NFC module or a UWB baseband communication module, integrated into the smart TV and smartphone, for simplified device discovery and secure connection triggering.

[0071] S102, and set that when the distance between the mobile terminal and the display device is within a predetermined distance, a distributed soft bus is triggered between the mobile terminal and the display device to establish a virtual communication channel between the mobile terminal and the display device.

[0072] The predetermined distance in this embodiment refers to a pre-configured distance threshold, determined based on near-field communication signal strength and ranging algorithms, such as 20 centimeters, as the trigger condition for automatically starting the link. In this embodiment, triggering the distributed soft bus requires no manual user operation; the device automatically wakes up the built-in soft bus background services at both ends after detecting that the distance has reached the threshold. The virtual communication channel is an independent point-to-point encrypted transmission link constructed by the distributed soft bus, distinct from ordinary Wi-Fi projection and Bluetooth pass-through channels. It is specifically used for transmitting application status data packets, UI component data, and audio / video control commands, and is isolated from the video mirroring stream channel.

[0073] In this embodiment, when a mobile terminal, such as a smartphone, approaches a display device, such as a smart TV, and the approach distance is less than or equal to a preset distance threshold, such as 20 centimeters, the two devices are automatically triggered to launch a distributed soft bus service, establishing a dedicated, encrypted, and independent point-to-point virtual communication transmission channel between the mobile phone and the large screen, providing an underlying transmission carrier for subsequent cross-device application migration and application data packet transmission.

[0074] Users can tap their phones against the NFC module of a smart TV to automatically wake up the distributed soft bus program of both the phone and the TV, establishing a virtual communication channel. Users can then initiate application migration operations directly without manually turning on screen mirroring or pairing.

[0075] In this way, the present invention can automatically sense and interconnect, reducing the operational threshold. Traditional screen mirroring requires users to manually turn on Bluetooth, Wi-Fi, and screen mirroring functions; the present invention relies on distance sensing to automatically establish a transmission channel when the device is close, achieving seamless device interconnection and making operation more convenient. In the embodiments of the present invention, a dedicated virtual communication channel is automatically generated after the distance meets the standard, isolated from the screen mirroring channel. The transmission of application status data packets does not have bandwidth contention or lag issues, ensuring low latency for cross-device interface rendering and audio-visual switching.

[0076] In a further embodiment of the present invention, the method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein step S200 includes: S201. When it is necessary to switch the target application to the display device, the user's operation command is received through the mobile terminal to select the target application to be switched. S202. The mobile terminal automatically captures the running status of the current application according to the selected target application to be switched, packages the current complete status of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus.

[0077] In this embodiment, the distributed soft bus establishes a high-bandwidth, low-latency secure communication channel between the mobile terminal and the smart TV. When a user's NFC-enabled mobile phone approaches the NFC sensing area of ​​the smart TV, the distributed soft bus is automatically activated, establishing a secure communication channel between the phone and the smart TV. When it's necessary to switch the target application to the display device, the mobile terminal receives the user's operation command to select the target application to switch to. For example, if a user is browsing a shoe product on their phone using the "Shopping Tao" app, they can touch their phone to the TV's NFC tag. A confirmation box will pop up asking if they want to switch to the smart TV display. When the user clicks "confirm," the mobile terminal automatically captures the current application's running status based on the selected target application. The phone packages the current product details page status (including product ID and user shopping cart information) into application data packets and sends them to the TV.

[0078] In a further embodiment of the present invention, the method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein step S300 includes: S301. An adaptive rendering engine is pre-set on the display device to dynamically reconstruct the user interface of the target application on the display device based on the screen size and interaction characteristics of the display device after receiving the target application status. The adaptive rendering engine in this embodiment is a graphics processing kernel program pre-installed on large screens such as smart TVs. It is independent of the TV's native system UI and can be used to parse the running status data of mobile applications. The target application status refers to the application data package output by the mobile terminal, which includes the coordinates, hierarchy, interaction logic, and page structure of all user interface UI components.

[0079] The interactive features refer to the TV interacting with the up, down, left, and right confirmation buttons on the remote control, and the mobile phone interacting with the touch screen by clicking and swiping; the dynamic reconstruction refers to not reusing the original image pixels of the mobile phone, but rebuilding a completely new interface adapted to the large-screen hardware based on the component parameters.

[0080] In the specific implementation of step S301, an adaptive rendering engine program is deployed locally on the smart TV as the underlying processing unit in advance. When the engine receives the complete application status data transmitted from the mobile phone, it combines the TV's own screen size and remote control interaction characteristics to rebuild the application interface adapted to the large-screen hardware from scratch, rather than directly stretching and mirroring the mobile phone screen.

[0081] For example, when a smartphone short video app is natively designed for a 6.7-inch vertical touchscreen, and the smart TV is pre-installed with an adaptive rendering engine, after receiving the short video app's page data, it combines the smart TV's 55-inch 16:9 horizontal screen size and the remote control's button interaction characteristics to rebuild a video browsing interface adapted to the large screen.

[0082] Thus, this invention deploys the underlying engine locally, without cloud involvement, eliminating network latency associated with cloud applications. Furthermore, this invention reconstructs the interface based on screen and interaction characteristics, fundamentally solving the pain points of traditional screen-casting mobile phone interfaces being stretched and distorted, and buttons being too small for remote control operation. Moreover, this invention, through a universal rendering kernel, can adapt to all mobile applications without a TV version, eliminating the need for application manufacturers to develop separate TV-adapted versions, thus solving the problem of a lack of TV application ecosystem.

[0083] S302. The application data packet is received and parsed by the adaptive rendering engine of the display device, and the display interface of the display device is reorganized according to the preset adaptation rules, so as to automatically convert the single-column list layout of the mobile terminal into the multi-column grid layout of the display device. The application data package in this embodiment refers to the structured data packaged by the mobile phone, which includes page components, list data, and control hierarchy. The adaptation rule in this embodiment refers to the locally pre-stored large screen layout conversion strategy. The single-column list layout refers to the mainstream interface style of mobile phones, with content arranged vertically from top to bottom. The multi-column grid layout refers to the smart TV large screen adaptation layout, which is horizontally split into multiple columns to make full use of the horizontal wide screen space.

[0084] In the specific implementation of step S302, the adaptive rendering engine on the smart TV reads and parses the application data packet transmitted from the mobile phone, retrieves the built-in layout transformation and adaptation rules, and re-plans the layout structure of the original vertical single-column page on the mobile phone; it automatically converts the single vertical scrolling list on the mobile phone into a multi-column grid style on the TV, completing the page layout reorganization. For example, the product page of a mobile shopping APP is a single-column vertical scrolling product list; after parsing the page data, the smart TV engine of this embodiment of the invention converts it into a 3-column grid layout on the TV according to the adaptation rules, displaying 3 product cards in one row at the same time, making full use of the horizontal screen width of the TV.

[0085] Thus, this embodiment of the steps can automatically complete the conversion between portrait and landscape screen layouts, making full use of the horizontal space of the large screen, displaying more information on the page, and creating a cleaner visual experience; moreover, no manual adaptation or application modification is required, as the engine automatically completes the layout switching, reducing development costs; and unlike existing technologies that directly stretch a single column of the screen during projection, resulting in a narrow and elongated screen with excessive white space, the visual experience of the large screen achieved by this invention is greatly improved.

[0086] S303, and scaling the font and controls of the display interface of the display device, scaling the displayed text and touch hotspots proportionally, and switching to the display device to display the adapted user interface; In this embodiment, the controls refer to page interaction components such as buttons, input boxes, pictures, and cards; the touch hotspots refer to the clickable and effective interactive areas on a mobile phone touchscreen; the proportional scaling refers to scaling up text and interactive areas proportionally based on a fixed magnification factor preset according to the TV screen size, without distortion; and the adapted user interface refers to the final large-screen interface with clear text, a sufficiently large interactive area, and suitable for remote viewing and operation from a distance.

[0087] In this embodiment, during implementation, the rendering engine of a display device such as a smart TV screen, after reorganizing the page layout, uniformly enlarges all text sizes and all interactive controls within the page according to a preset scaling ratio; simultaneously, it enlarges the original mobile phone's touch-clickable area to adapt to the usage scenarios of watching TV from a distance and selecting operations with a remote control, generating a complete application interface adapted to the large screen.

[0088] For example, on the mobile app, the button size is 40px, the font size is 14pt, and the clickable hotspot area is 50px. When the app is switched to a smart TV display, the scaling factor is 1.8. After processing, the button size is 72px, the font size is 25pt, and the interactive hotspot is enlarged accordingly. The text is clear when watching TV from a distance, and there will be no problem of not being able to select the desired text with the remote control.

[0089] In this way, the present invention can solve the defects of traditional screen projection, such as text that is too small and cannot be seen at a distance, and interactive buttons that are too small and difficult to select remotely; and proportional scaling ensures that the interface is not stretched or distorted, and the picture is beautiful; and uniformly enlarges the touch hotspots, adapts to the interaction logic of TV remote control, and greatly improves the ease of use of large screen operation.

[0090] S304, and automatically generate a focus navigation logic suitable for remote control operation from the displayed navigation focus.

[0091] In this embodiment, the navigation focus refers to the highlighted mark on the smart TV interface and the interactive control currently selected by the remote control; the focus navigation logic refers to defining the path and switching rules for the remote control's up, down, left, and right buttons to jump to the focus; the adapted remote control operation refers to the focus jump rules designed for the up, down, left, right, confirm, and return physical buttons, which are different from the free touch screen swiping on a mobile phone.

[0092] In the specific implementation of step S304, after the adaptive rendering engine completes the interface layout and font scaling, it automatically identifies all interactive buttons, cards, input boxes and other components on the page, and generates a set of exclusive focus jump rules based on the component position coordinates; when the user uses the up, down, left and right buttons of the TV remote control, the focus can be smoothly switched between various controls in a reasonable order, adapting to the TV remote control operation habits.

[0093] Following the example in step S303, the engine automatically generates focus logic for the converted three-column product grid interface: press the right button to switch to the next product in the same row, press the down button to switch to the first product in the next row, and press confirm to select the product card. This fully adapts to the remote control button operation logic, without the need for manual focus adaptation.

[0094] Thus, the automatic generation of remote control focus logic in this embodiment of the invention does not require developers to separately adapt the focus framework for the TV, and a large number of mobile applications can be directly operated on the TV for remote control; moreover, the focus jump logic is in line with the usage habits of large screens, solving the core pain points of no focus navigation and inability to remote control operation on the screen projection interface; and the entire process is automatically processed by the engine, without the need for cloud computing, generated locally in real time, and with no response delay.

[0095] In a further embodiment of the present invention, the method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein step S400 further includes: S401. A touchpad simulation module is pre-set in the mobile terminal to transform the mobile terminal screen into a virtual touchpad for the display device, receive touch and gesture input, and convert the received touch and gesture input into cursor movement and click events of the display device. In this step, the touchpad simulation module is a pre-installed software function module on the mobile phone system side, without additional hardware. It reuses the original touchscreen hardware resources of the mobile phone to realize input conversion logic similar to a computer touchpad. The virtual touchpad refers to mapping the entire screen of the mobile phone to a remote touch control area of ​​a large TV screen. Sliding on the mobile phone is equivalent to controlling the cursor on the TV. The touch and gesture input refers to the native touch screen operations of the mobile phone, such as single-point clicking, long press, left and right swiping, up and down dragging, and two-finger zooming. The cursor movement and click events refer to the standardized interactive commands of mouse cursor displacement, left click, long press selection, and scroll wheel zooming recognized by the graphics layer on the TV.

[0096] Specifically, before the present invention is implemented, a touchpad simulation software module will be built into the mobile terminal in advance. This module can map the entire screen of the mobile phone as a remote virtual touchpad of the smart TV; collect various touch and gesture operations of the user on the mobile phone screen in real time, and then convert the native touch screen coordinates and gesture actions of the mobile phone into standardized interactive events such as cursor displacement, click, zoom and other actions on the TV screen, so as to realize remote control of the TV interface by the mobile phone touch screen.

[0097] For example, when migrating a mobile game to a smart TV screen, the touchpad simulation module is activated. The module detects a finger swiping to the right on the phone screen, recognizes the swipe gesture, and converts it into a rightward movement of the TV cursor. When pinching to zoom with two fingers, the module converts it into a zoom command for the TV screen. When pressing the phone screen with a single tap, the corresponding button is selected by the TV cursor.

[0098] As can be seen, this invention reduces the hardware cost of large-screen operation by reusing the built-in touch screen hardware of mobile phones, eliminating the need to purchase additional peripherals such as mice and air mice; it can perfectly adapt to the native touch screen interaction logic of mobile phone applications and transform it into cursor operation on TV, solving the pain point of the inflexibility of button operation for mobile games and text-based apps on TV remote controls.

[0099] Compared with traditional screen mirroring, this invention uses the mobile phone only as a touch input pad, and the screen does not need to display the TV screen simultaneously. The mobile phone can open other software and be used independently at the same time. In addition, this invention is fully compatible with gestures. Clicking, swiping, zooming, and long pressing can all be synchronized across devices, fully preserving the interactive experience of mobile applications.

[0100] S402. A cross-device input route is pre-configured to transmit input events from the mobile terminal to the display device in real time via a distributed soft bus.

[0101] The cross-device input routing in this embodiment refers to an independent data forwarding channel scheduling logic used to divert interactive events generated by the mobile phone touch module and isolate them from the application screen data packet transmission channel; the input events in this embodiment refer to the standardized interactive commands such as cursor movement, click, and zoom completed in step S401; the distributed soft bus in this embodiment refers to the near-field encrypted point-to-point virtual communication channel and low-latency local transmission link between the smartphone and the large screen.

[0102] In the specific implementation of this step, the system pre-configures an independent cross-device input data forwarding route; all cursor interaction commands generated by the touchpad simulation module are scheduled through this dedicated input route and transmitted to the smart TV with low latency via the pre-built distributed soft bus, and the TV receives and executes the corresponding cursor operation in real time.

[0103] In the specific implementation of this step, the user continuously slides the TV cursor on the mobile phone screen. The continuous cursor movement events generated by the slide are sent to the TV in real time through a distributed soft bus via an independent input route. The route distinguishes between interface rendering data packets and input commands, and prioritizes the transmission of touch operation commands to ensure that the operation is lag-free.

[0104] Through this step, the input commands of this invention are independently routed and split, and transmitted separately from the UI interface data packets. Interactive commands have transmission priority, cursor control has low latency, and interactive response speed is fast and highly responsive. Moreover, this invention relies on local distributed soft bus near-field transmission, which does not require a public network, and significantly reduces operation latency compared to remote control of cloud applications.

[0105] Exemplary device like Figure 2 As shown, this embodiment of the invention provides a cross-device migration and operation device for mobile terminal applications based on near-field communication, comprising: The near-field communication and virtual channel establishment module 310 is used to control the mobile terminal to complete pairing with the display device through the near-field communication module, and to wake up the preset distributed soft bus of both parties to establish a secure connection between them. The packet transmission module 320 is used to control the mobile terminal to obtain the selected target application to be switched, package the current complete state of the target application into an application data packet, and transmit it to the display device through the established distributed soft bus; The parsing, rendering, and display module 330 is used to receive and parse the application data packet through the adaptive rendering engine of the display device, and rearrange and scale the user interface components of the target application on the mobile terminal in real time according to the preset adaptation rules, switch to the display device to display the adapted user interface; and control the redirection of the audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities. The touch panel switching module 340 is used to control the automatic switching of the mobile terminal screen to the touch panel interface of the target application migration display control. The touch operation is obtained through the mobile terminal screen as the touch panel interface and mapped in real time to the movement and operation instructions of the display device screen cursor, as described above.

[0106] Based on the above embodiments, the present invention also provides a smart terminal, the principle block diagram of which can be as follows: Figure 3 As shown, the smart terminal can be a smartphone, smart TV, smart large-screen smart terminal, etc. The smart terminal includes a processor, memory, network interface, display screen, and database connected via a system bus. The processor of the smart terminal provides computing and control capabilities. The memory of the smart terminal includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the smart terminal is used for communication with external terminals via a network connection. When the computer program is executed by the processor, it implements a method for cross-device migration and operation of mobile terminal applications based on near-field communication (NFC). The database of the smart terminal stores the cross-device migration and operation program for mobile terminal applications based on NFC.

[0107] Those skilled in the art will understand that Figure 3 The block diagram shown is merely a partial structural diagram related to the present invention and does not constitute a limitation on the smart terminal to which the present invention is applied. A specific smart terminal may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0108] In one embodiment, a smart terminal is provided, including a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations: The mobile terminal is paired with the display device through the near field communication module, and the pre-set distributed soft bus of both parties is activated to establish a secure connection between them. The mobile terminal obtains the selected target application to be switched, packages the current complete state of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus; The adaptive rendering engine of the display device receives and parses the application data packets, and according to the preset adaptation rules, rearranges and scales the user interface components of the target application on the mobile terminal in real time, switches to the display device to display the adapted user interface; and controls the redirection of the audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities. The control automatically switches the mobile terminal screen to the touchpad interface of the target application migration display control. Touch operations are obtained through the mobile terminal screen, which serves as the touchpad interface, and are mapped in real time to the movement and operation instructions of the cursor on the display device screen, as described above.

[0109] The step of obtaining touch operations through the mobile terminal screen (which serves as the touchpad interface) and mapping them in real time to movement and operation commands of the cursor on the display device screen further includes: When an operation command to switch the target application from the display device back to the mobile terminal is detected, control is used to repackage all data of the current state of the target application and transmit it back to the mobile terminal through the established distributed soft bus. Control the target application on the mobile terminal to restore it to the corresponding state, so as to achieve seamless task continuation.

[0110] The step of pairing the mobile terminal with the display device via a near-field communication module and waking up the pre-set distributed soft bus of both parties to establish a secure connection further includes: Near-field communication modules are pre-installed on mobile terminals and display devices; The system is configured to trigger the start of a distributed soft bus between the mobile terminal and the display device when the distance between the mobile terminal and the display device is within a predetermined distance, thereby establishing a virtual communication channel between the mobile terminal and the display device.

[0111] The steps of the mobile terminal acquiring the selected target application to be switched, packaging the current complete state of the target application into an application data packet, and transmitting it to the display device through the established distributed soft bus include: When it is necessary to switch the target application to the display device, the user's operation command is received through the mobile terminal to select the target application to be switched; The mobile terminal automatically captures the running status of the current application based on the selected target application to be switched, packages the current complete status of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus.

[0112] The step of receiving and parsing the application data packet through the adaptive rendering engine of the display device, and rearranging and scaling the user interface components of the target application on the mobile terminal in real time according to preset adaptation rules, and switching to displaying the adapted user interface on the display device includes: An adaptive rendering engine is pre-configured on the display device to receive the target application state and dynamically reconstruct the user interface of the target application on the display device according to the screen size and interaction characteristics of the display device. The application data packet is received and parsed by the adaptive rendering engine of the display device, and the display interface of the display device is reorganized according to the preset adaptation rules, so as to automatically convert the single-column list layout of the mobile terminal into the multi-column grid layout of the display device. And scaling the font and controls of the display interface of the display device, scaling the displayed text and touch hotspots proportionally, and switching to the display device to display the adapted user interface; It will also automatically generate focus navigation logic suitable for remote control operation based on the displayed navigation focus.

[0113] The step of automatically switching the mobile terminal screen to the touchpad interface of the target application migration display control, and obtaining touch operations through the mobile terminal screen as the touchpad interface and mapping them in real time to the movement and operation commands of the display device screen cursor, further includes: A touchpad simulation module is pre-installed on the mobile terminal to transform the mobile terminal screen into a virtual touchpad for the display device, receive touch and gesture inputs, and convert the received touch and gesture inputs into cursor movement and click events on the display device. A cross-device input route is pre-configured to transmit input events from the mobile terminal to the display device in real time via a distributed soft bus.

[0114] The method for cross-device migration and operation of mobile terminal applications based on near-field communication, wherein the near-field communication module is an NFC module or a UWB baseband communication module, as described above.

[0115] In other embodiments, this application proposes a computer-readable storage medium that, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to perform the above-described method.

[0116] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided by this invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0117] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for cross-device migration and operation of mobile terminal applications based on near-field communication, characterized in that, include: The mobile terminal is paired with the display device through the near field communication module, and the pre-set distributed soft bus of both parties is activated to establish a secure connection between them. The mobile terminal obtains the selected target application to be switched, packages the current complete state of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus; The application data packet is received and parsed by the adaptive rendering engine of the display device, and the user interface components of the target application on the mobile terminal are rearranged and scaled in real time according to the preset adaptation rules, and switched to the display device to display the adapted user interface. It also controls the redirection of audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device, achieving seamless switching of audio and video capabilities; The control automatically switches the mobile terminal screen to the touchpad interface of the target application migration display control, and obtains touch operations through the mobile terminal screen as the touchpad interface, and maps them in real time to the movement and operation instructions of the display device screen cursor.

2. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The step of obtaining touch operations through the mobile terminal screen, which serves as the touchpad interface, and mapping them in real time to movement and operation commands of the cursor on the display device screen further includes: When an operation command to switch the target application from the display device back to the mobile terminal is detected, control is used to repackage all data of the current state of the target application and transmit it back to the mobile terminal through the established distributed soft bus. Control the target application on the mobile terminal to restore it to the corresponding state, so as to achieve seamless task continuation.

3. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The steps of pairing the mobile terminal with the display device via the near-field communication module and waking up the pre-set distributed soft bus of both parties to establish a secure connection further include: Near-field communication modules are pre-installed on mobile terminals and display devices; The system is configured to trigger the start of a distributed soft bus between the mobile terminal and the display device when the distance between the mobile terminal and the display device is within a predetermined distance, thereby establishing a virtual communication channel between the mobile terminal and the display device.

4. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The steps of the mobile terminal acquiring the selected target application to be switched, packaging the current complete state of the target application into an application data packet, and transmitting it to the display device through the established distributed soft bus include: When it is necessary to switch the target application to the display device, the user's operation command is received through the mobile terminal to select the target application to be switched; The mobile terminal automatically captures the running status of the current application based on the selected target application to be switched, packages the current complete status of the target application into an application data packet, and transmits it to the display device through the established distributed soft bus.

5. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The step of receiving and parsing the application data packet through the adaptive rendering engine of the display device, and rearranging and scaling the user interface components of the target application on the mobile terminal in real time according to preset adaptation rules, and switching to displaying the adapted user interface on the display device includes: An adaptive rendering engine is pre-configured on the display device to receive the target application state and dynamically reconstruct the user interface of the target application on the display device according to the screen size and interaction characteristics of the display device. The application data packet is received and parsed by the adaptive rendering engine of the display device, and the display interface of the display device is reorganized according to the preset adaptation rules, so as to automatically convert the single-column list layout of the mobile terminal into the multi-column grid layout of the display device. And scaling the font and controls of the display interface of the display device, scaling the displayed text and touch hotspots proportionally, and switching to the display device to display the adapted user interface; It will also automatically generate focus navigation logic suitable for remote control operation based on the displayed navigation focus.

6. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The control automatically switches the mobile terminal screen to the touchpad interface of the target application migration display control. The step of obtaining touch operations through the mobile terminal screen as the touchpad interface and mapping them in real time to the movement and operation commands of the display device screen cursor also includes: A touchpad simulation module is pre-installed on the mobile terminal to transform the mobile terminal screen into a virtual touchpad for the display device, receive touch and gesture inputs, and convert the received touch and gesture inputs into cursor movement and click events on the display device. A cross-device input route is pre-configured to transmit input events from the mobile terminal to the display device in real time via a distributed soft bus.

7. The method for cross-device migration and operation of mobile terminal applications based on near-field communication according to claim 1, characterized in that, The near-field communication module is an NFC module or a UWB baseband communication module.

8. A device for cross-device migration and operation of mobile terminal applications based on near-field communication, characterized in that, The device includes: The near-field communication and virtual channel establishment module is used to control the mobile terminal to complete pairing with the display device through the near-field communication module, and to wake up the preset distributed soft bus of both parties to establish a secure connection between them. The packet transmission module is used to control the mobile terminal to obtain the selected target application to be switched, package the current complete state of the target application into an application data packet, and transmit it to the display device through the established distributed soft bus; The parsing and rendering display module is used to receive and parse the application data packet through the adaptive rendering engine of the display device, and rearrange and scale the user interface components of the target application on the mobile terminal in real time according to the preset adaptation rules, and switch to the display device to display the adapted user interface; and control the redirection of the audio and / or video rendering instructions corresponding to the target application to the speakers and display screen of the display device to achieve seamless switching of audio and video capabilities; The touch panel switching module is used to control the automatic switching of the mobile terminal screen to the touch panel interface of the target application migration display control. The touch operation is obtained through the mobile terminal screen as the touch panel interface and mapped in real time to the movement and operation instructions of the cursor on the display device screen.

9. A smart terminal, characterized in that, It includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors, wherein the one or more programs include methods for performing any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method as described in any one of claims 1-7.

Images