Electronic device, terminal device and intelligent seamless handover method thereof

Abstract

The present application provides an electronic device, a terminal device and an intelligent seamless switching method thereof. The electronic device comprises a lens synchronization unit, an artificial intelligence inference unit and a screen mirroring unit. The lens synchronization unit is used to capture at least one terminal lens image from at least one terminal device. The artificial intelligence inference unit is used to confirm one of the terminal devices as a target terminal device according to at least one face recognition result of the terminal lens image. The terminal lens image of the target terminal device has an authenticator. The screen mirroring unit superimposes the terminal lens image of the target terminal device on a screen image of the electronic device to obtain a composite mirror image. The composite mirror image is transmitted to the target terminal device and displayed on the target terminal device.

Description

Technical Field

[0001] This invention relates to an electronic device, a terminal device, and a control method thereof, and more particularly to an electronic device, a terminal device, and a method for intelligent seamless switching thereof. Background Technology

[0002] With the rapid development of technology, various electronic devices are constantly being innovated. People can use desktop computers, laptops, mobile phones, or tablets to conduct video conferencing, video calls, live streaming, and other activities.

[0003] However, currently, video conferencing, video calls, and live streaming can only be performed on a single device. For example, when a user uses a laptop for video conferencing, video calls, or live streaming, the user must move the laptop along with them if they move, which is quite inconvenient. This is especially true when using a desktop computer for video conferencing, video calls, or live streaming, as users cannot leave their seats. Once they leave their seats, they cannot continue the video conferencing, video calls, or live streaming activities.

[0004] To provide users with a more convenient way to use the device, the industry is working on developing various cross-device technologies. Summary of the Invention

[0005] This invention relates to an electronic device, a terminal device, and a method for intelligent seamless switching thereof. It uses AcerReal Time-Ai Media Mixer (ART-AIMMX) technology to make the electronic device the center of an intelligent environment, automatically and seamlessly connecting with the terminal device to achieve intelligent seamless switching across devices.

[0006] According to one aspect of the present invention, an electronic device with intelligent seamless switching function is provided. The electronic device with intelligent seamless switching function includes a lens synchronization unit, an artificial intelligence inference unit, and a screen mirroring unit. The lens synchronization unit is connected to at least one terminal device. The lens synchronization unit is used to capture at least one terminal lens image from at least one terminal device. The artificial intelligence inference unit is connected to the lens synchronization unit. The artificial intelligence inference unit is used to confirm that one of the terminal devices is a target terminal device based on at least one face recognition result of the terminal lens image. The terminal lens image of the target terminal device has an authenticator. The screen mirroring unit is connected to the artificial intelligence inference unit. The screen mirroring unit superimposes the terminal lens image of the target terminal device onto a screen of the electronic device to obtain a composite mirrored image. The composite mirrored image is transmitted to the target terminal device and displayed on the target terminal device.

[0007] According to another aspect of the present invention, a method for intelligent seamless switching of electronic devices is provided. The method includes the following steps: 1. Capturing at least one terminal camera image from at least one terminal device. 2. Identifying one of the terminal devices as a target terminal device based on at least one face recognition result based on the terminal camera image. 3. The terminal camera image of the target terminal device has an authenticator. 4. Superimposing the terminal camera image of the target terminal device onto a screen of the electronic device to obtain a composite mirror image. 5. Transmitting the composite mirror image to the target terminal device and displaying it on the target terminal device.

[0008] According to another aspect of the present invention, a terminal device with intelligent seamless switching function is provided. The terminal device with intelligent seamless switching function includes a lens and a display unit. The lens is used to capture a terminal lens image. The terminal lens image is transmitted to an electronic device. The display unit is used to display a composite mirror image. The composite mirror image is a superposition of the terminal lens image and a screen image of the electronic device. Attached Figure Description

[0009] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings, wherein:

[0010] Figure 1 A schematic diagram illustrating an intelligent seamless switching technology for an electronic device according to an embodiment of the present invention is shown.

[0011] Figure 2 A block diagram of an electronic device and a terminal device according to an embodiment of the present invention is shown.

[0012] Figure 3 A flowchart illustrating a method for intelligent seamless switching of an electronic device according to an embodiment of the present invention is shown.

[0013] Figure 4 A detailed flowchart of step S120 of an embodiment of the present invention is shown.

[0014] Figure 5 Example illustration of step S130.

[0015] Figure label:

[0016] 100: Electronic devices

[0017] 110: Lens Synchronization Unit

[0018] 120: Artificial Intelligence Inference Unit

[0019] 130: Screen mirroring unit

[0020] 200i: Terminal device

[0021] 200*: Target terminal device

[0022] 210i: Lens

[0023] 220i: Display Unit

[0024] 900: Authenticator

[0025] BTi: Remaining battery power

[0026] CF: Composite Mirror Image

[0027] CMi: Terminal Lens Image

[0028] CPi: Computational performance

[0029] FRi: Face recognition results

[0030] S110, S120, S121, S122, S123, S124, S125, S126, S127, S128, S130, S140: Steps

[0031] SG: Screen display Detailed Implementation

[0032] The technical terms used in this specification are based on common terminology in the field. Where this specification provides further explanation or definition of certain terms, the interpretation of those terms shall be based on the explanation or definition provided in this specification. Each embodiment of the present invention has one or more technical features. Where feasible, those skilled in the art may selectively implement some or all of the technical features in any embodiment, or selectively combine some or all of the technical features in the multiple embodiments.

[0033] Please refer to Figure 1 This illustration shows a schematic diagram of a smart seamless switching technology for an electronic device 100 according to an embodiment of the present invention. The electronic device 100 is, for example, a desktop computer, a laptop computer, a mobile phone, a tablet computer, or a smart home appliance. Figure 1 The electronic device 100 is illustrated using a desktop computer as an example. In a certain field, in addition to the electronic device 100, there are also many terminal devices 200i. The terminal device 200i is, for example, a desktop computer, a laptop computer, a mobile phone, a tablet computer, or a smart home appliance.

[0034] While user 900 is conducting a video conference using electronic device 100, they may need to move to the sofa. At this time, the camera 210i of the terminal device 200i (e.g., a smart TV) in front of the sofa will capture the image of user 900. This terminal device 200i will be identified as the target terminal device 200*, and a smart, seamless switch will occur between it and electronic device 100. User 900 can then switch to the terminal device 200i in front of the sofa to conduct the video conference.

[0035] If user 900 moves to another terminal device 200i (such as a smart refrigerator), the video conference can be seamlessly switched to this terminal device 200i. In this way, through intelligent and seamless switching across devices, users can freely move to conduct video conferences, which is quite convenient.

[0036] Please refer to Figure 2 The diagram illustrates a block diagram of an electronic device 100 and a terminal device 200i according to an embodiment of the present invention. The electronic device 100 includes a lens synchronization unit 110, an artificial intelligence inference unit 120, and a screen mirroring unit 130. Each terminal device 200i includes a lens 210i and a display unit 220i. The lens synchronization unit 110, the artificial intelligence inference unit 120, and the screen mirroring unit 130 are, for example, a circuit, a circuit board, a storage device storing program code, or a chip. The chip may be, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microcontroller (MCU), microprocessor, digital signal processor (DSP), programmable controller, application-specific integrated circuit (ASIC), graphics processing unit (GPU), image signal processor (ISP), image processing unit (IPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field-programmable gate array (FPGA), or other similar components or combinations thereof. The display unit 220i may be, for example, a liquid crystal display panel, an OLED display panel, a projector, or an electronic paper display panel.

[0037] In this invention, Acer RealTime-AiMedia Mixer (ART-AIMMX) technology is used to make electronic device 100 the center of a smart environment, automatically and seamlessly connecting with terminal device 200i to achieve intelligent and seamless switching across devices. The operation of each component is explained in detail below with a flowchart.

[0038] Please refer to Figure 3 The diagram illustrates a flowchart of an intelligent seamless switching method for an electronic device 100 according to an embodiment of the present invention. The intelligent seamless switching method includes steps S110 to S140.

[0039] In step S110, as Figure 2 As shown, the lens synchronization unit 110 of the electronic device 100 captures at least one terminal lens image CMi from at least one terminal device 200i. In this step, the electronic device 100 and the terminal device 200i establish a Bluetooth connection and pair with each other, and the electronic device 100 and the terminal device 200i are also located in the same wireless network domain.

[0040] In this step, electronic device 100 first activates ART-AIMMX and confirms that it is connected to a stable network and that Bluetooth is enabled. ART-AIMMX is a DMFT technology owned by Acer computers, used to acquire the image from the connected electronic device 100. This invention utilizes this technology to acquire CMi images from the terminal camera.

[0041] Simultaneously, terminal device 200i will also activate ART-AIMMX, enable Bluetooth, and ensure that it is connected to the same wireless network (Wi-Fi) domain as electronic device 100. Terminal device 200i will then complete pairing with electronic device 100. After pairing, both electronic device 100 and terminal device 200i can see the list of connected devices on the ART-AIMMX interface.

[0042] The camera 210i of the terminal device 200i will be activated and capture a terminal camera image CMi. The content of the terminal camera image CMi will vary depending on the location of the terminal device 200i.

[0043] Once electronic device 100 is connected to terminal device 200i, the terminal camera image CMi is automatically transmitted from terminal device 200i to electronic device 100 via ART-AIMMX technology. Terminal device 200i continuously transmits the terminal camera image CMi to electronic device 100 in real time. These multiple terminal camera images CMi may or may not be displayed on electronic device 100 (electronic device 100 may have a screen, be connected to a screen, or not have a screen or not be connected to a screen).

[0044] In the electronic device 100, the lens synchronization unit 110 is an execution unit for ART-AIMMX technology, and its main function is to provide the terminal lens image CMi and status information of the lens 210i.

[0045] Next, in step S120, as Figure 2 As shown, the artificial intelligence inference unit 120 confirms that one of the terminal devices 200i is the target terminal device 200* based at least on the face recognition result FRi of the terminal camera image CMi. Since the terminal devices 200i are located in different positions, the content of the terminal camera image CMi will also be different. The authenticator 900 may move in front of a certain terminal device 200i, so a certain terminal camera image CMi may contain the authenticator 900. The face recognition result FRi contains the recognition confidence level of each terminal camera image CMi for the authenticator 900. The higher the recognition confidence level, the higher the probability that the terminal camera image CMi contains the authenticator 900. The terminal device 200i corresponding to the terminal camera image CMi containing the authenticator 900 can be confirmed as the target terminal device 200*.

[0046] In addition to the facial recognition result FRi, the artificial intelligence inference unit 120 can further determine which terminal device 200i is the target terminal device 200* based on a remaining battery power BTi and a computing performance CPi. Please refer to Figure 4 This illustrates a detailed flowchart of step S120 according to an embodiment of the present invention. Step S120 includes, for example, steps S121 to S128. In step S121, as... Figure 2 As shown, the artificial intelligence inference unit 120 performs a face recognition process to obtain the face recognition result FRi. The face recognition process mainly identifies whether the authenticator 900 exists in the terminal camera image CMi.

[0047] Next, in step S122, as Figure 2 As shown, the artificial intelligence inference unit 120 determines whether the terminal lens image CMi has an authenticator 900. If the terminal lens image CMi has an authenticator 900, then proceed to step S123.

[0048] In step S123, as Figure 2As shown, the artificial intelligence inference unit 120 determines whether the network connection of this terminal device 200i is normal. For example, the network connection can be tested in the following ways: whether the network card is enabled and has a correct IP address; whether the default gateway can be pinged; whether the public DNS (such as 8.8.8.8) can be pinged; whether the domain name can be resolved (such as nslookup google.com); whether the traceroute shows that the packets are not blocked; whether there are any firewall or proxy restrictions; and whether the Wi-Fi signal is good and without excessive interference.

[0049] If the network connection of this terminal device 200i is normal, proceed to step S124.

[0050] Next, in step S124, as Figure 2 As shown, the artificial intelligence inference unit 120 obtains the remaining battery power BTi of the terminal device 200i. In this step, the remaining battery power BTi is obtained, for example, by the battery sensors of each terminal device 200i measuring information such as battery voltage, current, and temperature, and the remaining battery power is calculated through the embedded controller (EC) and battery management system (BMS) and transmitted to the motherboard. The above data can be read through ACPI (Advanced Configuration and Power Interface).

[0051] Then, in step S125, as Figure 2 As shown, the artificial intelligence inference unit 120 determines whether the remaining power BTi of the terminal device 200i is sufficient. If the remaining power BTi of the terminal device 200i is sufficient, then proceed to step S126. In one embodiment, if the terminal device 200i is connected to mains power, the remaining power BTi of the terminal device 200i will be determined to be sufficient.

[0052] Next, in step S126, as Figure 2As shown, the artificial intelligence inference unit 120 obtains the computing performance CPi of this terminal device 200i. Computing performance CPi includes, for example, the CPU's usage percentage, clock speed, temperature, and power consumption; the GPU's usage percentage, display memory usage, and temperature; the total RAM capacity, used RAM, and swap usage (virtual memory); and the HDD / SSD's read / write speed (IOPS, MB / s), usage percentage, and storage space. This information can be obtained through hardware performance counters (HPC), ACPI, and / or operating system built-in monitoring tools.

[0053] Then, in step S127, as Figure 2 As shown, the artificial intelligence inference unit 120 determines whether the computing performance CPi of the terminal device 200i is sufficient. If the computing performance CPi of the terminal device 200i is sufficient, then proceed to step S127.

[0054] In step S127, the artificial intelligence inference unit 120 selects this terminal device 200i as the target terminal device 200* for seamless switching.

[0055] according to Figure 4 In this embodiment, the terminal device 200i can continue to perform seamless switching operations when the terminal lens image CMi has an authenticator 900, the network connection is normal, the remaining power BTi is sufficient, and the computing performance CPi is sufficient.

[0056] In one embodiment, if a terminal camera image CMi has an unauthenticated user, the terminal device 200i is prevented from seamlessly switching, and an alert notification is sent.

[0057] In another embodiment, if the target terminal device 200* undergoing seamless handover suddenly experiences a network interruption, step S120 can be repeated to select a new terminal device 200i as the new target terminal device 200*.

[0058] In another embodiment, if the target terminal device 200* undergoing seamless switching suddenly experiences a low battery, step S120 can be repeated to select a new terminal device 200i as the new target terminal device 200*.

[0059] In one embodiment, the face recognition result FRi has the highest importance, followed by network connectivity, remaining battery power BTi, and computing performance CPi. The importance of these factors can be controlled and changed by setting the judgment order or weights.

[0060] Next, please refer to Figure 5 The example illustrates step S130. In step S130, the image mirroring unit 130 superimposes the terminal lens image CMi of the target terminal device 200* onto a screen image SG of the electronic device 100 to obtain a composite image CF.

[0061] The screen image SG of the electronic device 100 is, for example, a video conferencing screen, a medical monitoring screen, a teaching screen, or a music playback screen. The image mirroring unit 130 temporarily stores the screen image SG and the terminal camera image CMi in a custom memory space, and overlays the composite image CF onto the display unit 220i of the target terminal device 200* through network technologies such as WiFi-direct and hotspot.

[0062] In one embodiment, the screen mirroring unit 130 captures the composite mirror screen CF according to a screen update rate of the target terminal device 200*, so as to ensure that it can be stably displayed when mirrored to the target terminal device 200*.

[0063] The following examples illustrate various implementation scenarios.

[0064] In a smart office and seamless work environment, seamless communication and collaboration across multiple devices is possible when working from home. For example, Xiaomei is a designer who works from home, with a smart TV, tablet, and laptop. She needs to attend a video conference and share design drafts with her team, while also taking care of her child.

[0065] First, Xiaomei joined the video conference from her study using her laptop. The system automatically set the laptop's webcam as the source for the video window. She then presented the design drafts to the team and explained them.

[0066] Then, the child suddenly ran into the living room to play. Xiaomei, worried about the child, took her tablet computer with her and went to the living room. The system automatically detected Xiaomei's presence in front of the tablet computer, switched the video window in the video conference to the screen showing Xiaomei captured by the tablet computer, and pushed the conference screen to the tablet computer for display.

[0067] Then, in the living room, the external camera connected to the smart TV captured Xiaomei's image, and the system automatically switched the video window to the view of Xiaomei captured by the external camera on the smart TV. The smart TV also automatically displayed the meeting content in sync. After Xiaomei quieted the child down, she returned to her seat in the study and continued to concentrate on the meeting. The camera on her laptop once again became the main source of the video feed.

[0068] Next, after the meeting, the team asked to review the details of the design draft. Xiaomei displayed the design draft on the smart TV (which displays video footage simultaneously) so that all family members could give feedback and she could quickly make revisions.

[0069] Furthermore, in the context of smart healthcare and remote care, seamless connectivity across devices allows medical staff and patients to monitor and communicate without interruption across different devices. For example, when a patient moves from a ward to an examination room, health monitoring data (heart rate, blood pressure, blood oxygen, etc.) can be automatically switched to the doctor's mobile device, ensuring uninterrupted medical information flow and realizing uninterrupted medical information technology from ward to examination room.

[0070] Alternatively, when doctors or caregivers move from computers to mobile devices, video consultations or patient data can be continuously synchronized without affecting communication and monitoring, enabling a seamless switch in remote care.

[0071] Furthermore, in educational and remote learning contexts, students and teachers can seamlessly switch classroom content across different devices, enhancing the learning experience. For example, teachers can seamlessly switch from laptops to interactive whiteboards or projectors, while students' devices (tablets, laptops) can synchronize content in real time, enabling uninterrupted smart classroom technology.

[0072] Alternatively, students can start reading ebooks on their computers, and when they move to other devices, the content will automatically sync to their ebook reader or mobile phone, ensuring uninterrupted learning and enabling a cross-device learning experience.

[0073] Furthermore, in entertainment scenarios, music or videos can automatically and seamlessly switch to the new device without interruption when the user moves between different spaces. For example, when watching a movie in the living room, if the user moves to the bedroom, the system automatically switches to the bedroom screen or projector and synchronizes the playback progress to achieve smart home theater technology.

[0074] Alternatively, when a user moves from one room to another, the sound system can dynamically shift the audio source based on the user's location, ensuring that music always surrounds the user, thus achieving seamless and continuous whole-house music playback technology.

[0075] The intelligent seamless switching method invented according to the above embodiments can achieve at least the following functions:

[0076] "Cross-device communication": Enables seamless communication between devices within a smart environment.

[0077] "Automatic video feed switching": During video conferences, the feed is automatically switched to the mobile phone (when multiple mobile versions of current video software are logged in simultaneously, the camera feeds from different devices are displayed on the video conference screen together, and it is not possible to only display the camera feed from the location of the person).

[0078] "Smart Home": Automatically transfers mobile phone video feeds to the smart TV in the home environment.

[0079] "AIPC Core": As the core control technology of the intelligent environment, it coordinates the communication and operation between various devices.

[0080] "A convenient lifestyle": Through intelligent technology, we bring users a more convenient and intelligent lifestyle.

[0081] The intelligent seamless switching method disclosed in the above embodiments can achieve many effects: improve user convenience when using different devices, allowing switching devices without interrupting communication; enhance the smoothness and continuity of workflows, improving work efficiency; provide overall intelligent environment coordination and management, improving quality of life and reducing trivial operations in daily life; support seamless switching between devices, and based on an AI-based UserDetection automatic switching mechanism, it can determine the user's device in real time and automatically switch video feeds, avoiding the tediousness of manual operation. Using "detection of an authenticator" as the main trigger condition for dynamic screen switching improves the system's flexibility and real-time performance, enabling more accurate application in multi-device interaction scenarios.

[0082] The above disclosure provides various features for implementing some embodiments or examples of the present invention. Specific examples of components and configurations described above (e.g., mentioned values ​​or names) are provided to simplify / illustrate some embodiments of the invention. Of course, these components and configurations are merely examples and are not intended to be limiting. Furthermore, reference numerals and / or letters may be repeated in various embodiments of the invention. This repetition is for simplicity and clarity and does not in itself indicate a relationship between the various embodiments and / or configurations discussed.

[0083] Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications and improvements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be defined by the claims.

Claims

1. An electronic device with intelligent seamless switching function, comprising: A lens synchronization unit is connected to at least one terminal device, and the lens synchronization unit is used to capture at least one terminal lens image from the at least one terminal device. An artificial intelligence inference unit, connected to the camera synchronization unit, is used to confirm, based at least on a facial recognition result of at least one of the terminal devices, that one of the at least one terminal device is a target terminal device, and that the terminal camera image of the target terminal device has an authenticator; and A screen mirroring unit is connected to the artificial intelligence inference unit. The screen mirroring unit overlays the image of the terminal camera of the target terminal device onto the screen of the electronic device to obtain a composite mirror image. The composite mirror image is transmitted to the target terminal device and displayed on the target terminal device.

2. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The electronic device is a computer, and one of the at least one terminal device is a mobile phone, a tablet computer, or a smart home appliance.

3. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The electronic device establishes a Bluetooth connection with the at least one terminal device.

4. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The electronic device is located in the same network domain as the at least one terminal device.

5. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The image from the at least one terminal lens is captured by a lens of the at least one terminal device.

6. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The at least one terminal device transmits the image from the at least one terminal camera to the electronic device in real time and continuously.

7. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The artificial intelligence inference unit determines that one of the at least one terminal devices is the target terminal device based on the face recognition result of the at least one terminal device, the remaining battery power, and the computing performance.

8. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The screen mirroring unit captures the composite mirrored screen based on the screen update rate of the target terminal device.

9. The electronic device with intelligent seamless switching function as described in claim 1, characterized in that, The screen of the electronic device can display a video conference, a medical monitoring screen, a teaching screen, or a music playback screen.

10. A method for intelligent seamless switching of an electronic device, comprising: Capture images from at least one terminal camera using at least one terminal device; Based on at least one face recognition result of the at least one terminal camera image, it is confirmed that one of the at least one terminal devices is a target terminal device, and the terminal camera image of the target terminal device has an authenticator. The image from the camera of the target terminal device is superimposed on a screen of the electronic device to obtain a composite mirror image. as well as The composite image is transmitted to the target terminal device and displayed on the target terminal device.

11. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, The electronic device is a computer, and one of the at least one terminal device is a mobile phone, a tablet computer, or a smart home appliance.

12. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, In the step of capturing the image from the lens of the at least one terminal device, the electronic device establishes a Bluetooth connection with the at least one terminal device, and the electronic device and the at least one terminal device are located in the same network domain.

13. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, The image from the at least one terminal lens is captured by a lens of the at least one terminal device.

14. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, The at least one terminal device transmits the image from the at least one terminal camera to the electronic device in real time and continuously.

15. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, In the step of confirming that one of the at least one terminal devices is the target terminal device, the at least one terminal device is confirmed to be the target terminal device based on the face recognition result of the at least one terminal device, a remaining battery power and a computing performance.

16. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, In the step of obtaining the composite image, the composite image is captured based on the screen update rate of the target terminal device.

17. The intelligent seamless switching method for electronic devices as described in claim 10, characterized in that, The screen of the electronic device can display a video conference, a medical monitoring screen, a teaching screen, or a music playback screen.

18. A terminal device with intelligent seamless switching function, comprising: A lens for capturing an image from a terminal lens, which is then transmitted to an electronic device. as well as A display unit is used to display a composite mirror image, which is a superposition of the image from the terminal lens and the screen image of the electronic device.

19. The terminal device with intelligent seamless switching function as described in claim 18, characterized in that, The terminal device is a mobile phone, a tablet computer, or a smart home appliance.

Images